CN115278294A

CN115278294A - Method and device for transmitting audio data, electronic equipment and audio playing equipment

Info

Publication number: CN115278294A
Application number: CN202210713458.6A
Authority: CN
Inventors: 颜廷管; 余庆华; 杨建新; 王泷
Original assignee: Zeku Technology Shanghai Corp Ltd
Current assignee: Zeku Technology Shanghai Corp Ltd
Priority date: 2022-06-22
Filing date: 2022-06-22
Publication date: 2022-11-01
Also published as: WO2023246282A1; CN117278775A

Abstract

A method, a device, an electronic device and an audio playing device for transmitting audio data are provided. The method comprises the following steps: converting the initial PCM audio data into a first binary data group and a second binary data group; respectively carrying out audio coding on the first binary data group and the second binary data group to obtain a corresponding first coded packet and a corresponding second coded packet; and transmitting the first encoded packet and the second encoded packet over a wireless channel, respectively; wherein the first binary data group corresponds to a first plurality of binary bits of the initial PCM audio data and the second binary data group corresponds to a second one or more binary bits of the initial PCM audio data. By converting PCM audio data into a plurality of binary data groups, the amount of retransmission data can be reduced, thereby contributing to improvement of transmission efficiency and reduction of transmission delay.

Description

Method and device for transmitting audio data, electronic equipment and audio playing equipment

Technical Field

The present application relates to the field of data transmission technologies, and in particular, to a method and an apparatus for transmitting audio data, an electronic device, and an audio playing device.

Background

With the popularization of wireless audio playing devices, consumers have higher and higher requirements on the playing quality of the devices. In performing wireless transmission of audio data, the electronic device encodes Pulse Code Modulation (PCM) audio data and then transmits the encoded PCM audio data to an audio playback device. Due to the interference during the wireless transmission process, the data received by the playing device may be erroneous. If the data transmission fails, the data needs to be retransmitted.

The retransmission of data in the related art reduces transmission efficiency, and is liable to occur a large delay, resulting in a reduced user experience with audio and even jamming and silence.

Disclosure of Invention

The application provides a method and a device for transmitting audio data, electronic equipment and audio playing equipment. Various aspects of embodiments of the present application are described below.

In a first aspect, a method for transmitting audio data is provided, including: converting the initial PCM audio data into a first binary data group and a second binary data group; respectively carrying out audio coding on the first binary data group and the second binary data group to obtain a corresponding first coded packet and a corresponding second coded packet; and transmitting the first encoded packet and the second encoded packet over a wireless channel, respectively; wherein the first binary data group corresponds to a first plurality of binary bits of the initial PCM audio data and the second binary data group corresponds to a second one or more binary bits of the initial PCM audio data.

In a second aspect, a method of receiving audio data is provided, comprising: receiving a first encoded packet over a wireless channel; performing audio decoding on the first encoded packet to obtain a first binary data group; generating PCM audio data based at least in part on the first set of binary data; wherein the first binary data group corresponds to a first plurality of binary bits of initial PCM audio data.

In a third aspect, an apparatus for transmitting audio data is provided, including: the processor is used for converting the initial PCM audio data into a first binary data group and a second binary data group, and respectively carrying out audio coding on the first binary data group and the second binary data group to obtain a corresponding first coding packet and a corresponding second coding packet; and a transmitter for transmitting the first encoded packet and the second encoded packet over a wireless channel, respectively; wherein the first binary data group corresponds to a first plurality of binary bits of the initial PCM audio data and the second binary data group corresponds to a second one or more binary bits of the initial PCM audio data.

In a fourth aspect, an apparatus for receiving audio data is provided, comprising: a receiver for receiving a first encoded packet over a wireless channel; a processor for audio decoding the first encoded packet to obtain a first binary data set and generating PCM audio data based at least in part on the first binary data set; wherein the first binary data group corresponds to a first plurality of binary bits of the initial PCM audio data.

In a fifth aspect, an electronic device is provided, which includes the apparatus according to the third aspect.

In a sixth aspect, an audio playing device is provided, which includes the apparatus according to the fourth aspect.

According to the embodiment of the application, the initial PCM audio data is converted into a plurality of binary data groups, so that retransmission can be performed with smaller granularity, and the retransmission data amount can be reduced and the transmission delay can be reduced.

Drawings

Fig. 1 is a flowchart illustrating a bluetooth audio transmission method in the related art.

Fig. 2 is a flowchart illustrating a method for transmitting audio data according to an embodiment of the present application.

Fig. 3 is a flowchart illustrating a method for receiving audio data according to another embodiment of the present application.

Fig. 4 is an exemplary diagram of splitting initial PCM audio data according to an embodiment of the present application.

Fig. 5 is a diagram illustrating an example of a coding manner of a first binary data set according to an embodiment of the present application.

Fig. 6 is a diagram illustrating an example of a coding manner of a second binary data set according to an embodiment of the present application.

Fig. 7 is a flowchart illustrating a bluetooth audio transmission method according to an embodiment of the present application.

Fig. 8 is a schematic structural diagram of an apparatus for transmitting audio data according to an embodiment of the present application.

Fig. 9 is a schematic structural diagram of an apparatus for receiving audio data according to another embodiment of the present application.

Fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Fig. 11 is a schematic structural diagram of an audio playing device according to an embodiment of the present application.

Detailed Description

To facilitate an understanding of the present application, the present application is described in more detail below based on exemplary embodiments and in conjunction with the accompanying drawings. The same or similar reference numbers are used in the drawings to refer to the same or similar modules. It is to be understood that the drawings are diagrammatic and not restrictive, and that the scope of the application is not limited thereto.

With the development of the technology, the application of the wireless audio playing device (such as a bluetooth headset) is wider and wider. Taking true wireless bluetooth headsets (TWS) as an example, it is very common and common for consumers to use TWS in daily life and work. For example, consumers often listen to music, make calls using TWS. As another example, as the delay related performance of TWS improves, it also gradually replaces wired headsets in the gaming field. For another example, with the development of the TWS headset noise reduction technology, in noisy scenes such as subways, buses or airports, the use of the TWS noise reduction headset also has better experience than that of a common wired headset.

Meanwhile, consumers have higher and higher requirements on the playing quality of audio playing devices. For example, many consumers desire to listen to high quality music, even lossless (lossless) music, through wireless audio playback devices.

The audio played by the wireless audio playing device is received through wireless transmission. That is, through wireless transmission, the electronic device can transmit audio data to the audio playing device as a receiving end as a transmitting end. The following describes the wireless transmission process in detail by taking bluetooth wireless transmission as an example, with reference to fig. 1.

As shown in fig. 1, in the wireless transmission process, the electronic device transmits audio data to the audio playing device, and the audio playing device receives the audio data and plays the audio data. The electronic device is, for example, a mobile phone, a tablet computer, or the like. The audio playing device is, for example, a bluetooth headset, a bluetooth sound, etc.

Referring to fig. 1, on the electronic device side, step S110 starts with a lossless music data source. Lossless audio sources are, for example, lossless audio compression coding (FLAC) audio sources. In addition to lossless audio sources, the audio sources to be transmitted by the electronic device may also be lossy audio sources. The lossy source is, for example, an MP3 source.

In step S120, the sound source is PCM decoded to obtain PCM audio data. PCM decoding is decoding of audio source data into PCM audio data.

In step S130, bluetooth audio coding is performed on the PCM audio data to obtain a coded packet. In some embodiments, the bluetooth audio encoding may be lossless FLAC or apple lossless audio compression encoding (ALAC). Sources of Lossless audio compression coding may be collectively referred to as Lossless sources. In other embodiments, the Bluetooth Audio encoding may be Sub-band Coding (SBC) or Advanced Audio Coding (AAC).

The electronic device performs bluetooth audio coding in units of sampling depths of PCM audio. The sampling depth is also referred to as quantization precision. The sampling depth of PCM audio may be represented by the number of bits of PCM audio data. For example, when the PCM audio data is 24 bits, one encoded packet contains 24 bits of PCM audio data.

In step S140, the bluetooth sending module wirelessly transmits the encoded packet. The sending module is also referred to as a transmitting module. Through bluetooth wireless transmission, the coded packet reaches audio playback equipment.

On the audio playback device side, step S150 receives the transmitted encoded packet by the bluetooth receiving module.

In step S160, PCM decoding is performed on the received bluetooth audio encoded data to obtain PCM audio data. The bit number of the PCM audio data decoded by the audio playing device is the same as that of the electronic device.

In step S170, the PCM audio data is converted into analog data by a digital to analog converter (DAC) and amplified by a power Amplifier (AMP).

When the DAC performs digital-to-analog conversion on the PCM audio data, a signal-to-noise ratio (SNR) is related to a sampling depth of the PCM audio data. The larger the sampling depth, the higher the SNR. Theoretically, the SNR of an audio file of 32 bit sample depth can reach 192dB. The SNR of 24 bit sampling depth can reach 144dB, and the SNR of 16 bit sampling depth can reach 96db. The SNR for 8 bit sample depth is 48dB and the SNR for 4 bit sample depth is 24dB.

However, the SNR index for a better DAC is typically 110dB. The theoretical SNR is 120dB at 20 bit sample depth, so 20 bits of PCM audio data can reach the DAC SNR index.

In step S180, the playing of the analog audio signal is completed by the playing unit.

In the above wireless transmission, the data received by the audio playing device may be erroneous due to various factors. These effects may be interference from different frequency bands, interference from other wireless audio playback devices, or limitations on the radio frequency performance of the electronic device itself. The different frequency band is for example the 2.4G band of Wi-Fi.

When data is transmitted incorrectly, the data needs to be retransmitted. Data retransmission can reduce the efficiency of transmission and cause transmission delay. Further, the delay may degrade the user's experience with a lossless audio source, and even cause stutter and silence.

In a non-ideal transmission environment, factors such as environmental radio frequency interference further increase the delay caused by data retransmission. The non-ideal transmission environment may be a scene with more interference, such as a subway, a bus, and the like, and may also be a scene in which the electronic device is in a mobile state.

For audio sources with high bandwidth requirements, the delay caused by retransmission may further reduce the user experience. Bandwidth demanding sound sources such as Lossless music of high quality. Lossless music has a higher bandwidth requirement for bluetooth than games, lossy music, etc. Some lossless song sources have two-channel bandwidth requirements of up to 10Mbps, for example, 192kHz, 24-bit sources. Therefore, the problem of user experience of lossless music in non-ideal environment is more obvious.

In order to solve the above problem, an embodiment of the present application provides a method for transmitting audio data. The method can convert PCM audio data of the electronic equipment and respectively carry out coding transmission based on the converted data groups so as to realize high-efficiency low-delay transmission. The method for transmitting audio data provided by the embodiment of the present application is described in detail below with reference to fig. 2 and 3.

Fig. 2 is a flowchart illustrating a method for transmitting audio data according to an embodiment of the present application. The method of fig. 2 may be performed by a transmitting end of PCM audio data. The sending end may be, for example, an electronic device, such as a mobile phone, a tablet computer, a notebook computer, and the like.

Referring to fig. 2, initial PCM audio data is converted into a first binary data group and a second binary data group at step S210.

The initial PCM audio data is PCM decoded audio data. After PCM decoding, several frames of PCM audio data may be obtained. The initial PCM audio data may be one of several PCM audio data in a frame of data. One frame is, for example, 10 milliseconds.

The number of bits of the initial PCM audio data may represent the sampling depth. For example, N bits of initial PCM audio data may represent a sampling depth of N. N can take a variety of values, such as 32, 24, 16, etc. The larger N represents a finer recording of the sound intensity.

When the number of bits of the initial PCM audio data is represented by N, the initial PCM audio data may include N data from lower bits to upper bits. For example, when N is 24, the initial PCM audio data may be 24 binary data arranged from the least significant bit to the most significant bit.

The initial PCM audio data may be converted for N-bit data based on the principle of memory alignment. The initial PCM audio data may be converted into a plurality of binary data groups based on the number of bits. The plurality of binary data groups may include a first binary data group and a second binary data group.

Converting the initial PCM audio data may be based on splitting the bits, extraction may also be based on the number of bits. In some embodiments, the initial PCM audio data is split into a plurality of binary data groups. For example, the initial PCM audio data is formed as N-bit binary data, which may be split to form a first binary data group with upper M-bit data among the N-bit data. As another example, the second binary data group may also be formed with lower L-bit data of N-bit data. In other embodiments, particular bits or combinations thereof in the initial PCM audio data may be separately extracted to form a plurality of binary data sets. For example, odd or even bits in the initial PCM audio data (N-bit binary data) are extracted to form a first binary data group or a second binary data group, respectively.

The first binary data group may correspond to a first plurality of binary bits of the initial PCM audio data. The second binary data set may correspond to a second batch of one or more binary bits of the initial PCM audio data.

In some embodiments, the first binary data group may comprise a plurality of binary bits in the initial PCM audio data distributed consecutively. In other embodiments, the first binary data set may comprise a plurality of binary bits in the initial PCM audio data distributed discretely. For example, the first binary data group may comprise odd or even bits in the initial PCM audio data.

In some embodiments, the second binary data group may comprise one binary bit, or a plurality of binary bits distributed consecutively, in the initial PCM audio data. In other embodiments, the second binary data set may comprise a plurality of binary bits in discrete distribution in the initial PCM audio data. For example, the second binary data group may comprise even or odd bits in the initial PCM audio data.

In some embodiments, the number of bits corresponding to the first binary data set and the second binary data set may be different.

In some embodiments, the number of bits of the first binary data set may be greater than the number of bits of the second binary data set. For example, for 32-bit initial PCM audio data, the first binary data group may correspond to the upper 24 bits of the initial PCM audio data, and the second binary data group may correspond to the lower 8 bits of the initial PCM audio data.

In some embodiments, the number of bits corresponding to the first binary data set may be less than the number of bits corresponding to the second binary data set. For example, for 64-bit initial PCM audio data, the first binary data group may correspond to the upper 24 bits of the initial PCM audio data, and the second binary data group may correspond to the lower 48 bits of the initial PCM audio data.

In some embodiments, the number of bits corresponding to the first binary data set and the second binary data set may be the same. For example, for 32-bit initial PCM audio data, the first binary data group may correspond to the upper 16 bits of the initial PCM audio data, and the second binary data group may correspond to the lower 16 bits of the initial PCM audio data. As another example, for 32-bit initial PCM audio data, the first binary data group may correspond to the upper 8 bits of the initial PCM audio data, and the second binary data group may correspond to the middle 8 bits or the lower 8 bits of the initial PCM audio data.

Several specific examples of splitting of initial PCM audio data are given below, taking 32-bit and 24-bit initial PCM audio data as examples, respectively. In the following example, the first binary data group may be upper data split from the initial PCM audio data; the second binary data group may be middle data or lower data split in the original PCM audio data.

For 32 bits of initial PCM audio data, there may be several split types: 24 bits +8 bits, 24 bits +4 bits, 16 bits +16 bits, 16 bits +8 bits 16 bits +8 bits +4 bits, 16 bits +4 bits, 8 bits +8 bits, etc.

For 24 bits of initial PCM audio data, there may be several split types: 16 bits +8 bits, 16 bits +4 bits.

In step S220, the first binary data group and the second binary data group are respectively audio-encoded to obtain a corresponding first encoded packet and a corresponding second encoded packet.

The audio coding referred to herein may be lossless bluetooth audio coding (e.g., FLAC coding) or lossy bluetooth audio coding (e.g., SBC, AAC coding).

In some embodiments, the first encoded packet and the second encoded packet may be encoded separately in a serial manner. In some embodiments, the first encoded packet and the second encoded packet may be encoded in a parallel manner.

The first encoded packet and the second encoded packet may contain additional information in addition to the audio data. The additional information may include, for example, identification information and/or verification information.

The identification information may be used to identify the location of the encoded packet in the codestream. That is, the identification information may mark the time sequence of the encoded packet in the code stream. After the audio playing device performs packet packing according to the identification information, the correct sequence of the code stream can be ensured. The aforementioned first encoded packet and the second encoded packet may contain the same identification information, and the audio playing device may find the encoded packet corresponding to the initial PCM audio data according to the identification information and perform the grouping.

In some embodiments, the identification information may be a time series code. The time series code may time stamp the first encoded packet and the second encoded packet for the audio playback device to package in time series. In some embodiments, the time series code may be a 0 to 2⁶⁴-1 long shaped variable. When the variance of the time series code increases to 2⁶⁴At-1, the next value may be 0. The sending end may identify according to the time sequence value corresponding to each encoded packet. For example, the time-series value 100 is coded into the time-series bit of the code packet corresponding to the time, and the next code packetThe corresponding time series value is 101.

The verification information may verify the audio data within the encoded packet so that the receiving end may determine the integrity of the encoded packet. In some embodiments, the verification information may be a check code. For example, the next value may be subjected to xor calculation starting from the bit value of the 1 st bit of the encoded packet, and the obtained calculation result may be used as the check code.

In step S230, the first encoded packet and the second encoded packet are transmitted through the wireless channel, respectively. Taking bluetooth audio data as an example, the sending end may send the first encoded packet and the second encoded packet by using a bluetooth module.

The initial PCM audio data is divided into a plurality of binary data groups, and retransmission can be performed with smaller granularity, so that the amount of retransmission data and transmission delay can be reduced.

In some embodiments of the present invention, different retransmission strategies may be employed, depending on the channel conditions or actual requirements, for each case of success or failure in transmitting the first and/or second encoded packets. For example, for the case where the transmission of the first encoded packet is successful and the transmission of the second encoded packet is failed, the second encoded packet may be retransmitted, or the transmission of the second encoded packet may be aborted. For another example, in the case where both the first and second encoded packets fail to be transmitted, both the first and second encoded packets may be retransmitted, or the transmission of the second encoded packet may be abandoned and only the first encoded packet may be retransmitted. To this end, the method of fig. 2 may also comprise different steps, as further explained below.

In some embodiments, the method of fig. 2 further comprises: the second encoded packet is retransmitted in response to determining that the transmission of the first encoded packet succeeded and the transmission of the second encoded packet failed. The retransmission of the second encoded packet may ensure lossless transmission.

In some embodiments, the method of fig. 2 further comprises: in response to determining that the transmission of the first encoded packet succeeded and the transmission of the second encoded packet failed, forgoing transmission of the second encoded packet. The transmission of the second encoded packet is abandoned, and although certain audio data is lost, the transmission efficiency can be improved.

In some embodiments, the method of fig. 2 further comprises: the first encoded packet is retransmitted in response to determining that the transmission of the first encoded packet failed and the transmission of the second encoded packet succeeded. The retransmission of the first encoded packet may ensure lossless transmission.

In some embodiments, the method of fig. 2 further comprises: in response to determining that the transmission of the first encoded packet failed and the transmission of the second encoded packet failed, retransmitting the first encoded packet and forgoing transmission of the second encoded packet. The transmission of the second encoded packet is abandoned, and although certain audio data is lost, the transmission efficiency can be improved. Taking the example of 24-bit initial PCM audio data being split into a first binary data group of 16 higher bits and a second binary data group of 8 lower bits, in case of retransmitting only the first coded packet (corresponding to the first binary data group) and abandoning the transmission of the second coded packet (corresponding to the second binary data group), the amount of data of the lower 8 bits lost is 2⁸-1, total data size of 24 bits is 2²⁴-1, loss rate of 2⁸-1/2²⁴-1≈1/2¹⁶It is clear that this loss rate is low, while at the same time, the transmission efficiency is improved because only the first coded packet is retransmitted.

In some embodiments, the transmitting end may determine to perform retransmission or discard of the second encoded packet based on a channel status of the wireless channel. The channel state may be determined based on CSI or CQI information. For example, if the channel condition is good (e.g., the channel quality is greater than or equal to a preset threshold), retransmission of the second encoded packet may be performed. As another example, if the channel condition is poor (e.g., the channel quality is less than a predetermined threshold), retransmission of the second encoded packet may be aborted.

Fig. 3 is a flowchart illustrating a method for transmitting audio data according to another embodiment of the present application. The method of transmitting audio data may also be referred to as a method of receiving audio data. The method in fig. 3 may be performed by a receiving end of PCM audio data. The receiving end may be, for example, an audio playing device, such as a bluetooth headset, a bluetooth sound box, or a bluetooth car playing device. It should be understood that the flow shown in fig. 3 has contents corresponding to those of the flow shown in fig. 2, and thus, for the sake of brevity, fig. 3 will not explain in detail the terms that have appeared in fig. 2.

Referring to fig. 3, a first encoded packet is received through a wireless channel at step S310.

In step S320, the first encoded packet is audio-decoded to obtain a first binary data group.

In step S330, PCM audio data is generated based at least in part on the first binary data group.

Wherein the first binary data set may correspond to a first plurality of binary bits of the initial PCM audio data.

It will be appreciated that the PCM audio data generated here based at least partly on the first binary data set may or may not be the same as the initial PCM audio data described hereinbefore. Depending on whether the encoded packets used to generate the PCM audio data contain all encoded packets corresponding to the original PCM audio data.

For example, the initial PCM audio data may be converted and encoded into a first encoded packet and a second encoded packet, and when the transmitting end transmits the first encoded packet and the second encoded packet to the receiving end through a wireless channel, in some cases, transmission may be aborted with respect to the second encoded packet, so that the receiving end may receive only the first encoded packet, and at this time, the receiving end may generate PCM audio data only from data in the first encoded packet. At this time, the generated PCM audio data includes the first binary data group (decoded from the first encoded packet), and the initial PCM audio data includes the first binary data group and the second binary data group, which are not identical.

Alternatively, the initial PCM audio data may be converted and encoded into the first encoded packet and the second encoded packet, and the transmitting end may not discard the first encoded packet and the second encoded packet during transmission through the wireless channel, and the receiving end may further receive the second encoded packet through the wireless channel and perform audio decoding on the second encoded packet to obtain a second binary data set (where the second binary data set may correspond to a second one or more binary bits of the initial PCM audio data). At this time, the receiving end generates PCM audio data based on the first binary data set (decoded from the first encoded packet) and the second binary data set (decoded from the second encoded packet), and thus, it is identical to the original PCM audio data.

It should be noted that, the first encoded packet and the second encoded packet received by the receiving end may be encoded packets obtained after initial transmission or encoded packets obtained after retransmission, which is not specifically limited in this embodiment of the present application. Corresponding to the retransmission described above, the method for receiving audio data may further include a step of the receiving end generating or sending a request to instruct the transmitting end to retransmit the encoded packet or the receiving end to abandon the retransmission opportunity. There are several cases as follows.

Case one (lossless transmission): in response to determining that the transmission of the first encoded packet failed, a request to retransmit the first encoded packet is generated.

Case two (lossless transmission): in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet is failed, a request to retransmit the second encoded packet is generated.

Case three (lossy transmission): in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet is failed, a request to abort retransmitting the second encoded packet is generated.

Case four (lossless transmission): in response to determining that the transmission of the first encoded packet failed and the transmission of the second encoded packet failed, a request to retransmit the first encoded packet and the second encoded packet is generated.

Case five (lossy transmission): in response to determining that the transmission of the first encoded packet failed and the transmission of the second encoded packet failed, a request to retransmit the first encoded packet and forgo retransmitting the second encoded packet is generated.

In addition, it is also possible to determine to receive the retransmitted second encoded packet or to discard the retransmitted second encoded packet at the receiving end based on the channel state of the wireless channel. The method is similar to the above and is not described herein again.

In some embodiments, at the receiving end of the audio (e.g., a bluetooth headset), the user may make a selection by touching the adjustment portion or button of the headset, the user selection is typically a consideration of whether a lossless audio experience is desired or lower latency, which may require a lossless transmission, i.e., a retransmission when the transmission of the second encoded packet fails. Lower latency considerations require that retransmissions be aborted if the transmission of the second encoded packet fails. Accordingly, the headphone of the audio receiving end generates a request for retransmission of the second encoded packet or a request for giving up a retransmission opportunity according to the user selection.

Further, in some embodiments, the method of receiving audio data may further include: performing digital-to-analog conversion on the initial PCM audio data to obtain an analog audio signal; and playing the analog audio signal.

The method for transmitting audio data according to the embodiment of the present application is described above with reference to fig. 2 and fig. 3 from the perspective of the transmitting end and the receiving end, respectively. For the sake of understanding, the following description will be made in more detail and clearly with reference to fig. 4 to 6 by taking 24-bit initial PCM audio data and lossless FLAC coding as an example.

Fig. 4 is a schematic diagram of splitting an initial PCM audio data 410 of 24 bits into a first binary data group of upper 16 bits and a second binary data group of lower 8 bits. After splitting the PCM audio data 410, the first binary data group 420 and the second binary data group 430 may be bluetooth audio encoded (FLAC encoded) to obtain a first encoded packet 500 as shown in fig. 5 and a second encoded packet 600 as shown in fig. 6, respectively.

Referring to fig. 5 and 6, the first encoded packet 500 includes a high 16 FLAC packet 510, a time series code 520, and a check code 530. The second encoded packet 600 includes a lower 8-bit FLAC packet 610, a time series code 620, and a check code 630. The time-series code 620 has the same value as the time-series code 520.

The electronic device wirelessly transmits the first encoded packet 500 and the second encoded packet 600 through the transmission module. After receiving the first encoded packet 500 and the second encoded packet 600, the audio playing device performs verification. If the check is successful, it may indicate that the transmission was successful.

The audio playing device decompresses the received first encoded packet 500 and the second encoded packet 600, respectively, and may obtain a first binary data group and a second binary data group.

The audio playback device combines the first binary data group and the second binary data group together in order of the high order and the low order to form the initial PCM audio data.

If the check fails, it indicates that packet loss or transmission failure occurs in the transmission process. This is discussed in cases below.

The first condition is as follows: the first encoded packet and the second encoded packet are all lost or failed to transmit. For case one, if both the first encoded packet 500 and the second encoded packet 600 are retransmitted, the amount of retransmission data is the same as the conventional scheme (i.e., the scheme of directly retransmitting 24-bit data).

Case two: the first encoded packet is lost and the second encoded packet is successfully transmitted. For this case, the encoded packet 500 is retransmitted. For the second case, the embodiment of the present application only needs to retransmit the first coded packet with 16 bits higher, and assuming that the retransmission is successful, data with 16+8+16=40 bits is transmitted altogether, whereas data with 24+24=48 bits is transmitted altogether in the conventional scheme. That is, the embodiment of the present application transfers 8-bit data less, that is, transfers 8/48=1/6 data less.

And a third situation: the first encoded packet is transmitted successfully and the second encoded packet is lost. For the third case, the embodiment of the present application only needs to retransmit the second encoded packet with lower 8 bits. Assuming that the retransmission is successful, data of 16+ 8=32 bits is transmitted altogether, and data of 24+24=48 bits is transmitted altogether in the conventional scheme. That is, the embodiment of the present application transfers 16-bit data less, that is, transfers 16/48=1/3 data less.

In the experiment of full decibels scale (dBFS) and total harmonic distortion plus noise (THD + N), after the low 8-bit zero clearing is performed on the initial PCM audio data with 24 bits, the lossless audio experience of the user is not obviously reduced. The actual song experience is investigated, and most users cannot distinguish the original song from the song with the low order cleared. Therefore, the audio transmission method provided by the embodiment of the application can achieve the purpose of reducing data transmission amount and further reducing time delay on the premise of ensuring user experience. In a severe transmission environment, time delay can be remarkably reduced, and transmission efficiency is improved.

In some embodiments, the 24-bit initial PCM audio data may be split into three binary data groups of 16 bits +4 bits. In this example, the aforementioned first binary data group may be a high 16-bit binary data group; the second binary data group may be a middle 4-bit binary data group or a lower 4-bit binary data group. By encoding the three binary data groups, respectively, three encoded packets can be obtained. In this example, when the transmission of the encoded packet corresponding to the lower 4-bit binary data group fails, the retransmission may not be performed. Even without retransmission, the SNR of the decoded PCM audio data has reached 120dB. That is, the SNR of the decoded PCM audio data is greater than the SNR index of the DAC.

In summary, the embodiments of the present application reduce the number of times of retransmitting audio data and the transmission amount of retransmitting audio data on the premise of ensuring user experience as much as possible, thereby reducing the bandwidth requirement for transmitting audio data. Furthermore, the data error rate is reduced, the transmission efficiency is improved, and the transmission delay is reduced.

The embodiments of the present application will now be more fully illustrated with reference to specific example FIG. 7. It should be noted that the examples of fig. 2 to 6 are only for assisting the skilled person in understanding the embodiments of the present application, and are not intended to limit the embodiments of the present application to the specific values or specific scenarios illustrated. It will be apparent to those skilled in the art that various equivalent modifications or variations are possible in light of the examples given in figures 2 through 6, and such modifications or variations are intended to be included within the scope of the embodiments of the present application.

Fig. 7 is a flowchart of a bluetooth audio transmission method according to an embodiment of the present application, which completely describes a flow of the electronic device and the audio playback device in the whole transmission process.

Referring to fig. 7, the difference of the transmission method shown in fig. 7 compared to fig. 1 is in step S730 and step S760. Other steps are the same as those in fig. 1, and are not described herein again.

In step S730, bluetooth audio codec is performed on the initial PCM audio data. The splitting and encoding method may refer to the method described above to obtain a plurality of encoded packets.

In step S760, the plurality of encoded packets are PCM decoded into packets. As previously described, the decoding and packaging approach targets the initial PCM audio data of the electronic device.

Method embodiments of the present application are described in detail above in connection with fig. 2-7. In some embodiments of the present invention, the method for transmitting audio data may be performed by a communication chip at the mobile phone end. Accordingly, the method of receiving audio data may be performed by a communication chip of a headset side. Such a communication chip falls within the scope of the present invention.

The device embodiments of the present application are described in detail below with reference to fig. 8 to 11. It is to be understood that the description of the apparatus embodiments corresponds to the description of the method embodiments, and therefore reference may be made to the preceding method embodiments for parts which are not described in detail.

Fig. 8 is a schematic structural diagram of an apparatus for transmitting audio data according to an embodiment of the present application. The apparatus 800 shown in fig. 8 includes a processor 810 and a transmitter 820. In some embodiments, the apparatus 800 may be implemented as a communication chip on a mobile phone end, where the processor corresponds to an application processor of the chip, and the transmitter corresponds to a radio frequency module (and possibly a bluetooth controller) of the chip.

The processor 810 may be configured to convert the initial PCM audio data into a first binary data group and a second binary data group, and perform audio coding on the first binary data group and the second binary data group respectively to obtain a corresponding first coded packet and a corresponding second coded packet.

A transmitter 820 may be configured to transmit the first encoded packet and the second encoded packet over a wireless channel, respectively; wherein the first binary data group corresponds to a first plurality of binary bits of the initial PCM audio data and the second binary data group corresponds to a second one or more binary bits of the initial PCM audio data.

Optionally, the processor 810 is further operable to: retransmitting, with the transmitter, the second encoded packet in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet is failed.

Optionally, the processor 810 is further operable to: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet is failed, forgoing transmission of the second encoded packet.

Optionally, the processor 810 is further operable to: in response to determining that transmission of the first encoded packet failed and transmission of the second encoded packet succeeded, retransmitting, with the transmitter 820, the first encoded packet.

Optionally, the processor 810 is further operable to: in response to determining that transmission of the first encoded packet fails and transmission of the second encoded packet fails, retransmitting the first encoded packet and forgoing transmission of the second encoded packet with the transmitter 820.

Optionally, the processor 810 is further operable to: determining to perform retransmission or discard of the second encoded packet based on a channel state of the wireless channel.

Optionally, the processor 810 is configured to: forming the first binary data group with upper M-bit data of N-bit binary data of the initial PCM audio data.

Optionally, the processor 810 is configured to: the second binary data group is formed with lower L-bit data of N-bit binary data of the initial PCM audio data.

Optionally, the processor 810 is further configured to: causing the first binary data set to satisfy one or more of the following conditions: if N is greater than or equal to 24, configuring the number of bits of the first binary data set to be greater than or equal to 16; if N is less than 24, configuring the number of bits of the first binary data set to be greater than or equal to 8; and configuring the number of bits of the first binary data set to be greater than or equal to the number of bits of the second binary data set.

Optionally, the processor 810 is further configured to: and configuring corresponding identification information in the first coding packet and the second coding packet respectively, wherein the identification information is used for identifying the position of the corresponding coding packet in the code stream.

Fig. 9 is a schematic structural diagram of an apparatus for receiving audio data according to another embodiment of the present application. The apparatus 900 shown in fig. 9 includes a receiver 910 and a processor 920. In some embodiments, the apparatus 900 may be implemented as a communication chip at the earphone end, the processor corresponding to the processor of the chip, and the receiver corresponding to the radio frequency module (and possibly the bluetooth controller) of the chip.

The receiver 910 is configured to receive a first encoded packet over a wireless channel.

Processor 920 is configured to audio decode the first encoded packet to obtain a first binary data group, and generate PCM audio data based at least in part on the first binary data group.

Wherein the first binary data set corresponds to a first plurality of binary bits of the initial PCM audio data.

Optionally, the receiver 910 is further configured to receive a second encoded packet through a wireless channel; processor 920 is further configured to perform audio decoding on the second encoded packet to obtain a second binary data set;

wherein the second binary data group corresponds to a second batch of one or more binary bits of the initial PCM audio data.

Optionally, the processor 920 is further configured to: generating the PCM audio data based on the first binary data group and the second binary data group.

Optionally, the processor 920 is further configured to: in response to determining that transmission of the first encoded packet failed, a request to retransmit the first encoded packet is generated.

Optionally, the processor 920 is further configured to: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet is failed, generating a request to retransmit the second encoded packet.

Optionally, the processor 920 is further configured to: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet is failed, generating a request to forgo retransmission of the second encoded packet.

Optionally, the processor 920 is further configured to: in response to determining that the transmission of the first encoded packet failed and the transmission of the second encoded packet failed, generating a request to retransmit the first encoded packet and the second encoded packet.

Optionally, the processor 920 is further configured to: in response to determining that transmission of the first encoded packet fails and transmission of the second encoded packet fails, a request is generated that a retransmission of the first encoded packet is expected and retransmission of the second encoded packet is aborted.

Optionally, the processor 920 is further configured to: determining to receive the retransmitted second encoded packet or to abort the retransmitted second encoded packet based on a channel status of the wireless channel.

Optionally, the processor 920 is further configured to: based on the user selection, a request to retransmit the second encoded packet is generated or a request to abort retransmitting the second encoded packet is generated.

Optionally, the processor 920 is further configured to: and configuring corresponding identification information in the first coding packet and the second coding packet respectively, wherein the identification information is used for identifying the position of the corresponding coding packet in the code stream.

Fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device 1000 of fig. 10 may include the apparatus 800 shown in fig. 8.

Fig. 11 is a schematic structural diagram of an audio playing device according to an embodiment of the present application. The audio playback device 1100 of fig. 11 may include the apparatus 900 shown in fig. 9.

Optionally, the audio playing device 1100 further comprises: the digital-to-analog converter is used for performing digital-to-analog conversion on the initial PCM audio data to obtain an analog audio signal; and the player is used for playing the analog audio signal.

Optionally, the audio playing device is a bluetooth headset, a bluetooth sound or an automobile bluetooth playing device.

It should be understood that in the embodiments of the present application, the processor may be a Central Processing Unit (CPU), and the processor may also be other general-purpose processors, digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field Programmable Gate Arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not imply any order of execution, and the order of execution of the processes should be determined by their functions and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in, or transmitted from, a computer-readable storage medium to another computer-readable storage medium, e.g., from one website, computer, server, or data center, over a wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL), or wireless (e.g., infrared, wireless, microwave, etc.) network, the computer-readable storage medium may be any available medium that can be read by a computer or a data storage device including one or more integrated servers, data centers, etc. the available medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital Versatile Disk (DVD)), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method of transmitting audio data, comprising:

converting the initial PCM audio data into a first binary data group and a second binary data group;

respectively carrying out audio coding on the first binary data group and the second binary data group to obtain a corresponding first coded packet and a corresponding second coded packet; and

transmitting the first encoded packet and the second encoded packet over a wireless channel, respectively;

wherein the first binary data group corresponds to a first plurality of binary bits of the initial PCM audio data and the second binary data group corresponds to a second one or more binary bits of the initial PCM audio data.

2. The method of claim 1, further comprising:

retransmitting the second encoded packet in response to determining that the transmission of the first encoded packet succeeded and the transmission of the second encoded packet failed.

3. The method of claim 1, further comprising:

in response to determining that the transmission of the first encoded packet succeeded and the transmission of the second encoded packet failed, forgoing transmission of the second encoded packet.

4. The method of claim 1, further comprising:

retransmitting the first encoded packet in response to determining that the transmission of the first encoded packet failed and the transmission of the second encoded packet succeeded.

5. The method of claim 1, further comprising:

in response to determining that the transmission of the first encoded packet failed and the transmission of the second encoded packet failed, retransmitting the first encoded packet and forgoing transmission of the second encoded packet.

6. The method of claim 1, further comprising:

determining to perform retransmission or discard of the second encoded packet based on a channel state of the wireless channel.

7. The method of any of claims 1-6, wherein the initial PCM audio data is N-bit binary data, the upper M-bit data of the N-bit binary data forming the first binary data group.

8. The method of claim 7, wherein lower L-bit data of the N-bit binary data forms the second binary data group.

9. The method of claim 7, wherein the first binary data set satisfies one or more of the following conditions:

if N is greater than or equal to 24, the number of bits of the first binary data set is greater than or equal to 16;

if N is less than 24, the number of bits of the first binary data set is greater than or equal to 8; and

the number of bits of the first binary data set is greater than or equal to the number of bits of the second binary data set.

10. The method of claim 7, wherein the first encoded packet and the second encoded packet each contain identification information, and the identification information is used to identify a position of the corresponding encoded packet in the bitstream.

11. A method of receiving audio data, comprising:

receiving a first encoded packet over a wireless channel;

performing audio decoding on the first encoded packet to obtain a first binary data group;

generating PCM audio data based at least in part on the first set of binary data;

wherein the first binary data group corresponds to a first plurality of binary bits of initial PCM audio data.

12. The method of claim 11, further comprising:

receiving a second encoded packet over the wireless channel;

performing audio decoding on the second encoded packet to obtain a second binary data group;

13. The method of claim 12, wherein generating PCM audio data based at least in part on the first binary data set further comprises:

generating the PCM audio data based on the first binary data group and the second binary data group.

14. The method of claim 12, further comprising:

in response to determining that the transmission of the first encoded packet succeeded and the transmission of the second encoded packet failed, generating a request to retransmit the second encoded packet.

15. The method of claim 12, further comprising:

in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet is failed, generating a request to forgo retransmission of the second encoded packet.

16. The method of claim 12, further comprising:

in response to determining that the transmission of the first encoded packet failed and the transmission of the second encoded packet failed, generating a request to retransmit the first encoded packet and the second encoded packet.

17. The method of claim 12, further comprising:

in response to determining that transmission of the first encoded packet fails and transmission of the second encoded packet fails, a request to retransmit the first encoded packet and to abort retransmission of the second encoded packet is generated.

18. The method of claim 12, further comprising:

generating a request to retransmit the second encoded packet or forgoing the request to retransmit the second encoded packet based on a channel state of the wireless channel.

19. The method of claim 12, further comprising:

based on the user selection, a request to request retransmission of the second encoded packet is generated or a request to forgo retransmission of the second encoded packet is generated.

20. The method of claim 12, wherein the first encoded packet and the second encoded packet each contain identification information, and the identification information is used to identify a position of the corresponding encoded packet in the bitstream.

21. An apparatus for transmitting audio data, comprising:

the processor is used for converting the initial PCM audio data into a first binary data group and a second binary data group, and respectively carrying out audio coding on the first binary data group and the second binary data group to obtain a corresponding first coding packet and a corresponding second coding packet; and

a transmitter for transmitting the first encoded packet and the second encoded packet over a wireless channel, respectively;

22. The apparatus of claim 21, wherein the processor is further configured to:

retransmitting, with the transmitter, the second encoded packet in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet is failed.

23. The apparatus of claim 21, wherein the processor is further configured to:

in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet is failed, forgoing transmission of the second encoded packet.

24. The apparatus of claim 21, wherein the processor is further configured to:

retransmitting, with the transmitter, the first encoded packet in response to determining that transmission of the first encoded packet failed and transmission of the second encoded packet succeeded.

25. The apparatus of claim 21, wherein the processor is further configured to:

in response to determining that transmission of the first encoded packet failed and transmission of the second encoded packet failed, retransmitting, with the transmitter, the first encoded packet and forgoing transmission of the second encoded packet.

26. The apparatus of claim 21, wherein the processor is further configured to:

27. The apparatus according to any one of claims 21-26, wherein the processor is configured to:

forming the first binary data group with upper M-bit data of N-bit binary data of the initial PCM audio data.

28. The apparatus of claim 27, wherein the processor is configured to:

the second binary data group is formed with lower L-bit data of N-bit binary data of the initial PCM audio data.

29. The apparatus of claim 27, wherein the processor is further configured to:

causing the first binary data set to satisfy one or more of the following conditions:

if N is greater than or equal to 24, configuring the number of bits of the first binary data set to be greater than or equal to 16;

if N is less than 24, configuring the number of bits of the first binary data set to be greater than or equal to 8; and

configuring the number of bits of the first binary data set to be greater than or equal to the number of bits of the second binary data set.

30. The apparatus of claim 27, wherein the processor is further configured to:

and respectively configuring corresponding identification information in the first encoding packet and the second encoding packet, wherein the identification information is used for identifying the position of the corresponding encoding packet in the code stream.

31. An apparatus for receiving audio data, comprising:

a receiver for receiving a first encoded packet over a wireless channel;

a processor for audio decoding the first encoded packet to obtain a first binary data set and generating PCM audio data based at least in part on the first binary data set;

wherein the first binary data group corresponds to a first plurality of binary bits of the initial PCM audio data.

32. The apparatus of claim 31,

the receiver is further configured to receive a second encoded packet over the wireless channel;

the processor is further configured to perform audio decoding on the second encoded packet to obtain a second binary data set;

33. The apparatus of claim 32, wherein the processor is further configured to:

34. The apparatus of claim 32, wherein the processor is further configured to:

in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet is failed, generating a request to retransmit the second encoded packet.

35. The apparatus of claim 32, wherein the processor is further configured to:

36. The apparatus of claim 32, wherein the processor is further configured to:

37. The apparatus of claim 32, wherein the processor is further configured to:

38. The apparatus of claim 32, wherein the processor is further configured to:

39. The apparatus of claim 32, wherein the processor is further configured to:

based on the user selection, a request to retransmit the second encoded packet is generated or a request to abort retransmitting the second encoded packet is generated.

40. A chip, characterized in that the chip is configured to perform the method of any of claims 1-10.

41. A chip, characterized in that the chip is configured to perform the method of any of claims 11-20.

42. An electronic device, comprising the apparatus of any of claims 21-30.

43. An audio playback device, characterized in that it comprises an apparatus as claimed in any one of claims 31 to 39.

44. The audio playback device of claim 43, further comprising:

the digital-to-analog converter is used for performing digital-to-analog conversion on the initial PCM audio data to obtain an analog audio signal;

and the player is used for playing the analog audio signal.

45. The audio playback device of claim 43 or 44, wherein the audio playback device is a Bluetooth headset, a Bluetooth speaker, or a Bluetooth car playback device.