WO2023246282A1

WO2023246282A1 - Audio data transmission method and apparatus, electronic device, and audio playback equipment

Info

Publication number: WO2023246282A1
Application number: PCT/CN2023/090334
Authority: WO
Inventors: 颜廷管; 余庆华; 杨建新; 王泷
Original assignee: 哲库科技(上海)有限公司
Priority date: 2022-06-22
Filing date: 2023-04-24
Publication date: 2023-12-28
Also published as: CN117278775A; CN115278294A

Abstract

The present application provides an audio data transmission method and apparatus, an electronic device, and an audio playback device. The method comprises: splitting initial PCM audio data into at least a first binary data set and a second binary data set; separately performing audio encoding on the first binary data set and the second binary data set; separately transmitting a first encoded packet corresponding to the first binary data set and a second encoded packet corresponding to the second binary data set by means of a wireless channel; and in response to determining that the transmission of the first encoded packet has failed, retransmitting the first encoded packet; wherein the first binary data set and the second binary data set are a first plurality of binary bits and a second batch of one or more binary bits corresponding to the initial PCM audio data, respectively. By means of converting PCM audio data into a plurality of binary data sets, the amount of transmitted data can be reduced, the improvement of transmission efficiency is facilitated, and transmission delay is reduced.

Description

Methods, devices, electronic equipment and audio playback equipment for transmitting audio data

This application requests the priority of the Chinese patent application submitted to the China Patent Office on June 22, 2022, with the application number 202210713458.6 and the application name "Method, device, electronic equipment and audio playback equipment for transmitting audio data", and in 2022 The priority of the Chinese patent application filed with the China Patent Office on November 7, 2020, with the application number 202211385617.0 and the application title "Method, device, electronic equipment and audio playback equipment for transmitting audio data", the entire content of which is incorporated herein by reference. Applying.

Technical field

This application relates to the field of data transmission technology, and more specifically, to a method, device, electronic equipment and audio playback equipment for transmitting audio data.

Background technique

With the popularity of wireless audio playback devices, consumers have increasingly higher requirements for device playback quality. When wirelessly transmitting audio data, the electronic device encodes the pulse code modulation (PCM) audio data and then transmits it to the audio playback device. Since wireless transmission is susceptible to interference, the data received by the playback device may have errors. If data transmission fails, the data needs to be retransmitted.

Data retransmission in related technologies reduces transmission efficiency and is prone to large delays, resulting in a decrease in the user's audio experience and even lags and silence.

Contents of the invention

This application provides a method, device, electronic equipment and audio playback equipment for transmitting audio data. Various aspects involved in the embodiments of this application are introduced below.

A first aspect of the present application provides a method for transmitting audio data, including: splitting initial PCM audio data into at least a first binary data group and a second binary data group; The group and the second binary data group perform audio encoding respectively; respectively transmit the first encoding packet corresponding to the first binary data group and the second encoding packet corresponding to the second binary data group through the wireless channel; in response to determining The transmission of the first encoded packet fails, and the first encoded packet is retransmitted, wherein the first binary data group and the second binary data group respectively correspond to the first plurality of binary bits and the second batch of the initial PCM audio data. Batch one or more binary bits.

In a second aspect, a method for receiving audio data is provided, including: receiving a first encoded packet through a wireless channel; in response to determining that the transmission of the first encoded packet fails, receiving a retransmitted first encoded packet; and performing processing on the first encoded packet. audio decoding to obtain a first binary data set; generating PCM audio data based at least in part on the first binary data set; wherein the first binary data set corresponds to a first plurality of initial PCM audio data Binary bits.

In a third aspect, a device for transmitting audio data is provided, including: a processor configured to: split the initial PCM audio data into at least a first binary data group and a second binary data group, and perform the processing on the first binary data group. The binary data group and the second binary data group perform audio encoding respectively; and the transmitter is configured to: respectively transmit the first encoding packet and the second binary data corresponding to the first binary data group through the wireless channel. The second encoded packet corresponding to the group; in response to determining that the transmission of the first encoded packet fails, retransmitting the first encoded packet; wherein the first binary data group corresponds to the first plurality of binary bits of the initial PCM audio data, The second set of binary data corresponds to a second batch of one or more binary bits of the original PCM audio data.

A fourth aspect provides a device for receiving audio data, including: a receiver configured to: receive a first encoded packet through a wireless channel; in response to determining that transmission of the first encoded packet fails, receive a retransmitted first encoded packet; A processor configured to: perform audio decoding on the first encoded packet to obtain a first binary data group; generate PCM audio data based at least in part on the first binary data group; wherein, the first binary data group Corresponds to the first multiple bits of the initial PCM audio data.

A fifth aspect provides an electronic device, including the device described in the third aspect.

A sixth aspect provides an audio playback device, including the device described in the fourth aspect.

By converting the initial PCM audio data into multiple binary data groups, the embodiment of the present application can retransmit it at a smaller granularity, thereby reducing the amount of retransmitted data, improving transmission efficiency, and reducing transmission delay.

Description of the drawings

Figure 1 is a schematic flow chart of a Bluetooth audio transmission method in related technologies.

Figure 2 is a schematic flowchart of a method for transmitting audio data provided by an embodiment of the present application.

FIG. 3 is a schematic flowchart of a method for receiving audio data provided by another embodiment of the present application.

Figure 4 is an example diagram of splitting initial PCM audio data provided by the embodiment of the present application.

FIG. 5 is an example diagram of the encoding method of the first binary data group provided by the embodiment of the present application.

FIG. 6 is an example diagram of the encoding method of the second binary data group provided by the embodiment of the present application.

Figure 7 is a schematic flowchart of a Bluetooth audio transmission method provided by an embodiment of the present application.

Figure 8 is a schematic structural diagram of a device for transmitting audio data provided by an embodiment of the present application.

Figure 9 is a schematic structural diagram of a device for receiving audio data provided by another embodiment of the present application.

FIG. 10 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Figure 11 is a schematic structural diagram of an audio playback device provided by an embodiment of the present application.

Detailed ways

In order to facilitate understanding of the present application, the present application is described in more detail below based on exemplary embodiments and in conjunction with the accompanying drawings. The same or similar reference numbers are used in the drawings to identify the same or similar modules. It should be understood that the accompanying drawings are only schematic, and the protection scope of the present application is not limited thereto.

With the development of technology, wireless audio playback devices (such as Bluetooth headsets) are increasingly used. Take true wireless Bluetooth headsets (true wireless studio, TWS) as an example. In daily life and work, it has become very popular and common for consumers to use TWS. For example, consumers often use TWS to listen to music and make phone calls. For another example, as the delay-related performance of TWS improves, it has gradually replaced wired headsets in the gaming field. For another example, with the development of TWS headset noise reduction technology, using TWS noise reduction headsets in noisy scenes such as subways, buses or airports will provide a better experience than ordinary wired headsets.

At the same time, consumers have increasingly higher requirements for the playback quality of audio playback equipment. For example, many consumers hope to listen to high-quality music, even lossless music, through wireless audio playback devices.

The audio played by the wireless audio playback device is received through wireless transmission. That is to say, through wireless transmission, the electronic device as the sending end can transmit audio data to the audio playback device as the receiving end. The following is a detailed description of the wireless transmission process in conjunction with Figure 1, taking Bluetooth wireless transmission as an example.

As shown in Figure 1, during the wireless transmission process, the electronic device transmits audio data to the audio playback device, and the audio playback device receives the audio data and plays it. Electronic devices are, for example, mobile phones, tablet computers, etc. Audio playback devices are, for example, Bluetooth headsets, Bluetooth speakers, etc.

Referring to Figure 1, on the electronic device side, step S110 starts with a lossless music data source. The lossless audio source is, for example, a lossless audio compression coding (free lossless audio codec, FLAC) audio source. In addition to lossless audio sources, the audio sources to be sent by electronic devices can also be lossy audio sources. The lossy audio source is, for example, an MP3 audio source.

In step S120, PCM decoding is performed on the sound source to obtain PCM audio data. PCM decoding is to decode the audio source data into PCM audio data.

In step S130, Bluetooth audio encoding is performed on the PCM audio data to obtain an encoded packet. In some embodiments, the Bluetooth audio codec may be lossless FLAC or Apple lossless audio codec (ALAC). Lossless audio compression encoding audio sources can be collectively referred to as Lossless audio sources. In other embodiments, Bluetooth audio coding may be Sub-band coding (SBC) or Advanced Audio Coding (AAC).

Electronic devices encode Bluetooth audio in units of the sampling depth of PCM audio. Sampling depth is also called quantization accuracy. The sampling depth of PCM audio can be represented by the number of bits of PCM audio data. For example, when the PCM audio data is 24 bits, one encoding packet contains 24 bits of PCM audio data.

In step S140, the Bluetooth sending module wirelessly transmits the encoded packet. The sending module is also called the transmitting module. Through Bluetooth wireless transmission, the encoded packet reaches the audio playback device.

On the side of the audio playback device, in step S150, the Bluetooth receiving module receives the transmitted encoded packet.

In step S160, the received Bluetooth audio encoded data is PCM decoded to obtain PCM audio data. The number of bits of PCM audio data decoded by the audio playback device is the same as that of the electronic device.

In step S170, the PCM audio data is converted into analog data through a digital to analog converter (DAC) and amplified through a power amplifier (PA).

When the DAC performs digital-to-analog conversion of PCM audio data, the signal to noise ratio (SNR) is related to the sampling depth of the PCM audio data. The greater the sampling depth, the higher the SNR. In theory, the SNR of an audio file with a 32-bit sampling depth can reach 192dB. The SNR of 24-bit sampling depth can reach 144dB, and the SNR of 16-bit sampling depth can reach 96db. The SNR is 48dB for 8-bit sampling depth and 24dB for 4-bit sampling depth.

However, the SNR specification of a better DAC is generally 110dB. The theoretical SNR of 20-bit sampling depth is 120dB, so 20-bit PCM audio data can reach the SNR specification of the DAC.

In step S180, the playback unit completes the playback of the analog audio signal.

When performing the above wireless transmission, due to the influence of various factors, the data received by the audio playback device may have errors. These effects may be interference from different frequency bands, interference from other wireless audio playback devices, or limitations of the radio frequency performance of the electronic device itself. Different frequency bands are, for example, the 2.4G frequency band of Wi-Fi.

When there is an error in data transmission, the data needs to be retransmitted. Data retransmission will reduce the efficiency of transmission and cause transmission delays. Furthermore, delay will reduce the user's experience of lossless audio sources, and may even cause stuttering and silence.

In non-ideal transmission environments, factors such as environmental radio frequency interference will further increase delays caused by data retransmission. Non-ideal transmission environments may be scenarios with a lot of interference such as subways and buses, or scenarios where electronic devices are in a mobile state.

For audio sources with high bandwidth requirements, the delay caused by retransmission will further reduce the user experience. Audio sources with high bandwidth requirements such as high-quality Lossless music. Lossless music has higher Bluetooth bandwidth requirements than games, lossy music, etc. The dual-channel bandwidth requirement of some lossless music sources reaches 10Mbps, such as 192kHz, 24-bit audio sources. Therefore, the user experience problem of lossless music in non-ideal environments is more obvious.

In order to solve the above problem, an embodiment of the present application proposes a method for transmitting audio data. This method can be used for electronic The PCM audio data of the device is converted and encoded and transmitted separately based on the converted data group to achieve high-efficiency and low-latency transmission. The method for transmitting audio data provided by the embodiment of the present application will be described in detail below with reference to FIG. 2 and FIG. 3 .

FIG. 2 is a schematic flowchart of a method for transmitting audio data provided by an embodiment of the present application. The method of Figure 2 can be performed by the sending end of PCM audio data. The sending end may be, for example, an electronic device, such as a mobile phone, a tablet computer, a notebook, etc.

Referring to FIG. 2, in step S210, the initial PCM audio data is converted into a first binary data group and a second binary data group.

The initial PCM audio data is PCM decoded audio data. After PCM decoding, several frames of PCM audio data can be obtained. Thus, the initial PCM audio data may be one frame or multiple frames of PCM audio data. In addition, the initial PCM audio data may also be one of several PCM audio data in one frame of data, and one frame is, for example, 10 milliseconds. Thus, the initial PCM audio data may be one of several samples in one frame of audio data.

The number of bits of the initial PCM audio data can represent the sampling depth. For example, N-bit initial PCM audio data can represent a sampling depth of N. N can have multiple values, such as 32, 24, 16, etc. The larger N is, the more detailed the recording of sound intensity is.

When the number of bits of the initial PCM audio data is represented by N, the initial PCM audio data may include N pieces of data from low bits to high bits. For example, when N is 24, the initial PCM audio data can be 24 binary data arranged from the lowest bit to the highest bit.

The initial PCM audio data can be converted to N-bit data based on the principle of memory alignment. The initial PCM audio data can be converted into multiple binary data groups based on the number of bits. The plurality of binary data groups may include a first binary data group and a second binary data group.

The conversion of the initial PCM audio data can be split based on the number of bits, or it can be extracted based on the number of bits. In some embodiments, the initial PCM audio data is split into multiple binary data groups. For example, the initial PCM audio data is formed as N-bit binary data, which can be split, and the high-M bit data of the N-bit data is used to form the first binary data group. For another example, the second binary data group can also be formed with the lower L-bit data among the N-bit data. In other embodiments, specific bits or combinations thereof in the initial PCM audio data may be extracted separately to form multiple binary data groups. For example, odd-numbered bits or even-numbered bits in the initial PCM audio data (N-bit binary data) are respectively extracted to form a first binary data group or a second binary data group respectively.

The first set of binary data may correspond to a first plurality of binary bits of the initial PCM audio data. The second set of binary data may correspond to a second batch of one or more binary bits of the original PCM audio data.

In some embodiments, the first binary data group may include consecutively distributed multiple binary bits. In other embodiments, the first binary data group may include a plurality of discretely distributed binary bits in the original PCM audio data. For example, the first binary data group may include odd or even bits in the original PCM audio data.

In some embodiments, the second binary data group may include one binary bit in the initial PCM audio data, or a plurality of continuously distributed binary bits. In other embodiments, the second binary data group may include a plurality of discretely distributed binary bits in the original PCM audio data. For example, the second binary data group may include even or odd bits in the original PCM audio data.

In some embodiments, the number of bits corresponding to the first binary data group and the second binary data group may be different.

In some embodiments, the number of bits in the first binary data set may be greater than the number of bits in the second binary data set. For example, for 32-bit initial PCM audio data, the first binary data group may correspond to the upper 24 bits of the initial PCM audio data, and the second binary data group may correspond to the lower 8 bits of the initial PCM audio data.

In some embodiments, the number of bits corresponding to the first binary data group may be smaller than the number of bits corresponding to the second binary data group. For example, for 64-bit initial PCM audio data, the first binary data group may correspond to the upper 24 bits of the initial PCM audio data, and the second binary data group may correspond to the lower 48 bits of the initial PCM audio data.

In some embodiments, the number of bits corresponding to the first binary data group and the second binary data group may be the same. For example, for 32-bit initial PCM audio data, the first binary data group may correspond to the upper 16 bits of the initial PCM audio data, and the second binary data group may correspond to the lower 16 bits of the initial PCM audio data. For another example, for 32-bit initial PCM audio data, the first binary data group may correspond to the upper 8 bits of the initial PCM audio data, and the second binary data group may correspond to the middle 8 bits or lower 8 bits of the initial PCM audio data. .

The following takes 32-bit and 24-bit initial PCM audio data as examples to give several specific splitting examples of the initial PCM audio data. In the following example, the first binary data group may be the high-bit data split from the initial PCM audio data; the second binary data group may be the middle-bit data split from the initial PCM audio data or Low bit data.

For 32-bit initial PCM audio data, there are several splitting types: 24-bit+8-bit, 24-bit+4-bit+4-bit, 16-bit+16-bit, 16-bit+8-bit+8-bit, 16-bit +8 digits + 4 digits + 4 digits, 16 digits + 4 digits + 4 digits + 4 digits + 4 digits, 8 digits + 8 digits + 8 digits, etc.

For 24-bit initial PCM audio data, there are several splitting types: 16-bit + 8-bit, 16-bit + 4-bit + 4-bit.

In step S220, perform audio encoding on the first binary data group and the second binary data group respectively to obtain corresponding first encoded packets and second encoded packets.

The audio encoding mentioned here can be lossless Bluetooth audio encoding (such as FLAC encoding) or lossy Bluetooth audio encoding (such as SBC, AAC encoding).

In some embodiments, the first encoded packet and the second encoded packet may be separately encoded in a serial manner. In some embodiments, the first encoded packet and the second encoded packet may be encoded in a parallel manner.

In addition to audio data, the first encoded packet and the second encoded packet may also contain additional information. The additional information may include, for example, identification information and/or verification information.

The identification information can be used to identify the position of the encoded packet in the code stream. In other words, the identification information can mark the time sequence of the encoded packets in the code stream. After the audio playback device groups packets based on this identification information, it can ensure that the order of the code streams is correct. The first encoding packet and the second encoding packet mentioned above may contain the same identification information, and the audio playback device can find the encoding packet corresponding to the initial PCM audio data according to the identification information, and assemble the packets.

In some embodiments, the identification information may be a time sequence code. The time sequence code can time-mark the first encoded packet and the second encoded packet, so that the audio playback device can group the packets in time sequence. In some embodiments, the time sequence code may be a long integer variable ranging from 0 to 2 ⁶⁴ -1. When the variable of the time series code increases to 2 ⁶⁴ -1, the next value can be 0. The sender can be identified by the time series value corresponding to each encoded packet. For example, if the time series value 100 is compiled into the time series bit corresponding to the encoding packet at that moment, the time series value corresponding to the next encoding packet will be 101.

The verification information can verify the audio data in the encoded packet so that the receiving end can determine the integrity of the encoded packet. In some embodiments, the verification information may be a check code. For example, you can perform XOR calculation on the next value starting from the first bit value of the encoded packet, and the obtained calculation result can be used as the check code.

In step S230, the first encoded packet and the second encoded packet are respectively transmitted through the wireless channel. Taking Bluetooth audio data as an example, the sending end can use the Bluetooth module to send the first encoding packet and the second encoding packet.

Dividing the initial PCM audio data into multiple binary data groups can be retransmitted at a smaller granularity, thereby reducing the amount of retransmitted data and transmission delay.

In some embodiments of the present invention, for various situations of success or failure in transmitting the first and/or second encoded packets, different retransmission strategies may be adopted depending on the channel status or actual requirements. For example, if the first coded packet is successfully transmitted but the second coded packet fails to be transmitted, the second coded packet may be retransmitted, or the transmission of the second coded packet may be given up. For another example, when both the first and second coded packets fail to be transmitted, the first and second coded packets may be retransmitted, or the transmission of the second coded packet may be given up and only the first coded packet may be retransmitted. To this end, the method of Figure 2 can also comprise different steps, which are explained further below.

In some embodiments, the method of FIG. 2 further includes step A: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, retransmitting the second encoded packet. Retransmitting the second encoded packet can ensure lossless transmission.

In some embodiments, the method of FIG. 2 further includes step B: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, giving up transmitting the second encoded packet. Give up transmitting the second encoded packet, although a certain amount of audio will be lost. frequency data, but can improve transmission efficiency.

In some embodiments, the method of FIG. 2 further includes step C: in response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet is successful, retransmitting the first encoded packet. Retransmitting the first encoded packet can ensure lossless transmission.

In some embodiments, the method of FIG. 2 further includes step D: in response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet fails, retransmitting the first encoded packet and giving up transmission of the second encoded packet. Although a certain amount of audio data will be lost by giving up the transmission of the second encoding packet, the transmission efficiency can be improved. Taking the 24-bit initial PCM audio data as an example, it is split into a first binary data group of high 16 bits and a second binary data group of low 8 bits. When retransmitting the first encoded packet (corresponding to the first binary data group) binary data group) and gives up transmitting the second encoded packet (corresponding to the second binary data group), the data amount of the lower 8 bits lost is 2 ⁸ -1, and the total 24-bit data amount is 2 ²⁴ -1, the loss rate is 2 ⁸ -1/2 ²⁴ -1≈1/2 ¹⁶ . Obviously, this loss rate is very low. At the same time, because only the first encoded packet is retransmitted, the transmission efficiency is improved.

It should be understood that the above-mentioned steps A, B, C, and D can be executed in parallel or successively in different orders. In addition, each step can be executed in combination or divided into multiple sub-steps. For example, steps C and D can be combined into the following two steps that are executed sequentially: in response to determining that the transmission of the first encoded packet fails, retransmitting the first encoded packet; and in response to determining that the transmission of the second encoded packet fails, giving up the transmission The second encoding package.

In some embodiments, the sending end may determine to perform retransmission or abandonment of the second encoded packet based on the channel status of the wireless channel. The channel status can be determined based on CSI or CQI information. For example, if the channel status is good (eg, the channel quality is greater than or equal to a preset threshold), retransmission of the second encoded packet may be performed. For another example, if the channel status is poor (for example, the channel quality is less than a preset threshold), retransmission of the second encoded packet may be given up.

FIG. 3 is a schematic flowchart of a method for transmitting audio data provided by another embodiment of the present application. This method of transmitting audio data may also be called a method of receiving audio data. The method in Figure 3 can be performed by the receiving end of PCM audio data. The receiving end may be, for example, an audio playback device, such as a Bluetooth headset, a Bluetooth speaker, or a car Bluetooth playback device. It should be understood that the process shown in FIG. 3 has content that corresponds to the process shown in FIG. 2 . Therefore, for the sake of simplicity, FIG. 3 no longer explains in detail the terms that have appeared in FIG. 2 .

Referring to Figure 3, in step S310, a first encoded packet is received through a wireless channel.

In step S320, perform audio decoding on the first encoded packet to obtain a first binary data group.

At step S330, PCM audio data is generated based at least in part on the first binary data set.

Wherein, the first binary data group may correspond to a first plurality of binary bits of the initial PCM audio data.

It can be understood that the PCM audio data generated here based at least in part on the first binary data group may be the same as the aforementioned initial PCM audio data, or may be different. This depends on whether the encoding packet used to generate PCM audio data contains all encoding packets corresponding to the initial PCM audio data.

For example, the initial PCM audio data will be converted and encoded into a first encoded packet and a second encoded packet. When transmitting the first coded packet and the second coded packet to the receiving end through the wireless channel, in some cases, the transmission of the second coded packet may be given up, so the receiving end may only receive the first coded packet. This At this time, the receiving end can generate PCM audio data only through the data in the first encoded packet. At this time, the generated PCM audio data includes a first binary data group (decoded from the first encoded packet), and the initial PCM audio data includes a first binary data group and a second binary data group. are not the same.

Alternatively, the initial PCM audio data will be converted and encoded into the first encoded packet and the second encoded packet, and the sender will not give up the first encoded packet and the second encoded packet when transmitting through the wireless channel, and the receiving end will The second encoded packet may also be received through the wireless channel, and the second encoded packet may be audio decoded to obtain a second binary data group (wherein the second binary data group may correspond to a second portion of the initial PCM audio data). batch of one or more binary bits). At this time, the receiving end generates PCM audio data based on the first binary data group (decoded from the first encoded packet) and the second binary data group (decoded from the second encoded packet). Therefore, it is different from the initial PCM audio data is the same.

It should be noted that the first coded packet and the second coded packet received by the receiving end may be coded packets obtained after initial transmission, or may be coded packets obtained after retransmission. In other words, if it is determined that the transmission of the first encoded packet fails, the receiving end may receive the retransmitted first encoded packet. If it is determined that the transmission of the second encoded packet fails, the receiving end may also receive the retransmitted second encoded packet. The embodiments of the present application do not specifically limit this. Corresponding to the retransmission mentioned above, the method of receiving audio data may also include the step of the receiving end generating or sending a request to instruct the sending end to retransmit the encoded packet or the receiving end to give up the retransmission opportunity, specifically including the following situations.

Case 1 (lossless transmission): In response to determining that transmission of the first encoded packet fails, a request for retransmission of the first encoded packet is generated.

Case 2 (lossless transmission): In response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, a request for retransmission of the second encoded packet is generated.

Case three (lossy transmission): In response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, a request to give up and retransmit the second encoded packet is generated.

Case 4 (lossless transmission): In response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet fails, a request for retransmission of the first encoded packet and the second encoded packet is generated.

Case 5 (lossy transmission): In response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet fails, a request to retransmit the first encoded packet is generated and a request to retransmit the second encoded packet is given up.

In addition, the receiving end may also determine to receive the retransmitted second coded packet or to give up the retransmitted second coded packet based on the channel state of the wireless channel. The method is similar to the previous one and will not be described again here.

In some embodiments, at the receiving end of the audio (such as a Bluetooth headset), the user can make a selection by touching the adjustment part or button of the headset. The user's choice is usually based on the desire for a lossless audio experience or lower latency. ,none Lossless audio experience may require lossless transmission, that is, retransmission is required when the second encoded packet fails to be transmitted. The consideration of lower delay requires giving up retransmission when the transmission of the second encoded packet fails. Correspondingly, the headset of the audio receiving end generates a request to retransmit the second encoded packet or generates a request to give up the retransmission opportunity according to the user's selection.

Further, in some embodiments, the method of receiving audio data may further include: performing digital-to-analog conversion on the initial PCM audio data to obtain an analog audio signal; and playing the analog audio signal.

The above describes the method of transmitting audio data provided by embodiments of the present application from the perspectives of the sending end and the receiving end in conjunction with Figure 2 and Figure 3 respectively. For ease of understanding, the following takes 24-bit initial PCM audio data and lossless FLAC encoding as an example to describe the embodiments of the present application in more detail and clearly with reference to Figures 4 to 6 .

FIG. 4 is a schematic diagram of splitting the 24-bit initial PCM audio data 410 into a first binary data group of high-order 16 bits and a second binary data group of low-order 8 bits. After splitting the PCM audio data 410, Bluetooth audio encoding (FLAC encoding) can be performed on the first binary data group 420 and the second binary data group 430 respectively to obtain the first encoding as shown in Figure 5 packet 500, and the second encoded packet 600 as shown in Figure 6.

Referring to FIGS. 5 and 6 , the first encoding packet 500 includes a high-16 FLAC packet 510 , a time sequence code 520 and a check code 530 . The second encoding packet 600 includes the lower 8-bit FLAC packet 610, the time sequence code 620 and the check code 630. The time sequence code 620 has the same value as the time sequence code 520.

The electronic device wirelessly transmits the first encoded packet 500 and the second encoded packet 600 through the sending module. After receiving the first encoded packet 500 and the second encoded packet 600, the audio playback device performs verification. If the verification is successful, the transmission is successful.

The audio playback device decompresses the received first encoded packet 500 and the second encoded packet 600 respectively to obtain the first binary data group and the second binary data group.

The audio playback device combines the first binary data group and the second binary data group in order of high bits and low bits to form initial PCM audio data.

If the verification fails, it means that packet loss or transmission failure occurred during the transmission process. The following is discussed case by case.

Scenario 1: Both the first encoded packet and the second encoded packet are lost or the transmission fails. Regarding case 1, if both the first encoded packet 500 and the second encoded packet 600 are retransmitted, the amount of retransmitted data is the same as the traditional solution (that is, the solution of directly retransmitting 24-bit data).

Scenario 2: The first encoded packet is lost, but the second encoded packet is transmitted successfully. In this case, the encoded packet 500 is retransmitted. Regarding the second situation, the embodiment of this application only needs to retransmit the first coded packet with the upper 16 bits. Assuming that the retransmission is successful, a total of 16+8+16=40 bits of data will be transmitted, while the traditional solution will transmit a total of 24+24=48 bits of data. That is to say, the embodiment of the present application transmits 8 fewer bits of data, that is, 8/48 = 1/6 less data amount is transmitted.

Scenario 3: The first encoded packet is transmitted successfully, but the second encoded packet is lost. For situation three, the embodiment of this application only requires Retransmit the lower 8 bits of the second encoded packet. Assuming that the retransmission is successful, a total of 16+8+8=32 bits of data are transmitted, while the traditional solution transmits a total of 24+24=48 bits of data. That is to say, the embodiment of the present application transmits less 16-bit data, that is, less data amount of 16/48=1/3 is transmitted.

In the experiments of full decibel scale (dBFS) and total harmonic distortion plus noise (THD+N), the 24-bit initial PCM audio data was cleared after the lower 8 bits were cleared. , the user’s lossless audio experience has not been significantly degraded. According to a survey on real song experience, most users cannot distinguish between original songs and songs with low bits cleared. Therefore, the audio transmission method proposed in the embodiment of this application can achieve the purpose of reducing the amount of data transmission and thereby reducing the delay while ensuring the user experience. In harsh transmission environments, latency can be significantly reduced and transmission efficiency improved.

In some embodiments, the 24-bit initial PCM audio data may be split into three binary data groups of 16-bit+4-bit+4-bit. In this example, the first binary data group mentioned above can be a binary data group with the upper 16 bits; the second binary data group can be a binary data group with the middle 4 bits or the lower 4 bits. Group of binary data. By encoding the three binary data groups respectively, three encoding packets can be obtained. In this example, when the encoding packet corresponding to the lower 4-bit binary data group fails to be transmitted, retransmission does not need to be performed. Even without retransmission, the SNR of the decoded PCM audio data has reached 120dB. In other words, the SNR of the decoded PCM audio data is greater than the SNR indicator of the DAC.

To sum up, the embodiments of the present application reduce the number of audio data retransmissions and the amount of audio data retransmissions while ensuring the user experience as much as possible, thereby reducing the bandwidth requirements for audio data transmission. Furthermore, the probability of data errors is reduced, transmission efficiency is improved, and transmission delay is reduced.

Below, a more complete illustration of the embodiment of the present application will be given with reference to the specific example in FIG. 7 . It should be noted that the examples in Figures 2 to 6 are only to help those skilled in the art understand the embodiments of the present application, and are not intended to limit the embodiments of the present application to the specific numerical values or specific scenarios illustrated. Those skilled in the art can obviously make various equivalent modifications or changes based on the examples given in FIGS. 2 to 6 , and such modifications or changes also fall within the scope of the embodiments of the present application.

Figure 7 is a schematic flowchart of a Bluetooth audio transmission method provided by an embodiment of the present application, completely describing the flow of the entire transmission process of the electronic device and the audio playback device.

Referring to Figure 7, compared with Figure 1, the difference in the transmission method shown in Figure 7 is step S730 and step S760. Other steps are the same as in Figure 1 and will not be repeated here.

In step S730, Bluetooth audio split encoding is performed on the initial PCM audio data. For splitting and encoding methods, you can refer to the method described above to obtain multiple encoding packages.

In step S760, perform PCM decoding and grouping on multiple encoded packets. As mentioned above, the decoding and packaging method aims to obtain the initial PCM audio data of the electronic device.

The method embodiments of the present application are described in detail above with reference to Figures 2 to 7. In some embodiments of the present invention, the method of transmitting audio data may be performed by a communication chip on the mobile phone. Correspondingly, the method of receiving audio data can be performed by the communication chip on the earphone side. Such communication chips fall within the protection scope of the present invention.

The device embodiments of the present application will be described in detail below with reference to FIGS. 8 to 11 . It should be understood that the description of the device embodiments corresponds to the description of the method embodiments. Therefore, the parts not described in detail can be referred to the previous method embodiments.

Figure 8 is a schematic structural diagram of a device for transmitting audio data provided by an embodiment of the present application. The device 800 shown in FIG. 8 includes a processor 810 and a transmitter 820. In some embodiments, the device 800 can be implemented as a communication chip on a mobile phone, the processor corresponds to the chip's application processor, and the transmitter corresponds to the chip's radio frequency module (and a possible Bluetooth controller).

The processor 810 may be configured to convert the initial PCM audio data into a first binary data group and a second binary data group, and perform processing on the first binary data group and the second binary data group respectively. Perform audio encoding to obtain the corresponding first encoding packet and second encoding packet.

The transmitter 820 may be configured to transmit the first encoded packet and the second encoded packet respectively through a wireless channel; wherein the first binary data group corresponds to a first plurality of binary data of the initial PCM audio data. bits, the second binary data group corresponding to a second batch of one or more binary bits of the initial PCM audio data.

Optionally, the processor 810 may also be configured to: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, use the transmitter to retransmit the second encoded packet.

Optionally, the processor 810 may also be configured to: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, give up transmitting the second encoded packet.

Optionally, the processor 810 may also be configured to: in response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet is successful, use the transmitter 820 to retransmit the first encoded packet.

Optionally, the processor 810 may also be configured to: in response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet fails, use the transmitter 820 to retransmit the first encoded packet and give up. Transmit the second encoded packet.

Optionally, the processor 810 may also be configured to: determine to perform retransmission or abandonment of the second encoded packet based on the channel state of the wireless channel.

Optionally, the processor 810 is configured to form the first binary data group with high M-bit data among the N-bit data of the initial PCM audio data.

Optionally, the processor 810 is configured to form the second binary data group with lower L-bit data in the N-bit data of the initial PCM audio data.

Optionally, the processor 810 is further configured to: make the first binary data group satisfy one or more of the following conditions: if N is greater than or equal to 24, configure the first binary data group The number of digits is greater than or equal to 16; If N is less than 24, configure the number of bits of the first binary data group to be greater than or equal to 8; and configure the number of bits of the first binary data group to be greater than or equal to the second binary The number of digits in the data group.

Optionally, the processor 810 is further configured to configure corresponding identification information in the first encoding packet and the second encoding packet respectively, where the identification information is used to identify the position of the corresponding encoding packet in the code stream. .

Figure 9 is a schematic structural diagram of a device for receiving audio data provided by another embodiment of the present application. The device 900 shown in FIG. 9 includes a receiver 910 and a processor 920. In some embodiments, the device 900 may be implemented as a communication chip on the headset side, the processor corresponds to the processor of the chip, and the receiver corresponds to the radio frequency module (and possibly a Bluetooth controller) of the chip.

The receiver 910 is configured to receive the first encoded packet through the wireless channel.

The processor 920 is configured to perform audio decoding on the first encoded packet to obtain a first binary data group, and generate PCM audio data based at least in part on the first binary data group.

Wherein, the first binary data group corresponds to the first plurality of binary bits of the initial PCM audio data.

Optionally, the receiver 910 is also configured to receive the second encoded packet through the wireless channel; the processor 920 is further configured to perform audio decoding on the second encoded packet to obtain the second binary data group;

Wherein, the second binary data group corresponds to a second batch of one or more binary bits of the initial PCM audio data.

Optionally, the processor 920 is further configured to generate the PCM audio data based on the first binary data group and the second binary data group.

Optionally, the processor 920 is further configured to generate a request to retransmit the first encoded packet in response to determining that the transmission of the first encoded packet fails.

Optionally, the processor 920 is further configured to: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, generate a request to retransmit the second encoded packet.

Optionally, the processor 920 is further configured to: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, generate a request to give up and retransmit the second encoded packet.

Optionally, the processor 920 is further configured to: in response to determining that the transmission of the first encoding packet fails and the transmission of the second encoding packet fails, generate a request to retransmit the first encoding packet and the second encoding packet. package request.

Optionally, the processor 920 is further configured to: in response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet fails, generate an expectation to retransmit the first encoded packet and give up retransmitting the Request for second encoded packet.

Optionally, the processor 920 is further configured to determine whether to receive the retransmitted second coded packet or to give up the retransmitted second coded packet based on the channel state of the wireless channel.

Optionally, the processor 920 is further configured to: based on user selection, generate a request to retransmit the second encoded packet or Give up the request to retransmit the second encoded packet.

Optionally, the processor 920 is further configured to configure corresponding identification information in the first encoding packet and the second encoding packet respectively, where the identification information is used to identify the position of the corresponding encoding packet in the code stream. .

Figure 10 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. The electronic device 1000 of FIG. 10 may include the device 800 shown in FIG. 8 .

Figure 11 is a schematic structural diagram of an audio playback device provided by an embodiment of the present application. The audio playback device 1100 of FIG. 11 may include the device 900 shown in FIG. 9 .

Optionally, the audio playback device 1100 further includes: a digital-to-analog converter for performing digital-to-analog conversion on the initial PCM audio data to obtain an analog audio signal; and a player for playing the analog audio signal.

Optionally, the audio playback device is a Bluetooth headset, a Bluetooth speaker, or a car Bluetooth playback device.

It should be understood that in the embodiments of the present application, the processor can be a central processing unit (CPU), and the processor can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits ( application specific integrated circuit (ASIC), off-the-shelf programmable gate array (field programmable gate array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

It should be understood that in the various embodiments of the present application, the size of the sequence numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its functions and internal logic, and should not be used in the embodiments of the present application. The implementation process constitutes any limitation.

In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, indirect coupling or communication connection of devices or units, which may be in electrical, mechanical or other forms.

The above provides multiple embodiments taking Bluetooth wireless transmission as an example. However, it should be understood that in various embodiments of the present application, wireless channels may include channels configured on 3G, 4G, 5G, Wi-Fi, Bluetooth, or other forms of wireless Internet, through which audio data can be transmitted. transmission, and achieve the technical effects of each embodiment of this application.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, or each functional unit can be integrated into one processing unit. Each unit physically exists alone, or two or more units can be integrated into one unit.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., the computer instructions may be transferred from a website, computer, server, or data center Transmission to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means. The computer The readable storage medium can be any available media that can be read by a computer or a data storage device such as a server, data center, etc. that contains one or more available media integrated. The available media can be magnetic media, (for example, floppy disk, hard disk, tape), optical media (such as digital video disc (DVD)) or semiconductor media (such as solid state disk (SSD)), etc.

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application. should be covered by the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims

A method of transmitting audio data, characterized by including:

Split the initial PCM audio data into at least a first binary data group and a second binary data group;

Perform audio encoding on the first binary data group and the second binary data group respectively; and

respectively transmit the first coded packet corresponding to the first binary data group and the second coded packet corresponding to the second binary data group through a wireless channel;

In response to determining that transmission of the first encoded packet fails, retransmitting the first encoded packet;

Wherein, the first binary data group and the second binary data group respectively correspond to a first plurality of binary bits and a second batch of one or more binary bits of the initial PCM audio data.
The method of claim 1, further comprising:

In response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, the second encoded packet is retransmitted.
The method of claim 1, further comprising:

In response to determining that transmission of the first encoded packet is successful but transmission of the second encoded packet fails, transmission of the second encoded packet is abandoned.
The method according to claim 1, characterized in that the initial PCM audio data is N-bit binary data, and the upper M-bit data in the N-bit binary data forms the first binary data group, and the The lower L-bit data in the N-bit binary data forms the second binary data group.
The method according to claim 4, characterized in that the N-bit binary data consists of the high-M bit data and the low L-bit data.
The method according to claim 4, characterized in that the number of bits M of the high M-bit data is not less than the number of bits L of the low L-bit data.
The method according to any one of claims 4-6, characterized in that the first binary data group satisfies one of the following conditions:

If N is greater than or equal to 24, then the number of bits in the first binary data group is greater than or equal to 16;

If N is less than 24, the number of bits in the first binary data group is greater than or equal to 8.
The method according to claim 1, further comprising:

In the event that the transmission of the first encoded packet fails, in response to determining that the transmission of the second encoded packet fails, the transmission of the second encoded packet is given up.
The method according to claim 1, further comprising:

It is determined to perform retransmission or abandonment of the second encoded packet based on the channel status of the wireless channel.
The method according to any one of claims 1 to 9, characterized in that the first encoding packet and the second encoding packet respectively contain identification information, and the identification information is used to identify the corresponding encoding packet in the code. position in the stream.
A method for receiving audio data, characterized by including:

Receive the first encoded packet through the wireless channel;

In response to determining that transmission of the first encoded packet fails, receiving a retransmission of the first encoded packet;

Perform audio decoding on the first encoded packet to obtain a first binary data group;

Generate PCM audio data based at least in part on the first set of binary data;

Wherein, the first binary data group corresponds to the first plurality of binary bits of the initial PCM audio data.
The method according to claim 11, further comprising:

Receive the second encoded packet through the wireless channel;

In response to determining that transmission of the second encoded packet fails, receiving a retransmission of the second encoded packet;

Perform audio decoding on the second encoded packet to obtain a second binary data group;

Wherein, the second binary data group corresponds to a second batch of one or more binary bits of the initial PCM audio data.
The method according to claim 12, characterized in that the initial PCM audio data is N-bit binary data, the first binary data group corresponds to the upper M-bit data of the N-bit binary data, and the The second binary data group corresponds to the lower L-bit data of the N-bit binary data.
The method of claim 12, wherein generating PCM audio data based at least in part on the first binary data set further comprises:

The PCM audio data is generated based on the first binary data set and the second binary data set.
The method according to claim 11, further comprising:

Receive the second encoded packet through the wireless channel;

Based on the channel state of the wireless channel, a request to retransmit the second encoded packet is generated or the request to retransmit the second encoded packet is abandoned.
The method according to claim 11, further comprising:

Receive the second encoded packet through the wireless channel;

Based on user selection, a request to retransmit the second encoded packet is generated or the request to retransmit the second encoded packet is discarded.
The method according to claim 12, characterized in that the first encoding packet and the second encoding packet respectively contain identification information, and the identification information is used to identify the first encoding packet and the second encoding packet. The position of the packet in the code stream.
A device for transmitting audio data, characterized by including:

Processor, configured as:

Split the initial PCM audio data into at least a first binary data group and a second binary data group, and perform audio encoding on the first binary data group and the second binary data group respectively. ;as well as

Transmitter, configured to:

respectively transmit the first coded packet corresponding to the first binary data group and the second coded packet corresponding to the second binary data group through a wireless channel;

In response to determining that transmission of the first encoded packet fails, retransmitting the first encoded packet;

Wherein, the first binary data group corresponds to a first batch of multiple binary bits of the initial PCM audio data, and the second binary data group corresponds to a second batch of one of the initial PCM audio data. or multiple binary bits.
The device of claim 18, wherein the processor is further configured to:

In response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, the second encoded packet is retransmitted.
The device of claim 18, wherein the processor is further configured to:

In response to determining that transmission of the first encoded packet is successful but transmission of the second encoded packet fails, transmission of the second encoded packet is abandoned.
The device of claim 18, wherein the processor is configured to:

Forming the first binary data group with high-M bit data in the N-bit binary data of the initial PCM audio data;

The second binary data group is formed with lower L-bit data in the N-bit binary data of the initial PCM audio data.
The device according to claim 21, wherein the number of bits M of the high M-bit data is not less than the number of bits L of the low L-bit data.
The device of claim 21, wherein the processor is further configured to:

Make the first binary data group satisfy one of the following conditions:

If N is greater than or equal to 24, configure the number of digits of the first binary data group to be greater than or equal to 16;

If N is less than 24, the number of bits in the first binary data group is configured to be greater than or equal to 8.
The device of claim 18, wherein the processor is further configured to:

Based on the channel status of the wireless channel, it is determined to retransmit or to give up transmission of the second encoded packet.
The device of claim 18, wherein the processor is further configured to:

Corresponding identification information is configured in the first encoding packet and the second encoding packet respectively, and the identification information is used to Identifies the position of the corresponding encoding packet in the code stream.
A device for receiving audio data, characterized by including:

Receiver, configured as:

Receive the first encoded packet through the wireless channel;

In response to determining that transmission of the first encoded packet fails, receiving a retransmission of the first encoded packet;

Processor, configured as:

Perform audio decoding on the first encoded packet to obtain a first binary data group;

Generate PCM audio data based at least in part on the first set of binary data;

Wherein, the first binary data group corresponds to the first plurality of binary bits of the initial PCM audio data.
The device according to claim 26, characterized in that:

The receiver is also configured to:

Receive the second encoded packet through the wireless channel;

In response to determining that transmission of the second encoded packet fails, receiving a retransmission of the second encoded packet;

The processor is also configured to:

Perform audio decoding on the second encoded packet to obtain a second binary data group;

Wherein, the second binary data group corresponds to a second batch of one or more binary bits of the initial PCM audio data.
The device of claim 27, wherein the processor is further configured to:

Generate the PCM audio data based on the first binary data group and the second binary data group;

Wherein, the initial PCM audio data is N-bit binary data, the first binary data group corresponds to the upper M-bit data of the N-bit binary data, and the second binary data group corresponds to the The lower L bit data of N-bit binary data.
The apparatus of claim 26, wherein the receiver is further configured to receive a second encoded packet through the wireless channel, and the processor is further configured to:

Based on the channel state of the wireless channel, a request to retransmit the second encoded packet is generated or the request to retransmit the second encoded packet is abandoned.
The apparatus of claim 26, wherein the receiver is further configured to receive a second encoded packet through the wireless channel, and the processor is further configured to:

Based on user selection, a request to retransmit the second encoded packet is generated or the request to retransmit the second encoded packet is discarded.
A chip, characterized in that the chip is configured to perform the method according to any one of claims 1-10 Law.
A chip, characterized in that the chip is configured to perform the method according to any one of claims 11-17.
An electronic device, characterized by comprising the device according to any one of claims 18-25.
An audio playback device, characterized by comprising the device according to any one of claims 26-30.
The audio playback device according to claim 34, further comprising:

Digital-to-analog converter, used for digital-to-analog conversion of PCM audio data to obtain analog audio signals;

A player for playing the analog audio signal.
The audio playback device according to claim 34 or 35, characterized in that the audio playback device is a Bluetooth headset, a Bluetooth speaker or a car Bluetooth playback device.