WO2023246282A1 - Procédé et appareil de transmission de données audio, dispositif électronique et équipement de lecture audio - Google Patents

Procédé et appareil de transmission de données audio, dispositif électronique et équipement de lecture audio Download PDF

Info

Publication number
WO2023246282A1
WO2023246282A1 PCT/CN2023/090334 CN2023090334W WO2023246282A1 WO 2023246282 A1 WO2023246282 A1 WO 2023246282A1 CN 2023090334 W CN2023090334 W CN 2023090334W WO 2023246282 A1 WO2023246282 A1 WO 2023246282A1
Authority
WO
WIPO (PCT)
Prior art keywords
binary data
encoded packet
data group
packet
binary
Prior art date
Application number
PCT/CN2023/090334
Other languages
English (en)
Chinese (zh)
Inventor
颜廷管
余庆华
杨建新
王泷
Original Assignee
哲库科技(上海)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 哲库科技(上海)有限公司 filed Critical 哲库科技(上海)有限公司
Publication of WO2023246282A1 publication Critical patent/WO2023246282A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233—Processing of audio elementary streams
    • H04N21/2335—Processing of audio elementary streams involving reformatting operations of audio signals, e.g. by converting from one coding standard to another
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Definitions

  • This application relates to the field of data transmission technology, and more specifically, to a method, device, electronic equipment and audio playback equipment for transmitting audio data.
  • the electronic device encodes the pulse code modulation (PCM) audio data and then transmits it to the audio playback device. Since wireless transmission is susceptible to interference, the data received by the playback device may have errors. If data transmission fails, the data needs to be retransmitted.
  • PCM pulse code modulation
  • Data retransmission in related technologies reduces transmission efficiency and is prone to large delays, resulting in a decrease in the user's audio experience and even lags and silence.
  • This application provides a method, device, electronic equipment and audio playback equipment for transmitting audio data. Various aspects involved in the embodiments of this application are introduced below.
  • a first aspect of the present application provides a method for transmitting audio data, including: splitting initial PCM audio data into at least a first binary data group and a second binary data group; The group and the second binary data group perform audio encoding respectively; respectively transmit the first encoding packet corresponding to the first binary data group and the second encoding packet corresponding to the second binary data group through the wireless channel; in response to determining The transmission of the first encoded packet fails, and the first encoded packet is retransmitted, wherein the first binary data group and the second binary data group respectively correspond to the first plurality of binary bits and the second batch of the initial PCM audio data. Batch one or more binary bits.
  • a method for receiving audio data including: receiving a first encoded packet through a wireless channel; in response to determining that the transmission of the first encoded packet fails, receiving a retransmitted first encoded packet; and performing processing on the first encoded packet.
  • audio decoding to obtain a first binary data set; generating PCM audio data based at least in part on the first binary data set; wherein the first binary data set corresponds to a first plurality of initial PCM audio data Binary bits.
  • a device for transmitting audio data including: a processor configured to: split the initial PCM audio data into at least a first binary data group and a second binary data group, and perform the processing on the first binary data group.
  • the binary data group and the second binary data group perform audio encoding respectively; and the transmitter is configured to: respectively transmit the first encoding packet and the second binary data corresponding to the first binary data group through the wireless channel.
  • the second encoded packet corresponding to the group; in response to determining that the transmission of the first encoded packet fails, retransmitting the first encoded packet; wherein the first binary data group corresponds to the first plurality of binary bits of the initial PCM audio data,
  • the second set of binary data corresponds to a second batch of one or more binary bits of the original PCM audio data.
  • a fourth aspect provides a device for receiving audio data, including: a receiver configured to: receive a first encoded packet through a wireless channel; in response to determining that transmission of the first encoded packet fails, receive a retransmitted first encoded packet; A processor configured to: perform audio decoding on the first encoded packet to obtain a first binary data group; generate PCM audio data based at least in part on the first binary data group; wherein, the first binary data group Corresponds to the first multiple bits of the initial PCM audio data.
  • a fifth aspect provides an electronic device, including the device described in the third aspect.
  • a sixth aspect provides an audio playback device, including the device described in the fourth aspect.
  • the embodiment of the present application can retransmit it at a smaller granularity, thereby reducing the amount of retransmitted data, improving transmission efficiency, and reducing transmission delay.
  • Figure 1 is a schematic flow chart of a Bluetooth audio transmission method in related technologies.
  • Figure 2 is a schematic flowchart of a method for transmitting audio data provided by an embodiment of the present application.
  • FIG. 3 is a schematic flowchart of a method for receiving audio data provided by another embodiment of the present application.
  • Figure 4 is an example diagram of splitting initial PCM audio data provided by the embodiment of the present application.
  • FIG. 5 is an example diagram of the encoding method of the first binary data group provided by the embodiment of the present application.
  • FIG. 6 is an example diagram of the encoding method of the second binary data group provided by the embodiment of the present application.
  • FIG. 7 is a schematic flowchart of a Bluetooth audio transmission method provided by an embodiment of the present application.
  • Figure 8 is a schematic structural diagram of a device for transmitting audio data provided by an embodiment of the present application.
  • Figure 9 is a schematic structural diagram of a device for receiving audio data provided by another embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • Figure 11 is a schematic structural diagram of an audio playback device provided by an embodiment of the present application.
  • wireless audio playback devices such as Bluetooth headsets
  • TWS wireless studio
  • TWS headset noise reduction technology using TWS noise reduction headsets in noisy scenes such as subways, buses or airports will provide a better experience than ordinary wired headsets.
  • the audio played by the wireless audio playback device is received through wireless transmission. That is to say, through wireless transmission, the electronic device as the sending end can transmit audio data to the audio playback device as the receiving end.
  • wireless transmission the electronic device as the sending end can transmit audio data to the audio playback device as the receiving end.
  • the electronic device transmits audio data to the audio playback device, and the audio playback device receives the audio data and plays it.
  • Electronic devices are, for example, mobile phones, tablet computers, etc.
  • Audio playback devices are, for example, Bluetooth headsets, Bluetooth speakers, etc.
  • step S110 starts with a lossless music data source.
  • the lossless audio source is, for example, a lossless audio compression coding (free lossless audio codec, FLAC) audio source.
  • the audio sources to be sent by electronic devices can also be lossy audio sources.
  • the lossy audio source is, for example, an MP3 audio source.
  • step S120 PCM decoding is performed on the sound source to obtain PCM audio data.
  • PCM decoding is to decode the audio source data into PCM audio data.
  • Bluetooth audio encoding is performed on the PCM audio data to obtain an encoded packet.
  • the Bluetooth audio codec may be lossless FLAC or Apple lossless audio codec (ALAC).
  • Lossless audio compression encoding audio sources can be collectively referred to as Lossless audio sources.
  • Bluetooth audio coding may be Sub-band coding (SBC) or Advanced Audio Coding (AAC).
  • Electronic devices encode Bluetooth audio in units of the sampling depth of PCM audio.
  • Sampling depth is also called quantization accuracy.
  • the sampling depth of PCM audio can be represented by the number of bits of PCM audio data. For example, when the PCM audio data is 24 bits, one encoding packet contains 24 bits of PCM audio data.
  • step S140 the Bluetooth sending module wirelessly transmits the encoded packet.
  • the sending module is also called the transmitting module.
  • the encoded packet reaches the audio playback device.
  • the Bluetooth receiving module receives the transmitted encoded packet.
  • step S160 the received Bluetooth audio encoded data is PCM decoded to obtain PCM audio data.
  • the number of bits of PCM audio data decoded by the audio playback device is the same as that of the electronic device.
  • step S170 the PCM audio data is converted into analog data through a digital to analog converter (DAC) and amplified through a power amplifier (PA).
  • DAC digital to analog converter
  • PA power amplifier
  • the signal to noise ratio is related to the sampling depth of the PCM audio data.
  • the SNR of an audio file with a 32-bit sampling depth can reach 192dB.
  • the SNR of 24-bit sampling depth can reach 144dB, and the SNR of 16-bit sampling depth can reach 96db.
  • the SNR is 48dB for 8-bit sampling depth and 24dB for 4-bit sampling depth.
  • the SNR specification of a better DAC is generally 110dB.
  • the theoretical SNR of 20-bit sampling depth is 120dB, so 20-bit PCM audio data can reach the SNR specification of the DAC.
  • step S180 the playback unit completes the playback of the analog audio signal.
  • the data received by the audio playback device may have errors. These effects may be interference from different frequency bands, interference from other wireless audio playback devices, or limitations of the radio frequency performance of the electronic device itself. Different frequency bands are, for example, the 2.4G frequency band of Wi-Fi.
  • Non-ideal transmission environments may be scenarios with a lot of interference such as subways and buses, or scenarios where electronic devices are in a mobile state.
  • Audio sources with high bandwidth requirements such as high-quality Lossless music.
  • Lossless music has higher Bluetooth bandwidth requirements than games, lossy music, etc.
  • the dual-channel bandwidth requirement of some lossless music sources reaches 10Mbps, such as 192kHz, 24-bit audio sources. Therefore, the user experience problem of lossless music in non-ideal environments is more obvious.
  • an embodiment of the present application proposes a method for transmitting audio data.
  • This method can be used for electronic
  • the PCM audio data of the device is converted and encoded and transmitted separately based on the converted data group to achieve high-efficiency and low-latency transmission.
  • the method for transmitting audio data provided by the embodiment of the present application will be described in detail below with reference to FIG. 2 and FIG. 3 .
  • FIG. 2 is a schematic flowchart of a method for transmitting audio data provided by an embodiment of the present application.
  • the method of Figure 2 can be performed by the sending end of PCM audio data.
  • the sending end may be, for example, an electronic device, such as a mobile phone, a tablet computer, a notebook, etc.
  • step S210 the initial PCM audio data is converted into a first binary data group and a second binary data group.
  • the initial PCM audio data is PCM decoded audio data. After PCM decoding, several frames of PCM audio data can be obtained. Thus, the initial PCM audio data may be one frame or multiple frames of PCM audio data. In addition, the initial PCM audio data may also be one of several PCM audio data in one frame of data, and one frame is, for example, 10 milliseconds. Thus, the initial PCM audio data may be one of several samples in one frame of audio data.
  • the number of bits of the initial PCM audio data can represent the sampling depth.
  • N-bit initial PCM audio data can represent a sampling depth of N.
  • N can have multiple values, such as 32, 24, 16, etc. The larger N is, the more detailed the recording of sound intensity is.
  • the initial PCM audio data may include N pieces of data from low bits to high bits.
  • N the initial PCM audio data can be 24 binary data arranged from the lowest bit to the highest bit.
  • the initial PCM audio data can be converted to N-bit data based on the principle of memory alignment.
  • the initial PCM audio data can be converted into multiple binary data groups based on the number of bits.
  • the plurality of binary data groups may include a first binary data group and a second binary data group.
  • the conversion of the initial PCM audio data can be split based on the number of bits, or it can be extracted based on the number of bits.
  • the initial PCM audio data is split into multiple binary data groups.
  • the initial PCM audio data is formed as N-bit binary data, which can be split, and the high-M bit data of the N-bit data is used to form the first binary data group.
  • the second binary data group can also be formed with the lower L-bit data among the N-bit data.
  • specific bits or combinations thereof in the initial PCM audio data may be extracted separately to form multiple binary data groups. For example, odd-numbered bits or even-numbered bits in the initial PCM audio data (N-bit binary data) are respectively extracted to form a first binary data group or a second binary data group respectively.
  • the first set of binary data may correspond to a first plurality of binary bits of the initial PCM audio data.
  • the second set of binary data may correspond to a second batch of one or more binary bits of the original PCM audio data.
  • the first binary data group may include consecutively distributed multiple binary bits. In other embodiments, the first binary data group may include a plurality of discretely distributed binary bits in the original PCM audio data. For example, the first binary data group may include odd or even bits in the original PCM audio data.
  • the second binary data group may include one binary bit in the initial PCM audio data, or a plurality of continuously distributed binary bits. In other embodiments, the second binary data group may include a plurality of discretely distributed binary bits in the original PCM audio data. For example, the second binary data group may include even or odd bits in the original PCM audio data.
  • the number of bits corresponding to the first binary data group and the second binary data group may be different.
  • the number of bits in the first binary data set may be greater than the number of bits in the second binary data set.
  • the first binary data group may correspond to the upper 24 bits of the initial PCM audio data
  • the second binary data group may correspond to the lower 8 bits of the initial PCM audio data.
  • the number of bits corresponding to the first binary data group may be smaller than the number of bits corresponding to the second binary data group.
  • the first binary data group may correspond to the upper 24 bits of the initial PCM audio data
  • the second binary data group may correspond to the lower 48 bits of the initial PCM audio data.
  • the number of bits corresponding to the first binary data group and the second binary data group may be the same.
  • the first binary data group may correspond to the upper 16 bits of the initial PCM audio data
  • the second binary data group may correspond to the lower 16 bits of the initial PCM audio data.
  • the first binary data group may correspond to the upper 8 bits of the initial PCM audio data
  • the second binary data group may correspond to the middle 8 bits or lower 8 bits of the initial PCM audio data.
  • the first binary data group may be the high-bit data split from the initial PCM audio data; the second binary data group may be the middle-bit data split from the initial PCM audio data or Low bit data.
  • step S220 perform audio encoding on the first binary data group and the second binary data group respectively to obtain corresponding first encoded packets and second encoded packets.
  • the audio encoding mentioned here can be lossless Bluetooth audio encoding (such as FLAC encoding) or lossy Bluetooth audio encoding (such as SBC, AAC encoding).
  • the first encoded packet and the second encoded packet may be separately encoded in a serial manner. In some embodiments, the first encoded packet and the second encoded packet may be encoded in a parallel manner.
  • the first encoded packet and the second encoded packet may also contain additional information.
  • the additional information may include, for example, identification information and/or verification information.
  • the identification information can be used to identify the position of the encoded packet in the code stream. In other words, the identification information can mark the time sequence of the encoded packets in the code stream. After the audio playback device groups packets based on this identification information, it can ensure that the order of the code streams is correct.
  • the first encoding packet and the second encoding packet mentioned above may contain the same identification information, and the audio playback device can find the encoding packet corresponding to the initial PCM audio data according to the identification information, and assemble the packets.
  • the identification information may be a time sequence code.
  • the time sequence code can time-mark the first encoded packet and the second encoded packet, so that the audio playback device can group the packets in time sequence.
  • the time sequence code may be a long integer variable ranging from 0 to 2 64 -1. When the variable of the time series code increases to 2 64 -1, the next value can be 0.
  • the sender can be identified by the time series value corresponding to each encoded packet. For example, if the time series value 100 is compiled into the time series bit corresponding to the encoding packet at that moment, the time series value corresponding to the next encoding packet will be 101.
  • the verification information can verify the audio data in the encoded packet so that the receiving end can determine the integrity of the encoded packet.
  • the verification information may be a check code. For example, you can perform XOR calculation on the next value starting from the first bit value of the encoded packet, and the obtained calculation result can be used as the check code.
  • step S230 the first encoded packet and the second encoded packet are respectively transmitted through the wireless channel.
  • the sending end can use the Bluetooth module to send the first encoding packet and the second encoding packet.
  • Dividing the initial PCM audio data into multiple binary data groups can be retransmitted at a smaller granularity, thereby reducing the amount of retransmitted data and transmission delay.
  • the method of Figure 2 can also comprise different steps, which are explained further below.
  • the method of FIG. 2 further includes step A: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, retransmitting the second encoded packet. Retransmitting the second encoded packet can ensure lossless transmission.
  • the method of FIG. 2 further includes step B: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, giving up transmitting the second encoded packet. Give up transmitting the second encoded packet, although a certain amount of audio will be lost. frequency data, but can improve transmission efficiency.
  • the method of FIG. 2 further includes step C: in response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet is successful, retransmitting the first encoded packet. Retransmitting the first encoded packet can ensure lossless transmission.
  • the method of FIG. 2 further includes step D: in response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet fails, retransmitting the first encoded packet and giving up transmission of the second encoded packet.
  • step D in response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet fails, retransmitting the first encoded packet and giving up transmission of the second encoded packet.
  • the data amount of the lower 8 bits lost is 2 8 -1, and the total 24-bit data amount is 2 24 -1, the loss rate is 2 8 -1/2 24 -1 ⁇ 1/2 16 . Obviously, this loss rate is very low. At the same time, because only the first encoded packet is retransmitted, the transmission efficiency is improved.
  • steps A, B, C, and D can be executed in parallel or successively in different orders.
  • each step can be executed in combination or divided into multiple sub-steps.
  • steps C and D can be combined into the following two steps that are executed sequentially: in response to determining that the transmission of the first encoded packet fails, retransmitting the first encoded packet; and in response to determining that the transmission of the second encoded packet fails, giving up the transmission The second encoding package.
  • the sending end may determine to perform retransmission or abandonment of the second encoded packet based on the channel status of the wireless channel.
  • the channel status can be determined based on CSI or CQI information. For example, if the channel status is good (eg, the channel quality is greater than or equal to a preset threshold), retransmission of the second encoded packet may be performed. For another example, if the channel status is poor (for example, the channel quality is less than a preset threshold), retransmission of the second encoded packet may be given up.
  • FIG. 3 is a schematic flowchart of a method for transmitting audio data provided by another embodiment of the present application.
  • This method of transmitting audio data may also be called a method of receiving audio data.
  • the method in Figure 3 can be performed by the receiving end of PCM audio data.
  • the receiving end may be, for example, an audio playback device, such as a Bluetooth headset, a Bluetooth speaker, or a car Bluetooth playback device.
  • an audio playback device such as a Bluetooth headset, a Bluetooth speaker, or a car Bluetooth playback device.
  • step S310 a first encoded packet is received through a wireless channel.
  • step S320 perform audio decoding on the first encoded packet to obtain a first binary data group.
  • PCM audio data is generated based at least in part on the first binary data set.
  • the first binary data group may correspond to a first plurality of binary bits of the initial PCM audio data.
  • the PCM audio data generated here based at least in part on the first binary data group may be the same as the aforementioned initial PCM audio data, or may be different. This depends on whether the encoding packet used to generate PCM audio data contains all encoding packets corresponding to the initial PCM audio data.
  • the initial PCM audio data will be converted and encoded into a first encoded packet and a second encoded packet.
  • the transmission of the second coded packet may be given up, so the receiving end may only receive the first coded packet.
  • the receiving end can generate PCM audio data only through the data in the first encoded packet.
  • the generated PCM audio data includes a first binary data group (decoded from the first encoded packet), and the initial PCM audio data includes a first binary data group and a second binary data group. are not the same.
  • the initial PCM audio data will be converted and encoded into the first encoded packet and the second encoded packet, and the sender will not give up the first encoded packet and the second encoded packet when transmitting through the wireless channel, and the receiving end will
  • the second encoded packet may also be received through the wireless channel, and the second encoded packet may be audio decoded to obtain a second binary data group (wherein the second binary data group may correspond to a second portion of the initial PCM audio data). batch of one or more binary bits).
  • the receiving end generates PCM audio data based on the first binary data group (decoded from the first encoded packet) and the second binary data group (decoded from the second encoded packet). Therefore, it is different from the initial PCM audio data is the same.
  • the first coded packet and the second coded packet received by the receiving end may be coded packets obtained after initial transmission, or may be coded packets obtained after retransmission.
  • the receiving end may receive the retransmitted first encoded packet. If it is determined that the transmission of the second encoded packet fails, the receiving end may also receive the retransmitted second encoded packet.
  • the embodiments of the present application do not specifically limit this.
  • the method of receiving audio data may also include the step of the receiving end generating or sending a request to instruct the sending end to retransmit the encoded packet or the receiving end to give up the retransmission opportunity, specifically including the following situations.
  • Case 1 In response to determining that transmission of the first encoded packet fails, a request for retransmission of the first encoded packet is generated.
  • Case 2 In response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, a request for retransmission of the second encoded packet is generated.
  • Case three In response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, a request to give up and retransmit the second encoded packet is generated.
  • Case 4 In response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet fails, a request for retransmission of the first encoded packet and the second encoded packet is generated.
  • Case 5 In response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet fails, a request to retransmit the first encoded packet is generated and a request to retransmit the second encoded packet is given up.
  • the receiving end may also determine to receive the retransmitted second coded packet or to give up the retransmitted second coded packet based on the channel state of the wireless channel.
  • the method is similar to the previous one and will not be described again here.
  • the user can make a selection by touching the adjustment part or button of the headset.
  • the user's choice is usually based on the desire for a lossless audio experience or lower latency.
  • ,none Lossless audio experience may require lossless transmission, that is, retransmission is required when the second encoded packet fails to be transmitted.
  • the consideration of lower delay requires giving up retransmission when the transmission of the second encoded packet fails.
  • the headset of the audio receiving end generates a request to retransmit the second encoded packet or generates a request to give up the retransmission opportunity according to the user's selection.
  • the method of receiving audio data may further include: performing digital-to-analog conversion on the initial PCM audio data to obtain an analog audio signal; and playing the analog audio signal.
  • FIG. 4 is a schematic diagram of splitting the 24-bit initial PCM audio data 410 into a first binary data group of high-order 16 bits and a second binary data group of low-order 8 bits.
  • Bluetooth audio encoding FLAC encoding
  • first binary data group 420 and the second binary data group 430 respectively to obtain the first encoding as shown in Figure 5 packet 500, and the second encoded packet 600 as shown in Figure 6.
  • the first encoding packet 500 includes a high-16 FLAC packet 510 , a time sequence code 520 and a check code 530 .
  • the second encoding packet 600 includes the lower 8-bit FLAC packet 610, the time sequence code 620 and the check code 630.
  • the time sequence code 620 has the same value as the time sequence code 520.
  • the electronic device wirelessly transmits the first encoded packet 500 and the second encoded packet 600 through the sending module. After receiving the first encoded packet 500 and the second encoded packet 600, the audio playback device performs verification. If the verification is successful, the transmission is successful.
  • the audio playback device decompresses the received first encoded packet 500 and the second encoded packet 600 respectively to obtain the first binary data group and the second binary data group.
  • the audio playback device combines the first binary data group and the second binary data group in order of high bits and low bits to form initial PCM audio data.
  • Scenario 1 Both the first encoded packet and the second encoded packet are lost or the transmission fails.
  • case 1 if both the first encoded packet 500 and the second encoded packet 600 are retransmitted, the amount of retransmitted data is the same as the traditional solution (that is, the solution of directly retransmitting 24-bit data).
  • Scenario 3 The first encoded packet is transmitted successfully, but the second encoded packet is lost.
  • the audio transmission method proposed in the embodiment of this application can achieve the purpose of reducing the amount of data transmission and thereby reducing the delay while ensuring the user experience. In harsh transmission environments, latency can be significantly reduced and transmission efficiency improved.
  • the 24-bit initial PCM audio data may be split into three binary data groups of 16-bit+4-bit+4-bit.
  • the first binary data group mentioned above can be a binary data group with the upper 16 bits; the second binary data group can be a binary data group with the middle 4 bits or the lower 4 bits. Group of binary data.
  • three encoding packets can be obtained.
  • the SNR of the decoded PCM audio data has reached 120dB. In other words, the SNR of the decoded PCM audio data is greater than the SNR indicator of the DAC.
  • the embodiments of the present application reduce the number of audio data retransmissions and the amount of audio data retransmissions while ensuring the user experience as much as possible, thereby reducing the bandwidth requirements for audio data transmission. Furthermore, the probability of data errors is reduced, transmission efficiency is improved, and transmission delay is reduced.
  • Figure 7 is a schematic flowchart of a Bluetooth audio transmission method provided by an embodiment of the present application, completely describing the flow of the entire transmission process of the electronic device and the audio playback device.
  • step S730 and step S760 are the same as in Figure 1 and will not be repeated here.
  • step S730 Bluetooth audio split encoding is performed on the initial PCM audio data.
  • splitting and encoding methods you can refer to the method described above to obtain multiple encoding packages.
  • step S760 perform PCM decoding and grouping on multiple encoded packets.
  • the decoding and packaging method aims to obtain the initial PCM audio data of the electronic device.
  • the method of transmitting audio data may be performed by a communication chip on the mobile phone.
  • the method of receiving audio data can be performed by the communication chip on the earphone side.
  • Such communication chips fall within the protection scope of the present invention.
  • FIG. 8 is a schematic structural diagram of a device for transmitting audio data provided by an embodiment of the present application.
  • the device 800 shown in FIG. 8 includes a processor 810 and a transmitter 820.
  • the device 800 can be implemented as a communication chip on a mobile phone, the processor corresponds to the chip's application processor, and the transmitter corresponds to the chip's radio frequency module (and a possible Bluetooth controller).
  • the processor 810 may be configured to convert the initial PCM audio data into a first binary data group and a second binary data group, and perform processing on the first binary data group and the second binary data group respectively. Perform audio encoding to obtain the corresponding first encoding packet and second encoding packet.
  • the transmitter 820 may be configured to transmit the first encoded packet and the second encoded packet respectively through a wireless channel; wherein the first binary data group corresponds to a first plurality of binary data of the initial PCM audio data. bits, the second binary data group corresponding to a second batch of one or more binary bits of the initial PCM audio data.
  • the processor 810 may also be configured to: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, use the transmitter to retransmit the second encoded packet.
  • the processor 810 may also be configured to: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, give up transmitting the second encoded packet.
  • the processor 810 may also be configured to: in response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet is successful, use the transmitter 820 to retransmit the first encoded packet.
  • the processor 810 may also be configured to: in response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet fails, use the transmitter 820 to retransmit the first encoded packet and give up. Transmit the second encoded packet.
  • the processor 810 may also be configured to: determine to perform retransmission or abandonment of the second encoded packet based on the channel state of the wireless channel.
  • the processor 810 is configured to form the first binary data group with high M-bit data among the N-bit data of the initial PCM audio data.
  • the processor 810 is configured to form the second binary data group with lower L-bit data in the N-bit data of the initial PCM audio data.
  • the processor 810 is further configured to: make the first binary data group satisfy one or more of the following conditions: if N is greater than or equal to 24, configure the first binary data group The number of digits is greater than or equal to 16; If N is less than 24, configure the number of bits of the first binary data group to be greater than or equal to 8; and configure the number of bits of the first binary data group to be greater than or equal to the second binary The number of digits in the data group.
  • the processor 810 is further configured to configure corresponding identification information in the first encoding packet and the second encoding packet respectively, where the identification information is used to identify the position of the corresponding encoding packet in the code stream. .
  • FIG. 9 is a schematic structural diagram of a device for receiving audio data provided by another embodiment of the present application.
  • the device 900 shown in FIG. 9 includes a receiver 910 and a processor 920.
  • the device 900 may be implemented as a communication chip on the headset side, the processor corresponds to the processor of the chip, and the receiver corresponds to the radio frequency module (and possibly a Bluetooth controller) of the chip.
  • the receiver 910 is configured to receive the first encoded packet through the wireless channel.
  • the processor 920 is configured to perform audio decoding on the first encoded packet to obtain a first binary data group, and generate PCM audio data based at least in part on the first binary data group.
  • the first binary data group corresponds to the first plurality of binary bits of the initial PCM audio data.
  • the receiver 910 is also configured to receive the second encoded packet through the wireless channel; the processor 920 is further configured to perform audio decoding on the second encoded packet to obtain the second binary data group;
  • the second binary data group corresponds to a second batch of one or more binary bits of the initial PCM audio data.
  • the processor 920 is further configured to generate the PCM audio data based on the first binary data group and the second binary data group.
  • the processor 920 is further configured to generate a request to retransmit the first encoded packet in response to determining that the transmission of the first encoded packet fails.
  • the processor 920 is further configured to: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, generate a request to retransmit the second encoded packet.
  • the processor 920 is further configured to: in response to determining that the transmission of the first encoded packet is successful and the transmission of the second encoded packet fails, generate a request to give up and retransmit the second encoded packet.
  • the processor 920 is further configured to: in response to determining that the transmission of the first encoding packet fails and the transmission of the second encoding packet fails, generate a request to retransmit the first encoding packet and the second encoding packet. package request.
  • the processor 920 is further configured to: in response to determining that the transmission of the first encoded packet fails and the transmission of the second encoded packet fails, generate an expectation to retransmit the first encoded packet and give up retransmitting the Request for second encoded packet.
  • the processor 920 is further configured to determine whether to receive the retransmitted second coded packet or to give up the retransmitted second coded packet based on the channel state of the wireless channel.
  • the processor 920 is further configured to: based on user selection, generate a request to retransmit the second encoded packet or Give up the request to retransmit the second encoded packet.
  • the processor 920 is further configured to configure corresponding identification information in the first encoding packet and the second encoding packet respectively, where the identification information is used to identify the position of the corresponding encoding packet in the code stream. .
  • FIG. 10 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • the electronic device 1000 of FIG. 10 may include the device 800 shown in FIG. 8 .
  • FIG. 11 is a schematic structural diagram of an audio playback device provided by an embodiment of the present application.
  • the audio playback device 1100 of FIG. 11 may include the device 900 shown in FIG. 9 .
  • the audio playback device 1100 further includes: a digital-to-analog converter for performing digital-to-analog conversion on the initial PCM audio data to obtain an analog audio signal; and a player for playing the analog audio signal.
  • a digital-to-analog converter for performing digital-to-analog conversion on the initial PCM audio data to obtain an analog audio signal
  • a player for playing the analog audio signal.
  • the audio playback device is a Bluetooth headset, a Bluetooth speaker, or a car Bluetooth playback device.
  • the processor can be a central processing unit (CPU), and the processor can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits ( application specific integrated circuit (ASIC), off-the-shelf programmable gate array (field programmable gate array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • DSP digital signal processors
  • ASIC application specific integrated circuit
  • FPGA off-the-shelf programmable gate array
  • a general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.
  • the size of the sequence numbers of the above-mentioned processes does not mean the order of execution.
  • the execution order of each process should be determined by its functions and internal logic, and should not be used in the embodiments of the present application.
  • the implementation process constitutes any limitation.
  • the disclosed systems, devices and methods can be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented.
  • the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, indirect coupling or communication connection of devices or units, which may be in electrical, mechanical or other forms.
  • wireless channels may include channels configured on 3G, 4G, 5G, Wi-Fi, Bluetooth, or other forms of wireless Internet, through which audio data can be transmitted. transmission, and achieve the technical effects of each embodiment of this application.
  • the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application can be integrated into one processing unit, or each functional unit can be integrated into one processing unit.
  • the computer program product includes one or more computer instructions.
  • the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device.
  • the computer instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., the computer instructions may be transferred from a website, computer, server, or data center Transmission to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means.
  • the readable storage medium can be any available media that can be read by a computer or a data storage device such as a server, data center, etc. that contains one or more available media integrated.
  • the available media can be magnetic media, (for example, floppy disk, hard disk, tape), optical media (such as digital video disc (DVD)) or semiconductor media (such as solid state disk (SSD)), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

La présente demande concerne un procédé et un appareil de transmission de données audio, un dispositif électronique et un dispositif de lecture audio. Le procédé consiste : à diviser des données audio PCM initiales en au moins un premier ensemble de données binaires et un second ensemble de données binaires ; à effectuer séparément un codage audio sur le premier ensemble de données binaires et le second ensemble de données binaires ; à transmettre séparément un premier paquet codé correspondant au premier ensemble de données binaires et un second paquet codé correspondant au second ensemble de données binaires au moyen d'un canal sans fil ; et en réponse à la détermination de l'échec de la transmission du premier paquet codé, à retransmettre le premier paquet codé ; le premier ensemble de données binaires et le second ensemble de données binaires étant une première pluralité de bits binaires et un second lot d'un ou plusieurs bits binaires correspondant aux données audio PCM initiales, respectivement. Grâce à la conversion de données audio PCM en une pluralité d'ensembles de données binaires, la quantité de données transmises peut être réduite, l'amélioration de l'efficacité de transmission est facilitée, et le retard de transmission est réduit.
PCT/CN2023/090334 2022-06-22 2023-04-24 Procédé et appareil de transmission de données audio, dispositif électronique et équipement de lecture audio WO2023246282A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202210713458.6A CN115278294A (zh) 2022-06-22 2022-06-22 传输音频数据的方法、装置、电子设备及音频播放设备
CN202210713458.6 2022-06-22
CN202211385617.0 2022-11-07
CN202211385617.0A CN117278775A (zh) 2022-06-22 2022-11-07 传输音频数据的方法、装置、电子设备及音频播放设备

Publications (1)

Publication Number Publication Date
WO2023246282A1 true WO2023246282A1 (fr) 2023-12-28

Family

ID=83761218

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/090334 WO2023246282A1 (fr) 2022-06-22 2023-04-24 Procédé et appareil de transmission de données audio, dispositif électronique et équipement de lecture audio

Country Status (2)

Country Link
CN (2) CN115278294A (fr)
WO (1) WO2023246282A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115278294A (zh) * 2022-06-22 2022-11-01 哲库科技(上海)有限公司 传输音频数据的方法、装置、电子设备及音频播放设备
CN115243238A (zh) * 2022-06-30 2022-10-25 哲库科技(上海)有限公司 传输音频数据的装置、方法以及电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070270103A1 (en) * 2006-05-16 2007-11-22 Samsung Electronics Co., Ltd. Method and apparatus for transmitting/receiving uncompressed audio/video data
US20080008173A1 (en) * 2000-04-26 2008-01-10 International Business Machines Corporation Methods and Apparatus for Transmitting Data in a Packet Network
CN102017492A (zh) * 2008-04-21 2011-04-13 高通股份有限公司 用于对传输数据块编码以提高切换性能的方法和装置
CN110970039A (zh) * 2019-11-28 2020-04-07 北京蜜莱坞网络科技有限公司 一种音频传输方法、装置、电子设备和存储介质
CN111787633A (zh) * 2020-08-13 2020-10-16 无锡中感微电子股份有限公司 一种蓝牙低功耗音频数据分组传输方法及装置
CN115278294A (zh) * 2022-06-22 2022-11-01 哲库科技(上海)有限公司 传输音频数据的方法、装置、电子设备及音频播放设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080008173A1 (en) * 2000-04-26 2008-01-10 International Business Machines Corporation Methods and Apparatus for Transmitting Data in a Packet Network
US20070270103A1 (en) * 2006-05-16 2007-11-22 Samsung Electronics Co., Ltd. Method and apparatus for transmitting/receiving uncompressed audio/video data
CN102017492A (zh) * 2008-04-21 2011-04-13 高通股份有限公司 用于对传输数据块编码以提高切换性能的方法和装置
CN110970039A (zh) * 2019-11-28 2020-04-07 北京蜜莱坞网络科技有限公司 一种音频传输方法、装置、电子设备和存储介质
CN111787633A (zh) * 2020-08-13 2020-10-16 无锡中感微电子股份有限公司 一种蓝牙低功耗音频数据分组传输方法及装置
CN115278294A (zh) * 2022-06-22 2022-11-01 哲库科技(上海)有限公司 传输音频数据的方法、装置、电子设备及音频播放设备

Also Published As

Publication number Publication date
CN115278294A (zh) 2022-11-01
CN117278775A (zh) 2023-12-22

Similar Documents

Publication Publication Date Title
WO2023246282A1 (fr) Procédé et appareil de transmission de données audio, dispositif électronique et équipement de lecture audio
US8989884B2 (en) Automatic audio configuration based on an audio output device
US11050971B2 (en) Pulse code modulation (PCM) data-marking
WO2021160040A1 (fr) Procédé de transmission audio et dispositif électronique
WO2024016758A1 (fr) Procédé et appareil de transmission de données audio, puce, dispositif électronique et support de stockage
KR20220123109A (ko) 오디오 인코딩 및 디코딩 방법 및 오디오 인코딩 및 디코딩 장치
WO2024001138A1 (fr) Appareil et procédé de transmission de données audio, et dispositif électronique
US9680507B2 (en) Offset selection for error correction data
WO2024001398A1 (fr) Procédé et appareil de transmission de données audio, et puce, dispositif électronique et support de stockage
US11996107B2 (en) Sound signal receiving and decoding method, sound signal encoding and transmitting method, sound signal decoding method, sound signal encoding method, sound signal receiving side apparatus, sound signal transmitting side apparatus, decoding apparatus, encoding apparatus, program and storage medium
US10727858B2 (en) Error resiliency for entropy coded audio data
US11443753B2 (en) Audio stream dependency information
US9437203B2 (en) Error concealment for speech decoder
JP2012155233A (ja) 情報伝送装置
WO2019243670A1 (fr) Détermination d'un codage de paramètre audio spatial et décodage associé
CN115240692A (zh) 接收音频数据的方法、装置以及音频播放设备
JP2024521195A (ja) 前方誤り訂正と組み合わせたパケット化されたオーディオ・データの無線送受信
WO2024087001A1 (fr) Procédé et appareil de codage bluetooth, procédé et appareil de décodage bluetooth, et dispositif et support
WO2023049628A1 (fr) Codage et/ou décodage efficace de données protégées contre une perte de paquets
TWI538419B (zh) 藍牙無線音訊傳輸器
TWI469135B (zh) 調適性差分脈衝碼調變編碼解碼的方法
Tatlas et al. Perceptually-optimized error concealment for audio over WLANs
US20150127332A1 (en) System and method of improving signal-to-noise ratio

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23825935

Country of ref document: EP

Kind code of ref document: A1