WO2022218165A1

WO2022218165A1 - Method and apparatus for receiving audio data packet, method and apparatus for sending audio data packet, and electronic device

Info

Publication number: WO2022218165A1
Application number: PCT/CN2022/084598
Authority: WO
Inventors: 许超杰
Original assignee: Oppo广东移动通信有限公司
Priority date: 2021-04-13
Filing date: 2022-03-31
Publication date: 2022-10-20
Also published as: CN113131972A; CN113131972B

Abstract

Disclosed in the embodiments of the present application are a method and apparatus for receiving an audio data packet, a method and apparatus for sending an audio data packet, and an electronic device and a storage medium. The method for receiving an audio data packet comprises: receiving audio source data from an audio source by means of transparent transmission; receiving a first audio data packet from the audio source, and storing the first audio data packet in a first cache area; encoding the audio source data to obtain a second audio data packet, and storing the second audio data packet in a second cache area; and if a predetermined condition is satisfied, storing the second audio data packet of the second cache area in the first cache area on the basis of a playing order of the audio data packet.

Description

Method, apparatus and electronic device for receiving and transmitting audio data packets

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on the Chinese patent application with the application number of 202110395397.9 and the filing date of April 13, 2021, and claims the priority of the above-mentioned Chinese patent application. The entire content of the above-mentioned Chinese patent application is incorporated herein by reference.

technical field

The present application relates to the field of data transmission, and in particular, to a method for receiving audio data packets, a method, apparatus, electronic device and storage medium for transmitting audio data packets.

Background technique

In the related art, through Bluetooth transmission, the audio data in the device can be transmitted to the Bluetooth device for playback. However, when the Bluetooth connection is not good, the transmission of the transmitted audio data packet may fail, or the Bluetooth device cannot. The audio data packet is received in time, which reduces the transmission efficiency of the audio data packet and causes the audio playback on the Bluetooth device side to freeze.

SUMMARY OF THE INVENTION

In order to solve the related technical problems, the embodiments of the present application provide a method for receiving audio data packets, a method, apparatus, electronic device and storage medium for sending audio data packets.

The embodiment of the present application provides a method for receiving audio data packets in an audio receiving end, including:

Receive audio source data from the audio source through transparent transmission;

Receive the first audio data packet from the audio source, and store the first audio data packet in the first buffer area;

Encoding the audio source data to obtain a second audio data packet, and storing the second audio data packet in the second buffer area;

If the predetermined condition is satisfied, the second audio data packet in the second buffer area is stored in the first buffer area based on the playing sequence of the audio data packets.

Embodiments of the present application also provide a method for sending audio data packets in an audio source, including:

The audio source data is encoded to obtain the first audio data packet, and the first audio data packet is stored in the third buffer area;

transparently transmit the audio source data to the audio receiving end;

The first audio data packet is extracted from the third buffer area and sent to the audio receiving end.

The embodiment of the present application also provides an audio receiving device, including:

a first receiving unit, configured to receive audio source data from an audio source through transparent transmission;

a second receiving unit, configured to receive a first audio data packet from the audio source, and store the first audio data packet in a first buffer area;

a storage unit, configured to encode the audio source data to obtain a second audio data packet, and store the second audio data packet in a second buffer area;

The playing unit is configured to store the second audio data packets in the second buffer area into the first buffer area based on the playing sequence of the audio data packets if a predetermined condition is satisfied.

The embodiment of the present application also provides another audio transmission device, including:

an encoding unit, configured to encode the audio source data to obtain a first audio data packet, and store the first audio data packet in a third buffer area;

a first transmission unit, configured to transparently transmit the audio source data to the audio receiving end;

The second transmission unit is configured to extract the first audio data packet from the third buffer area and send it to the audio receiving end.

Embodiments of the present application also provide an electronic device, including: a processor and a memory configured to store a computer program that can be executed on the processor,

Wherein, the processor is configured to execute the steps of any of the above methods when running the computer program.

Embodiments of the present application further provide a storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the steps of any of the foregoing methods.

In the embodiment of the present application, the audio source data is received from the audio source through transparent transmission; the first audio data packet is received from the audio source, and the first audio data packet is stored in the first buffer area; The source data is encoded to obtain the second audio data packet, and the second audio data packet is stored in the second buffer area; if the predetermined condition is met, based on the playback order of the audio data packets, the second audio data packet in the second buffer area is stored. The audio data packet is stored in the first buffer area, and the audio source data and the audio data after the encoding process are simultaneously transmitted to the audio receiving end, so that the audio receiving end can pass the received audio when the playback is stuck. Extract the corresponding data from the source data and continue to play, thus avoiding the problem of audio playback being stuck.

Description of drawings

1 is a schematic flowchart of an implementation of an audio transmission method provided by an embodiment of the present application;

2 is a schematic diagram of an audio playback process of a second Bluetooth device provided by an embodiment of the present application;

3 is a schematic flowchart of determining a first identifier according to an embodiment of the present application;

FIG. 4 is a schematic diagram of an implementation flowchart of an audio transmission method provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of a sending process of audio data provided by an embodiment of the present application;

6 is a schematic diagram of sending a first audio data packet according to an embodiment of the present application;

7 is a schematic structural diagram of an audio transmission device provided by an embodiment of the present application;

FIG. 8 is a schematic structural diagram of an audio transmission apparatus provided by another embodiment of the present application

FIG. 9 is a schematic structural diagram of a hardware composition of an electronic device according to an embodiment of the present application.

Detailed ways

An embodiment of the present application provides a method for receiving an audio data packet in an audio receiving end, and FIG. 1 is a schematic flowchart of a method for receiving an audio data packet in an audio receiving end according to an embodiment of the present application. As shown in Figure 1, the method includes:

S101: Receive audio source data from an audio source in a transparent transmission manner.

Here, the received audio source data is transmitted from the audio source to the audio receiver through transparent transmission. When the audio source transmits the audio source data, it does not perform encoding and other processing on the audio source data, and directly transmits the audio source data to the audio receiver. so that the audio sink can obtain the audio source data. In practical applications, the audio source and the audio receiving end may be connected by Bluetooth. For example, the audio source may be a mobile terminal, and the audio receiving end may be a Bluetooth headset.

S102: Receive a first audio data packet from the audio source, and store the first audio data packet in a first buffer area; the first audio data packet is obtained by encoding the audio source data by the audio source.

Here, the audio receiving end may also receive the first audio data packet from the audio source, and store the first audio data packet in the first buffer area on the audio receiving end side. The first audio data packet is the first audio data packet obtained by encoding the audio source data by the audio source. In practical applications, the first audio data packet is transmitted from the audio source to the audio receiving end at a certain time, so the audio source data can be transmitted at a time other than the transmission of the first audio data packet, so that the first audio data packet will not be affected. The transmission efficiency of an audio data packet.

S103: Encode the audio source data to obtain a second audio data packet, and store the second audio data packet in a second buffer area.

Here, after receiving the audio source data, the audio receiving end encodes the audio source data to obtain the second audio data packet, and stores the second audio data packet in the second buffer area, wherein the second buffer area is located in the audio receiving end. The terminal side is responsible for storing the second audio data packet so that when the audio played at the audio receiving end is stuck, the corresponding second audio data packet can be extracted from the second audio buffer area to keep the audio playing.

S104: If a predetermined condition is satisfied, store the second audio data packet in the second buffer area into the first buffer area based on the playback sequence of the audio data packets.

Here, the first audio data packet and the second audio data packet are both valid audio data, and the corresponding audio content can be played. Generally, when the transmission between the audio sink and the audio source is in good condition, the The corresponding first audio data packet is extracted from the buffer area for audio playback. If the predetermined condition is met, the second audio data packet in the second buffer area can be stored in the first buffer area for playback, wherein the predetermined condition can represent The playback of the first audio data packet is blocked or the audio playback is stuck. In practical applications, when the audio source encodes the audio source data to generate an audio data packet, the audio source data is encoded in sequence. The first audio data packet received by the audio receiver and the second audio data generated by the encoding are both It is a part of the data in the audio source data. When performing audio playback, it is necessary to play the corresponding audio data packets in the playback order corresponding to the audio data packets, which can ensure the normal audio playback without any disordered audio playback. In practical applications, when the audio source coding generates the first audio data packet, a corresponding first audio data packet serial number may be attached to the first audio data packet, and the first audio data packet serial number may indicate the playback of the audio sequence, so that the corresponding first audio data packet can be extracted and played. For example, the sequence number of the first audio data packet corresponding to the currently playing audio is 3, then after the corresponding audio is played, the first audio data packet is extracted from the first buffer area. The audio data packet whose sequence number is 4 of the first audio data packet is used for subsequent audio playback. As shown in FIG. 2 , FIG. 2 shows a schematic diagram of an audio playing process of an audio receiving end. In Figure 2, the Bluetooth module of the audio receiving end receives the first audio data packet and audio source data, stores the first audio data packet received by the Bluetooth module in the first buffer area, and encodes the second audio based on the audio source data. The data packets are stored in the second buffer area, and the audio playback unit extracts the corresponding first audio data packets from the first buffer area to realize audio playback. In the case of setting conditions, the audio playback unit extracts the corresponding second audio data packets from the second buffer area and stores them in the first buffer area, which can also realize audio playback.

In the above-mentioned embodiment, the audio source data is received from the audio source through transparent transmission; the first audio data packet is received from the audio source, and the first audio data packet is stored in the first buffer area; Data encoding obtains a second audio data packet, and the second audio data packet is stored in the second buffer area; if a predetermined condition is met, based on the playback order of the audio data packets, the second audio data packet in the second buffer area is stored. The data packet is stored in the first buffer area, and the transmission audio data packet and audio source data can be transmitted to the audio receiving end, so that the audio receiving end encounters a jam during the playback of the audio data packet. Maintain the normal playback of audio according to the received audio source data to avoid the problem of audio playback being stuck or interrupted.

In one embodiment, if a predetermined condition is met, the second audio data packet in the second buffer area is stored in the first buffer area based on the playback order of the audio data packets, including:

In the case that the number of the first audio data packets stored in the first buffer area is less than the set threshold, the second audio data packets in the second buffer area are stored in the first buffer area.

Here, it can be determined by the number of the first audio data packets stored in the first buffer area whether the audio playback will freeze. Under normal circumstances, the number of the first audio data packets stored in the first buffer area should be in a stable state. When the connection between the audio source and the audio receiver is unstable, and the number of the first audio data packets stored in the first buffer area is less than the set threshold, it can be determined that the audio receiver has not received audio. The new first audio data packet from the source, and in this case, in order to maintain the normal playback of the audio, the first audio data packet originally stored in the first buffer area is extracted and played, that is, the audio receiving end The received first audio data packet is about to be exhausted, and the audio playback is about to freeze, then store the second audio data packet in the second buffer area into the first buffer area, and pass through the second buffer area. The first audio data packet that cannot be successfully transmitted will be replaced, so that audio playback can be maintained according to the second audio data packet.

In the above embodiment, when the number of the first audio data packets stored in the first buffer area is less than a set threshold, the second audio data packets in the second buffer area are stored in the A buffer area, which can predict the situation of audio playback by the data volume of the first audio data packet stored in the buffer area, so that the audio playback can be maintained through the second audio data packet in time when the audio playback freezes, so as to avoid the occurrence of Audio playback is stuttered or interrupted.

In one embodiment, after the second audio data packets in the second buffer area are stored in the first buffer area, the method further includes:

In the case that the first audio data packet buffered in the first buffer area is greater than or equal to the set threshold, the storing of the second audio data packet in the second buffer area into the first buffer area is stopped.

Here, when the first audio data packet stored in the first buffer area is greater than or equal to the set threshold, it means that the connection between the audio source and the audio receiving end is restored or the connection state is good, which can ensure the normal operation of the first audio packet. In this case, it is not necessary to perform audio playback through the second audio data packet, so that the extraction of the corresponding second audio data packet from the second buffer area and storing the corresponding second audio data packet in the first buffer area is stopped.

In the above embodiment, when the first audio data packet buffered in the first buffer area is greater than or equal to the set threshold, the storage of the second audio data packet in the second buffer area into the The first buffer area can determine the transmission status of the first audio data packet according to the number of the first audio data packets stored in the first buffer area. When the transmission of the first audio data packet returns to normal, the original playback can be maintained. mode, so as to ensure that the audio can be played normally and avoid the phenomenon that the audio playback is stuck or interrupted.

In one embodiment, the encoding of the audio source data to obtain the second audio data packet includes:

The audio source data is encoded using the same encoding parameters as the encoding method of the audio source to obtain the second audio data packet.

Here, when the audio receiving end encodes the audio source data, it uses the same encoding parameters as the encoding method of the audio source to perform corresponding operations such as encoding and compressing the audio source data, so that the encoding of the generated second audio data packet is The parameter is the same as the encoding parameter of the first audio data packet, wherein the encoding parameter may include the frame length of one audio data packet. In practical applications, the audio data packet sequence number corresponding to each second audio data packet may also be determined when the second audio data packet is generated. Since the second audio data packet is generated using the same encoding parameters as the first audio data packet, in principle, the first audio data packet with the same audio data packet serial number is the same as the second audio data packet, for example, the audio data The audio content corresponding to the first audio data packet with the packet sequence number of 1 is the same as the audio content corresponding to the second audio data packet, so that when audio playback is performed based on the second audio data packet, the extracted second audio data packet is just for the subsequent needs. The audio content to be played ensures the continuity of audio playback.

In the above embodiment, the audio source data is encoded using the same encoding parameters as the encoding method of the audio source to obtain the second audio data packet, which enables the generated first audio data packet and the second audio data to be generated. The packets are the same, so that when the audio is played based on the playback of the second audio data packet, the continuity of the audio playback is ensured, and the disorder of the audio playback is avoided.

In an embodiment, when the second audio data packet is stored in the second buffer area, the method further includes:

A first identifier is added to the second audio data packet, where the first identifier is used to mark whether the audio receiving end has played the audio corresponding to the second audio data packet.

Here, in order to ensure that the second audio data packet extracted from the second buffer area is the subsequent content of the played audio content, a first identification can be added to the second audio data packet, and the first identification is used to mark whether the audio receiving end is The audio corresponding to the second audio data packet has been played. In practical applications, the first identifier corresponding to the second audio data packet can be changed according to the currently playing audio data packet. The first mark of the second audio data packet of the audio data packet serial number is determined to be in the played state. Since the first audio data packet is the same as the second audio data packet, when the content of the first audio data packet has been played When the corresponding second audio data packet with the same content is also in the state of being played, for example, the first flag is indicated by flag, flag=0 means that the audio receiving end does not play the second audio data packet, and flag=1 means that the audio is received The terminal has played the second audio data packet. In practical applications, the flag=0 of all the second audio data packets is defaulted, and the second audio data packet is compared with the first audio data packet being played by the audio receiving terminal, so as to change it in time. The flag value corresponding to the second audio data packet is shown in FIG. 3 , which shows a schematic flowchart of determining the first identifier. In FIG. 3 , the audio data packet sequence number Sequence_Num=8 corresponding to the currently playing audio data packet , according to the comparison with the second audio data packet in the second buffer area, determine the second audio data packet of Sequence_Num=8, and change the value of the corresponding first identification flag from 0 to 1, and identify the audio data packet sequence number The audio corresponding to the second audio data packet of 8 has been played by the audio playback terminal, so that the playback progress of the current audio can be determined according to the first identifier of the second audio data packet.

The storing of the second audio data packet in the second buffer area into the first buffer area includes:

Based on the corresponding first identifier and the current play sequence, the second audio data packet in the second buffer area is stored in the first buffer area.

Here, because the first identification can determine whether the audio content corresponding to the second audio data packet has been played by the audio receiving end, so if the first identification of the second audio data packet represents the current second audio data packet has not been played by the audio receiving end Play, it can be determined that the audio receiving end is the follow-up audio content of the currently playing audio, and according to the corresponding first identification and the current playback order, the second audio data packet in the second buffer area is stored in the first buffer area, for example , the unplayed second audio data packet can be determined according to the second audio data packet flag=0, and the current playback order can be determined according to the second audio data packet flag=1. When the conditions are set, the second audio data packet The audio data packet sequence number corresponding to the packet flag=1 is 5, and the flag=0 of the second audio data packet corresponding to the audio data packet sequence number 6 indicates that the audio content to be played next is the audio data packet sequence number 6. to extract the second audio data packet with the audio data packet sequence number of 6 in the second buffer area to the first buffer area.

In the above embodiment, when the second audio data packet is stored in the second buffer area, a first identification is added to the second audio data packet, and the first identification is used to mark the audio receiving end Whether the audio corresponding to the second audio data packet has been played; based on the corresponding first identification and the current playback order, the second audio data packet in the second buffer area is stored in the first buffer area, The playback progress of the current audio can be determined by the first identification, which is conducive to accurately extracting the audio data packets corresponding to the subsequent content of the current audio, and can accurately play the corresponding audio content while avoiding the audio playback jam, keeping the audio Continuity of playback.

In one embodiment, storing the second audio data packet in the second buffer area into the first buffer area includes:

Determine the first period based on the audio playback speed of the audio receiver; and

Every first cycle, the second audio data packets in the second buffer area are sequentially stored in the first buffer area.

Here, when the corresponding second audio data packet is extracted from the second buffer area, it is not obtained continuously, but every first cycle, the corresponding second audio data packet is extracted from the second buffer area, wherein, The first period is determined based on the audio playback speed of the audio receiving end. In practical applications, the first audio data packet that the audio receiving end can receive periodically indicates that the audio source can send the first audio data packet normally, thus ensuring that The audio playback at the audio receiving end is smooth. Therefore, extracting the second audio data packet from the second buffer area based on the first cycle of receiving the first audio data packet can maintain the audio playback speed and ensure smooth audio playback.

In the above embodiment, a first cycle is determined based on the audio playback speed of the audio receiving end; and every first cycle, the second audio data packets in the second buffer area are sequentially stored in the first cycle The buffer area can maintain the audio playback speed by controlling the extraction time of the audio data packet, so that the effect of playing audio based on the second audio data packet is similar to or the same as the effect of playing audio based on the first audio data packet, thereby ensuring smooth audio playback. .

In one embodiment, the method further includes:

If the Bluetooth connection is disconnected from the audio source, the second audio data packet in the second buffer area is stored in the first buffer area for playback.

Here, the first audio data packet is realized by the Bluetooth connection between the audio source and the audio receiving end. When the Bluetooth connection between the audio source and the audio receiving end is disconnected, for example, the audio receiving end and the audio receiving end are disconnected. The distance between the sources is outside the effective Bluetooth communication range, so the effective transmission of the first audio data packet cannot be achieved, resulting in the inability to realize audio playback according to the first audio data packet before the audio source and the audio receiving end are reconnected, and In the process of maintaining the Bluetooth connection between the audio source and the audio receiving end, the transmission of all audio source data can be realized, and the transmission of the audio source data does not take too long. The second audio data package obtained by encoding the audio source data is used for audio playback, and the second audio data package is stored in the audio receiving device to realize offline local playback.

In the above embodiment, if the Bluetooth connection is disconnected from the audio source, the second audio data packet in the second buffer area is stored in the first buffer area for playback, which can be played when the Bluetooth connection is disconnected. In this case, offline local playback is implemented based on the audio data packets of the transmitted audio source data, so that the offline playback capability of the audio receiving end can be implemented.

In one embodiment, the method further includes:

Based on the second audio data packet stored in the first buffer area, the corresponding audio is played.

Here, the second audio data packet extracted from the second buffer area is stored in the first buffer area, and the first buffer area can play the corresponding audio according to the stored second audio data packet. Both the audio data packet and the second audio data packet are valid audio data and can play the corresponding audio content, and the second audio data packet in the first buffer area is the first audio data packet in the first buffer area that is about to be consumed. Therefore, when the corresponding audio is played according to the second audio data packet, the playback content corresponding to the first audio data packet can be followed, thereby ensuring smooth playback of the audio.

In the above-mentioned embodiment, based on the second audio data packet stored in the first buffer area, the corresponding audio is played, and the transparently transmitted audio data can be used to maintain the audio playback when the transmission condition is not good, so as to avoid audio Playback freezes.

The embodiment of the present application also provides a method for sending audio data packets in an audio source, as shown in FIG. 4 , the method includes:

S401: Encode audio source data to obtain a first audio data packet, and store the first audio data packet in a third buffer area.

Here, the audio source encodes the audio source data to generate the first audio data packet, and stores the generated first audio data packet into the third buffer area. In practical applications, a corresponding audio data packet serial number can also be added to the first audio data packet when the first audio data packet is generated, and different first audio data packets can be played in the playback order through the audio data packet serial number. Sorting, so that the order in which the first audio data packets are sent to the audio receiving end can be determined.

S402: Transparently transmit the audio source data to the audio receiving end.

Here, the audio source also transmits audio source data to the audio sink through transparent transmission. In practical applications, the audio source data does not need to undergo data processing such as encoding, and the audio source data is directly transmitted to the audio receiving end.

S403: Extract the first audio data packet from the third buffer area and send it to the audio receiving end.

Here, when the first audio data packet is sent, the first audio data packet is extracted from the third buffer area and sent to the receiving end. When the transmission condition between the audio source and the audio receiver is not good, for example, the first audio data packet needs to be retransmitted, etc., the third buffer area on the audio source side can be used to encode the first audio data packet generated later. The audio data packet is buffered first, and after the first audio data packet that needs to be retransmitted is successfully transmitted, the first audio data packet stored in the third buffer area can be transmitted immediately, so as to ensure that the connection is unstable or the transmission condition is insufficient. The complete transmission of audio data packets can be achieved under optimal conditions. As shown in Figure 5, Figure 5 shows a schematic diagram of the sending process of the first audio data packet and the audio source data. First, the audio source will encode the audio source data to obtain the first audio data packet, and judge the previous first audio data. Whether the transmission of the packet is successful and whether there is no audio data packet in the buffer area, when the last first audio data packet is sent successfully, it means that the first audio data packet can be sent directly. If successful, the first audio data packet is stored in the buffer area, and when the previous first audio data packet is successfully sent, the first audio data packet in the buffer area is sent out.

In the above embodiment, the audio source data is encoded to obtain the first audio data packet, and the first audio data packet is stored in the third buffer area; the audio source data is transparently transmitted to the audio receiving end; The third buffer area extracts the first audio data packet and sends it to the audio receiving end, so that the audio source data and the corresponding audio data packet can be sent to the audio playing end, so that the audio receiving end can receive the audio in time. In the case of data packets, the audio source data is used for subsequent audio playback to avoid abnormal disconnection between Bluetooth devices or the phenomenon that audio playback is stuck due to infinite interference.

In an embodiment, the extracting the first audio data packet from the third buffer area and sending it to the audio receiving end includes:

Determine the first cycle based on the audio playback speed of the audio receiver; and,

Every first cycle, the first audio data packet is extracted from the third buffer area and sent to the audio receiving end.

Here, the transmission of the first audio data packet from the audio source to the audio receiving end needs to adapt the playback data of the audio. Therefore, the transmitted first audio data packet extracts the first audio from the third buffer area every first cycle. The data packet is sent to the audio receiving end, and the first cycle is determined based on the audio playback speed of the audio receiving end. In practical applications, when the first cycle can remain the same, it means that the transmission of the first audio data packet is stable, so that the Audio playback is smooth. As shown in FIG. 6 , FIG. 6 shows a schematic diagram of sending a first audio data packet. In FIG. 6 , the sending time interval between two different first audio data packets is a first period.

The transparent transmission of the audio source data to the audio receiving end includes:

The audio source data is transparently transmitted to the audio receiving end in the transmission gap of the first audio data packet.

Here, the audio source data is transparently transmitted to the audio receiving end during the transmission gap of the first audio data packet. Since the first audio data packet is sent every first cycle, the first audio data will not be processed in the first cycle. In the transmission of the packet, the transparent transmission of the audio source data at this time will not affect the transmission performance of the first audio data packet, so that the transmission of the audio source data can be achieved while ensuring the transmission efficiency of the first audio data packet.

In the above embodiment, the first cycle is determined based on the audio playback speed of the audio receiving end; and, every first cycle, the first audio data packet is extracted from the third buffer area and sent to the The audio receiving end transparently transmits the audio source data to the audio receiving end in the transmission gap of the first audio data packet, so that the transmission of the audio data packet can be carried out without affecting the transmission of the audio data packet, and the audio data can be transmitted. transmission efficiency.

In order to implement the method of the embodiment of the present application, the embodiment of the present application further provides an audio receiving apparatus, as shown in FIG. 7 , the apparatus includes:

The first receiving unit 701 is configured to receive audio source data from the audio source through transparent transmission;

The second receiving unit 702 is configured to receive a first audio data packet from the audio source, and store the first audio data packet in a first buffer area; the first audio data packet is stored by the audio source to the The audio source data is encoded and obtained;

Storage unit 703, configured to encode the audio source data to obtain a second audio data packet, and store the second audio data packet into a second buffer area;

The playback unit 704 is configured to extract the corresponding first audio data packets from the first buffer area and play them according to the playback sequence corresponding to the audio data packets, or, under predetermined conditions, place the second buffer area in the second buffer area. The second audio data packet is stored in the first buffer area and played.

In one embodiment, the playing unit 704 stores the second audio data packet in the second buffer area into the first buffer area under a predetermined condition and plays it, and is further configured to:

In the case that the number of the first audio data packets stored in the first buffer area is less than the set threshold, the second audio data packets in the second buffer area are stored in the first buffer area and played.

In one embodiment, after the second audio data packet in the second buffer is stored in the first buffer and played, the playing unit 704 is further configured to:

In one embodiment, the storage unit 703 encodes the audio source data to obtain a second audio data packet, and is further configured to:

In one embodiment, the storage unit 703, which stores the second audio data packet in the second buffer area, is further configured to:

A first identification is added for the second audio data packet, and the first identification is used to mark whether the audio receiver has played the audio corresponding to the second audio packet;

The playing unit 704 stores the second audio data packet in the second buffer area into the first buffer area, and is further configured to:

In one embodiment, the playing unit 704 stores the second audio data packet in the second buffer area into the first buffer area, and is further configured to:

In one embodiment, the playback unit 704 is further configured to:

In practical applications, the first receiving unit 701, the second receiving unit 702, the storage unit 703, and the playing unit 704 may be implemented by a processor in an audio receiving device. Of course, the processor needs to run the program stored in the memory to realize the functions of the above program modules.

It should be noted that, when the audio receiving apparatus provided in the above embodiment of FIG. 7 performs audio transmission, only the division of the above program modules is used as an example for illustration. In practical applications, the above processing may be allocated to different program modules as required. Completion means dividing the internal structure of the device into different program modules to complete all or part of the processing described above. In addition, the audio receiving apparatus provided in the above embodiment and the method embodiment for receiving an audio data packet in an audio receiving end belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

The embodiment of the present application also provides another audio transmission device, as shown in FIG. 8 , the device includes:

The encoding unit 801 is configured to encode the audio source data to obtain the first audio data packet, and store the first audio data packet into the third buffer area;

a first transmission unit 802, configured to transparently transmit the audio source data to the audio receiving end;

The second transmission unit 803 is configured to extract the first audio data packet from the third buffer area and send it to the audio receiving end.

In one embodiment, the second transmission unit 803 extracts the first audio data packet from the third buffer area and sends it to the audio receiving end, and is further configured to:

At every first cycle, extract the first audio data packet from the third buffer area and send it to the audio receiver;

The first transmission unit 802 transparently transmits the audio source data to the audio receiving end, and is further configured to:

In practical application, the encoding unit 801, the first transmission unit 802, and the second transmission unit 803 may be implemented by a processor in the audio transmission apparatus. Of course, the processor needs to run the program stored in the memory to realize the functions of the above program modules.

It should be noted that, when the audio transmission device provided in the above-mentioned embodiment of FIG. 8 performs audio transmission, only the division of the above-mentioned program modules is used for illustration. In practical applications, the above-mentioned processing may be allocated to different program modules as required. Completion means dividing the internal structure of the device into different program modules to complete all or part of the processing described above. In addition, the audio sending device provided in the above embodiment and the method embodiment for sending audio data packets in an audio source belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

Based on the hardware implementation of the above program modules, and in order to implement the method of the embodiment of the present application, the embodiment of the present application further provides an electronic device. FIG. 9 is a schematic diagram of the hardware composition of the electronic device according to the embodiment of the present application, as shown in FIG. 9 . , electronic equipment including:

Communication interface 1, which can exchange information with other devices such as network devices;

The processor 2 is connected to the communication interface 1 to realize information interaction with other devices, and is configured to execute the audio transmission method provided by one or more of the above technical solutions when running a computer program. The computer program is instead stored on the memory 3 .

Of course, in practical application, various components in the electronic device are coupled together through the bus system 4 . It will be appreciated that the bus system 4 is configured to enable connection communication between these components. In addition to the data bus, the bus system 4 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the various buses are labeled as bus system 4 in FIG. 9 .

The memory 3 in the embodiment of the present application is configured to store various types of data to support the operation of the electronic device. Examples of such data include: any computer program configured to operate on an electronic device.

It will be appreciated that the memory may be either volatile memory or non-volatile memory, and may include both volatile and non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM, Read Only Memory), a programmable read-only memory (PROM, Programmable Read-Only Memory), an erasable programmable read-only memory (EPROM, Erasable Programmable Read-only memory) Only Memory), Electrically Erasable Programmable Read-Only Memory (EEPROM, Electrically Erasable Programmable Read-Only Memory), Magnetic Random Access Memory (FRAM, ferromagnetic random access memory), Flash Memory (Flash Memory), Magnetic Surface Memory , CD-ROM, or CD-ROM (Compact Disc Read-Only Memory); magnetic surface memory can be disk memory or tape memory. Volatile memory may be Random Access Memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory Memory (DRAM, Dynamic Random Access Memory), Synchronous Dynamic Random Access Memory (SDRAM, Synchronous Dynamic Random Access Memory), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM, Double Data Rate Synchronous Dynamic Random Access Memory), Enhanced Type Synchronous Dynamic Random Access Memory (ESDRAM, Enhanced Synchronous Dynamic Random Access Memory), Synchronous Link Dynamic Random Access Memory (SLDRAM, SyncLink Dynamic Random Access Memory), Direct Memory Bus Random Access Memory (DRRAM, Direct Rambus Random Access Memory) ). The memories described in the embodiments of the present application are intended to include, but not be limited to, these and any other suitable types of memories.

The methods disclosed in the above embodiments of the present application may be applied to a processor, or implemented by a processor. A processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above-mentioned method can be completed by a hardware integrated logic circuit in a processor or an instruction in the form of software. The above-mentioned processors may be general-purpose processors, DSPs, or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. The processor may implement or execute the methods, steps, and logical block diagrams disclosed in the embodiments of this application. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium, the storage medium is located in a memory, and the processor reads the program in the memory, and completes the steps of the foregoing method in combination with its hardware.

When the processor executes the program, the corresponding process in each method of the embodiments of the present application is implemented, which is not repeated here for brevity.

In an exemplary embodiment, an embodiment of the present application further provides a storage medium, that is, a computer storage medium, specifically a computer-readable storage medium, for example, including a memory for storing a computer program, and the above-mentioned computer program can be executed by a processor to complete the steps described in the preceding method. The computer-readable storage medium may be memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface memory, optical disk, or CD-ROM.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus, electronic device and method may be implemented in other manners. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored, or not implemented. In addition, the coupling, or direct coupling, or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be electrical, mechanical or other forms. of.

The unit described above as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place or distributed to multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may all be integrated into one processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; the above integration The unit can be implemented either in the form of hardware or in the form of hardware plus software functional units.

Those of ordinary skill in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by program instructions related to hardware, the aforementioned program can be stored in a computer-readable storage medium, and when the program is executed, execute It includes the steps of the above method embodiments; and the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic disk or an optical disk and other media that can store program codes.

Alternatively, if the above-mentioned integrated units of the present application are implemented in the form of software function modules and sold or used as independent products, they may also be stored in a computer-readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence or in the parts that make contributions to the prior art. The computer software products are stored in a storage medium and include several instructions for An electronic device (which may be a personal computer, a server, or a network device, etc.) is caused to execute all or part of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic disk or an optical disk and other mediums that can store program codes.

It should be noted that "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence.

In addition, the technical solutions described in the embodiments of the present application may be combined arbitrarily unless there is a conflict.

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited to this. should be covered within the scope of protection of this application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

A method for receiving audio data packets in an audio receiving end, comprising:

Receive audio source data from the audio source through transparent transmission;

Receive the first audio data packet from the audio source, and store the first audio data packet in the first buffer area;

Encoding the audio source data to obtain a second audio data packet, and storing the second audio data packet into the second buffer area; and

If a predetermined condition is met, the second audio data packet in the second buffer area is stored in the first buffer area based on the playback sequence of the audio data packets.
The method according to claim 1, wherein, if a predetermined condition is met, the second audio data packet in the second buffer area is stored in the first buffer area based on the playback sequence of the audio data packets, include:

In the case that the number of the first audio data packets stored in the first buffer area is less than a predetermined threshold, the second audio data packets in the second buffer area are stored in the first buffer area.
The method according to claim 2, wherein after the second audio data packets in the second buffer area are stored in the first buffer area, the method further comprises:

In the case that the first audio data packet buffered in the first buffer area is greater than or equal to the predetermined threshold, the storing of the second audio data packet in the second buffer area into the first buffer area is stopped.
The method according to any one of claims 1 to 3, wherein the encoding the audio source data to obtain the second audio data packet further comprises:

The second audio data packet is obtained by encoding the audio source data in the same encoding manner as the encoding manner of the audio source.
The method according to any one of claims 1 to 3, wherein, when the second audio data packet is stored in the second buffer area, the method further comprises:

A first identification is added for the second audio data packet, and the first identification is used to mark whether the audio receiver has played the audio corresponding to the second audio packet;

The storing of the second audio data packet in the second buffer area into the first buffer area includes:

Based on the corresponding first identifier and the current play sequence, the second audio data packet in the second buffer area is stored in the first buffer area.
The method according to any one of claims 1 to 3, wherein the storing the second audio data packet in the second buffer area into the first buffer area comprises:

Determine the first period based on the audio playback speed of the audio receiver; and

Every first cycle, the second audio data packets in the second buffer area are sequentially stored in the first buffer area.
The method of claim 1, wherein the method further comprises:

If the Bluetooth connection is disconnected from the audio source, the second audio data packet in the second buffer area is stored in the first buffer area for playback.
The method of claim 1, wherein the method further comprises:

Based on the second audio data packet stored in the first buffer area, the corresponding audio is played.
A method of sending audio data packets in an audio source, the method comprising:

The audio source data is encoded to obtain the first audio data packet, and the first audio data packet is stored in the third buffer area;

transparently transmit the audio source data to the audio sink; and

The first audio data packet is extracted from the third buffer area and sent to the audio receiving end.
The method according to claim 9, wherein the extracting the first audio data packet from the third buffer area and sending it to the audio receiving end comprises:

Determine the first cycle based on the audio playback speed of the audio receiver; and,

At every first cycle, extract the first audio data packet from the third buffer area and send it to the audio receiver;

The transparent transmission of the audio source data to the audio receiving end includes:

The audio source data is transparently transmitted to the audio receiving end in the transmission gap of the first audio data packet.
An audio receiving device, comprising:

a first receiving unit, configured to receive audio source data from an audio source through transparent transmission;

a second receiving unit, configured to receive a first audio data packet from the audio source, and store the first audio data packet in a first buffer area;

a storage unit, configured to encode the audio source data to obtain a second audio data packet, and store the second audio data packet in a second buffer area;

The playing unit is configured to store the second audio data packets in the second buffer area into the first buffer area based on the playing sequence of the audio data packets if a predetermined condition is satisfied.
The audio receiving apparatus according to claim 11, wherein, if a predetermined condition is satisfied, the playback unit stores the second audio data packet in the second buffer area into the When the first buffer area is also configured as:

In the case that the number of the first audio data packets stored in the first buffer area is less than a predetermined threshold, the second audio data packets in the second buffer area are stored in the first buffer area.
The audio receiving apparatus according to claim 12, wherein after the second audio data packet in the second buffer area is stored in the first buffer area, the playback unit is further configured to:

In the case that the first audio data packet buffered in the first buffer area is greater than or equal to the predetermined threshold, the storing of the second audio data packet in the second buffer area into the first buffer area is stopped.
The audio receiving device according to any one of claims 11 to 13, wherein the storage unit encodes the audio source data to obtain a second audio data packet, and stores the second audio data packet in the second audio data packet. The cache area is also configured as:

The second audio data packet is obtained by encoding the audio source data in the same encoding manner as the encoding manner of the audio source.
The audio receiving apparatus according to any one of claims 11 to 13, wherein, when the storage unit stores the second audio data packet in the second buffer area, it is further configured to:

A first identification is added for the second audio data packet, and the first identification is used to mark whether the audio receiver has played the audio corresponding to the second audio packet;

The storing of the second audio data packet in the second buffer area into the first buffer area includes:

Based on the corresponding first identifier and the current play sequence, the second audio data packet in the second buffer area is stored in the first buffer area.
The audio receiving device according to any one of claims 11 to 13, wherein, when the storage unit stores the second audio data packets in the second buffer area into the first buffer area, the storage unit is further configured to for:

Determine the first period based on the audio playback speed of the audio receiver; and

Every first cycle, the second audio data packets in the second buffer area are sequentially stored in the first buffer area.
The audio receiving apparatus of claim 11, wherein the apparatus is further configured to:

If the Bluetooth connection is disconnected from the audio source, the second audio data packet in the second buffer area is stored in the first buffer area for playback.
An audio transmission device, comprising:

an encoding unit, configured to encode the audio source data to obtain a first audio data packet, and store the first audio data packet in a third buffer area;

a first transmission unit, configured to transparently transmit the audio source data to the audio receiving end;

The second transmission unit is configured to extract the first audio data packet from the third buffer area and send it to the audio receiving end.
An electronic device comprising: a processor and a memory configured to store a computer program executable on the processor,

Wherein, the processor is configured to execute the steps of the method of any one of claims 1 to 8 or 9 to 10 when running the computer program.
A storage medium having a computer program stored thereon, the computer program implementing the steps of the method of any one of claims 1 to 8 or 9 to 10 when executed by a processor.