CN116887408A

CN116887408A - Audio transmission method, system and related equipment

Info

Publication number: CN116887408A
Application number: CN202310878694.8A
Authority: CN
Inventors: 徐斌
Original assignee: Zgmicro Nanjing Ltd
Current assignee: Zgmicro Nanjing Ltd
Priority date: 2023-05-23
Filing date: 2023-07-17
Publication date: 2023-10-13

Abstract

The invention discloses an audio transmission method, an audio transmission system and related equipment, which relate to the technical field of wireless communication and are used for solving the problem of low transmission efficiency of a communication link of wireless multichannel audio transmission. The method comprises the following steps: determining a target communication link and a target audio data packet to be sent in a first sub-event of the current equal time interval; allocating a transmitting sub-time slot in a first sub-event for each target communication link, wherein after allocation, at least one first transmitting sub-time slot exists in the first sub-event, the target communication link corresponding to the first transmitting sub-time slot is different from the target communication link corresponding to a second transmitting sub-time slot in a second sub-event, and the time domain position of the first transmitting sub-time slot in the first sub-event is the same as the time domain position of the second transmitting sub-time slot in the second sub-event; and transmitting a target audio data packet corresponding to the target communication link based on the target communication link in the transmitting sub-time slot of the first sub-event.

Description

Audio transmission method, system and related equipment

Cross Reference to Related Applications

The present disclosure claims priority to chinese patent application No.202310583554.8 filed in china at 2023, 05, 23, the entire contents of which are incorporated herein by reference.

Technical Field

The present invention relates to the field of wireless communications technologies, and in particular, to an audio transmission method, system, and related devices.

Background

The wireless audio technology brings unconstrained free conversation and music enjoyment to people, and is widely loved by people. For example, two-channel true wireless stereo (True Wireless Stereo, TWS) headphones and speakers based on two-way connection isochronous streams (Connected Isochronous Stream, CIS) or two-way broadcast isochronous streams (Broadcast Isochronous Stream, BIS). However, the link efficiency and reliability of connecting the isochronous group (Connected Isochronous Group, CIG) and the broadcast isochronous group (Broadcast Isochronous Group, BIG) is low, limiting the number of channels that can be supported by Wireless Multi-Channel Audio (WMCA), making it difficult to implement higher quality and more Channel Wireless Multi-Channel Audio functions.

As with CIG, in the case where a plurality of communication links are established between the audio transmitting end and the plurality of audio receiving ends, the radio resource of each link is already configured when the link is established, each link occupies a transmitting sub-slot of a fixed time domain position in each sub-event in each communication interval, the transmitting sub-slot can only be occupied by the communication link, and the audio transmitting end can only transmit an audio data packet to the corresponding audio receiving end based on the fixed communication link in the transmitting sub-slot.

When the audio transmitting end does not need to transmit an audio data packet to a certain audio receiving end in a sub-event, a transmitting sub-time slot occupied by a communication link corresponding to the audio receiving end in the sub-event is idle, but the transmitting sub-time slot cannot be occupied by other communication links, which results in waste of time slot resources. In addition, there are frequent cases where slot resources are wasted for similar reasons in the receiving sub-slots in the CIG. Because of the configuration mechanism of the fixed time slot, the maximum retransmission times of each audio data packet are extremely limited to a certain extent, so that the transmission reliability of WMCA is difficult to ensure. Therefore, the existing wireless multi-channel audio transmission communication link has the problems of low transmission efficiency and poor transmission reliability.

Disclosure of Invention

The embodiment of the invention provides an audio transmission method, an audio transmission system and related equipment, which are used for solving the problem of low transmission efficiency of a communication link of wireless audio transmission.

In a first aspect, an embodiment of the present invention provides an audio transmission method, applied to an audio transmitting end, where the audio transmitting end wirelessly communicates with a plurality of audio receiving ends respectively in consecutive isochronous intervals based on a plurality of communication links to transmit corresponding audio data, where one isochronous interval includes a plurality of sub-events, one sub-event includes M consecutive transmission sub-slots, and one transmission sub-slot is used by the audio transmitting end to transmit an audio packet of one communication link, one audio receiving end corresponds to one communication link, and M is a positive integer greater than 1, where the method includes: within the first sub-event of the current isochronous interval,

Determining a target communication link and a target audio data packet to be sent in a first sub-event, wherein one target audio data packet corresponds to one target communication link;

allocating a transmitting sub-time slot in the first sub-event for each target communication link, wherein after allocation, at least one first transmitting sub-time slot exists in the first sub-event, the target communication link corresponding to the first transmitting sub-time slot is different from the target communication link corresponding to a second transmitting sub-time slot in a second sub-event, the second sub-event is a sub-event with the time domain position in the current isochronous interval before the first sub-event, and the time domain position of the first transmitting sub-time slot in the first sub-event is the same as the time domain position of the second transmitting sub-time slot in the second sub-event;

and transmitting a target audio data packet corresponding to the target communication link based on the target communication link in a transmitting sub-time slot of the first sub-event.

In a second aspect, an embodiment of the present invention further provides an audio transmission method, applied to an audio receiving end, where the audio receiving end corresponds to one communication link of a plurality of communication links, and the audio receiving end communicates with an audio transmitting end in a continuous isochronous interval to receive corresponding audio data, where one isochronous interval includes a plurality of sub-events, and one sub-event includes M continuous transmission sub-slots, and one transmission sub-slot is used by the audio transmitting end to transmit an audio packet of one communication link, where the method includes: within any one sub-event of the current isochronous interval,

And based on the communication links corresponding to the audio receiving end, sequentially receiving in the M sending sub-slots to acquire a target audio data packet corresponding to the audio receiving end.

In a third aspect, an embodiment of the present invention further provides an audio transmitting end, where the audio transmitting end wirelessly communicates with a plurality of audio receiving ends respectively in consecutive isochronous intervals based on a plurality of communication links to transmit corresponding audio data, where one isochronous interval includes a plurality of sub-events, where one sub-event includes M consecutive transmission sub-slots, where one transmission sub-slot is used by the audio transmitting end to transmit an audio packet of one communication link, where one audio receiving end corresponds to one communication link, where M is a positive integer greater than 1, and where the audio transmitting end includes a first determining module, an allocating module, and a first transmitting module,

the first determining module is configured to determine a target communication link and a target audio data packet to be sent in a first sub-event, where one target audio data packet corresponds to one target communication link;

the allocation module is configured to allocate a transmission sub-slot in the first sub-event to each of the target communication links, and after allocation, at least one first transmission sub-slot exists in the first sub-event, where a target communication link corresponding to the first transmission sub-slot is different from a target communication link corresponding to a second transmission sub-slot in a second sub-event, and the second sub-event is a sub-event whose time domain position in the current isochronous interval is before the first sub-event, and the time domain position of the first transmission sub-slot in the first sub-event is the same as the time domain position of the second transmission sub-slot in the second sub-event;

The first transmitting module is configured to transmit, in a transmission sub-slot of the first sub-event, a target audio data packet corresponding to the target communication link based on the target communication link.

In a fourth aspect, an embodiment of the present invention further provides an audio receiving end, where the audio receiving end corresponds to one of a plurality of communication links, and communicates with an audio transmitting end in a continuous isochronous interval to receive corresponding audio data, where one isochronous interval includes a plurality of sub-events, where one sub-event includes M continuous transmission sub-slots, and where one transmission sub-slot is used by the audio transmitting end to transmit an audio packet of one communication link, where the audio receiving end includes a first receiving module that, in any one sub-event of a current isochronous interval,

the first receiving module is configured to sequentially receive in the M transmission sub-slots based on the communication link corresponding to the audio receiving end, so as to obtain a target audio data packet corresponding to the audio receiving end.

In a fifth aspect, an embodiment of the present invention further provides an audio transmission system, including:

an audio transmitting terminal as described in the third aspect;

N audio receivers according to the fourth aspect;

the audio transmitting terminal is in wireless communication with a plurality of audio receiving terminals respectively in continuous time intervals based on a plurality of communication links to transmit corresponding audio data, one time interval comprises a plurality of sub-events, one sub-event comprises M continuous transmitting sub-time slots, one transmitting sub-time slot is used for the audio transmitting terminal to transmit an audio data packet of one communication link, one audio receiving terminal corresponds to one communication link, and M is a positive integer greater than 1.

In a sixth aspect, an embodiment of the present invention further provides an electronic device, including a processor, a memory, and a program stored on the memory and executable on the processor, where the program when executed by the processor implements steps in the audio transmission method according to the first aspect, or steps in the audio transmission method according to the second aspect.

In a seventh aspect, an embodiment of the present invention further provides a readable storage medium, on which a program is stored, which when executed by a processor, implements steps in an audio transmission method as described in the first aspect, or steps in an audio transmission method as described in the second aspect.

In the embodiment of the invention, in a first sub-event of the current time interval, a target communication link and a target audio data packet to be transmitted in the first sub-event are determined, a transmission sub-time slot in the first sub-event is allocated for each target communication link, and in the transmission sub-time slot of the first sub-event, a target audio data packet corresponding to the target communication link is transmitted based on the target communication link. By the method, the allocation mode of the sending sub-time slots in each sub-event is not fixed, the sending sub-time slots can be flexibly allocated according to the current communication condition, the positions and the number of the sending sub-time slots corresponding to each target communication link are adjusted, the time slots are prevented from being wasted, and the utilization rate of communication resources and the transmission efficiency of the communication links are improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments of the present invention will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort to a person of ordinary skill in the art.

Fig. 1 is a schematic structural diagram of an audio transmission system according to an embodiment of the present application;

fig. 2 is one of flowcharts of an audio transmission method according to an embodiment of the present application;

fig. 3a is a schematic diagram of a packet header according to an embodiment of the present application;

fig. 3b is a schematic diagram of a header according to a second embodiment of the present application;

FIG. 4 is a second flowchart of an audio transmission method according to an embodiment of the present application;

fig. 5a is a schematic diagram of a slot structure according to an embodiment of the present application;

FIG. 5b is a diagram illustrating a second slot structure according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of an audio transmitting end according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of an audio receiving end according to an embodiment of the present application;

FIG. 8 is a second schematic structural diagram of an audio transmitting terminal according to an embodiment of the present application;

FIG. 9 is a second schematic diagram of an audio receiver according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the application. All other embodiments, which are derived by a person skilled in the art based on the embodiments of the application, fall within the scope of protection of the application.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or otherwise described herein, and that the "first" and "second" distinguishing between objects generally are not limited in number to the extent that the first object may, for example, be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/" generally means a relationship in which the associated object is an "or" before and after.

For clarity and distinction from the prior art, the audio transmission method of embodiments of the present application may also be referred to herein as an adaptive hybrid isochronous stream (Adaptive Hybrid Isochronous Stream, AHIS) link protocol. In addition, in the embodiment of the present application, an AHIS link is established between the Audio transmitting end and each Audio receiving end, similar to the definition of a connection isochronous stream (Connected Isochronous Stream, CIS) link protocol and a corresponding connection isochronous group (Connected Isochronous Group, CIG) composed of multiple CIS links in bluetooth low energy (Bluetooth Low Energy, BLE) Audio (Audio) technology. The AHIS links between the audio sender and all audio receivers form an adaptive hybrid isochronous group (Adaptive Hybrid Isochronous Group, AHIG).

Referring to fig. 1, the audio transmission system includes an audio transmitting end and a plurality of audio receiving ends, where the audio transmitting end and the audio receiving ends can perform wireless communication, so that the audio transmission system can be used for implementing multi-channel audio transmission or multi-channel audio transmission, and the audio transmitting end and the audio receiving end in the audio transmission system shown in fig. 1 can perform audio transmission through the audio transmission method provided by the embodiment of the application. By way of example, the audio transmission method provided by the embodiment of the present application will be described in the application scenario of a wireless multi-channel audio transmission system, and the audio transmitting end may be implemented as a multi-channel audio transmitting device, such as a mobile phone, a sound box, a television, etc. The audio receiving terminal may be implemented as a mono audio receiving apparatus or as a part of a multi-channel audio receiving apparatus, for example, several audio receiving terminals may be configured within one multi-channel audio receiving apparatus to receive audio data of different channels, respectively. The audio receiving device may be a wireless speaker, a true wireless stereo (True Wireless Stereo, TWS) headset, a wireless 5.1 channel speaker, etc. It can be understood that the audio transmission method of the embodiment of the application can also be applied to application scenes such as a multipath independent audio wireless transmission system and the like, so as to meet the requirements of people on various functions such as home cinema, game earphone, multi-room sound and the like.

The audio transmission method provided by the embodiment of the application is described below. Referring to fig. 2, fig. 2 is a flow chart of an audio transmission method according to an embodiment of the application. The audio transmission method shown in fig. 2 may be performed by an audio transmitting terminal.

For convenience of description, the number of the audio receiving ends is denoted as N, N is a positive integer greater than 1, and the audio receiving ends are in one-to-one correspondence with the communication links, so that the number of the communication links is also denoted as N. As an alternative implementation manner, each audio receiving end corresponds to one channel, so that the number of channels is also N, and corresponds to a communication link and a channel corresponding to the same audio receiving end, and the audio transmitting end transmits an audio data packet of the corresponding channel to the audio receiving end based on the communication link corresponding to the audio receiving end.

As shown in fig. 2, the method includes: within the first sub-event of the current isochronous interval,

in step 201, a target communication link and a target audio data packet to be transmitted in a first sub-event are determined, where one target audio data packet corresponds to one target communication link.

Each audio data packet corresponds to an audio receiving end, and each audio data packet can also be considered to correspond to a communication link. Thus, the target communication link may be determined at the same time as the target audio data packet to be transmitted within the first sub-event is determined.

It will be appreciated that if a plurality of target audio data packets for a target communication link are transmitted within a sub-event, the number of target communication links is less than the number of target audio data packets; if a target audio data packet of a target communication link is transmitted within a sub-event, the number of target communication links is the same as the number of target audio data packets. The configuration may be specifically configured according to the actual application scenario, and is not specifically limited herein. The inventive concept of the present application will be described mainly in the case where the number of target communication links is the same as the number of target audio packets in the embodiment of the present application.

The number of target audio data packets to be transmitted in the first sub-event is not limited herein. In a specific implementation, the number of target audio data packets to be transmitted in the first sub-event may be less than or equal to the number of transmit sub-slots.

In particular, the target audio data packet may include an audio data packet that is first transmitted, that is, an audio data packet that has not been transmitted before the first sub-event of the current isochronous interval, an audio data packet that has been transmitted before the first sub-event of the current isochronous interval but not acknowledged as correctly received, and an audio data packet that has been transmitted in the previous isochronous interval but not acknowledged as correctly received, which is not limited herein.

Step 202, allocating a transmission sub-slot in the first sub-event to each target communication link, where after allocation, at least one first transmission sub-slot exists in the first sub-event, and the target communication link corresponding to the first transmission sub-slot is different from the target communication link corresponding to a second transmission sub-slot in a second sub-event, where the second sub-event is a sub-event whose time domain position in the current isochronous interval is before the first sub-event, and the time domain position of the first transmission sub-slot in the first sub-event is the same as the time domain position of the second transmission sub-slot in the second sub-event.

For ease of understanding, the following description will be given by taking, as an example, a case in which 3 consecutive transmission sub-slots are included in one sub-event.

As an alternative implementation manner, in the case that the number of the target communication links is equal to the number of the transmission sub-slots, one transmission sub-slot is allocated to each target communication link, and the corresponding sequence of the target communication links and the transmission sub-slots can be flexibly adjusted according to the specific application scenario.

Illustratively, the target communication links include link 1, link 2 and link 3, and the number of the target communication links is the same as the number of the transmission sub-slots, and one transmission sub-slot is allocated to each target communication link at this time, but the order can be flexibly adjusted. For example, 3 consecutive transmit sub-slots may correspond to link 1, link 2, and link 3, respectively, or may correspond to link 2, link 1, and link 3, respectively.

Optionally, as another optional implementation manner, when the number of the determined target audio data packets is smaller than M, the target communication links corresponding to at least two transmission sub-slots in the M transmission sub-slots included in the first sub-event are the same. Herein, the number of the determined target audio data packets is denoted as T, which is a positive integer.

In the case that the number of the target communication links is smaller than the number of the transmission sub-slots, on the basis that one transmission sub-slot is allocated to each target communication link, the remaining transmission sub-slots can be allocated to at least part of the target communication links, so that the number of times of transmitting the corresponding target audio data packet in the first sub-event is increased.

Illustratively, the target communication link includes link 1 and link 2, the number of target communication links being less than the number of transmit sub-slots. At this time, one transmission sub-slot remains after the allocation of one transmission sub-slot for link 1 and link 2, and the transmission sub-slot may be allocated to link 1 or link 2. For example, 3 consecutive transmission sub-slots may be sequentially allocated to link 1, link 2, and link 1, 3 consecutive transmission sub-slots may be sequentially allocated to link 2, link 1, and link 2, or 3 consecutive transmission sub-slots may be sequentially allocated to link 2, and link 1.

In this embodiment, when the number of the target audio data packets is smaller than the number of the transmission sub-slots, the target communication links corresponding to at least two transmission sub-slots among the M transmission sub-slots included in the first sub-event are the same. In this case, there is a target communication link that can be allocated to at least two transmission sub-slots, and the number of times the target communication link transmits the audio data packet is at least two, thereby improving the reliability of audio transmission, while avoiding the waste of communication resources, and improving the utilization rate of the communication resources.

Optionally, as an optional implementation manner, when the determined number T of target audio data packets is smaller than M, the allocating a transmission sub-slot in the first sub-event for each target communication link includes:

respectively distributing T sending sub-slots in a first sub-event to target communication links corresponding to the T target audio data packets;

and distributing the transmission sub-time slots for the target communication links corresponding to part of the target audio data packets in the T target audio data packets based on the remaining M-T transmission sub-time slots in the first sub-event. And recording the number of the partial target audio data packets as L, wherein L is less than or equal to M-T.

And distributing the T sending sub-time slots to target communication links corresponding to the T target audio data packets, and ensuring that the T target audio data packets are all sent at least once. The positions of the T transmission sub-slots in the M consecutive sub-slots are not limited herein. The T transmit sub-slots may be the first T transmit sub-slots, or may be randomly chosen T transmit sub-slots, or T transmit sub-slots selected for frequency diversity.

For the remaining M-T transmission sub-slots, the allocation manner may have multiple different schemes under different application scenarios, and in specific implementation, the remaining M-T transmission sub-slots may be fully allocated or partially allocated.

Illustratively, in the case of T.gtoreq (M-T), as an alternative embodiment, M-T target audio data packets are selected from among the T target audio data packets, and a transmission sub-slot is allocated for each of the target communication links to which the M-T target audio data packets correspond. As another alternative, less than M-T target audio data packets are selected from the T target audio data packets, and a transmit sub-slot is allocated for each of the target communication links for which the less than M-T target audio data packets correspond.

In case T < (M-T), as an alternative embodiment, at least part of the audio data packets are selected from the T target audio data packets and at least one transmit sub-slot is allocated for each of the target communication links to which these data packets correspond until all of the M-T transmit sub-slots are allocated. As another alternative embodiment, at least some of the T target audio data packets are selected and each of the target communication links to which the data packets correspond is allocated a transmission sub-slot.

It should be understood that the foregoing is merely illustrative of several alternative embodiments, and that in a specific implementation, the number of transmission sub-slots allocated to each target communication link may be determined according to various factors such as the channel quality of the target communication link, the data type of the target audio data packet, the priority of the target audio data packet, the sequence number of the target communication link, and so on, so as to obtain different application effects.

Optionally, in some embodiments, the allocating, based on the remaining M-T transmission sub-slots in the first sub-event, a transmission sub-slot for a target communication link corresponding to a portion of the target audio data packets in the T target audio data packets includes:

selecting L target communication links with the lowest channel quality according to the determined channel quality of the target communication links, wherein L is a positive integer less than or equal to T;

according to a preset allocation principle, the remaining M-T sending sub-time slots are allocated to the L target communication links with the lowest channel quality;

the predetermined allocation principle includes: the number of transmission sub-slots allocated to the target communication link with low channel quality is not less than the number of transmission sub-slots allocated to the target communication link with high channel quality.

The value of L may be set and adjusted according to practical situations, and is not limited herein. As an alternative embodiment, L is a preset value. As another alternative embodiment, a quality threshold may be preset, and the target communication links with channel quality lower than the quality threshold are divided into L target communication links with lowest channel quality, where the value of L is flexible and is affected by the quality threshold. Alternatively, in some other alternative embodiments, the L value in different sub-events is changed along with the change of the T value (i.e. the number of target audio packets) and the M-T value (i.e. the number of remaining transmission sub-slots) in the sub-event, for example, when T ∈t in a certain sub-event is equal to or greater than (M-T), l=m-T in the sub-event is made, i.e. M-T target packets are selected from the T target audio packets for allocating the remaining M-T transmission sub-slots; when T < (M-T) in a certain sub-event, l=t in the sub-event is made, that is, at least T transmit sub-slots of the remaining M-T transmit sub-slots are allocated to the target communication links corresponding to the T target data packets.

In this embodiment, the remaining M-T transmit sub-slots are all allocated. In the case of l=m-T, the L target communication links with the lowest channel quality are each allocated to one transmission sub-slot. In the case of L < M-T, at least one of the L target communication links having the lowest channel quality may be allocated to at least two transmit sub-slots.

The M-T transmission sub-slots are allocated according to a predetermined allocation principle, and a specific allocation manner may be set according to actual situations. In the predetermined allocation principle, the low and high channel quality are relative concepts, and for any two target communication links in the L target communication links with the lowest channel quality, if the channel quality of the target communication link a is lower than that of the target communication link B, the number of allocated transmission sub-slots of the target communication link a should not be less than that of the target communication link B.

The probability of packet loss of the communication link with lower channel quality is larger, and by the method provided by the embodiment, on one hand, the target communication link with lower channel quality can be distributed to more transmission sub-time slots, so that more transmission opportunities are obtained, and the reliability of audio transmission is improved. On the other hand, the rest M-T transmission sub-slots are flexibly allocated, so that the waste of communication resources caused by idle transmission sub-slots can be reduced, the utilization rate of the transmission sub-slots is improved, and the link efficiency is improved.

In this embodiment, different radio resources may be adaptively allocated to different communication links, fewer radio resources may be allocated to a communication link with good channel quality, and more radio resources may be obtained by a communication link with poor channel quality, so as to improve link efficiency and transmission reliability of the wireless multichannel audio system.

And step 203, transmitting a target audio data packet corresponding to the target communication link based on the target communication link in the transmission sub-time slot of the first sub-event.

Specifically, in each allocated transmission sub-slot of the first sub-event, the audio transmitting end transmits a corresponding target audio data packet in the transmission sub-slot based on the target communication link corresponding to the transmission sub-slot.

And the audio receiving end sequentially receives the M sending sub-slots based on the communication links corresponding to the audio receiving end so as to acquire a target audio data packet corresponding to the audio receiving end.

In each sub-event, the audio transmitting end can redetermine the target communication link and the target audio data packet to be transmitted in the sub-event, and assigns a transmitting sub-time slot in the sub-event for each target communication link, so that the audio receiving end sequentially receives in M transmitting sub-time slots based on the communication link corresponding to the audio receiving end in any sub-event so as to acquire the target audio data packet corresponding to the audio receiving end.

The specific manner in which the audio receiving end receives the audio data packet is not limited herein. As the audio receiving end cannot know the allocation condition of the sending sub-time slots in the sub-event in advance, as an optional implementation manner, the audio receiving end sequentially receives the target audio data packet in each sending sub-time slot until the audio receiving end receives the corresponding target audio data packet and stops receiving. As another optional implementation manner, the audio receiving end receives the corresponding target audio data packet in the process of traversing all the transmission sub-time slots so as to avoid omission and ensure the receiving reliability of the audio receiving end on the target audio data packet.

Optionally, the sub-event further includes K consecutive receiving sub-slots, where K is a positive integer;

and a receiver sub-slot is used for the audio transmitting end to receive an acknowledgement data packet sent by the audio receiving end on a communication link, and the acknowledgement data packet is used for indicating whether the audio receiving end correctly receives the corresponding audio data packet.

Under the condition that the audio receiving end needs to feed back the confirmation information, the audio receiving end can occupy a receiving sub-time slot for sending the confirmation data packet based on the corresponding communication link, and feeding back the receiving condition of the audio receiving end on the audio data packet to the audio sending end.

It should be understood that the number of K is not limited herein, and K may be smaller, equal to, or larger than the number N of audio receiving terminals. As an alternative implementation manner, K is larger than or equal to N, and at least one receiving sub-time slot is allocated to the communication link corresponding to each audio receiving end, so that each audio receiving end can reply to the confirmation data packet through the corresponding receiving sub-time slot. As another alternative embodiment, K < N, K receiving sub-slots are allocated to the communication links corresponding to the partial audio receivers, and only the partial audio receivers need to reply to the acknowledgement packet. As another alternative embodiment, at least two receiving sub-slots may be allocated to a communication link corresponding to a part of the audio receiving end, so as to increase the probability that the acknowledgement data packet sent by the audio receiving end is correctly received by the audio transmitting end.

Optionally, in some embodiments, the step 201 further includes:

determining a target audio receiving end; the target audio receiving end is at least one part of audio receiving ends in the audio receiving ends corresponding to the target audio data packet, and the target audio receiving end needs to feed back a confirmation data packet;

configuring the target audio data packet to carry indication information, wherein the indication information is used for indicating the determined target audio receiving end;

After the step 203, the method further includes:

and in the receiving sub-time slot of the first sub-event, receiving the acknowledgement data packet sent by the target audio receiving end on the target communication link corresponding to the target audio receiving end.

The number of target receiving ends is not limited herein, and only the target audio receiving ends need to feed back the acknowledgement data packet, and other audio receiving ends do not need to feed back the acknowledgement data packet. After receiving the target audio data packet, the audio receiving end can judge whether the audio receiving end needs to feed back the confirmation data packet or not based on the indication information.

Specifically, after receiving and obtaining a target audio data packet corresponding to the audio receiving end, the audio receiving end judges whether the audio receiving end is the target audio receiving end or not based on the indication information. And under the condition that the audio receiving end is a target audio receiving end, in a receiving sub-time slot of the sub-event, sending a confirmation data packet on a communication link corresponding to the target audio receiving end, wherein the confirmation data packet carries confirmation information, and the confirmation information is used for indicating whether the target audio receiving end successfully receives the corresponding target audio data packet. In the case that the audio receiving end is not the target audio receiving end, the audio receiving end does not need to feed back a confirmation data packet to the audio transmitting end.

Further, in some embodiments, the indication information is a first acknowledgement link mapping table set in the header of the target audio data packet, where the first acknowledgement link mapping table indicates a sequence number of a communication link corresponding to the target audio receiving end determined by the audio sending end;

and under the condition that the audio receiving end is a target audio receiving end, the audio receiving end selects a receiving sub-time slot at a corresponding position from the K receiving sub-time slots according to the sequence of the sequence numbers of the communication links indicated by the first confirmation link mapping table, and sends a confirmation data packet in the selected receiving sub-time slot.

For example, the number of communication links is 4, and the sequence numbers are sequentially 1, 2, 3 and 4, wherein the first acknowledgement link mapping table indicates that the sequence number of the communication link corresponding to the target audio receiving end is 2, 3 and 4. The target audio receiving end corresponding to the communication link with the sequence number of 3 knows that the audio receiving end corresponding to the communication link with the sequence number of 2 is also the target audio receiving end based on the first acknowledgement link mapping table, so that the target audio receiving end corresponding to the communication link with the sequence number of 3 selects to send the acknowledgement data packet in the second receiving sub-time slot.

In this embodiment, when the audio receiving end is the target audio receiving end, the audio receiving end selects a receiving sub-slot in a corresponding position from the K receiving sub-slots according to the sequence of the sequence numbers of the communication links indicated by the first acknowledgement link mapping table, and sends the acknowledgement packet in the selected receiving sub-slot. By the method, the audio receiving end can reasonably select the corresponding receiving sub-time slot, so that the allocation of the receiving sub-time slot is automatically completed at the audio receiving end side, and the reasonability of the sequence of the target audio receiving end for transmitting the confirmation data packet is improved.

It may be understood that the audio transmitting end may also allocate a corresponding receiving sub-slot to each target audio receiving end through the indication information, for example, arrange indication marks of the target audio receiving ends in the indication information (such as a serial number of a communication link corresponding to the target audio receiving end, an equipment address of the target audio receiving end, etc.) according to a time sequence of the allocated receiving sub-slots, or may also configure a serial number of the receiving sub-slot corresponding to each target audio receiving end in the indication information. Correspondingly, the audio transmitting end sequentially receives the acknowledgement data packets sent by the corresponding target audio receiving end based on the corresponding target communication link in the corresponding receiving sub-time slots according to the allocation condition.

As an optional implementation manner, when the number of the receiving sub-slots is greater than that of the target audio receiving ends, in order to improve the utilization rate of the receiving sub-slots and reduce the waste of communication resources, on the basis of ensuring that each target audio receiving end corresponds to one receiving sub-slot, at least part of the target audio receiving ends can select at least two receiving sub-slots to repeatedly send the acknowledgement data packet, thereby improving the receiving success rate of the audio transmitting end on the acknowledgement data packet. It can be understood that the audio transmitting end can also specify the target audio receiving end that repeatedly transmits the acknowledgement data packet through the indication information.

In this embodiment, the target audio receiving end is at least part of the audio receiving ends corresponding to the target audio data packet. By the method, at least part of the audio receiving terminals can be appointed to feed back the confirmation data packet, and all the audio receiving terminals are not necessarily required to feed back the confirmation data packet, so that the proportion of time slots occupied by the receiving sub-time slots in one sub-event is reduced, and the link efficiency is improved.

It will be appreciated that various methods may be used to select the target audio receiver that needs to feed back the acknowledgement information, for example, according to the quality of the link communication, or according to the sequence number of the communication link, or according to the receiving situation of the target audio data packet, or according to the data type or priority of the target audio data packet, etc.

Optionally, in some embodiments, the determining the target audio receiving end includes:

according to a preset selection principle, R target audio receiving ends are selected from T audio receiving ends respectively corresponding to T target audio data packets to be sent in the first sub-event, wherein R is a positive integer less than or equal to K;

the predetermined selection criteria include:

preferably selecting an audio receiving end which has been required to feed back the confirmation data packet but the corresponding target audio data packet is not confirmed to be received correctly, as the target audio receiving end,

secondly, selecting an audio receiving end corresponding to a target communication link with optimal channel quality as the target audio receiving end,

and finally, selecting the audio receiving end of which the corresponding target audio data packet is sent but not required to feed back the confirmation data packet as the target audio receiving end.

It should be appreciated that in some embodiments, the value of R may be predetermined, and the specific value may be adjusted and set according to the actual application scenario. In other embodiments, the R value in different sub-events may also change along with the change of the value of T, for example, when T is greater than or equal to K, r=k may be set, that is, K target audio receiving ends are selected from the audio receiving ends corresponding to the T target audio data packets; when T < K, r=t may be set, that is, all the audio receiving ends corresponding to the T target audio data packets are required to reply the acknowledgement data packet.

Failure of the target audio data packet to be acknowledged to be received correctly includes two situations. In the first case, the audio receiving end corresponding to the target audio data packet feeds back the acknowledgement data packet to the audio sending end, and the audio sending end receives the acknowledgement data packet and confirms that the target audio data packet is not correctly received by the corresponding audio receiving end based on the acknowledgement data packet. In another case, the audio receiving end corresponding to the target audio data packet feeds back the acknowledgement data packet to the audio sending end, but the audio sending end does not correctly receive the acknowledgement data packet, so that the receiving condition of the audio receiving end on the target audio data packet cannot be known. When the above situation exists in the T target audio data packets, the audio receiving end is preferentially selected as the target audio receiving end.

And when the target audio receiving end still has the remaining name, comparing the channel quality of each communication link, and selecting the audio receiving end corresponding to the target communication link with the optimal channel quality as the target audio receiving end. The better the communication link with better communication quality, the lower the probability of packet loss occurs, the better the communication quality, the better the communication link with better communication quality, the better the audio receiving end corresponding to the target communication link is selected as the target audio receiving end, and the receiving condition of the corresponding target data packet can be confirmed as early as possible, thereby reducing the chance that the communication link with better communication quality occupies the transmitting sub-time slot and the receiving sub-time slot in the next sub-event, reserving more time slot resources for the communication link with poor communication quality, and further improving the link efficiency.

On the basis, if the target audio receiving end still has the remaining name, selecting the audio receiving end of which the target audio data packet is sent but not required to feed back the confirmation data packet as the target audio receiving end.

Optionally, in some embodiments, in the receiving sub-slot of the first sub-event, receiving, on a target communication link corresponding to the target audio receiving end, an acknowledgement packet sent by the target audio receiving end, where the acknowledgement packet includes:

and sequentially receiving the acknowledgement data packets in the K continuous receiving sub-time slots based on the corresponding target communication links according to the sequence of the sequence numbers of the corresponding target communication links of the determined target audio receiving terminals.

It should be appreciated that in order to distinguish between the communication links, a sequence number is pre-set for each communication link. The target audio receiving end sequentially selects corresponding receiving sub-time slots according to the sequence numbers of the corresponding target communication links, and sends the confirmation data packets based on the corresponding target communication links in the corresponding receiving sub-time slots. The audio transmitting end sequentially receives the acknowledgement data packet sent by each target audio receiving end in K continuous receiving sub-time slots based on the corresponding target communication link.

Optionally, as an optional implementation manner, the packet header of the audio data packet carries first information, where the first information is used to indicate a serial number of a communication link corresponding to the audio data packet;

the audio receiving end receives in each transmission sub-slot in turn from the first transmission sub-slot of the M transmission sub-slots based on the communication link corresponding to the audio receiving end, wherein,

receiving a packet header of the audio data packet in a current transmission sub-slot, acquiring a sequence number indicated by the first information, and judging whether a communication link corresponding to the current transmission sub-slot is a communication link corresponding to the audio receiving end or not based on the sequence number;

and under the condition that the communication link corresponding to the current transmission sub-time slot is the communication link corresponding to the audio receiving end, the load of the audio data packet is received in the current transmission sub-time slot.

In each transmitting sub-time slot, the audio receiving end receives the packet header of the audio data packet transmitted in the transmitting sub-time slot, and obtains the serial number indicated by the first information from the packet header. From the sequence number it is possible to determine which communication link the currently received audio data packet corresponds to. The audio receiving end, the communication link and the audio data packet are in one-to-one correspondence. Therefore, the audio receiving end can judge whether the audio data packet is the corresponding audio data packet based on the serial number indicated by the first information.

And under the condition that the communication link corresponding to the audio data packet is the same as the communication link corresponding to the audio receiving end, the audio data packet can be judged to be the corresponding audio data packet, so that the load of the audio data packet is received, and otherwise, the load of the audio data packet is not received.

In this embodiment, the packet header of the audio data packet carries the first information, and the audio receiving end may first receive the packet header of the audio data packet. By the method, the audio receiving end can judge whether to continue to receive the load of the audio data packet only by receiving the packet head of the audio data packet, and only receives the load of the audio data packet under the condition that the audio data packet is the corresponding data packet, and the load of each audio data packet is not required to be received, so that the power consumption can be reduced.

Optionally, in some embodiments, after the audio receiving end receives the load of the audio data packet in the current transmission sub-slot, when determining that the load of the audio data packet is not received correctly, the audio receiving end continues to receive in the next transmission sub-slot until the target audio data packet corresponding to the audio receiving end is received correctly, or completes the receiving in the last transmission sub-slot.

Optionally, in some embodiments, when the second sub-event is the first sub-event of the current isochronous interval, the method includes: during the second sub-event of the current equal interval,

determining a target communication link and a target audio data packet to be sent in a second sub-event, wherein one target audio data packet corresponds to one target communication link;

allocating M transmit sub-slots in the second sub-event to the target communication links, respectively, wherein each target communication link is allocated with at least one transmit sub-slot;

and transmitting a target audio data packet corresponding to the target communication link based on the target communication link in a transmitting sub-time slot of the second sub-event.

Further, when the second sub-event is the first sub-event of the current isochronous interval, the second sub-event further includes K consecutive receiving sub-slots therein, the method further includes:

determining a target audio receiving end; the target audio receiving end is a part of audio receiving ends in the audio receiving ends respectively corresponding to the target audio data packets to be sent in the second sub-event, and the target audio receiving ends need to feed back the confirmation data packets; configuring the target audio data packet to carry indication information, wherein the indication information is used for indicating the determined target audio receiving end; and in the receiving sub-time slot of the second sub-event, receiving an acknowledgement data packet sent by the target audio receiving end based on a target communication link corresponding to the target audio receiving end.

It can be understood that, when the second sub-event is the first sub-event in the current isochronous interval, the above steps may also be implemented by using the related technical details of the first sub-event, which are not described herein. And when the second sub-event is not the first sub-event, the second sub-event corresponds to the first sub-event.

Optionally, in some embodiments, the header of the audio data packet is configured with one or more of the following information:

the first expected sequence number is used for representing the sequence number of a next acknowledgement data packet expected to be received by the audio sending end on a communication link corresponding to the audio data packet;

the first preset sequence number is used for representing the sequence number of the audio data packet;

the first information is used for indicating the serial number of the communication link corresponding to the audio data packet;

a first acknowledgement link mapping table, where the first acknowledgement link mapping table is used to indicate a sequence number of a communication link corresponding to a target audio receiving end;

and the number of the remaining data packets is used for representing the number of the audio data packets to be transmitted remaining in the current sub-event.

For convenience of description, a communication link corresponding to a current audio data packet is referred to as a link a, and an audio receiving end corresponding to the current audio data packet is referred to as a receiving end a. The first expected sequence number is used to characterize the sequence number of the next acknowledgement packet that the audio sender expects to receive on link a. After receiving the current audio data packet, the receiving end a can determine the next acknowledgement data packet to be sent based on the first expected sequence number, and can also determine whether the last acknowledgement data packet sent is correctly received by the audio sending end.

The first preset sequence number is used for representing the sequence number of the current audio data packet. It should be understood that, in the audio transmission process, the audio transmitting end transmits corresponding audio data streams to each audio receiving end based on each communication link, and for the audio data streams transmitted on each communication link, the audio data are encapsulated into audio data packets one by one, and each audio data packet is programmed with a serial number, that is, the first preset serial number, so as to be distinguished from other audio data packets in the audio stream where the audio data packet is located.

The first information is used to indicate a sequence number of link a, the sequence number of the communication link being predetermined. For example, the sequence number of a communication link may be determined when the communication link is established.

The first confirmation link mapping table is used for indicating the serial number of the communication link corresponding to the target audio receiving end, and the audio receiving end can judge whether the audio receiving end is the target audio receiving end or not at least based on the first link mapping table after receiving the audio data packet.

The number of the remaining data packets is used for representing the number of the remaining audio data packets to be sent in the current sub-event, and after the audio receiving terminal receives the audio data packets, the audio receiving terminal can judge the number of the audio data packets to be sent in batches at present based on the number of the remaining data packets, so that the audio receiving terminal can conveniently judge when to start feeding back the confirmation data packets.

Optionally, in some embodiments, the acknowledgement data packet includes a second expected sequence number, the second expected sequence number being used to characterize a sequence number of a next audio data packet expected to be received by the audio receiving end on a corresponding communication link;

the acknowledgement data packet also carries a second preset sequence number, and the second preset sequence number is used for representing the sequence number of the acknowledgement data packet.

For convenience of description, the communication link corresponding to the current acknowledgement packet is referred to as a link B, and the audio receiving end corresponding to the current acknowledgement packet is referred to as a receiving end B. The second expected sequence number is used to characterize the sequence number of the next audio data packet that receiver B expects to receive on link B. After receiving the current acknowledgement data packet, the audio transmitting end may determine the next audio data packet to be transmitted based on the second expected sequence number, or may confirm whether the last audio data packet transmitted on the link B is correctly received by the receiving end B.

The second preset sequence number is used for representing the sequence number of the current acknowledgement data packet. It will be appreciated that each acknowledgement packet may also be serialized so as to be distinguishable from other acknowledgement packets.

As an alternative implementation manner, the embodiment of the present application may refer to the BLE synchronous isochronous channel (Isochronous Channels) protocol to set the structure of the data packet in this embodiment, for example, the packet header structure of the audio data packet may refer to the structure of the header of the BIS protocol data unit (Protocol Data Unit, PDU), and the packet header structure of the acknowledgment data packet may refer to the structure of the header of the CIS protocol data unit. Therefore, the AHIS and AHIG protocols of the embodiment of the application can be better compatible with the existing BLE communication protocol.

In order to distinguish from the prior art, the Header of the data packet in the embodiment of the present application is referred to as an Extended Header (Extended Header). In the embodiment of the application, the audio data packet generated by the audio transmitting end is named as an adaptive mixing isochronous stream audio transmitting end (Adaptive Hybrid Isochronous Stream Master, AHISM) PDU, and the acknowledgement data packet generated by the audio receiving end is named as an adaptive mixing isochronous stream audio receiving end (Adaptive Hybrid Isochronous Stream Slave, AHISS) PDU. The AHISM PDU has the same structure as the BLE BIS PDU but has a different Header format, i.e., BIS PDU using an Extended Header. The AHISS PDU has the same format as the BLE CIS PDU but has a different Header format, i.e. the CIS PDU using an Extended Header.

For example, referring to fig. 3a, the ahism PDU header format is shown in fig. 3 a. On the basis of the BIS PDU header, a 1-bit (bit) reserved field (Reserved for Future Use, RFU) is set to AHIGM for indicating the enabling AHISM PDU. An AHIGM field value of 0 indicates that the AHISM PDU is not enabled, and an AHIGM field value of 1 indicates that the AHISM PDU is enabled. When enabling the AHISM PDU, the extension packet header is added with a certain number of bytes, and contains at least one field in AHIS Num (i.e. first information), AHIS SN (i.e. first preset sequence number), AHIS NESN (i.e. first expected sequence number), ACK MT (i.e. first acknowledgement link mapping table), PDU Num. The AHIS Num is used to indicate which AHIS link the current AHISM PDU belongs to. The AHIS SN is used to indicate the Sequence Number (SN) of the current AHIS Link AHISM PDU. The AHIS NESN is used to indicate the expected sequence number (Next Expected Sequence Number, NESN) next to the current AHIS link AHISS PDU. The ACK MT is used to indicate a Mapping Table (MT) of an AHIS link for which acknowledgement information (ACK) is required to be replied, each bit corresponds to one AHIS link, and, without loss of generality, bits from low to high sequentially correspond to an AHIS Num value from low to high, a bit set to 1 indicates that the corresponding AHIS link is required to reply to the acknowledgement information, and a bit set to 0 indicates that the corresponding AHIS link is required to not reply to the acknowledgement information. The PDU Num is used to indicate how much AHISM PDU currently transmitted in batch is left, for example, when PDU Num is 0, it indicates that the current AHISM PDU is the last AHISM PDU transmitted in batch this time, and the next time slot is used for the monaural audio receiving end to transmit acknowledgement information. The function and usage of the AHISM PDU extension header other fields are the same as that of the BIS PDU, including a logical link identifier (Logical Link Identifier, LLID) for indicating the type of AHISM PDU payload, a control sub-event sequence number (Control Subevent Sequence Number, CSSN), a control sub-event transmission flag (Control Subevent Transmission Flag, CSTF), the Length of AHISM PDU payload, and a 1-bit RFU.

For example, referring to fig. 3b, the format of the AHISS PDU extension header is shown in fig. 3b, and the 1-bit RFU is set to AHIGS on the basis of the CIS PDU header, to indicate that the AHISS PDU is enabled. An AHIGS field value of 0 indicates that the AHISS PDU is not enabled, and an AHIGS field value of 1 indicates that the AHISS PDU is enabled. When the AHIS PDU is enabled, the extension packet header is added with a certain number of bytes, and at least comprises an AHIS Num domain. The AHIS Num is used to indicate which AHIS link the current AHIS PDU belongs to. The meaning of other fields of the AHISS PDU packet header is the same as that of the CIS PDU packet header. A logical link identification (Logical Link Identifier, LLID) is used to indicate the payload type of the AHISS PDU. The second expected Sequence Number (Next Expected Sequence Number, NESN) indicates the Sequence Number of the next AHISM PDU expected to be received by the audio receiving end on the AHIS Num communication link, and the second preset Sequence Number (SN) is the Sequence Number of the current AHISM PDU. The shutdown isochronous event (Close Isochronous Event, CIE) is used to indicate whether the isochronous event is ended. The Null PDU identifier (Null PDU Indicator, NPI) indicates whether the PDU is CIS Data PDU (Data PDU) or CIS Null PDU (Null PDU) in CIS PDU, and indicates whether the PDU is AHISS Data PDU or AHISS Null PDU in AHISS PDU. Length represents the payload Length of the AHISS PDU.

The first expected sequence number, the first preset sequence number, the second expected sequence number, and the second preset sequence number may be configured in various manners according to a specific application scenario, for example, may be configured with reference to a relevant rule in the CIG, which is not specifically limited in the present application.

In the embodiment of the application, in a first sub-event of the current time interval, a target communication link and a target audio data packet to be transmitted in the first sub-event are determined, a transmission sub-time slot in the first sub-event is allocated for each target communication link, and in the transmission sub-time slot of the first sub-event, a target audio data packet corresponding to the target communication link is transmitted based on the target communication link. By the method, the allocation mode of the sending sub-time slots in each sub-event is not fixed, the sending sub-time slots can be flexibly allocated according to the current communication condition, the positions and the number of the sending sub-time slots corresponding to each target communication link are adjusted, the time slots are prevented from being wasted, and the utilization rate of communication resources and the transmission efficiency of the communication links are improved.

Referring to fig. 4, the embodiment of the present application further provides an audio transmission method, which is applied to an audio receiving end, where the audio receiving end corresponds to one communication link of a plurality of communication links, and the audio receiving end communicates with an audio transmitting end in a continuous isochronous interval to receive corresponding audio data, where one isochronous interval includes a plurality of sub-events, and one sub-event includes M continuous transmission sub-slots, and one transmission sub-slot is used for the audio transmitting end to transmit an audio packet of one communication link.

As shown in fig. 4, the method specifically includes the following steps: within any one sub-event of the current isochronous interval,

step 401, based on the communication link corresponding to the audio receiving end, sequentially receiving in the M transmission sub-slots, so as to obtain a target audio data packet corresponding to the audio receiving end.

Optionally, in some embodiments, a packet header of the audio data packet carries first information, where the first information is used to indicate a sequence number of a communication link corresponding to the audio data packet;

the step 401 includes:

based on the communication link corresponding to the audio receiving end, the audio receiving end receives in each transmission sub-slot in turn from the first transmission sub-slot of the M transmission sub-slots, wherein,

Optionally, after the receiving the load of the audio data packet in the current transmission sub-slot, the method further includes:

and when the load of the audio data packet is not correctly received, continuing to receive in the next transmission sub-slot until the target audio data packet corresponding to the audio receiving end is correctly received, or completing the receiving in the last transmission sub-slot.

Optionally, in some embodiments, K consecutive receiving sub-slots are further included in one sub-event, where K is a positive integer;

the target audio data packet carries indication information, and the indication information is used for indicating a target audio receiving end determined by the audio sending end;

the method further comprises the steps of:

after receiving and obtaining the target audio data packet corresponding to the audio receiving end,

judging whether the audio receiving end is a target audio receiving end or not based on the indication information;

and under the condition that the audio receiving end is a target audio receiving end, in a receiving sub-time slot of the sub-event, sending a confirmation data packet on a communication link corresponding to the target audio receiving end, wherein the confirmation data packet carries confirmation information, and the confirmation information is used for indicating whether the target audio receiving end successfully receives the corresponding target audio data packet.

Optionally, in some embodiments, the indication information is a first acknowledgement link mapping table set in the header of the target audio data packet, where the first acknowledgement link mapping table indicates a sequence number of a communication link corresponding to the target audio receiving end determined by the audio sending end;

and when the audio receiving end is the target audio receiving end, sending a confirmation data packet on a communication link corresponding to the target audio receiving end in a receiving sub-time slot of the sub-event, wherein the confirmation data packet comprises:

and selecting a receiving sub-time slot at a corresponding position from the K receiving sub-time slots according to the sequence of the sequence numbers indicated by the first acknowledgement link mapping table, and transmitting acknowledgement data packets in the selected receiving sub-time slot.

It should be noted that, this embodiment is an embodiment of the audio receiving end corresponding to the embodiment of the method of fig. 2, so reference may be made to the description related to the embodiment of the method of fig. 2, and the same beneficial effects may be achieved. In order to avoid repetition of the description, a description thereof will be omitted.

For ease of understanding, a BLE Audio wireless 5.1 channel sound system will be described below as an example.

As shown in fig. 1, in a wireless 5.1 channel application, the wireless multi-channel audio transmission device is a bar stereo, smart tv or other audio transmission device, and the center channel and the subwoofer channel are played locally to the wireless multi-channel audio transmission device. The wireless multichannel audio transmitting equipment is in wireless connection with at most four mono audio receiving ends, namely four wireless mono audio boxes, which correspond to a front left channel audio box, a front right channel audio box, a rear left surround channel audio box and a rear right surround channel audio box respectively through an AHIS link. The wireless multi-channel audio transmitting device is a wireless four-channel audio transmitting device, and transmits four channels of audio, a front left channel, a front right channel, a rear left surround channel and a rear right surround channel. Each mono audio receiving end receives a sound channel corresponding to a front left sound channel, a front right sound channel, a rear left surrounding sound channel and a rear right surrounding sound channel respectively. The wireless four-channel audio transmitting device establishes an AHIS1 link (corresponding to AHIS Num equal to 1), an AHIS2 link (corresponding to AHIS Num equal to 2), an AHIS3 link (corresponding to AHIS Num equal to 3) and an AHIS4 link (corresponding to AHIS Num equal to 4) with a front left channel sound box (mono audio receiving end 1), a front right channel sound box (mono audio receiving end 2), a rear left surround channel sound box (mono audio receiving end 3) and a rear right surround channel sound box (mono audio receiving end 4) of the wireless four-channel sound box respectively. AHIS1, AHIS2, AHIS3 and AHIS4 constitute AHIG. The AHISM field of the AHISM PDU extension header as shown in fig. 3a is assigned a value of 1, and the extension header is incremented by 2 bytes. Wherein, AHIS Num field 3 bits, AHIS SN field 1 bit, AHIS NESN field 1 bit, ACK MT field 8 bits, PDU Num field 3 bits. The AHIGS field of the AHISS PDU extension header as shown in FIG. 3b is assigned 1, and the extension header is incremented by 1 byte as the AHIS Num field.

Specifically, the sampling rate of the digital audio signal of each channel is 48kHz, and the number of quantization bits per sampling point is 16. The digital audio signal of each channel is encoded with a low complexity communication codec (Low Complexity Communication Codec, LC 3) having a frame length (frame length) of 10ms and a coding rate of 80kbps, and each frame of audio data after encoding is 100 bytes. An adaptive wireless four-channel audio system based on the AHIG protocol adopts a slot structure as shown in fig. 5a and 5b, in which the communication time is divided into 10ms isochronous intervals (Isochronous Interval), each of which starts with an AHIG Anchor Point (Anchor Point). With BLE 2Mbps transmission rate, one AHISM PDU contains one frame of 100 bytes of audio data, one encrypted AHISM PDU occupies an air time of 468us, the minimum slot interval (Time of Minimum Slot Space, t_mss) is 150us, and the AHISM Null PDU carrying acknowledgement information occupies an air time of 48us. Within each isochronous interval, 3 sub-event (SE) slots are included for the wireless four-channel audio transmitting device to transmit AHISM PDUs in bulk to the wireless four-channel speakers. Each subvent contains the time when the wireless multichannel audio transmitting device continuously transmits four AHISM PDUs and the time when the single-channel audio receiving terminal transmits two AHISS Null PDUs carrying acknowledgement information, and the air duration occupied by each subvent, namely SE interval (Subevent Interval), is equal to 2.868ms. Each time interval also contains a time of at most 0.771ms when the wireless multichannel audio transmitting device transmits an AHIGC PDU (MAHIGC) and the monophonic audio receiving end transmits the AHIGC PDU (S AHIGC). Wherein, the time slots of all audio receiving ends for transmitting AHIGC PDU are overlapped, and the transmission will interfere with each other. Therefore, each audio receiving end transmits the AHIGC PDU in different time intervals through random delay so as to avoid mutual interference. Each isochronous interval also contains 0.625ms of Period Advertisement (PA) PDU sent by the audio sending end for synchronization of the audio receiving end, and definition and function of the PA PDU are specified by BLE protocol.

As shown in fig. 5a, in an equal time interval, the wireless four-channel audio transmitting apparatus sequentially transmits four-channel AHISM PDUs in batches, which are sequentially identified as an AHISM PDU S1, an AHISM PDU S2, an AHISM PDU S3, and an AHISM PDU S4, wherein the AHIS Num of the extension packet header is sequentially 1,2,3, and 4; PDU Num is 3,2,1,0 in turn; the value of the ACK MT is 3, the corresponding 0 th bit and 1 st bit are set to be 1, and the other bits are all 0, namely, only the AHIS links with AHIS Num of 1 and 2 or the corresponding mono audio receiving end are required to reply the AHISS Null PDU carrying the confirmation information. After the mono audio receiving end with the AHIS Num of 1 and 2 correctly receives the AHISM PDU S1 and the AHISM PDU S2, the AHISS Null PDU (ACK 1 and ACK 2) carrying the confirmation information is replied, wherein the NESN is set to a new value (originally set to 0 and newly set to 1 and originally set to 0) which represents that the AHISM PDU S1 and the AHISM PDU S2 sent by the wireless four-channel audio sending equipment are correctly received. After the wireless four-channel audio transmitting equipment correctly receives the ACK1 and the ACK2, when the AHISM PDU is transmitted in batches for the second time, only AHISM PDU S3 and AHISM PDU S4 corresponding to AHIS Num of 3 and 4 are repeatedly transmitted, and the AHISM PDU S3 and the AHISM PDU S4 are repeatedly transmitted for 2 times. The AHIS Num of the extension packet header of the four AHISM PDUs transmitted in batch for the second time is 3,4,3,4 in sequence; the AHIS SN and AHIS NESN remain unchanged; PDU Num is 3,2,1,0 in turn; the value of ACK MT is 12, the corresponding 2 nd bit and 3 rd bit are set to 1, and the other bits are all 0, that is, the AHIS link or the corresponding mono audio receiving end requiring the AHIS Num to be 3 and 4 replies the AHIS Null PDU carrying the acknowledgement information. After the mono audio receiving end with the AHIS Num of 3 and 4 correctly receives the AHISM PDU S3 and the AHISM PDU S4, the AHISS Null PDU (ACK 3 and ACK 4) carrying the confirmation information is replied, wherein the NESN is set to a new value (originally set to 0 and 1 and originally set to 0) which represents that the AHISM PDU S3 and the AHISM PDU S4 sent by the wireless four-channel audio sending device are correctly received. And after the wireless four-channel audio transmitting equipment correctly receives the ACK3 and the ACK4, stopping transmitting. It can be seen that in the example shown in fig. 5a, the AHIS links with AHIS Num of 1 and 2 have good channel quality, and are preferentially required to reply to the acknowledgement information, and the AHISM PDU S1 and the AHISM PDU S2 need to be transmitted only once. And the AHIS links with AHIS Num of 3 and 4 have poor channel quality, AHISM PDU S3 and AHISM PDU S4 obtain 3 times of transmission opportunities, three times of transmission are correctly received once, and the wireless four-channel audio transmission equipment can stop batch transmission. Compared with the BLE Audio BIG protocol, under the condition that the Audio data of each channel has only two batch transmission opportunities, the Audio data of each channel has only 2 transmission opportunities.

By adopting the audio transmission method provided by the embodiment of the invention, the AHISM PDU S3 and the AHISM PDU S4 have more retransmission opportunities, thereby improving the reliability of wireless multichannel transmission. Compared with BLE Audio CIG protocol in the prior art, after the wireless multichannel Audio transmitting equipment transmits AHISM PDU of 4 AHIS links in batches, only 2 AHIS links reply acknowledgement information, thereby improving the link efficiency of wireless multichannel Audio transmission.

As shown in fig. 5b, in an equal time interval, the wireless four-channel audio transmitting apparatus sequentially transmits four-channel AHISM PDUs in batches, which are sequentially identified as an AHISM PDU S1, an AHISM PDU S2, an AHISM PDU S3, and an AHISM PDU S4, wherein the AHIS Num of the extension packet header is sequentially 1,2,3, and 4; PDU Num is 3,2,1,0 in turn; the value of ACK MT is 3, the corresponding 0 th bit and 1 st bit are set to 1, and the other bits are all 0, that is, the AHIS link or the corresponding mono audio receiving end requiring the AHIS Num to be 1 and 2 replies the AHIS Null PDU carrying the acknowledgement information. After the receiving end of the mono audio with the AHIS Num of 2 correctly receives the AHISM PDU S2, the receiving end replies an AHISS Null PDU (ACK 2) carrying acknowledgement information, wherein the NESN is set as a new value to represent that the AHISM PDU S2 sent by the wireless four-channel audio sending equipment is correctly received. And the mono audio receiving terminal with the AHIS Num of 1 does not correctly receive the AHISM PDU S1, replies an AHISS Null PDU (ACK 1) carrying acknowledgement information, wherein the value of NESN remains unchanged to represent that the AHISM PDU S1 sent by the wireless multichannel audio sending equipment is not correctly received. After the wireless four-channel audio transmitting equipment correctly receives the ACK1 and the ACK2, when the AHISM PDU is transmitted in batches for the second time, the AHIS Num is the AHISM PDU S1, the AHISM PDU S3 and the AHISM PDU S4 corresponding to 1, 3 and 4 are repeatedly transmitted. Because the channel quality of AHIS Num of 3 is better than that of AHIS Num of 4, AHISM PDU S3 is less frequently than AHISM PDU S4. The AHIS Num of the extension packet header of the four AHISM PDUs transmitted in batch for the second time is 1,4,3,4 in sequence; the AHIS SN and AHIS NESN remain unchanged; PDU Num is 3,2,1,0 in turn; the value of ACK MT is 5, the corresponding 0 th bit and 2 nd bit are set to 1, and the other bits are all 0, that is, the AHIS link or the corresponding mono audio receiving end requiring the AHIS Num to be 1 and 3 replies the AHIS Null PDU carrying the acknowledgement information. After the mono audio receiving end with the AHIS Num of 1 and 3 correctly receives the AHISM PDU S1 and the AHISM PDU S3, the AHISS Null PDU (ACK 1 and ACK 3) carrying the confirmation information is replied, wherein the NESN is set to a new value to represent that the AHISM PDU S1 and the AHISM PDU S3 sent by the wireless four-channel audio sending equipment are correctly received. And the wireless four-channel audio transmission equipment correctly receives the ACK1, but does not correctly receive the ACK3, and repeatedly transmits the AHIS Num to be the AHISM PDU S3 and the AHISM PDU S4 corresponding to 3 and 4 when the AHISM PDU is transmitted in batches for the third time. The AHIS Num of the extension packet header of the four AHISM PDUs transmitted in batch for the third time is 3,4,3,4 in sequence; the AHIS SN and AHIS NESN remain unchanged; PDU Num is 3,2,1,0 in turn; the value of ACK MT is 12, the corresponding 2 nd bit and 3 rd bit are set to 1, and the other bits are all 0, that is, the AHIS link or the corresponding mono audio receiving end requiring the AHIS Num to be 3 and 4 replies the AHIS Null PDU carrying the acknowledgement information. After the mono audio receiving end with the AHIS Num of 3 and 4 correctly receives the AHISM PDU S3 and the AHISM PDU S4, the AHISS Null PDU (ACK 3 and ACK 4) carrying the confirmation information is replied, wherein the NESN is set to a new value to represent that the AHISM PDU S3 and the AHISM PDU S4 sent by the wireless four-channel audio sending equipment are correctly received. And after the wireless four-channel audio transmitting equipment correctly receives the ACK3 and the ACK4, stopping transmitting. It can be seen that in the example shown in fig. 5b, the AHIS link with AHIS Num of 1 and 2 has good channel quality, and is preferentially required to reply to the acknowledgement information, and the AHISM PDU S2 needs to be sent once, and the AHISM PDU S1 needs to be sent twice. The AHIS link channel quality with AHIS Num of 3 is slightly better than HIS Num of 4, AHISM PDU S3 gets 4 transmission opportunities, AHISM PDU S4 gets 5 transmission opportunities. Compared with the BLE Audio BIG protocol, under the condition that the volume transmission opportunity is only three times, the Audio data of each channel has only 3 transmission opportunities.

By adopting the audio transmission method provided by the embodiment of the invention, the AHISM PDU S3 and the AHISM PDU S4 have more retransmission opportunities exceeding 3 times, thereby improving the reliability of wireless multichannel transmission. Compared with BLE Audio CIG protocol of which wireless resources are evenly distributed by all CIS links in the prior art, the AHIG protocol provided by the embodiment of the invention is adopted, so that more retransmission opportunities are obtained for links with poor channel quality. In addition, after the wireless four-channel audio transmission equipment transmits the AHISM PDU of 4 AHIS links in batches, only 2 AHIS links are required to reply the confirmation information, thereby further improving the link efficiency of audio transmission.

In addition, in the current isochronous interval, any one of the AHISM PDU S1, the AHISM PDU S2, the AHISM PDU S3 and the AHISM PDU S4 is not successfully and correctly received by the mono audio receiving end, and may be repeatedly transmitted in the next isochronous interval until the refresh Time (Flush Time, FT) is overtime, where the AHIS SN remains unchanged. Ft=1 means that only during the current isochronous interval is transmitted, the next isochronous interval is not being retransmitted; ft=2 means that retransmissions can be performed within two consecutive equal time intervals. The larger the FT, the higher the transmission reliability, but the larger the transmission delay. Ft=1 when low delay is generally required.

As can be seen from the foregoing embodiments provided in fig. 5a and fig. 5b, by adopting the audio transmission method provided in the embodiment of the present invention, the wireless multi-channel audio system can adaptively allocate different wireless resources to different mono audio receiving terminals according to the channel quality of different AHIS links and the acknowledgement information fed back by the mono audio receiving terminals, so as to improve the link efficiency and the transmission reliability of the wireless multi-channel audio transmission. In specific implementation, the channel quality of the AHIS link may be obtained by measuring signal-to-noise ratio, signal-to-interference-and-noise ratio, packet error probability, and the like, which will not be described in detail herein.

For an example, please refer to fig. 6. Fig. 6 is a schematic structural diagram of an audio transmitting end according to an embodiment of the present invention. The audio transmitting end comprises an audio input unit, an audio processing unit, a baseband data and protocol processor and a BLE radio frequency transceiver module. The audio input unit acquires a digital audio signal and transmits the digital audio signal to the audio processing unit, and the audio processing unit adopts LC3 compression coding to convert the digital audio signal into audio data. And the baseband data and protocol processor executes BLE protocol related to BLE Audio and the AHIG protocol, and processes the Audio data into an AHIGM PDU which is suitable for being sent by the BLE radio frequency transceiver module. The BLE radio frequency transceiver module is used for receiving and transmitting BLE wireless signals or PDUs, and comprises the steps of sending AHISM PDUs and receiving AHISS PDUs.

For example, please refer to fig. 7. Fig. 7 is a schematic structural diagram of an audio receiving end according to an embodiment of the present application. The audio receiving end comprises an audio output unit, an audio processing unit, a baseband data and protocol processor and a BLE radio frequency transceiver module. And the baseband data and protocol processor executes BLE protocol and the AHIG protocol related to BLE Audio, processes the AHIGM PDU sent by the Audio sending end and received by the BLE radio frequency transceiver module, and sends the AHIGM PDU to the Audio processing unit. The audio processing unit is used for audio decoding, packet loss processing, equalization, sound effect and other post-processing. The audio output unit is used for converting the audio signal into a sound signal. The BLE radio frequency transceiver module is used for receiving and transmitting BLE radio signals or various PDUs, including receiving and transmitting AHISS PDUs.

Referring to fig. 8, an embodiment of the present application further provides an audio transmitting terminal 800, where the audio transmitting terminal 800 wirelessly communicates with a plurality of audio receiving terminals respectively in consecutive isochronous intervals based on a plurality of communication links to transmit corresponding audio data, one isochronous interval includes a plurality of sub-events, one sub-event includes M consecutive transmission sub-slots, one transmission sub-slot is used by the audio transmitting terminal 800 to transmit an audio data packet of one communication link, one audio receiving terminal corresponds to one communication link, M is a positive integer greater than 1, the audio transmitting terminal 800 includes a first determining module 801, an allocating module 802, and a transmitting module 803, in a first sub-event of a current isochronous interval,

The first determining module 801 is configured to determine a target communication link and a target audio data packet to be sent in a first sub-event, where one target audio data packet corresponds to one target communication link;

the allocating module 802 is configured to allocate a transmission sub-slot in the first sub-event to each of the target communication links, and after allocation, at least one first transmission sub-slot exists in the first sub-event, where a target communication link corresponding to the first transmission sub-slot is different from a target communication link corresponding to a second transmission sub-slot in a second sub-event, and the second sub-event is a sub-event whose time domain position in the current isochronous interval is before the first sub-event, and the time domain position of the first transmission sub-slot in the first sub-event is the same as the time domain position of the second transmission sub-slot in the second sub-event;

the sending module 803 is configured to send, in a sending sub-slot of the first sub-event, a target audio data packet corresponding to the target communication link based on the target communication link.

Optionally, when the number of the determined target audio data packets is smaller than M, the target communication links corresponding to at least two transmit sub-slots in the M transmit sub-slots included in the first sub-event are the same.

Optionally, when the determined number T of target audio data packets is smaller than M, the allocation module 802 includes:

the first allocation unit is used for allocating the T sending sub-slots in the first sub-event to the corresponding target communication links of the T target audio data packets respectively;

and the second allocation unit is used for allocating the transmission sub-time slots for the target communication links corresponding to part of the target audio data packets in the T target audio data packets based on the remaining M-T transmission sub-time slots in the first sub-event, wherein the number L of the part of the target audio data packets is smaller than or equal to M-T.

Optionally, the second allocation unit is specifically configured to:

a receiver sub-slot is used by the audio transmitter 800 to receive, on a communication link, an acknowledgement packet sent by an audio receiver, where the acknowledgement packet is used to indicate whether the audio receiver correctly receives the corresponding audio packet.

Optionally, the first determining module 801 further includes:

the determining unit is used for determining a target audio receiving end; the target audio receiving end is at least one part of audio receiving ends in the audio receiving ends corresponding to the target audio data packet, and the target audio receiving end needs to feed back a confirmation data packet;

the configuration unit is used for configuring the target audio data packet to carry indication information, wherein the indication information is used for indicating the determined target audio receiving end;

a transmitting unit, configured to, in a transmission sub-slot of the first sub-event, after transmitting, based on the target communication link, a target audio data packet corresponding to the target communication link, the method further includes:

and the receiving unit is used for receiving the acknowledgement data packet sent by the target audio receiving end on the target communication link corresponding to the target audio receiving end in the receiving sub-time slot of the first sub-event.

Optionally, the determining unit is specifically configured to:

the predetermined selection criteria include:

Optionally, the receiving unit is specifically configured to:

Optionally, when the second sub-event is the first sub-event of the current isochronous interval, the audio transmitting terminal 800 includes a second determining module, a second transmitting module, and a third transmitting module: during the second sub-event of the current equal interval,

The second determining module is configured to determine a target communication link and a target audio data packet to be sent in a second sub-event, where one target audio data packet corresponds to one target communication link;

a second transmitting module, configured to allocate M transmit sub-slots in the second sub-event to the target communication links, where each target communication link is allocated with at least one transmit sub-slot;

and the third sending module is used for sending the target audio data packet corresponding to the target communication link based on the target communication link in the sending sub-time slot of the second sub-event.

Optionally, the header of the audio data packet is configured with one or more of the following:

a first expected sequence number, where the first expected sequence number is used to characterize a sequence number of a next acknowledgement data packet expected to be received by the audio transmitting end 800 on a communication link corresponding to the audio data packet;

The audio transmitting terminal 800 provided in the embodiment of the present application can implement each process that can be implemented in the embodiment of the method shown in fig. 2, and achieve the same beneficial effects, and in order to avoid repetition, the description is omitted here.

Referring to fig. 9, an embodiment of the present application further provides an audio receiving terminal 900, where the audio receiving terminal 900 corresponds to one of a plurality of communication links, the audio receiving terminal 900 communicates with an audio transmitting terminal to receive corresponding audio data in consecutive isochronous intervals, one isochronous interval includes a plurality of sub-events, one sub-event includes M consecutive transmission sub-slots, one transmission sub-slot is used by the audio transmitting terminal to transmit an audio packet of one communication link, the audio receiving terminal 900 includes a first receiving module 901, in any sub-event of the current isochronous interval,

the first receiving module 901 is configured to sequentially receive in the M transmit sub-slots based on the communication link corresponding to the audio receiving end 900, so as to obtain a target audio data packet corresponding to the audio receiving end 900.

Optionally, the packet header of the audio data packet carries first information, where the first information is used to indicate a sequence number of a communication link corresponding to the audio data packet;

the first receiving module 901 is specifically configured to:

based on the communication link corresponding to the audio receiving end 900, the audio signal is received in each transmission sub-slot in sequence from the first transmission sub-slot of the M transmission sub-slots, where,

receiving a packet header of the audio data packet in a current transmission sub-slot, acquiring a sequence number indicated by the first information, and judging whether a communication link corresponding to the current transmission sub-slot is a communication link corresponding to the audio receiving end 900 or not based on the sequence number;

and in the case that the communication link corresponding to the current transmission sub-slot is the communication link corresponding to the audio receiving end 900, receiving the load of the audio data packet in the current transmission sub-slot.

Optionally, the audio receiving end 900 further includes:

and the third receiving module is configured to, when it is determined that the load of the audio data packet is not received correctly, continue receiving in the next transmission sub-slot until the target audio data packet corresponding to the audio receiving end 900 is received correctly, or complete receiving in the last transmission sub-slot.

Optionally, K consecutive receiving sub-slots are further included in one sub-event, where K is a positive integer;

the audio receiving end 900 further includes: a judging module, configured to, after receiving and obtaining the target audio data packet corresponding to the audio receiving end 900,

judging whether the audio receiving end 900 is a target audio receiving end or not based on the indication information;

and a fourth sending module, configured to send, in a receiving sub-slot of the sub-event, a confirmation data packet on a communication link corresponding to the target audio receiving end, where the audio receiving end 900 is the target audio receiving end, where the confirmation data packet carries confirmation information, and the confirmation information is used to indicate whether the target audio receiving end successfully receives the corresponding target audio data packet.

Optionally, the indication information is a first acknowledgement link mapping table set in the packet header of the target audio data packet, where the first acknowledgement link mapping table indicates a sequence number of a communication link corresponding to the target audio receiving end determined by the audio sending end;

The fourth sending module is specifically configured to:

Optionally, the acknowledgement data packet includes a second expected sequence number, where the second expected sequence number is used to characterize a sequence number of a next audio data packet that the audio receiving end 900 expects to receive on a corresponding communication link;

The audio receiving end 900 provided in the embodiment of the present application can implement each process that can be implemented in the embodiment of the method shown in fig. 4, and achieve the same beneficial effects, and in order to avoid repetition, the description is omitted here.

Referring to fig. 1, the embodiment of the present application further provides an audio transmission system, which includes the above-mentioned audio transmitting end and N above-mentioned audio receiving ends;

The embodiment of the invention also provides electronic equipment. Because the principle of solving the problem of the electronic device is similar to that of the audio transmission method in the embodiment of the invention, the implementation of the electronic device can be referred to the implementation of the method, and the repetition is omitted. As shown in fig. 10, an electronic device according to an embodiment of the present invention includes: processor 1000, for reading the program in memory 1020, performs the following processes:

within the first sub-event of the current isochronous interval,

Transmitting, by the transceiver 1010, a target audio data packet corresponding to the target communication link based on the target communication link within a transmit sub-slot of the first sub-event;

or alternatively, the process may be performed,

sequentially receiving in the M transmit sub-slots through the transceiver 1010 based on the communication link corresponding to the audio receiving end, so as to obtain a target audio data packet corresponding to the audio receiving end;

a transceiver 1010 for receiving and transmitting data under the control of the processor 1000.

Wherein in fig. 10, a bus architecture may comprise any number of interconnected buses and bridges, and in particular one or more processors represented by the processor 1000 and various circuits of the memory, represented by the memory 1020, are chained together. The bus architecture may also link together various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., which are well known in the art and, therefore, will not be described further herein. The bus interface provides an interface. The transceiver 1010 may be a number of elements, i.e., including a transmitter and a receiver, providing a means for communicating with various other apparatus over a transmission medium. The user interface 1030 may also be an interface capable of interfacing with an internal connection requiring device for a different user device including, but not limited to, a keypad, display, speaker, microphone, joystick, etc.

The processor 1000 is responsible for managing the bus architecture and general processing, and the memory 1020 may store data used by the processor 1000 in performing operations.

Optionally, when the determined number T of target audio data packets is smaller than M, the processor 1000 is further configured to read the program in the memory 1020, and perform the following steps:

and distributing transmitting sub-time slots for target communication links corresponding to partial target audio data packets in the T target audio data packets based on the remaining M-T transmitting sub-time slots in the first sub-event, wherein the number L of the partial target audio data packets is smaller than or equal to M-T.

Optionally, the processor 1000 is further configured to read a program in the memory 1020, and perform the following steps:

After transmitting, in a transmission sub-slot of the first sub-event, a target audio data packet corresponding to the target communication link based on the target communication link, the method further includes:

the predetermined selection criteria include:

Optionally, when the second sub-event is the first sub-event of the current isochronous interval, the processor 1000 is further configured to read the program in the memory 1020, and perform the following steps:

during the second sub-event of the current equal interval,

The first expected sequence number is used for representing the sequence number of a next acknowledgement data packet expected to be received by the audio sending end on a communication link corresponding to the audio data packet; the first preset sequence number is used for representing the sequence number of the audio data packet; the first information is used for indicating the serial number of the communication link corresponding to the audio data packet; a first acknowledgement link mapping table, where the first acknowledgement link mapping table is used to indicate a sequence number of a communication link corresponding to a target audio receiving end; and the number of the remaining data packets is used for representing the number of the audio data packets to be transmitted remaining in the current sub-event.

the processor 1000 is further configured to read a program in the memory 1020, and perform the following steps:

Optionally, the acknowledgement data packet includes a second expected sequence number, where the second expected sequence number is used to characterize a sequence number of a next audio data packet expected to be received by the audio receiving end on a corresponding communication link;

The readable storage medium provided in the embodiment of the present application is used for storing a program, where the program may be executed by a processor to implement the steps in the method embodiment shown in fig. 2, or implement the steps in the method embodiment shown in fig. 4.

In the several embodiments provided in the present application, it should be understood that the disclosed methods and apparatus may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may be physically included separately, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in hardware plus software functional units.

The integrated units implemented in the form of software functional units described above may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium, and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform part of the steps of the transceiving method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

While the foregoing is directed to the preferred embodiments of the present invention, it will be appreciated by those skilled in the art that various modifications and adaptations can be made without departing from the principles of the present invention, and such modifications and adaptations are intended to be comprehended within the scope of the present invention.

Claims

1. An audio transmission method applied to an audio transmitting end, wherein the audio transmitting end is in wireless communication with a plurality of audio receiving ends respectively in continuous time intervals based on a plurality of communication links to transmit corresponding audio data, one time interval comprises a plurality of sub-events, one sub-event comprises M continuous transmission sub-time slots, one transmission sub-time slot is used for the audio transmitting end to transmit audio data packets of one communication link, one audio receiving end corresponds to one communication link, and M is a positive integer greater than 1, the method comprises the following steps: within the first sub-event of the current isochronous interval,

2. The method of claim 1, wherein when the determined number of target audio data packets is less than M, the target communication links corresponding to at least two transmit sub-slots of the M transmit sub-slots included in the first sub-event are the same.

3. The method of claim 2, wherein said allocating a transmit sub-slot within said first sub-event for each of said target communication links when said determined number T of target audio data packets is less than M comprises:

4. The method of claim 3, wherein the allocating a transmission sub-slot for the target communication link corresponding to a portion of the T target audio data packets based on the remaining M-T transmission sub-slots in the first sub-event comprises:

5. The method of claim 1, further comprising K consecutive receive sub-slots within said one sub-event, K being a positive integer;

6. The method of claim 5, wherein determining the target communication link and the target audio data packet to be transmitted within the first sub-event further comprises:

7. The method of claim 6, wherein the determining the target audio receiving end comprises:

the predetermined selection criteria include:

8. The method of claim 6, wherein the receiving, in the receiving sub-slots of the first sub-event, the acknowledgement packet sent by the target audio receiving end on the target communication link corresponding to the target audio receiving end, respectively, includes:

9. The method of claim 1, wherein when the second sub-event is the first sub-event of a current isochronous interval, the method comprises: during the second sub-event of the current equal interval,

10. The method according to any one of claims 1 to 9, wherein the header of the audio data packet is configured with one or more of the following:

11. An audio transmission method applied to an audio receiving end, wherein the audio receiving end corresponds to one communication link of a plurality of communication links, the audio receiving end communicates with an audio transmitting end in a continuous time interval to receive corresponding audio data, one time interval comprises a plurality of sub-events, one sub-event comprises M continuous transmitting sub-time slots, and one transmitting sub-time slot is used for the audio transmitting end to transmit an audio data packet of one communication link, the method comprises: within any one sub-event of the current isochronous interval,

12. The method of claim 11, wherein a header of the audio data packet carries first information, the first information being used to indicate a sequence number of a communication link to which the audio data packet corresponds;

the receiving, in turn, in the M transmission sub-slots based on the communication link corresponding to the audio receiving end, so as to obtain a target audio data packet corresponding to the audio receiving end, including:

13. The method of claim 12, wherein after receiving the payload of the audio data packet within the current transmit sub-slot, further comprising:

14. The method of claim 11, further comprising K consecutive receive sub-slots within a sub-event, K being a positive integer;

the method further comprises the steps of: after receiving and obtaining the target audio data packet corresponding to the audio receiving end,

15. The method of claim 14, wherein the indication information is a first acknowledgement link mapping table set in a header of the target audio data packet, the first acknowledgement link mapping table indicating a sequence number of a communication link corresponding to the target audio receiving end determined by the audio transmitting end;

16. The method of claim 14, wherein the acknowledgment packet includes a second expected sequence number that characterizes a sequence number of a next audio packet that the audio receiver expects to receive over a corresponding communication link;

17. An audio transmitting terminal, characterized in that the audio transmitting terminal is in wireless communication with a plurality of audio receiving terminals respectively in continuous time intervals based on a plurality of communication links to transmit corresponding audio data, one time interval comprises a plurality of sub-events, one sub-event comprises M continuous transmitting sub-time slots, one transmitting sub-time slot is used for the audio transmitting terminal to transmit audio data packets of one communication link, one audio receiving terminal corresponds to one communication link, M is a positive integer greater than 1, the audio transmitting terminal comprises a first determining module, an allocating module and a first transmitting module,

18. An audio receiving end, characterized in that the audio receiving end corresponds to one communication link of a plurality of communication links, the audio receiving end communicates with an audio transmitting end in continuous time intervals to receive corresponding audio data, the time interval comprises a plurality of sub-events, the sub-event comprises M continuous transmitting sub-time slots, the transmitting sub-time slots are used for the audio transmitting end to transmit audio data packets of the communication link, the audio receiving end comprises a first receiving module, in any sub-event of the current time interval,

19. An audio transmission system, comprising:

an audio transmitting end as claimed in claim 17;

n audio receivers as claimed in claim 18;

20. An electronic device comprising a processor, a memory and a program stored on the memory and executable on the processor, the program when executed by the processor implementing the steps of the audio transmission method of any one of claims 1 to 10 or the steps of the audio transmission method of any one of claims 11 to 16.

21. A readable storage medium, characterized in that the readable storage medium has stored thereon a program which, when executed by a processor, implements the steps of the audio transmission method according to any one of claims 1 to 10 or the steps of the audio transmission method according to any one of claims 11 to 16.