CN117319314A

CN117319314A - Audio transmission method, related device and readable storage medium

Info

Publication number: CN117319314A
Application number: CN202311264806.7A
Authority: CN
Inventors: 徐斌; 杨晓东; 陈璠; 周世祺; 卫琳
Original assignee: Zgmicro Corp
Current assignee: Zgmicro Corp
Priority date: 2023-09-27
Filing date: 2023-09-27
Publication date: 2023-12-29

Abstract

The invention discloses an audio transmission method, related equipment and a readable storage medium, which relate to the technical field of wireless communication and are used for solving the problems of low transmission efficiency and high transmission delay of audio data. The wireless audio transmission method is applied to a transmitting device, the transmitting device is in wireless communication with a receiving device in continuous time intervals to transmit a broadband audio stream, the time length of the time intervals is less than 5ms, each time interval comprises N sub-events, each sub-event comprises a transmitting time slot for transmitting a data packet, and N is a positive integer; the method comprises the following steps: audio data in the wideband audio stream is transmitted in each sub-event based on the data packets, and in at least part of the sub-events control information is transmitted simultaneously with the audio data, the control information comprising at least parameters required by the receiving device to receive the data packets. The embodiment of the invention can improve the transmission efficiency of the audio data and reduce the time delay of data transmission.

Description

Audio transmission method, related device and readable storage medium

Technical Field

The present invention relates to the field of wireless communications technologies, and in particular, to an audio transmission method, a related device, and a readable storage medium.

Background

The wireless audio technology brings unconstrained free conversation and music enjoyment to people, and is widely loved by people. Based on the currently common connection isochronous group (Connected Isochronous Group, CIG) protocol and broadcast isochronous group (Broadcast Isochronous Group, BIG) protocol, when a transmitting device and a receiving device communicate, various different types of data packets need to be transmitted over multiple channels in different sub-events of an isochronous Interval (ISO Interval) to meet the requirements of synchronization, control and data transmission in the communication.

Taking advertisement synchronization as an example, the BIG protocol specifies that the extended advertisement (adv_ext_ind) is sent exclusively on three primary advertisement (Primary Advertising) channels, then the auxiliary advertisement (aux_adv_ind) is sent on a secondary advertisement (Secondary Advertising) channel, and the protocol packets such as the synchronized advertisement (aux_sync_ind) are sent on a periodic advertisement (Periodic Advertising) channel. Information transmission mechanisms such as these result in lower wireless transmission efficiency and higher transmission delay of audio data. At present, the time interval between the isochronous streams of the CIG protocol and the BIG protocol is 5ms at minimum, and the audio digital signals are compressed by adopting low-complexity communication encoding and decoding (Low Complexity Communication Codec, LC 3) and then are transmitted wirelessly, and the LC3 encoding has 2.5ms algorithm delay. Thus, CIGs and BIG typically only provide wireless audio end-to-end delays of no less than 20ms, and cannot provide lower end-to-end delays. Particularly for wideband audio stream data with a sampling rate of not less than 16KHz, a better ultra-low delay transmission scheme is lacking at present.

Disclosure of Invention

The embodiment of the invention provides an audio transmission method, related equipment and a readable storage medium, which are used for solving the problems that the transmission efficiency of audio data is low, the transmission delay is high and the ultra-low delay broadband audio stream transmission is difficult to realize.

In a first aspect, an embodiment of the present invention provides a wireless audio transmission method, applied to a transmitting device, where the transmitting device wirelessly communicates with a receiving device in consecutive isochronous intervals to transmit a wideband audio stream, where the duration of the isochronous intervals is less than 5ms, and each isochronous interval includes N sub-events, where each sub-event includes a transmission time slot for transmitting a data packet, and N is a positive integer; the method comprises the following steps:

and transmitting audio data in the broadband audio stream in each sub-event based on the data packet, and simultaneously transmitting control information in addition to the audio data in at least part of the sub-events, wherein the control information at least comprises parameters required by the receiving device to receive the data packet.

In a second aspect, an embodiment of the present invention further provides a wireless audio transmission method, which is applied to a receiving device, where the receiving device wirelessly communicates with a transmitting device in a continuous time interval to receive a wideband audio stream, where the time duration of the time interval is less than 5ms, and each time interval includes N sub-events, where each sub-event includes a transmission time slot for transmitting one data packet, and N is a positive integer;

When the receiving device is operating in a scanning mode, the method comprises:

searching a data packet sent by the sending equipment;

synchronizing the transmission time of the data packet with the transmission equipment based on searching;

acquiring audio data in the broadband audio stream from the data packet obtained by searching, and acquiring control information when the data packet comprises the control information; the control information includes at least parameters required by the receiving device to receive the data packet.

In a third aspect, an embodiment of the present invention further provides a transmitting device, where the transmitting device wirelessly communicates with a receiving device in consecutive isochronous intervals to transmit a wideband audio stream, where the duration of the isochronous intervals is less than 5ms, and each of the isochronous intervals includes N sub-events, where each sub-event includes a transmission time slot for transmitting one data packet, and N is a positive integer; the transmitting apparatus includes:

and the sending module is used for sending the audio data in the broadband audio stream in each sub-event based on the data packet, and simultaneously sending control information except the audio data in at least part of the sub-events, wherein the control information at least comprises parameters required by the receiving equipment to receive the data packet.

In a fourth aspect, the embodiment of the present invention further provides a receiving device, where the receiving device wirelessly communicates with a transmitting device in consecutive isochronous intervals to receive a wideband audio stream, where the duration of the isochronous intervals is less than 5ms, and each isochronous interval includes N sub-events, where each sub-event includes a transmission time slot for transmitting one data packet, and N is a positive integer;

the receiving device comprises a searching module, a first synchronizing module and a first acquiring module:

when the receiving device is operating in a scanning mode,

the searching module is used for searching the data packet sent by the sending equipment;

the first synchronization module is used for obtaining the transmission time of the data packet based on searching and synchronizing with the transmission equipment;

the first acquisition module is used for acquiring audio data in the broadband audio stream from the data packet obtained by searching, and also acquiring control information when the data packet comprises the control information; the control information includes at least parameters required by the receiving device to receive the data packet.

In a fifth aspect, an embodiment of the present invention further provides an electronic device, including: a memory, a processor, and a program stored on the memory and executable on the processor; the processor is configured to read a program in a memory to implement the steps in the wireless audio transmission method according to the first aspect or the second aspect.

In a sixth aspect, embodiments of the present invention further provide a readable storage medium storing a program, which when executed by a processor implements the steps of the method according to the first or second aspect.

In the embodiment of the present application, the duration of the isochronous interval is less than 5ms, and each isochronous interval includes N sub-events, and each sub-event includes a transmission time slot for transmitting a data packet. The transmitting device transmits audio data in the broadband audio stream in each sub-event based on the data packet, and simultaneously transmits control information in addition to the audio data in at least part of the sub-events. The receiving device acquires the audio data and the control information based on the data packet, and completes the synchronization with the transmitting device. By the method, on one hand, the time length of the equal time interval is shortened, on the other hand, all sub-events are used for transmitting audio data, and meanwhile, the functions of wireless communication synchronization, control, audio data transmission and the like can be realized based on one data packet, so that the transmission efficiency of the audio data is ensured, the utilization rate of time slots is improved, the transmission time delay of the audio data is reduced, and the ultra-low-delay broadband audio stream transmission can be realized.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments of the present invention will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort to a person of ordinary skill in the art.

FIG. 1 is a schematic diagram of a system to which embodiments of the invention are applicable;

fig. 2 is a schematic flow chart of a wireless audio transmission method according to an embodiment of the present invention;

fig. 3 is a schematic diagram of a slot structure provided by an embodiment of the present invention;

fig. 4a is a schematic diagram of a data packet according to an embodiment of the present invention;

fig. 4b is a schematic structural diagram of a protocol data unit (Protocol Data Unit, PDU) provided by an embodiment of the present invention;

fig. 4c is a schematic structural diagram of a Header (Header) according to an embodiment of the present invention;

FIG. 4d is a schematic diagram of a load (Payload) according to an embodiment of the present invention;

fig. 5 is a schematic diagram of a transmission flow of a transmitting device according to an embodiment of the present invention;

FIG. 6 is a second flowchart of a wireless audio transmission method according to an embodiment of the present invention;

Fig. 7 is a schematic diagram of a workflow of a receiving device in a scanning mode according to an embodiment of the present invention;

fig. 8 is a schematic diagram of a workflow of a receiving device in an audio data receiving mode according to an embodiment of the present invention;

fig. 9 is one of schematic structural diagrams of a transmitting device according to an embodiment of the present invention;

fig. 10 is a schematic structural diagram of a receiving device according to an embodiment of the present invention;

fig. 11 is a second schematic structural diagram of a transmitting device according to an embodiment of the present invention;

fig. 12 is a second schematic structural diagram of a receiving device according to an embodiment of the present invention;

fig. 13 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all, of the embodiments of the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of the protection of the present application.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or otherwise described herein, and that the terms "first" and "second" are generally intended to be used in a generic sense and not to limit the number of objects, for example, the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/" generally means a relationship in which the associated object is an "or" before and after.

The embodiment of the invention provides a wireless audio transmission method, which can be also called an Ultra-low delay wireless audio (ULWA) transmission method for better distinguishing from the prior art, and for convenience of description and understanding, and a link protocol realized by the method provided by the embodiment of the invention can be called an integrated broadcast isochronous stream (Integrated Broadcast Isochronous Stream, IBIS) link protocol. As a specific example, the method provided by the embodiment of the present invention may be applied to the ULLWA system shown in fig. 1. The ULLWA system includes a transmitting device and one or more receiving devices, where the transmitting device transmits audio data over an IBIS link between the receiving devices. It will be appreciated that, in implementation, the ULLWA transmission method may be applicable to a point-to-point or point-to-multipoint ultra low delay wireless microphone function, and may also be applicable to a point-to-multipoint wireless audio sharing function.

Referring to fig. 2, the wireless audio transmission method provided by the embodiment of the invention is applied to a transmitting device and is executed by the transmitting device. The transmitting device wirelessly communicates with the receiving device to transmit a wideband audio stream in successive isochronous intervals, the isochronous intervals being less than 5ms long and each of the isochronous intervals comprising N sub-events, each of the sub-events comprising a transmission time slot for transmitting a data packet, N being a positive integer. The method specifically comprises the following steps:

Step 201, based on the data packet, sending audio data in the broadband audio stream in each sub-event, and simultaneously sending control information in addition to the audio data in at least part of the sub-events, wherein the control information at least comprises parameters required by the receiving device to receive the data packet.

Besides, in at least part of sub-events, the audio data in the broadband audio stream is sent based on the data packet, and control information is also sent based on the data packet, so that each data packet can be guaranteed to carry the audio data.

As an alternative embodiment, the audio data and the control information in the wideband audio stream may be transmitted in each of the sub-events based on the data packet.

The data packet is used for the receiving equipment to realize the functions of synchronization, control, audio data transmission and the like.

And searching the data packet transmitted by the transmitting device when the receiving device works in the scanning mode, and synchronizing the transmitting time of the data packet obtained based on searching with the transmitting device. In the case where only audio data in the wideband audio stream is included in the data packet, the audio data in the wideband audio stream is acquired from the data packet. In the case where the audio data and control information in the broadband audio stream are included in the data packet, the audio data and control information in the broadband audio stream are acquired from the data packet.

When the receiving device works in the scanning mode, the starting time of the equal time interval can be determined based on the sending time of the data packet obtained by searching, and the time synchronization is carried out with the sending device based on the starting time of the equal time interval and the duration of the equal time interval. In some embodiments, the receiving device may also perform frequency hopping channel synchronization with the transmitting device based on the control information. Frequency hopping channel synchronization refers to the receiving device selecting the same channel as the transmitting device at each sub-event.

The receiving device receives the data packets in each of the isochronous intervals when the receiving device is operating in an audio data reception mode. In the case where only audio data in the wideband audio stream is included in the data packet, the receiving apparatus acquires audio data in the wideband audio stream from each received data packet. In the case where the data packets include audio data and control information in the wideband audio stream, as an alternative embodiment, the receiving device acquires the audio data and control information in the wideband audio stream from each of the received data packets. As another alternative embodiment, the receiving device obtains audio data in the wideband audio stream from each received data packet and discards the control information.

It may be understood that the parameters required for the receiving device to receive the data packet may be parameters related to determining, by the receiving device, transmission time, transmission channel, error checking, etc. of the data packet, and may be specifically configured according to an actual application scenario.

In this embodiment, the transmitting device and the receiving device communicate wirelessly to transmit a wideband audio stream, where wideband audio refers to an audio signal with a sampling rate greater than or equal to 16kHz, and the specific sampling rate is not limited. Illustratively, in some embodiments, the sampling rate of the wideband audio stream is greater than or equal to 24kHz.

It should be understood that 5ms is the minimum isochronous interval of the BIG protocol in BLE Audio (Audio), and since the duration of each isochronous interval in this application is less than 5ms, the method may have a lower delay than the BIG protocol. Optionally, in some embodiments, the isochronous interval duration is less than or equal to 2.5ms, e.g., 2.5ms, 2ms, 1.25ms, or 1ms.

Each time interval includes N sub-events, so that up to N packets can be sent during each time interval. In particular implementations, the value of N is typically small due to the small duration of the isochronous interval. Optionally, in some embodiments, the N is 1 or 2 or 3.

In the embodiment of the present application, the duration of the isochronous interval is less than 5ms, and each isochronous interval includes N sub-events, and each sub-event includes a transmission time slot for transmitting a data packet. Based on the data packets, audio data in the wideband audio stream is transmitted in each sub-event, and in at least part of the sub-events control information is transmitted simultaneously with the audio data. By the method, on one hand, the time length of the equal time interval is shortened, on the other hand, all sub-events are used for transmitting audio data, and meanwhile, the functions of wireless communication synchronization, control, audio data transmission and the like can be realized based on one data packet, so that the transmission efficiency of the audio data is ensured, the utilization rate of time slots is improved, the transmission time delay of the audio data is reduced, and the ultra-low-delay broadband audio stream transmission can be realized.

Optionally, in some embodiments, the step 201 includes:

determining the type of a sending time slot of a current sub-event, wherein the type of the sending time slot comprises a synchronous time slot and a data time slot, and the current sub-event is any sub-event;

transmitting the data packet based on a synchronous channel in the current sub-event under the condition that the type of the transmission time slot of the current sub-event is the synchronous time slot; the synchronous channel is a special channel for searching a data packet by the receiving equipment in a scanning mode;

And transmitting the data packet based on a data channel in the current sub-event under the condition that the type of the transmission time slot of the current sub-event is the data time slot.

The synchronization channel and the data channel may each be one or more channels. There are various methods of selecting a channel. In a specific embodiment, the data channel may be a bluetooth low energy data channel, and the synchronization channel may be a bluetooth low energy advertising channel. The bluetooth low energy specification defines 40 radio frequency channels, of which the 37 th, 38 th and 39 th channels are defined as primary advertisement channels, the other 37 channels are defined as data channels, the primary advertisement channels being used for initial broadcasting and all conventional broadcasting activities prior to connection, and the data channels being used mainly for data communication between devices. In another embodiment, the synchronization channel may also be a partial bluetooth low energy data channel, for example, one or several of the 37 data channels may be designated as the synchronization channel. It will be appreciated that the synchronization channels and data channels may also be defined in other manners, such as according to other general wireless communication specifications, or user-defined specifications, within a predetermined frequency range, as is not specifically limited in this application.

The transmitting device may frequency hop to the corresponding channel according to the type of the transmitting time slot of the current sub-event to transmit the data packet. Accordingly, the receiving device may search for a data packet based on a predicted synchronization channel in the scanning mode, and may frequency-hop to a corresponding channel to receive the data packet in the audio data receiving mode according to the type of the transmission slot of the current sub-event.

Optionally, in some embodiments, the determining a type of a transmission slot of the current sub-event includes:

determining a type of a transmission slot of the current sub-event based on the synchronization interval;

wherein when the starting time of the sending time slot of the current sub-event is the same as the starting time of the synchronous interval, determining the type of the sending time slot of the current sub-event as the synchronous time slot, otherwise, determining the type of the sending time slot of the current sub-event as the data time slot, or,

when the starting time of the current time interval where the current sub-event is located is the same as the starting time of the synchronous interval, determining that the type of the transmission time slot of the preset sub-event in the current time interval is a synchronous time slot, and the type of the transmission time slot of other sub-events except the preset sub-event in the current time interval is a data time slot;

The duration of the synchronization interval is an integer multiple of the duration of the isochronous interval.

Referring to fig. 3, for convenience of understanding, a description will be first given of a slot structure adopted in the present embodiment. In order to distinguish from the prior art, the data packet is abbreviated as an IBIS PDU in the embodiment of the present invention. As shown in fig. 3, the IBIS communication time is divided into equal isochronous intervals, the time slots in which the IBIS PDUs are transmitted on the synchronization channel are called synchronization time slots, and the timing in which the IBIS PDUs are transmitted on the data channel are called data time slots. The time interval for transmitting the IBIS PDUs on the synchronization channel is a synchronization interval (i.e., the interval between the starting moments of two adjacent synchronization slots is a synchronization interval), and the duration of the IBIS synchronization interval is an integer multiple, e.g., 32 or 64, of the duration of the IBIS isochronous interval. It will be appreciated that in other embodiments, an IBIS PDU may be transmitted on a synchronous channel in a set of consecutive multiple sub-events each time, and the transmission slots of the set of sub-events are all synchronous slots, and the time interval between the start moments of two adjacent sets of synchronous slots is a synchronous interval.

As shown in fig. 3, k represents a synchronization interval with a sequence number k, and there are M equal time intervals in each synchronization interval, and N sub-events in each equal time interval. The box labeled IBIS PDU in fig. 3 represents a sub-event, one for transmitting one packet. N is equal to 1, only one IBIS PDU is transmitted per isochronous interval, and N is equal to 2, two IBIS PDUs are transmitted per isochronous interval. As shown in fig. 3, wherein the solid line box marking the IBIS PDU represents a sub-event of the first transmission of the IBIS PDU and the dashed line box marking the IBIS PDU represents a sub-event of the second transmission of the IBIS PDU. In a specific embodiment, the second transmitted IBIS PDU may be a retransmission of the first transmitted IBIS PDU, or at least a retransmission of audio data in the first transmitted IBIS PDU.

In some embodiments, when the starting time of the transmission time slot of the current sub-event is the same as the starting time of the synchronization interval (e.g., the first sub-event numbered IBIS PDU m×k+1 from left to right in fig. 3, or the sub-event numbered IBIS PDU m× (k+1) +1), the type of the transmission time slot of the current sub-event is determined to be the synchronization time slot.

In other embodiments, when the starting time of the current isochronous interval at which the current sub-event is located is the same as the starting time of the isochronous interval, the isochronous interval includes a synchronization time slot, and the type of the transmission time slot of the predetermined sub-event in the isochronous interval is determined to be the synchronization time slot. The predetermined sub-event may be the first sub-event in the time interval, or may be other sub-events in the time interval, which may be specifically set according to the actual situation. Further, the type of transmission slots of other sub-events than the predetermined sub-event within the current isochronous interval may be determined to be data slots.

Optionally, the data packet includes an access address unit,

the sending the data packet based on the synchronous channel in the current sub-event comprises the following steps:

configuring an access address unit of the data packet by adopting a first access address parameter, wherein the first access address parameter is a preset specific value;

The transmitting the data packet based on a data channel in the current sub-event includes:

and configuring an access address unit of the data packet by adopting a second access address parameter, wherein the second access address parameter is different from the first access address parameter.

When the data packet is sent based on the synchronization channel in the current sub-event, in order to facilitate access of the access device, a first access address parameter is generally used to configure an access address unit of the data packet, where the first access address parameter is a preset specific value. The access device may confirm, based on the first access address parameter, that the data packet obtained by searching on the synchronization channel is the data packet transmitted by the transmitting device, while excluding noise and other interference data packets, in the case that the first access address parameter is known in advance. Illustratively, the first access address parameter may employ an advertising address (0 x8E89BED 6) defined in the bluetooth low energy specification.

And when the data packet is transmitted based on the data channel in the current sub-event, configuring an access address unit of the data packet by adopting the second access address parameter. Correspondingly, the control information is configured to contain the second access address parameter. Since the second access address parameter is included in the control information, the receiving device may receive the data packet on the data channel based on the second access address parameter. In order to facilitate the receiving device to distinguish the data packets sent by different sending devices, the second access address parameter of each sending device is different, so that the data packets sent by different sending devices are prevented from interfering with each other, and the anti-interference capability of the receiving device is improved. Since the first access address parameter is usually a predetermined, more well-known address, in this embodiment, the second access address parameter is different from the first access address parameter. Illustratively, the second access address parameter is randomly generated each time the transmitting device is powered on.

Optionally, the data packet is an advertisement data packet,

the synchronous channel adopts a Bluetooth low-power consumption advertisement channel or a partial Bluetooth low-power consumption data channel;

the data channel adopts a Bluetooth low-power consumption data channel.

Optionally, in some embodiments, the wideband audio stream is a mono audio stream, and in case N is greater than 1, the audio data transmitted in each sub-event within the same isochronous interval is the same; or,

the broadband audio stream is a multi-channel audio stream, and at least two sub-events in the same time interval respectively send audio data of different channels under the condition that N is larger than 1.

Optionally, in some embodiments, in order to further improve transmission efficiency and reduce transmission delay, the sub-event does not include a receiving slot for receiving data sent by the receiving device. It will be appreciated that in the prior art, the receiving device may typically transmit audio data and/or acknowledgement information, and may also transmit control data, where the acknowledgement information is used to characterize the receiving device's reception of the data packet transmitted by the transmitting device, and the control data is used by the receiving device to transmit control instructions to the transmitting device, etc. In some embodiments of the present application, the receiving time slot is not configured in the sub-event, so that the transmitting device continuously transmits the data packet, and the receiving device continuously receives the data packet, and the time slot resource is used for transmitting the wideband audio stream data as much as possible, so as to meet the stringent time requirement of ultra-low delay.

Optionally, in some embodiments, the data packet further includes a protocol data unit, the protocol data unit including a packet header and a payload, the payload being configured to carry the audio data and control information.

Optionally, the control information may include various parameters related to wireless communication, audio data transmission, playing, control and the like between the sending device and the receiving device, and may be specifically configured according to an actual application scenario. In order to meet the performance requirement of the ultralow delay of the embodiment, the configuration of parameters in the control information can be optimized while the communication flow is optimized. As a specific embodiment, the control information includes at least one of: the method comprises the steps of synchronizing interval parameters, time interval parameters, the number of sub-events, a second access address parameter, a channel mapping table, a cyclic check set value, a load number, a channel mode parameter, an audio playing synchronization instruction, a volume synchronization instruction and a master-slave switching instruction.

For ease of understanding, a specific example is described below. As an alternative implementation manner, the embodiment of the present invention may set the structure of the data packet in the embodiment with reference to the bluetooth low energy (Bluetooth Low Energy, BLE) synchronous isochronous channel (Isochronous Channels) protocol, for example, the structure of the data packet may refer to the structure of the BLE protocol data unit (Protocol Data Unit, PDU).

In some embodiments, in order to distinguish the data packet provided in the embodiments of the present invention from the data packet in the related art, the data packet may be identified by a reserved (Reserved for future use, RFU) value of a certain advertisement PDU type. Illustratively, when the reserved value is assigned to b1100, it indicates that the PDU adopts the structure of the data packet provided by the embodiment of the present invention.

Please refer to fig. 4 a-4 d. As shown in fig. 4a, the data packet includes a Preamble (Preamble), an Access Address (Access Address) unit, a protocol data unit (Protocol Data Unit, PDU) and cyclic redundancy check (Cyclic Redundancy Check, CRC) bits, where the Preamble is used for automatic gain control and time-frequency synchronization, and may occupy 1 to 2 bytes (Byte, B) for example; the access address unit is used for configuring a first access address parameter or a second access address parameter required by link synchronization, and can occupy 4B in an exemplary way; the CRC is used to detect whether the PDU is correct or not, and may occupy 3B, for example. The PDU may illustratively occupy 2B-258B, the specific structure of which may be seen in FIG. 4B. The PDU includes a Header (Header) and a Payload (Payload), the size of the Header may occupy 1B or 2B, for example, and the size of the Payload may be 1B-255B, for example.

Illustratively, the structure of the Header is shown in FIG. 4 c. The Header includes a PDU Type (Type) indicating a packet Type (4 bits), RFU (1 bit), chSel (1 bit) indicating a channel selection algorithm, txAdd (1 bit) and RxAdd (1 bit) indicating device address attributes, and Length (8 bits) indicating a Payload Length. Payload contains both control information and audio Data (Data). The control information combines synchronization information (SynInfo) in auxiliary advertisement (AUX ADV) and BIG information (BIG Info) in Periodic advertisement (Periodic ADV) in BLE Audio (Audio) protocol.

Illustratively, the structure of Payload is shown in FIG. 4 d. The Payload includes a 4-bit synchronization Interval (Sync Interval) parameter, a 2-bit isochronous Interval (ISO Interval) parameter, a 2-bit subevents Number (NSE), a 32-bit Access Address (AA), a 37-bit channel map (ChM), an 8-bit cyclic check set value (CRCInit), a 9-bit IBIS load number (Payload Count), and a 2-bit channel pattern (CH Mode) parameter. The Length of Data in the IBIS PDU payload is 0 to 240 bytes, and the receiving device may obtain the Length of Data by subtracting the Length of the control information in the payload from the Length of the IBIS header. The access address contained in the Payload is used to configure the second access address parameter. Parameters such as ChSel, chM and Payload Count may be used for calculation of the frequency hopping channel.

Illustratively, the synchronization channel employs a bluetooth low energy advertising channel, i.e., a bluetooth low energy 3 primary advertising channel (Primary Advertising Channels). Transmitting the IBIS PDU on the primary advertisement channel uses BLE unified advertisement address (0 x8E89BED 6) as AA (first access address parameter), while transmitting the IBIS PDU on the data channel uses AA (i.e. second access address parameter) set in the IBIS PDU control information. The second access address parameter is generated randomly, or a defined value may be used, where the second access address parameter is different between different devices or links in the specific implementation.

In this embodiment, the data channels employ 37 bluetooth low energy data channels, and the 37 data channels are divided into two classes, one class being usable (Used) channels and the other class being unusable (unoccupied) channels. The channel map table (ChM) in the IBIS PDU control information is used to characterize which channels are available and which are not. For example, chM is 37bits total and represents 37 data channels, respectively, with a bit set to 1 indicating that the data channel is a Used channel and a bit set to 0 indicating that the data channel is a unoccupied channel. The synchronization interval is an interval in which the IBIS PDU is transmitted on three primary advertisement channels, the isochronous interval is an interval in which the IBIS PDU is transmitted, and NSE is the number of times the IBIS PDU is repeatedly transmitted within one isochronous interval, typically being equal to 1, at most being equal to 2 or 3, in order to achieve ultra low latency. The CRCInit is used for setting a cyclic check initial value of the IBIS PDU on the data channel, wherein the lower 16bits of the 24bits cyclic check initial value in the IBIS PDU sent on the data channel are composed of AA high 16bits, and the upper 8bits are composed of the CRCInit. And the initial value of the cyclic check of the IBIS PDU sent on the main advertising channel is composed of its corresponding AA 24bits high. Payload Count encodes the sequence of the IBIS PDU Payload for the receiving device to identify which sequence numbers of the IBIS PDUs were not received correctly. The channel Mode (CH Mode) is set to 1 for mono, 2 for binaural, and other values remain. ISO Interval includes 4 modes, set to 0 to 1ms,1 to 1.25ms,2 to 2ms, and 3 to 2.5ms. Sync Interval is an integer multiple of ISO Interval, set to 0 for a minimum of 4 ISO intervals, set to 1 for 4 (1+1) equal to 8 ISO intervals, set to 15 for 4 (15+1) equal to 64 ISO intervals.

In the embodiment, the synchronization, control and data transmission functions in wireless communication are integrated in the same data packet, the data packet structure is optimized, parameters in the data packet are reasonably configured, the communication flow can be simplified, the algorithm complexity is reduced, redundant information is eliminated, the time slot utilization rate is effectively improved, the system delay is reduced, and the ultra-low delay broadband audio stream data transmission is realized.

For convenience of understanding, a specific embodiment is taken as an example, and a transmission flow of the transmitting device provided by the embodiment of the present invention is described below. Referring to fig. 5, at each IBIS isochronous interval, audio data in a wideband audio stream to be transmitted is prepared, and then whether the current transmission slot is a synchronization slot is determined according to a clock set by the synchronization interval. In some embodiments, to achieve ultra low latency, the transmitting device typically processes the digital audio signal using a time domain compression method with little algorithmic delay or in an uncompressed manner. If it is a synchronization slot, the transmission channel is set as a synchronization channel, an access address unit of a packet is configured based on an advertisement address (e.g., 0x8E89BED 6) and an IBIS PDU is generated. If the data time slot is the data time slot, setting the sending channel as the data channel, configuring an access address unit of the data packet based on the second access address parameter which is randomly generated and generating the IBIS PDU. The IBIS PDU is then transmitted at the beginning of the corresponding synchronization slot or data slot. If the number of sub-events is greater than 1, then there is a retransmission slot in the current sub-event where an IBIS PDU needs to be transmitted until the transmission is ended within the current isochronous interval when retransmission is no longer needed.

Referring to fig. 6, fig. 6 is a second flowchart of a wireless audio transmission method according to an embodiment of the present invention, where the wireless audio transmission method according to the embodiment of the present invention may be applied to a receiving device and executed by the receiving device. The receiving device has at least two working modes: a scanning mode and an audio data receiving mode. When the receiving device enters a receiving state, a scanning mode is executed first, and the data packet sent by the sending device is searched through scanning and is synchronized with the sending device. After the synchronization is completed, the receiving apparatus executes an audio data receiving mode to continuously receive audio data.

As shown in fig. 6, the receiving device wirelessly communicates with the transmitting device to receive the wideband audio stream in consecutive time intervals, the time duration of the time intervals is less than 5ms, each time interval includes N sub-events, each sub-event includes a transmission time slot for transmitting one data packet, and N is a positive integer;

when the receiving device is operating in a scanning mode, the method comprises the steps of:

step 601, searching a data packet sent by the sending device.

Step 602, obtaining the transmission time of the data packet based on the search and synchronizing with the transmitting device.

Step 603, acquiring audio data in the broadband audio stream from the data packet obtained by searching, and acquiring control information when the data packet includes the control information; the control information includes at least parameters required by the receiving device to receive the data packet.

Optionally, the obtaining, based on the searching, the transmission time of the data packet to synchronize with the transmitting device includes:

determining the starting time of the equal time interval based on the sending time of the data packet obtained by searching;

and carrying out time synchronization with the sending equipment based on the starting moment of the equal time interval and the duration of the equal time interval.

Optionally, after the control information is further acquired when the control information is included in the data packet, the method further includes:

and carrying out frequency hopping channel synchronization with the transmitting equipment based on the control information.

It will be appreciated that the receiving device may also synchronize with the transmitting device in terms of pre-known parameters (e.g., factory set parameters, etc.).

In this embodiment, the synchronization, control and data transmission functions in the wireless communication are integrated in the same data packet, and the receiving device can implement time synchronization and frequency hopping channel synchronization based on the data packet, and acquire audio data and control information while synchronizing, so that the communication flow is simple, the timeslot utilization rate is high, and ultra-low delay broadband audio data reception can be implemented.

It may be understood that, in implementation, the data packet obtained by the receiving device through searching may be sent by the sending device in a specific sub-event, or may be sent by the sending device in any sub-event, or may be sent in a specific channel, or may be sent in any channel. Corresponding schemes can be adopted according to specific application scenes.

In some embodiments, the transmitting device transmits control information based on the data packet only in a portion of the sub-events. Thus, certain flag bits of the data packet may be configured to indicate that the data packet carries control information, so that the receiving device determines whether the obtained data packet carries control information. The transmitting device may also transmit a data packet carrying both audio data and control information based on a specific channel in part of the sub-event, and the receiving device searches for the data packet based on the specific channel, thereby determining that the current data packet carries control information.

In other embodiments, the transmitting device may transmit a data packet including audio data and control information in each sub-event. At this time, the receiving apparatus can confirm that each of the data packets obtained by itself includes control information.

Optionally, the searching the data packet sent by the sending device includes:

and searching and obtaining the data packet sent by the sending equipment on a synchronous channel based on a first access address parameter, wherein the first access address parameter is a preset specific value, and the synchronous channel is a special channel for searching the data packet by the receiving equipment in a scanning mode.

Optionally, when the receiving device is operating in an audio data receiving mode, the method further comprises:

receiving the data packets in each isochronous interval;

audio data in the wideband audio stream is retrieved from each received data packet, or,

audio data in the wideband audio stream is obtained from each received data packet and the control information is obtained from the data packets received in at least part of the sub-events.

It will be appreciated that in particular implementations, the receiving device may receive in sequence in each sub-event of each isochronous interval until the data packet is received correctly. Optionally, the receiving the data packet at each isochronous interval includes:

determining the type of a transmitting time slot of a current sub-event, wherein the type of the transmitting time slot comprises a synchronous time slot and a data time slot, and the current sub-event is any sub-event in each equal time interval;

Receiving the data packet based on a synchronous channel in the current sub-event under the condition that the type of the transmission time slot of the current sub-event is the synchronous time slot;

and receiving the data packet based on a data channel in the current sub-event under the condition that the type of the sending time slot of the current sub-event is the data time slot.

Optionally, the receiving the data packet based on a synchronization channel in the current sub-event includes:

receiving the data packet on a synchronous channel based on a first access address parameter, wherein the first access address parameter is a preset specific value;

the receiving the data packet based on a data channel in the current sub-event includes:

the data packet is received on a data channel based on a second access address parameter, the second access address parameter being different from the first access address parameter.

It should be noted that, as an implementation manner of the receiving device side corresponding to the example shown in fig. 2, a specific implementation manner of the embodiment may refer to a related description in the example shown in fig. 2, and in order to avoid repetition, a description is omitted here.

Optionally, in some embodiments, the receiving device employs a low-latency time domain packet loss concealment (Packet Loss Concealment, PLC) technique, for example, employing a time domain PLC technique based on an autoregressive model (Autoregressive Models, AR Models), or employing a time domain PLC technique based on a convolutional recursive network (Convolutional Recurrent Network, CRN).

Optionally, in some embodiments, the receiving device uses a multi-path receiving method to receive the data packet, thereby improving reliability of audio data transmission while reducing the number of retransmissions and reducing transmission delay.

As a specific embodiment, fig. 7 provides a schematic workflow diagram of a receiving device in a scanning mode, referring to fig. 7, three primary advertisement channels numbered 37, 38, 39 are determined as synchronization channels with reference to BLE protocol, and the other 37 channels are data channels. After the receiving device enters the receiving state, the receiving device is in a scanning mode, and the receiving device searches IBIS PDU through advertisement access address (0 x8E89BED 6) on three main advertisement channels (numbered 37, 38, 39). The receiving device synchronizes with the transmitting device based on the transmission time of the data packet obtained by searching, further obtains control information from the data packet, extracts relevant parameters for calculating the frequency hopping channel from the control information, and completes the frequency hopping channel synchronization. After the device is synchronously sent on the main advertisement channel, other parameters are obtained from the control information, such as a synchronization interval, an equal time interval, a second access address parameter, a channel mapping table, a cyclic check setting value and the like, and the device is switched to an audio data receiving mode to receive the IBIS PDU on the main advertisement channel according to the synchronization interval and the advertisement access address to obtain audio data, and the IBIS PDU is received on the corresponding data channel according to the equal time interval, the second access address parameter and the channel mapping table to obtain audio data.

Fig. 8 provides a schematic diagram of the workflow of a receiving device in an audio data receiving mode, as a specific embodiment. As shown in fig. 8, when the receiving apparatus prepares to receive audio data every new isochronous interval in the audio data receiving mode, it is first determined whether the current slot is a synchronous slot. If the current time slot is judged to be the synchronous time slot, setting a main advertisement channel and receiving the IBIS PDU by adopting the advertisement access address. And if the current time slot is judged to be the data time slot, setting a data channel and adopting a second access address parameter to receive the IBIS PDU. If the IBIS PDU is not received correctly and there is a retransmission slot within the isochronous interval and the IBIS PDU needs to be re-received, the IBIS PDU is received again in the retransmission slot. When there are no retransmission slots in the isochronous interval and no more IBIS PDUs are re-received, the reception is ended in the current isochronous interval.

The application of the wireless audio transmission method provided by the invention in an actual scene is described in a specific embodiment. In a specific embodiment, a single-point to multi-point Ultra low latency wireless microphone (Ultra-Low Latency Wireless Microphone, ULLWM) system, such as the ULLWA system shown in fig. 1, comprises a wireless microphone and one or more wireless microphone receiving devices, such as a cell phone, a computer, a recording device, an earphone or a speaker, etc.

In one embodiment, the wireless microphone monaural audio sample rate is 48kHz and the pulse code modulation (Pulse Code Modulation, PCM) quantization bit number of the digital audio signal is 16. In this embodiment, the transmission rate required for the digital audio not compression-encoded is 768kbps by adopting the non-compression encoding method. In the IBIS slot structure shown in fig. 3, the isochronous interval is 1ms, the synchronization interval is 32ms, and each frame of audio data is 1ms long, which is 96 bytes. The IBIS PDU adopts BLE 2M PHY, wherein the control information comprises a 4-bit synchronous Interval (Sync Interval), a 2-bit equal Interval (ISO Interval), a 2-bit sub-event Number (NSE), a 32-bit Access Address (AA), a 37-bit channel mapping table (ChM), an 8-bit cyclic check setting value (CRCInit), a 9-bit IBIS load number (Payload Count), a 2-bit channel Mode (CH Mode), and the total Data length in the IBIS PDU load is 96 bytes. Where nse=1, chm is set to all 1, crcinit is randomly generated, CH Mode is set to 0, and it is used to characterize the channel Mode as mono. The IBIS PDU contains a total of 119 bytes of 2-byte preamble, 4-byte access address, 2-byte header, 3-byte cyclic check bit, 12-byte control information, and 96-byte Data, with an air time of 476us.

In another embodiment, the wireless microphone monaural audio sample rate is 32kHz and the pulse code modulation (Pulse Code Modulation, PCM) quantization bit number of the digital audio signal is 16. In this embodiment, the transmission rate required for the digital audio not compression-encoded is 512kbps by adopting the non-compression encoding method. In the IBIS slot structure shown in fig. 3, the IBIS isochronous interval is 1ms, the synchronization interval is 32ms, and each frame of audio data is 1ms long, which is 64 bytes. The IBIS PDU employs BLE 2M PHY, wherein the control information includes a 4-bit synchronization Interval (Sync Interval), a 2-bit isochronous Interval (ISO Interval), a 2-bit sub-event Number (NSE), a 32-bit Access Address (AA), a 37-bit channel map (ChM), an 8-bit cyclic check set value (CRCInit), a 9-bit IBIS load number (Payload Count), a 2-bit channel Mode (CH Mode), and a total of 12 bytes. The Data length in the IBIS PDU payload is 64 bytes. Where nse=2, chm is set to all 1 s, crcinit is randomly generated, CH Mode is set to 0, and it is used to characterize the channel Mode as mono. The IBIS PDU contains a 2 byte preamble, a 4 byte access address, a 2 byte header, a 3 byte cyclic check bit, 12 bytes of control information, and 64 bytes of Data, for a total of 87 bytes, with an air time of 348us. Two sub-events are 500us long, and the interval between sub-events is 152us. In this embodiment nse=2, each sub-event contains a retransmission time slot, and audio data within the time interval can be transmitted 2 times, thereby providing a more reliable wireless audio transmission.

It should be appreciated that the above are only examples of two alternative embodiments, and that in practical applications, higher rate BLE Physical layer (PHY) techniques, e.g., 4mbps,6mbps,8mbps PHY techniques, may also be employed, providing stereo audio transmission, and providing a larger NSE to improve audio transmission reliability.

Referring to fig. 9, the transmitting device shown in fig. 9 includes an audio input unit, a user interface, an audio processing unit, a baseband data and protocol processor, and a BLE radio frequency transceiver module. The audio input unit is used for acquiring digital audio signals and transmitting the digital audio signals to the audio processing unit, and if necessary, the audio processing unit compresses and encodes the digital audio signals into audio data, and the audio data are directly output without compression. The baseband data and protocol processor is used for executing a BLE Audio related protocol and the IBIS protocol, and processing the Audio data into IBIS PDU which is suitable for being sent by the BLE radio frequency transceiver module. The BLE radio frequency transceiver module is configured to convert the IBIS PDU into radio frequency signal for transmission, and the BLE radio frequency transceiver module may further include a physical layer technology supporting future BLE high rates, e.g., 4mbps,6mbps,8mbps. The user interface may be a key, a touch pad, a wireless control interface, etc.

Referring to fig. 10, the receiving device shown in fig. 10 includes a user interface, an audio output unit, an audio processing unit, a baseband data and protocol processor, and a BLE radio frequency transceiver module. The baseband data and protocol processor is used for executing a BLE Audio related protocol and the IBIS protocol, processing IBIS PDU sent by ULWM sending equipment and received by the BLE radio frequency receiving and transmitting module, and sending the IBIS PDU to the Audio processing unit. The audio processing unit is also used for audio decoding, packet loss processing, equalization, and sound effect post-processing, if necessary. The audio output unit is used for converting the audio signal into a sound signal. The BLE radio frequency transceiver module is used for BLE radio signal or IBIS PDU reception, and may further include a physical layer technology supporting future BLE high rates, e.g., 4mbps,6mbps,8mbps. The BLE radio frequency transceiver module may also support multi-path parallel reception to improve reliability of wireless transmission, e.g., 2-path parallel reception. The user interface may be a key, a touch pad, a wireless control interface, etc.

The embodiment of the invention also provides a transmitting device. Referring to fig. 11, fig. 11 is a second block diagram of a transmitting apparatus according to an embodiment of the present invention. Since the principle of the sending device for solving the problem is similar to that of the wireless audio transmission method in the embodiment shown in fig. 2, the implementation of the sending device can refer to the implementation of the method, and the repetition is omitted.

As shown in fig. 11, the embodiment of the present invention further provides a transmitting device 1100, where the transmitting device 1100 wirelessly communicates with a receiving device to transmit a wideband audio stream in consecutive isochronous intervals, where the duration of the isochronous intervals is less than 5ms, and each isochronous interval includes N sub-events, where each sub-event includes a transmission slot for transmitting one data packet, and N is a positive integer; the transmitting apparatus 1100 includes:

a sending module 1101, configured to send audio data in the wideband audio stream in each sub-event based on the data packet, and send control information in addition to the audio data in at least part of the sub-events, where the control information includes at least parameters required by the receiving device to receive the data packet.

Optionally, the sending module 1101 includes:

and the first sending unit is used for sending the audio data and the control information in the broadband audio stream in each sub-event based on the data packet.

Optionally, the sending module 1101 includes:

the first determining unit is used for determining the type of a sending time slot of a current sub-event, wherein the type of the sending time slot comprises a synchronous time slot and a data time slot, and the current sub-event is any sub-event;

A second transmitting unit, configured to transmit, in the current sub-event, the data packet based on a synchronization channel when the type of the transmission slot of the current sub-event is the synchronization slot; the synchronous channel is a special channel for searching a data packet by the receiving equipment in a scanning mode;

and the third sending unit is used for sending the data packet based on a data channel in the current sub-event when the type of the sending time slot of the current sub-event is the data time slot.

Optionally, the first determining unit is specifically configured to:

Optionally, the data packet includes an access address unit,

the second sending unit is specifically configured to:

the third sending unit is specifically configured to:

Optionally, the data packet further includes a protocol data unit, where the protocol data unit includes a packet header and a payload, and the payload is used to carry the audio data and control information;

the control information includes at least one of: the method comprises the steps of synchronizing interval parameters, time interval parameters, the number of sub-events, a second access address parameter, a channel mapping table, a cyclic check set value, a load number, a channel mode parameter, an audio playing synchronization instruction, a volume synchronization instruction and a master-slave switching instruction.

Optionally, the data packet is an advertisement data packet,

The data channel adopts a Bluetooth low-power consumption data channel.

Optionally, the wideband audio stream is a mono audio stream, and in the case that N is greater than 1, the audio data sent in each sub-event in the same isochronous interval is the same; or,

Optionally, the N is 1 or 2 or 3, the time duration of the equal time interval is less than or equal to 2.5ms, and the sampling rate of the wideband audio stream is greater than or equal to 24KHz; and/or the number of the groups of groups,

the sub-event does not include a receiving time slot for receiving data sent by the receiving device.

The transmitting device 1100 provided in the embodiment of the present invention may perform the method embodiment shown in fig. 2, and its implementation principle and technical effects are similar, and this embodiment will not be described herein again.

As shown in fig. 12, the embodiment of the invention further provides a receiving device. Referring to fig. 12, fig. 12 is a second block diagram of a receiving apparatus according to an embodiment of the present invention. Since the principle of the receiving device for solving the problem is similar to that of the wireless audio transmission method in the embodiment shown in fig. 6, the implementation of the receiving device can refer to the implementation of the method, and the repetition is omitted.

As shown in fig. 12, the receiving device 1200 wirelessly communicates with the transmitting device to receive a wideband audio stream in consecutive isochronous intervals, the duration of the isochronous intervals being less than 5ms, and each of the isochronous intervals including N sub-events, each of the sub-events including a transmission time slot for transmitting one data packet, N being a positive integer;

the receiving apparatus 1200 includes a search module 1201, a first synchronization module 1202, and a first acquisition module 1203:

when the receiving device 1200 is operating in a scanning mode,

the searching module 1201 is configured to search a data packet sent by the sending device;

the first synchronization module 1202 is configured to synchronize, with the transmitting device, the transmission time of the data packet obtained based on searching;

the first obtaining module 1203 is configured to obtain audio data in the wideband audio stream from the data packet obtained by searching, and further obtain control information when the data packet includes the control information; the control information includes at least parameters required for the receiving apparatus 1200 to receive the data packet.

Optionally, the first synchronization module 1202 includes:

a second determining unit, configured to determine a start time of the isochronous interval based on a transmission time of the data packet obtained by searching;

And the first synchronization unit is used for carrying out time synchronization with the sending equipment based on the starting moment of the equal time interval and the duration of the equal time interval.

Optionally, the receiving apparatus 1200 further includes:

and the second synchronization module is used for carrying out frequency hopping channel synchronization with the sending equipment based on the control information.

Optionally, the search module 1201 is specifically configured to:

and searching and obtaining the data packet sent by the sending device on a synchronous channel based on a first access address parameter, wherein the first access address parameter is a preset specific value, and the synchronous channel is a dedicated channel for searching the data packet by the receiving device 1200 in a scanning mode.

Optionally, the receiving apparatus 1200 further includes a receiving module, a second acquiring module, and a third acquiring module:

when the receiving apparatus 1200 is operating in an audio data reception mode,

the receiving module is used for receiving the data packet in each equal time interval;

the second acquisition module is configured to acquire audio data in the wideband audio stream from each received data packet, or,

the third obtaining module is configured to obtain audio data in the wideband audio stream from each received data packet, and obtain the control information from the data packet received in at least part of the sub-events.

Optionally, the receiving module includes:

a third determining unit, configured to determine a type of a transmission time slot of a current sub-event, where the type of the transmission time slot includes a synchronization time slot and a data time slot, and the current sub-event is any sub-event in the each isochronous interval;

a first receiving unit, configured to receive, in the current sub-event, the data packet based on a synchronization channel when a type of a transmission slot of the current sub-event is the synchronization slot;

and the second receiving unit is used for receiving the data packet based on a data channel in the current sub-event when the type of the sending time slot of the current sub-event is the data time slot.

Optionally, the first receiving unit is specifically configured to:

the second receiving unit is specifically configured to:

The receiving apparatus 1200 provided in the embodiment of the present invention may perform the method embodiment shown in fig. 6, and its implementation principle and technical effects are similar, and this embodiment will not be repeated here.

As shown in fig. 13, an embodiment of the present invention further provides an electronic device 1300, including a processor 1301, a memory 1302, and a program or an instruction stored in the memory 1302 and capable of being executed on the processor 1301, where the program or the instruction implements each process of the method embodiment shown in fig. 2 or fig. 6 when executed by the processor 1301, and the same technical effects can be achieved, and for avoiding repetition, a detailed description is omitted herein.

The embodiment of the present invention further provides a readable storage medium, where a program is stored, where the program when executed by a processor implements each process of the method embodiment shown in fig. 2 or fig. 6 and achieves the same technical effects, and in order to avoid repetition, a description is omitted here. Wherein the readable storage medium is selected from Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk.

In the several embodiments provided in this application, it should be understood that the disclosed methods and apparatus may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may be physically included separately, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in hardware plus software functional units.

The integrated units implemented in the form of software functional units described above may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium, and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform part of the steps of the transceiving method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

While the foregoing is directed to the preferred embodiments of the present invention, it will be appreciated by those skilled in the art that various modifications and adaptations can be made without departing from the principles of the present invention, and such modifications and adaptations are intended to be comprehended within the scope of the present invention.

Claims

1. A wireless audio transmission method applied to a transmitting device, wherein the transmitting device wirelessly communicates with a receiving device to transmit a broadband audio stream in successive isochronous intervals, the duration of the isochronous intervals is less than 5ms, each isochronous interval comprises N sub-events, each sub-event comprises a transmission time slot for transmitting a data packet, and N is a positive integer; the method comprises the following steps:

2. The method of claim 1, wherein said transmitting audio data in said wideband audio stream in each of said sub-events based on said data packets and simultaneously transmitting control information in addition to said audio data in at least part of said sub-events comprises:

and transmitting audio data and the control information in the broadband audio stream in each sub-event based on the data packet.

3. The method according to claim 1 or 2, wherein said transmitting audio data in said wideband audio stream in each of said sub-events based on said data packets and simultaneously transmitting control information in addition to said audio data in at least part of said sub-events comprises:

4. The method of claim 3, wherein the determining the type of transmission slot for the current sub-event comprises:

5. The method of claim 3, wherein the data packet comprises an access address unit,

6. The method of claim 5, wherein the data packet further comprises a protocol data unit, the protocol data unit comprising a header and a payload, the payload for carrying the audio data and control information;

7. The method of claim 6, wherein the data packet is an advertisement data packet,

the data channel adopts a Bluetooth low-power consumption data channel.

8. The method of claim 1, wherein the wideband audio stream is a mono audio stream, and wherein in the case where N is greater than 1, the audio data transmitted in each sub-event within the same isochronous interval is the same; or,

9. The method of claim 1, wherein N is 1 or 2 or 3, the isochronous interval duration is less than or equal to 2.5ms, and the sampling rate of the wideband audio stream is greater than or equal to 24KHz; and/or the number of the groups of groups,

10. A wireless audio transmission method applied to a receiving device, wherein the receiving device wirelessly communicates with a transmitting device in a continuous time interval to receive a broadband audio stream, the time duration of the time interval is less than 5ms, each time interval comprises N sub-events, each sub-event comprises a transmitting time slot for transmitting one data packet, and N is a positive integer;

searching a data packet sent by the sending equipment;

11. The method of claim 10, wherein the obtaining the transmission time of the data packet based on the search is synchronized with the transmitting device, comprising:

12. The method of claim 11, wherein after further acquiring the control information when the control information is included in the data packet, further comprising:

13. The method of claim 10, wherein the searching for the data packet transmitted by the transmitting device comprises:

14. The method according to any one of claims 10-13, wherein when the receiving device is operating in an audio data receiving mode, the method further comprises:

receiving the data packets in each isochronous interval;

15. The method of claim 14, wherein said receiving the data packet at each isochronous interval comprises:

16. The method of claim 15, wherein said receiving the data packet based on a synchronization channel in the current sub-event comprises:

17. A transmitting device in wireless communication with a receiving device for transmitting a wideband audio stream in successive isochronous intervals, said isochronous intervals being less than 5ms in duration and each of said isochronous intervals comprising N sub-events, each of said sub-events comprising a transmission time slot for transmitting a data packet, N being a positive integer; the transmitting apparatus includes:

18. A receiving device in wireless communication with a transmitting device in successive isochronous intervals to receive a wideband audio stream, wherein the isochronous intervals have a duration of less than 5ms and each of the isochronous intervals comprises N sub-events, each of the sub-events comprising a transmission time slot for transmitting a data packet, N being a positive integer;

when the receiving device is operating in a scanning mode,

19. The receiving device of claim 18, further comprising a receiving module, a second acquisition module, and a third acquisition module:

when the receiving device is operating in an audio data receiving mode,

20. An electronic device, comprising: a memory, a processor, and a program stored on the memory and executable on the processor; the method according to any one of claims 1 to 16, characterized in that the processor is adapted to read a program in a memory for implementing the steps in the wireless audio transmission method according to any one of claims 1 to 16.

21. A readable storage medium storing a program, wherein the program when executed by a processor implements the steps of the method of any one of claims 1 to 16.