WO2020107491A1

WO2020107491A1 - Wireless audio system, and audio communication method and device

Info

Publication number: WO2020107491A1
Application number: PCT/CN2018/118791
Authority: WO
Inventors: 朱宇洪; 王良; 郑勇; 张景云
Original assignee: 华为技术有限公司
Priority date: 2018-11-30
Filing date: 2018-11-30
Publication date: 2020-06-04
Also published as: CN115665670A; CN113169915B; CN113169915A

Abstract

The present application relates to a wireless audio system, and an audio communication method and device, wherein a parameter of an isochronous data transmission channel is determined for each audio service, with the audio service as the granularity. Parameter negotiations, such as QoS parameter negotiation, codec parameter negotiation and ISO parameter negotiation, can be carried out between a first audio device (such as a mobile phone and a media player) and a second audio device (such as an earphone) with an audio service as the granularity, and an isochronous data transmission channel is then created based on the negotiated parameters. Regardless of the kind of audio service scenarios, streaming data is transmitted through an LE ISO link, and service scenario handover does not relate to transmission frame handover, and thus, efficiency is higher.

Description

Wireless audio system, audio communication method and equipment

Technical field

This application relates to the field of wireless technology, in particular to a wireless audio system, audio communication method and equipment.

Background technique

Bluetooth (Bluetooth) wireless technology is a short-range communication system intended to replace cable connections between portable and/or stationary electronic devices. The key features of Bluetooth wireless communication technology are stability, low power consumption and low cost. Many features of its core specifications are optional and support product differentiation.

Bluetooth wireless technology has two forms of system: basic rate (basic rate, BR) and low power consumption (low energy, LE). Both types of systems include device discovery, connection establishment, and connection mechanisms. The basic rate BR may include an optional enhanced data rate (EDR), and alternating media access control layer and physical layer extension (alternate media access control and physical layer extensions, AMP). Low-power LE systems include features that are designed to achieve products that require lower power consumption, lower complexity, and lower cost than BR/EDR.

Devices that implement the two systems BR and LE can communicate with other devices that also implement the two systems. Some profiles and use cases are only supported by one of the systems. Therefore, devices that implement these two systems have the ability to support more use cases.

Profile is a unique concept of Bluetooth protocol. In order to achieve the interconnection of different devices under different platforms, the Bluetooth protocol not only specifies the core specification (called Bluetooth core), but also defines various application layer specifications for various application scenarios. These application layer specifications are called Make a Bluetooth profile. In order to realize the interconnection of different devices under different platforms, the Bluetooth protocol has developed application layer specifications (profiles) for various possible and universal application scenarios, such as the Bluetooth stereo audio transmission specifications (advance audio distribution profile, A2DP), audio/video remote control profile (AVRCP), basic image profile (basic imaging profile (BIP), hands-free profile (HFP), human interface specification (human interface device profile, HID profile, Bluetooth headset profile (headset profile, HSP), serial port profile (serial port profile, SPP), file transfer profile (file transmission profile, FTP), personal area network protocol (personal area network profile, PAN profile )and many more.

However, the existing Bluetooth protocol defines different protocol frameworks for different profiles, which are independent of each other and cannot be compatible.

Summary of the invention

This application provides a wireless audio system, audio communication method and device, which can solve the problem of poor compatibility based on the existing Bluetooth protocol.

In a first aspect, the present application provides an audio communication method, which is applied to an audio source side. The method may include: establishing an ACL link between an audio source (such as a mobile phone and a media player) and an audio receiver (such as a headset). For a specific first audio service, the audio source can negotiate parameters with the audio receiver through the ACL link. Based on the first parameter determined through negotiation, an isochronous data transmission channel can be established between the audio source and the audio receiver. The isochronous data transmission channel can be used to transmit streaming data (i.e. audio data) of the first audio service. Among them, a Bluetooth low energy connection is established between the audio source and the audio receiver.

In a second aspect, the present application provides an audio communication method, which is applied to the audio receiver side. The method may include: the audio receiver and the audio source establish a Bluetooth low energy connectionless asynchronous LE ACL link. The audio receiver performs parameter negotiation for the first audio service through the LE ACL link and the audio source, and the first parameter negotiated in the parameter negotiation corresponds to the first audio service. The audio receiver may create an LE isochronous data transmission channel corresponding to the first audio service based on the first parameter and the audio source. The LE isochronous data transmission channel corresponding to the first audio service is used for the audio receiver to receive the audio data of the first audio service sent by the audio source. Among them, a Bluetooth low energy connection is established between the audio source and the audio receiver.

In this application, the audio service may refer to a service or application capable of providing audio functions (such as audio playback, audio recording, etc.). Audio services may involve audio-related data transmission services, such as the transmission of audio data itself, content control messages used to control the playback of audio data, and flow control messages used to create isochronous data transmission channels.

By implementing the methods provided in the first and second aspects, parameter negotiation and the establishment of isochronous data transmission channels can be performed at the granularity of audio services. The flow control messages and content control messages of each audio service are transmitted through the LEACL link The data is transmitted through the LE ISO link, which unifies the transmission framework of each business. Instead of using the profile as the granularity to adapt different transmission frameworks for different profile applications. It can be seen that the audio communication method provided in this application can be applied to more audio services and has better compatibility.

With reference to the first aspect or the second aspect, in some embodiments, the ACL link may be used to carry flow control messages, such as flow control messages involved in parameter negotiation, parameter configuration, and establishment of isochronous transmission channels. The ACL link can also be used to carry content control messages, such as call control (e.g. answer, hang up, etc.) messages, playback control (e.g. previous, next, etc.) messages, and volume control (e.g., increase volume, decrease volume) News etc.

With reference to the first aspect or the second aspect, in some embodiments, the audio source may generate the content control message of the first audio service, and may send the content control message of the first audio service to the audio receiver through the LEACL link.

Correspondingly, the audio receiver can receive the content control message of the first audio service sent by the audio source through the LEACL link, and can perform content control on the first audio service according to the content control message. The content control includes one or more of the following : Volume control, playback control, call control.

The content control message is used by the audio receiver to perform content control on the first audio service. The content control includes one or more of the following: volume control, playback control, and call control.

Optionally, the audio source may receive user input (for example, the user presses the phone hang-up button on the audio source), and then generates a content control message for the first audio service according to the user input.

With reference to the first aspect or the second aspect, in some embodiments, the audio receiver may generate the content control message of the first audio service, and may send the content control message of the first audio service to the audio source through the LEACL link.

Correspondingly, the audio source can receive the content control message of the first audio service sent by the audio receiver through the LEACL link, and can perform content control on the first audio service according to the content control message. The content control includes one or more of the following : Volume control, playback control, call control.

Optionally, the audio receiver can receive user input (for example, the user presses the phone hangup button on the audio receiver), and then generates a content control message for the first audio service according to the user input.

With reference to the first aspect or the second aspect, in some embodiments, the audio source may generate audio data of the first audio service, and may send the first audio to the audio receiver through the LE isochronous data transmission channel corresponding to the first audio service Audio data for business.

Correspondingly, the audio receiver can receive the audio data sent by the audio source through the LE isochronous data transmission channel corresponding to the first audio service. Optionally, the audio receiver may convert the audio data of the first audio service into sound. Optionally, the audio receiver may store audio data of the first audio service.

With reference to the first aspect or the second aspect, in some embodiments, the first parameter may include one or more of the following: QoS parameters, codec parameters, ISO parameters, and so on.

Among them, the QoS parameters may include parameters such as delay, packet loss rate, throughput, etc. that represent transmission quality. Codec parameters may include parameters that affect audio quality, such as encoding method and compression ratio. ISO parameters can include CIS ID, number of CIS, maximum data size transmitted from master to slave, maximum data size transmitted from slave to master, maximum time interval of data transmission from master to slave at the link layer, and data from slave to master The longest time interval for packet transmission at the link layer, etc.

With reference to the first aspect or the second aspect, in some embodiments, the first parameter may be obtained by querying a database according to the first audio service, and the database may store parameters corresponding to various audio services.

Optionally, in the database, the parameters corresponding to the audio service may be designed by comprehensively considering various audio switching situations or mixing situations involved in the audio service. This parameter can be applied to these situations involved in the business. For example, in the game business, it may happen that the background sound of the game and the voice of the microphone are switched or superimposed (the microphone is turned on during the game). The codec parameters and QoS parameters of the game background sound and Mike's speech sound may be different. For the game business, parameters suitable for this situation can be designed, so that when the user opens the microphone to speak during the game, it will not affect the listening experience.

With reference to the first aspect or the second aspect, in some embodiments, the content control message may include one or more of the following: volume control (such as increasing the volume, decreasing the volume, etc.) message, playback control (such as the previous song, the next One, etc.) message, call control (answer, hang up) message.

With reference to the first aspect or the second aspect, in some embodiments, when an audio service scene is switched, switching from a music service to a telephone service (answering a call when listening to music) is used as an example, the audio source and the audio receiver can Re-negotiate the parameters, negotiate to determine the new parameters corresponding to the new audio service (such as the telephone service), and then create a new isochronous data transmission channel based on the new parameters. The new isochronous data transmission channel can be used to transmit streaming data of the new audio service (such as telephone service). The isochronous data transmission channels of various services are based on LE. In this way, the switching of the business scenario does not involve the switching of the transmission frame, and the efficiency is higher, and there is no obvious pause.

Optionally, when the audio service scene is switched, the isochronous data transmission channel corresponding to the old audio service (such as the music service) can also be reconfigured using the new parameters corresponding to the new audio service (such as the telephone service), without the need for new The parameters recreate a new isochronous data transmission channel. In this way, efficiency can be further improved.

With reference to the first aspect or the second aspect, in some embodiments, the creation time of the isochronous data transmission channel may include the following options:

In one option, an isochronous data transmission channel can be created when the audio service arrives. For example, when the user opens the game application (the game background sound starts playing at the same time), the application layer of the mobile phone will send a game background sound service creation notification to the Host, according to the notification, the mobile phone will initiate the creation process of the isochronous data transmission channel to the Bluetooth headset .

In another option, a default isochronous data transmission channel may be established first, and the default isochronous data transmission channel may be created based on default CIG parameters. In this way, when the audio service arrives, the default isochronous data transmission channel can be used directly to carry streaming data, and the response speed is faster.

In yet another option, multiple virtual isochronous data transmission channels may be established first. The multiple virtual isochronous data transmission channels may correspond to multiple sets of different CIG parameters, and may be applicable to multiple audio services. A virtual isochronous data transmission channel refers to an isochronous data transmission channel where no data interaction occurs on the air interface. In this way, when an audio service arrives, a virtual isochronous data transmission channel corresponding to the audio service may be selected, and a handshake is triggered between the first audio device and the second audio device and communication is started.

In a third aspect, an audio device is provided, which includes multiple functional units for correspondingly performing the method provided in any one of the possible implementation manners of the first aspect.

According to a fourth aspect, there is provided an audio device including a plurality of functional units for correspondingly performing the method provided in any one of the possible implementation manners of the second aspect.

In a fifth aspect, an audio device is provided for performing the audio communication method described in the first aspect. The network device may include: a memory and a processor, a transmitter, and a receiver coupled to the memory, where the transmitter is used to send a signal to another wireless communication device, the receiver is used to receive a signal sent by another wireless communication device, and the memory is used To store the implementation code of the audio communication method described in the first aspect, the processor is used to execute the program code stored in the memory, that is, to execute any one of the audio communication methods described in the possible implementation manners of the first aspect.

In a sixth aspect, an audio device is provided for performing the audio communication method described in the second aspect. The terminal may include: a memory and a processor, a transmitter, and a receiver coupled to the memory, where the transmitter is used to send signals to another wireless communication device, the receiver is used to receive signals sent by another wireless communication device, and the memory is used The implementation code of the audio communication method described in the second aspect is stored, and the processor is used to execute the program code stored in the memory, that is, the audio communication method described in any one of the possible implementation manners of the second aspect is executed.

According to a seventh aspect, a chip set is provided. The chip set may include: a first chip and a second chip. The first chip and the second chip communicate through an interface HCI. The first chip may include the following modules: multimedia audio module, voice module, background sound module, content control module, stream control module, stream data module, and L2CAP module. The second chip may include: an LE physical layer module and an LE link layer module.

In the second chip: LE physical layer module, which can be used to provide a physical channel for data transmission (commonly referred to as a channel). Generally, there are several different types of channels in a communication system, such as control channels, data channels, voice channels, and so on. The LE link layer module can be used to provide a physical independent logical transmission channel (also called a logical link) between two or more devices on the basis of the physical layer. The LE link layer module can be used to control the radio frequency state of the device. The device will be in one of five states: waiting, advertising, scanning, initializing, and connecting. The broadcast device can send data without establishing a connection, and the scanning device receives the data sent by the broadcast device; the device that initiates the connection responds to the broadcast device by sending a connection request. If the broadcast device accepts the connection request, the broadcast device and the device that initiates the connection will Will enter the connection state. The device that initiates the connection is called the master device, and the device that accepts the connection request is called the slave device. The LE link layer module may include the LE ACL module and the LE isochronous (ISO) module. The LEACL module can be used to transmit control messages between devices through the LEACL link, such as flow control messages, content control messages, and volume control messages. The LEISO module can be used to transmit isochronous data between devices (such as streaming data itself) through isochronous data transmission channels.

In the first chip: the L2CAP module can be used to manage the logical links provided by the logical layer. Based on L2CAP, different upper-layer applications can share the same logical link. Similar to the concept of port in TCP/IP.

The multimedia audio module, voice module, and background sound module may be modules set according to business scenarios, and may be used to divide the audio application of the application layer into several types of audio services such as multimedia audio, voice, and background sound. It is not limited to multimedia audio, voice, background sound, etc. Audio services can also be divided into: voice, music, games, video, voice assistant, e-mail reminder, alarm, reminder sound, navigation sound, etc. The content control module can be responsible for encapsulating the content control (such as previous, next, etc.) messages of various audio services, and output the content control message of the audio service to the LEACL module 411 to transmit the encapsulated content through the LEACL module 411 Control messages. The flow control module can be used to negotiate parameters for specific audio services, such as QoS parameter negotiation, codec parameter negotiation, ISO parameter negotiation, and creating an isochronous data transmission channel for the specific service based on the negotiated parameters. Creating an isochronous data transmission channel for the specific service can be used to transmit audio data of the specific audio service. In this application, the specific audio service may be referred to as a first audio service, and the negotiated parameter may be referred to as a first parameter. The streaming data module can be used to output audio data of the audio service to the LE isochronous (ISO) module to transmit audio data through the isochronous data transmission channel. The isochronous data transmission channel may be CIS. CIS can be used to transfer isochronous data between connected devices. The isochronous data transmission channel is finally carried on LEISO.

According to an eighth aspect, a chip is provided. The chip may include the module in the first chip and the module in the second chip described in the seventh aspect. For the description of each module, please refer to the seventh aspect, which will not be repeated here.

In a ninth aspect, a communication system is provided. The communication system includes: a first audio device and a second audio device, where the first audio device may be the audio device described in the third aspect or the fifth aspect. The second audio device may be the audio device described in the fourth aspect or the sixth aspect.

According to a tenth aspect, a communication system is provided. The communication system includes: a first audio device, a second audio device, and a third audio device, where the first audio device may be the audio device described in the third aspect or the fifth aspect. Both the second audio device and the third audio device may be the audio devices described in the fourth aspect or the sixth aspect.

According to an eleventh aspect, there is provided a computer-readable storage medium having instructions stored on it, which when run on a computer, causes the computer to execute the audio communication method described in the first aspect above.

According to a twelfth aspect, another computer-readable storage medium is provided. The readable storage medium stores instructions, which when executed on a computer, causes the computer to perform the audio communication method described in the second aspect.

According to a thirteenth aspect, there is provided a computer program product containing instructions, which when executed on a computer, causes the computer to execute the audio communication method described in the first aspect above.

According to a fourteenth aspect, there is provided another computer program product containing instructions that, when run on a computer, cause the computer to perform the audio communication method described in the second aspect above.

BRIEF DESCRIPTION

In order to more clearly explain the technical solutions in the embodiments or the background technology of the present application, the drawings required in the embodiments or the background technology of the present application will be described below.

FIG. 1 is a schematic structural diagram of a wireless audio system provided by this application;

2A is a schematic diagram of the existing protocol framework for releasing BR/EDR Bluetooth;

2B-2D are schematic diagrams of existing protocol stacks of several audio profiles;

FIG. 3 is a schematic diagram of a BLE-based audio protocol framework provided by this application;

4 is a schematic diagram of several data types of audio services provided by this application;

Figure 5 is a schematic diagram of the extended BLE transmission framework;

6 is a schematic diagram of the overall flow of the audio communication method provided by this application;

7 is a schematic flowchart of creating an isochronous data transmission channel provided by this application;

8 is a schematic flowchart of an audio communication method in a scenario where left and right headphones are used together provided by this application;

9 is a schematic flowchart of a BLE connection creation process provided by this application;

10A is a schematic diagram of a hardware architecture of an electronic device provided by an embodiment of the present application;

10B is a schematic diagram of a software architecture implemented on the electronic device shown in FIG. 10A;

11 is a schematic diagram of a hardware architecture of an audio output device provided by an embodiment of the present application;

12 is a schematic diagram of an architecture for providing a chipset according to this application;

13 is a schematic diagram of a chip architecture of the present application.

detailed description

The terms used in the implementation part of the present application are only used to explain specific examples of the present application, and are not intended to limit the present application.

FIG. 1 shows a wireless audio system 100 provided by this application. As shown in FIG. 1, the wireless audio system 100 may include a first audio device 101, a second audio device 102 and a third audio device 103. The first audio device 101 may be implemented as any of the following electronic devices: mobile phones, portable game consoles, portable media playback devices, personal computers, vehicle-mounted media playback devices, and so on. The second audio device 102 and the third audio device 103 may be configured as any type of electro-acoustic transducer for converting audio data into sound, such as speakers, in-ear headphones, headphones, etc. Wait. Not limited to that shown in FIG. 1, the physical form and size of the first audio device 101, the second audio device 102, and the third audio device 103 may also be different, which is not limited in this application.

The first audio device 101, the second audio device 102, and the third audio device 103 may all be configured with a wireless transceiver, and the wireless transceiver may be used to transmit and receive wireless signals.

There is no cable connection between the second audio device 102 and the third audio device 103. The two can communicate through a wireless communication connection 106 instead of a wired communication connection.

The first audio device 101 and the second audio device 102 can establish a wireless communication connection 104.

In the transmission direction of the first audio device 101 to the second audio device 102, the first audio device 101 may send audio data to the second audio device 102 through the wireless communication connection 104. At this time, the role of the first audio device 101 is an audio source (audiosource), and the role of the second audio device 102 is an audio receiver (audio sink). In this way, the second audio device 102 can convert the received audio data into sound, so that the user wearing the second audio device 102 can hear the sound.

In the transmission direction of the second audio device 102 to the first audio device 101, when the second audio device 102 is configured with a sound collection device such as a receiver/microphone, the second audio device 102 can convert the collected sound into audio data And send audio data to the first audio device 101 through the wireless communication connection 104. At this time, the role of the second audio device 102 is an audio source (audiosource), and the role of the first audio device 101 is an audio receiver (audio sink). In this way, the first audio device 101 can process the received audio data, such as sending the audio data to other electronic devices (in a voice call scenario) and storing the audio data (in a recording scenario).

In addition to audio data, the first audio device 101 and the second audio device 102 can also interactively play control control (such as previous, next, etc.) messages, call control (such as answer, hang up) messages based on the wireless communication connection 104, Volume control messages (eg volume up, volume down), etc. Specifically, the first audio device 101 may send a playback control message and a call control message to the second audio device 102 through the wireless communication connection 104, which may implement playback control and call control on the first audio device 101 side. Specifically, the second audio device 102 may send a playback control message and a call control message to the first audio device 101 through the wireless communication connection 104, which may implement playback control and call control on the second audio device 102 side.

Similarly, a wireless communication connection 105 can be established between the first audio device 101 and the third audio device 103, and audio data, playback control messages, and call control messages can be exchanged through the wireless communication connection 105.

The first audio device 101 can simultaneously transmit audio data to the second audio device 102 and the third audio device 103. In order to ensure the integrity of the hearing experience, the audio data transmitted from the first audio device 101 to the second audio device 102, the audio data from the third audio device 103, and the control messages all need to achieve point-to-multipoint synchronous transmission. The synchronization of the second audio device 102 and the third audio device 103 has a crucial influence on the integrity of the user's hearing experience. When the second audio device 102 and the third audio device 103 are implemented as a left earphone and a right earphone, respectively, if the signals of the left and right ears are out of synchronization for about 30 microseconds, it will be disturbing and the user will feel the sound chaos.

The wireless audio system 100 shown in FIG. 1 may be a wireless audio system implemented based on the Bluetooth protocol. That is, the wireless communication connection (wireless communication connection 104, wireless communication connection 105, wireless communication connection 106) between the devices may use a Bluetooth communication connection. In order to support audio applications, the existing BR Bluetooth protocol provides some profiles, such as A2DP, AVRCP, HFP.

However, the existing Bluetooth protocol has some problems. This is explained below.

The existing Bluetooth protocol defines different protocol frameworks for different profiles, which are independent of each other and cannot be compatible.

FIG. 2A exemplarily shows the existing BR/EDR Bluetooth protocol framework. As shown in FIG. 2A, the existing BR/EDR Bluetooth protocol framework may include multiple profiles. To simplify the illustration, only some audio application profiles are shown in FIG. 2A: A2DP, AVRCP, and HFP. Not limited to this, the existing BR/EDR Bluetooth protocol framework may also include other profiles, such as SPP, FTP, etc.

Among them, A2DP stipulates the protocol stack and method of using Bluetooth asynchronous transmission channel to transmit high-quality audio. For example, you can use a stereo Bluetooth headset to listen to music from a music player. AVRCP refers to the remote control function, and generally supports remote control operations such as pause, stop, replay, and volume control. For example, you can use a Bluetooth headset to perform pauses, switch to the next song, etc. to control the music player to play music. FHP is a voice application that provides hands-free calling.

2B-2C show the protocol stacks of A2DP and HFP respectively. among them:

Protocols and entities included in the A2DP protocol stack

The audio source (audio source) is a source of a digital audio stream, which is transmitted to an audio sink in the piconet. An audio receiver (audio sink) is a receiver that receives a digital audio stream from an audio source (audio source) in the same piconet. In a music playing scenario, a typical device used as an audio source may be a media player device, such as MP3, and a typical device used as an audio receiver may be a headset. In a recording scenario, a typical device used as an audio source may be a sound collection device, such as a microphone, and a typical device used as an audio receiver may be a portable recorder.

Baseband, link management protocol (LMP), logical link control and adaptation protocol (logical link control and adaptation protocol, L2CAP) and service discovery protocol (service discovery protocol, SDP) are at the core of Bluetooth The Bluetooth protocol defined in the specification. The audio and video data transmission protocol (audio, video, data, protocol, AVDTP) includes a signaling entity for negotiating streaming parameters and a transmission entity for controlling the stream itself. The application (Application) layer is an entity in which application service and transmission service parameters are defined. This entity is also used to adapt the audio stream data to a defined packet format or adapt the defined packet format to audio stream data.

Protocols and entities included in the AVRCP protocol stack

A controller is a device that initiates a transaction by sending a command frame to a target device. Typical controllers can be personal computers, mobile phones, remote controllers, etc. A target is a device that receives command frames and generates response frames accordingly. Typical target parties may be audio playback/recording devices, video playback/recording devices, televisions, etc.

Baseband (Baseband), Link Management Protocol (LMP) and Logical Link Control and Adaptation Protocol (L2CAP) are layer 1 and layer 2 Bluetooth protocols of the OSI model. The audio and video control transmission protocol (audio, controltransport, protocol, AVCTP) and basic image specification (basic imaging profile, BIP) define procedures and messages used in exchange for A/V device control. SDP is a Bluetooth service discovery protocol (service discovery protocol). The object exchange (OBEX) protocol is used to transfer data objects between Bluetooth devices. It is derived from the protocol defined by infrared and was later adopted by Bluetooth. Audio/video/control (AV/C) is an entity responsible for device control signaling based on AV/C commands. The Application layer is an ACRVP entity used to exchange control and browsing commands defined in the protocol.

Protocols and entities included in the HFP protocol stack

An audio gateway (audio gateway) is a device used as a gateway for inputting audio and outputting audio. A typical device used as an audio gateway may be a cellular phone. Hands-free unit (Hands-Free unit) is a device used as a remote audio input and output mechanism of the audio gateway. The hands-free unit can provide some remote control methods. A typical device used as a hands-free unit may be an on-board hands-free unit.

Baseband (Baseband), Link Management Protocol (LMP) and Logical Link Control and Adaptation Protocol (L2CAP) are layer 1 and layer 2 Bluetooth protocols of the OSI model. RFCOMM is a Bluetooth serial port emulation entity. SDP is a Bluetooth service discovery protocol. Hands-free control (Hands-Free control) is the entity responsible for the specific control signal of the hands-free unit. The control signal is based on AT commands. The audio port simulation (audio port emulation) layer is the entity that simulates the audio port on the audio gateway (audio gateway), and the audio driver (audio driver) is the driver software in the hands-free unit.

Based on the above items A-C, it can be seen that A2DP, AVRCP, and HFP respectively correspond to different protocol stacks, and different profiles use different transmission links, which are not compatible with each other. That is to say, the profile is actually a different protocol stack of the Bluetooth protocol corresponding to different application scenarios. When the Bluetooth protocol needs to support new application scenarios, it is necessary to follow the existing Bluetooth protocol framework to add a profile and add a protocol stack.

Moreover, because different profiles use different protocol stacks, and each protocol stack is independent of each other, the switching between applications of different profiles is time-consuming and will cause significant pauses.

For example, a user wearing a Bluetooth headset turns on Mike and his teammates during the game (the game will produce a background sound of the game, such as a sound triggered by game skills). In this scenario, audio transmission will need to switch from A2DP to HFP. Among them, the background sound transmission during the game can be implemented based on the A2DP protocol stack, and the voice transmission to the teammates can be implemented based on the HFP protocol stack. The game background sound requires higher sound quality than the voice, that is, the coding parameters (such as compression rate) used by the two are different, and the game background sound uses a higher compression rate than the voice. Since A2DP and HFP are independent of each other, switching from A2DP to HFP needs to stop the configuration related to the transmission of game background sound under A2DP, and re-negotiate the parameters of audio data transmission under HFP, configuration initialization, etc. This switch The process takes a long time, resulting in a pause that the user can clearly perceive.

In addition, the existing BR/EDR Bluetooth protocol does not implement point-to-multipoint synchronous transmission.

The existing BR/EDR Bluetooth protocol defines two types of Bluetooth physical links: connectionless asynchronous (Asynchronous) connectionless (ACL) link, synchronous connection-oriented (synchronous connection oriented (SCO) or extended SCO (extended SCO, eSCO) link. Among them, the ACL link supports both symmetric connection (point-to-point) and asymmetric connection (point-to-multipoint). The transmission efficiency of the ACL link is high, but the delay is uncontrollable, and the number of retransmissions is not limited. It can be mainly used to transmit data that is not sensitive to delay, such as control signaling and packet data. SCO/eSCO links support symmetrical connections (point-to-point). The transmission efficiency of the SCO/eSCO link is low, but the delay is controllable, and the number of retransmissions is limited. It can mainly transmit delay-sensitive services (such as voice).

The existing links of ACL and SCO/eSCO in the BR/EDR Bluetooth protocol do not support isochronous data. That is to say, in the point-to-multipoint piconet, the data sent by the master device to multiple slave devices is not synchronized, and the signals of multiple slave devices will be out of sync.

In view of the problems of the existing Bluetooth protocol, this application provides an audio protocol framework based on Bluetooth low energy BLE.

The existing BLE protocol supports a point-to-multipoint network topology. Moreover, the Bluetooth Interest Group (SIG) has proposed to add isochronous data support to BLE to allow BLE devices to transmit isochronous data. isochronous data is time-bounded. isochronous data refers to the information in the stream. Each information entity in the stream is limited by the time relationship between it and the previous entity and the subsequent entity.

However, the existing BLE protocol does not define audio transmission, and the BLE profile does not include audio profiles (such as A2DP, HFP). That is to say, the audio transmission (voice-over-ble) based on Bluetooth low energy is not standardized. The BLE-based audio protocol framework provided by this application will support audio transmission.

FIG. 3 shows a BLE-based audio protocol framework provided by this application. As shown in FIG. 3, the protocol framework may include: LE physical layer (LE physical layer) 313, LE link layer (LE link layer) 310, L2CAP layer and application (application) layer 308. The LE physical layer 313 and the LE link layer 310 may be implemented in a controller, and the L2CAP layer 308 may be implemented in a host. The protocol framework may further include some functional entities implemented in the Host: multimedia audio functional entity 302, voice functional entity 303, background sound functional entity 304, content control functional entity 305, flow control functional entity 306, and streaming data functional entity 307.

In the Controller:

(1) The LE physical layer 313 may be responsible for providing a physical channel (commonly referred to as a channel) for data transmission. Generally, there are several different types of channels in a communication system, such as control channels, data channels, voice channels, and so on. Bluetooth uses the 2.4 GHz industrial scientific (ISM) frequency band.

(2) The LE link layer 310 provides, on the basis of the physical layer, a logical transmission channel (also called a logical link) between two or more devices that is physically independent. The LE link layer 310 can be used to control the radio frequency state of the device. The device will be in one of five states: waiting, advertising, scanning, initializing, and connecting. The broadcast device can send data without establishing a connection, and the scanning device receives the data sent by the broadcast device; the device that initiates the connection responds to the broadcast device by sending a connection request. If the broadcast device accepts the connection request, the broadcast device and the device that initiated the connection will Will enter the connection state. The device that initiates the connection is called the master device, and the device that accepts the connection request is called the slave device.

The LE link layer 310 may include a LE ACL link 311 and a LE isochronous (ISO) link 312. The LE ACL link 311 can be used to transmit control messages between devices, such as flow control messages, content control messages, and volume control messages. The LE ISO link 312 can be used to transmit isochronous data between devices (such as streaming data itself).

In Host:

(1) The L2CAP layer 308 can be responsible for managing the logical links provided by the logical layer. Based on L2CAP, different upper-layer applications can share the same logical link. Similar to the concept of port in TCP/IP.

(2) The multimedia audio function entity 302, the voice function entity 303, and the background sound function entity 304 may be function entities set according to business scenarios, and may be used to divide the audio application of the application layer into multimedia audio, voice, background sound, etc. business. It is not limited to multimedia audio, voice, background sound, etc. Audio services can also be divided into: voice, music, games, video, voice assistant, e-mail reminder, alarm, reminder sound, navigation sound, etc.

(3) The content control function entity 305 may be responsible for encapsulating content control (eg, previous, next, etc.) messages of various audio services, and transmitting the encapsulated content control message through the LEACL link 311.

(4) The stream control functional entity 306 may be responsible for parameter negotiation, such as quality of service (QoS) parameter negotiation, codec parameter negotiation, and isochronous data transmission channel parameter (hereinafter referred to as ISO parameter) Negotiation, and responsible for the establishment of isochronous data transmission channels.

(5) The streaming data function entity 307 may be responsible for transmitting audio data through the isochronous data transmission channel. The isochronous data transmission channel (isochronous data path) may be a connected isochronous audio stream (connected isochronous stream, CIS). CIS can be used to transfer isochronous data between connected devices. The isochronous data transmission channel is finally carried on LEISO 312. The flow control function entity 306 may also be used to negotiate parameters before creating an isochronous data transmission channel, and then create an isochronous data transmission channel based on the negotiated parameters.

As shown in FIG. 3, in the BLE-based audio protocol framework provided by the present application, audio data from the application layer is finally transmitted through the LE ISO link 312.

In addition, the audio protocol framework shown in FIG. 3 may also include a host controller interface (Host Controller Interface, HCI). Host and Controller communicate through HCI, and the communication medium is HCI commands. The Host can be implemented in the application processor (AP) of the device, and the Controller can be implemented in the Bluetooth chip of the device. Optionally, in small devices, Host and Controller can be implemented in the same processor or controller, in which case HCI is optional.

As shown in Figure 4, the BLE-based audio protocol framework provided by this application can divide the data of various audio applications (such as A2DP, HFP, etc.) into three types:

Content control: call control (such as answering, hanging up, etc.), playback control (such as previous song, next song, etc.), volume control (such as increasing the volume, decreasing the volume) and other signaling.

Flow control: Create stream (create stream), terminate stream (terminate stream) and other signaling for stream management. Streams can be used to carry audio data.

Streaming data: audio data itself.

Among them, the content control and flow control data are transmitted through the LEACL 311 link; the streaming data is transmitted through the LEISO 312 link.

In the existing Bluetooth protocol, different profiles correspond to different protocol stacks and correspond to different transmission frames. For example, A2DP and HFP correspond to different transmission frames. A2DP stream data (such as stereo music data) is finally transmitted through the ACL link. Because the transmission efficiency of the ACL link is high, HFP stream data (such as voice data) finally passes through SCO/eSCO. Link transmission, because the transmission delay of the SCO/eSCO link is controllable. Different from the existing Bluetooth protocol, the BLE-based audio protocol framework provided by this application provides a unified audio transmission framework, no matter which audio profile data can be divided into three types: content control, flow control, and flow data. Based on the BLE framework, two types of data, content control and flow control, are transmitted on the LEACL link, and streaming data is transmitted on the LEISO link.

It can be seen that the BLE-based audio protocol framework provided by this application supports audio transmission and can unify service level connections, and divide all upper-layer audio profiles into multimedia audio, voice, background sound and other audio services according to business scenarios. The flow control of each audio service (including negotiation of QoS parameters, negotiation of codec parameters, negotiation of ISO parameters and establishment of isochronous data transmission channels) is unified by the flow control functional entity in the protocol stack. The content control of each audio service (such as call control such as answering and hanging up, playback control such as previous and next song, such as volume control, etc.) is unified by the content control function entity in the protocol stack. Both the flow control message and the content control message are transmitted through the LE ACL link, and the streaming data is transmitted through the LE ISO link. In this way, different audio profiles can be implemented based on the same transmission framework, with better compatibility.

The audio protocol framework provided in this application is based on BLE, which refers to an extended BLE transmission framework (transport architecture). Compared with the existing BLE transmission framework, the expanded BLE transmission framework mainly includes the addition of: isochronous channel (isochronous) channel characteristics.

Figure 5 shows the extended BLE transport framework entities (transport architectures). Among them, the shaded entities are newly added logical sublayers, and these newly added logical sublayers jointly provide isochronous channel characteristics. As shown in Figure 5:

(1) LE physical transmission (LE physical transmission) layer: air interface data transmission, through the data packet structure, through coding, modulation scheme and other marks. LEPHYSICALtransport carries all the information from the upper layer.

(2) LE physical channel (LE physical channel) layer: the air interface physical channel transmitted between Bluetooth devices, through the time domain, frequency domain, and the physical layer bearer channel marked by the air domain, including frequency hopping, time slot, event, access code the concept of. For the upper layer, a LE physical channel can carry different LE logical transmissions (LE logical transmission); for the lower layer, an LE physical channel always maps its only corresponding LE physical transmission.

The LE physical channel layer can include four physical channel entities: LE physical network (LE piconet physical channel), LE broadcast physical channel (LE advertising physical channel), LE periodic physical channel (LE periodic physical channel), LE isochronous physical Channel (LE isochronous physical channel). That is, the LE isochronous physical channel is added to the existing LE physical channel.

Among them, LE piconet physical channel can be used for communication between connected devices. The communication uses frequency hopping technology. LE advertising can be used for connectionless broadcast communications between devices. These broadcast communications can be used for device discovery, connection operations, and connectionless data transmission. LE periodic physical channel can be used for periodic broadcast communication between devices. LE isochronous physical channel can be used to transmit isochronous data, and there is a one-to-one mapping relationship with the upper LE isochronous physical link.

(3) LE physical link layer: the baseband connection between Bluetooth devices, it is a virtual concept, and there is no corresponding field expression in the air interface data packet. For the upper-level LE logical transport, an LE logical transport will only be mapped to an LE physical link. For the lower layer, a LE physical link can be carried through different LE physical channels, but a transmission is always mapped to an LE physical channel.

LE physical link is a further encapsulation of the LE physical channel. The LE physical link layer can include four physical link entities: LE active physical link (LE active physical link), LE broadcast physical link (LE advertising physical link), LE periodic physical link (LE periodic physical link), LE Isochronous physical link (LE isochronous physical link). On the basis of the existing LE physical link, the LE isochronous physical link is added.

Among them, LE isochronous physical link can be used to transmit isochronous data, carrying the upper layer LE-BIS, LE-CIS, and LE physical channel there is a one-to-one mapping relationship.

(4) LE logical transmission layer: it can be responsible for flow control, ACK/NACK confirmation mechanism, retransmission mechanism, and scheduling mechanism. This information is generally carried in the data packet header. For the upper layer, one LElogical transport can correspond to multiple LElogical links. For the lower layer, a LElogical transport only maps to a corresponding LEphysical link.

The LE logical transport layer may include the following logical transport entities: LE-ACL, ADVB, PADVB, LE-BIS, LE-CIS. That is, LE-BIS and LE-CIS are added to the existing LE logical transport.

Among them, LE-CIS is a point-to-point logical transport between the Master and a designated slave, and each CIS supports a LE-S logical link. CIS can be a symmetric rate or an asymmetric rate. LE-CIS is built on LE-ACL. LE-BIS is a point-to-multipoint Logical transport, and each BIS supports one LE-S logical link. LE-BIS is built on PADVB. Here, BIS refers to broadcast isochronous stream, and CIS refers to connected isochronous stream.

The LE ISO link 312 in FIG. 3 may be LE CIS, and the LE ACL link 311 in FIG. 3 may be LE ACL.

(5) LE logical link (LE logical link) layer: can be used to support different application data transmission. For the lower layer, each LElogical link may be mapped to multiple LElogical transports, but only one LElogical transport is selected for mapping at a time.

The LE logical layer may include the following logical link entities: LE-C, LE-U, ADVB-C, ADVB-U, low-energy broadcast control (LEB-C), and low-power flow (low energy, stream, LE-S). Here, "-C" means control, and "-U" means user. That is, LEB-C and LE-S are added on the basis of the existing LE logical link. Among them, LEB-C is used to carry BIS control information, and LE-S is used to carry isochronous data streams.

Based on the audio protocol framework shown in FIG. 3, the present application provides an audio communication method.

The main inventive idea may include: determining the parameters of the isochronous data transmission channel for each audio service with the audio service as the granularity. The first audio device (such as a mobile phone, a media player) and the second audio device (such as a headset) can use the audio service as a granular parameter negotiation, such as QoS parameter negotiation, codec parameter negotiation, ISO parameter negotiation, and Create an isochronous data transmission channel (isochronous data path) based on the negotiated parameters. The isochronous data transmission channel can be used to transmit streaming data.

Different from the prior art, the audio communication method provided in this application no longer uses the profile as a granularity for parameter negotiation, but uses the audio service as a granularity for parameter negotiation. When the business scenario is switched, the isochronous data transmission channel can be configured based on the renegotiated parameters, without the need to switch between different profile protocol stacks, which is more efficient and avoids obvious pauses.

For example, switching from a music business scene to a telephone business scene (answering a call while listening to music). In the existing Bluetooth protocol, this switching involves switching from A2DP (music service) to HFP (telephone service). A2DP and HFP respectively correspond to different transmission frames. A2DP stream data (such as stereo music data) is finally transmitted through the ACL link, and HFP stream data (such as voice data) is finally transmitted through the SCO/eSCO link. Therefore, in the existing Bluetooth protocol, this switch will cause the switch of the underlying transmission frame, which is time-consuming. However, the BLE-based audio protocol framework provided by this application provides a unified audio transmission framework. No matter which audio business scenario, streaming data will be transmitted through the LE ISO link. The switching of business scenarios does not involve the switching of the transmission framework, efficiency higher.

In this application, the QoS parameters may include parameters representing transmission quality such as delay, packet loss rate, and throughput. Codec parameters may include parameters that affect audio quality, such as encoding method and compression ratio. ISO parameters can include CIS ID, number of CIS, maximum data size transmitted from master to slave, maximum data size transmitted from slave to master, maximum time interval of data transmission from master to slave at the link layer, and data from slave to master The longest time interval for packet transmission at the link layer, etc.

FIG. 6 shows the overall flow of the audio communication method provided by the present application. In FIG. 6, a BLE connection is established between the first audio device (such as a mobile phone and a media player) and the second audio device (such as a headset). Expand below:

1. Establish ACL link (S601)

S601, an ACL link is established between the first audio device (such as a mobile phone and a media player) and the second audio device (such as a headset).

Specifically, the ACL link can be used to carry flow control messages, such as flow control messages involved in parameter negotiation, parameter configuration, and establishment of isochronous transmission channels in the flow control process (S602-S604).

Specifically, the ACL link can also be used to carry content control messages, such as call control (such as answering, hanging up, etc.) messages during the content control process (S605-S607), and playback control (such as previous, next, etc.) messages. , Volume control (such as increasing the volume, decreasing the volume) message, etc.

2. Flow control process (S602-S604)

S602. For a specific audio service, the first audio device and the second audio device may perform parameter negotiation through the ACL link.

Specifically, the parameter negotiation can be conducted with the audio service as the granularity. Different audio services require parameter negotiation, such as QoS parameter negotiation, codec parameter negotiation, and ISO parameter negotiation. An audio service can correspond to a set of parameters, and a set of parameters can include one or more of the following: QoS parameters, codec parameters, and ISO parameters.

Specifically, the specific process of the parameter negotiation may include:

Step a. The first audio device may send a parameter negotiation message to the second audio device through the ACL link, and the message may carry a set of parameters corresponding to the specific audio service. This set of parameters may be obtained by querying from a database according to the specific audio service, and the database may store parameters corresponding to various audio services.

Step b. The second audio device receives the parameter negotiation message sent by the first audio device through the ACL link. If the second audio device agrees with the parameters carried in the message, a confirmation message is returned to the first audio device; if the second audio device does not agree or partially agrees with the parameters carried in the parameter negotiation message, it returns to the first audio device to continue the negotiation Message to return to the first audio device to continue parameter negotiation.

Here, the specific audio service may be phone, game, voice assistant, music and so on.

S603. The first audio device may perform parameter configuration to the second audio device through the ACL link. The parameter configuration refers to a parameter determined by configuration negotiation of the second audio device.

In a specific implementation, the first audio device may send a parameter configuration message to the second audio device through the ACL link, and the parameter configuration message may carry parameters that have been negotiated and determined by both the first audio device and the second audio device. Correspondingly, after receiving the parameter configuration message through the ACL link, the second audio device can perform the reception or transmission of the streaming data according to the parameters that have been negotiated and determined by both parties.

S604. Based on the parameters determined through negotiation, establish an isochronous data transmission channel between the first audio device and the second audio device.

Specifically, the isochronous data transmission channel can be used to transmit streaming data (ie, audio data). The subsequent content will expand and explain the specific process of establishing an isochronous data transmission channel between the first audio device and the second audio device, which will not be repeated here.

In the above flow control process, the first audio device may be an audio source (audio source), and the second audio device may be an audio receiver (audio sink). That is, the audio source initiates parameter negotiation and isochronous data channel creation. In the above flow control process, the first audio device may also be an audio source (audio sink) and the second audio device may be an audio receiver (audio source). That is, the audio receiver initiates parameter negotiation and isochronous data channel creation.

3. Content control process (S605-S607)

S605-S607, the content control message can be exchanged between the first audio device and the second audio device based on the ACL link.

S605: The first audio device and the second audio device may exchange call control messages based on the ACL link, such as answering and hanging up control messages.

In one way, the first audio device can send a call control (such as answering, hanging up, etc.) message to the second audio device (such as a headset) through the ACL link, which can be implemented on the first audio device (such as a mobile phone) Call control. A typical application scenario corresponding to this method may be: when using a Bluetooth headset to make a call, the user clicks the hang up button on the mobile phone to hang up the phone. In another way, the second audio device (such as a headset) can send a call control (such as answering, hanging up, etc.) message to the first audio device (such as a mobile phone) through the ACL link, which can be implemented on the second audio device ( Such as headset) side call control. A typical application scenario corresponding to this method may be: when using a Bluetooth headset to make a call, the user presses the hangup button on the Bluetooth headset to hang up the phone. Not limited to pressing the hang up button, the user can also hang up the phone on the Bluetooth headset through other operations, such as tapping the headset.

S606. The first audio device and the second audio device can interactively play control messages based on the ACL link, such as the previous song and the next song.

In one way, the first audio device (such as a mobile phone) can send a playback control (such as previous song, next song, etc.) message to the second audio device (such as a headset) through the ACL link, which can be implemented in the first audio device (Such as mobile phone) side to play control. A typical application scenario corresponding to this method may be: when listening to music using a Bluetooth headset, the user clicks the previous/next button on the mobile phone to switch songs. In another way, the second audio device (such as a headset) can send a playback control (such as previous song, next song, etc.) message to the first audio device (such as a mobile phone) through the ACL link, which can be implemented in the second audio Playback control is performed on the device (such as headphones) side. A typical application scenario corresponding to this method may be: when listening to music using a Bluetooth headset, the user presses the previous/next button on the Bluetooth headset to switch songs.

S607: The first audio device and the second audio device may exchange volume control messages based on the ACL link, and increase or decrease volume control messages.

In one way, the first audio device (such as a mobile phone) can send a volume control (such as volume increase, volume decrease, etc.) message to the second audio device (such as a headset) through the ACL link, which can be implemented in the first audio The volume control is performed on the device (such as a mobile phone) side. The typical application scenario corresponding to this method may be: when using a Bluetooth headset to listen to music, the user clicks the volume adjustment button on the mobile phone to adjust the volume. In another way, the second audio device (such as a headset) can send a volume control (such as volume increase, volume decrease, etc.) message to the first audio device (such as a mobile phone) through the ACL link, which can be implemented in the second Volume control is performed on the side of the audio device (such as headphones). A typical application scenario corresponding to this method may be: when using a Bluetooth headset to listen to music, the user presses the volume adjustment button on the Bluetooth headset to adjust the volume to adjust the volume.

In the above content control process, the first audio device may be an audio source (audio source), and the second audio device may be an audio receiver (audio sink). That is, content control can be performed on the audio source side. In the above content control process, the first audio device may also be an audio source (audio sink) and the second audio device may be an audio receiver (audio source). That is, content control can be performed on the audio receiver side.

4. Streaming data transmission process (S608)

S608: The first audio device and the second audio device may exchange streaming data based on the created isochronous data transmission channel. The stream data is the stream data of the aforementioned specific audio service. The created isochronous data transmission channel corresponds to the aforementioned specific audio service.

In one way, the first audio device (such as a mobile phone) can send streaming data to the second audio device (such as a headset) through an isochronous data transmission channel. At this time, the role of the first audio device (such as a mobile phone) is an audio source (audio source), and the role of the second audio device (such as a headset) is an audio receiver (audio sink). In this way, the second audio device (such as a headset) can convert the received audio data into sound. A typical application scenario corresponding to this method may be: the user wears a Bluetooth headset to listen to music played on the mobile phone.

In another way, the second audio device (such as a headset) can send streaming data to the first audio device (such as a mobile phone) through an isochronous data transmission channel. At this time, the role of the second audio device (such as a headset) is an audio source (audio source), and the role of the first audio device (such as a mobile phone) is an audio receiver (audio sink). In this way, the first audio device (such as a mobile phone) can process the received audio data, such as converting the audio data into sound, sending the audio data to other electronic devices (in a voice call scenario), and storing the audio data (recording scenario) under). A typical application scenario corresponding to this method may be: a user wears a Bluetooth headset (equipped with a sound collection device such as a receiver/microphone) to make a call, and at this time, the Bluetooth headset collects the voice of the user's speech and converts it into audio data for transmission to the mobile phone.

This application does not limit the execution order of the content control process and the streaming data transmission process. The streaming data transmission process may be executed before the content control process, and the two processes may also be executed at the same time.

The first audio device and the second audio device in the method shown in FIG. 6 may implement the BLE-based audio protocol framework shown in FIG. 3. At this time, the flow control process (S602-S604) in FIG. 6 may be performed by the flow control function entity 306 in FIG. 3; the content control process (S605-S607) in FIG. 6 may be performed by the content control function in FIG. The entity 305 executes. The ACL link mentioned in the method in FIG. 6 may be LE ACL311 in FIG. 3, and the isochronous data transmission channel mentioned in the method in FIG. 6 may be LE312 in FIG. 3.

When the audio service scene is switched, taking the switching from the music service to the phone service (answering the phone while listening to music) as an example, the first audio device and the second audio device may renegotiate parameters to negotiate and determine the new audio service (such as Telephone service) corresponding to the new parameters, and then create a new isochronous data transmission channel based on the new parameters. The new isochronous data transmission channel can be used to transmit streaming data of the new audio service (such as telephone service). The isochronous data transmission channels of various services are based on LE. In this way, the switching of the business scenario does not involve the switching of the transmission frame, and the efficiency is higher, and there is no obvious pause.

The audio communication method provided in this application uses the audio service as the granularity for parameter negotiation and the establishment of an isochronous data transmission channel. The flow control messages and content control messages of each audio service are transmitted through the LEACL link, and the stream data is transmitted through the LEISO link Transmission, unifying the transmission framework of each business. Instead of using the profile as the granularity to adapt different transmission frameworks for different profile applications. It can be seen that the audio communication method provided in this application can be applied to more audio services and has better compatibility. Moreover, when the business scenario is switched, the isochronous data transmission channel can be configured based on the renegotiated parameters, without the need to switch between different profile protocol stacks, and without switching the transmission frame, which is more efficient and avoids obvious pauses.

The creation process of the isochronous data transmission channel mentioned in the method flow shown in FIG. 6 is described below.

FIG. 7 shows the creation process of the isochronous data transmission channel. The isochronous data transmission channel is based on a connected isochronous data channel, that is, the first audio device and the second audio device are already in a connection (Connection) state. Both the first audio device and the second audio device have a host Host and a link layer LL (in a controller), and the Host and LL communicate through HCI. As shown in Figure 7, the process may include:

S701-S702, Host A (Host of the first audio device) sets related parameters of the connected isochronous group (CIG) based on the HCI instruction.

Among them, the CIG-related parameters may include previously determined parameters (QoS parameters, codec parameters, ISO parameters), which are used to create isochronous data transmission channels.

Specifically, Host A can send the HCI command "LE Set CIG parameters" to LL (the first audio device's LL) through HCI. Correspondingly, LL A can return the response message "Command Complete".

S703-S704, Host A initiates the creation of CIS through the HCI instruction.

Specifically, Host A can send the HCI command "LE CreateCIS" to LL (LL of the first audio device) through HCI. Correspondingly, LL A can return the response message "HCI Command Status".

S705, the LLA may request the LLB (LL of the second audio device) to create a CIS stream through the air interface request message LL_CSI_REQ.

S706-S708, the LLB notifies HostB (Host of the second audio device) through the HCI instruction, and HostB agrees to the CIS chain building process of the first audio device.

S709, the LLB responds to the LLA through the air interface response message LL_CIS_RSP and agrees to the CIS chain building process.

S710, LLA notifies LLB through the air interface notification message LL_CIS_IND to complete the chain establishment.

S711, the LLB notifies HostB that the CIS chain establishment is complete.

S712, LLA notifies HostA through the HCI instruction that the CIS chain establishment is completed.

At this point, the CIS establishment between the first audio device and the second audio device is completed. Based on the established CIS, the first audio device and the second audio device can create an isochronous data transmission channel.

It can be seen that the isochronous data transmission channel is carried on the CIS. CIS is a connection-based flow that can be used to carry isochronous data.

In this application, the creation time of the isochronous data transmission channel (ie, when the process shown in FIG. 7 is executed) may include multiple options. In one option, an isochronous data transmission channel can be created when the audio service arrives. For example, when the user opens the game application (the game background sound starts to play simultaneously), the application layer of the mobile phone will send a game background sound service creation notification to the Host, and according to the notification, the mobile phone will initiate the process shown in FIG. In another option, a default isochronous data transmission channel may be established first, and the default isochronous data transmission channel may be created based on default CIG parameters. In this way, when the audio service arrives, the default isochronous data transmission channel can be used directly to carry streaming data, and the response speed is faster. In yet another option, multiple virtual isochronous data transmission channels may be established first. The multiple virtual isochronous data transmission channels may correspond to multiple sets of different CIG parameters, and may be applicable to multiple audio services. A virtual isochronous data transmission channel refers to an isochronous data transmission channel where no data interaction occurs on the air interface. In this way, when an audio service arrives, a virtual isochronous data transmission channel corresponding to the audio service may be selected, and a handshake is triggered between the first audio device and the second audio device and communication is started.

The method flow shown in FIG. 6 describes a connection-based point-to-point audio communication method formed by the first audio device and the second audio device. The first audio device may be the first audio device 101 in the wireless audio system 100 shown in FIG. 1, and the second audio device may be the second audio device 102 in the wireless audio system 100 shown in FIG. 1. The first audio device 101 and the third audio device 103 in the wireless audio system 100 may also use the audio communication method shown in FIG. 6 for communication.

In one case, the first audio device 101 can communicate with both the second audio device 102 and the third audio device 103. The first audio device 101 may be implemented as a mobile phone, and the second audio device 102 and the third audio device 103 may be implemented as left and right headphones, respectively. This situation corresponds to a typical application scenario: the left earphone and the right earphone are used together. This typical application scenario can be referred to as a “binaural use together” scenario.

FIG. 8 shows the audio communication method in the scenario of “using both ears together”. Expand below:

1. Establish a BLE connection (S801-S803)

S801, the left earphone and the right earphone establish a BLE connection.

S802, a BLE connection is established between the left earphone and the mobile phone.

S803, the BLE connection is established between the right earphone and the mobile phone.

This application does not limit the execution order of the above S801-S803, and the order between them may be changed. The BLE connection establishment process will be described in the following content, and will not be described here.

2. Establish ACL link (S804)

S804, the mobile phone establishes ACL links with the left earphone and the right earphone respectively.

Specifically, the establishment of the ACL link is the responsibility of the link layer LL. An ACL link can be established between the LL of the mobile phone and the LL of the left earphone, and an ACL link can be established between the LL of the mobile phone and the LL of the right earphone.

Specifically, the ACL link can be used to carry flow control messages, such as flow control messages involved in parameter negotiation, parameter configuration, and establishment of isochronous transmission channels in the flow control process (S805-S813). The ACL link can also be used to carry content control messages, such as call control (such as answering, hanging up, etc.) messages during the content control process (S814-S819), playback control (such as previous, next, etc.) messages, and volume control (Such as increasing the volume and decreasing the volume) messages, etc.

3. Flow control process (S805-S813)

S805-S806, when the audio service arrives, the mobile phone can determine the parameters corresponding to the audio service (QoS parameters, codec parameters, ISO parameters, etc.).

Specifically, the host of the mobile phone first receives an audio service establishment notification from the application layer, and then determines the parameters corresponding to the audio service. The audio service establishment notification may be generated when the mobile phone detects that the user opens an audio-related application (such as a game).

Specifically, the parameter corresponding to the audio service may be obtained by the mobile phone querying from a database according to the service type of the audio service, and the database may store parameters corresponding to various audio services.

S807, the host of the mobile phone sends the parameter corresponding to the audio service to the LL of the mobile phone through HCI.

S808, for the audio service, the LL of the mobile phone and the LL of the left earphone can perform parameter negotiation through the established ACL link. For the specific process of parameter negotiation, reference may be made to the related content in the method embodiment of FIG. 6, and details are not described here.

S809. After the parameter negotiation is completed, the mobile phone can perform parameter configuration to the left earphone through the established ACL link. The parameter configuration refers to the parameters negotiated by the left earphone configuration.

In a specific implementation, the LL of the mobile phone may send a parameter configuration message to the LL of the left earphone through the ACL link, and the parameter configuration message may carry parameters that have been negotiated and determined by both parties. Correspondingly, after receiving the parameter configuration message through the ACL link, the left earphone can perform the reception or transmission of the streaming data according to the parameters that have been negotiated by both parties.

S810. Based on the parameters determined through negotiation, an isochronous data transmission channel can be established between the mobile phone and the left earphone. For the creation process of the isochronous data transmission channel, reference may be made to the related content in the method embodiment of FIG. 6, and details are not described herein again.

S811. For the audio service, the LL of the mobile phone and the LL of the right earphone can perform parameter negotiation through the established ACL link. For the specific process of parameter negotiation, reference may be made to the related content in the method embodiment of FIG. 6, and details are not described here.

S812. After the parameter negotiation is completed, the mobile phone can perform parameter configuration to the right earphone through the established ACL link. The parameter configuration refers to the parameters negotiated by the left earphone configuration.

In a specific implementation, the LL of the mobile phone may send a parameter configuration message to the LL of the right earphone through the ACL link, and the parameter configuration message may carry parameters that have been negotiated and determined by both parties. Correspondingly, after receiving the parameter configuration message through the ACL link, the right earphone can perform the reception or transmission of the streaming data according to the parameters that have been negotiated by both parties.

S813. Based on the parameters determined through negotiation, an isochronous data transmission channel can be established between the mobile phone and the right headset. For the creation process of the isochronous data transmission channel, reference may be made to the related content in the method embodiment of FIG. 6, and details are not described herein again.

It can be seen that in order to maintain the integrity of the binaural parameters (QoS parameters, codec parameters, ISO parameters, etc.), the parameter determination can be determined in units of binaural, and then negotiated and configured one by one.

S808-S810 describe the process of parameter negotiation, configuration and creation of isochronous data transmission channel for the left earphone by the mobile phone, and S811-S813 describe the process of parameter negotiation, configuration and creation of isochronous data transmission channel for the right earphone by the mobile phone. This application does not limit the execution order of the two processes, and the two processes can be performed simultaneously.

Content control process (S814-S819)

S814-S816, the content control message can be exchanged between the mobile phone and the left earphone based on the ACL link. For specific implementation, reference may be made to related content in the method embodiment of FIG. 6, and details are not described herein again.

S817-S819, the content control message can be exchanged between the mobile phone and the right earphone based on the ACL link. For specific implementation, reference may be made to related content in the method embodiment of FIG. 6, and details are not described herein again.

When the mobile phone transmits content control messages to the left earphone and right earphone, the transmission of the content control messages from the mobile phone to the left earphone and right earphone needs to be synchronized to realize the synchronous control of the left earphone and the right earphone, so as to avoid the user from feeling confused. In order to achieve this, the left and right headsets can take effect after the content control message is received synchronously.

5. Streaming data transmission process (S820-S821)

S820, the mobile phone and the left earphone can exchange streaming data based on the created isochronous data transmission channel. The stream data is the stream data of the aforementioned audio service.

S821, the mobile phone and the right earphone can exchange streaming data based on the created isochronous data transmission channel. The stream data is the stream data of the aforementioned audio service.

It can be seen that the audio communication method shown in this FIG. 8 can be applied to the “both ears together” scenario, and the audio communication method between the mobile phone and the single ear (left earphone or right earphone) can refer to the method shown in FIG. 6, Applicable to more audio services and better compatibility. When the business scenario is switched, it is sufficient to configure the isochronous data transmission channel between the mobile phone and the headset based on the renegotiated parameters. There is no need to switch between different profile protocol stacks, and there is no need to switch the transmission frame, which is more efficient and avoids obvious Pause.

The following describes the BLE connection establishment process with reference to FIG. 9. As shown in Figure 9, the BLE connection establishment process may include:

1. Establish a BLE connection between the left and right headphones (S902-S907)

S902-S903, the Host of the left earphone initiates the establishment of the BLE connection through the HCI instruction. Specifically, the host of the left earphone can send the HCI command "LE create connection" to the LL of the left earphone through HCI. Correspondingly, the LL of the left earphone can return the response message "HCI Command Status".

S904, the right earphone sends a broadcast.

S905, the left earphone initiates the connection to the right earphone. Specifically, a connection request is sent to the LL of the left earphone to the LL of the right earphone.

S906, after receiving the connection request, the LL of the right earphone notifies the Host of the right earphone through the HCI instruction, and the establishment of the BLE connection is completed.

S907: After sending the connection request, the LL of the left earphone notifies the Host of the left earphone through the HCI instruction that the establishment of the BLE connection is completed.

In a nutshell, the process of establishing connection in BLE described in S902-S907 is: the right earphone sends a broadcast, and the left earphone initiates a connection to the right earphone. Alternatively, the left earphone can also send a broadcast, and the right earphone can initiate a connection to the left earphone.

2. Establish a BLE connection between the left headset and the phone (S909-S914)

S909-S910, the host of the mobile phone initiates the establishment of the BLE connection through the HCI instruction. Specifically, the host of the mobile phone can send the HCI command "LE create connection" to the LL of the mobile phone through the HCI. Correspondingly, the LL of the mobile phone can return the response message "HCI Command Status".

S911, the left earphone sends a broadcast.

S912, the mobile phone initiates a connection to the left earphone. Specifically, a connection request is sent to the LL of the mobile phone and the LL of the left earphone.

S913. After receiving the connection request, the LL of the left earphone notifies the Host of the left earphone through the HCI instruction that the establishment of the BLE connection is completed.

S914, after sending the connection request, the LL of the mobile phone notifies the Host of the mobile phone through the HCI instruction, and the establishment of the BLE connection is completed.

In summary, the process of BLE connection establishment described in S909-S914 is: the left earphone sends a broadcast, and the mobile phone initiates the connection to the left earphone. Alternatively, the mobile phone can also send a broadcast, and the left earphone initiates a connection to the mobile phone.

3. Establish a BLE connection between the right headset and the mobile phone (S916-S921)

S911, the right earphone sends a broadcast.

S912, the mobile phone initiates a connection to the right earphone. Specifically, a connection request is sent to the LL of the mobile phone and the LL of the right earphone.

S913, after receiving the connection request, the LL of the right earphone notifies the Host of the right earphone through the HCI instruction, and the establishment of the BLE connection is completed.

In summary, the process of BLE connection establishment described in S916-S921 is: the right earphone sends a broadcast, and the mobile phone initiates the connection to the right earphone. Alternatively, the mobile phone can also send a broadcast, and the right headset can initiate a connection to the mobile phone.

The following describes an exemplary electronic device 200 provided in an embodiment of the present application. The electronic device 200 may be implemented as the first audio device mentioned in the above embodiment, and may be the first audio device 101 in the wireless audio system 100 shown in FIG. 1. The electronic device 200 can generally be used as an audio source (audio source), such as a mobile phone, a tablet, etc., and can transmit audio data to other audio receiving devices (audio headphones, speakers, etc.), so that other audio receiving devices can use Audio data is converted into sound. In some scenarios, the electronic device 200 can also be used as an audio receiver, receiving audio data (such as audio converted by the user's voice collected by the headset) transmitted by other device audio sources (such as a headset with a microphone) data).

FIG. 10A shows a schematic structural diagram of the electronic device 200.

The electronic device 200 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2 , Mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, key 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), and an image signal processor (image)signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Among them, different processing units may be independent devices, or may be integrated in one or more processors. In some embodiments, the electronic device 200 may also include one or more processors 110.

The controller may be the nerve center and command center of the electronic device 200. The controller can generate the operation control signal according to the instruction operation code and the timing signal to complete the control of fetching instructions and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. The repeated access is avoided, the waiting time of the processor 110 is reduced, and thus the efficiency of the electronic device 200 is improved.

In some embodiments, the processor 110 may include one or more interfaces. Interfaces can include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit, sound, I2S) interface, pulse code modulation (pulse code modulation (PCM) interface, universal asynchronous transceiver (universal asynchronous) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and And/or universal serial bus (USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL). In some embodiments, the processor 110 may include multiple sets of I2C buses. The processor 110 may respectively couple the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 may couple the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the electronic device 200.

The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, to realize the function of answering the phone call through the Bluetooth headset.

The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface to realize the function of answering the phone call through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communication. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.

The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI) and so on. In some embodiments, the processor 110 and the camera 193 communicate through a CSI interface to implement the shooting function of the electronic device 200. The processor 110 and the display screen 194 communicate through the DSI interface to realize the display function of the electronic device 200.

The GPIO interface can be configured via software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface may be used to connect the processor 110 to the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.

The USB interface 130 is an interface that conforms to the USB standard, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and so on. The USB interface 130 can be used to connect a charger to charge the electronic device 200, and can also be used to transfer data between the electronic device 200 and peripheral devices. It can also be used to connect headphones and play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices.

It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present invention is only a schematic description, and does not constitute a limitation on the structure of the electronic device 200. In other embodiments, the electronic device 200 may also use different interface connection methods in the foregoing embodiments, or a combination of multiple interface connection methods.

The charging management module 140 is used to receive charging input from the charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive the charging input of the wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through the wireless charging coil of the electronic device 200. While the charging management module 140 charges the battery 142, it can also supply power to the electronic device through the power management module 141.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, wireless communication module 160, and the like. The power management module 141 can also be used to monitor battery capacity, battery cycle times, battery health status (leakage, impedance) and other parameters. In some other embodiments, the power management module 141 may also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may also be set in the same device.

The wireless communication function of the electronic device 200 can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.

Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 200 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device 200. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1 and filter, amplify, etc. the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor and convert it to electromagnetic wave radiation through the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a high-frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is processed by the baseband processor and then passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110, and may be set in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (bluetooth, BT), and global navigation satellites that are applied to the electronic device 200. System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency-modulates and filters electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive the signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and convert it to electromagnetic wave radiation through the antenna 2. Exemplarily, the wireless communication module 160 may include a Bluetooth module, a Wi-Fi module, and the like.

In some embodiments, the antenna 1 of the electronic device 200 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 200 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include a global mobile communication system (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long-term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidou navigation system (BDS), and a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite-based augmentation systems (SBAS).

The electronic device 200 can realize a display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations, and is used for graphics rendering. The processor 110 may include one or more GPUs that execute instructions to generate or change display information.

The display screen 194 is used to display images, videos and the like. The display screen 194 includes a display panel. The display panel may use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode) emitting diode, AMOLED, flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device 200 may include 1 or N display screens 194, where N is a positive integer greater than 1.

The electronic device 200 can realize a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP processes the data fed back by the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, and the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, which is converted into an image visible to the naked eye. ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be set in the camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other image signals. In some embodiments, the electronic device 200 may include 1 or N cameras 193, where N is a positive integer greater than 1.

The digital signal processor is used to process digital signals. In addition to digital image signals, it can also process other digital signals. For example, when the electronic device 200 is selected at a frequency point, the digital signal processor is used to perform Fourier transform on the energy at the frequency point.

Video codec is used to compress or decompress digital video. The electronic device 200 may support one or more video codecs. In this way, the electronic device 200 can play or record videos in various encoding formats, for example: moving picture experts group (MPEG)-1, MPEG-2, MPEG-3, MPEG-4, etc.

NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, for example, the transfer mode between neurons in the human brain, it can quickly process the input information and can continue to self-learn. The NPU can realize applications such as intelligent recognition of the electronic device 200, such as image recognition, face recognition, voice recognition, and text understanding.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 200. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, photos, videos and other data in an external memory card.

The internal memory 121 may be used to store one or more computer programs including instructions. The processor 110 may execute the above-mentioned instructions stored in the internal memory 121, so that the electronic device 200 executes the data sharing method, various functional applications, and data processing provided in some embodiments of the present application. The internal memory 121 may include a storage program area and a storage data area. Among them, the storage program area can store the operating system; the storage program area can also store one or more application programs (such as gallery, contacts, etc.) and so on. The storage data area may store data (such as photos, contacts, etc.) created during use of the electronic device 200. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and so on.

The electronic device 200 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, and an application processor. For example, music playback, recording, etc.

The audio module 170 is used to convert digital audio information into analog audio signal output, and also used to convert analog audio input into digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also called "speaker", is used to convert audio electrical signals into sound signals. The electronic device 200 can listen to music through the speaker 170A, or listen to a hands-free call.

The receiver 170B, also known as "handset", is used to convert audio electrical signals into sound signals. When the electronic device 200 answers a phone call or voice message, the voice can be received by bringing the receiver 170B close to the ear.

The microphone 170C, also called "microphone", "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 170C through a person's mouth, and input a sound signal to the microphone 170C. The electronic device 200 may be provided with at least one microphone 170C. In other embodiments, the electronic device 200 may be provided with two microphones 170C. In addition to collecting sound signals, it may also implement a noise reduction function. In other embodiments, the electronic device 200 may also be provided with three, four, or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.

The headset interface 170D is used to connect wired headsets. The earphone interface 170D may be a USB interface 130 or a 3.5mm open mobile electronic device (open terminal) platform (OMTP) standard interface, and the American Telecommunications Industry Association (cellular telecommunications industry association of the United States, CTIA) standard interface.

The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be provided on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. The capacitive pressure sensor may be at least two parallel plates with conductive materials. When force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 200 determines the intensity of the pressure according to the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 200 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 200 may also calculate the touched position based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch position but have different touch operation intensities may correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

The gyro sensor 180B may be used to determine the movement posture of the electronic device 200. In some embodiments, the angular velocity of the electronic device 200 around three axes (ie, x, y, and z axes) may be determined by the gyro sensor 180B. The gyro sensor 180B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyro sensor 180B detects the jitter angle of the electronic device 200, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the jitter of the electronic device 200 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 200 calculates the altitude using the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

The magnetic sensor 180D includes a Hall sensor. The electronic device 200 can detect the opening and closing of the flip holster using the magnetic sensor 180D. In some embodiments, when the electronic device 200 is a clamshell machine, the electronic device 200 may detect the opening and closing of the clamshell according to the magnetic sensor 180D. Furthermore, according to the detected opening and closing state of the holster or the opening and closing state of the flip cover, features such as automatic unlocking of the flip cover are set.

The acceleration sensor 180E can detect the magnitude of acceleration of the electronic device 200 in various directions (generally three axes). When the electronic device 200 is stationary, the magnitude and direction of gravity can be detected. It can also be used to recognize the posture of electronic devices, and be used in applications such as horizontal and vertical screen switching and pedometers.

The distance sensor 180F is used to measure the distance. The electronic device 200 can measure the distance by infrared or laser. In some embodiments, when shooting scenes, the electronic device 200 may use the distance sensor 180F to measure distance to achieve fast focusing.

The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 200 emits infrared light outward through the light emitting diode. The electronic device 200 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it may be determined that there is an object near the electronic device 200. When insufficient reflected light is detected, the electronic device 200 may determine that there is no object near the electronic device 200. The electronic device 200 can use the proximity light sensor 180G to detect that the user holds the electronic device 200 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode, pocket mode automatically unlocks and locks the screen.

The ambient light sensor 180L is used to sense the brightness of ambient light. The electronic device 200 can adaptively adjust the brightness of the display screen 194 according to the perceived brightness of the ambient light. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 200 is in a pocket to prevent accidental touch.

The fingerprint sensor 180H is used to collect fingerprints. The electronic device 200 can use the collected fingerprint characteristics to unlock the fingerprint, access the application lock, take a picture of the fingerprint, and answer the call with the fingerprint.

The temperature sensor 180J is used to detect the temperature. In some embodiments, the electronic device 200 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds the threshold, the electronic device 200 performs to reduce the performance of the processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 200 heats the battery 142 to avoid abnormal shutdown of the electronic device 200 due to low temperature. In some other embodiments, when the temperature is below another threshold, the electronic device 200 performs boosting on the output voltage of the battery 142 to avoid abnormal shutdown due to low temperature.

The touch sensor 180K can also be called a touch panel or a touch-sensitive surface. The touch sensor 180K may be provided on the display screen 194, and the touch sensor 180K and the display screen 194 constitute a touch screen, also called a "touch screen". The touch sensor 180K is used to detect a touch operation acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. The visual output related to the touch operation may be provided through the display screen 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 200, which is different from the location where the display screen 194 is located.

The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the pulse of the human body and receive a blood pressure beating signal. In some embodiments, the bone conduction sensor 180M may also be provided in the earphone and combined into a bone conduction earphone. The audio module 170 may parse out the voice signal based on the vibration signal of the vibrating bone block of the voice part acquired by the bone conduction sensor 180M to realize the voice function. The application processor may analyze the heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 180M to implement the heart rate detection function.

The key 190 includes a power-on key, a volume key, and the like. The key 190 may be a mechanical key. It can also be a touch button. The electronic device 200 may receive key input and generate key signal input related to user settings and function control of the electronic device 200.

The motor 191 may generate a vibration prompt. The motor 191 can be used for vibration notification of incoming calls and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) may correspond to different vibration feedback effects. For the touch operation in different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminder, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. Touch vibration feedback effect can also support customization.

The indicator 192 may be an indicator light, which may be used to indicate a charging state, a power change, and may also be used to indicate a message, a missed call, a notification, and the like.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device 200. The electronic device 200 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. The same SIM card interface 195 can insert multiple cards at the same time. The types of the multiple cards may be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 200 interacts with the network through the SIM card to realize functions such as call and data communication. In some embodiments, the electronic device 200 uses eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the electronic device 200 and cannot be separated from the electronic device 200.

The electronic device 200 exemplarily shown in FIG. 10A may display various user interfaces described in the following embodiments through the display screen 194. The electronic device 200 can detect a touch operation in each user interface through the touch sensor 180K, for example, a click operation in each user interface (such as a touch operation on an icon, a double-click operation), and for example, an upward or Swipe down, or perform a gesture of drawing a circle, and so on. In some embodiments, the electronic device 200 may detect a motion gesture performed by the user holding the electronic device 200, such as shaking the electronic device, through the gyro sensor 180B, the acceleration sensor 180E, or the like. In some embodiments, the electronic device 200 can detect non-touch gesture operations through the camera 193 (eg, 3D camera, depth camera).

In some implementations, the terminal application processor (AP) included in the electronic device 200 can implement the Host in the audio protocol framework shown in FIG. 3, and the Bluetooth (BT) module included in the electronic device 200 can implement the shown in FIG. 3. The controller in the audio protocol framework communicates between the two through HCI. That is, the functions of the audio protocol framework shown in FIG. 3 are distributed on two chips.

In other embodiments, the terminal application processor (AP) of the electronic device 200 may implement the host and controller in the audio protocol framework shown in FIG. 3. That is, all the functions of the audio protocol framework shown in Figure 3 are placed on one chip, that is, the host and controller are placed on the same chip, because the host and controller are on the same chip, so the physical HCI is There is no need to exist, and the host and controller directly interact through the application programming interface API.

The software system of the electronic device 200 may adopt a layered architecture, event-driven architecture, micro-core architecture, micro-service architecture, or cloud architecture. The embodiment of the present invention takes the Android system with a layered architecture as an example to exemplarily explain the software structure of the electronic device 200.

10B is a block diagram of the software structure of the electronic device 200 according to an embodiment of the present invention.

The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom are the application layer, the application framework layer, the Android runtime and the system library, and the kernel layer.

The application layer may include a series of application packages.

As shown in FIG. 10B, the application package may include applications such as games, voice assistants, music players, video players, mailboxes, calls, navigation, and file browsers.

The application framework layer provides an application programming interface (application programming interface) and programming framework for applications at the application layer. The application framework layer includes some predefined functions.

As shown in FIG. 10B, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and so on.

The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, intercept the screen, etc.

Content providers are used to store and retrieve data, and make these data accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls for displaying text and controls for displaying pictures. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface that includes an SMS notification icon may include a view that displays text and a view that displays pictures.

The phone manager is used to provide the communication function of the electronic device 200. For example, the management of the call state (including connection, hang up, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.

The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of downloading, message reminders, etc. The notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, the text message is displayed in the status bar, a prompt sound is emitted, the electronic device vibrates, and the indicator light flashes.

Android Runtime includes core library and virtual machine. Android runtime is responsible for the scheduling and management of the Android system.

The core library contains two parts: one part is the function function that Java language needs to call, and the other part is the core library of Android.

The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and the application framework layer into binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

The system library may include multiple functional modules. For example: surface manager (surface manager), media library (Media library), 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.

The surface manager is used to manage the display subsystem and provides a combination of 2D and 3D layers for multiple applications.

The media library supports a variety of commonly used audio, video format playback and recording, and still image files. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to realize 3D graphics drawing, image rendering, synthesis, and layer processing.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

The following describes the workflow of the software and hardware of the electronic device 200 in combination with capturing a photographing scene.

When the touch sensor 180K receives the touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes touch operations into original input events (including touch coordinates, time stamps and other information of touch operations). The original input event is stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch operation, the control corresponding to the touch operation is a camera application icon as an example. The camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer. Capture still images or videos.

The following describes an exemplary audio output device 300 provided in an embodiment of the present application. The audio output device 300 may be implemented as the second audio device or the third audio device mentioned in the above embodiment, and may be the second audio device 102 or the third audio device 103 in the wireless audio system 100 shown in FIG. 1. The audio output device 300 can generally be used as an audio receiving device (audio sink), such as headphones and speakers, can transmit audio data to other audio sources (audio phones, tablets, etc.), and can receive the received audio Convert data to sound. In some scenarios, if a sound collection device such as a microphone/receiver is configured, the audio output device 300 can also be used as an audio source to transmit audio data (such as an audio sink) (such as a mobile phone) to other devices Audio data converted by the voice collected by the headset into the user).

FIG. 11 exemplarily shows a schematic structural diagram of an audio output device 300 provided by the present application.

As shown in FIG. 11, the audio output device 300 may include a processor 302, a memory 303, a Bluetooth communication processing module 304, a power supply 305, a wear detector 306, a microphone 307, and an electric/acoustic converter 308. These components can be connected via a bus. among them:

The processor 302 may be used to read and execute computer-readable instructions. In a specific implementation, the processor 302 may mainly include a controller, an arithmetic unit, and a register. Among them, the controller is mainly responsible for instruction decoding and issues control signals for the operations corresponding to the instructions. The arithmetic unit is mainly responsible for performing fixed-point or floating-point arithmetic operations, shift operations, and logical operations, and can also perform address operations and conversions. The register is mainly responsible for saving the register operand and intermediate operation result temporarily stored during the execution of the instruction. In a specific implementation, the hardware architecture of the processor 302 may be an application specific integrated circuit (Application Specific Integrated Circuits, ASIC) architecture, a MIPS architecture, an ARM architecture, an NP architecture, or the like.

In some embodiments, the processor 302 may be used to parse signals received by the Bluetooth communication processing module 304, such as signals encapsulated with audio data, content control messages, flow control messages, and so on. The processor 302 may be used to perform corresponding processing operations according to the analysis result, such as driving the electrical/acoustic converter 308 to start or pause or stop converting audio data into sound, and so on.

In some embodiments, the processor 302 may also be used to generate signals sent out by the Bluetooth communication processing module 304, such as Bluetooth broadcast signals, beacon signals, and audio data converted from the collected sound.

The memory 303 is coupled to the processor 302 and is used to store various software programs and/or multiple sets of instructions. In a specific implementation, the memory 303 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 303 can store an operating system, such as embedded operating systems such as uCOS, VxWorks, RTLinux, and so on. The memory 303 may also store a communication program that can be used to communicate with the electronic device 200, one or more servers, or additional devices.

The Bluetooth (BT) communication processing module 304 may receive signals transmitted by other devices (such as the electronic device 200), such as scan signals, broadcast signals, signals encapsulated with audio data, content control messages, flow control messages, and so on. The Bluetooth (BT) communication processing module 304 may also transmit signals, such as broadcast signals, scan signals, signals encapsulated with audio data, content control messages, flow control messages, and so on.

The power supply 305 may be used to supply power to the processor 302, the memory 303, the Bluetooth communication processing module 304, the wear detector 306, the electrical/acoustic converter 308, and other internal components.

The wearing detector 306 may be used to detect a state where the audio output device 300 is worn by the user, such as an unworn state, a worn state, and may even include a worn tight state. In some embodiments, the wear detector 306 may be implemented by one or more of a distance sensor, a pressure sensor, and the like. The wearing detector 306 can transmit the detected wearing state to the processor 302, so that the processor 302 can be powered on when the audio output device 300 is worn by the user, and powered off when the audio output device 300 is not worn by the user, to save Power consumption.

The microphone 307 can be used to collect sounds, such as the voice of the user speaking, and can output the collected sounds to the electric/acoustic converter 308, so that the electric/acoustic converter 308 can convert the sound collected by the microphone 307 into audio data.

The electric/acoustic converter 308 can be used to convert sound into electrical signals (audio data), for example, convert the sound collected by the microphone 307 into audio data, and can transmit audio data to the processor 302. In this way, the processor 302 can trigger the Bluetooth (BT) communication processing module 304 to transmit the audio data. The electrical/acoustic converter 308 may also be used to convert electrical signals (audio data) into sound, for example, audio data output by the processor 302 into sound. The audio data output by the processor 302 may be received by the Bluetooth (BT) communication processing module 304.

In some implementations, the processor 302 can implement the Host in the audio protocol framework shown in FIG. 3, and the Bluetooth (BT) communication processing module 304 can implement the controller in the audio protocol framework shown in FIG. 3. Communicate. That is, the functions of the audio protocol framework shown in FIG. 3 are distributed on two chips.

In other embodiments, the processor 302 may implement the host and controller in the audio protocol framework shown in FIG. 3. That is, all the functions of the audio protocol framework shown in Figure 3 are placed on one chip, that is, the host and controller are placed on the same chip, because the host and controller are on the same chip, so the physical HCI is There is no need to exist, and the host and controller directly interact through the application programming interface API.

It can be understood that the structure illustrated in FIG. 11 does not constitute a specific limitation on the audio output device 300. In other embodiments of the present application, the audio output device 300 may include more or fewer components than shown, or combine some components, or split some components, or arrange different components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

Referring to FIG. 12, FIG. 12 shows a schematic structural diagram of a chip set provided by the present application. As shown in FIG. 12, the chipset 400 may include chip 1 and chip 2. Chip 1 and chip 2 communicate through interface HCI409. The chip 1 may include the following modules: a multimedia audio module 402, a voice module 403, a background sound module 404, a content control module 405, a stream control module 406, a stream data module 407, and an L2CAP module 408. The chip 2 may include: an LE physical layer module 413 and an LE link layer module 410.

In chip 2:

(1) The LE physical layer module 413 can be used to provide a physical channel (commonly referred to as a channel) for data transmission. Generally, there are several different types of channels in a communication system, such as control channels, data channels, voice channels, and so on.

(2) The LE link layer module 410 can be used to provide a logical transmission channel (also referred to as a logical link) between two or more devices that is physically independent, based on the physical layer. The LE link layer module 410 can be used to control the radio frequency state of the device. The device will be in one of five states: waiting, advertising, scanning, initializing, and connecting. The broadcast device can send data without establishing a connection, and the scanning device receives the data sent by the broadcast device; the device that initiates the connection responds to the broadcast device by sending a connection request. If the broadcast device accepts the connection request, the broadcast device and the device that initiates the connection will Will enter the connection state. The device that initiates the connection is called the master device, and the device that accepts the connection request is called the slave device.

The LE link layer module 410 may include a LE ACL module 411 and a LE isochronous (ISO) module 412. The LE ACL module 411 can be used to transmit control messages between devices through the LE ACL link, such as flow control messages, content control messages, and volume control messages. The LE ISO module 412 can be used to transmit isochronous data (such as streaming data itself) between devices through an isochronous data transmission channel.

In chip 1:

(1) The L2CAP module 408 can be used to manage the logical links provided by the logical layer. Based on L2CAP, different

Upper layer applications can share the same logical link. Similar to the concept of port in TCP/IP.

(2) The multimedia audio module 402, the voice module 403, and the background sound module 404 may be modules set according to business scenarios, and may be used to divide the audio applications of the application layer into multimedia audio, voice, background sound, and other audio services. It is not limited to multimedia audio, voice, background sound, etc. Audio services can also be divided into: voice, music, games, video, voice assistant, e-mail reminder, alarm, reminder sound, navigation sound, etc.

(3) The content control module 405 can be responsible for encapsulating the content of various audio services

Control (such as previous song, next song, etc.) messages, and output content control messages of the audio service to the LEACL module 411, so as to transmit the encapsulated content control messages through the LEACL module 411.

(4) The stream control module 406 can be used to negotiate parameters for specific audio services, such as QoS parameter negotiation, codec parameter negotiation, ISO parameter negotiation, and negotiation based on the negotiated parameters for the specific service Create an isochronous data transmission channel. Creating an isochronous data transmission channel for the specific service can be used to transmit audio data of the specific audio service. In this application, the specific audio service may be referred to as a first audio service, and the negotiated parameter may be referred to as a first parameter.

(5) The streaming data module 407 may be used to output the audio data of the audio service to the LE isochronous (ISO) module 412 to transmit the audio data through the isochronous data transmission channel. The isochronous data transmission channel may be CIS. CIS can be used to transfer isochronous data between connected devices. The isochronous data transmission channel is finally carried in LEISO 412.

In a specific implementation, chip 1 may be implemented as an application processor (AP), and chip 2 may be implemented as a Bluetooth processor (or referred to as a Bluetooth module, Bluetooth chip, etc.). In this application, chip 1 may be referred to as a first chip, and chip 2 may be referred to as a second chip. The chipset 400 may be included in the first audio device in the foregoing method embodiment, or may be included in the first audio device and the second audio device in the foregoing method embodiment.

It can be understood that the structure illustrated in FIG. 12 does not constitute a specific limitation on the chipset 400. In other embodiments of the present application, the chipset 400 may include more or less components than shown, or combine some components, or split some components, or arrange different components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

Referring to FIG. 13, FIG. 13 shows a schematic structural diagram of a chip provided by the present application. As shown in FIG. 13, the chip 500 may include: a multimedia audio module 502, a voice module 503, a background sound module 504, a content control module 505, a stream control module 506, a stream data module 507, an L2CAP module 508, a LE physical layer module 513, LE link layer module 510. For the description of each module, please refer to the corresponding module in FIG. 12, which will not be repeated here.

Different from the chip architecture shown in FIG. 12, the chip architecture shown in FIG. 13 is that the host and controller in the audio protocol framework shown in FIG. 3 are implemented on one chip at the same time. Since Host and Controller are implemented on the same chip, HCI may not be needed inside the chip. The chip architecture shown in FIG. 12 is to implement Host and Controller in the audio protocol framework shown in FIG. 3 in two chips, respectively.

The chip 500 may be included in the first audio device in the foregoing method embodiment, or may be included in the first audio device and the second audio device in the foregoing method embodiment.

It can be understood that the structure shown in FIG. 13 does not constitute a specific limitation on the chip 500. In other embodiments of the present application, the chip 500 may include more or less components than shown, or combine some components, or split some components, or arrange different components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

A person of ordinary skill in the art can understand that all or part of the process in the method of the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when the program is executed , May include the processes of the foregoing method embodiments. The foregoing storage media include various media that can store program codes such as ROM or random storage memory RAM, magnetic disks or optical disks.

Claims

An audio communication method, characterized in that it includes:

The audio source and the audio receiver establish a low-power Bluetooth connectionless asynchronous LE ACL link; a low-power Bluetooth connection is established between the audio source and the audio receiver;

The audio source performs parameter negotiation for the first audio service through the LE ACL link and the audio receiver, and the first parameter negotiated in the parameter negotiation corresponds to the first audio service;

The audio source creates an LE isochronous data transmission channel corresponding to the first audio service based on the first parameter and the audio receiver; an LE isochronous data transmission channel corresponding to the first audio service is used for the The audio source sends the audio data of the first audio service to the audio receiver.
The method of claim 1, comprising:

The audio source generates a content control message of the first audio service;

The audio source sends a content control message of the first audio service to the audio receiver through the LE ACL link; the content control message is used by the audio receiver to perform content on the first audio service Control, the content control includes one or more of the following: volume control, playback control, call control.
The method according to any one of claims 1-2, comprising:

The audio source receives the content control message of the first audio service sent by the audio receiver through the LE ACL link;

The audio source performs content control on the first audio service according to the content control message, and the content control includes one or more of the following: volume control, playback control, and call control.
The method according to any one of claims 1-3, comprising:

The audio source generates audio data of the first audio service;

The audio source sends the audio data of the first audio service to the audio receiver through the LE isochronous data transmission channel corresponding to the first audio service.
The method according to any one of claims 1 to 4, wherein the content control message includes one or more of the following: volume control message, playback control message, and call control message.
The method according to any one of claims 1-5, wherein the first parameter includes one or more of the following: quality of service QoS parameters, coding codec parameters, and isochronous data transmission channel parameters.
An audio communication method, characterized in that it includes:

The audio receiver and the audio source establish a Bluetooth low energy connectionless asynchronous LE ACL link; a low power Bluetooth connection is established between the audio source and the audio receiver;

The audio receiver performs parameter negotiation for the first audio service through the LE ACL link and the audio source, and the first parameter negotiated in the parameter negotiation corresponds to the first audio service;

The audio receiver creates an LE isochronous data transmission channel corresponding to the first audio service based on the first parameter and the audio source; an LE isochronous data transmission channel corresponding to the first audio service is used for the The audio receiver receives the audio data of the first audio service sent by the audio source.
The method of claim 7, comprising:

The audio receiver receives the content control message of the first audio service sent by the audio source through the LE ACL link;

The audio receiver performs content control on the first audio service according to the content control message, and the content control includes one or more of the following: volume control, playback control, and call control.
The method according to claim 7 or 8, comprising:

The audio receiver generates a content control message of the first audio service;

The audio receiver sends the content control message of the first audio service to the audio source through the LE ACL link; the content control message is used by the audio source to control the content of the first audio service The content control includes one or more of the following: volume control, playback control, and call control.
The method according to any one of claims 7-9, comprising:

The audio receiver receives the audio data of the first audio service sent by the audio source through the LE isochronous data transmission channel corresponding to the first audio service.
The method according to any one of claims 7-10, wherein the content control message includes one or more of the following: volume control message, playback control message, and call control message.
The method according to any one of claims 7-11, wherein the first parameter includes one or more of the following: quality of service QoS parameters, coding codec parameters, and isochronous data transmission channel parameters.
An audio device, comprising: a transmitter and a receiver, a memory and a processor coupled to the memory, the memory is used to store instructions executable by the processor, and the processor is used to call The instructions in the memory execute the method of any one of claims 1-6.
An audio device, comprising: a transmitter and a receiver, a memory and a processor coupled to the memory, the memory is used to store instructions executable by the processor, and the processor is used to call The instructions in the memory execute the method of any one of claims 7-12.
A chipset, comprising: a first chip and a second chip; the first chip includes a stream control module, a content control module, and a stream data module; the second chip includes a LE ACL module and LE isochronous Module; where:

The flow control module is configured to perform parameter negotiation for the first audio service and create an LE isochronous data transmission channel corresponding to the first audio service based on the first parameter negotiated by the parameter negotiation;

The content control module is used to output the content control message of the first audio service to the LE ACL module;

The streaming data module is used to output the audio data of the first audio service to the LE isochronous module;

The LE ACL module is used to transmit the content control message of the first audio service through the LE ACL link;

The LE isochronous module is configured to transmit audio data of the first audio service through an LE isochronous data transmission channel corresponding to the first audio service.
A chip is characterized by comprising: a stream control module, a content control module, a stream data module, a LE ACL module and a LE isochronous module; wherein:

The flow control module is used to perform parameter negotiation for the first audio service, and create an LE isochronous data transmission channel corresponding to the first audio service based on the first parameter negotiated by the parameter negotiation;

The content control module is used to output the content control message of the first audio service to the LE ACL module;

The streaming data module is used to output the audio data of the first audio service to the LE isochronous module;

The LE ACL module is used to transmit the content control message of the first audio service through the LE ACL link;

The LE isochronous module is configured to transmit audio data of the first audio service through an LE isochronous data transmission channel corresponding to the first audio service.
A communication system is characterized by comprising: a first audio device and a second audio device, wherein:

The first audio device is the audio device of claim 13, and the second audio device is the audio device of claim 14.
A communication system is characterized by comprising: a first audio device, a second audio device and a third audio device, wherein:

The first audio device is the audio device of claim 13, and the second audio device and the third audio device are the audio device of claim 14.