WO2022213689A1

WO2022213689A1 - Method and device for voice communicaiton between audio devices

Info

Publication number: WO2022213689A1
Application number: PCT/CN2022/070153
Authority: WO
Inventors: 付雷; 林士博; 唐能福
Original assignee: 北京荣耀终端有限公司
Priority date: 2021-04-09
Filing date: 2022-01-04
Publication date: 2022-10-13
Also published as: CN113301544B; CN113301544A

Abstract

The embodiments of the present application relate to the field of electronic devices. Disclosed are a method and device for voice communication between audio devices, which method and device solve the problem of normal voice communication between users who use audio devices being affected when audio sharing is performed among a plurality of audio devices. The specific solution involves: when an electronic device is respectively connected to a first audio device and a second audio device for audio sharing, the first audio device establishing a first link with the second audio device, and the first audio device synchronizing voice data with the second audio device by means of the first link.

Description

A method and device for voice intercommunication between audio devices

This application claims the priority of the Chinese patent application with the application number 202110385309.7 and the application title "A method and device for voice intercommunication between audio devices", which was submitted to the State Intellectual Property Office on April 9, 2021, the entire contents of which are by reference Incorporated in this application.

technical field

The embodiments of the present application relate to the field of electronic devices, and in particular, to a method and device for voice intercommunication between audio devices.

Background technique

In order to facilitate users to share audio played on their own smart phones, many smart phone products currently provide a function that supports Bluetooth audio sharing, that is, an audio sharing function. For example, the smart phone can make a Bluetooth connection with the headset device 1 and the headset device 2, respectively. Through the audio sharing function, the audio played on the smartphone can be played simultaneously on the headset device 1 and the headset device 2 connected to it.

However, when multiple users share the audio played on the smart phone through the audio sharing function provided by the smart phone, each user is affected by their own earphones, and the sound of each other's speech and communication will be weakened, which will affect the normal communication between the users. For example, when user 1 wears headset device 1 and user 2 wears headset device 2 to share the audio played on the smartphone, due to the influence of their respective headset devices, when user 1 and user 2 communicate with each other, both parties may not be able to hear each other clearly. words that cause inconvenience. In particular, when the earphone device 1 and the earphone device 2 support and enable the noise reduction function, the user 1 and the user 2 cannot hear the words of the other party clearly, which affects the normal communication between the two parties.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a method and device for voice intercommunication between audio devices, which solves the problem of affecting normal voice communication between users using audio devices when multiple audio devices perform audio sharing.

In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:

In a first aspect, an embodiment of the present application provides a method for voice interworking between audio devices, and the method can be applied to a voice interworking system. The voice interworking system may include an electronic device, a first audio device and a second audio device, and the method includes: connecting the electronic device and the first audio device through a first asynchronous connectionless (ACL) link; sending audio data to the first audio device; the first audio device receives the audio data, and plays audio through the speaker of the first audio device according to the audio data; the electronic device receives the operation of the user to enable the audio sharing function; in response to the operation of enabling the audio sharing function , the electronic device detects an audio device close to the electronic device; the electronic device detects a second audio device; the electronic device establishes a second ACL link with the second audio device; the electronic device sends audio data to the second audio device through the second ACL link The second audio equipment receives the audio data, and plays audio through the speaker of the second audio equipment according to the audio data; The electronic equipment sends the audio sharing status information and the equipment information of the second audio equipment to the first audio equipment through the first ACL link; Audio The sharing state information is used to indicate that the electronic device is in a state of audio sharing between the first audio device and the second audio device; the first audio device outputs prompt information for prompting the user whether to enable the voice interworking function; the first audio device receives the user's confirmation to enable Operation of the voice interworking function; in response to determining the operation of enabling the voice interworking function, the first audio device sends a first instruction to the electronic device, and the first instruction is used to instruct the electronic device to suspend sending audio data to the first audio device and the second audio device. ; The electronic device suspends sending audio data to the first audio device and the second audio device according to the first instruction; the first audio device establishes a first link with the second audio device according to the device information; The microphone receives the user's voice, generates first voice data, and sends the first voice data to the second audio device; the second audio device plays the voice through the speaker of the second audio device according to the first voice data; The microphone of the second audio device receives the user's voice, generates second voice data, and sends the second voice data to the first audio device; the first audio device plays the voice through the speaker of the first audio device according to the second voice data.

Wherein, after the electronic device is connected to the first audio device and the second audio device respectively through the ACL link, the audio data received by the second audio device is the same as the audio data received by the first audio device, that is, the electronic device simultaneously sends the audio data to the first audio device. The device and the second audio device transmit audio data.

Based on the method of the first aspect, the user can use the voice intercommunication between multiple audio devices to conduct voice communication, thereby improving the convenience of the user's voice communication. For example, when multiple users share the audio played on the mobile phone through the audio sharing function, the multiple users can use the voice intercommunication between their respective earphones for voice communication, so as to prevent the users from being unable to hear the voice of the communication clearly.

With reference to the first aspect, in a possible design manner, the first audio device receives the user's operation to determine to enable the voice interworking function, including: the first audio device receives the user's operation on the function keys on the first audio device; An audio device receives a user's operation on a touch area on the first audio device; or the first audio device receives a user's tap operation on the first audio device.

Based on this possible design manner, the user can conveniently determine that the voice interworking function needs to be enabled by operating the first audio device, thereby improving the user operation experience.

With reference to the first aspect, in another possible design manner, the first link is a Synchronous Connection Oriented (SCO) link.

Based on this possible design method, since the earlier version of the Bluetooth protocol also supports the SCO link, setting the first link as the SCO link can improve the applicability of the method to audio devices.

With reference to the first aspect, in another possible design manner, the first link is an isochronous connection stream (CIS) link.

Based on this possible design method, since the CIS link can support the connection between multiple (such as two or more) devices, setting the first link as the CIS link enables the method to support multiple audio devices voice communication between.

With reference to the first aspect, in another possible design manner, the electronic device is a mobile phone, and both the first audio device and the second audio device are true wireless stereo (TWS) earphones.

With reference to the first aspect, in another possible design manner, the electronic device uses the Bluetooth Stereo Audio Distribution Protocol (A2DP) to send audio data.

With reference to the first aspect, in another possible design manner, the electronic device receives an operation of enabling the audio sharing function from the user, including: the electronic device receives a user's click operation on the audio sharing option displayed by the electronic device.

Based on this possible design method, the user can enable the audio sharing function through the audio sharing option displayed on the electronic device, thereby improving the user's operational convenience.

With reference to the first aspect, in another possible design manner, after the electronic device detects the second audio device, the method further includes: the electronic device displays a pop-up prompt, where the pop-up prompt is used to prompt the user that the second audio device can be connected for audio sharing.

Based on this possible design method, the user can confirm to enable audio sharing by performing a confirmation operation on the pop-up prompt displayed by the electronic device, thereby improving the convenience of the user's operation.

With reference to the first aspect, in another possible design manner, the first audio device outputs prompt information for prompting the user whether to enable the voice interworking function, including: the first audio device prompts the user whether Enable the voice of the voice interworking function.

In a second aspect, an embodiment of the present application provides a voice interworking system, where the voice interworking system may include an electronic device, a first audio device, and a second audio device. Wherein, the electronic device can be used to connect with the first audio device through a first asynchronous connectionless (ACL) link; send audio data to the first audio device through the first ACL link; receive the operation of the user enabling the audio sharing function; Detecting an audio device close to the electronic device; detecting that the second audio device establishes a second ACL link with the second audio device; sending audio data to the second audio device through the second ACL link; sending audio data to the first audio device through the first ACL link The audio device sends audio sharing state information and device information of the second audio device; the audio sharing state information is used to indicate that the electronic device is in a state of audio sharing between the first audio device and the second audio device; Instruct, suspend sending audio data to the first audio device and the second audio device according to the first instruction;

The first audio device can be used for receiving audio data, and playing audio through the speaker of the first audio device according to the audio data; outputting prompt information for prompting the user whether to enable the voice interworking function; receiving an operation that the user determines to enable the voice interworking function; The electronic device sends the first instruction; establishes a first link with the second audio device according to the device information; receives the user's voice through the microphone of the first audio device, generates first voice data, and sends the first voice data to the second audio device; Or, receive the second voice data from the second audio device, and play the voice through the speaker of the first audio device according to the second voice data;

The second audio device can be used to receive audio data, and play audio through the speaker of the second audio device according to the audio data; receive the first voice data from the first audio device, and play the audio through the speaker of the second audio device according to the first voice data voice; or, receiving the user's voice through the microphone of the second audio device, generating second voice data, and sending the second voice data to the first audio device.

With reference to the second aspect, in a possible design manner, the first audio device is specifically configured to receive user operations on function keys on the first audio device; The operation of the touch area; or the first audio device receives the user's tapping operation on the first audio device.

With reference to the second aspect, in another possible design manner, the first link is a synchronous connection oriented (SCO) link.

With reference to the second aspect, in another possible design manner, the first link is an isochronous connection stream (CIS) link.

With reference to the second aspect, in another possible design manner, the electronic device is a mobile phone, and both the first audio device and the second audio device are True Wireless Stereo (TWS) earphones.

With reference to the second aspect, in another possible design manner, the electronic device uses the Bluetooth Stereo Audio Distribution Protocol (A2DP) to send audio data.

With reference to the second aspect, in another possible design manner, the electronic device is specifically configured to receive a user's click operation on an audio sharing option displayed by the electronic device.

With reference to the second aspect, in another possible design manner, the electronic device is further used to display a pop-up prompt, and the pop-up prompt is used to prompt the user that the second audio device can be connected for audio sharing.

With reference to the second aspect, in another possible design manner, the first audio device is specifically configured to play a voice prompting the user whether to enable the voice interworking function through the speaker of the first audio device.

It should be understood that, for the beneficial effects of the foregoing second aspect, reference may be made to the relevant descriptions in the foregoing first aspect, and details are not described herein again.

In a third aspect, an embodiment of the present application provides a method for voice interworking between audio devices, and the method can be applied to a voice interworking system. The voice interworking system may include an electronic device, a first audio device and a second audio device, and the method includes: connecting the electronic device and the first audio device through a first asynchronous connectionless (ACL) link; sending audio data to the first audio device; the first audio device receives the audio data, and plays audio through the speaker of the first audio device according to the audio data; the electronic device receives the operation of the user to enable the audio sharing function; in response to the operation of enabling the audio sharing function , the electronic device detects an audio device close to the electronic device; the electronic device detects a second audio device; the electronic device establishes a second ACL link with the second audio device; the electronic device sends audio data to the second audio device through the second ACL link The second audio device receives the audio data, and plays audio through the speaker of the second audio device according to the audio data; the first audio device outputs a prompt message for prompting the user whether to open the voice interworking function; the first audio device receives the user and determines to open the voice interworking the operation of the function; in response to determining the operation of enabling the voice interworking function, the first audio device sends a first instruction to the electronic device, and the first instruction is used to instruct the electronic device to suspend sending audio data to the first audio device and the second audio device; electronic The device suspends sending audio data to the first audio device and the second audio device according to the first instruction; the first audio device establishes a first link with the second audio device according to the device information; the first audio device receives through the microphone of the first audio device The user's voice generates first voice data, and sends the first voice data to the second audio device; the second audio device plays the voice through the speaker of the second audio device according to the first voice data; or, the second audio device passes the second audio The microphone of the device receives the user's voice, generates second voice data, and sends the second voice data to the first audio device; the first audio device plays the voice through the speaker of the first audio device according to the second voice data.

Based on the method of the third aspect, the user can use the voice intercommunication between multiple audio devices to conduct voice communication, thereby improving the convenience of the user's voice communication. For example, when multiple users share the audio played on the mobile phone through the audio sharing function, the multiple users can use the voice intercommunication between their respective earphones for voice communication, so as to prevent the users from being unable to hear the voice of the communication clearly.

With reference to the third aspect, in a possible design manner, the first audio device receives the user's operation to determine to enable the voice interworking function, including: the first audio device receives the user's operation on the function keys on the first audio device; An audio device receives a user's operation on a touch area on the first audio device; or the first audio device receives a user's tap operation on the first audio device.

With reference to the third aspect, in another possible design manner, the first link is a synchronous connection oriented (SCO) link.

With reference to the third aspect, in another possible design manner, the first link is an isochronous connection stream (CIS) link.

With reference to the third aspect, in another possible design manner, the electronic device is a mobile phone, and both the first audio device and the second audio device are true wireless stereo (TWS) earphones.

With reference to the third aspect, in another possible design manner, the electronic device uses the Bluetooth Stereo Audio Distribution Protocol (A2DP) to send audio data.

With reference to the third aspect, in another possible design manner, the electronic device receives an operation of enabling the audio sharing function from the user, including: the electronic device receives a user's click operation on the audio sharing option displayed by the electronic device.

With reference to the third aspect, in another possible design manner, after the electronic device detects the second audio device, the method further includes: the electronic device displays a pop-up prompt, where the pop-up prompt is used to prompt the user that the second audio device can be connected for audio sharing.

With reference to the third aspect, in another possible design manner, the first audio device outputs prompt information for prompting the user whether to enable the voice interworking function, including: the first audio device prompts the user whether Enable the voice of the voice interworking function.

In a fourth aspect, an embodiment of the present application provides a method for voice interworking between audio devices, and the method can be applied to a voice interworking system. The voice interworking system may include an electronic device, a first audio device, and a second audio device, and the method includes: in response to a user's operation of turning on the first mode, the electronic device establishes an ACL link with the first audio device and the second audio device respectively. The electronic equipment sends audio data to the first audio equipment and the second audio equipment respectively; the first audio equipment and the second audio equipment respectively receive the audio data and play audio; An audio device sends device information of the second audio device; the first audio device establishes a first link with the second audio device according to the device information; the first audio device sends voice data to the second audio device through the first link; the second audio device The audio device plays the voice according to the voice data; or, the second audio device sends the voice data to the first audio device through the first link; the first audio device plays the voice according to the voice data.

Based on the method of the fourth aspect, the user can use the voice intercommunication between multiple audio devices to conduct voice communication, thereby improving the convenience of the user's voice communication. For example, when multiple users share the audio played on the mobile phone through the audio sharing function, the multiple users can use the voice intercommunication between their respective earphones for voice communication, so as to prevent the users from being unable to hear the voice of the communication clearly.

With reference to the fourth aspect, in another possible design manner, the first link is a synchronous connection oriented (SCO) link.

With reference to the fourth aspect, in another possible design manner, the first link is an isochronous connection stream (CIS) link.

With reference to the fourth aspect, in another possible design manner, the electronic device is a mobile phone, and both the first audio device and the second audio device are true wireless stereo (TWS) earphones.

With reference to the fourth aspect, in another possible design manner, the electronic device uses the Bluetooth Stereo Audio Distribution Protocol (A2DP) to send audio data.

With reference to the fourth aspect, in another possible design manner, the operation for the user to enable the first mode includes: the user's click operation on the audio sharing option displayed by the electronic device.

With reference to the fourth aspect, in another possible design manner, the operation for the user to enable the second mode includes: the user's click operation on the voice interworking option displayed by the electronic device.

In a fifth aspect, an embodiment of the present application provides an electronic device, including: a processor, and a memory for storing instructions executable by the processor. When the processor is configured to execute the above-mentioned instructions, the electronic device implements the function of the electronic device in the method for voice intercommunication between audio devices according to any one of the first aspect, the third aspect or the fourth aspect.

In a sixth aspect, an embodiment of the present application provides an audio device, including: a processor, and a memory for storing instructions executable by the processor. When the processor is configured to execute the above instruction, the audio device can implement the function of the first audio device in the method for voice interworking between audio devices according to any one of the first aspect, the third aspect or the fourth aspect.

In a seventh aspect, an embodiment of the present application provides an audio device, including: a processor, and a memory for storing instructions executable by the processor. When the processor is configured to execute the above-mentioned instructions, the audio device implements the function of the second audio device in the method for voice interworking between audio devices according to any one of the first aspect, the third aspect or the fourth aspect.

Description of drawings

1 is a schematic diagram of an audio sharing link provided by an embodiment of the present application;

2 is a schematic diagram of an interface for enabling audio sharing according to an embodiment of the present application;

3 is a schematic diagram of another interface for enabling audio sharing according to an embodiment of the present application;

FIG. 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

5 is a schematic flowchart of a method for voice intercommunication between audio devices provided by an embodiment of the present application;

6 is a schematic interface diagram when a method for voice intercommunication between audio devices provided by an embodiment of the present application is applied;

7 is a schematic interface diagram when another method for voice intercommunication between audio devices provided by an embodiment of the present application is applied;

FIG. 8 is a schematic diagram of a scenario when a method for voice intercommunication between audio devices provided by an embodiment of the present application is applied;

9 is a schematic flowchart of another method for voice intercommunication between audio devices provided by an embodiment of the present application;

10 is a schematic diagram of a scenario when another method for voice intercommunication between audio devices provided by an embodiment of the present application is applied;

11 is a schematic flowchart of another method for voice intercommunication between audio devices provided by an embodiment of the present application;

12 is a schematic diagram of a scenario when another method for voice intercommunication between audio devices provided by an embodiment of the present application is applied;

13 is a schematic flowchart of another method for voice intercommunication between audio devices provided by an embodiment of the present application;

14 is a schematic diagram of a scenario when another method for voice intercommunication between audio devices provided by an embodiment of the present application is applied;

15 is a schematic diagram of a scenario when another method for voice intercommunication between audio devices provided by an embodiment of the present application is applied;

16 is a schematic interface diagram when another method for voice intercommunication between audio devices provided by an embodiment of the present application is applied;

FIG. 17 is a schematic interface diagram when another method for voice intercommunication between audio devices provided by an embodiment of the present application is applied.

Detailed ways

When people use electronic devices, such as mobile phones, tablets or laptops, they often use these electronic devices to watch videos or listen to music. In order to enhance the listening experience when watching videos or listening to music, people wear headphones so that they can listen to the sound played by the electronic device through the headphones. Alternatively, in order to avoid affecting others in public places (eg, restaurants, cafes, lounges, public transportation, etc.), people also wear earphones to listen to the sound played by electronic devices through earphones. However, when people listen to the sound playing on the device through headphones, it is difficult to share the sound playing from the device with friends. Therefore, many electronic devices now provide a function that supports Bluetooth audio sharing, that is, an audio sharing function. Taking a mobile phone as an example, when people watch videos or listen to music on their mobile phones, they can connect their own and their friends' headsets to their own mobile phones through Bluetooth, and use the audio sharing function to enable themselves and their friends to hear through their own headsets. The sound played by the phone.

Wherein, an electronic device (such as a mobile phone) can be respectively connected with a plurality of earphones through Bluetooth (for example, the electronic device establishes a second link with the earphones respectively) to perform audio sharing. For example, taking the electronic device as a mobile phone as an example, as shown in FIG. 1 , an asynchronous connectionless (ACL) link is established between the mobile phone 101 and a plurality of earphones 102 respectively (ACL is the main unit and all the devices coexisting in the piconet). One-point-multiple-access connection between the slave units), the mobile phone 101 can transmit audio data to each earphone 102 through the ACL link, thereby realizing audio sharing. Of course, the electronic device may also share audio with multiple earphones in other ways, which is not limited here.

As an example, the user may set and enable the connection between the electronic device and multiple earphones and audio sharing in the system settings of the electronic device. For example, take the electronic device as a mobile phone and the connected earphones as earphone 1 and earphone 2 as an example, as shown in Figure 2, when the user needs to share audio through the mobile phone, he can open the system settings of the mobile phone to operate. As shown in (a) of Figure 2, the Bluetooth setting interface of the mobile phone may include setting options for enabling Bluetooth and audio sharing, as well as devices that have been paired with the mobile phone (eg, earphone 1, earphone 2, smart speakers, and smart projectors). equipment list, etc.). When turning on the Bluetooth function, the user may select (eg, click to select an operation) the audio sharing option in the Bluetooth setting interface. In response to this action, the phone can display the audio sharing settings interface. As shown in (b) of FIG. 2 , the audio sharing setting interface may include setting options for enabling audio sharing, including and a device list of devices that have been paired with the mobile phone. The user can choose to enable the audio sharing function on the audio sharing setting interface, and select the headset 1 and headset 2 that have been paired with the mobile phone. In response to these operations, the mobile phone can connect to headset 1 and headset 2 respectively (eg, establish an ACL link), thereby enabling the audio sharing function, so that the audio on the mobile phone can be played through headset 1 and headset 2 at the same time.

As another example, the user may enable and set audio sharing on the multimedia notification interface of the electronic device. For example, take the electronic device as a mobile phone and the connected earphones as earphone 1 and earphone 2 as an example, as shown in Figure 3, when the user needs to share audio through the mobile phone, the multimedia notification interface in the pull-down notification of the mobile phone can be used as an example. operate in. As shown in (a) of Figure 3, when the user is listening to the audio played by the mobile phone using the headset 1 connected to the mobile phone (for example, the headset 1 is connected to the mobile phone through the first ACL link, and the mobile phone sends the headset to the headset through the first ACL link) 1 to send audio data, and the headset 1 to play audio through the speaker according to the received audio data), the user can click the icon showing more options in the multimedia notification interface in the pull-down notification to select more multimedia options. After that, as shown in (b) of FIG. 3 , the user can select an audio sharing option to enable audio sharing. When the user selects audio sharing, in response to these actions, the phone can detect audio devices (eg, headphones) in proximity to it. As shown in (c) of FIG. 3 , when the earphone 2 (such as the earphone 301 shown in the figure) is close to the mobile phone, the mobile phone detects that the earphone 2 is approaching, and can pop up a pop-up box prompting the user to connect the earphone 2 for audio sharing Prompt 302, the user can click the audio sharing in the pop-up box prompt 302 to make the mobile phone connect with the headset 2 in response to the above operation (for example, the mobile phone and the headset 2 establish a second ACL link), thereby enabling the audio sharing function, so that the The audio on the mobile phone can be played through the headset 1 and the headset 2 at the same time (that is, the mobile phone also sends audio data to the headset 2 through the second ACL link, and the headset 2 plays audio through the speaker according to the received audio data). Optionally, the mobile phone can transmit audio data to the headset 1 and the headset 2 respectively by using a Bluetooth stereo audio distribution profile (advanced audio distribution profile, A2DP).

For example, an electronic device (eg, a mobile phone) may also perform audio sharing in a manner similar to a true wireless stereo (true wireless stereo, TWS) headset synchronizing audio between two earbuds. For example, when audio playback is performed after the first earphone establishes a link with the mobile phone, the second earphone can obtain the audio data transmitted between the mobile phone and the first earphone by monitoring the link established between the first earphone and the mobile phone, thereby realizing the first Headphone and second headphone audio sharing.

It can be seen from this that the audio sharing function enables the user to share the audio played on his electronic device with his friends in a better and more convenient manner. However, when multiple users use the audio sharing function to share the audio played on the electronic device through the headset, since each user wears the headset, the user's perception of external sound will be weakened due to the impact of the headset. Therefore, when multiple users who are using the audio sharing function speak and communicate with each other, it may be difficult for the users to hear each other's voices. In addition, in order to improve the immersion of listening, many headphones now support the noise reduction function. When the noise reduction function is turned on, it is more difficult for each user to hear the sounds of mutual communication.

In order to solve the above problem, an embodiment of the present application provides a method for voice intercommunication between audio devices. The method can be applied to a voice interworking system, that is, a system composed of an electronic device and at least two audio devices (eg, a first audio device and at least one second audio device). The method may include: when the electronic device performs audio sharing with a plurality of audio devices respectively. The electronic device can establish a link (eg, a first link) for voice intercommunication with each audio device, so as to forward or synchronize the voice data transmitted between the audio devices through the electronic device, so as to realize the voice intercommunication between the audio devices. Alternatively, one of the multiple audio devices can be used as the master device (ie, the master audio device), and establish a link (eg, the first link) for voice interworking with other audio devices, so as to pass the audio device as the master device. Forward or synchronize the voice data transmitted between audio devices to realize voice intercommunication between audio devices.

It should be noted that the above established link for voice interworking may be a synchronous connection oriented (SCO) link (SCO uses reserved bandwidth for synchronous communication (circuit switching), and mainly supports transmission time-limited information), extended synchronous connection-oriented (ESCO) (similar to SCO, and has a retransmission mechanism), an isochronous connected isochronous stream (CIS) link (CIS is a logical transmission , enabling connected devices to transmit isochronous data in any direction), etc., or a dedicated link established based on 2.4G wireless technology. Of course, those skilled in the art can also define a link for user voice interworking according to the actual situation, which is not limited here.

In this way, the user can use the voice intercommunication between multiple audio devices to conduct voice communication, thereby improving the convenience of the user's voice communication. For example, when multiple users share the audio played on the mobile phone through the audio sharing function, the multiple users can use the voice intercommunication between their respective earphones for voice communication, so as to prevent the users from being unable to hear the voice of the communication clearly.

Hereinafter, the method for voice intercommunication between audio devices provided by the embodiments of the present application will be described with reference to the accompanying drawings.

In the embodiments of the present application, the above-mentioned audio device is a device with functions of sound pickup and playback (eg, a device with a microphone and a speaker), such as an earphone, a Bluetooth speaker, a smart speaker, and the like. The above-mentioned electronic device can be a mobile phone, a tablet computer, a handheld computer, a PC, a cellular phone, a personal digital assistant (personal digital assistant, PDA), a wearable device (such as a smart watch, a smart bracelet), a smart home device (such as : TV), car machine (such as: car computer), smart screen, game console, smart TV box, and augmented reality (AR)/virtual reality (VR) equipment, etc. The embodiments of the present application do not specifically limit the specific device form of the electronic device.

Optionally, in some embodiments, the device shapes of the above-mentioned multiple audio devices may be the same. For example, several audio devices are headphones.

Or, in other embodiments, the device forms of the above-mentioned multiple audio devices may also be different. For example, multiple audio devices include headphones and smart speakers.

For example, taking the electronic device as a mobile phone as an example, FIG. 4 shows a schematic structural diagram of an electronic device provided by an embodiment of the present application. That is, by way of example, the electronic device shown in FIG. 4 may be a mobile phone.

As shown in FIG. 4 , the electronic device may include a processor 410, an external memory interface 420, an internal memory 421, a universal serial bus (USB) interface 430, a charge management module 440, a power management module 441, a battery 442, Antenna 1, Antenna 2, Mobile Communication Module 450, Wireless Communication Module 460, Audio Module 470, Speaker 470A, Receiver 470B, Microphone 470C, Headphone Interface 470D, Sensor Module 480, Key 490, Motor 491, Indicator 492, Camera 493, A display screen 494, and a subscriber identification module (SIM) card interface 495, etc. Wherein, the sensor module 480 may include a pressure sensor 480A, a gyroscope sensor 480B, an air pressure sensor 480C, a magnetic sensor 480D, an acceleration sensor 480E, a distance sensor 480F, a proximity light sensor 480G, a fingerprint sensor 480H, a temperature sensor 480J, a touch sensor 480K, and an environmental sensor. Light sensor 480L, bone conduction sensor 480M, etc.

It can be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device. In other embodiments, the electronic device may include more or fewer components than shown, or some components may be combined, or some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 410 may include one or more processing units, for example, the processor 410 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

A controller can be the nerve center and command center of an electronic device. The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.

A memory may also be provided in the processor 410 for storing instructions and data. In some embodiments, the memory in processor 410 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 410 . If the processor 410 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided, and the waiting time of the processor 410 is reduced, thereby improving the efficiency of the system.

In some embodiments, processor 410 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / or universal serial bus (universal serial bus, USB) interface, etc.

The wireless communication function of the electronic device can be implemented by the antenna 1, the antenna 2, the mobile communication module 450, the wireless communication module 460, the modulation and demodulation processor, the baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 450 can provide a wireless communication solution including 2G/3G/4G/5G etc. applied on the electronic device. The mobile communication module 450 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and the like. The mobile communication module 450 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 450 can also amplify the signal modulated by the modulation and demodulation processor, and then convert it into electromagnetic waves for radiation through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 450 may be provided in the processor 410 . In some embodiments, at least part of the functional modules of the mobile communication module 450 may be provided in the same device as at least part of the modules of the processor 410 .

The wireless communication module 460 can provide wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellite systems applied on electronic devices. (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 460 may be one or more devices integrating at least one communication processing module. The wireless communication module 460 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 410 . The wireless communication module 460 can also receive the signal to be sent from the processor 410 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .

In some embodiments, the antenna 1 of the electronic device is coupled with the mobile communication module 450, and the antenna 2 is coupled with the wireless communication module 460, so that the electronic device can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc. The GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite based augmentation systems (SBAS).

The electronic device realizes the display function through the GPU, the display screen 494, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 494 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 410 may include one or more GPUs that execute program instructions to generate or alter display information.

Display screen 494 is used to display images, video, and the like. Display screen 494 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light). emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on. In some embodiments, the electronic device may include 1 or N display screens 494, where N is a positive integer greater than 1.

The electronic device can realize the shooting function through the ISP, the camera 493, the video codec, the GPU, the display screen 494, and the application processor. In some embodiments, the electronic device may include 1 or N cameras 493 , where N is a positive integer greater than 1.

The NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transfer mode between neurons in the human brain, it can quickly process the input information, and can continuously learn by itself. Through the NPU, applications such as intelligent cognition of electronic devices can be realized, such as image recognition, face recognition, speech recognition, text understanding, etc.

Internal memory 421 may be used to store computer executable program code, which includes instructions. The processor 410 executes various functional applications and data processing of the electronic device by executing the instructions stored in the internal memory 421 . The internal memory 421 may include a storage program area and a storage data area. The storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like. The storage data area can store data (such as audio data, phone book, etc.) created during the use of the electronic device. In addition, the internal memory 421 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.

The electronic device can implement audio functions through an audio module 470, a speaker 470A, a receiver 470B, a microphone 470C, an earphone interface 470D, and an application processor. Such as music playback, recording, etc.

Of course, it can be understood that the above-mentioned FIG. 4 is only an exemplary illustration when the form of the electronic device is a mobile phone. If the electronic devices are tablet computers, handheld computers, PCs, PDAs, wearable devices (such as smart watches, smart bracelets), smart home devices (such as smart TVs), car devices (such as car computers), smart screens , game consoles, AR/VR devices and other device forms, the structure of the electronic device may include fewer structures than those shown in FIG. 4 , or may include more structures than those shown in FIG. 4 , which is not limited here. .

The methods in the following embodiments can all be implemented in an electronic device having the above-mentioned hardware structure. The embodiments of the present application will be illustrated below with reference to the accompanying drawings.

Taking the electronic device as a mobile phone, the audio devices to be communicated with each other are two earphones, that is, the first audio device is the first earphone (or referred to as earphone 1), and the second audio device is the second earphone (or referred to as earphone 2), The established link (eg, the first link) for voice interworking is an SCO link as an example.

FIG. 5 is a schematic flowchart of a method for voice intercommunication between audio devices according to an embodiment of the present application. As shown in FIG. 5 , the method for voice intercommunication between audio devices may include the following S501-S503.

S501. The mobile phone determines that the user needs to enable the voice interworking function in the case of audio sharing through the first earphone and the second earphone.

The mobile phone performs audio sharing through the first earphone and the second earphone, which may be enabled by the user in the manner shown in FIG. 2 or FIG. 3 . It can also be opened by the user through other methods, which is not limited here.

In some possible implementations, the mobile phone may receive the user's operation and determine whether the user needs to enable the voice interworking function according to the user's operation.

As an example, taking the user enabling audio sharing as shown in FIG. 2 as an example, as shown in FIG. 6 , the audio sharing setting interface may further include an option for enabling voice interworking. After the user enables the audio sharing, the user can activate the voice interworking function by clicking the option of the voice interworking. When the mobile phone receives the operation of the user clicking the option of voice interworking, the mobile phone can determine that the user needs to enable the voice interworking function, and in response to the operation, the mobile phone can enable the voice interworking function. It should be noted that, in this example, when the user does not click to select the option for enabling audio sharing as shown in (b) in FIG. 2 to enable audio sharing, the option for voice interworking as shown in FIG. 6 is in Turn off the locked state. That is, the user cannot enable the voice interworking function without enabling audio sharing on the mobile phone. Of course, in other embodiments of the present application, the user may also enable the voice interworking function in the manner shown in FIG. 6 when the mobile phone does not enable audio sharing, which is not limited here.

As another example, after the user enables audio sharing (eg, by enabling audio sharing as shown in FIG. 2 or FIG. 3 ), the mobile phone may ask the user whether to enable the voice interworking function through a pop-up window. Then, according to the corresponding operation of the user, it is determined whether the user needs to enable the voice interworking function. For example, as shown in FIG. 7 , after the user enables audio sharing, the mobile phone may pop up a pop-up window asking whether to enable the voice interworking function. In this pop-up window, you can provide two option controls of "Yes" and "No". The user can enable or disable the voice interworking function by clicking the "Yes" or "No" option. When the mobile phone receives the operation of the user clicking the "Yes" or "No" option, the mobile phone can determine whether the user needs to enable the voice interworking function. For example, when the mobile phone receives the user's operation of the "Yes" option, in response, the mobile phone can enable the voice interworking function. For another example, when the mobile phone receives the user's operation of the "No" option, in response, the mobile phone may not enable the voice interworking function.

When the mobile phone determines that the user needs to enable the voice interworking function, for example, when the mobile phone receives an operation of the user to enable the voice interworking function. Then, the mobile phone can execute the following S502. It should be noted that, in some other embodiments, the mobile phone does not need to determine whether the user needs to enable the voice interworking function, but enables it by default. For example, when the mobile phone audio is shared, the following S502 is performed.

S502, the mobile phone establishes a SCO link with the first earphone and the second earphone respectively.

In some possible implementations, the mobile phone can send a request for establishing a SCO link to the first headset and the second headset respectively, and after the first headset and the second headset receive the above request, they can establish a SCO link with the mobile phone respectively. road. Optionally, after the first earphone and the second earphone respectively establish the SCO link with the mobile phone, a response that the SCO link is established successfully may also be respectively sent to the mobile phone.

It should be noted that when the mobile phone uses Bluetooth connection to share audio through the first headset and the second headset, the pairing between the mobile phone and the first headset and the second headset is usually completed, so the mobile phone is connected to the first headset and the second headset respectively. The pairing of the mobile phone and the headset can no longer be performed before the two headsets establish the SCO link. Of course, if the audio sharing of the mobile phone through the first earphone and the second earphone is not realized through a Bluetooth connection, but through other connection methods, before the mobile phone establishes the SCO link with the first earphone and the second earphone respectively, the mobile phone It can be paired with the first earphone and the second earphone respectively first.

Wherein, both the first earphone and the second earphone can support a hands-free profile (hands-free profile, HFP). After the mobile phone establishes a link for voice intercommunication with the first earphone and the second earphone respectively, the mobile phone can forward the voice data between the first earphone and the second earphone through the link. For example, the mobile phone can execute the following S503.

S503, the mobile phone forwards the voice data between the first earphone and the second earphone.

In some possible implementations, the mobile phone may forward the voice data between the first earphone and the second earphone after decoding, routing, and encoding. It is also possible to directly transparently transmit the voice data between the first earphone and the second earphone, that is, the mobile phone only forwards the voice data without processing it.

For example, take the mobile phone forwarding the voice data of the first earphone to the second earphone as an example. Refer to FIG. 8 for the mobile phone to forward the voice data between the first earphone and the second earphone. As shown in FIG. 8 , a SCO link is established between the mobile phone 810 and the first headset 821 and the second headset 822 respectively. When the first user 831 wearing the first earphone 821 speaks (eg, the first user 831 says "hello" to the second user 832), the microphone of the first earphone 821 can receive the voice of the first user 831 and convert it Then the first headset 821 can send the voice data to the mobile phone 810 through the SCO link, the mobile phone 810 can forward the voice data to the second headset 822 after receiving the voice data, and finally the second headset 822 that receives the voice data The voice data can be converted into sound through the speaker and played to the second user 832 . Therefore, the second user 832 can hear what the first user 831 speaks to him through the second earphone 822, thereby improving the effect of voice communication between the first user 831 and the second user 832.

Wherein, if the earphones (such as the first earphone and the second earphone above) are TWS earphones, the voice can be collected by the microphone of the left earphone or the right earphone, or the microphone of the left earphone and the microphone of the right earphone can simultaneously collect the speech.

Continue to take the electronic device as the mobile phone, and the audio devices to be communicated with each other are two earphones, that is, the first audio device is the first earphone (or referred to as earphone 1), and the second audio device is the second earphone (or referred to as earphone 2) , the established link (eg, the first link) for voice interworking is an SCO link as an example. In this embodiment of the present application, a link may also be established between the first earphone and the second earphone, so that voice data may be directly transmitted between the first earphone and the second earphone through the established link.

For example, FIG. 9 is a schematic flowchart of another method for voice interworking between audio devices provided by an embodiment of the present application. As shown in FIG. 9 , the method for voice intercommunication between audio devices may include the following S901-S905.

S901, the mobile phone performs audio sharing through the first earphone and the second earphone.

When the mobile phone performs audio sharing through the first headset and the second headset, the mobile phone can send the device information of the other headset to one of the two headsets. For example, the mobile phone can execute the following S902.

S902, the mobile phone sends the audio sharing status information and other earphones, such as the device information (eg, media access control (MAC) address) of the second earphone, to the main earphone, such as the first earphone. That is, the mobile phone sends configuration information to the main earphone, where the configuration information includes audio sharing state information and device information of other earphones.

It should be noted that, among the multiple earphones that need to perform voice intercommunication, the main earphone can be defined according to actual needs, which is not limited here. For example, when connecting to a mobile phone for audio sharing, the headset that is first connected to the mobile phone can be used as the primary headset. In this embodiment, the first earphone is used as the main earphone for illustration.

As an example, the mobile phone may send the audio sharing state information and the device information of other earphones to the main earphone through the link established by the audio sharing. Of course, the mobile phone can also send audio sharing information and device information of other earphones to the main earphone through other forms such as broadcasting, which is not limited here.

The audio sharing state information may be indication information that can indicate that the mobile phone is in an audio sharing state. The mobile phone sends the audio sharing state information to the first earphone serving as the main earphone, so that the first earphone can determine that the mobile phone is currently in the audio sharing state according to the audio sharing state information. The device information of other earphones sent by the mobile phone to the first earphone can facilitate the subsequent establishment of a connection between the first earphone and other earphones according to the device information.

When the main earphone, such as the first earphone, receives the audio sharing status information and the device information of other earphones, the main earphone can perform the following S903.

S903. The first headset determines that the user needs to enable the voice interworking function.

In some possible implementations, the first earphone may prompt the user whether to enable the voice interworking function by outputting prompt information, and then receive the user's operation, and determine whether the user needs to enable the voice interworking function according to the user's operation.

For example, the first earphone may play the prompt information in the form of voice "whether to enable the voice interworking function" to the user. At this time, the user may determine that the voice interworking function needs to be enabled by pressing a physical button (such as a function key) on the first earphone, touching the touch area on the first earphone, and tapping the first earphone. When the first earphone receives the above operations such as pressing the physical key, touching the touch area, tapping the earphone, etc., it can be determined that the user needs to enable the voice interworking function.

When the first earphone (ie, the main earphone) determines that the user needs to enable the voice interworking function, for example, when the first earphone receives a corresponding operation performed by the user for the above prompt information, the first earphone can perform the following S904.

S904, the first headset establishes a SCO link with the second headset.

In some possible implementations, the first headset may be paired with the second headset first, and after the pairing is completed, the SCO link is established with the second headset. For example, the first earphone may first send a pairing request to the second earphone according to the device information sent by the mobile phone, and after receiving the pairing request, the second earphone may prompt the user to perform pairing (eg, prompt by voice, vibration, etc.). The user can confirm pairing with the first earphone by pressing the physical button on the second earphone, touching the touch area on the second earphone, and tapping the second earphone. As a response to the above operation of the user, the second earphone may complete the pairing with the first earphone according to the pairing request. After the first headset is successfully paired with the second headset, the first headset can send a request for establishing a SCO link to the second headset, and when the second headset receives the above request, it can establish a SCO link with the first headset. Optionally, after the first headset and the second headset establish the SCO link, the second headset may further send a response that the SCO link is established successfully to the first headset. It should be noted that, when the second earphone is not confirmed to be paired with the first earphone, or does not support pairing with the first earphone, the first earphone can be unpaired and the voice interworking function can be turned off.

Optionally, before the first headset establishes the SCO link with the second headset, the first headset may also send instruction information (eg, a first instruction) to the electronic device to instruct the electronic device to suspend the communication between the first headset and the second headset. Sending audio data instructs the electronic device to pause audio playback. Therefore, when the first earphone and the second earphone communicate with each other, they will not be interfered by the audio data sent by the electronic device during audio sharing, and the quality of the voice intercommunication between the first earphone and the second earphone is improved.

Wherein, both the first earphone and the second earphone can support a hands-free profile (hands-free profile, HFP). After the first headset and the second headset establish a link for voice intercommunication, the first headset and the second headset can transmit voice data through the link. For example, the following S905 can be executed.

S905, the voice data is transmitted between the first earphone and the second earphone through the SCO link.

For example, take the transmission of the voice data (ie, the first voice data) of the first earphone to the second earphone as an example. For the transmission of voice data between the first earphone and the second earphone through the SCO link, reference may be made to FIG. 10 . As shown in FIG. 10 , a SCO link is established between the first earphone 1011 and the second earphone 1012 . When the first user 1021 wearing the first earphone 1011 speaks (eg, the first user 1021 says "hello" to the second user 1022), the microphone of the first earphone 1011 can receive the voice of the first user 1021 and convert it Then the first headset 1011 can send the voice data to the second headset 1012 through the SCO link, and the second headset 1012 that finally receives the voice data can convert the voice data into sound through the speaker and play it to the second headset 1012. User 1022. Thus, the second user 1022 can hear what the first user 1021 speaks to him through the second earphone 1012, thereby improving the effect of voice communication between the first user 1021 and the second user 1022. When the voice data of the second earphone (ie, the second voice data) is transmitted to the first earphone, the process is similar to the above-mentioned process, which is not repeated here.

In this embodiment, S901 in the method shown in FIG. 9 may also be replaced with S501 in the method shown in FIG. 5 , and correspondingly, S903 does not need to be executed. In this way, it is relatively convenient and quick for the user to determine whether to enable the voice interworking function through the mobile phone.

Illustratively, take the electronic device as a mobile phone, and the audio devices to be communicated with each other are the first earphone (or referred to as earphone 1) and the second earphone (or referred to as earphone 2), and the established link for voice intercommunication (eg, the first link) is an example of a dedicated link established based on 2.4G wireless technology or the like. In this embodiment of the present application, a dedicated link may also be established between the first headset and the second headset, so that voice data may be directly transmitted between the first headset and the second headset through the established dedicated link. An implementation of this embodiment may be similar to the method shown in FIG. 9 , and the similarities will not be repeated here, and reference may be made to the specific description of the method shown in FIG. 9 . The difference is that the link established between the first earphone and the second earphone is the above-mentioned dedicated link. Correspondingly, voice data is transmitted between the first earphone and the second earphone through the dedicated link. As another implementation manner, the mobile phone may not send the device information of the second earphone to the first earphone, and the first earphone may negotiate the configuration information required by the above-mentioned dedicated link in the form of broadcasting, and then establish a dedicated link for voice communication . There is no restriction on how to establish a link between the first earphone and the second earphone.

Taking the electronic device as a mobile phone, the audio devices to be communicated with each other are three earphones, that is, the first audio device is the first earphone (or referred to as earphone 1), the second audio device is the second earphone (or referred to as earphone 2) and The third earphone (or referred to as earphone 3 ), the established link (eg, the first link) for voice interworking is the CIS as an example.

FIG. 11 is a schematic flowchart of another method for voice interworking between audio devices according to an embodiment of the present application. As shown in FIG. 11 , the method for voice intercommunication between audio devices may include the following S1101-S1103.

S1101. The mobile phone determines that the user needs to enable the voice interworking function in the case of audio sharing through the first earphone, the second earphone and the third earphone.

It should be noted that the specific implementation of this step is similar to S501 in the method shown in FIG. 5 , and reference may be made to the relevant description of S501 , which is not repeated here.

S1102, the mobile phone and the first earphone, the second earphone and the third earphone establish an isochronous connection group (connected isochronous group, CIG) through the CIS (CIG is created by a host (Master) and includes one or more CISs).

In some possible implementation manners, the mobile phone may send a request for establishing a CIS to the first earphone, the second earphone and the third earphone respectively. After the first earphone, the second earphone and the third earphone respectively receive the above request, A CIS is established with the mobile phone respectively, so that the mobile phone and the first earphone, the second earphone and the third earphone form a CIG. Optionally, after the first earphone, the second earphone and the third earphone respectively establish the CIS with the mobile phone, a response that the CIS is established successfully may also be respectively sent to the mobile phone.

S1103, the mobile phone schedules the first earphone, the second earphone and the third earphone to synchronize the voice data through the established CIG.

In some possible implementations, by using the mobile phone as the host, the first earphone, the second earphone and the third earphone can be scheduled to synchronize voice data through the established CIG. That is, the CIG is scheduled through the mobile phone, so that the voice data among the first earphone, the second earphone and the third earphone are synchronized with each other.

For example, take the synchronization of the voice data of the first earphone to the second earphone and the third earphone as an example. The first earphone, the second earphone, and the third earphone synchronize the voice data through the CIG established by referring to FIG. 12 . As shown in FIG. 12 , the mobile phone 1210 establishes a CIG with the first earphone 1221 , the second earphone 1222 and the third earphone 1223 . When the first user 1231 wearing the first earphone 1221 speaks (eg, the first user 1231 says "hello" to the second user 1232 and the third user 1233), the microphone of the first earphone 1221 can receive the first user 1231 The voice of speaking is converted into voice data, and then the mobile phone 1210 can synchronize the voice data of the first earphone 1221 to the second earphone 1222 and the third earphone 1223 by scheduling CIG, and finally the second earphone 1222 that receives the voice data and the third earphone 1223 can respectively convert the voice data into sound through the respective speakers and play it to the second user 1232 and the third user 1233 . Therefore, the second user 1232 and the third user 1233 can hear what the first user 1231 is saying to them through the second earphone 1222 and the third earphone 1223 they wear, and the first user 1231 and the second user 1232 and the third user can be improved. The effect of voice communication between 1233.

It should be noted that, in this embodiment of the present application, the method shown in FIG. 5 and the method shown in FIG. 11 may also be combined with each other. That is, when the mobile phone is connected to multiple headsets for audio sharing, if it is determined that the user needs to enable the voice interworking function, the mobile phone can establish a SCO link with some headsets, and establish a CIG with another part through the CIS, and then the mobile phone can forward and dispatch In the form of CIG, the voice data between the headset that establishes the SCO link and another part of the headset that establishes the CIG are synchronized, so as to realize the voice intercommunication between the headsets. Specifically, which earphones and mobile phones establish SCO links and which earphones and mobile phones establish CIGs can be defined according to actual needs, and there is no restriction here. For example, a mobile phone establishes a CIG with a headset that supports Bluetooth 5.2 through CIS, and establishes a SCO link with other headsets.

Continue to take the electronic device as the mobile phone, and the audio devices to be communicated with each other are three earphones, that is, the first audio device is the first earphone (or referred to as earphone 1), and the second audio device is the second earphone (or referred to as earphone 2) The established link (eg, the first link) for voice intercommunication with the third headset (or referred to as the headset 3 ) is the CIS as an example. In this embodiment of the present application, each audio device, such as the first earphone, the second earphone, and the third earphone, may also establish a link for voice communication, so as to synchronize voice data with each other.

For example, FIG. 13 is a schematic flowchart of another method for voice interworking between audio devices provided by an embodiment of the present application. As shown in FIG. 13 , the method for voice intercommunication between audio devices may include the following S1301-S1305.

S1301. The mobile phone performs audio sharing through the first earphone, the second earphone and the third earphone.

S1302, the mobile phone sends audio sharing status information and other earphones, such as the device information (such as media access control (MAC) addresses) of the second earphone and the third earphone, to the main earphone, such as the first earphone. That is, the mobile phone sends configuration information to the main earphone, where the configuration information includes audio sharing state information and device information of other earphones.

S1303. The first headset determines that the user needs to enable the voice interworking function.

It should be noted that the specific implementations of steps S1301 to S1303 are similar to those of S901 to S903 in the method shown in FIG. 9 , and the relevant descriptions of S901 to S903 may be referred to, which will not be repeated here.

S1304, the first earphone, the second earphone and the third earphone establish a CIG through the CIS.

In some possible implementations, the first earphone may be paired with the second earphone and the third earphone first, and after the pairing is completed, the CIG is established with the second earphone and the third earphone. For example, the first earphone may first send a pairing request to the second earphone and the third earphone according to the device information sent by the mobile phone, and after receiving the pairing request, the second earphone and the third earphone may prompt the user to perform pairing (for example, by voice , vibration, etc. to prompt). The user can confirm pairing with the first earphone by pressing the physical buttons on the second earphone and the third earphone, touching the touch area on the second earphone and the third earphone, tapping the second earphone and the third earphone, etc. . As a response to the above operation of the user, the second earphone and the third earphone can be paired with the first earphone respectively according to the pairing request. After the first earphone is successfully paired with the second earphone and the third earphone, the first earphone can send a request for establishing a CIS to the second earphone and the third earphone respectively. When the second earphone and the third earphone respectively receive the above request, A CIS can be established with the first earphone respectively, so that the first earphone, the second earphone and the third earphone form a CIG (wherein the first earphone serves as the host). Optionally, after the second earphone and the third earphone respectively establish the CIS with the first earphone, a response that the CIS is established successfully may also be respectively sent to the first earphone. It should be noted that, when the second earphone and/or the third earphone are not confirmed to be paired with the first earphone, or do not support pairing with the first earphone, the first earphone can be unpaired and the voice interworking function can be turned off.

S1305, the first earphone schedules the first earphone, the second earphone and the third earphone to synchronize the voice data through the established CIG.

In some possible implementations, by using the first headset as a host, the first headset, the second headset, and the third headset can be scheduled to synchronize voice data through the established CIG. That is, the CIG is scheduled through the first earphone, so that the voice data of the first earphone, the second earphone and the third earphone are synchronized with each other.

For example, take the synchronization of the voice data of the first earphone to the second earphone and the third earphone as an example. The first earphone, the second earphone and the third earphone can synchronize the voice data through the established CIG with reference to FIG. 14 . As shown in FIG. 14, the first earphone 1411, the second earphone 1412, and the third earphone 1413 establish a CIG. When the first user 1421 wearing the first earphone 1411 speaks (eg, the first user 1421 says "hello" to the second user 1422 and the third user 1423), the microphone of the first earphone 1411 can receive the first user 1421 The voice of speaking is converted into voice data, and then the first earphone 1411 can synchronize the voice data of the first earphone 1411 to the second earphone 1412 and the third earphone 1413 by scheduling CIG, and finally receive the second earphone 1411 of the voice data. The earphone 1412 and the third earphone 1413 can respectively convert the voice data into sound through the respective speakers and play it to the second user 1422 and the third user 1423 . Therefore, the second user 1422 and the third user 1423 can hear what the first user 1421 says to them through the second earphone 1412 and the third earphone 1413 they wear, and the first user 1421 and the second user 1422 and the third user can be improved. The effect of voice communication between 1423.

In this embodiment, S1301 in the method shown in FIG. 13 can also be replaced with S1101 in the method shown in FIG. 11 , and accordingly, S1303 does not need to be executed. In this way, the user can determine whether to enable the voice interworking function through the mobile phone, which is relatively convenient and quick.

It should be noted that, in the above embodiment, when an electronic device (eg, a mobile phone) forwards or schedules voice data between various audio devices (eg, earphones), the speaker of the electronic device can also convert the voice data into sound Play, so that the voice of the speaking user is broadcast through the electronic device. For example, taking the scenario shown in FIG. 8 as an example, as shown in FIG. 15 , when the first user 1511 speaks, an indicative utterance such as “broadcast” can be added before the content to be said (for example, the first user 1511 Say "Broadcasting, hello"), so when the first earphone 1521 sends the voice data to the mobile phone 1530, the mobile phone 1530 can decode and recognize it, and when it recognizes that there is an instruction such as "broadcasting" in the voice data, the mobile phone 1530 speaks When the voice data is forwarded to the second earphone 1522, the user's words, such as "hello", are also played through its own speaker. For another example, based on the above example, the mobile phone may also be set to broadcast the voice of the speaking user by default. That is, the user does not need to add indicative words such as "broadcast" before the content to be said, and the mobile phone can also broadcast the words spoken by the user, which is not limited here.

It should also be noted that, in the above embodiment, if the earphones (for example, the above-mentioned first earphone and the second earphone) are TWS earphones, the link for voice intercommunication (for example, SCO) established between the mobile phone and the earphones link or CIS), or a link for voice interworking (eg, SCO link or CIS) established between the headset as the main device and other headsets can be established with only one of the TWS headsets.

In other embodiments of the present application, the electronic device may also be connected to multiple audio devices to implement voice intercommunication without audio sharing. The specific implementation is similar to the above-mentioned embodiment, except that the electronic device does not need to determine whether the user needs to enable voice interworking in the case of audio sharing. That is, as long as the electronic device determines that the user needs to enable voice interworking, the electronic device can establish a link (eg, the first link) for voice interworking with each audio device, so as to forward or synchronize the voice transmitted between the audio devices through the mobile phone. data to achieve voice intercommunication between audio devices. Alternatively, the electronic device sends the device information of the other audio devices to one of the multiple audio devices, and then the audio device establishes a link for voice communication with the other audio devices according to the device information, thereby realizing voice communication between the audio devices. In this way, the user can make a voice call through a plurality of audio devices connected to the electronic device, which is convenient for the users to communicate with each other.

As an example, take the electronic device as a mobile phone and the audio device as two speakers. The mobile phone can be connected to the speakers in the living room and the speakers in the bedroom, and communicate with each other, so that the first user in the living room can communicate with the second user in the bedroom through the voice communication between the speakers in the living room and the bedroom. voice communication. For example, as shown in FIG. 16 , when the user needs to perform voice communication, the system settings of the mobile phone can be opened to operate. As shown in (a) in Figure 16, the Bluetooth setting interface of the mobile phone may include setting options for enabling Bluetooth, audio sharing, and voice interworking, as well as devices that have been paired with the mobile phone (eg, headset 1, headset 2, A list of devices for speakers, bedroom speakers, etc.). When turning on the Bluetooth function, the user may select (eg, select operations such as clicking) the voice interworking option in the Bluetooth setting interface to turn on the voice interworking. As shown in (b) in Figure 16, when the user opens the voice interworking, the user can select the speaker in the living room and the speaker in the bedroom that have been paired with the mobile phone. Connect the speakers in the bedroom (for example, establish a SCO link, etc.) to enable the voice interworking function, so that the mobile phone can forward the voice data between the two speakers to achieve voice communication.

As another example, take the electronic device as a mobile phone and the audio device as two earphones, earphone 1 and earphone 2 .

The mobile phone can be connected to the headset 1 and the headset 2 respectively, and communicate with each other, so that the first user wearing the headset 1 and the second user wearing the headset 2 can easily communicate through the headset 1 and the headset 2. For example, as shown in FIG. 17 , when the user needs to perform voice communication, the operation can be performed in the multimedia notification interface in the pull-down notification of the mobile phone. As shown in (a) of FIG. 17 , when the mobile phone has been connected to the headset 1, the user can click the icon displaying more options in the multimedia notification interface in the pull-down notification to select more multimedia options. After that, as shown in (b) of FIG. 17 , the user can select a voice interworking option to perform voice interworking. When the user selects voice interworking, in response to these operations, the handset can detect audio devices (eg, headphones) in proximity to it. As shown in (c) of Figure 17, when the headset 2 1701 is close to the mobile phone, the mobile phone detects that the headset 2 1701 is approaching, and a pop-up prompt 1702 prompts the user to connect the headset 2 1701 for voice communication. The pop-up box prompts the voice interworking in 1702, so that the mobile phone connects with the headset 2 1701 in response to the above operation, thereby enabling the voice interworking function, so that the mobile phone can forward the voice data between the headset 1 and the headset 2 1701 to achieve voice interworking. Through this example, if the two users wearing earphone 1 and earphone 2 are both hearing impaired, the voice communication between earphone 1 and earphone 2 can be used to enable the two users to hear the other's words more clearly, thereby more convenient to communicate.

By using the method in the above embodiment, the user can use the voice intercommunication between multiple audio devices to conduct voice communication, thereby improving the convenience of the user's voice communication.

Corresponding to the methods in the foregoing embodiments, the embodiments of the present application further provide a voice interworking system. The voice interworking system may include an electronic device, a first audio device and a second audio device. Wherein, the electronic device can be used to connect with the first audio device through a first asynchronous connectionless (ACL) link; send audio data to the first audio device through the first ACL link; receive the operation of the user enabling the audio sharing function; Detecting an audio device close to the electronic device; detecting that the second audio device establishes a second ACL link with the second audio device; sending audio data to the second audio device through the second ACL link; sending audio data to the first audio device through the first ACL link The audio device sends audio sharing state information and device information of the second audio device; the audio sharing state information is used to indicate that the electronic device is in a state of audio sharing between the first audio device and the second audio device; Instruct, suspend sending audio data to the first audio device and the second audio device according to the first instruction;

The first audio device can be used for receiving audio data, and playing audio through the speaker of the first audio device according to the audio data; outputting prompt information for prompting the user whether to enable the voice interworking function; receiving the operation that the user determines to enable the voice interworking function; The electronic device sends the first instruction; establishes a first link with the second audio device according to the device information; receives the user's voice through the microphone of the first audio device, generates first voice data, and sends the first voice data to the second audio device; Or, receive the second voice data from the second audio device, and play the voice through the speaker of the first audio device according to the second voice data;

In a possible design, the first audio device is specifically configured to receive user operations on function keys on the first audio device; or the first audio device receives user operations on the touch area on the first audio device; Or the first audio device receives a user's tapping operation on the first audio device.

In another possible design, the first link is a Synchronous Connection Oriented (SCO) link.

In another possible design, the first link is an isochronous connection stream (CIS) link.

In another possible design manner, the electronic device is a mobile phone, and both the first audio device and the second audio device are true wireless stereo TWS earphones.

In another possible design manner, the electronic device uses the Bluetooth Stereo Audio Distribution Protocol (A2DP) to send audio data.

In another possible design manner, the electronic device is specifically configured to receive a user's click operation on an audio sharing option displayed by the electronic device.

In another possible design manner, the electronic device is also used to display a pop-up prompt, and the pop-up prompt is used to prompt the user that the second audio device can be connected for audio sharing.

In another possible design manner, the first audio device is specifically configured to play a voice prompting the user whether to enable the voice interworking function through the speaker of the first audio device.

Other embodiments of the present application provide an electronic device, and the electronic device may include: a memory and one or more processors. The memory is coupled to the processor. The memory is used to store computer program code comprising computer instructions. When the processor executes the computer instructions, the electronic device can perform various functions or steps performed by the electronic device in the foregoing method embodiments. Of course, the electronic device includes, but is not limited to, the aforementioned memory and one or more processors. For example, the structure of the electronic device may refer to the structure of the electronic device shown in FIG. 8 .

Other embodiments of the present application provide an audio device, and the audio device may include: a processor, and a memory for storing instructions executable by the processor. When the processor executes the computer instructions, the audio device can perform various functions or steps performed by the first audio device or the second audio device in the foregoing method embodiments.

Embodiments of the present application further provide a computer-readable storage medium for storing computer instructions for running the electronic device, the first audio device, or the second audio device.

Embodiments of the present application further provide a computer program product, including computer instructions executed by the electronic device, the first audio device, or the second audio device.

From the description of the above embodiments, those skilled in the art can clearly understand that, for the convenience and brevity of the description, only the division of the above functional modules is used as an example for illustration. In practical applications, the above functions can be allocated by Different functional modules are completed, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be Incorporation may either be integrated into another device, or some features may be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place, or may be distributed to multiple different places . Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, which are stored in a storage medium , including several instructions to make a device (may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

The above contents are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto, and any changes or replacements within the technical scope disclosed in the present application should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

A method for voice interworking between audio devices, wherein the method is applied to a voice interworking system, and the voice interworking system includes an electronic device, a first audio device, and a second audio device, and the method includes:

the electronic device and the first audio device are connected through a first asynchronous connectionless ACL link;

The electronic device sends audio data to the first audio device through the first ACL link;

The first audio device receives the audio data, and plays audio through the speaker of the first audio device according to the audio data;

The electronic device receives the user's operation of enabling the audio sharing function;

In response to the operation of turning on the audio sharing function, the electronic device detects an audio device proximate to the electronic device;

the electronic device detects the second audio device;

establishing a second ACL link between the electronic device and the second audio device;

The electronic device sends the audio data to the second audio device through the second ACL link;

The second audio device receives the audio data, and plays the audio through a speaker of the second audio device according to the audio data;

The electronic device sends audio sharing state information and device information of the second audio device to the first audio device through the first ACL link; the audio sharing state information is used to indicate that the electronic device is in any the state in which the first audio device and the second audio device perform audio sharing;

The first audio device outputs prompt information for prompting the user whether to enable the voice interworking function;

The first audio device receives an operation that the user determines to enable the voice interworking function;

In response to the operation of determining that the voice interworking function is enabled, the first audio device sends a first instruction to the electronic device, where the first instruction is used to instruct the electronic device to suspend the communication between the first audio device and the electronic device. sending the audio data by the second audio device;

The electronic device suspends sending the audio data to the first audio device and the second audio device according to the first indication;

The first audio device establishes a first link with the second audio device according to the device information;

The first audio device receives the user's voice through the microphone of the first audio device, generates first voice data, and sends the first voice data to the second audio device;

The second audio device plays a voice through the speaker of the second audio device according to the first voice data;

or,

The second audio device receives the user's voice through the microphone of the second audio device, generates second voice data, and sends the second voice data to the first audio device;

The first audio device plays a voice through a speaker of the first audio device according to the second voice data.
The method according to claim 1, wherein the first audio device receiving an operation for determining to enable a voice interworking function from a user comprises:

The first audio device receives user operations on function keys on the first audio device;

Or the first audio device receives a user's operation on the touch area on the first audio device;

Or the first audio device receives a user's tapping operation on the first audio device.
The method according to claim 1, wherein the first link is a synchronous connection oriented SCO link.
The method of claim 1, wherein the first link is an isochronous connection stream CIS link.
The method according to any one of claims 1 to 4, wherein the electronic device is a mobile phone, and the first audio device and the second audio device are both true wireless stereo TWS earphones.
The method according to claim 1, wherein the electronic device sends the audio data by using a Bluetooth stereo audio transmission protocol A2DP.
The method according to claim 1, wherein the electronic device receives an operation of a user to enable an audio sharing function, comprising:

The electronic device receives a user's click operation on the audio sharing option displayed by the electronic device.
The method according to claim 1, wherein after the electronic device detects the second audio device, the method further comprises:

The electronic device displays a pop-up prompt, where the pop-up prompt is used to prompt the user that the second audio device can be connected for audio sharing.
The method according to claim 1, wherein the first audio device outputs prompt information for prompting the user whether to enable the voice interworking function, comprising:

The first audio device plays a voice prompting the user whether to enable the voice interworking function through the speaker of the first audio device.
A voice interworking system, comprising electronic equipment, first audio equipment and second audio equipment;

The electronic device is configured to connect with the first audio device through a first asynchronous connectionless ACL link; send audio data to the first audio device through the first ACL link; the receiving user enables the audio sharing function Detecting an audio device close to the electronic device; Detecting that the second audio device establishes a second ACL link with the second audio device; reporting to the second audio device through the second ACL link sending the audio data; sending audio sharing state information and device information of the second audio device to the first audio device through the first ACL link; the audio sharing state information is used to instruct the electronic device In a state of audio sharing between the first audio device and the second audio device; receiving a first instruction from the first audio device, and suspending the audio to the first audio device and the second audio device according to the first instruction The audio device sends the audio data;

The first audio device is configured to receive the audio data, and play audio through the speaker of the first audio device according to the audio data; output prompt information for prompting the user whether to enable the voice interworking function; the receiving user determines to enable operation of the voice interworking function; sending the first indication to the electronic device; establishing a first link with the second audio device according to the device information; receiving the user's voice through the microphone of the first audio device, generating first voice data, and sending the first voice data to the second audio device; or, receiving second voice data from the second audio device, and passing the first audio data according to the second voice data The device's speaker plays the voice;

the second audio device, configured to receive the audio data, and play the audio through the speaker of the second audio device according to the audio data; receive the first voice data from the first audio device, Play the voice through the speaker of the second audio device according to the first voice data; or, receive the user's voice through the microphone of the second audio device, generate second voice data, and send the voice to the first audio device. describe the second voice data.
The voice interworking system according to claim 10, wherein the first audio device is specifically configured to receive user operations on function keys on the first audio device; or the first audio device receives user operations An operation on a touch area on the first audio device; or the first audio device receives a user's tapping operation on the first audio device.
The voice interworking system according to claim 10, wherein the first link is a synchronous connection oriented SCO link.
The voice interworking system according to claim 10, wherein the first link is an isochronous connection stream CIS link.
The voice interworking system according to any one of claims 10 to 13, wherein the electronic device is a mobile phone, and the first audio device and the second audio device are both true wireless stereo TWS earphones.
The voice interworking system according to claim 10, wherein the electronic device sends the audio data by using a Bluetooth stereo audio transmission protocol A2DP.
The voice interworking system according to claim 10, wherein the electronic device is specifically configured to receive a user's click operation on an audio sharing option displayed by the electronic device.
The voice interworking system according to claim 10, wherein the electronic device is further configured to display a pop-up prompt, and the pop-up prompt is used to prompt a user that the second audio device can be connected for audio sharing.
The voice interworking system according to claim 10, wherein the first audio device is specifically configured to play a voice prompting the user whether to enable the voice interworking function through a speaker of the first audio device.