CN113301544B

CN113301544B - Method and equipment for voice intercommunication between audio equipment

Info

Publication number: CN113301544B
Application number: CN202110385309.7A
Authority: CN
Inventors: 付雷; 林士博; 唐能福
Original assignee: Honor Device Co Ltd
Current assignee: Beijing Honor Device Co Ltd
Priority date: 2021-04-09
Filing date: 2021-04-09
Publication date: 2022-05-03
Anticipated expiration: 2041-04-09
Also published as: CN113301544A; WO2022213689A1

Abstract

The embodiment of the application discloses a method and equipment for voice intercommunication among audio equipment, relates to the field of electronic equipment, and solves the problem that normal voice communication among users using the audio equipment is influenced when a plurality of audio equipment share audio. The specific scheme is as follows: when the electronic equipment is respectively connected with the first audio equipment and the second audio equipment for audio sharing, the first audio equipment and the second audio equipment establish a first link, and the first audio equipment and the second audio equipment synchronize voice data through the first link.

Description

Method and equipment for voice intercommunication between audio equipment

Technical Field

The embodiment of the application relates to the field of electronic equipment, in particular to a method and equipment for voice intercommunication among audio equipment.

Background

In order to facilitate users to share audio played on their own smart phones, many smart phone products provide a function supporting bluetooth audio sharing, namely, an audio sharing function. For example, the smartphone may be bluetooth connected to the headphone apparatus 1 and the headphone apparatus 2, respectively. The audio played on the smart phone can be played on the earphone device 1 and the earphone device 2 connected with the smart phone simultaneously through the audio sharing function.

However, when a plurality of users share the audio played on the smart phone through the audio sharing function provided by the smart phone, the users are affected by their earphones, and the sound of mutual speaking and communication is weakened, so that normal communication between the users is affected. For example, the user 1 wears the headset device 1, and the user 2 wears the headset device 2, so that when the audio played on the smart phone is shared, the user is affected by the headset devices, and when the user 1 and the user 2 speak and communicate with each other, the two parties may not hear the words spoken by the other party clearly, which causes inconvenience. Especially, when the headphone device 1 and the headphone device 2 support and turn on the noise reduction function, the user 1 and the user 2 cannot hear what the other party says, which affects normal communication between both parties.

Disclosure of Invention

The embodiment of the application provides a method and equipment for voice intercommunication among audio equipment, and solves the problem that normal voice communication among users using the audio equipment is influenced when a plurality of audio equipment share audio.

In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:

in a first aspect, an embodiment of the present application provides a method for voice interworking between audio devices, where the method is applicable to a voice interworking system. The voice intercommunication system can comprise an electronic device, a first audio device and a second audio device, and the method comprises the following steps: the electronic equipment is connected with the first audio equipment through a first asynchronous connection-free (ACL) link; the electronic equipment sends audio data to the first audio equipment through the first ACL link; the first audio equipment receives audio data and plays audio through a loudspeaker of the first audio equipment according to the audio data; the electronic equipment receives the operation of starting the audio sharing function by a user; in response to an operation of turning on the audio sharing function, the electronic device detects an audio device that is close to the electronic device; the electronic device detects a second audio device; the electronic equipment and the second audio equipment establish a second ACL link; the electronic equipment sends audio data to second audio equipment through a second ACL link; the second audio equipment receives the audio data and plays audio through a loudspeaker of the second audio equipment according to the audio data; the electronic equipment sends audio sharing state information and equipment information of the second audio equipment to the first audio equipment through the first ACL link; the audio sharing state information is used for indicating that the electronic equipment is in a state of audio sharing between the first audio equipment and the second audio equipment; the first audio equipment outputs prompt information for prompting a user whether to start a voice intercommunication function; the method comprises the steps that first audio equipment receives operation of a user for determining to start a voice intercommunication function; in response to determining to start the operation of the voice interworking function, the first audio device sends a first indication to the electronic device, wherein the first indication is used for indicating the electronic device to suspend sending audio data to the first audio device and the second audio device; the electronic equipment suspends sending audio data to the first audio equipment and the second audio equipment according to the first indication; the first audio equipment establishes a first link with the second audio equipment according to the equipment information; the method comprises the steps that first audio equipment receives voice of a user through a microphone of the first audio equipment, generates first voice data and sends the first voice data to second audio equipment; the second audio equipment plays voice through a loudspeaker of the second audio equipment according to the first voice data; or the second audio equipment receives the voice of the user through a microphone of the second audio equipment, generates second voice data and sends the second voice data to the first audio equipment; and the first audio equipment plays voice through a loudspeaker of the first audio equipment according to the second voice data.

After the electronic device is connected with the first audio device and the second audio device through the ACL link respectively, the audio data received by the second audio device is the same as the audio data received by the first audio device, that is, the electronic device simultaneously sends the audio data to the first audio device and the second audio device.

Based on the method of the first aspect, a user can perform voice communication by using voice intercommunication among a plurality of audio devices, and convenience of the voice communication of the user is improved. For example, when multiple users share the audio played on the mobile phone through the audio sharing function, the multiple users can communicate with each other by using the voice intercommunication between their respective earphones, thereby avoiding the situation that the users cannot hear the communication sound clearly.

With reference to the first aspect, in a possible design manner, the receiving, by the first audio device, an operation of the user to determine to start the voice interworking function includes: the method comprises the steps that a first audio device receives operation of a user on function keys on the first audio device; or the first audio equipment receives the operation of the user on the touch area on the first audio equipment; or the first audio equipment receives the tapping operation of the first audio equipment by the user.

Based on the possible design mode, the user can conveniently and quickly determine that the voice intercommunication function needs to be started by operating the first audio equipment, and the user operation experience is improved.

With reference to the first aspect, in another possible design, the first link is a Synchronous Connection Oriented (SCO) link.

Based on the possible design mode, since the SCO link is also supported by the Bluetooth protocol of the earlier version, the applicability of the method to the audio equipment can be improved by setting the first link as the SCO link.

With reference to the first aspect, in another possible design, the first link is an isochronous connection stream (CIS) link.

Based on the possible design mode, since the CIS link can support the connection between a plurality of (such as two or more) devices, the first link is set as the CIS link, so that the method can support the voice intercommunication between a plurality of audio devices.

With reference to the first aspect, in another possible design, the electronic device is a mobile phone, and the first audio device and the second audio device are both True Wireless Stereo (TWS) headsets.

With reference to the first aspect, in another possible design, the electronic device sends the audio data using a bluetooth stereo audio transmission protocol (A2 DP).

With reference to the first aspect, in another possible design manner, the receiving, by the electronic device, an operation of starting an audio sharing function by a user includes: the electronic equipment receives click operation of a user on an audio sharing option displayed by the electronic equipment.

Based on the possible design mode, the user can start the audio sharing function through the audio sharing option displayed on the electronic equipment, and the operation convenience of the user is improved.

With reference to the first aspect, in another possible design manner, after the electronic device detects the second audio device, the method further includes: the electronic equipment displays a pop-up box prompt, and the pop-up box prompt is used for prompting that a user can be connected with second audio equipment to share audio.

Based on the possible design mode, the user can confirm the audio sharing by carrying out confirmation operation on the pop-up box prompt displayed by the electronic equipment, and the operation convenience of the user is improved.

With reference to the first aspect, in another possible design manner, the outputting, by the first audio device, a prompt message for prompting a user whether to start a voice interworking function includes: the first audio equipment plays the voice prompting whether the user starts the voice intercommunication function or not through a loudspeaker of the first audio equipment.

In a second aspect, an embodiment of the present application provides a voice interworking system, which may include an electronic device, a first audio device, and a second audio device. The electronic equipment can be used for being connected with the first audio equipment through a first asynchronous connection-free (ACL) link; sending audio data to a first audio device through a first ACL link; receiving the operation of starting the audio sharing function by a user; detecting an audio device in proximity to the electronic device; detecting that a second audio device establishes a second ACL link with the second audio device; sending audio data to the second audio device through the second ACL link; sending audio sharing state information and equipment information of second audio equipment to first audio equipment through a first ACL link; the audio sharing state information is used for indicating that the electronic equipment is in a state of audio sharing between the first audio equipment and the second audio equipment; receiving a first indication from a first audio device, and suspending transmission of audio data to the first audio device and a second audio device according to the first indication;

the first audio equipment can be used for receiving audio data and playing audio through a loudspeaker of the first audio equipment according to the audio data; outputting prompt information for prompting a user whether to start a voice intercommunication function; receiving the operation that a user determines to start a voice intercommunication function; sending a first indication to the electronic device; establishing a first link with a second audio device according to the device information; receiving voice of a user through a microphone of first audio equipment, generating first voice data, and sending the first voice data to second audio equipment; or receiving second voice data from the second audio equipment, and playing voice through a loudspeaker of the first audio equipment according to the second voice data;

the second audio equipment can be used for receiving the audio data and playing audio through a loudspeaker of the second audio equipment according to the audio data; receiving first voice data from first audio equipment, and playing voice through a loudspeaker of second audio equipment according to the first voice data; or receiving the voice of the user through a microphone of the second audio equipment, generating second voice data, and sending the second voice data to the first audio equipment.

With reference to the second aspect, in a possible design manner, the first audio device is specifically configured to receive an operation of a user on a function key on the first audio device; or the first audio equipment receives the operation of the user on the touch area on the first audio equipment; or the first audio equipment receives the tapping operation of the first audio equipment by the user.

With reference to the second aspect, in another possible design, the first link is a Synchronous Connection Oriented (SCO) link.

With reference to the second aspect, in another possible design, the first link is an isochronous connection stream (CIS) link.

With reference to the second aspect, in another possible design, the electronic device is a mobile phone, and the first audio device and the second audio device are both True Wireless Stereo (TWS) headsets.

In another possible design, in combination with the second aspect, the electronic device transmits the audio data using a bluetooth stereo audio transport protocol (A2 DP).

With reference to the second aspect, in another possible design manner, the electronic device is specifically configured to receive a click operation of a user on an audio sharing option displayed by the electronic device.

With reference to the second aspect, in another possible design manner, the electronic device is further configured to display a pop-up prompt, where the pop-up prompt is used to prompt a user that the second audio device can be connected for audio sharing.

With reference to the second aspect, in another possible design, the first audio device is specifically configured to play, through a speaker of the first audio device, a voice that prompts a user whether to start a voice interworking function.

It should be understood that the beneficial effects of the second aspect can be referred to the related description of the first aspect, and are not described herein again.

In a third aspect, an embodiment of the present application provides a method for voice interworking between audio devices, where the method is applicable to a voice interworking system. The voice intercommunication system can comprise an electronic device, a first audio device and a second audio device, and the method comprises the following steps: the electronic equipment is connected with the first audio equipment through a first asynchronous connection-free (ACL) link; the electronic equipment sends audio data to the first audio equipment through the first ACL link; the first audio equipment receives audio data and plays audio through a loudspeaker of the first audio equipment according to the audio data; the electronic equipment receives the operation of starting the audio sharing function by a user; in response to an operation of turning on the audio sharing function, the electronic device detects an audio device that is close to the electronic device; the electronic device detects a second audio device; the electronic equipment and the second audio equipment establish a second ACL link; the electronic equipment sends audio data to second audio equipment through a second ACL link; the second audio equipment receives the audio data and plays audio through a loudspeaker of the second audio equipment according to the audio data; the first audio equipment outputs prompt information for prompting a user whether to start a voice intercommunication function; the method comprises the steps that first audio equipment receives operation of a user for determining to start a voice intercommunication function; in response to determining to start the operation of the voice interworking function, the first audio device sends a first indication to the electronic device, wherein the first indication is used for indicating the electronic device to suspend sending audio data to the first audio device and the second audio device; the electronic equipment suspends sending audio data to the first audio equipment and the second audio equipment according to the first indication; the first audio equipment establishes a first link with the second audio equipment according to the equipment information; the method comprises the steps that first audio equipment receives voice of a user through a microphone of the first audio equipment, generates first voice data and sends the first voice data to second audio equipment; the second audio equipment plays voice through a loudspeaker of the second audio equipment according to the first voice data; or the second audio equipment receives the voice of the user through a microphone of the second audio equipment, generates second voice data and sends the second voice data to the first audio equipment; and the first audio equipment plays voice through a loudspeaker of the first audio equipment according to the second voice data.

Based on the method of the third aspect, the user can perform voice communication by using voice intercommunication among a plurality of audio devices, and convenience of voice communication of the user is improved. For example, when multiple users share the audio played on the mobile phone through the audio sharing function, the multiple users can communicate with each other by using the voice intercommunication between their respective earphones, thereby avoiding the situation that the users cannot hear the communication sound clearly.

With reference to the third aspect, in one possible design manner, the receiving, by the first audio device, an operation of the user to determine to turn on the voice interworking function includes: the method comprises the steps that a first audio device receives operation of a user on function keys on the first audio device; or the first audio equipment receives the operation of a user on the touch area on the first audio equipment; or the first audio equipment receives the tapping operation of the first audio equipment by the user.

With reference to the third aspect, in another possible design, the first link is a Synchronous Connection Oriented (SCO) link.

With reference to the third aspect, in another possible design, the first link is an isochronous connection stream (CIS) link.

With reference to the third aspect, in another possible design, the electronic device is a mobile phone, and the first audio device and the second audio device are both True Wireless Stereo (TWS) headsets.

With reference to the third aspect, in another possible design, the electronic device transmits the audio data using a bluetooth stereo audio transport protocol (A2 DP).

With reference to the third aspect, in another possible design manner, the receiving, by the electronic device, an operation of the user to start an audio sharing function includes: the electronic equipment receives click operation of a user on an audio sharing option displayed by the electronic equipment.

With reference to the third aspect, in another possible design manner, after the electronic device detects the second audio device, the method further includes: the electronic equipment displays a pop-up box prompt which is used for prompting that the user can connect the second audio equipment to carry out audio sharing.

With reference to the third aspect, in another possible design manner, the outputting, by the first audio device, a prompt message for prompting a user whether to turn on the voice interworking function includes: the first audio equipment plays the voice prompting whether the user starts the voice intercommunication function or not through a loudspeaker of the first audio equipment.

In a fourth aspect, an embodiment of the present application provides a method for voice interworking between audio devices, where the method may be applied to a voice interworking system. The voice intercommunication system can comprise an electronic device, a first audio device and a second audio device, and the method comprises the following steps: responding to the operation that a user starts the first mode, and establishing an ACL link between the electronic equipment and the first audio equipment and between the electronic equipment and the second audio equipment respectively; the electronic equipment respectively sends audio data to the first audio equipment and the second audio equipment; the first audio equipment and the second audio equipment respectively receive the audio data and play audio; responding to the operation of starting the second mode by the user, and sending equipment information of the second audio equipment to the first audio equipment by the electronic equipment; the first audio equipment establishes a first link with the second audio equipment according to the equipment information; the first audio equipment sends voice data to the second audio equipment through a first link; the second audio equipment plays voice according to the voice data; or the second audio equipment sends voice data to the first audio equipment through the first link; the first audio device plays the voice according to the voice data.

Based on the method of the fourth aspect, the user can perform voice communication by using voice intercommunication among a plurality of audio devices, and convenience of the voice communication of the user is improved. For example, when multiple users share the audio played on the mobile phone through the audio sharing function, the multiple users can communicate with each other by using the voice intercommunication between their respective earphones, thereby avoiding the situation that the users cannot hear the communication sound clearly.

With reference to the fourth aspect, in another possible design, the first link is a Synchronous Connection Oriented (SCO) link.

With reference to the fourth aspect, in another possible design, the first link is an isochronous connection stream (CIS) link.

With reference to the fourth aspect, in another possible design manner, the electronic device is a mobile phone, and the first audio device and the second audio device are both True Wireless Stereo (TWS) headphones.

With reference to the fourth aspect, in another possible design, the electronic device transmits the audio data using a bluetooth stereo audio transport protocol (A2 DP).

With reference to the fourth aspect, in another possible design manner, a user starts the operation of the first mode, including: and clicking the audio sharing option displayed by the electronic equipment by the user.

With reference to the fourth aspect, in another possible design manner, the user starts the operation of the second mode, including: and clicking the voice intercommunication option displayed by the electronic equipment by the user.

In a fifth aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory for storing instructions executable by the processor. The processor is configured to execute the above instructions to enable the electronic device to implement the functions of the electronic device in the method for voice intercommunication between audio devices as in any one of the first aspect, the third aspect or the fourth aspect.

In a sixth aspect, an embodiment of the present application provides an audio device, including: a processor, a memory for storing instructions executable by the processor. The processor is configured to execute the above instructions to cause the audio device to implement the function of the first audio device in the method for voice interworking between audio devices according to any one of the first aspect, the third aspect or the fourth aspect.

In a seventh aspect, an embodiment of the present application provides an audio device, including: a processor, a memory for storing instructions executable by the processor. The processor is configured to execute the above instructions to cause the audio device to implement the function of the second audio device in the method for voice interworking between audio devices according to any one of the first aspect, the third aspect or the fourth aspect.

Drawings

Fig. 1 is a schematic diagram of an audio sharing link according to an embodiment of the present application;

fig. 2 is a schematic diagram of an interface for opening audio sharing according to an embodiment of the present application;

fig. 3 is a schematic diagram of another interface for opening audio sharing according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 5 is a flowchart illustrating a method for voice interworking between audio devices according to an embodiment of the present application;

fig. 6 is a schematic interface diagram of an application of a method for voice interworking between audio devices according to an embodiment of the present application;

FIG. 7 is a schematic interface diagram of another method for voice interworking between audio devices according to an embodiment of the present application;

fig. 8 is a schematic view of a scene when the method for voice interworking between audio devices according to the embodiment of the present application is applied;

FIG. 9 is a flowchart illustrating another method for interworking speech between audio devices according to an embodiment of the present application;

fig. 10 is a schematic view of a scene in which another method for voice interworking between audio devices according to an embodiment of the present application is applied;

FIG. 11 is a flowchart illustrating another method for interworking speech between audio devices according to an embodiment of the present application;

fig. 12 is a schematic view of a scene in which another method for voice interworking between audio devices according to an embodiment of the present application is applied;

FIG. 13 is a flowchart illustrating another method for interworking speech between audio devices according to an embodiment of the present application;

fig. 14 is a schematic view of a scene in which another method for voice interworking between audio devices according to an embodiment of the present application is applied;

fig. 15 is a schematic view of a scene in which another method for voice interworking between audio devices according to an embodiment of the present application is applied;

fig. 16 is a schematic interface diagram of another method for voice interworking between audio devices according to the embodiment of the present application when applied;

fig. 17 is a schematic interface diagram of another method for voice interworking between audio devices according to an embodiment of the present application when applied.

Detailed Description

In the process of using electronic devices, such as mobile phones, tablet computers or notebook computers, people often use the electronic devices to watch videos or listen to music and the like. In order to improve the listening experience when watching video or listening to music, people wear earphones to listen to the sound played by the electronic device through the earphones. Alternatively, in public places (e.g., restaurants, cafes, restrooms, public transportation vehicles, etc.), in order to avoid affecting others, people may also wear earphones to listen to the sound played by the electronic device through the earphones. However, when a person listens to the sound played on the device through headphones, it is difficult to share the sound played by the device with friends. Therefore, a function supporting bluetooth audio sharing, i.e., an audio sharing function, is now provided on many electronic devices. Taking a mobile phone as an example, when people watch videos or listen to music through the mobile phone, the earphones of the people and friends can be respectively connected with the mobile phone of the people through the Bluetooth, and the people and the friends can listen to the sound played by the mobile phone through the respective earphones by utilizing the audio sharing function.

The electronic device (e.g., a mobile phone) may be connected to the plurality of earphones through bluetooth (e.g., the electronic device establishes a second link with the earphones, respectively) to perform audio sharing. For example, taking an electronic device as a mobile phone as an example, as shown in fig. 1, an Asynchronous Connection (ACL) link is established between each of the mobile phones 101 and the plurality of earphones 102 (ACL is a connection manner in which a master unit and all slave units stored in a piconet realize one-point multiple access), and the mobile phone 101 can transmit audio data to each of the earphones 102 through the ACL link, thereby realizing audio sharing. Of course, the electronic device may also implement audio sharing with multiple earphones in other ways, which is not limited herein.

As an example, a user may set and turn on the connection of the electronic device to multiple headsets and audio sharing at a system setting of the electronic device. For example, taking an electronic device as a mobile phone, and connected earphones as two earphones, namely an earphone 1 and an earphone 2, as shown in fig. 2, when a user needs to perform audio sharing through the mobile phone, the system setting of the mobile phone may be opened for operation. As shown in fig. 2 (a), the bluetooth setup interface of the mobile phone may include setup options for turning on bluetooth and audio sharing, and a device list including devices (e.g., headset 1, headset 2, smart speaker, smart projector, etc.) that have been paired with the mobile phone. The user may select (e.g., click, etc. a selection operation) an audio sharing option in the bluetooth settings interface when the bluetooth function is enabled. In response to this operation, the handset may display an audio sharing setting interface. As shown in fig. 2 (b), the audio sharing setup interface may include a setup option to start audio sharing, including a list of devices that have already been paired with the handset. The user can select to start the audio sharing function on the audio sharing setting interface and select the headset 1 and the headset 2 which are already paired with the mobile phone. In response to these operations, the handset may connect to headset 1 and headset 2 separately (e.g., establish an ACL link), thereby enabling the audio sharing functionality so that audio on the handset can be played through headset 1 and headset 2 simultaneously.

As another example, a user may turn on and set audio sharing at a multimedia notification interface of an electronic device. For example, taking the electronic device as a mobile phone, and the connected earphones as two earphones, namely the earphone 1 and the earphone 2, as shown in fig. 3, when a user needs to perform audio sharing through the mobile phone, the user can operate in a multimedia notification interface in a pull-down notification of the mobile phone. As shown in (a) of fig. 3, when the user is listening to audio played by the mobile phone using the headset 1 connected to the mobile phone (e.g., the headset 1 is connected to the mobile phone through the first ACL link, the mobile phone sends audio data to the headset 1 through the first ACL link, and the headset 1 plays audio through the speaker according to the received audio data), the user may click an icon displaying more options on the multimedia notification interface in the pull-down notification so as to select more options on multimedia. Thereafter, as shown in fig. 3 (b), the user may select an audio sharing option to start audio sharing. When the user selects audio sharing, the handset may detect an audio device (e.g., a headset) in proximity thereto in response to these operations. As shown in (c) of fig. 3, when the earphone 2 (e.g., the earphone 301 shown in the figure) approaches the mobile phone, the mobile phone detects that the earphone 2 approaches, and then a pop-up prompt 302 can pop up to prompt the user to connect the earphone 2 for audio sharing, and the user can click the audio sharing in the pop-up prompt 302 to connect the mobile phone with the earphone 2 in response to the above operation (e.g., the mobile phone establishes a second ACL link with the earphone 2), so as to start the audio sharing function, so that the audio on the mobile phone can be played simultaneously through the earphone 1 and the earphone 2 (i.e., the mobile phone also sends audio data to the earphone 2 through the second ACL link, and the earphone 2 plays the audio through the speaker according to the received audio data). Alternatively, the mobile phone may employ a bluetooth stereo distribution profile (A2 DP) to transmit audio data to the headset 1 and the headset 2, respectively.

Illustratively, an electronic device (e.g., a cell phone) may also perform audio sharing in a manner similar to the way audio is synchronized between two earpieces of a True Wireless Stereo (TWS) headset. For example, when the first earphone and the mobile phone establish a link and then play audio, the second earphone can acquire audio data transmitted between the mobile phone and the first earphone by monitoring the link established between the first earphone and the mobile phone, so that audio sharing between the first earphone and the second earphone is realized.

Therefore, the audio sharing function enables the user to better and more conveniently share the audio played on the electronic equipment with the friends. However, when a plurality of users share audio played on the electronic device through the earphone by using the audio sharing function, the users may feel less external sound due to the influence of the earphone because each user wears the earphone. Therefore, when a plurality of users who are using the audio sharing function speak with each other and communicate with each other, it may be difficult for the users to hear the sounds of the mutual communication. In addition, in order to improve the sense of immersion in listening, many earphones now support a noise reduction function, and when the noise reduction function is turned on, it is more difficult for users to hear the sounds of mutual communication.

In order to solve the above problem, an embodiment of the present application provides a method for voice interworking between audio devices. The method may be applied to a voice interworking system, i.e. a system consisting of an electronic device and at least two audio devices, such as a first audio device and at least one second audio device. The method can comprise the following steps: when the electronic device performs audio sharing with a plurality of audio devices, respectively. The electronic device may establish a link (e.g., a first link) for voice interworking with each audio device, respectively, so as to forward or synchronize voice data transmitted between the audio devices through the electronic device, thereby implementing voice interworking between the audio devices. Alternatively, one of the audio devices may serve as a master device (i.e., a master audio device) and establish a link (e.g., a first link) for voice interworking with the other audio devices, respectively, so as to forward or synchronize voice data transmitted between the audio devices through the audio device serving as the master device, thereby implementing voice interworking between the audio devices.

It should be noted that the link established for voice interworking may be a Synchronous Connection Oriented (SCO) link (SCO performs synchronous communication (circuit switching) with reserved bandwidth, and mainly supports transmission of information with time limitation), an extended synchronous connection-oriented (ESCO) (similar to the SCO and having a retransmission mechanism), an isochronous connection stream (CIS) link (CIS is a logical transmission, so that connected devices can transmit isochronous data in any direction), or a dedicated link established based on a 2.4G wireless technology. Of course, those skilled in the art can also define the link for user voice interworking according to the actual situation, and is not limited herein.

Therefore, the user can communicate by utilizing the voice intercommunication among the plurality of audio devices, and the convenience of the voice communication of the user is improved. For example, when multiple users share the audio played on the mobile phone through the audio sharing function, the multiple users can communicate with each other by using the voice intercommunication between their respective earphones, thereby avoiding the situation that the users cannot hear the communication sound clearly.

Hereinafter, a method for voice intercommunication between audio devices according to an embodiment of the present application will be described with reference to the drawings.

In the embodiment of the present application, the audio device is a device (e.g., a device having a microphone and a speaker) with sound pickup and playback functions, such as an earphone, a bluetooth sound box, a smart sound box, and the like. The electronic device may be a mobile phone, a tablet computer, a handheld computer, a PC, a cellular phone, a Personal Digital Assistant (PDA), a wearable device (e.g., a smart watch, a smart bracelet), a smart home device (e.g., a television), a vehicle machine (e.g., a vehicle-mounted computer), a smart screen, a game machine, a smart tv box, and an Augmented Reality (AR)/Virtual Reality (VR) device. The embodiment of the present application is not particularly limited to the specific device form of the electronic device.

Optionally, in some embodiments, the device modalities of the plurality of audio devices may be the same. For example, the plurality of audio devices are each headphones.

Alternatively, in other embodiments, the device forms of the plurality of audio devices may be different. For example, among the plurality of audio devices are headphones and smart speakers.

Exemplarily, taking an electronic device as a mobile phone as an example, fig. 4 shows a schematic structural diagram of an electronic device provided in an embodiment of the present application. That is, the electronic device shown in fig. 4 may be a mobile phone, for example.

As shown in fig. 4, the electronic device may include a processor 410, an external memory interface 420, an internal memory 421, a Universal Serial Bus (USB) interface 430, a charging management module 440, a power management module 441, a battery 442, an antenna 1, an antenna 2, a mobile communication module 450, a wireless communication module 460, an audio module 470, a speaker 470A, a receiver 470B, a microphone 470C, an earphone interface 470D, a sensor module 480, keys 490, a motor 491, an indicator 492, a camera 493, a display screen 494, a Subscriber Identification Module (SIM) card interface 495, and the like. Among them, the sensor module 480 may include a pressure sensor 480A, a gyro sensor 480B, an air pressure sensor 480C, a magnetic sensor 480D, an acceleration sensor 480E, a distance sensor 480F, a proximity light sensor 480G, a fingerprint sensor 480H, a temperature sensor 480J, a touch sensor 480K, an ambient light sensor 480L, a bone conduction sensor 480M, and the like.

It is to be understood that the illustrated structure of the present embodiment does not constitute a specific limitation to the electronic device. In other embodiments, an electronic device may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 410 may include one or more processing units, such as: the processor 410 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), among others. The different processing units may be separate devices or may be integrated into one or more processors.

The controller may be a neural center and a command center of the electronic device. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 410 for storing instructions and data. In some embodiments, the memory in the processor 410 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 410. If the processor 410 needs to use the instruction or data again, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 410, thereby increasing the efficiency of the system.

In some embodiments, processor 410 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The wireless communication function of the electronic device may be implemented by the antenna 1, the antenna 2, the mobile communication module 450, the wireless communication module 460, the modem processor, the baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in an electronic device may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 450 may provide a solution including 2G/3G/4G/5G wireless communication applied on the electronic device. The mobile communication module 450 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 450 may receive the electromagnetic wave from the antenna 1, and filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 450 can also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave to radiate the electromagnetic wave through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 450 may be disposed in the processor 410. In some embodiments, at least some of the functional blocks of the mobile communication module 450 may be disposed in the same device as at least some of the blocks of the processor 410.

The wireless communication module 460 may provide solutions for wireless communication applied to electronic devices, including Wireless Local Area Networks (WLANs), such as wireless fidelity (Wi-Fi) networks, Bluetooth (BT), Global Navigation Satellite Systems (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 460 may be one or more devices integrating at least one communication processing module. The wireless communication module 460 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 410. The wireless communication module 460 may also receive a signal to be transmitted from the processor 410, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.

In some embodiments, antenna 1 of the electronic device is coupled to the mobile communication module 450 and antenna 2 is coupled to the wireless communication module 460, such that the electronic device can communicate with the network and other devices through wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), Wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), Long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The electronic device implements a display function via the GPU, the display screen 494, and the application processor, etc. The GPU is an image processing microprocessor connected to a display screen 494 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 410 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 494 is used to display images, videos, and the like. The display screen 494 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the electronic device may include 1 or N display screens 494, N being a positive integer greater than 1.

The electronic device may implement a shooting function through the ISP, the camera 493, the video codec, the GPU, the display screen 494, the application processor, and the like. In some embodiments, the electronic device may include 1 or N cameras 493, N being a positive integer greater than 1.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. The NPU can realize applications such as intelligent cognition of electronic equipment, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The internal memory 421 may be used to store computer-executable program code, which includes instructions. The processor 410 executes various functional applications of the electronic device and data processing by executing instructions stored in the internal memory 421. The internal memory 421 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The data storage area can store data (such as audio data, phone book and the like) created in the using process of the electronic device. In addition, the internal memory 421 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

The electronic device may implement audio functions through the audio module 470, the speaker 470A, the receiver 470B, the microphone 470C, the headphone interface 470D, and the application processor. Such as music playing, recording, etc.

Of course, it should be understood that fig. 4 is only an exemplary illustration of the electronic device in the form of a mobile phone. If the electronic device is a tablet computer, a handheld computer, a PC, a PDA, a wearable device (e.g., a smart watch, a smart bracelet), a smart home device (e.g., a smart television), a vehicle machine (e.g., a vehicle-mounted computer), a smart screen, a game machine, an AR/VR device, or other device forms, the structure of the electronic device may include fewer structures than those shown in fig. 4, or may include more structures than those shown in fig. 4, which is not limited herein.

The methods in the following embodiments may be implemented in an electronic device having the above hardware structure. The embodiments of the present application will be described below by way of example with reference to the accompanying drawings.

For example, the electronic device is a mobile phone, the audio devices to be voice-interconnected are two earphones, that is, the first audio device is a first earphone (or called earphone 1), the second audio device is a second earphone (or called earphone 2), and the established link for voice interconnection (e.g., the first link) is an SCO link.

Fig. 5 is a flowchart illustrating a method for voice interworking between audio devices according to an embodiment of the present application. As shown in fig. 5, the method of voice interworking between audio devices may include the following S501-S503.

S501, under the condition that the mobile phone shares audio through the first earphone and the second earphone, the mobile phone determines that a user needs to start a voice intercommunication function.

The mobile phone performs audio sharing through the first earphone and the second earphone, and can be turned on by a user in a manner as shown in fig. 2 or fig. 3. The user may also open the device in other ways, which is not limited herein.

In some possible embodiments, the mobile phone may determine whether the user needs to turn on the voice interworking function according to the user operation by receiving the user operation.

As an example, taking the user to open the audio sharing in the manner shown in fig. 2 as an example, as shown in fig. 6, an option for opening voice intercommunication may be further included in the audio sharing setting interface. After the user starts the audio sharing, the user can start the voice intercommunication function by clicking the voice intercommunication option. When the mobile phone receives an operation that the user clicks the voice intercommunication option, the mobile phone can determine that the user needs to start the voice intercommunication function, and then the mobile phone can start the voice intercommunication function as a response to the operation. It should be noted that, in this example, when the user does not select the option of opening audio sharing shown in (b) in fig. 2 by clicking to open audio sharing, the option of voice interworking shown in fig. 6 is in the off-lock state. That is, the user cannot start the voice intercommunication function without starting audio sharing in the mobile phone. Of course, in other embodiments of the present application, the user may also turn on the voice interworking function in the manner shown in fig. 6 without turning on audio sharing in the mobile phone, which is not limited herein.

As another example, after the user turns on the audio sharing (e.g., turns on the audio sharing in the manner shown in fig. 2 or fig. 3), the handset may ask the user whether to turn on the voice interworking function in a pop-up window manner. And then determining whether the user needs to start the voice intercommunication function according to the corresponding operation of the user. For example, as shown in fig. 7, after the user starts audio sharing, the mobile phone may pop up a popup asking whether to start the voice interworking function. Two option controls, "yes" and "no" may be provided in the pop-up window. The user may or may not turn on the voice interworking function by clicking the yes or no option. When the mobile phone receives the operation that the user clicks the 'yes' or 'no' option, the mobile phone can determine whether the user needs to start the voice intercommunication function. If the mobile phone receives the operation of the user to the 'yes' option, the mobile phone can start the voice intercommunication function as a response. If the mobile phone receives the operation of the user on the "no" option, the mobile phone may not turn on the voice interworking function in response.

When the mobile phone determines that the user needs to start the voice intercommunication function, for example, the mobile phone receives an operation of the user to start the voice intercommunication function. Then, the handset may perform the following S502. It should be noted that in some other embodiments, the handset may also be turned on by default without determining whether the user needs to turn on the voice interworking function. If so, the following S502 is executed.

S502, the mobile phone establishes SCO links with the first earphone and the second earphone respectively.

In some possible embodiments, the mobile phone may send a request for establishing an SCO link to the first headset and the second headset, respectively, and after the first headset and the second headset receive the request, the mobile phone can establish an SCO link with the mobile phone, respectively. Optionally, after the first and second headsets establish the SCO link with the mobile phone, respectively, a response that the SCO link is established successfully may also be sent to the mobile phone.

It should be noted that, when the mobile phone uses the bluetooth connection to perform audio sharing through the first earphone and the second earphone, the mobile phone is usually paired with the first earphone and the second earphone, and therefore, the mobile phone may not be paired with the earphone any longer before the mobile phone establishes the SCO link with the first earphone and the second earphone. Of course, if the mobile phone performs audio sharing through the first earphone and the second earphone, not through bluetooth connection, but through other connection manners, before the mobile phone establishes an SCO link with the first earphone and the second earphone, the mobile phone may be paired with the first earphone and the second earphone, respectively.

Wherein, the first earphone and the second earphone can both support hands-free profile (HFP). After the mobile phone establishes a link for voice intercommunication with the first earphone and the second earphone respectively, the mobile phone can forward voice data between the first earphone and the second earphone through the link. For example, the handset may perform the following S503.

S503, the mobile phone forwards the voice data between the first earphone and the second earphone.

In some possible embodiments, the handset may decode, route, encode and forward voice data between the first headset and the second headset. Or the voice data between the first earphone and the second earphone can be directly transmitted, namely, the mobile phone only forwards the voice data without processing the voice data.

Exemplarily, the handset forwards the voice data of the first earphone to the second earphone. The handset forwards voice data between the first headset and the second headset may refer to fig. 8. As shown in fig. 8, the handset 810 has an SCO link established with the first earpiece 821 and the second earpiece 822, respectively. When the first user 831 wearing the first earphone 821 speaks (e.g., the first user 831 speaks "hello" to the second user 832), the microphone of the first earphone 821 may receive the voice of the first user 831 and convert the voice into voice data, then the first earphone 821 may transmit the voice data to the mobile phone 810 through the SCO link, the mobile phone 810 may forward the voice data to the second earphone 822 after receiving the voice data, and finally the second earphone 822 receiving the voice data may convert the voice data into voice through the speaker and play the voice data to the second user 832. Thereby enabling the second user 832 to hear the words spoken by the first user 831 through the second earpiece 822, and improving the effect of voice communication between the first user 831 and the second user 832.

If the earphones (such as the first earphone and the second earphone) are TWS earphones, the voice can be collected by a microphone of the left earphone or the right earphone of the earphones, or the voice can be collected by a microphone of the left earphone and a microphone of the right earphone at the same time.

Continuing to use the electronic device as a mobile phone, the audio devices to be voice-interconnected are two earphones, that is, the first audio device is a first earphone (or called earphone 1), the second audio device is a second earphone (or called earphone 2), and the established link for voice interconnection (e.g., the first link) is an SCO link. The embodiment of the application can also establish a link between the first earphone and the second earphone, so that voice data can be directly transmitted between the first earphone and the second earphone through the established link.

For example, fig. 9 is a flowchart illustrating another method for voice interworking between audio devices according to an embodiment of the present application. As shown in fig. 9, the method of voice interworking between audio devices may include the following S901-S905.

And S901, the mobile phone carries out audio sharing through the first earphone and the second earphone.

The handset performs audio sharing through the first earphone and the second earphone, and can be turned on by the user in a manner as shown in fig. 2 or fig. 3. The user may also open the device in other ways, which is not limited herein.

When the mobile phone performs audio sharing through the first earphone and the second earphone, the mobile phone may send device information of the other earphone to one of the two earphones. For example, the handset may perform the following S902.

S902, the handset sends the audio sharing status information and device information (e.g., Media Access Control (MAC) address) of the other headset, e.g., the second headset, to the master headset, e.g., the first headset. That is, the handset sends configuration information to the primary earpiece, the configuration information including audio sharing status information and device information of the other earpieces.

It should be noted that, in a plurality of headsets that need to perform voice intercommunication, a main headset may be defined according to actual needs, and this is not limited here. For example, when the mobile phone is connected to share audio, the earphone connected to the mobile phone first may be used as the master earphone. In this embodiment, the first earphone will be exemplified as the main earphone.

As an example, the handset may send audio sharing status information and device information of other headphones to the master headphone over the link established for audio sharing. Of course, the mobile phone may also send the audio sharing information and the device information of other earphones to the main earphone through other forms such as broadcasting, which is not limited herein.

The audio sharing state information may be indication information capable of indicating that the mobile phone is in an audio sharing state. The mobile phone sends the audio sharing state information to the first earphone serving as the main earphone, so that the first earphone can determine that the mobile phone is in the audio sharing state at present according to the audio sharing state information. And the equipment information of other earphones, which is sent to the first earphone by the mobile phone, can be convenient for the first earphone to establish connection with other earphones subsequently according to the equipment information.

When the master earphone, e.g., the first earphone, receives the audio sharing state information and the device information of the other earphones, the master earphone may perform the following S903.

S903, the first earphone determines that the user needs to start the voice intercommunication function.

In some possible embodiments, the first earphone may prompt the user whether to start the voice interworking function by outputting the prompt message, then receive an operation of the user, and determine whether the user needs to start the voice interworking function according to the operation of the user.

For example, the first headset may play a prompt message "whether to turn on the voice interworking function" to the user in voice form. At this time, the user may determine that the voice interworking function needs to be started by pressing an entity key (e.g., a function key) on the first headset, touching a touch area on the first headset, tapping the first headset, and other operation manners. When the first earphone receives the operations of pressing the entity key, touching the touch area, knocking the earphone and the like, the fact that the user needs to start the voice intercommunication function can be determined.

When the first earphone (i.e., the master earphone) determines that the user needs to start the voice interworking function, for example, when the first earphone receives a corresponding operation performed by the user for the above prompt information, the first earphone may perform the following S904.

S904, the first earphone and the second earphone establish an SCO link.

In some possible embodiments, the first headset may be paired with the second headset before establishing the SCO link with the second headset after the pairing is completed. For example, the first earphone may first send a pairing request to the second earphone according to the received device information sent by the mobile phone, and the second earphone may prompt the user to perform pairing after receiving the pairing request (e.g., prompt in a manner of voice, vibration, etc.). The user can confirm pairing with the first earphone by pressing the entity key on the second earphone, touching the touch area on the second earphone, knocking the second earphone and the like. In response to the user, the second headset may complete pairing with the first headset according to the pairing request. When the first earphone and the second earphone are successfully paired, the first earphone can send a request for establishing an SCO link to the second earphone, and when the second earphone receives the request, the second earphone can establish the SCO link with the first earphone. Optionally, after the first headset and the second headset establish the SCO link, the second headset may further send a response that the SCO link establishment is successful to the first headset. It should be noted that, when the second headset does not confirm the pairing with the first headset or does not support the pairing with the first headset, the first headset may unpair and turn off the voice interworking function.

Optionally, before the first headset establishes the SCO link with the second headset, the first headset may further send an indication message (e.g., a first indication) to the electronic device to instruct the electronic device to pause sending audio data to the first headset and the second headset, i.e., instruct the electronic device to pause playing audio. Therefore, the first earphone and the second earphone are not interfered by audio data sent by the electronic equipment when audio is shared during voice intercommunication, and the voice intercommunication quality of the first earphone and the second earphone is improved.

Wherein, the first earphone and the second earphone can both support hands-free profile (HFP). After the first earphone and the second earphone establish a link for voice intercommunication, the first earphone and the second earphone can transmit voice data through the link. As such, the following S905 may be performed.

And S905, transmitting voice data between the first earphone and the second earphone through the SCO link.

Exemplarily, voice data of the first headset (i.e., the first voice data) is transmitted to the second headset. The transmission of voice data between the first headset and the second headset over the SCO link may be referred to fig. 10. As shown in fig. 10, an SCO link is established between the first earpiece 1011 and the second earpiece 1012. When the first user 1021 wearing the first earphone 1011 speaks (e.g., the first user 1021 speaks "hello" to the second user 1022), the microphone of the first earphone 1011 can receive the voice spoken by the first user 1021 and convert it into voice data, then the first earphone 1011 can send the voice data to the second earphone 1012 through the SCO link, and finally the second earphone 1012 receiving the voice data can convert the voice data into voice through the speaker and play it to the second user 1022. Thereby enabling the second user 1022 to hear the words spoken by the first user 1021 through the second earpiece 1012, enhancing the effect of voice communication between the first user 1021 and the second user 1022. When the voice data of the second earphone (i.e. the second voice data) is transmitted to the first earphone, the process is similar to the above process, and is not described herein again.

In this embodiment, S901 in the method shown in fig. 9 may be replaced by S501 in the method shown in fig. 5, and accordingly, S903 does not need to be executed. Therefore, the user determines whether to start the voice intercommunication function through the mobile phone, and the method is relatively convenient and quick.

For example, an electronic device is taken as a mobile phone, an audio device to be voice-intercommunicated is taken as two headsets, namely a first headset (or referred to as headset 1) and a second headset (or referred to as headset 2), and an established link (e.g., a first link) for voice intercommunicating is taken as a dedicated link established based on 2.4G wireless technology and the like. The embodiment of the application can also establish a dedicated link between the first earphone and the second earphone, so that voice data can be directly transmitted between the first earphone and the second earphone through the established dedicated link. An implementation manner of this embodiment may be similar to the method shown in fig. 9, and details of the same parts are not repeated here, and reference may be made to the detailed description of the method shown in fig. 9. The difference is that the link established between the first and second headsets is the dedicated link described above. Accordingly, voice data is transmitted between the first earphone and the second earphone through the dedicated link. As another embodiment, the handset may also not send the device information of the second headset to the first headset, and the first headset may negotiate the configuration information required by the dedicated link in a broadcast manner, and then establish the dedicated link for voice interworking. There is no restriction on how the link is established between the first and second headsets.

Taking an electronic device as a mobile phone, the audio devices to be voice-intercommunicated are three earphones, that is, the first audio device is a first earphone (or called earphone 1), the second audio device is a second earphone (or called earphone 2) and a third earphone (or called earphone 3), and the established link for voice intercommunicating (for example, the first link) is CIS.

Fig. 11 is a flowchart illustrating another method for voice interworking between audio devices according to an embodiment of the present application. As shown in fig. 11, the method of voice interworking between audio devices may include the following S1101-S1103.

S1101, under the condition that the mobile phone carries out audio sharing through the first earphone, the second earphone and the third earphone, it is determined that a user needs to start a voice intercommunication function.

It should be noted that the specific implementation of this step is similar to S501 in the method shown in fig. 5, and reference may be made to the related description of S501, which is not repeated herein.

S1102, the mobile phone, the first earphone, the second earphone, and the third earphone establish a Connected Isochronous Group (CIG) through the CIS (the CIG is created by a host (Master) and includes 1 or more CIS).

In some possible embodiments, the mobile phone may send a request for establishing a CIS to the first earphone, the second earphone, and the third earphone, respectively, and after the first earphone, the second earphone, and the third earphone receive the request, the CIS may be established with the mobile phone, respectively, so that the mobile phone, the first earphone, the second earphone, and the third earphone form a CIG. Optionally, after the first earphone, the second earphone, and the third earphone respectively establish CIS with the mobile phone, a response that the CIS is successfully established may be sent to the mobile phone.

S1103, the mobile phone schedules the first earphone, the second earphone and the third earphone to synchronize voice data through the established CIG.

In some possible embodiments, the first headset, the second headset, and the third headset may be scheduled to synchronize voice data through the established CIG with the handset as the host. The CIG is dispatched through the mobile phone, so that voice data among the first earphone, the second earphone and the third earphone are mutually synchronous.

Exemplarily, the voice data of the first earphone is synchronized to the second earphone and the third earphone. The first earphone, the second earphone, and the third earphone synchronize voice data through the established CIG as can be seen from fig. 12. As shown in fig. 12, the handset 1210 establishes a CIG with a first earpiece 1221, a second earpiece 1222, and a third earpiece 1223. When the first user 1231 wearing the first earphone 1221 speaks (e.g., the first user 1231 speaks "hello" to the second user 1232 and the third user 1233), the microphone of the first earphone 1221 may receive the voice of the first user 1231 and convert the voice into voice data, and then the cellular phone 1210 may synchronize the voice data of the first earphone 1221 to the second earphone 1222 and the third earphone 1223 by scheduling the CIG, and finally the second earphone 1222 and the third earphone 1223 receiving the voice data may convert the voice data into voice through their respective speakers and play the voice to the second user 1232 and the third user 1233, respectively. Thereby enabling the second and

third users

1232 and 1233 to hear the words spoken by the first user 1231 through the second and

third earphones

1222 and 1223 worn by themselves, and improving the effect of voice communication between the first and

second users

1231 and 1232 and the third user 1233.

If the earphones (such as the first earphone and the second earphone) are TWS earphones, the voices can be collected by the microphone of the left earphone or the microphone of the right earphone of the earphones, or the voices can be collected by the microphone of the left earphone and the microphone of the right earphone at the same time.

It should be noted that, in the embodiment of the present application, the method shown in fig. 5 and the method shown in fig. 11 may also be combined with each other. That is, when the mobile phone is connected with multiple earphones for audio sharing, if it is determined that the user needs to start the voice interworking function, the mobile phone may establish an SCO link with a part of the earphones, establish a CIG with another part of the earphones through a CIS, and synchronize voice data between the earphones in which the SCO link is established and the earphones in which the CIG is established in another part of the earphones through forwarding and scheduling the CIG, so as to implement voice interworking between the earphones. Specifically, which earphones establish an SCO link with the mobile phone and which earphones establish a CIG with the mobile phone may be defined according to actual needs, and no limitation is made here. For example, a handset establishes a CIG with a Bluetooth 5.2 enabled headset via the CIS and an SCO link with other headsets.

Continuing to use the electronic device as a mobile phone, the audio devices to be voice-interconnected are three earphones, that is, the first audio device is a first earphone (or called earphone 1), the second audio device is a second earphone (or called earphone 2) and a third earphone (or called earphone 3), and the established link for voice interconnection (e.g., the first link) is CIS. In the embodiment of the present application, links for voice interworking may be further established between the respective audio devices, such as the first headset, the second headset and the third headset, so as to synchronize voice data with each other.

For example, fig. 13 is a flowchart illustrating another method for voice interworking between audio devices according to an embodiment of the present application. As shown in fig. 13, the method of voice interworking between audio devices may include the following S1301-S1305.

And S1301, the mobile phone carries out audio sharing through the first earphone, the second earphone and the third earphone.

S1302, the handset transmits audio sharing status information and device information (e.g., Media Access Control (MAC) addresses) of other headsets, e.g., a second headset and a third headset, to a master headset, e.g., the first headset. That is, the handset sends configuration information to the primary earpiece, the configuration information including audio sharing status information and device information of the other earpieces.

S1303, the first earphone determines that the user needs to start the voice intercommunication function.

It should be noted that the specific implementation of steps S1301 to S1303 is similar to that of steps S901 to S903 in the method shown in fig. 9, and reference may be made to the related descriptions of steps S901 to S903, which are not repeated herein.

And S1304, establishing a CIG by the first earphone, the second earphone and the third earphone through a CIS.

In some possible embodiments, the first earphone may be paired with the second earphone and the third earphone, and then the CIG may be established with the second earphone and the third earphone after the pairing is completed. For example, the first earphone may first send a pairing request to the second earphone and the third earphone according to the received device information sent by the mobile phone, and after receiving the pairing request, the second earphone and the third earphone may prompt the user to perform pairing (e.g., prompt in a manner of voice, vibration, etc.). The user can confirm to pair with the first earphone by pressing the entity keys on the second earphone and the third earphone, touching the touch areas on the second earphone and the third earphone, knocking the second earphone and the third earphone, and the like. In response to the user's actions, the second earphone and the third earphone may be paired with the first earphone according to the pairing request. When the first earphone is successfully paired with the second earphone and the third earphone, the first earphone can respectively send a request for establishing a CIS to the second earphone and the third earphone, and when the second earphone and the third earphone respectively receive the request, the first earphone and the second earphone and the third earphone can respectively establish the CIS, so that the first earphone, the second earphone and the third earphone form a CIG (wherein the first earphone serves as a host). Optionally, after the second and third headsets establish CIS with the first headset, respectively, a response that the CIS is successfully established may be sent to the first headset. It should be noted that, when the second headset and/or the third headset do not confirm the pairing with the first headset or do not support the pairing with the first headset, the first headset may unpair and turn off the voice interworking function.

And S1305, the first earphone schedules the first earphone, the second earphone and the third earphone to synchronize voice data through the established CIG.

In some possible embodiments, with the first headset as the master, the first headset, the second headset, and the third headset may be scheduled to synchronize voice data through the established CIG. The CIG is dispatched through the first earphone, so that voice data among the first earphone, the second earphone and the third earphone are mutually synchronous.

Exemplarily, the voice data of the first earphone is synchronized to the second earphone and the third earphone. The first earphone, the second earphone, and the third earphone synchronize voice data through the established CIG as may be referred to fig. 14. As shown in fig. 14, the first earphone 1411, the second earphone 1412, and the third earphone 1413 establish a CIG. When the first user 1421 wearing the first earphone 1411 speaks (e.g., the first user 1421 speaks "hello" to the second user 1422 and the third user 1423), the microphone of the first earphone 1411 may receive the voice spoken by the first user 1421 and convert the voice into voice data, then the first earphone 1411 may synchronize the voice data of the first earphone 1411 to the second earphone 1412 and the third earphone 1413 by scheduling the CIG, and finally the second earphone 1412 and the third earphone 1413 receiving the voice data may convert the voice data into voice through their respective speakers and play the voice to the second user 1422 and the third user 1423, respectively. Thereby enabling the second and

third users

1422 and 1423 to hear the words spoken by the first user 1421 through the second and

third earphones

1412 and 1413 worn by themselves, and improving the effect of voice communication between the first and

second users

1421 and 1422 and the third user 1423.

In this embodiment, S1301 in the method shown in fig. 13 may be replaced with S1101 in the method shown in fig. 11, and accordingly, S1303 does not need to be executed. Therefore, the user can determine whether to start the voice intercommunication function through the mobile phone, and the method is relatively convenient and quick.

It should be noted that, in the above embodiments, when the electronic device (e.g., a mobile phone) forwards or schedules the voice data between the audio devices (e.g., earphones), the speaker of the electronic device may also convert the voice data into sound to be played, so as to broadcast the voice of the speaking user through the electronic device. For example, taking the scenario shown in fig. 8 as an example, as shown in fig. 15, when the first user 1511 speaks, an indicative utterance such as "broadcast" may be added before the content to be spoken (e.g., the first user 1511 speaks "broadcast, hello"), so that when the first earphone 1521 sends voice data to the mobile phone 1530, the mobile phone 1530 may perform decoding recognition, and when the utterance is recognized when there is an indication such as "broadcast" in the voice data, the mobile phone 1530 may also play the word spoken by the user, e.g., "hello", through its own speaker when forwarding the voice data to the second earphone 1522. For another example, based on the above example, the handset may also be set to broadcast the voice of the speaking user by default. That is, the user does not need to add an indicative word such as "broadcast" to the content to be spoken, and the handset can also broadcast the speech spoken by the user, which is not limited herein.

It should be noted that, in the above embodiment, if the earphones (e.g., the first earphone and the second earphone) are TWS earphones, a link (e.g., SCO link or CIS) established between the handset and the earphones for voice interworking, or a link (e.g., SCO link or CIS) established between the earphone serving as the master device and the other earphones for voice interworking may be established with only one of the TWS earphones.

In other embodiments of the present application, the electronic device may also be connected to multiple audio devices to implement voice intercommunication without audio sharing. The specific implementation is similar to the above embodiment, except that the electronic device does not need to determine whether the user needs to turn on voice interworking in case of audio sharing. That is, as long as the electronic device determines that the user needs to start voice intercommunication, the electronic device can establish a link (e.g., a first link) for voice intercommunication with each audio device, so as to forward or synchronize voice data transmitted between each audio device through the mobile phone, thereby implementing voice intercommunication between audio devices. Or the electronic equipment sends the equipment information of other audio equipment to one of the audio equipment, and then the audio equipment establishes a link for voice intercommunication with the other audio equipment according to the equipment information, thereby realizing the voice intercommunication among the audio equipment. Therefore, the user can carry out voice call through the plurality of audio devices connected with the electronic device, and the user can conveniently communicate with each other.

As an example, the electronic device is a mobile phone, and the audio device is two speakers. The mobile phone can be respectively connected with the sound box of the living room and the sound box of the bedroom through the mobile phone, and voice intercommunication is carried out, so that a first user in the living room can conveniently carry out voice communication with a second user in the bedroom through the voice intercommunication between the sound box of the living room and the sound box of the bedroom. For example, as shown in fig. 16, when the user needs to perform voice intercommunication, the system setting of the mobile phone may be opened for operation. As shown in fig. 16 (a), the bluetooth setup interface of the mobile phone may include setup options for turning on bluetooth, audio sharing, and voice intercommunication, and a device list including devices that have been paired with the mobile phone (e.g., the headset 1, the headset 2, the speaker in the living room, the speaker in the bedroom, etc.). The user may select (e.g., click, etc. a selection operation) the voice interworking option in the bluetooth setup interface when the bluetooth function is turned on to open voice interworking. As shown in fig. 16 (b), after the user opens the voice intercommunication, the user may select the loudspeaker box in the living room and the loudspeaker box in the bedroom that have already been paired with the mobile phone, and as a response to the above operation by the user, the mobile phone may be connected to the loudspeaker box in the living room and the loudspeaker box in the bedroom, respectively (e.g., an SCO link is established, etc.), so as to open the voice intercommunication function, so that the mobile phone forwards the voice data between the two loudspeaker boxes to implement the voice intercommunication.

As another example, the electronic device is a mobile phone, and the audio devices are two earphones, namely an earphone 1 and an earphone 2. Can be connected with earphone 1 and earphone 2 respectively through the cell-phone to pronunciation intercommunication is carried out, so that the first user who wears earphone 1 and the second user who wears earphone 2, can be convenient carry out pronunciation through earphone 1 and earphone 2 and exchange. For example, as shown in fig. 17, when the user needs to perform voice intercommunication, the operation can be performed in the multimedia notification interface in the pull-down notification of the mobile phone. As shown in (a) of fig. 17, when the handset has connected the headset 1, the user can click on an icon showing more options in the multimedia notification interface in the pull-down notification to select more options on multimedia. Thereafter, as shown in (b) of fig. 17, the user may select a voice interworking option to perform voice interworking. When the user selects voice interworking, the handset may detect an audio device (e.g., a headset) in proximity thereto in response to these operations. As shown in (c) of fig. 17, when the earphone 21701 approaches the mobile phone, the mobile phone detects that the earphone 21701 approaches, and can pop up the pop-up box prompt 1702 which prompts the user to connect the earphone 21701 for voice intercommunication, and the user can click the voice intercommunication in the pop-up box prompt 1702 to connect the mobile phone with the earphone 21701 in response to the above operation, so as to open the voice intercommunication function, and enable the mobile phone to forward voice data between the earphone 1 and the earphone 21701 for voice intercommunication. By this example, if both users wearing the headphones 1 and 2 have hearing impairment, the two users can hear the words spoken by the other party more clearly by using the voice intercommunication between the headphones 1 and 2, and thus the communication is more convenient.

By adopting the method in the embodiment, the user can communicate by utilizing the voice intercommunication among a plurality of audio devices, and the convenience of the voice communication of the user is improved.

Corresponding to the method in the foregoing embodiment, the embodiment of the present application further provides a voice interworking system. The voice interworking system may include an electronic device, a first audio device, and a second audio device. The electronic equipment can be used for being connected with the first audio equipment through a first asynchronous connection-free (ACL) link; sending audio data to a first audio device through a first ACL link; receiving the operation of starting the audio sharing function by a user; detecting an audio device in proximity to the electronic device; detecting that a second audio device establishes a second ACL link with the second audio device; sending audio data to the second audio device over the second ACL link; sending audio sharing state information and equipment information of second audio equipment to first audio equipment through a first ACL link; the audio sharing state information is used for indicating that the electronic equipment is in a state of audio sharing between the first audio equipment and the second audio equipment; receiving a first indication from a first audio device, and suspending transmission of audio data to the first audio device and a second audio device according to the first indication;

the first audio equipment can be used for receiving audio data and playing audio through a loudspeaker of the first audio equipment according to the audio data; outputting prompt information for prompting a user whether to start a voice intercommunication function; receiving the operation that a user determines to start a voice intercommunication function; sending a first indication to the electronic device; establishing a first link with a second audio device according to the device information; receiving voice of a user through a microphone of first audio equipment, generating first voice data, and sending the first voice data to second audio equipment; or receiving second voice data from second audio equipment, and playing voice through a loudspeaker of the first audio equipment according to the second voice data;

In a possible design, the first audio device is specifically configured to receive an operation of a user on a function key on the first audio device; or the first audio equipment receives the operation of the user on the touch area on the first audio equipment; or the first audio equipment receives the tapping operation of the first audio equipment by the user.

In another possible design, the first link is a Synchronous Connection Oriented (SCO) link.

In another possible design, the first link is an isochronous connection stream (CIS) link.

In another possible design, the electronic device is a mobile phone, and the first audio device and the second audio device are both true wireless stereo TWS headphones.

In another possible design, the electronic device transmits the audio data using a bluetooth stereo audio transport protocol (A2 DP).

In another possible design, the electronic device is specifically configured to receive a click operation of a user on an audio sharing option displayed by the electronic device.

In another possible design, the electronic device is further configured to display a pop-up prompt, where the pop-up prompt is used to prompt the user that the second audio device may be connected for audio sharing.

In another possible design, the first audio device is specifically configured to play, through a speaker of the first audio device, a voice that prompts a user whether to start a voice interworking function.

Other embodiments of the present application provide an electronic device, which may include: a memory and one or more processors. The memory is coupled to the processor. The memory is for storing computer program code comprising computer instructions. When the processor executes the computer instructions, the electronic device may perform the various functions or steps performed by the electronic device in the above-described method embodiments. Of course, the electronic device includes, but is not limited to, the above-described memory and one or more processors. For example, the structure of the electronic device may refer to the structure of the electronic device shown in fig. 8.

Other embodiments of the present application provide an audio device, which may include: a processor, a memory for storing instructions executable by the processor. When the processor executes the computer instructions, the audio device may perform the respective functions or steps performed by the first audio device or the second audio device in the above-described method embodiments.

The embodiment of the present application further provides a computer-readable storage medium, which is used for storing the computer instructions executed by the electronic device, the first audio device, or the second audio device.

An embodiment of the present application further provides a computer program product, which includes computer instructions for operating the electronic device, the first audio device, or the second audio device.

Through the description of the above embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical functional division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another device, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, that is, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or partially contributed to by the prior art, or all or part of the technical solutions may be embodied in the form of a software product, where the software product is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for voice intercommunication among audio devices is applied to a voice intercommunication system, wherein the voice intercommunication system comprises an electronic device, a first audio device and a second audio device, and the method comprises the following steps:

the electronic equipment is connected with the first audio equipment through a first asynchronous connectionless ACL link;

the electronic equipment sends audio data to the first audio equipment through the first ACL link;

the first audio equipment receives the audio data and plays audio through a loudspeaker of the first audio equipment according to the audio data;

the electronic equipment receives the operation of starting the audio sharing function by a user;

in response to the operation of starting the audio sharing function, the electronic equipment detects an audio device close to the electronic equipment;

the electronic device detects the second audio device;

the electronic equipment establishes a second ACL link with the second audio equipment;

the electronic device sends the audio data to the second audio device through the second ACL link;

the second audio equipment receives the audio data and plays the audio through a loudspeaker of the second audio equipment according to the audio data;

the electronic equipment sends audio sharing state information and equipment information of the second audio equipment to the first audio equipment through the first ACL link; the audio sharing state information is used for indicating that the electronic equipment is in a state of audio sharing between the first audio equipment and the second audio equipment;

the first audio equipment outputs prompt information for prompting a user whether to start a voice intercommunication function;

the first audio equipment receives an operation that a user determines to start a voice intercommunication function;

in response to the operation of determining to start the voice intercommunication function, the first audio device sending a first indication to the electronic device, wherein the first indication is used for indicating the electronic device to suspend sending the audio data to the first audio device and the second audio device;

the electronic device suspends sending the audio data to the first audio device and the second audio device according to the first indication;

the first audio equipment establishes a first link with the second audio equipment according to the equipment information;

the first audio equipment receives voice of a user through a microphone of the first audio equipment, generates first voice data and sends the first voice data to the second audio equipment;

the second audio equipment plays voice through a loudspeaker of the second audio equipment according to the first voice data;

alternatively, the first and second electrodes may be,

the second audio equipment receives the voice of a user through a microphone of the second audio equipment, generates second voice data and sends the second voice data to the first audio equipment;

and the first audio equipment plays voice through a loudspeaker of the first audio equipment according to the second voice data.

2. The method of claim 1, wherein the first audio device receiving a user determination to turn on a voice interworking function comprises:

the first audio equipment receives operation of a user on a function key on the first audio equipment;

or the first audio equipment receives the operation of a user on a touch area on the first audio equipment;

or the first audio equipment receives the tapping operation of the first audio equipment by the user.

3. The method of claim 1, wherein the first link is a synchronous connection oriented SCO link.

4. The method of claim 1, wherein the first link is an isochronous connection stream (CIS) link.

5. The method of any of claims 1-4, wherein the electronic device is a cell phone and the first audio device and the second audio device are both true wireless stereo TWS headphones.

6. The method of claim 1, wherein the electronic device transmits the audio data using a bluetooth stereo audio transport protocol A2 DP.

7. The method of claim 1, wherein the electronic device receives an operation of a user to turn on an audio sharing function, and the operation comprises:

the electronic equipment receives click operation of a user on the audio sharing options displayed by the electronic equipment.

8. The method of claim 1, wherein after the electronic device detects the second audio device, the method further comprises:

the electronic equipment displays a pop-up box prompt which is used for prompting that a user can connect the second audio equipment for audio sharing.

9. The method of claim 1, wherein the first audio device outputting a prompt for prompting a user whether to turn on a voice interworking function comprises:

and the first audio equipment plays voice prompting whether the user starts a voice intercommunication function or not through a loudspeaker of the first audio equipment.

10. A voice intercommunication system is characterized by comprising electronic equipment, first audio equipment and second audio equipment;

the electronic equipment is used for being connected with the first audio equipment through a first asynchronous connectionless ACL link; sending audio data to the first audio device over the first ACL link; receiving the operation of starting the audio sharing function by a user; detecting an audio device in proximity to the electronic device; detecting that the second audio device establishes a second ACL link with the second audio device; transmitting the audio data to the second audio device over the second ACL link; transmitting audio sharing status information and device information of the second audio device to the first audio device through the first ACL link; the audio sharing state information is used for indicating that the electronic equipment is in a state of audio sharing between the first audio equipment and the second audio equipment; receiving a first indication from a first audio device, suspending transmission of the audio data to the first audio device and the second audio device in accordance with the first indication;

the first audio equipment is used for receiving the audio data and playing audio through a loudspeaker of the first audio equipment according to the audio data; outputting prompt information for prompting a user whether to start a voice intercommunication function; receiving the operation that a user determines to start a voice intercommunication function; sending the first indication to the electronic device; establishing a first link with the second audio device according to the device information; receiving voice of a user through a microphone of the first audio equipment, generating first voice data, and sending the first voice data to the second audio equipment; or receiving second voice data from the second audio equipment, and playing voice through a loudspeaker of the first audio equipment according to the second voice data;

the second audio device is configured to receive the audio data, and play the audio through a speaker of the second audio device according to the audio data; receiving the first voice data from the first audio equipment, and playing voice through a loudspeaker of the second audio equipment according to the first voice data; or receiving the voice of the user through a microphone of the second audio equipment, generating second voice data, and sending the second voice data to the first audio equipment.

11. The voice interworking system of claim 10, wherein the first audio device is specifically configured to receive an operation of a function key on the first audio device by a user; or the first audio equipment receives the operation of a user on a touch area on the first audio equipment; or the first audio equipment receives the tapping operation of the first audio equipment by the user.

12. The voice interworking system of claim 10, wherein the first link is a synchronous connection oriented SCO link.

13. The voice interworking system of claim 10, wherein the first link is an isochronous connection stream (CIS) link.

14. The voice interworking system of any one of claims 10-13, wherein the electronic device is a cellular phone and the first audio device and the second audio device are both true wireless stereo TWS headsets.

15. The voice interworking system of claim 10, wherein the electronic device employs bluetooth stereo audio transport protocol A2DP to transmit the audio data.

16. The voice interworking system of claim 10, wherein the electronic device is specifically configured to receive a click operation of a user on an audio sharing option displayed by the electronic device.

17. The voice interworking system of claim 10, wherein the electronic device is further configured to display a pop-up prompt, and the pop-up prompt is configured to prompt a user to connect the second audio device for audio sharing.

18. The voice interworking system of claim 10, wherein the first audio device is specifically configured to play a voice prompting a user whether to start a voice interworking function through a speaker of the first audio device.