WO2024067432A1

WO2024067432A1 - Audio transmission method and system, and related apparatus

Info

Publication number: WO2024067432A1
Application number: PCT/CN2023/120907
Authority: WO
Inventors: 陈永; 孙强; 尤君
Original assignee: 华为技术有限公司
Priority date: 2022-09-30
Filing date: 2023-09-23
Publication date: 2024-04-04
Also published as: CN117857963A

Abstract

An audio transmission method and system, and a related apparatus. In the method, when audios of two applications are simultaneously played in an electronic device, the electronic device needs to choose to send, according to the states and orientations of windows of the two applications and the orientations of earphones, audio data of one of the two applications to an earphone 200 having the same orientation as the window of the application, and to send the audio data of the other application to an earphone 300 having the same orientation as the window of the application. By means of implementing the technical solution provided in the present application, a user wearing different earphones can listen to audio data of different applications in an electronic device.

Description

AUDIO TRANSMISSION METHOD, SYSTEM AND RELATED DEVICE

This application claims the priority of the Chinese patent application filed with the China Patent Office on September 30, 2022, with application number 202211207452.8 and application name “A method, system and related device for audio transmission”, the entire contents of which are incorporated by reference in this application.

Technical Field

The present application relates to the technical field of terminals and audio transmission, and in particular to an audio transmission method, system and related devices.

Background technique

Currently, users can listen to audio played in electronic devices such as mobile phones, tablets, and computers through audio devices (for example, Bluetooth headsets). With the development of electronic devices, some electronic devices can already support the connection of multiple pairs of wireless headsets. In this way, multiple users can listen to the audio played in the same electronic device at the same time through multiple pairs of wireless headsets. However, multiple users can only listen to the same audio played in the same electronic device. Multiple users cannot listen to different audio in the same electronic device through multiple pairs of wireless headsets.

Therefore, how multiple users can listen to different audios from the same electronic device through multiple pairs of wireless headphones is an urgent problem to be solved.

Summary of the invention

The present application provides an audio transmission method, system and related devices, through which multiple users can listen to different audios in the same electronic device through multiple pairs of wireless headphones.

In a first aspect, the present application provides an audio transmission method, which may include: an electronic device establishing a connection with a first audio device and a second audio device; the electronic device displays a first window and a second window on a display screen, wherein the first window is an application window of a first application, and the first window plays first audio data, and the second window is an application window of a second application, and the second window plays second audio data; the electronic device sends the first audio data to the first audio device and sends the second audio data to the second audio device according to the status of the first window and the second window on the display screen, and the orientation of the first audio device and the orientation of the second audio device.

In some possible examples, the first audio device and the second audio device may be wireless headphones.

In some feasible examples, the orientation of the first audio device and the orientation of the second audio device may be specific orientations (eg, azimuth angles) or relative orientations.

In some feasible examples, the first application and the second application are applications that can play audio. For example, the first application can be any one of an audio playback application, a video playback application, a call application, an instant messaging application, and a browser application. The second application can also be any one of an audio playback application, a video playback application, a call application, an instant messaging application, and a browser application.

In some feasible examples, the electronic device may be a tablet, a mobile phone, a computer, a notebook, or the like, which has a display screen and can play audio.

In this way, the user of the first audio device and the user of the second audio device can listen to different audio data.

In combination with the first aspect, in a possible implementation method, the state of the first window on the display screen includes the display mode of the first window and/or the position of the first window on the display screen; the state of the second window on the display screen includes the display mode of the second window and/or the position of the second window on the display screen; wherein the display mode includes full-screen display, floating display, and split-screen display.

In some feasible examples, floating display and split-screen display may also be referred to as small window display.

In combination with the first aspect, in a possible implementation method, the display mode of the first window is full-screen display, and the display mode of the second window is floating display. The electronic device sends the first audio data to the first audio device and sends the second audio data to the second audio device according to the status of the first window and the second window on the display screen, and the orientation of the first audio device and the orientation of the second audio device. Specifically, the electronic device sends the second audio data to the second audio device according to the position of the second window on the display screen and the orientations of the first audio device and the second audio device, wherein the position of the second window on the display screen matches the position of the second audio device relative to the first audio device, and the position of the second audio device relative to the first audio device is determined by the orientation of the first audio device and the orientation of the second audio device.

In this way, the user of the second audio device can listen to the audio data played by the application window that matches the relative position of the second audio device. When the relative position of the second audio device matches the position of the application window on the display screen, it is convenient for the user of the second audio device to watch and listen to the content played by the application window.

In combination with the first aspect, in a possible implementation method, the display mode of the first window and the second window is split-screen display, or the display mode of the first window and the second window is suspended display, and the electronic device sends the first audio data to the first audio device and sends the second audio data to the second audio device according to the status of the first window and the second window on the display screen, and the orientation of the first audio device and the orientation of the second audio device. Specifically, the electronic device sends the first audio data to the first audio device and sends the second audio data to the second audio device according to the position of the first window on the display screen, the position of the second window on the display screen, and the orientation of the first audio device and the orientation of the second audio device, wherein the position of the first window on the display screen matches the position of the first audio device relative to the second audio device, and the second window is The position on the display screen matches the position of the second audio device relative to the first audio device, and the position of the first audio device relative to the second audio device and the position of the second audio device relative to the first audio device are determined by the orientation of the first audio device and the orientation of the second audio device.

In this way, the user of the first audio device and the user of the second audio device can listen to the audio data played by the application window that matches the relative position of the second audio device. When the relative position of the first audio device matches the position of the first window on the display screen, it is convenient for the user of the first audio device to watch and listen to the content played by the first window. When the relative position of the second audio device matches the position of the second window on the display screen, it is convenient for the user of the second audio device to watch and listen to the content played by the second window.

In combination with the first aspect, in a possible implementation, the position of the second window on the display screen matches the position of the second audio device relative to the first audio device, including: the second window is on the left side of the display screen, and the position of the second audio device relative to the first audio device is that the second audio device is located on the left side of the first audio device; or, the second window is on the right side of the display screen, and the position of the second audio device relative to the first audio device is that the second audio device is located on the right side of the first audio device.

In combination with the first aspect, in a possible implementation, the position of the first window on the display screen matches the position of the first audio device relative to the second audio device, including: the first window is on the left side of the display screen, and the position of the first audio device relative to the second audio device is that the first audio device is located on the left side of the second audio device; or, the first window is on the right side of the display screen, and the position of the first audio device relative to the second audio device is that the first audio device is located on the right side of the second audio device.

In combination with the first aspect, in a possible implementation method, the electronic device sends the audio data of the second window to the second audio device based on the position of the second window on the display screen, and the orientation of the first audio device and the orientation of the second audio device, specifically including: when the second window is in the middle area of the display screen, the electronic device sends the second audio data to the first audio device and the second audio device at the same time.

In combination with the first aspect, in a possible implementation, the method may also include: when the second window is in the middle area of the display screen, the electronic device stops sending the first audio data to the first audio device; or, the electronic device sends the first audio data to the first audio device and the second audio device at the same time.

In combination with the first aspect, in a possible implementation, the second window is on the left side of the display screen, and the position of the second audio device relative to the first audio device is that the second audio device is located on the left side of the first audio device. After the electronic device sends the audio data of the second window to the second audio device according to the position of the second window on the display screen and the orientations of the first audio device and the second audio device, the method may also include: based on the first user operation, the electronic device moves the second window from the left side of the display screen to the right side of the display screen; the electronic device sends the first audio data to the second audio device and stops sending the second audio data to the second audio device; the electronic device sends the second audio data to the first audio device and stops sending the first audio data to the first audio device.

In combination with the first aspect, in a possible implementation manner, the second window is on the right side of the display screen, the position of the second audio device relative to the first audio device is that the second audio device is located on the right side of the first audio device, the electronic device sends the first audio data to the second audio device, and stops sending the second audio data to the second audio device; after the electronic device sends the second audio data to the first audio device and stops sending the second audio data to the second audio device, the method may further include:

Based on the second user operation, the electronic device moves the second window from the left side of the display screen to the right side of the display screen; the electronic device sends the second audio data to the second audio device and stops sending the first audio data to the second audio device; the electronic device sends the first audio data to the first audio device and stops sending the second audio data to the first audio device.

In this way, when the user of the first audio device and the user of the second audio device want to exchange the content they are listening to, the user only needs to move the positions of the first window and the second window on the display screen. In this way, the user operation is simple and the user experience can be improved.

Optionally, in a possible implementation, when the electronic device detects that the position of the first audio device relative to the second audio device changes and the positions of the first window and the second window on the display screen do not change, the audio data received by the first audio device and the second audio device changes.

Furthermore, in a possible implementation, when the first window is located on the left side of the display screen and the second window is located on the right side of the display screen, and the position of the first audio device relative to the second audio device changes from the first audio device being located on the left side of the second audio device to the first audio device being located on the right side of the second audio device, the electronic device sends the second audio data to the first audio device and stops sending the first audio data to the first audio device; the electronic device sends the first audio data to the second audio device and stops sending the second audio device to the first audio device.

In combination with the first aspect, in a possible implementation, the position of the first audio device is calculated by the electronic device based on a received Bluetooth signal sent by the first audio device; the position of the second audio device is calculated by the electronic device based on a received Bluetooth signal sent by the second audio device.

In a second aspect, an audio transmission system is provided. The audio transmission system may include an electronic device, a first audio device, and a second audio device. The electronic device establishes a communication connection with the first audio device and the second audio device, respectively. The electronic device, the first audio device, and the second audio device are used to execute the audio transmission method in any possible implementation of the first aspect above.

In a third aspect, an electronic device is provided, comprising a memory, a processor, and a display screen, wherein the memory, the display screen, and the processor are electrically coupled, the display screen is used to display an application window of an application for playing audio data in the electronic device, the memory is used to store program instructions, and the processor is configured to call all or part of the program instructions stored in the memory so that the electronic device executes the audio transmission method in any possible implementation of the first aspect above.

In a fourth aspect, a computer storage medium is provided, comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the audio transmission method in any possible implementation of the first aspect.

In a fifth aspect, a computer program product is provided. When the computer program product is run on an electronic device, the electronic device executes the audio transmission method in any possible implementation of any of the above aspects.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of an audio transmission system provided by an embodiment of the present application;

FIG2 is a schematic diagram of an audio transmission scenario provided in an embodiment of the present application;

3A-3B are schematic diagrams of another set of audio transmission scenarios provided in an embodiment of the present application;

4A-4D are schematic diagrams of another set of audio transmission scenarios provided in an embodiment of the present application;

FIG5 is a schematic diagram of the middle area of the tablet 100 provided in an embodiment of the present application;

FIG6 is a schematic diagram of the tablet 100 determining the orientation of the earphone 200 and the earphone 300 provided in an embodiment of the present application;

FIG7 is a schematic diagram of determining the azimuth angle of the earphone 200 by using a phase difference model provided in an embodiment of the present application;

FIG8 is a flow chart of an audio transmission method provided in an embodiment of the present application;

FIG9 is a schematic diagram of a flow chart of an audio transmission method provided in an embodiment of the present application;

FIG10 is a schematic flow chart of an audio transmission method provided in an embodiment of the present application;

FIG11 is a schematic flow chart of an audio transmission method provided in an embodiment of the present application;

FIG12 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

FIG13 is a schematic diagram of a framework of an electronic device provided in an embodiment of the present application;

FIG14 is a schematic diagram of a device 1400 provided in an embodiment of the present application;

FIG15 is a schematic diagram of a device 1500 provided in an embodiment of the present application;

FIG. 16 is a schematic diagram of a device 1600 provided in an embodiment of the present application.

Detailed ways

The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and/or" used in the present application refers to and includes any or all possible combinations of one or more listed items.

In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

Currently, an electronic device can support connecting two pairs of headphones, and the electronic device can transmit audio data to the two pairs of headphones at the same time. Multiple application windows can also be displayed simultaneously in the electronic device. However, the electronic device can only transmit the same audio data to the two pairs of headphones, that is, the audio data output by the window of one application among the multiple application windows. In some scenarios, the wearers of the two pairs of headphones want to watch the windows of different applications and listen to different audios on the electronic device at the same time. In this way, the existing technology cannot meet the needs of users.

In order to enable multiple users to listen to different audios in the same electronic device through multiple pairs of wireless headphones, first, an embodiment of the present application provides an audio transmission system 10. The audio transmission system 10 may include an electronic device and multiple (2 or more) audio devices. The electronic device may display two windows that can play audio. For example, window 1 can play audio data 1, and window 2 can play audio data 2. The electronic device can transmit audio data 1 played by window 1 to an audio device, and transmit the audio data played by window 2 to other audio devices. The audio device can be used to play audio data. Exemplarily, the audio device can be a wireless headset, a speaker, etc. The electronic device can be a tablet, a mobile phone, a computer, etc. The specific type of electronic device and audio device in the embodiment of the present application is not limited. The following is an example in which the electronic device is a tablet 100 and the audio device is headphones 200 and headphones 300.

Exemplarily, the audio transmission system 10 provided in the embodiment of the present application may be as shown in FIG1 . The electronic device in the audio transmission system 10 may be the tablet 100 shown in FIG1 . The multiple pairs of wireless headphones included in the audio transmission system 10 may include the headphones 200 and the headphones 300 shown in FIG1 . Among them:

A video play window 101 and an audio play window 102 may be displayed in the user interface 1000 of the tablet 100 .

The headset 200 establishes a communication connection with the tablet 100, and the headset 300 establishes a communication connection with the tablet 100. In some feasible examples, the headset 200 and the tablet 100 can establish a communication connection via Bluetooth. The headset 300 and the tablet 100 can establish a communication connection via Bluetooth. The embodiment of the application does not limit the manner in which the headset 200 and the tablet 100 establish a communication connection, and the manner in which the headset 300 and the tablet 100 establish a communication connection.

The tablet 100 may display two windows of application programs that can play audio, such as the video playback window 101 and the audio playback window 102 shown in FIG. 1. The video playback window 101 is a window of the video playback APP in the tablet 100. The audio playback window 102 is a window of the audio playback APP in the tablet 100. The video playback window 101 and the audio playback window 102 may be suspended in the user interface 1000. The video playback window 101 is close to the right side of the display screen of the tablet 100, and the audio playback window 102 is close to the left side of the display screen of the tablet 100. In some embodiments, the video playback window 101 and the audio playback window 102 shown in FIG. 1 may be referred to as floating windows. It is understood that the embodiment of the present application does not limit the state of the video playback window 101 and the audio playback window 102 displayed in the tablet 100 in the tablet 100.

The status of the video playback window 101 and the audio playback window 102 in the tablet 100 may include the display mode of the video playback window 101 and the audio playback window 102 in the tablet 100 (for example, floating display, full screen display, split screen display, etc.) and/or the position (or orientation) of the video playback window 101 and the audio playback window 102 on the display screen of the tablet 100.

As shown in Fig. 1, the earphone 200 is on the left side of the earphone 300. The tablet 100 can send the audio data 1 of the audio being played in the audio playing window 102 to the earphone 200. The tablet 100 can send the audio data 2 of the video being played in the video playing window 101 to the earphone 300.

It is understandable that in the embodiment of the present application, the audio data of the audio currently played by the audio playback window 102 is referred to as audio data 1. The audio data 1 is not limited to the audio data of the specific audio played by the audio playback window 102 in a specific time period. The audio content of the audio data 1 played by the audio playback window 102 in the first time period and the audio data 1 played by the audio playback window 102 in the second time period described in the embodiment of the present application may be different.

Similarly, in the embodiment of the present application, the audio data of the audio currently played by the video playback window 101 is referred to as audio data 2. The audio data 2 is not limited to the audio data of a specific video played by the video playback window 101 in a specific time period. The audio content of the audio data 2 played by the video playback window 101 in the first time period and the audio data 2 played by the video playback window 101 in the second time period described in the embodiment of the present application may be different.

The tablet 100 in the audio transmission system 10 shown in FIG1 can send the audio data played in the windows of two application programs to two pairs of headphones respectively. In this way, the user wearing the headphones 200 and the user wearing the headphones 300 can listen to the audio played in the windows of different application programs in the tablet 100.

In some feasible examples, tablet 100 can determine to send audio data 1 of the audio being played in audio playback window 102 to earphone 200 and to send audio data 2 of the video being played in video playback window 101 to earphone 300 based on the relative positions of earphone 200 and earphone 300 .

When the relative positions of earphones 200 and 300 change, tablet 100 can decide how to distribute audio data 1 of the audio being played in audio playback window 102 and audio data 2 of the video being played in video playback window 101 to earphones 200 and 300 based on the current relative positions of earphones 200 and 300.

For example, as shown in FIG2 , compared with FIG1 , the relative directions of the earphone 200 and the earphone 300 are changed, and the earphone 200 is changed from being on the left side of the earphone 300 to being on the right side of the earphone 300. The tablet 100 can send the audio data 1 of the audio being played in the audio playing window 102 to the earphone 300. The tablet 100 can send the audio data 2 of the video being played in the video playing window 101 to the earphone 200.

In this way, when the user wearing earphone 200 wants to listen to the audio data played by the video playback APP, the user wearing earphone 200 can exchange positions with the user wearing earphone 300. In this way, the user wearing earphone 200 can listen to the audio data of the video playback APP, and the user wearing earphone 300 can listen to the audio data played by the audio playback APP.

It can be understood that in the embodiment of the present application, the tablet 100 can determine to send audio data 1 of the audio being played in the audio playback window 102 to the earphone 300, and to send audio data 2 of the video being played in the video playback window 101 to the earphone 200, or to send audio data 1 of the audio being played in the audio playback window 102 to the earphone 200, and to send audio data 2 of the video being played in the video playback window 101 to the earphone 300 based on the relative positions of the earphone 200 and the earphone 300, and the positions and states of the audio playback window 102 and the video playback window 101 in the display screen of the tablet 100.

In the embodiment of the present application, when a window (the center line or midpoint of the window) is closer to the left frame of the tablet 100, the window can be said to be on the left side of the display screen of the tablet 100. When a window is closer to the right frame of the tablet 100, the window can be said to be on the right side of the display screen of the tablet 100. In the case where both window 1 and window 2 are closer to the left frame of the tablet 100, if the distance between window 1 and the left frame of the tablet 100 is less than the distance between window 2 and the left frame of the tablet 100, then window 1 can be said to be on the left side of the display screen of the tablet 100, and window 2 can be said to be on the right side of the display screen of the tablet 100.

In some feasible examples, when the positions of the audio playback window 102 and the video playback window 101 in the tablet 100 on the display screen change, the tablet 100 can determine to send audio data 1 of the audio being played in the audio playback window 102 to the earphone 300, send audio data 2 of the video being played in the video playback window 101 to the earphone 200, or send audio data 1 of the audio being played in the audio playback window 102 to the earphone 200, and send audio data 2 of the video being played in the video playback window 101 to the earphone 300 based on the changed positions of the audio playback window 102 and the video playback window 101, and the relative positions of the earphone 200 and the earphone 300.

Exemplarily, as shown in FIG3A , compared with FIG1 , the positions of the video play window 101 and the audio play window 102 in the tablet 100 in the display screen are changed. Specifically, the position of the video play window 101 in the tablet 100 is changed from the right side to the left side of the tablet display screen. The position of the audio play window 102 in the tablet 100 is changed from the left side to the right side of the tablet display screen. The relative direction of the earphone 200 and the earphone 300 remains unchanged. The earphone 200 is still on the left side of the earphone 300. Based on the positions of the video play window 101 and the audio play window 102, and the relative direction of the earphone 200 and the earphone 300, the tablet 100 sends the audio data 2 of the video being played in the video play window 101 to the earphone 200, and sends the audio data 1 of the audio being played in the audio play window 102 to the earphone 300.

In this way, when the user wearing headphones 200 wants to listen to the audio data of the video playback APP, and the user wearing headphones 300 wants to listen to the audio data of the audio playback APP, they only need to change the positions of the video playback window 101 and the audio playback window 102 in the display screen of the tablet 100, and the user wearing headphones 200 can change from listening to the audio data of the audio playback APP to listening to the audio data of the video playback APP; the user wearing headphones 300 can change from listening to the audio data of the video playback APP to listening to the audio data of the audio playback APP.

In some feasible examples, when the windows of two applications in the tablet are displayed in split screen, the tablet 100 can determine, based on the positions of the windows of the two applications and the relative directions of the headphones 200 and the headphones 300, to send audio data 1 of the audio being played by the audio playback window 102 to the headphones 300, and to send audio data 2 of the video being played by the video playback window 101 to the headphones 200, or to send audio data 1 of the audio being played by the audio playback window 102 to the headphones 200, and to send audio data 2 of the video being played by the video playback window 101 to the headphones 300.

Exemplarily, as shown in FIG3B , two split-screen windows may be displayed in the tablet 100, namely, a video playback window 101 and an audio playback window 102. The video playback window 101 and the audio playback window 102 may divide the display screen of the tablet 100 into two areas, area 1 and area 2. The video playback window 101 may be displayed in area 1, and the audio playback window 102 may be displayed in area 2. Area 1 is an area formed by quadrilaterals ABDE, and area 2 is an area formed by quadrilaterals BECF. The video playback window 101 is located on the left side of the display screen of the tablet 100, and the audio playback window 102 is located on the right side of the display screen of the tablet 100. The earphone 200 is located on the left side of the earphone 300. The tablet 100 may determine to send the audio data 2 of the video being played in the video playback window 101 to the earphone 200, and to send the audio data 1 of the audio being played in the audio playback window 102 to the earphone 300, based on the positions of the two split-screen windows and the relative directions of the earphone 200 and the earphone 300.

It is understandable that when the positions of the two split-screen windows in the tablet 100 are changed, for example, the video play window 101 is located on the right side of the display screen of the tablet 100, and the audio play window 102 is located on the left side of the display screen of the tablet 100. The earphone 200 is located on the left side of the earphone 300. The tablet 100 can determine to send the audio data 2 of the video being played in the video play window 101 to the earphone 300 and to send the audio data 1 of the audio being played in the audio play window 102 to the earphone 200 based on the positions of the two split-screen windows and the relative directions of the earphone 200 and the earphone 300.

It is understandable that the two split-screen windows displayed in the tablet 100 may not occupy the entire display screen of the tablet 100. That is, the two split-screen windows may equally divide the user interface in the tablet 100, and the user interface may be displayed in full screen or in small windows. This embodiment of the present application does not limit this.

In some feasible examples, when a full-screen window and a floating window are displayed on the tablet 100, the tablet 100 can determine whether to send the audio data of the full-screen window to the earphone 200 or the earphone 300, and whether to send the audio data of the floating window to the earphone 200 or the earphone 300 based on the position of the floating window and the relative directions of the earphone 200 and the earphone 300.

In this way, the user wearing the earphone 200 and the user wearing the earphone 300 can choose to listen to the audio data of the video playback APP or the audio data of the audio playback APP according to their own needs.

In a possible implementation, a full-screen window and a floating window are displayed on the tablet 100, the floating window is located on the right side of the display screen of the tablet 100, and the earphone 200 is located on the left side of the earphone 300. The position of the floating window on the display screen of the tablet 100 is consistent with the relative position of the earphone 300 (the position of the earphone 300 relative to the earphone 200). Based on the position of the floating window and the relative direction of the earphone 200 and the earphone 300, the tablet 100 can send the audio data being played in the floating window to the earphone 300, and send the audio data being played in the full-screen window to the earphone 200.

Exemplarily, as shown in FIG4A , a full-screen video playback window 101 and a floating window, namely, a call window 103, may be displayed in the tablet 100. The call window 103 may be located on the right side of the display screen of the tablet 100. The video playback window 101 may be an application window of a video APP in the tablet 100. The call window 103 may be an application window of a call APP in the tablet 100. The earphone 200 is located on the left side of the earphone 300. The tablet 100 may send the audio data 2 of the video being played in the video playback window 101 to the earphone 200, and send the audio data 3 of the call being played in the call window 103 to the earphone 300.

In this way, when the user wearing earphone 300 answers a call, it does not affect the user wearing earphone 200 to continue listening to the audio data of the video playback APP.

In a possible implementation, a full-screen window and a floating window are displayed on the tablet 100, the floating window is located on the left side of the display screen of the tablet 100, and the earphone 200 is located on the left side of the earphone 300. The position of the floating window on the display screen of the tablet 100 is consistent with the relative position of the earphone 200 (the position of the earphone 200 relative to the earphone 300). Based on the position of the floating window and the relative direction of the earphone 200 and the earphone 300, the tablet 100 can send the audio data being played in the floating window to the earphone 200, and send the audio data being played in the full-screen window to the earphone 300.

Exemplarily, as shown in FIG. 4B , a full-screen video playback window 101 and a floating window, i.e., a call window 103, may be displayed in the tablet 100. The call window 103 may be located on the left side of the display screen of the tablet 100. The video playback window 101 may be an application window of a video APP in the tablet 100. The call window 103 may be an application window of a call APP in the tablet 100. The earphone 200 is located on the left side of the earphone 300. The tablet 100 may send the audio data 2 of the video being played in the video playback window 101 to the earphone 300, and send the audio data 3 of the call being made in the call window 103 to the earphone 200.

In this way, when the user wearing the headset 200 needs to make a call, he only needs to move the application window of the call APP to the same position as the headset 200. In this way, the user wearing the headset 200 can make a call and chat, while the user wearing the headset 300 can continue to listen to the audio data of the video playback APP.

In a possible implementation, a full-screen window and a floating window are displayed on the tablet 100, and the floating window is located in the middle area of the display screen of the tablet 100. The earphone 200 is located on the left side of the earphone 300. The tablet 100 can send only the audio data being played in the floating window to the earphone 200 and the earphone 300 based on the position of the floating window.

For example, as shown in FIG4C , the tablet 100 may display a full-screen video playback window 101 and a floating window, namely, a call window 103. The call window 103 may be located in the middle of the display screen of the tablet 100. The earphone 200 is located on the left side of the earphone 300. The tablet 100 may only send the audio data 3 of the call in the call window 103 to the earphone 200 and the earphone 300.

In this way, when the user wearing the headset 200 and the user wearing the headset 300 both want to listen to the content of the ongoing call in the call APP, they only need to move the call window 103 to the middle of the display screen of the tablet 100.

Optionally, in another possible implementation, a full-screen window and a floating window are displayed in the tablet 100, and the floating window is located in the middle area of the display screen of the tablet 100. The tablet 100 can send the audio data being played in the floating window and the audio data being played in the full-screen window to the earphones 200 and 300 based on the position of the floating window.

For example, as shown in FIG4D , the tablet 100 may display a full-screen video playback window 101 and a floating window, namely, a call window 103. The call window 103 may be located in the middle of the display screen of the tablet 100. The earphone 200 is located on the left side of the earphone 300. The tablet 100 may send the audio data 2 being played in the full-screen window and the audio data 3 of the call being made in the call window 103 to the earphone 200 and the earphone 300.

In this way, it is only necessary to move the call window 103 to the middle of the display screen of the tablet 100, and the user wearing the earphones 200 and the user wearing the earphones 300 can listen to the call content of the call APP and the audio data played by the video playback APP.

Exemplarily, as shown in FIG. 4C and FIG. 4D , the central axis of the call window 103 may coincide with the central axis of the display screen of the tablet 100 .

It is understood that, in the embodiment of the present application, the floating window being located in the middle area of the tablet 100 is not limited to the central axis of the floating curtain coinciding with the central axis of the display screen of the tablet 100. The floating window can be located in a preset middle area of the tablet 100, and the size and position of the preset middle area can be set by the user or configured by default by the tablet 100. The embodiment of the present application does not limit the size and position of the preset middle area of the display screen of the tablet 100.

For example, as shown in Fig. 5, the preset middle area of the tablet 100 may be the area 501 shown in Fig. 5. The size and position of the area 501 may be set by the user or configured by default by the tablet 100. The embodiment of the present application does not limit the size and position of the area 501.

Optionally, in a possible implementation, two or more windows for playing audio data may be displayed in the tablet 100. The tablet 100 may use the window for playing audio data selected by the user (the window clicked by the finger) or the window for playing audio data that was recently opened as the focus window. Then, the tablet 100 may send the audio data of the focus window to the earphone 200 and the earphone 300. Alternatively, the tablet 100 may send the audio data of the focus window to the earphone with the relative position on the left side if the focus window is located on the left side of the tablet 100 display screen, and send the audio data of the focus window to the earphone with the relative position on the right side if the focus window is located on the right side of the tablet 100 display screen based on the position of the focus window in the tablet 100.

Optionally, in a possible implementation, two or more windows for playing audio data may be displayed in the tablet 100. The tablet 100 may only send the audio data of the window of the application with the highest application priority to the earphone 200 and the earphone 300. The application priority may be set by the user or configured by the tablet system, which is not limited here.

Optionally, in a possible implementation, two or more windows for playing audio data may be displayed on the tablet 100. The user may choose to send the audio data of one of the two or more windows for playing audio data to the headset 200, and the audio data of the other window may be sent to the headset 200. The first area of the tablet 100 may be a sidebar of the tablet 100, which is not limited here.

Optionally, in a possible implementation, two windows (window 1 and window 2) for playing audio data are displayed in the tablet 100, and window 1 can be located on the left side of the display screen of the tablet 100, and window 2 can be located on the right side of the tablet 100. Based on user operations, the tablet 100 can open and display a window 3 for playing audio data. If window 3 covers window 1, the tablet 100 sends the audio data of window 3 to the earphone on the left, and pauses sending the audio data of window 1 to the earphone on the left. If window 3 covers window 2, the tablet 100 sends the audio data of window 3 to the earphone on the right, and pauses sending the audio data of window 2 to the earphone on the right. Here, window 3 covering window 1 can mean that window 3 is displayed on window 1, completely blocking or partially blocking window 1.

In some feasible examples, a floating window or a split-screen window may also be referred to as a small window (or small window).

In the embodiment of the present application, the earphone 200 may be referred to as a first audio device, and the earphone 300 may be referred to as a second audio device; alternatively, the earphone 200 may be referred to as a second audio device, and the earphone 300 may be referred to as a first audio device.

It is understandable that in the embodiment of the present application, the tablet 100 can obtain the position of the earphone 200 and the earphone 300, and determine the relative position of the earphone 200 and the earphone 300. Specifically, the tablet 100 can be positioned by an ultra wide band positioning method or a Bluetooth positioning method, and the position and distance of the earphone 200 and the earphone 300 can be obtained, thereby determining the relative position of the earphone 200 and the earphone 300. The embodiment of the present application does not limit the specific positioning position used by the tablet 100 to position the earphone 200 and the earphone 300.

Exemplarily, the following description takes the example of the tablet 100 positioning the earphones 200 and 300 by using the Bluetooth positioning method.

In some feasible examples, the tablet 100 may have an antenna array module, and the tablet 100 may receive and send Bluetooth signals through the antenna array module. The antenna array module may receive Bluetooth signals sent by the earphone 200 and the earphone 300. The Bluetooth signal may carry positioning information, such as an angle of arrival (AOA) data packet. The tablet 100 may locate the earphone 200 based on the positioning information in the Bluetooth signal sent by the earphone 200 received by the antenna array module. And the tablet 100 may locate the earphone 300 based on the positioning information in the Bluetooth signal sent by the earphone 300 received by the antenna array module.

FIG6 exemplarily shows a schematic diagram of the tablet 100 determining the orientation of the earphone 200 and the earphone 300. As shown in FIG6 , the tablet 100 may include an antenna array module 600. The antenna array module 600 may include three positioning antennas. The tablet 100 may select two positioning antennas in the antenna array module 600 through a switching switch to position the earphone 200, and determine that the orientation angle of the earphone 200 is α1, and the distance between the earphone 200 and the antenna array module 600 is d1. The tablet 100 may select two positioning antennas in the antenna array module 600 through a switching switch to position the earphone 300, and determine that the orientation angle of the earphone 300 is α2, and the distance between the earphone 300 and the antenna array module 600 is d2.

It is understandable that the number and arrangement of the positioning antennas shown in the antenna array module 600 are only examples, and the antenna array module 600 may include 2 positioning antennas or 3 positioning antennas, or more positioning antennas. The embodiment of the present application does not limit the number and arrangement of the positioning antennas in the antenna array module 600.

In some feasible examples, the tablet 100 can determine the azimuth angle of the headset 200 through the phase difference of the Bluetooth signal of the headset 200 received by different antenna units in the antenna array module 600.

Exemplarily, as shown in FIG7 , the earphone 200 can transmit a Bluetooth signal. Antenna 1 and antenna 2 in the antenna array module 600 can receive the Bluetooth signal transmitted by the earphone 200. The tablet 100 can determine the incident angle of the Bluetooth signal transmitted by the earphone 200, that is, the azimuth angle α1 of the earphone 200, based on the distance between antenna 1 and antenna 2 in the antenna array module 600, the wavelength of the Bluetooth signal transmitted by the earphone 200, and the phase difference between antenna 1 and antenna 2 receiving the Bluetooth signal transmitted by the earphone 200:

In the above formula 1, is the phase difference between antenna 1 and antenna 2 in the antenna array module 600 when receiving the Bluetooth signal transmitted by the headset 200, λ1 is the wavelength of the Bluetooth signal transmitted by the headset 200, and d is the distance between antenna 1 and antenna 2 in the antenna array module 600.

In some feasible examples, the tablet 100 can determine that the distance between the earphone 200 and the antenna array module 600 is d1 by receiving the time when the earphone 200 transmits the Bluetooth signal and the propagation speed of the Bluetooth signal transmitted by the earphone 200 through the antenna array module 600.

In some feasible examples, the tablet 100 can determine the azimuth angle of the headset 300 through the phase difference of the Bluetooth signal of the headset 300 received by different antenna units in the antenna array module 600.

Exemplarily, referring to FIG. 7 above, the earphone 300 can transmit a Bluetooth signal. Antenna 1 and antenna 2 in the antenna array module 600 can receive the Bluetooth signal transmitted by the earphone 300. The tablet 100 can determine the incident angle of the Bluetooth signal transmitted by the earphone 300, that is, the azimuth angle α2 of the earphone 300, based on the distance between antenna 1 and antenna 2 in the antenna array module 600, the wavelength of the Bluetooth signal transmitted by the earphone 300, and the phase difference between antenna 1 and antenna 2 receiving the Bluetooth signal transmitted by the earphone 300:

In the above formula 2, is the phase difference between antenna 1 and antenna 2 in the antenna array module 600 when receiving the Bluetooth signal transmitted by the headset 300, λ2 is the wavelength of the Bluetooth signal transmitted by the headset 300, and d is the distance between antenna 1 and antenna 2 in the antenna array module 600.

In some feasible examples, the tablet 100 can receive the time when the headset 300 transmits the Bluetooth signal and the propagation speed of the Bluetooth signal transmitted by the headset 300 through the antenna array module 600 to determine that the distance between the headset 300 and the antenna array module 600 is d2.

It is understandable that the embodiment of the present application does not limit the specific method or algorithm used by the tablet 100 to determine the orientation and distance of the earphones 200 and 300.

In some feasible examples, the tablet 100 can determine the relative orientation of the earphone 200 and the earphone 300 by the azimuth angle α1 of the earphone 200 and the azimuth angle α2 of the earphone 300. For example, if α1 is -30° and α2 is 60°, the earphone 200 is located on the left side of the earphone 300, and the earphone 300 is located on the right side of the earphone 200. If α1 is 90° and α2 is 60°, the earphone 200 is located on the right side of the earphone 300, and the earphone 300 is located on the left side of the earphone 200. If α1 is -90° and α2 is -60°, the earphone 200 is located on the left side of the earphone 300, and the earphone 300 is located on the right side of the earphone 200. It can be understood that the angles of α1 and α2 are not limited to 0° to +180° and -180° to 0°, and can also be between 0° and 360°, which is not limited in the embodiments of the present application.

In the embodiment of the present application, the specific relative positions of the earphone 200 and the earphone 300 may include: the earphone 200 is located on the left side of the earphone 300, or the earphone 200 is located on the right side of the earphone 300. Alternatively, the earphone 200 being located on the left side of the earphone 300 may also be referred to as the earphone 200 being located on the left side and the earphone 300 being located on the right side. The earphone 200 being located on the right side of the earphone 300 may also be referred to as the earphone 200 being located on the right side and the earphone 300 being located on the left side.

It is to be understood that when the headset 200 is described as being located on the left side in the embodiment of the present application, it is not limited to the headset 200 being located on the left side of the central axis of the display screen of the tablet 100 (see the central axis of the display screen of the tablet 100 shown in FIG. 4C or FIG. 4D ). The headset 200 can be located on either side of the central axis of the display screen of the tablet 100. When the headset 300 is described as being located on the right side in the embodiment of the present application, it is not limited to the headset 300 being located on the right side of the central axis of the display screen of the tablet 100. The headset 300 can be located on either side of the central axis of the display screen of the tablet 100.

Optionally, in other feasible examples, the tablet 100 can determine the relative orientation of the earphone 200 and the earphone 300 through the azimuth angle α1 of the earphone 200 and the azimuth angle α2 of the earphone 300, as well as the distance d1 between the earphone 200 and the antenna array module 600 in the tablet 100, and the distance d2 between the earphone 300 and the antenna array module 600 in the tablet 100.

Based on the above introduction, the embodiment of the present application takes two windows that can play audio displayed in an electronic device as an example, which are a full-screen window and a floating window, respectively, to introduce in detail how the electronic device distributes the audio of the two windows to headphones 200 and headphones 300.

FIG8 exemplarily shows a flow chart of an audio transmission method provided in an embodiment of the present application. As shown in FIG8 , an audio transmission method provided in an embodiment of the present application may include the following steps:

S800a: The electronic device establishes a Bluetooth connection with the headset 200 based on user operation 1.

S800b: The electronic device establishes a Bluetooth connection with the headset 300 based on user operation 2.

The electronic device can establish a Bluetooth connection with the headset 200 and the headset 300 respectively based on user operation 1 and user operation 2. For example, the user can click on the control for turning on the Bluetooth function in the electronic device, and then the user can turn on the headset 200 and adjust it to a connectable state. Then, the user can choose to connect the headset 200 in the electronic device. Finally, the electronic device can establish a Bluetooth connection with the headset 200. Similarly, when the Bluetooth function of the electronic device is turned on, the user can turn on the headset 300 and adjust it to a connectable state, and then the user can choose to connect the headset 300 in the electronic device. Finally, the electronic device can establish a Bluetooth connection with the headset 300.

Exemplarily, user operation 1 may include an operation of a user clicking a control in an electronic device for turning on a Bluetooth function, an operation of a user clicking a control for turning on a Bluetooth function of the headset 200, an operation of clicking a control for placing the headset 200 in a connectable state, and an operation of clicking a control in an electronic device for establishing a Bluetooth connection between the electronic device and the headset 200, etc. It is understandable that user operation 1 may enable the electronic device to establish a Bluetooth connection with the headset 200. For different electronic devices or different operating habits of different users, the operation of establishing a Bluetooth connection between the electronic device and the headset 200 may be different. The embodiment of the present application does not limit the specific user operation 1.

Exemplarily, user operation 2 may include an operation of a user clicking on a control in an electronic device for turning on a Bluetooth function, an operation of a user clicking on a control for turning on the Bluetooth function of the headset 300, an operation of clicking on a control for making the headset 300 connectable, and an operation of clicking on a control in an electronic device for establishing a Bluetooth connection between the electronic device and the headset 300, etc. It is understandable that user operation 1 may enable the electronic device to establish a Bluetooth connection with the headset 300. For different electronic devices or different operating habits of different users, the operation of establishing a Bluetooth connection between the electronic device and the headset 300 may be different. The embodiment of the present application does not limit the specific user operation 1.

It is understandable that the embodiment of the present application does not limit the order in which the electronic device establishes a Bluetooth connection with the headset 200, and the electronic device establishes a Bluetooth connection with the headset 300. That is, the embodiment of the present application does not limit the execution order of step S800a and step S800b. The electronic device may first establish a Bluetooth connection with the headset 200, and then establish a Bluetooth connection with the headset 300. Alternatively, the electronic device may first establish a Bluetooth connection with the headset 300, and then establish a Bluetooth connection with the headset 200.

It is understandable that the electronic device may be able to display the application window and connect to the wireless headset, such as a mobile phone, a tablet and other devices.

S801. Based on user operation 3, the electronic device starts a full-screen APP1 that outputs audio data data1.

The electronic device can open the full-screen APP1 based on the user operation 3, and the full-screen APP1 can output the audio data data1. The user operation 3 can be that the user clicks the icon of the full-screen APP1 in the main interface of the electronic device displaying the application icon. The user operation 3 can also be that the user inputs a voice command to the electronic device to open the full-screen APP1, or clicks the shortcut key for opening the full-screen APP1 in the electronic device, etc. The embodiment of the present application does not limit the user operation 3. The full-screen APP1 can be an APP that can play audio, for example, the video APP shown in Figure 4A. The audio data data1 can be the audio data that is playing audio in the full-screen APP1. For example, the audio data 2 that is being played in the video playback window 101 shown in Figure 4A. It can be understood that the embodiment of the present application does not limit what type of APP the full-screen APP1 is, nor does it limit the specific content of the audio data data1 played by the full-screen APP1.

S802a : The electronic device sends the audio data data1 to the headset 200 .

S802b : The electronic device sends the audio data data1 to the earphone 300 .

The electronic device can send audio data data1 to earphones 200 and 300. It is understandable that when the electronic device only opens one APP that can play audio, that is, full-screen APP1, the electronic device can simultaneously send the audio data played by the APP to multiple earphones connected to the electronic device, that is, earphones 200 and 300.

S803. Based on user operation 4, the electronic device starts the floating APP2 that outputs the audio data data2, and displays the floating APP2 in the first area of the display screen of the electronic device.

The electronic device can open the floating APP2 based on the user operation 4, and the floating APP2 can output the audio data data2. The user operation 4 can be that the user clicks the icon of the floating APP2 in the main interface of the electronic device displaying the application icon, and adjusts the application window of the floating APP2 to the first area of the display screen of the electronic device for floating display. The user operation 4 can also be that the user inputs a voice command to the electronic device to open the floating APP2, and adjusts the application window of the floating APP2 to the first area of the display screen of the electronic device for floating display. The embodiment of the present application does not limit the user operation 4. The floating APP2 can be an APP that can play audio, for example, a call APP corresponding to the call window 103 shown in FIG. 4A. The audio data data2 can be the audio data being played by the floating APP2, for example, the audio data data2 can be the call audio data 3 of the call window 103 shown in FIG. 4A. It can be understood that the embodiment of the present application does not limit what type of APP the floating APP2 is, nor does it limit the specific content of the audio data data2 played by the floating APP2.

It is understandable that the full-screen APP1 in the embodiment of the present application is not displayed in full screen in all scenarios. The full-screen APP1 can also be displayed in a suspended state or in a split screen based on user operations in some scenarios, and the embodiment of the present application does not limit this. Similarly, the floating APP2 in the embodiment of the present application is not displayed in a suspended state in all scenarios. The floating APP2 can also be displayed in a full screen or in a split screen based on user operations in some scenarios, and the embodiment of the present application does not limit this.

S804a: The electronic device monitors the position of the earphone 200.

S804b: The electronic device monitors the position of the earphone 300.

The electronic device can detect the position of the earphone 200 and the earphone 300, for example, the azimuth and/or distance of the earphone 200, and the azimuth and/or distance of the earphone 300. Exemplarily, the electronic device can monitor the position of the earphone 200 and the earphone 300 based on the antenna array module 600 shown in FIG. 6. Specifically, how the electronic device detects the position of the earphone 200 and the earphone 300 can refer to the description in FIG. 6 and FIG. 7, which will not be repeated here.

S805: The electronic device determines that the earphone 200 is located at the position d1, and the earphone 300 is located at the position d2, and the position d1 is the same as the position of the first area in the display screen.

The electronic device can determine that the earphone 200 is located at the position d1 and the earphone 300 is located at the position d2 according to the monitored position of the earphone 200 and the monitored position of the earphone 300. Specifically, the earphone 200 being located at the position d1 can indicate that the earphone 200 has an azimuth angle of α1; the earphone 300 being located at the position d2 can indicate that the earphone 300 has an azimuth angle of α2.

The electronic device can determine the relative positions of the earphone 200 and the earphone 300 according to the position d1 of the earphone 200 and the position d2 of the earphone 300 .

Optionally, the orientation d1 and the orientation d2 may be relative orientations, and the orientation d1 and the orientation d2 are different. For example, the orientation d1 may be the left side, that is, the earphone 200 is located on the left side of the earphone 300. The orientation d2 may be the right side, that is, the earphone 300 is located on the right side of the earphone 200. The embodiment of the present application does not specifically limit the orientation d1.

The electronic device may determine the position of the first area in the display screen. The position of the first area in the display screen may be the same as the position d1. For example, the position d1 is the left side, and the first area is located on the left side of the display screen of the electronic device.

In some embodiments, when the orientation d1 and the orientation d2 indicate that the earphone 200 is located on the left side of the earphone 300 and the first area is located on the left side of the electronic device display screen, the orientation of the earphone 200 can be said to match or be the same as the orientation of the first area (or the orientation of the window of the suspended APP2). When the orientation d1 and the orientation d2 indicate that the earphone 200 is located on the right side of the earphone 300 and the first area is located on the right side of the electronic device display screen, it can also be said that the orientation of the earphone 200 matches or is the same as the orientation of the first area (or the orientation of the window of the suspended APP2). It is said that the orientation of the earphone 200 matches or is the same as the orientation of the first area (or the orientation of the window of the floating APP2).

S806 : The electronic device stops sending the audio data data1 to the earphone 200 , and sends the audio data data2 to the earphone 200 .

When the electronic device determines that the first area where the floating APP2 is located is the same as the orientation d1 of the headset 200 , the electronic device can stop sending the audio data data1 of the full-screen APP1 to the headset 200 and send the audio data data2 of the floating APP2 to the headset 200 instead.

S807: Based on user operation 5, the electronic device displays the floating APP2 in the second area of the display screen, and determines that the position of the second area in the display screen is the same as the position d2.

User operation 5 may be that the user moves the application window of the floating APP2 from the first area of the display screen to the second area. That is, the user may move the application window of the floating APP2 to the second area of the electronic device display screen, and in response to the user operation, the electronic device may display the floating APP2 in the second area of the display screen. The embodiment of the present application does not specifically limit user operation 5.

The orientation of the second area in the display screen is different from the orientation of the first area in the display screen. The orientation of the second area in the display screen may be the same as the orientation d2. For example, the second area is on the right side of the display screen, and the orientation d2 may also be on the right side (i.e., the earphone 300 is on the right side of the earphone 200).

S808a: The electronic device stops sending the audio data data2 to the earphone 200, and sends the audio data data1 to the earphone 200.

S808b: The electronic device stops sending the audio data data1 to the earphone 300, and sends the audio data data2 to the earphone 300.

When the electronic device detects that the position of the floating APP in the display screen is consistent with the position of the earphone 300, that is, the position of the second area in the display screen is the same as the position d2, the electronic device can stop sending the audio data data2 of the floating APP2 to the earphone 200, and instead send the audio data data1 of the full-screen APP1 to the earphone 200; and stop sending the audio data data1 of the full-screen APP1 to the earphone 300, and instead send the audio data data2 of the floating APP2 to the earphone 300.

Optionally, in a possible implementation, in step S805, the user may also adjust the position of the floating APP2 in the display screen to be the same as the position of the earphone 300. That is, the floating APP2 may also be located in the second area first, and then moved from the second area to the first area. When the floating APP2 is located in the second area, the electronic device may send the audio data data2 of the floating APP2 to the earphone 300 with the same position as the floating APP2. For example, as shown in FIG4A, when the call window 103 of the call APP is located on the right side of the display screen, the electronic device may send the audio data 3 of the call window 103 to the earphone 300 with the same position as the call window 103. Afterwards, the user may move the floating APP2 from the second area to the first area, and when the floating APP2 is located in the first area, the electronic device may send the audio data data2 of the floating APP2 to the earphone 200 with the same position as the floating APP2. For example, as shown in FIG4B, when the call window 103 of the call APP is located on the left side of the display screen, the electronic device may send the audio data 3 of the call window 103 to the earphone 200 with the same position as the call window 103.

It can be understood that the electronic device sends the audio data data2 of the suspended APP2 to the earphone (earphone 200 or earphone 300) consistent with the position of the suspended APP2 based on the position of the suspended APP2 in the display screen, the position of the earphone 200 and the position of the earphone 300.

It can be understood that in the embodiment of the present application, the first area where the floating APP2 is displayed on the display screen is the first area where the application window (or user interface) of the floating APP2 is displayed on the display screen. The second area where the floating APP2 is displayed on the display screen is the second area where the application window (or user interface) of the floating APP2 is displayed on the display screen.

S809: Based on user operation 6, the electronic device displays the floating APP 2 in the third area of the display screen.

User operation 6 may be that the user moves the floating APP2 to the third area of the display screen. The embodiment of the present application does not specifically limit user operation 6. The electronic device may display the floating APP2 in the third area of the display screen based on user operation 6. The third area may be the middle area of the electronic device display screen, for example, area 501 shown in FIG. 5. The embodiment of the present application does not limit the specific position of the third area in the display screen and the specific size of the third area.

It can be immediately understood that the user involved in the embodiment of the present application moves the floating APP2 to the first area of the display screen, or from the first area to the second area, and to the third area, which means that the user moves the application window (or user interface) of the floating APP2 to the first area of the display screen, or from the first area to the second area, and to the third area.

S810a : The electronic device sends the audio data data1 and the audio data data2 to the headset 200 .

S810b: The electronic device sends the audio data data1 and the audio data data2 to the headset 300.

When the electronic device detects that the floating APP2 is located in the third area of the display screen, such as the middle area, the electronic device can send the audio data data1 and the audio data data2 to the earphone 200, and send the audio data data1 and the audio data data2 to the earphone 300. That is, the earphone 200 and the earphone 300 can receive the audio data data1 and the audio data data2 at the same time. For example, when the call window 103 in FIG. 4D is in the middle area of the display screen of the tablet 100, the tablet 100 sends the audio data 3 of the call window 103 and the audio data 2 of the video playback window 101 to the earphone 200, and sends the audio data 3 of the call window 103 and the audio data 2 of the video playback window 101 to the earphone 300.

Optionally, in a possible implementation, when the electronic device detects that the floating APP2 is located in the third area of the display screen, the electronic device can send the audio data data2 of the floating APP2 to the earphone 200 and the earphone 300 at the same time. For example, when the call window 103 in FIG4C is in the middle area of the display screen of the tablet 100, the tablet 100 sends the audio data 3 of the call window 103 to the earphone 200 and the earphone 300.

S811. The electronic device exits the floating APP2 based on the user operation 7.

Optionally, the user may also click on a control for closing the floating APP. In response to the user operation, the electronic device may exit the floating APP2, that is, the electronic device closes the floating APP2.

S812a : The electronic device sends the audio data data1 to the earphone 200 .

S812b: The electronic device sends the audio data data1 to the headset 200.

After the electronic device closes the floating APP2, the electronic device may only send the audio data data1 of the full-screen APP1 to the earphone 200 and the earphone 300.

In some feasible examples, when the user clicks the control to pause the playing of the audio data data2 of the floating APP2, in response to the user operation, the electronic device pauses sending the audio data data2 to the earphone 200 or the earphone 300, and sends the audio data data1 to the earphone 200 and the earphone 300.

In some feasible examples, when the user clicks the control to pause playing the audio data data1 of the full-screen APP1, in response to the user operation, the electronic device pauses sending the audio data data1 to the earphone 200 or the earphone 300, and sends the audio data data2 to the earphone 200 and the earphone 300.

In the embodiment of the present application, when the electronic device plays the audio of only one application, the electronic device can send the audio data of the application to the earphone 200 and the earphone 300 at the same time. When the application is displayed in a floating manner in the electronic device, the electronic device does not need to consider the position of the application in the display screen, and still sends the audio data of the application to the earphone 200 and the earphone 300. When the audio of two applications is played simultaneously in the electronic device, the electronic device needs to choose to send the audio data of one application of the two applications to the earphone 200 and the audio data of the other application to the earphone 300 according to the status and position of the two applications; or send the audio data of the two applications to the earphone 200 and the earphone 300 at the same time, or send the audio data of one application of the two applications to the earphone 200 and the earphone 300 at the same time.

FIG. 9 shows an audio transmission method provided in an embodiment of the present application.

In some scenarios, when the electronic device determines that two pairs of headphones are connected to the electronic device and two apps that output audio are opened in the electronic device, the electronic device will start to detect the window status of the apps and monitor the position of the headphones.

As shown in FIG. 9 , an audio transmission method provided in an embodiment of the present application may include the following steps:

S901: Whether the electronic device is connected to two wireless headphones, if so, execute step S902a, if not, execute S902b.

The electronic device can be connected to multiple pairs of headphones. When the electronic device is connected to at least two pairs of headphones, such as the headphones 200 and 300 mentioned above, the electronic device can determine whether an APP with two output audios is turned on, that is, execute the following step S902a.

When the electronic device is not connected to a wireless headset or is only connected to a pair of wireless headsets, the electronic device may stop detecting the position of the headset, that is, execute step S902b.

In one possible implementation, the electronic device continuously monitors whether two pairs of wireless headphones are connected to the electronic device. When the electronic device first determines that the electronic device is connected to two pairs of wireless headphones, while monitoring the positions of the two pairs of wireless headphones, if the electronic device detects that any one of the two pairs of headphones is disconnected from the electronic device, the electronic device stops monitoring the positions of the two pairs of headphones.

In some scenarios, when the electronic device determines that two pairs of wireless headphones are not connected, the electronic device may continuously monitor whether two pairs of wireless headphones are connected, that is, continuously execute step S901.

S902a, the electronic device determines whether two apps that output audio are turned on, if so, executes step S903, if not, continues to execute S902a.

After the electronic device determines that two wireless headphones are connected, the electronic device can also determine whether two APPs with audio output are turned on: APP11 with audio output and APP22 with audio output. For example, APP11 and APP22 can be the video APP, call APP in Figures 4A-4D, or the full-screen APP1 and floating APP2 involved in Figure 8. The embodiment of the present application does not limit the specific type and name of APP11 and APP22. When the electronic device determines that two APPs with audio output are turned on, the electronic device can perform the following step S903. When the electronic device determines that two APPs with audio output are not turned on (that is, only one APP with audio output is turned on or the APP with audio output is not turned on), the electronic device can continue to detect whether two APPs with audio output are turned on in the electronic device, that is, continue to execute step S902.

S902b. The electronic device stops monitoring the position of the earphone.

When the electronic device has started to monitor the position of the earphones and the electronic device changes from being connected to two pairs of earphones to not being connected to two pairs of earphones, the electronic device can stop monitoring the position of the earphones.

S903. The electronic device monitors the APP window status.

When the electronic device determines to open two APPs with output audio, namely APP11 and APP22, the electronic device can monitor the status of the application window of APP11 and the application window of APP22. The status of APP11 and APP22 can be full screen display, floating display or split screen display, etc.

Specifically, the electronic device can monitor the window status of APP11 and APP2 through the application window monitoring service module in the electronic device. For the application window monitoring service module, please refer to the description of FIG. 12 below, which will not be repeated here.

S904. The electronic device monitors the position of the earphone.

When the electronic device determines that two pairs of wireless headphones are connected and two apps that output audio are turned on, the electronic device can start monitoring the position of the headphones. How the electronic device detects the position of the headphones can refer to the description in Figures 6 and 7 above, which will not be repeated here.

By monitoring the positions of the earphones, the electronic device can determine in real time the positions of the two connected wireless earphones and the relative positions of the two wireless earphones.

S905. The electronic device determines whether the position of the floating APP is the same as the position of a pair of headphones. If so, execute step S906; if not, execute step S903.

If the electronic device determines that APP11 or APP22 of the two APP11 and APP22 that output audio is a floating APP (hereinafter, APP11 is taken as an example of a floating APP), the electronic device needs to determine the floating APP, for example, the position of APP11 is the same as the position of one of the two pairs of wireless headphones. If the electronic device determines that the position of APP11 is the same as the position of one of the two pairs of wireless headphones, step S906 is executed; if not, the electronic device can continue to monitor the APP window status, that is, step S903 is executed.

S906: The electronic device sends the audio data of the two audio-output APPs to the corresponding earphones according to the directions.

The electronic device can send the audio data of the two audio-output APPs to the corresponding headphones according to the window status of the two audio-output APPs and the orientation of the application windows of the two audio-output APPs in the display screen. Since the window status of the two audio-output APPs can be divided into multiple situations, the following will describe how the electronic device specifically sends the audio data of the two audio-output APPs to the corresponding headphones according to different situations.

In the embodiment of the present application, APP11 may be a full-screen APP, a floating APP, or a split-screen APP. APP2 may also be a full-screen APP, a floating APP, or a split-screen APP.

It is understandable that in the embodiment of the present application, when the current display state of an application window of an APP is full-screen display (that is, an application window of an APP is currently a full-screen window), the APP can be called a full-screen APP. When the current display state of an application window of an APP is split-screen display (that is, an application window of an APP is currently a split-screen window), the APP can be called a split-screen APP. When the current display state of an application window of an APP is suspended display (that is, an application window of an APP is currently a suspended window), the APP can be called a suspended APP.

Case 1: APP11 is a floating APP, APP22 is a full-screen APP

APP11 can be a floating APP, that is, the application window of APP11 is a floating window. APP22 can be a full-screen APP, that is, the application window of APP22 is a full-screen window. It can be understood that the application window of APP11 is displayed floatingly above the application window of APP22. For example, the video playback window 101 of the video playback APP shown in FIG. 4A is a full-screen window, and the call window 103 of the call APP is a floating window. The call window 103 is displayed floatingly above the video playback window 101.

When the electronic device determines that the orientation of the application window of the floating APP is the same as the orientation of any one of the two pairs of wireless headphones, the electronic device can send the audio data of the two audio-output APPs to the corresponding headphones according to the orientation. For example, when the orientation of the application window of APP11 is the same as the orientation of earphone 200 in two pairs of wireless headphones (such as earphone 200 and earphone 300), the electronic device can send the audio data of APP11 to earphone 200 and the audio data of APP22 to earphone 300; when the orientation of the application window of APP11 is the same as the orientation of earphone 300, the electronic device can send the audio data of APP11 to earphone 300 and the audio data of APP22 to earphone 200.

In some feasible examples, if the electronic device determines that the orientation of the application window of APP11 is different from the orientation of the two pairs of wireless headphones, for example, the application window of APP11 is in the middle area of the display screen of the electronic device (for example, the call window 103 shown in Figure 4C is located on the central axis of the display screen of the tablet 100, or the area 501 shown in Figure 5), the electronic device can send the audio data of APP11 to headphones 200 and headphones 300.

Optionally, in other feasible examples, if the electronic device determines that the orientation of the application window of APP11 and the orientation of the two pairs of wireless headphones are different, for example, APP11 is in the middle area of the display screen of the electronic device (for example, the call window 103 shown in Figure 4D is located on the central axis of the display screen of the tablet 100, or the area 501 shown in Figure 5), the electronic device can send the audio data of APP11 and the audio data of APP22 to the headset 200, and send the audio data of APP11 and the audio data of APP22 to the headset 300.

Case 2: APP11 is a floating APP, APP22 is a floating APP

APP11 can be a floating APP, that is, the application window of APP11 is a floating window. APP22 can also be a floating APP, that is, the application window of APP22 is a floating window. For example, the video playback window 101 of the video playback APP shown in FIG. 3A is a floating window, and the audio playback window 102 of the audio playback APP is also a floating window. The video playback window 101 and the audio playback window 102 can be displayed in a floating manner on the main interface of the electronic device or the full-screen window of other applications.

The electronic device can send the audio data of two audio-outputting APPs to the earphones with the same orientation based on the orientation of the application windows of the two audio-outputting APPs. For example, when the electronic device determines that the orientation of the application window of APP11 is the same as the orientation of earphone 200, and the orientation of the application window of APP22 is the same as the orientation of earphone 300, the electronic device sends the audio data of APP11 to earphone 200 and the audio data of APP22 to earphone 300. The data is sent to the headset 300. When the electronic device determines that the orientation of the application window of APP11 is the same as the orientation of the headset 300 and the orientation of the application window of APP22 is the same as the orientation of the headset 200, the electronic device sends the audio data of APP11 to the headset 300 and sends the audio data of APP22 to the headset 200.

Case 3: APP11 is a split-screen APP, APP22 is a split-screen APP

APP11 and APP22 can be split-screen APPs, that is, the application window of APP11 and the application window of APP22 can be split-screen displayed in the electronic device. For example, the video playback window 101 of the audio playback APP and the audio playback window 102 of the audio playback APP shown in FIG. 3B are split-screen displayed in the tablet 100.

The electronic device can send the audio data of two audio-outputting APPs to the earphones with the same orientation based on the orientation of the application windows of the two audio-outputting APPs. For example, when the electronic device determines that the orientation of the application window of APP11 is the same as the orientation of the earphone 200, and the orientation of the application window of APP22 is the same as the orientation of the earphone 300, the electronic device sends the audio data of APP11 to the earphone 200, and sends the audio data of APP22 to the earphone 300. When the electronic device determines that the orientation of the application window of APP11 is the same as the orientation of the earphone 300, and the orientation of the application window of APP22 is the same as the orientation of the earphone 200, the electronic device sends the audio data of APP11 to the earphone 300, and sends the audio data of APP22 to the earphone 200.

In an embodiment of the present application, the electronic device can send the audio data of the two audio output APPs to the headphones with the same orientation based on the status and orientation of the application windows of the two audio output APPs. In this way, the user wearing the headphones 200 and the user wearing the headphones 300 can choose to keep the orientation of the headphones and the application window of one of the two audio output APPs the same based on user needs, so as to listen to the audio data of the audio APP they want to listen to. Moreover, the user wearing the headphones 200 can also listen to the audio data of different audio APPs with the user wearing the headphones 300.

In an audio transmission method provided in the above-mentioned Figures 8 and 9, the electronic device starts to detect the position of the earphone after determining that the electronic device has opened two APPs that output audio. In this way, the power consumption of the electronic device can be saved. In some scenarios, in order to shorten the waiting time for the electronic device to send the audio data of the two APPs to different earphones. The electronic device can monitor the position of the two earphones immediately after the electronic device is connected to two wireless earphones. Exemplarily, Figure 10 provides an audio transmission method, in which the electronic device monitors the position of the two pairs of wireless earphones after connecting them. Then, after the electronic device opens two APPs that output audio, the audio data of the two APPs that output audio are sent to different earphones respectively according to the position of the application windows of the two APPs that output audio.

As shown in FIG. 10 , an audio transmission method provided in an embodiment of the present application may specifically include the following steps:

S1000a: The electronic device establishes a Bluetooth connection with the headset 200 based on user operation 1.

S1000b: The electronic device establishes a Bluetooth connection with the headset 300 based on user operation 2.

Step S1000a may refer to the description in the above step S800a, which will not be described in detail here. Step S1000b may refer to the description in the above step S800b, which will not be described in detail here.

S1001a, the electronic device monitors the position of the earphone 200.

S1001b, the electronic device monitors the position of the earphone 300.

After the electronic device connects the earphone 200 and the earphone 300, the electronic device may start to monitor the position of the earphone 200 and the position of the earphone 300. Specifically, the description of step S1001a may refer to the description of step S804a, which will not be repeated here. The description of step S1001b may refer to the description of step S804b, which will not be repeated here.

S1002 . Based on user operation 3 , the electronic device starts a full-screen APP1 that outputs audio data data1 .

The description of step S1002 refers to the above step S801 and will not be repeated here.

S1003a : The electronic device sends the audio data data1 to the earphone 200 .

S1003b : The electronic device sends the audio data data1 to the earphone 300 .

Step S1003a may refer to the description in the above step S802a, which is not repeated here. Step S1003b may refer to the description in the above step S802b, which is not repeated here.

S1004. Based on user operation 4, the electronic device starts the floating APP2 that outputs the audio data data2, and displays the floating APP2 in the first area of the display screen of the electronic device.

The description of step S1004 may refer to step S804 and will not be repeated here.

S1005: The electronic device determines that the earphone 200 is located at the position d1, and the earphone 300 is located at the position d2, and the position d1 is the same as the position of the first area in the display screen.

The description of step S1005 may refer to that of step S805 and will not be repeated here.

S1006 : The electronic device stops sending the audio data data1 to the earphone 200 , and sends the audio data data2 to the earphone 200 .

The description of step S1006 may refer to that of step S806 and will not be repeated here.

S1007. Based on user operation 5, the electronic device displays the floating APP2 in the second area of the display screen, and determines that the position of the second area in the display screen is the same as the position d2.

For step S1007, reference may be made to the description in step S807, which will not be repeated here.

S1008a: The electronic device stops sending the audio data data2 to the earphone 200, and sends the audio data data1 to the earphone 200.

S1008b: The electronic device stops sending the audio data data1 to the earphone 300, and sends the audio data data2 to the earphone 300.

Step S1008a and step S1008b may refer to the description of the above-mentioned step S808a and step S808b, which will not be repeated here.

S1009: Based on user operation 6, the electronic device displays the floating APP 2 in the third area of the display screen.

Step S1009 may refer to the description of the above step S809 and will not be repeated here.

S1010a : The electronic device sends the audio data data1 and the audio data data2 to the headset 200 .

S1010b : The electronic device sends the audio data data1 and the audio data data2 to the headset 300 .

Step S1010a and step S1010b may refer to the description of the above-mentioned step S810a and step S810b, which will not be repeated here.

S1011. The electronic device exits the floating APP2 based on the user operation 7.

Step S1011 may refer to the description of the above step S811 and will not be repeated here.

S1012a : The electronic device sends the audio data data1 to the headset 200 .

S1012b : The electronic device sends the audio data data1 to the headset 200 .

Step S1012a and step S1012b may refer to the description of the above-mentioned step S812a and step S812b, which will not be repeated here.

FIG. 11 shows an audio transmission method provided in an embodiment of the present application.

In some scenarios, when the electronic device determines that two pairs of headphones are connected to the electronic device, the electronic device starts to detect the position of the headphones. In this way, when two apps that output audio are opened in the electronic device, the electronic device can quickly determine to send the audio data of the two apps to the corresponding headphones according to the position of the headphones without waiting to determine the position of the headphones.

As shown in FIG. 11 , an audio transmission method provided in an embodiment of the present application may include the following steps:

S1101: Is the electronic device connected to two wireless headphones? If so, execute step S1102a; if not, execute step S1102b.

The electronic device may be connected to multiple pairs of headphones. When the electronic device is connected to at least two pairs of headphones, such as the headphones 200 and 300 mentioned above, the electronic device may start to monitor the position of the headphones, that is, execute the following step S1102a.

When the electronic device is not connected to a wireless headset or is only connected to a pair of wireless headsets, the electronic device may stop detecting the orientation of the headset, ie, execute step S1102b.

In some scenarios, when the electronic device determines that two pairs of wireless headphones are not connected, the electronic device may continuously monitor whether two pairs of wireless headphones are connected, that is, continuously execute step S1101.

S1102a. The electronic device monitors the position of the earphone.

When the electronic device determines that two pairs of wireless headphones are connected, the electronic device can start to monitor the position of the headphones. How the electronic device detects the position of the headphones can refer to the description in Figures 6 and 7 above, which will not be repeated here.

S1102b. The electronic device stops monitoring the position of the earphone.

S1103: The electronic device determines whether two apps that output audio are turned on. If so, step S1104 is executed. If not, step S1103 is continued.

When the electronic device determines that two APPs that output audio are turned on: APP11 that outputs audio and APP22 that outputs audio, the electronic device can detect the window status of the two APPs. For example, APP11 and APP22 can be the video APPs, call APPs in Figures 4A-4D, or the full-screen APP1 and floating APP2 involved in Figure 8. The embodiment of the present application does not limit the specific type and name of APP11 and APP22. When the electronic device determines that two APPs with audio output are turned on, the electronic device can execute the following step S1104.

S1104. The electronic device monitors the APP window status.

When the electronic device determines to start two APPs that output audio, namely APP11 and APP22, the electronic device can monitor the application of APP11. The status of the application window of APP11 and APP22. The status of APP11 and APP22 can be full screen display, floating display or split screen display, etc.

S1105. The electronic device determines whether the position of the floating APP is the same as the position of one of the two headphones. If so, execute step S1106; if not, continue to execute step S1104.

If the electronic device determines that APP11 or APP22 of the two APP11 and APP22 that output audio is a floating APP (hereinafter, APP11 is taken as an example of a floating APP), the electronic device needs to determine the floating APP, for example, the position of APP11 is the same as the position of one of the two pairs of wireless headphones. If the electronic device determines that the position of APP11 is the same as the position of one of the two pairs of wireless headphones, step S1106 is executed; if not, the electronic device can continue to monitor the APP window status, that is, step S1104 is executed.

S1106. The electronic device sends the audio data of the two audio-output APPs to the corresponding earphones according to the directions.

The electronic device can send the audio data of the two audio output APPs to the corresponding headphones according to the window states of the two audio output APPs and the positions of the application windows of the two audio output APPs on the display screen. For details, please refer to the description in step S906, which will not be repeated here.

In an embodiment of the present application, the electronic device can send the audio data of the two audio output APPs to the headphones with the same orientation based on the status and orientation of the application windows of the two audio output APPs. In this way, the user wearing the headphones 200 and the user wearing the headphones 300 can choose to keep the headphones in the same orientation as the application window of one of the two audio output APPs based on user needs, so as to listen to the audio data of the audio APP they want to listen to. Moreover, the user wearing the headphones 200 can also listen to the audio data of different audio APPs with the user wearing the headphones 300.

Furthermore, the electronic device can start monitoring the position of the earphones when two pairs of earphones are connected. In this way, the electronic device can timely send the audio data of the two audio output APPs to the earphones with the same position.

The following introduces an exemplary electronic device 1200 provided in an embodiment of the present application.

FIG. 12 is a schematic diagram of the structure of an electronic device 1200 provided in an embodiment of the present application.

The embodiment is described in detail below by taking the electronic device 1200 as an example. It should be understood that the electronic device 1200 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

The electronic device 1200 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194 and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 1200. In other embodiments of the present application, the electronic device 1200 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated in one or more processors.

The controller may be the nerve center and command center of the electronic device 1200. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (SIM) interface, and/or a universal serial bus (USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the electronic device 1200.

The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.

The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 1200. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 1200.

The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

The SIM interface can be used to communicate with the SIM card interface 195 to implement the function of transmitting data to the SIM card or reading data in the SIM card.

The USB interface 130 is an interface that complies with USB standard specifications, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 1200, and can also be used to transmit data between the electronic device 1200 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 1200. In other embodiments of the present application, the electronic device 1200 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The charging management module 140 is used to receive charging input from a charger, where the charger can be a wireless charger or a wired charger.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.

The wireless communication function of the electronic device 1200 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 1200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

The mobile communication module 150 can provide solutions for wireless communications including 2G/3G/4G/5G, etc., applied to the electronic device 1200. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), Etc. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, and filter, amplify and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 can be set in the same device as at least some modules of the processor 110.

The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) and the like applied to the electronic device 1200. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

In some embodiments, the antenna 1 of the electronic device 1200 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 1200 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and/or a satellite based augmentation system (SBAS).

The electronic device 1200 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (QLED), etc. In some embodiments, the electronic device 1200 may include 1 or N display screens 194, where N is a positive integer greater than 1.

The electronic device 1200 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 1200 may include 1 or N cameras 193, where N is a positive integer greater than 1.

Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals. For example, When the electronic device 1200 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

Video codecs are used to compress or decompress digital videos. The electronic device 1200 may support one or more video codecs. Thus, the electronic device 1200 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

NPU is a neural network (NN) computing processor, which can quickly process input information and continuously self-learn by drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain. NPU can realize applications such as intelligent cognition of electronic device 1200, such as image recognition, face recognition, voice recognition, text understanding, etc.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 1200. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.

The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 1200 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, applications required for at least one function (such as face recognition function, fingerprint recognition function, mobile payment function, etc.), etc. The data storage area may store data created during the use of the electronic device 1200 (such as face information template data, fingerprint information template, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

The electronic device 1200 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 1200 can listen to music or listen to a hands-free call through the speaker 170A.

The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 1200 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 1200 can be provided with at least one microphone 170C. In other embodiments, the electronic device 1200 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 1200 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

The earphone interface 170D is used to connect a wired earphone. The earphone interface 170D may be the USB interface 130, or may be a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

The pressure sensor 180A is used to sense pressure signals and convert the pressure signals into electrical signals.

The gyro sensor 180B may be used to determine the motion posture of the electronic device 1200 .

The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 1200 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

The magnetic sensor 180D includes a Hall sensor, and the electronic device 1200 can detect the opening and closing of the flip leather case by using the magnetic sensor 180D.

The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 1200 in all directions (generally three axes). When the electronic device 1200 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

The distance sensor 180F is used to measure the distance. The electronic device 1200 can measure the distance by infrared or laser.

The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 1200 emits infrared light outward through the light emitting diode. The electronic device 1200 uses the photodiode to detect infrared reflected light from nearby objects.

The ambient light sensor 180L is used to sense the brightness of the ambient light. The electronic device 1200 can adaptively adjust the brightness of the display screen 194 according to the sensed brightness of the ambient light.

The fingerprint sensor 180H is used to collect fingerprints.

The temperature sensor 180J is used to detect the temperature.

The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it.

The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 1200 may receive key input and generate key signal input related to user settings and function control of the electronic device 1200.

Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.

The indicator 192 may be an indicator light, which may be used to indicate the charging status, power changes, messages, missed calls, notifications, etc.

The SIM card interface 195 is used to connect a SIM card. The electronic device 1200 interacts with the network through the SIM card to implement functions such as calls and data communications.

It can be understood that the electronic device 1200 shown in FIG. 12 may be the tablet 100 or the electronic device involved in the above embodiments.

FIG. 13 is a block diagram of the software and hardware structure of an electronic device 1300 according to an embodiment of the present application.

The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the system of the electronic device 1300 is divided into an application layer, a framework layer, and a hardware abstraction layer. In addition, the electronic device 1300 also includes a hardware layer. The electronic device 1300 can implement the audio transmission method shown in Figures 8 to 11 by combining the software architecture layer and the hardware layer.

The application layer can include a series of application packages.

As shown in FIG. 13 , the application package may include applications such as APP1, APP2, APP3, …, APPn, etc. Among them, APP1 and APP2 may be applications that can output audio, such as music, video, call, etc. APP3, …, APPn may be applications (also referred to as applications) such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

As shown in FIG. 13 , the framework layer may include a media service module, an application window monitoring service module, a Bluetooth service module, and the like.

The media service module may include an audio flinger module for executing an audio policy. The audio mixer in the audio flinger module may be used to mix the audio stream 1 and the audio stream 2 respectively input by APP1 and APP2 of the application layer according to the mixing logic specified by the application window monitoring service module, and send the mixed audio to the Bluetooth hardware abstraction layer module in the hardware abstraction layer (HAL).

The application window monitoring service module can be used to monitor the position and status of the application window, that is, to monitor whether the application window is on the left, right or middle of the display screen, and to monitor whether the application window is a full-screen window, a floating window, or a split-screen window.

The application window monitoring service module can also be used to formulate mixing logic based on the application window position and state, and send the mixing logic to the audio mixer.

The audio mixer can choose whether to mix based on the mixing logic, and allocate the application's audio stream to the system pulse code modulation (PCM) audio stream channel 2 or the system PCM audio stream channel 1 based on the mixing logic.

Specifically, the audio mixer may allocate the audio stream of the application based on the mixing logic, including the following situations:

1. When the application window monitoring service module detects that the electronic device opens an APP that outputs audio, such as APP1, the mixing logic can be: the audio mixer does not need to perform mixing, and allocates the audio stream of APP1 to system PCM audio stream channel 1 and system PCM audio stream channel 2.

2. When the application window monitoring service module detects that the electronic device has two APPs with audio output, such as APP1 and APP2, and the application window of APP1 is a full-screen window and the application window of APP2 is a floating window, the following mixing logics may exist:

A: When the floating window is on the left or right side of the display screen, the audio mixer does not need to perform mixing, and the audio stream of the floating window and the audio stream of the full-screen window are assigned to different system PCM audio stream channels. Specifically, if the floating window is on the left side of the display screen, the audio mixer assigns the audio stream of the floating window to system PCM audio stream channel 2; and assigns the audio stream of the full-screen window to another system PCM audio stream channel, namely, system PCM audio stream channel 1. If the floating window is on the right side, the audio mixer assigns the audio stream of the floating window on the right side of the display screen to system PCM audio stream channel 1; and assigns the audio stream of the full-screen window to another system audio PCM stream channel, namely, system PCM audio stream channel 2.

B: When the floating window is on the left or right side of the display screen, the audio mixer needs to mix the audio and send the mixed audio stream to one system PCM audio stream channel, and the unmixed audio stream of the full-screen window to another system PCM audio stream channel. Specifically, if the floating window is on the left side of the display screen, the audio mixer mixes the audio stream of the floating window and the audio stream of the full-screen window and assigns them to system PCM audio stream channel 2; and assigns the audio stream of the full-screen window to another system PCM audio stream channel, namely, system PCM audio stream channel 1. If the floating window is on the right side, the audio mixer mixes the audio stream of the floating window on the right side of the display screen and the audio stream of the full-screen window and assigns them to system PCM audio stream channel 1; and assigns the audio stream of the full-screen window to another system PCM audio stream channel, namely, system PCM audio stream channel 2.

C: When the floating window is in the middle of the display screen, the audio mixer needs to mix the audio and send the mixed audio stream to two system PCM audio stream channels. Specifically, when the floating window is in the middle of the display screen, the audio mixer mixes the audio stream of the floating window and the audio stream of the full-screen window and distributes them to system PCM audio stream channel 2 and system PCM audio stream channel 1.

3. When the application window monitoring service module detects that the electronic device has opened two APPs with output audio, such as APP1 and APP2, and the application window of APP1 and the application window of APP2 are floating windows or split-screen windows, the mixing logic can be: the audio mixer can choose not to mix, and based on the orientation of the application window, the audio stream of the application window on the left is assigned to the system PCM audio stream channel 2, and the audio stream of the application window on the right is assigned to the system PCM audio stream channel 1.

The application window monitoring service module can also be used to detect that two apps that output audio are opened in the electronic device 1300, and notify the earphone positioning service module in the Bluetooth service module to obtain the earphone position.

The Bluetooth service module may include a headset positioning service module. The headset positioning service module may be used to start acquiring the headset position based on the instruction sent by the application window monitoring service module, or may be used to start acquiring the headset position when two pairs of wireless headsets are detected to be connected. The headset positioning service module may also be used to send the acquired headset position information to the headset data stream allocation unit in the Bluetooth hardware abstraction layer module.

The hardware abstraction layer HAL may include a Bluetooth hardware abstraction layer module. The headphone data stream distribution unit in the Bluetooth hardware abstraction layer module may receive audio data sent by the audio mixer through the system PCM audio stream channel 2 and the system PCM audio stream channel 1, as well as the headphone position information sent by the headphone positioning service module. The headphone data stream distribution unit may distribute the audio data sent by the system PCM audio stream channel 2 and the system PCM audio stream channel 1 to the headphone based on the headphone position information. Exemplarily, the headphone data stream distribution unit may distribute the audio stream of the application in the system PCM audio stream channel 2 to the headphone located on the left, and distribute the audio stream of the application in the system PCM audio stream channel 1 to the headphone located on the right. The audio stream of the application in the system PCM audio stream channel 2 may be the audio data of the APP located on the left side of the display screen of the electronic device 1300.

The headset data stream distribution unit can send the audio stream allocated to the headset 200 (for example, the audio stream in the system PCM audio stream path 2) to the Bluetooth chip in the hardware layer, and the Bluetooth chip sends the audio stream to the headset 200. The headset data stream distribution unit can send the audio stream allocated to the headset 300 (for example, the audio stream in the system PCM audio stream path 1) to the Bluetooth chip in the hardware layer, and the Bluetooth chip sends the audio stream to the headset 300.

Exemplarily, taking the application window of APP1 as a full-screen window, the application window of APP2 as a floating window, and the application window of APP2 on the left side of the display screen as an example, it is explained how each module in the electronic device 1300 specifically distributes the audio streams of APP1 and APP2 to headphones 200 and headphones 300.

When the application window monitoring service of the electronic device 1300 detects that the application window of APP1 is a full-screen window, the application window of APP2 is a floating window, and the application window of APP2 is on the left side of the display screen, the mixing logic formulated by the application window monitoring service can be: if the floating window is on the left side of the display screen, the audio mixer does not need to mix. Then the audio mixer assigns the audio stream of the floating window to the system audio stream channel 2; and assigns the audio stream of the full-screen window to another audio stream channel, namely the system PCM audio stream channel 1.

The application window monitoring service can send the mixing logic and the monitored window display mode and position of APP1 and APP2 to the audio mixer. Based on the mixing logic and the window display mode and position of APP1 and APP2, the audio mixer determines that there is no need to mix the audio stream of APP1 and the audio stream of APP2. The audio mixer assigns the audio stream of APP2 to the system audio stream channel 2; and assigns the audio stream of APP1 to another audio stream channel, namely the system PCM audio stream channel 1.

When the headset data stream distribution unit receives the headset orientation information that the headset 200 is on the left and the headset 300 is on the right, the headset data stream distribution unit distributes the audio stream of APP2 in the system audio stream channel 2 to the headset 200, and distributes the audio stream of APP1 in the system PCM audio stream channel 1 to the headset 300. In this way, the user of the headset 200 can listen to the audio data of APP2, and the user of the headset 300 can listen to the audio data of APP1.

It can be understood that the electronic device 1300 shown in FIG. 13 may be the tablet 100 or the electronic device involved in the above embodiments.

The above content elaborates on the method provided by the present application. In order to facilitate better implementation of the above scheme of the embodiment of the present application, the embodiment of the present application also provides corresponding devices or equipment.

The embodiment of the present application can divide the functional modules of the electronic device and the wireless headset (such as headset 200, headset 300) according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

As a possible product form, the electronic device described in the embodiment of the present application can be implemented with a general bus body structure.

Referring to FIG. 14, FIG. 14 is a schematic diagram of the structure of a device 1400 provided in an embodiment of the present application. The device 1400 may be the device 1400 of FIG. 1 to FIG. 6. And the tablet 100, or the electronic device involved in Figures 8-11, or the device therein. As shown in Figure 14, the device 1400 may include an antenna array module 1401, a switch 1402, a short-range chip 1403, a processor 1404, and an audio decoder 1405. Among them, the antenna array module 1401 can be used to receive a Bluetooth signal sent by a wireless headset, or send a Bluetooth signal to a wireless headset. The switch 1402 can be used to switch multiple antennas in the antenna array module 1401. The short-range chip 1403 can be used to perform angle detection and distance estimation based on the Bluetooth signal obtained by the antenna array module 1401. The processor 1404 can be used to distribute the audio data of the two audio APPs to the corresponding wireless headsets based on the orientation of the application windows of the two audio output APPs in the display screen and the orientation of the wireless headset connected to the device 1400. The audio decoder 1405 can be used to decode the audio output by the APP in the device 1400, and to package the audio data of each APP into a sequence according to different scenarios, or to package the audio data of each APP into multiple sequences.

In one design, the apparatus 1400 may be used to perform the functions of the tablet 100 or the electronic device in the aforementioned embodiments.

As a possible product form, the earphone 200 or earphone 300 described in the embodiment of the present application can be implemented with a general bus body structure.

Referring to FIG. 15 , FIG. 15 is a schematic diagram of the structure of a device 1500 provided in an embodiment of the present application. The device 1500 may be the earphone 200 or earphone 300 involved in the aforementioned embodiments, or a device in the earphone 200 or earphone 300. As shown in FIG. 15 , the device 1500 may include a Bluetooth micro-control processing unit MCU chip 1501, a microphone 1502, an earpiece 1503, and a Bluetooth antenna 1504. Among them, the Bluetooth micro-control processing unit MCU chip 1501 can be used to process the received audio signal, for example, digital-to-analog conversion, amplification, etc. The microphone 1502 can be used to collect sound signals and convert the sound signals into electrical signals. The earpiece 1503 can be used to play sound signals. The Bluetooth antenna 1504 can be used to send and receive Bluetooth signals.

In one design, the apparatus 1500 may be used to perform the functions of the earphone 200 or the earphone 300 in the aforementioned embodiments.

As a possible product form, the electronic device described in the embodiment of the present application can be implemented in the form of a software function module.

Referring to FIG. 16 , FIG. 16 is a schematic diagram of the structure of an apparatus 1600 provided in an embodiment of the present application. The apparatus 1600 may be the tablet 100 involved in FIGS. 1 to 6 , or the electronic device involved in FIGS. 8 to 11 , or an apparatus therein. As shown in FIG. 16 , the apparatus 1600 may include a communication module 1601, a display module 1602, and an audio distribution module 1603. Among them:

The communication module 1601 may be configured to establish a communication connection with a first audio device and a second audio device.

The display module 1602 is used to display a first window and a second window on the display screen in the device 1600, wherein the first window may be an application window of a first application, the first window plays first audio data, and the second window is an application window of a second application, the second window plays second audio data.

The first window and the second window may be any one of the video play window 101, the audio play window 102 or the call window 103 in the above-mentioned embodiment, respectively.

The audio distribution module 1603 can be used to send the first audio data to the first audio device and the second audio data to the second audio device according to the status of the first window and the second window on the display screen in the device 1600 and the orientation of the first audio device and the second audio device.

Optionally, the apparatus 1600 may further include a device sensing module, which may be used to detect an angle between the first audio device and the apparatus 1600 (which may be referred to as the azimuth of the first audio device) and/or a distance between the first audio device and the apparatus 1600. The device sensing module may also be used to detect an angle between the second audio device and the apparatus 1600 (which may be referred to as the azimuth of the second audio device) and/or a distance between the second audio device and the apparatus 1600.

Optionally, the device 1600 may further include an application position monitoring module, which may be used to detect the display mode of the first window and the position of the first window on the display screen, and to detect the display mode of the second window and the position of the second window on the display screen.

Optionally, device 1600 may also include an audio processing module, which can be used to determine whether to package the first audio data of the first window and the second audio data of the second window into one audio sequence, or package them into multiple audio sequences and send them to the first audio device and the second audio device at corresponding locations according to the display mode of the first window and the second window and the position of the first window and the second window on the display screen.

In one design, the apparatus 1600 may be used to perform the functions of the tablet 100 or the electronic device in the aforementioned embodiments.

As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrase "when determining..." or "if detecting (the stated condition or event)" may also be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. “If it is determined that…” or “in response to determining that…” or “upon detection of (stated condition or event)” or “in response to detecting (stated condition or event)”.

In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.

A person skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by a computer program to instruct the relevant hardware, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above-mentioned method embodiments. The aforementioned storage medium includes: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

Claims

An audio transmission method, characterized by comprising:

The electronic device establishes a connection with the first audio device and the second audio device;

The electronic device displays a first window and a second window on a display screen, wherein the first window is an application window of the first application, the first window plays first audio data, and the second window is an application window of the second application, the second window plays second audio data;

The electronic device sends the first audio data to the first audio device and sends the second audio data to the second audio device according to the status of the first window and the second window on the display screen, and the orientation of the first audio device and the orientation of the second audio device.
The method according to claim 1 is characterized in that the state of the first window on the display screen includes the display mode of the first window and/or the position of the first window on the display screen; the state of the second window on the display screen includes the display mode of the second window and/or the position of the second window on the display screen; wherein the display mode includes full-screen display, floating display, and split-screen display.
The method according to claim 2 is characterized in that the display mode of the first window is full screen display, the display mode of the second window is floating display, and the electronic device sends the first audio data to the first audio device and sends the second audio data to the second audio device according to the status of the first window and the second window on the display screen, and the orientation of the first audio device and the orientation of the second audio device, specifically comprising:

The electronic device sends the second audio data to the second audio device based on the position of the second window on the display screen and the orientations of the first audio device and the second audio device, wherein the position of the second window on the display screen matches the position of the second audio device relative to the first audio device, and the position of the second audio device relative to the first audio device is determined by the orientations of the first audio device and the orientation of the second audio device.
The method according to claim 2 is characterized in that the display mode of the first window and the second window is split-screen display, or the display mode of the first window and the second window is suspended display, and the electronic device sends the first audio data to the first audio device and sends the second audio data to the second audio device according to the state of the first window and the second window on the display screen, and the orientation of the first audio device and the orientation of the second audio device, specifically comprising:

The electronic device sends the first audio data to the first audio device and sends the second audio data to the second audio device based on the position of the first window on the display screen, the position of the second window on the display screen, and the orientation of the first audio device and the orientation of the second audio device, wherein the position of the first window on the display screen matches the position of the first audio device relative to the second audio device, the position of the second window on the display screen matches the position of the second audio device relative to the first audio device, and the position of the first audio device relative to the second audio device and the position of the second audio device relative to the first audio device are determined by the orientation of the first audio device and the orientation of the second audio device.
The method according to any one of claims 3 or 4, characterized in that the position of the second window on the display screen matches the position of the second audio device relative to the first audio device, comprising:

The second window is on the left side of the display screen, and the position of the second audio device relative to the first audio device is that the second audio device is located on the left side of the first audio device; or,

The second window is on the right side of the display screen, and the position of the second audio device relative to the first audio device is that the second audio device is located on the right side of the first audio device.
The method according to claim 4, wherein the position of the first window on the display screen matches the position of the first audio device relative to the second audio device, comprising:

The first window is on the left side of the display screen, and the position of the first audio device relative to the second audio device is that the first audio device is on the left side of the second audio device; or,

The first window is on the right side of the display screen, and the position of the first audio device relative to the second audio device is that the first audio device is located on the right side of the second audio device.
The method according to claim 3, characterized in that the electronic device sends the audio data of the second window to the second audio device according to the position of the second window on the display screen, the orientation of the first audio device and the orientation of the second audio device, specifically comprising:

When the second window is in the middle area of the display screen, the electronic device sends the second audio data to the first audio device and the second audio device simultaneously.
The method according to claim 7, characterized in that the method further comprises:

When the second window is in the middle area of the display screen, the electronic device stops sending the first audio data to the first audio device; or, the electronic device sends the first audio data to the first audio device and the second audio device at the same time.
The method according to claim 5 or 6 is characterized in that the second window is on the left side of the display screen, and the position of the second audio device relative to the first audio device is that the second audio device is on the left side of the first audio device, and after the electronic device sends the audio data of the second window to the second audio device according to the position of the second window on the display screen and the orientations of the first audio device and the second audio device, the method further comprises:

Based on a first user operation, the electronic device moves the second window from a left side of the display screen to a right side of the display screen;

The electronic device sends the first audio data to the second audio device and stops sending the second audio data to the second audio device; the electronic device sends the second audio data to the first audio device and stops sending the first audio data to the first audio device.
The method according to any one of claims 1-9 is characterized in that the position of the first audio device is calculated by the electronic device based on the received Bluetooth signal sent by the first audio device; the position of the second audio device is calculated by the electronic device based on the received Bluetooth signal sent by the second audio device.
An audio transmission system, characterized in that the audio transmission system includes an electronic device and a first audio device and a second audio device, the electronic device establishes a communication connection with the first audio device and the second audio device respectively, and the electronic device, the first audio device, and the second audio device are used to execute the audio transmission method described in any one of claims 1-10.
An electronic device, characterized in that it includes a memory, a processor, and a display screen, wherein the memory, the display screen, and the processor are electrically coupled, the display screen is used to display an application window of an application for playing audio data in the electronic device, the memory is used to store program instructions, and the processor is configured to call all or part of the program instructions stored in the memory so that the electronic device executes the method according to any one of claims 1 to 10.
A computer storage medium, characterized in that it includes computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 10.