WO2022078056A1

WO2022078056A1 - Audio playback method and apparatus, electronic device, and storage medium

Info

Publication number: WO2022078056A1
Application number: PCT/CN2021/113242
Authority: WO
Inventors: 张辉; 陈光明; 钟卫东; 张斌; 杨俊拯
Original assignee: Oppo广东移动通信有限公司
Priority date: 2020-10-15
Filing date: 2021-08-18
Publication date: 2022-04-21
Also published as: CN112181353B; CN112181353A

Abstract

Disclosed in the present application are an audio playback method and apparatus, an electronic device, and a storage medium, the method being used in the electronic device, the electronic device comprising at least one built-in audio output apparatus and at least one externally-connecting audio output apparatus, each audio output apparatus comprising a plurality of audio output channels, and the method comprising: acquiring the number of a plurality of audio input devices and audio output apparatuses; on the basis of the number of the plurality of audio input devices and the number of audio output apparatuses, allocating at least one audio output channel of at least one audio output apparatus to each audio input device, the audio output channel allocated to each audio input device being different; acquiring audio data transmitted by the plurality of audio input devices; and, on the basis of the audio output channel allocated to each audio input device, implementing playback of the audio data transmitted by each audio input device. The present method enables the user to conveniently clearly distinguish the sound inputted by different audio input devices, enhancing the user experience.

Description

Audio playback method, device, electronic device and storage medium

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to Chinese Application No. 202011105792.0 filed on October 15, 2020, which is hereby incorporated by reference in its entirety for all purposes.

technical field

The present application relates to the field of audio technology, and more particularly, to an audio playback method, device, electronic device, and storage medium.

Background technique

With the advancement of science and technology, the screen projection function has been widely used in electronic devices. For example, a user can project a video image in a resource providing device (such as a smart phone) to a resource display device (such as a TV) for display, so that the user can view the display content in the resource providing device on the resource display device. In addition, with the development of screen projection technology, in a screen projection application scenario, video images played in multiple resource providing devices can be projected to the same resource display device for display. However, when an electronic device displays a video projected by multiple devices, it usually mixes the audio data in the video projected by multiple devices before playing it, resulting in poor sound playback effect when the video is projected. affect the user experience.

SUMMARY OF THE INVENTION

In view of the above problems, the present application proposes an audio playback method, device, electronic device and storage medium.

In a first aspect, an embodiment of the present application provides an audio playback method, which is applied to an electronic device. The electronic device includes at least one built-in audio output device and at least one external audio output device, and the audio output device includes multiple audio output devices. audio output channels, the method includes: acquiring multiple audio input devices and the number of the audio output devices, wherein the number of the multiple audio input devices is taken as the first number, and the number of the audio output devices is taken as a second quantity; based on the first quantity and the second quantity, allocating at least one audio output channel of at least one audio output device to each audio input device; acquiring audio data transmitted by the plurality of audio input devices; The audio data transmitted by each audio input device is played based on the audio output channel assigned to each audio input device.

In a second aspect, an embodiment of the present application provides an audio playback device, which is applied to an electronic device. The electronic device includes at least one built-in audio output device and at least one external audio output device, and the audio output device includes multiple audio output devices. audio output channels, the device includes: a quantity determination module, an audio distribution module, an audio acquisition module and a playback module, wherein the quantity determination module is used to acquire the number of multiple audio input devices and the audio output devices, Wherein, the number of the plurality of audio input devices is used as the first number, and the number of the audio output devices is used as the second number; the audio distribution module is configured to, based on the first number and the second number, assign each Each audio input device is allocated at least one audio output channel of at least one audio output device; the audio acquisition module is used to acquire the audio data transmitted by the plurality of audio input devices; the playback module is used to The audio output channel allocated by the audio input device plays the audio data transmitted by each audio input device.

In a third aspect, embodiments of the present application provide an electronic device, comprising: one or more processors; a memory; and one or more application programs, wherein the one or more application programs are stored in the memory and Configured to be executed by the one or more processors, the one or more programs are configured to execute the audio playback method provided by the first aspect.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, and the program code can be called by a processor to execute the audio provided in the first aspect. play method.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained from these drawings without creative effort.

FIG. 1 shows a schematic structural diagram of an application environment provided by an embodiment of the present application.

FIG. 2 shows another schematic structural diagram of an application environment provided by an embodiment of the present application.

FIG. 3 shows a flowchart of an audio playback method according to an embodiment of the present application.

FIG. 4 shows a flowchart of an audio playback method according to another embodiment of the present application.

FIG. 5 shows a schematic diagram of a first principle of an audio playback method provided by another embodiment of the present application.

FIG. 6 shows a schematic diagram of a second principle of an audio playback method provided by another embodiment of the present application.

FIG. 7 shows a schematic diagram of a third principle of an audio playback method provided by another embodiment of the present application.

FIG. 8 shows a schematic diagram of a fourth principle of an audio playback method provided by another embodiment of the present application.

FIG. 9 shows a schematic diagram of a fifth principle of an audio playback method provided by another embodiment of the present application.

FIG. 10 shows a schematic diagram of the sixth principle of the audio playback method provided by another embodiment of the present application.

FIG. 11 shows a schematic diagram of a seventh principle of an audio playback method provided by another embodiment of the present application.

FIG. 12 shows a schematic diagram of an eighth principle of an audio playback method provided by another embodiment of the present application.

FIG. 13 shows a flowchart of an audio playback method according to yet another embodiment of the present application.

FIG. 14 shows a flowchart of an audio playback method according to still another embodiment of the present application.

FIG. 15 shows a schematic diagram of the principle of an audio playback method provided by still another embodiment of the present application.

FIG. 16 shows a flowchart of an audio playback method according to yet another embodiment of the present application.

FIG. 17 shows a flowchart of an audio playback method according to still another embodiment of the present application.

FIG. 18 shows a block diagram of an audio playback apparatus according to an embodiment of the present application.

FIG. 19 is a block diagram of an electronic device for executing an audio playback method according to an embodiment of the present application according to an embodiment of the present application.

FIG. 20 is a storage unit for storing or carrying a program code for implementing the audio playback method according to the embodiment of the present application according to the embodiment of the present application.

Detailed ways

In order to make those skilled in the art better understand the solutions of the present application, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application.

At present, the screen projection function is widely used in daily life. Users can project content displayed on one device to another device for display, and can transmit audio data to another device for playback. For example, when a user plays a video through a smart phone, he can project the video played on the mobile terminal to another device (such as a smart TV, etc.) for display, and transmit the audio data of the video to another device for playback, so as to facilitate the user There is a better video viewing experience; for another example, when the user plays music through the smart watch, the user can project the audio playback interface displayed on the smart watch to the computer for display, and output the played music through the computer.

Gradually, some electronic devices can realize the display of the display content projected by multiple devices, and can play the audio data input by multiple devices, but when the electronic device plays the audio data input by multiple devices, it usually Audio input from multiple devices is mixed and then output, but when the audio is played after mixing, the user cannot distinguish the audio input from each device, resulting in a chaotic feeling, resulting in poor playback effect.

In view of the above problems, the inventor proposes the audio playback method, device, electronic device, and storage medium provided by the embodiments of the present application, which can realize the assignment of different audio output channels to different audio input devices, and facilitate users to clearly distinguish different audio input. The sound input by the device enhances the user experience. The specific audio playback method will be described in detail in the following embodiments.

The following describes an application environment of the video rendering method provided by the embodiments of the present application.

Referring to FIG. 1 , FIG. 1 shows an architecture diagram of an application scenario of an embodiment of the present application, and the application scenario may include an electronic device 100 and multiple input devices 200 . The electronic device 100 may be a smart TV or the like as shown in FIG. 1 . Of course, the electronic device 100 may also be other devices with display functions, such as a desktop computer, a notebook computer, etc., which are not limited herein. The input device 200 may be a smart phone, a tablet computer, a smart watch, a computer, or other devices. In this application scenario, the input device 200 can be used as a resource providing device to project the display content to the electronic device 100 for display. Of course, the input device 200 can also transmit the audio content to the electronic device 100 for playback.

In some embodiments, the electronic device 100 and the input device 200 may communicate to complete data interaction. The electronic device 100 and the input device 200 may communicate with each other through a local area network (LAN), or communicate with each other through a wide area network (WAN). For example, the electronic device 100 and the input device 200 can be connected to a router at the same time, and the electronic device 100 and the input device 200 can communicate through the local area network provided by the router; for another example, the electronic device 100 and the input device 200 can communicate with the cloud, and The data interaction between the two is realized through the cloud; for another example, the electronic device 100 and the input device 200 can also establish an end-to-end network connection (ie, a P2P network connection) through Bluetooth, Zigbee, WebRTC and other communication methods, and through the established network connection for communication. Of course, the communication manner between the electronic device 100 and the input device 200 may not be limited.

In some scenarios, the electronic device 100 may be a large-screen device (such as the smart TV shown in FIG. 1 , etc.), and the user can project the display content on the small-screen device such as a smartphone, tablet computer, smart watch, etc., to the large-screen device. display, thereby enhancing the user experience when viewing the displayed content. In addition, the electronic device 100 can simultaneously receive the content projected by the multiple input devices 200 and display the content projected by the multiple input devices 200, so that the content projected by the multiple input devices 200 can be projected to the electronic device 100 for display, so that the user can Viewing the contents projected by multiple input devices 200 at the same time greatly improves the user experience.

In some embodiments, the electronic device 100 may perform a display layout (eg, layout position, size of the display area, etc.) for the display contents input by the multiple input devices according to the received display contents of the multiple input devices 100, and then based on the display layout , after rendering the display content input by multiple input devices, display it on the display screen.

In some embodiments, the electronic device 100 may include a content receiving module, a first capability negotiation module, a layout generating module, and a display rendering module; the input device 200 may include a content acquisition module, a content sending module, and a second capability negotiation module.

The input device 200 can first collect the content as the content to be displayed through the content collection module, and then transmit the content to be displayed to the electronic device 100 through the content sending module wirelessly, and the content receiving module is responsible for receiving the content in the electronic device 100 . At the same time, the second capability negotiation module of the input device 200 and the first capability negotiation module of the electronic device 100 are responsible for negotiating the software and hardware capabilities of both parties. The optimal display parameters (such as resolution/bit rate/frame rate) are fed back to the input device 200 for adaptive tuning. The layout generation module of the electronic device 100 comprehensively considers various factors according to the current constraints (such as the number of input devices connected, the display parameter information of the input device itself, the display parameter information of the electronic device, etc.), and follows the layout principle. , which dynamically generates the display layout. After the current layout mode is generated, it is then handed over to the display rendering module to draw and display the content to be displayed according to the layout.

Referring to FIG. 2 , the electronic device 100 may include at least one built-in first audio output device 140 and at least one externally connected second audio output device 150 . The first audio output device 141 includes at least one first audio output channel 142 , and the second audio output device 143 includes at least one second audio output channel 144 . It should be noted that the number of the first audio output devices 141 may not be limited (only one is shown in FIG. 2 ), and the number of the second audio output devices 143 may be unlimited (only two are shown in FIG. 2 ) , the number of the first audio output channels of the first audio output device 141 may not be limited (only 4 are shown in FIG. 2 ), and the number of the second audio output channels of the second audio output device 143 may not be limited (Only 2 are shown in Figure 2). The electronic device 100 can output sound through the audio output channels of the above audio output devices. When the electronic device 100 receives audio data input from multiple input devices 200 for output, the electronic device 100 can assign at least one audio data to the multiple input devices 200. At least one audio output channel of the above-mentioned audio output device, and ensure that the audio output channels allocated by each input device 200 are different, so that the audio data of each input device 200 will not share the same audio output channel output Audio data, which is convenient for users to distinguish sounds corresponding to audio data of different input devices.

Please refer to FIG. 3, which shows a schematic flowchart of an audio playback method provided by an embodiment of the present application. In a specific embodiment, the audio playback method is applied to the audio playback apparatus 400 shown in FIG. 18 and the electronic device 100 ( FIG. 19 ) equipped with the audio playback apparatus 400 . The electronic device includes at least one built-in audio output device and at least one external audio output device, each of which includes a plurality of audio output channels. The following will take an electronic device as an example to describe the specific process of this embodiment. Of course, it can be understood that the electronic device applied in this embodiment may be a smart TV, a notebook computer, a desktop computer, etc., which is not limited here. The flow shown in FIG. 3 will be described in detail below, and the audio playback method may specifically include the following steps:

Step S110: Acquire the number of multiple audio input devices and the audio output devices, wherein the number of the multiple audio input devices is taken as the first number, and the number of the audio output devices is taken as the second number.

In this embodiment of the present application, the electronic device may receive input audio data from multiple audio input devices, and play the received audio data based on the built-in audio output device and the audio output channels of the external audio output device.

In some embodiments, the audio input device may be an input device in a screen projection scenario, and the audio input device may input audio data to the electronic device for playback, or input display content to the electronic device for display.

In some embodiments, the electronic device may establish a network connection with each audio input device to receive input data from the audio input device according to the established network connection. Wherein, the electronic device can establish a network connection with the audio input device by means of wireless communication, for example, a network connection can be established by means of Bluetooth, WiFi network, etc., and the specific communication method used may not be limited.

Exemplarily, when the electronic device establishes a network connection with the audio input device through the WiFi network, the electronic device can display a list of devices under the same WiFi network, and then detect the user's selection operation on the device, and according to the detected selection operation, and The device selected by the user establishes a network connection. Similarly, establishing a network connection between an electronic device and an audio input device can also be established according to the user's operation on the audio input device. For an audio input device, such as a smartphone, the audio input device can also display the information of the electronic device under the same WiFi network. device list, and then detect the user's selection operation on the device, and establish a network connection with the electronic device selected by the user according to the detected selection operation.

In this embodiment of the present application, when the electronic device plays the audio data input by the audio input device, it can determine the number of audio input devices that input audio data at this time, and the number of audio output devices of the electronic device, so as to determine the number of audio output devices of the electronic device according to the determined number of audio input devices. The number of audio input devices and the number of audio output devices allocate the audio output channels corresponding to the audio input devices. The determined number of audio input devices may be used as the first number, and the determined number of audio output devices may be used as the second number.

In some embodiments, the electronic device may determine the number of audio input devices according to the audio input devices currently established with the network connection. The electronic device can detect the external audio output devices, determine the number of external audio output devices, and can determine the number of its own built-in audio output devices, and then obtain the difference between the number of external audio output devices and the number of built-in audio output devices. and, that is, the number of audio output devices is obtained. As a method, when the electronic device establishes a network connection with the audio input device, the audio input device does not necessarily start to project the screen or input audio to the electronic device, so the electronic device can determine the actual screen projection or input audio data to the electronic device. The number of audio input devices of the electronic device, for example, the electronic device may determine the number of audio input devices that have sent a screen projection command to the electronic device and have established a network connection with the electronic device.

Step S120: Based on the first number and the second number, assign at least one audio output channel of at least one audio output device to each audio input device, wherein the audio output channel assigned by each audio input device different.

In this embodiment of the present application, after determining the number of audio input devices and audio output devices, the electronic device may allocate audio output channels to the audio input device according to the above first number and second number. The electronic device may allocate at least one audio output channel of at least one audio output device to each audio input device based on the first number and the second number.

In some embodiments, the electronic device may try to ensure that all audio output channels of an audio output device are allocated to the audio input device according to the principle of prioritizing the allocation of the entire audio output device to the audio input device; the number of audio output devices cannot be guaranteed. When all the audio output channels of an audio output device can be assigned to the audio input device, the different channels of the audio output device can be assigned to different audio input devices, and the audio output channels assigned by each audio input device are guaranteed. In this way, at least part of the audio data of the audio input device can be played by the complete audio output device (that is, all channels of the audio output device are used to play the audio data of one audio input device), and it is convenient for the user to distinguish Playing sounds corresponding to the audio data of different audio input devices.

Step S130: Acquire audio data transmitted by the plurality of audio input devices.

In this embodiment of the present application, after assigning audio output channels to each audio input device, the electronic device may acquire audio data input by these audio input devices for playback. The electronic device can receive the audio data transmitted by the audio input device according to the network connection established with the audio input device, that is, obtain the audio data to be played. In some embodiments, the audio data input by the audio input device may be audio data of content such as music, video, games, etc., which is not limited herein.

Step S140: Play audio data transmitted by each audio input device based on the audio output channel allocated to each audio input device.

In the embodiment of the present application, after acquiring the audio data input by the above multiple audio input devices, the electronic device can de-multiplex the audio data, and after decoding, output the sound according to the audio allocated to each audio input device. channel to play the audio data transmitted by each audio input device.

In the audio playback method provided by the embodiments of the present application, according to the number of audio input devices and the number of audio output devices, at least one audio output channel of at least one audio output device is allocated to each audio input device, and then multiple audio output channels are obtained. The audio data transmitted by the input device, based on the audio output channel allocated to each audio input device, play the audio data transmitted by each audio input device, so as to realize the allocation of different audio output channels to different audio input devices, It is convenient for users to clearly distinguish the sounds input by different audio input devices and improve the user experience. In addition, since the electronic device not only has a built-in audio output device, but also has an external audio output device, and each audio output device includes a plurality of audio output channels, so when the number of audio input devices is large, the audio input device can also be guaranteed. The input audio data is played in different audio output channels, which improves the sound playback effect.

Referring to FIG. 4, FIG. 4 shows a schematic flowchart of an audio playback method provided by another embodiment of the present application. The audio playback method is applied to the above-mentioned electronic equipment, and the flow shown in FIG. 4 will be described in detail below, and the audio playback method may specifically include the following steps:

Step S200: Acquire the number of multiple audio input devices and the audio output devices, wherein the number of the multiple audio input devices is taken as the first number, and the number of the audio output devices is taken as the second number.

In this embodiment of the present application, for step S200, reference may be made to the content of the foregoing embodiments, and details are not described herein again.

Step S210: Determine whether the second number is greater than the first number.

In this embodiment of the present application, the electronic device may try to ensure that all audio output channels of an audio output device are allocated to the audio input device according to the principle of preferentially allocating the entire audio output device to the audio input device. After acquiring the first number of audio input devices and the second number of audio output devices, the electronic device can compare the second number with the first number, and then determine whether the second number is less than the first number according to the comparison result . It can be understood that if the second number is greater than or equal to the first number, it means that the number of audio output devices is greater than or equal to the number of audio input devices, so each audio input device can be assigned to at least one complete audio output device. ; If the second number is less than the first number, it means that the number of audio output devices is less than the number of audio input devices, so it cannot be guaranteed that each audio input device can be assigned to at least one complete audio output device.

Step S220: If the second number is greater than or equal to the first number, assign all audio output channels of at least one audio output device to each audio input device.

In this embodiment of the present application, if the electronic device determines that the second number is greater than or equal to the first number, the number of audio output devices at this time can ensure that each audio input device is assigned at least one complete audio output device, and also That is, for an audio input device, all audio output channels of the assigned audio output device are used for playing the audio data of the audio input device. Therefore, in this case, the electronic device can assign all audio output channels of at least one audio output device to each audio input device, and ensure that the audio output devices assigned to each audio input device are different.

5, when the number of audio input devices 200 is 1, and the audio output device includes the first audio output device 140a and the second audio output device 140b, the number of audio output devices is 2, the audio output device 140b. The number of input devices is 1, so the first audio output device 140a and the second audio output device 140b can be allocated to the audio input device 200, and the audio data input by the audio input device 200 can be simultaneously transmitted by the first audio output device 140a and the second audio output device 140b. All audio output channels of the two audio output devices 140b are played.

6, the audio input device includes: a first audio input device 201 and a second audio input device 202, the audio output device includes a first audio output device 140a and a second audio output device 140b, at this time the audio output The number of devices is 2, the number of audio input devices is 2, and the number of audio output devices just satisfies that each audio input device is assigned a complete audio output device, so the first audio input device 201 can be assigned a first audio output The device 140a assigns the second audio output device 140b to the second audio input device 202, so that the audio data input by the first audio input device 201 can be played by all audio output channels of the first audio output device 140a, and the second audio The audio data input by the input device 202 can be played by all output channels of the second audio output device 140b.

7, the audio input device includes: a first audio input device 201, a second audio input device 202 and a third audio input device 203, the audio output device includes a first audio output device 140a, a second audio output device The device 140b and the third audio output device 140c, at this time, the number of audio output devices is 3, the number of audio input devices is 3, and the number of audio output devices just satisfies that each audio input device is allocated a complete audio output device, so The first audio output device 140a may be assigned to the first audio input device 201, the second audio output device 140b to the second audio input device 202, and the third audio output device 140c to the third audio input device 203, thereby The audio data input by the first audio input device 201 can be played by all the audio output channels of the first audio output device 140a, and the audio data input by the second audio input device 202 can be played by all the output channels of the second audio output device 140b For playback, the audio data input by the third audio input device 203 can be played by all output channels of the second audio output device 140c.

Similarly, referring to FIG. 8 , when the number of audio input devices is 4 and the number of audio output devices is 4, it is also possible to assign an audio output device to each audio input device, so that the audio data input by each audio input device is Played by all audio output channels of an audio output device.

Step S230: If the second number is less than the first number, acquire the number of audio output channels of all the audio output devices as a third number.

In this embodiment of the present application, if the electronic device determines that the second number is smaller than the first number, the number of audio output devices is not sufficient for each audio input device to be assigned at least one complete audio output device. Therefore, in this case, the electronic device can determine whether all audio output channels of at least one complete audio output device can be allocated to some audio input devices, and then perform the allocation of audio output channels.

In some implementations, the number of audio output channels of each audio output device is the same, eg, both are 2, both are 4, and so on. The electronic device may determine the number of audio output channels of all audio output devices as the third number when judging that the second number is smaller than the first number. As a way, the electronic device may acquire device information of each audio output device, and then determine the number of audio output channels from the device information.

Step S240: Obtain the ratio of the third quantity to the first quantity.

Step S250: If the ratio is greater than the set threshold, assign all audio output channels of at least one audio output device to some of the plurality of audio input devices.

In this embodiment of the present application, after acquiring the number of audio output channels of all audio output devices, the electronic device may acquire the ratio between the third number of all audio output channels and the first number of all audio input devices, To determine whether all audio output channels of at least one complete audio output device can be allocated to a part of the audio input device according to the ratio. Wherein, after acquiring the ratio, the electronic device may compare the ratio with a set threshold, where the set threshold is determined according to the number of audio output channels of a single audio output device. When the above ratio is greater than the set threshold, it means that there are many audio output channels, and at least some audio input devices can be allocated all audio output channels of at least one complete audio output device; when the above ratio is not greater than the set threshold, It means that there are fewer audio output channels. If all audio output channels of at least one complete audio output device are allocated to at least some audio input devices, other audio input devices cannot be allocated to at least one audio output channel, or the audio output The channel distribution is uneven, resulting in uneven sound loudness of the audio input by each audio input device heard by the user, resulting in a poor experience.

In some embodiments, when the above ratio is greater than a set threshold, when the electronic device allocates all audio output channels of at least one complete audio output device to at least some of the audio input devices, it may determine that the audio frequency of the complete audio output device is to be allocated. The number of input devices is then allocated to all audio output channels of at least one audio output device for the number of audio input devices, and it is ensured that the audio output devices allocated to these audio input devices are different.

Optionally, each audio input device in the number of audio input devices can be assigned all audio output channels of an audio output device, so as to avoid the audio output that cannot be assigned by other audio input devices of a complete audio output device. There are fewer channels, so that the audio input from each audio input device heard by the user has uneven loudness, resulting in a poor experience.

In some embodiments, the electronic device assigns all audio output channels of at least one audio output device to some of the plurality of audio input devices, which may include:

Determine the number of audio input devices that allocate all audio output channels of an audio output device in the plurality of audio input devices, as the fourth number; obtain the priority of each audio input device in the plurality of audio input devices; The fourth number of audio input devices is determined from the plurality of audio input devices as the partial audio input devices based on the priority of each audio input device, wherein the priority of the partial audio input devices The priority is higher than that of the other audio input devices; all audio output channels of an audio output device are allocated to the part of the audio input devices.

In this embodiment, the electronic device allocates all audio output channels of an audio output device to each audio input device of the partial audio input devices. After the electronic device determines the number of audio input devices that can be assigned a complete audio output device, according to the priority of the audio input device, the number of audio input devices with relatively high priority is determined as the number of audio input devices that can be assigned an audio output device. audio input devices, and then assign an audio output to those audio input devices to promote all audio output channels. Therefore, an audio input device with a relatively high priority can be assigned a complete audio output device, and when the audio is played, it can be different from the audio input by other audio input devices, which can better meet the needs of users. Improve user experience.

As an implementation manner, the priority of the audio input device can be set according to the needs of the user. Exemplarily, the electronic device may display an interface for setting the priority of each audio input device for the user to set the priority of each audio input device.

As another implementation manner, the priority of the audio input device may be determined according to the type of the audio input device, that is, the electronic device may obtain the type of each audio input device, and then, according to the type of each audio input device, determine each audio input device Enter the priority of the device. Exemplarily, the audio input devices can be divided into: desktop computers, laptop computers, tablet computers, smart phones and smart watches, etc. The priority of audio input devices is in the order of desktop computers, laptop computers, tablet computers, smart phones and smart watches Decrease in sequence, of course, the above is only an example, and does not represent a limitation on the actual priority.

In some manners, the electronic device determines the number of audio input devices to which all audio output channels of one audio output device are allocated among the plurality of audio input devices, which may be determined according to the above ratio. Exemplarily, the integer part of the ratio can be used as the quantity, so that more audio input devices can be allocated to all audio output channels of an audio output device; for another example, the integer part of the ratio can be subtracted by 1 The value obtained later is used as the number, so that some audio input devices can be assigned to all audio output channels of an audio output device, and at the same time, the occurrence of uneven sound volume can also be avoided.

In some manners, the above set threshold is determined according to the number of audio output channels of a single audio output device. Since the number of audio output channels of each audio output device is the same, the audio output of any audio output device can be The number of channels to determine the set threshold. Exemplarily, if the number of audio output channels of a single audio output device is 4, the set threshold may be 2. Of course, the specific manner of determining the threshold value may not be limited.

9, the audio input device includes: a first audio input device 201, a second audio input device 202 and a third audio input device 203, and the audio output device includes a first audio output device 140a and a second audio output device 140a The number of audio output channels of the device 140b, the first audio output device 140a and the second audio output device 140b are all four. At this time, the number of all audio output devices is 8, the number of audio input devices is 3, and the ratio of the number of all audio output devices to the number of audio input devices is greater than 2, so the first audio input device 201 can be assigned a first audio The output device 140a assigns the audio output channels b1 and b2 of the second audio output device 140b to the second audio input device 202, and assigns the audio output channels b3 and b4 of the second audio output device to the third audio input device 203.

10, the audio input device includes: a first audio input device 201, a second audio input device 202, a third audio input device 203 and a fourth audio input device 204, and the audio output device includes a first audio output device The number of audio output channels of the device 140a, the second audio output device 140b and the third audio output device 140c, the first audio output device 140a, the second audio output device 140b and the third audio output device 140c are all four. At this time, the number of all audio output devices is 12, the number of audio input devices is 4, and the ratio of the number of all audio output devices to the number of audio input devices is greater than 2, so the first audio input device 201 can be assigned a first audio The output device 140a assigns the second audio output device 140b to the second audio input device 202, assigns the audio output channels c1 and c2 of the third audio output device 140c to the third audio input device 203, and assigns the audio output channels c1 and c2 of the third audio output device 140c to the fourth audio input device 203. 204 allocates audio output channels c3 and c4 of the third audio output device 140c.

Step S260: Allocate at least one audio output channel of the remaining audio output device to each audio input device in the other audio input devices.

In this embodiment of the present application, after all the audio output channels of one audio output device are allocated to the above part of the audio input devices, the electronic device may allocate at least one of the remaining audio output devices to each of the other audio input devices Audio output channels, other audio input devices are audio input devices other than some audio input devices among the multiple audio input devices, and ensure that the audio output channels assigned to different audio input devices in the other audio input devices are different.

Step S270: If the ratio is less than or equal to the set threshold, assign at least one audio output channel to each of the plurality of audio input devices.

In the embodiment of the present application, if the electronic device determines that the above ratio is less than or equal to the set threshold, it means that no audio input device can be assigned to all audio output channels of an audio output device, so each audio output channel can be allocated according to the guarantee According to the principle that the input device is assigned at least one audio output channel, at least one audio output channel is assigned to each audio input device.

11, the audio input device includes: a first audio input device 201, a second audio input device 202, a third audio input device 203 and a fourth audio input device 204, and the audio output device includes a first audio output device The number of audio output channels of the device 140a and the second audio output device 140b, the first audio output device 140a and the second audio output device 140b are all four. At this time, the number of all audio output devices is 8, the number of audio input devices is 4, and the ratio of the number of all audio output devices to the number of audio input devices is equal to 2, so the first audio input device 201 can be assigned a first audio The audio output channels a1 and a2 of the output device 140a, the audio output channels a3 and a4 of the first audio output device 140a to the second audio input device 202, the second audio output device 140b is assigned to the third audio input device 203 The audio output channels b1 and b2 of the fourth audio input device 204 are allocated to the audio output channels b3 and b4 of the second audio output device 140b.

In some embodiments, since the above-mentioned process is performed based on the condition that the number of audio output channels of each audio output device is the same when the second number is less than the first number, the data of all audio output devices may be obtained in step S230. Before the number of audio output channels, the electronic device can also determine whether the number of audio output channels of each audio output device is the same, and when the number of audio output channels is the same, the number of audio output channels of all audio output devices can be obtained; , the audio output channels can be allocated to the audio input devices according to the principle of allocating all the audio output channels of an audio output device to some audio input devices as much as possible.

Step S280: Acquire audio data transmitted by the plurality of audio input devices.

Step S290: Play audio data transmitted by each audio input device based on the audio output channel allocated to each audio input device.

In this embodiment of the present application, for step S280 and step S290, reference may be made to the content of the foregoing embodiments, and details are not described herein again.

In some manners, the electronic device may have no external audio output device. In this case, the electronic device may have only one audio output device. In this case, at least one audio output device can be assigned to each audio input device according to the guarantee. According to the principle of channel, assign at least one audio output channel to the audio input device. 12, the audio input device includes: a first audio input device 201 and a second audio input device 202, and the audio output device includes a first audio output device 140a. At this time, the first audio input device 201 can be used. The audio output channels a1 and a2 of the first audio output device 140a are allocated to the audio output channels a3 and a4 of the first audio output device 140a for the second audio input device 202 .

In the audio playback method provided by the embodiment of the present application, when multiple audio input devices input audio input to the electronic device for playback, according to the principle of preferentially assigning all audio output channels of at least one audio output device to the audio input device, based on the audio input device The relationship between the number of devices and the number of audio output devices, assigning different audio output channels to audio input devices ensures that the audio data of different audio input devices is played through different audio output channels, and can give priority to The audio data of the audio input device can be output in all audio output channels of at least one audio output device, which improves the audio playback effect.

Please refer to FIG. 13. FIG. 13 shows a schematic flowchart of an audio playback method provided by yet another embodiment of the present application. The audio playback method is applied to the above-mentioned electronic equipment, and the flow shown in FIG. 13 will be described in detail below. The audio playback method may specifically include the following steps:

Step S310: Acquire the number of multiple audio input devices and the audio output devices, wherein the number of the multiple audio input devices is used as the first number, and the number of the audio output devices is used as the second number.

In this embodiment of the present application, for step S310, reference may be made to the content of the foregoing embodiments, and details are not described herein again.

Step S320: Obtain the relative positional relationship between each audio input device and the electronic device.

In this embodiment of the present application, the relative positional relationship may be used to represent the relative distance and relative angle between the audio input device and the electronic device.

In this embodiment, the audio input device may be located directly in front of the electronic device, may be located in the front left of the electronic device, may be located in the front right of the electronic device, may be located in the upper front of the electronic device, or may be located in the lower front of the electronic device, etc. , the second source device can be located directly in front of the electronic device, can be located in the front left of the electronic device, can be located in the front right of the electronic device, can be located in the upper front of the electronic device, or can be located in the lower front of the electronic device, etc. Do limit.

As a first approach, the electronic device may include an ultra-wide band (UWB) sensor, and each audio input device may also include an ultra-wideband sensor, and the electronic device may pass the electronic device and the UWB sensor of each audio input device. , to obtain the relative positional relationship between each audio input device and the electronic device.

As a second manner, the electronic device may include an image capture device, and the relative positional relationship between the audio input device and the electronic device may be acquired through the image capture device.

Step S330: Based on the first quantity, the second quantity, and the relative positional relationship between each audio input device and the electronic device, assign at least one of at least one audio output device to each audio input device. An audio output channel, wherein the audio output channel allocated by each audio input device corresponds to the relative positional relationship.

In this embodiment of the present application, when the electronic device allocates an audio output channel to each audio input device, in addition to referring to the number of audio output devices and the number of audio input devices, it may also refer to the relationship between the audio input device and the electronic device. relative positional relationship. Similarly, the electronic device may, in accordance with the principle of prioritizing the allocation of the entire audio output device to the audio input device, try to ensure that all audio output channels of an audio output device are allocated to the audio input device; the number of audio output devices cannot guarantee that one When all the audio output channels of the audio output device are assigned to the audio input device, then assign different channels of the audio output device to different audio input devices, and ensure that the audio output channels assigned to each audio input device are different, like this , the audio data of at least part of the audio input device can be played by the complete audio output device (that is, all channels of the audio output device are used to play the audio data of one audio input device), and it is convenient for users to distinguish different audio input devices. The playback sound corresponding to the audio data of the device. In addition, when assigning audio output channels, the electronic device can also make the audio output channel assigned to the audio input device close to the audio input device according to the above relative positional relationship. For example, the audio input device 1 is located on the left side of the electronic device. side, the audio output channel on the left can be assigned to the audio input device 1; if the audio input device 2 is located on the right side of the electronic device, the audio output channel on the right can be assigned to the audio input device 2.

In some embodiments, the electronic device may allocate a corresponding number of audio output channels to each audio input device according to the first number and the second number, and then according to the relative positional relationship between the audio input device and the electronic device, and The position of the audio output channels, assign the corresponding number of audio output channels to each audio input device.

Step S340: Acquire audio data transmitted by the multiple audio input devices.

Step S350: Play audio data transmitted by each audio input device based on the audio output channel allocated to each audio input device.

In this embodiment of the present application, for steps S340 and S350, reference may be made to the contents of the foregoing embodiments, and details are not described herein again.

In the audio playback method provided by the embodiment of the present application, when multiple audio input devices input audio input to the electronic device for playback, according to the principle of preferentially assigning all audio output channels of at least one audio output device to the audio input device, based on the audio input device The number of devices, the number of audio output devices, and the relative positional relationship between the audio input device and the electronic device. Assign different audio output channels to the audio input device to ensure that the audio data of different audio input devices pass through different audio outputs. The audio output channel can be guaranteed to correspond to the above relative positional relationship, which further facilitates the user to distinguish the playback sound of the audio data of different audio input devices, and improves the audio playback effect.

Please refer to FIG. 14. FIG. 14 shows a schematic flowchart of an audio playback method provided by still another embodiment of the present application. The audio playback method is applied to the above-mentioned electronic equipment, and the flow shown in FIG. 14 will be described in detail below. The audio playback method may specifically include the following steps:

Step S410: Acquire the number of multiple audio input devices and the audio output devices, wherein the number of the multiple audio input devices is used as the first number, and the number of the audio output devices is used as the second number.

In this embodiment of the present application, for step S410, reference may be made to the content of the foregoing embodiments, and details are not described herein again.

Step S420: Obtain the distance of each audio input device relative to the electronic device.

In this embodiment of the present application, the electronic device may also acquire the distance of each audio input device relative to the electronic device. As one way, the electronic device can obtain the distance of each audio input device relative to the electronic device through the distance sensor; as another way, the electronic device can be provided with multiple depth cameras, and the depth images collected by the depth cameras can be used to determine each The distance of the audio input device relative to the electronic device.

Step S430: Allocate at least one audio output of at least one audio output device to each audio input device based on the first number, the second number, and the distance of each audio input device relative to the electronic device channel, wherein the number of audio output channels allocated by each audio input device is positively related to the distance.

In this embodiment of the present application, when the electronic device allocates an audio output channel to each audio input device, in addition to referring to the number of audio output devices and the number of audio input devices, it may also refer to the relationship between the audio input device and the electronic device. distance. Similarly, the electronic device may, in accordance with the principle of assigning the entire audio output device to the audio input device preferentially, try to ensure that all audio output channels of an audio output device are allocated to the audio input device, and refer to the relationship between the audio input device and the electronic device. The distance finally makes the audio output channels allocated by each audio input device different, and the number of audio output channels allocated by each audio input device is positively related to the above distance. That is to say, the greater the distance, the greater the number of allocated audio output channels. Since the number of allocated audio output channels is different, the sound volume is also different, so that the user can easily distinguish different audio inputs. The audio sound of the device.

In some embodiments, the electronic device may determine the number of audio output channels allocated by each audio input device according to the above distance, and the number of audio output channels allocated by each audio input device is positively correlated with the above distance . Then, based on the number of audio output channels allocated to each audio input device, and according to the first number and the second number, the audio output channels of all audio output devices are allocated to the audio input devices, that is, on this basis On the condition that the number of audio output channels allocated by each audio input device is kept unchanged, according to the first number and the second number, the audio output channels of all audio output devices are allocated to the audio input device to ensure As many audio input devices as possible are assigned to complete audio output devices, ie all audio output channels of at least one audio deletion device.

Step S440: Acquire audio data transmitted by the multiple audio input devices.

Step S450: Play audio data transmitted by each audio input device based on the audio output channel allocated to each audio input device.

In this embodiment of the present application, for steps S440 and S450, reference may be made to the contents of the foregoing embodiments, and details are not described herein again.

In the audio playback method provided by the embodiment of the present application, when multiple audio input devices input audio input to an electronic device for playback, according to the principle of preferentially assigning all audio output channels of at least one audio output device to the audio input device, based on the audio input device The number of devices, the number of audio output devices, and the distance between the audio input device and the electronic device, assign different audio output channels to the audio input device, ensuring that the audio data of different audio input devices pass through different audio output channels Play, and can ensure that the number of audio output channels corresponds to the above distance, which further facilitates the user to distinguish the playback sound of audio data of different audio input devices, and improves the audio playback effect.

Please refer to FIG. 15. FIG. 15 shows a schematic flowchart of an audio playback method provided by yet another embodiment of the present application. The audio playback method is applied to the above-mentioned electronic equipment, and the flow shown in FIG. 15 will be described in detail below. The audio playback method may specifically include the following steps:

Step S510: Acquire the number of multiple audio input devices and the audio output devices, wherein the number of the multiple audio input devices is taken as the first number, and the number of the audio output devices is taken as the second number.

In this embodiment of the present application, for step S510, reference may be made to the content of the foregoing embodiments, and details are not described herein again.

Step S520: Perform a display layout on the resources to be displayed corresponding to each audio input device.

In this embodiment of the present application, the audio input device may be an input device in a screen projection scenario, and the audio input device may not only input display content to the electronic device for display, but also input audio data to the electronic device for playback. In a screen-casting scenario, the electronic device may display a layout for the resources to be displayed corresponding to each audio input device, so that when displaying the resources to be displayed, the resources to be displayed inputted by multiple input devices are displayed according to the display layout. Wherein, the display layout may include at least: the position of each channel of video in the preset window and the area size of each channel of video in the preset window, etc., which are not limited herein. The resources to be displayed may include videos, music, documents, games, etc., which are not limited herein.

In some embodiments, the electronic device performs a display layout for the resources to be displayed corresponding to each audio input device, which may include: acquiring the number of resources to be displayed corresponding to multiple audio input devices; based on the number, generating multiple audio input devices The display layout of the corresponding resource to be displayed in the interface.

In this embodiment, the electronic device may divide the display interface into multiple regions based on the number of resources to be displayed corresponding to the multiple audio input devices, and then assign each region in the multiple regions to the to-be-displayed corresponding to one audio input device resources (ie, one channel of video), so as to obtain the display layout of the resources to be displayed corresponding to each audio input device in the display interface. Wherein, the ratio of the sum of the areas occupied by the resources to be displayed in the display interface of the multiple audio input devices to the area of the display interface may be the largest. It can be understood that by using this layout method to lay out the positions and sizes of the resources to be displayed in the display interface of the multiple audio input devices, the resources to be displayed of the multiple audio input devices can occupy the largest proportion in the display interface. to make full use of the area in the display interface.

In other embodiments, the electronic device may also generate the display layout based on the display parameters of the resource to be displayed corresponding to each audio input device in the corresponding audio input device. Likewise, the ratio of the sum of the areas occupied by the resources to be displayed in the display interface of the plurality of audio input devices to the area of the display interface may be the largest. The display parameters may include size information and display status of the resources to be displayed in each audio input device in the audio input device, and the size information may include "length", "width", "aspect ratio", "area" etc., the display state may include a landscape display state and a portrait display state.

As a method, the audio input device corresponding to the resource to be displayed can use JavaScript to determine whether it is in a horizontal screen display state or a vertical screen display state. Specifically, the audio input device generally supports the parameter window.orientation, then the audio input device can The display state is determined by window.orientation, and the display state is sent to the electronic device. In addition, the electronic device may acquire size information of the video, that is, the electronic device may acquire size information such as "length", "width", "aspect ratio", and "area" of the video. As one approach, the audio input device can use JavaScript to obtain its sizing information and send the sizing information to the electronic device.

In this embodiment, the electronic device determines the display layout by acquiring the display parameters of the resources to be displayed of multiple audio input devices, and can divide the display interface into multiple areas according to the above size information and display status, and divide each Regions are allocated to the resources to be displayed of an audio input device, so that the relationship between the sizes of the regions to which the resources to be displayed of different audio input devices are allocated can correspond to the size relationship between the size information in the audio input devices, for example , the size information of the resources to be displayed in the audio input device A is larger than the size information of the resources to be displayed in the audio input device B The size of the area is also larger than the size allocated by the resources to be displayed of the audio input device B; and the display state of the resources to be displayed of each audio input device in the display interface also corresponds to the display state in the audio input device, for example, If the resource to be displayed on the audio input device A is displayed in landscape on the audio input device, the allocated area should also be in landscape.

In still other embodiments, the electronic device may also acquire the relative positional relationship between the audio input device and the electronic device for each audio input device that outputs the resource to be displayed, and then determine the display layout based on the relative positional relationship. The relative positional relationship can be used to characterize the relative distance and relative angle between the audio input device and the electronic device.

As a first method, the electronic device may include an ultra-wide band (UWB) sensor, and the audio input device may also include an ultra-wideband sensor, and the electronic device may obtain the difference between the audio input device and the electronic device through the two UWB sensors. relative positional relationship.

In this embodiment, after obtaining the relative positional relationship between the electronic device and the audio input device, the display layout may be determined based on the relative positional relationship. As an approach, when the first audio input device is in the front left of the electronic device and the second audio input device is in the front right of the electronic device, the display layout determined based on the relative positional relationship may include: The position of the display resource in the display interface is located in the left area of the display interface, and the position of the resource to be displayed of the second audio input device in the display interface is located in the right area of the display interface, etc., which are not limited here.

In the above embodiment, the electronic device may also combine the number of resources to be displayed of multiple audio input devices, the display parameters of the resources to be displayed, and the relative positional relationship between the audio input device and the electronic device to determine the display interface of each channel of video. display layout.

Step S530: Based on the first quantity, the second quantity and the display layout, assign at least one audio output channel of at least one audio output device to each audio input device, wherein each audio input device The assigned audio output channel corresponds to the display layout.

In this embodiment of the present application, when the electronic device allocates audio output channels to each audio input device, in addition to referring to the number of audio output devices and the number of audio input devices, the above display layout may also be referred to. Similarly, the electronic device may, in accordance with the principle of prioritizing the allocation of the entire audio output device to the audio input device, try to ensure that all audio output channels of an audio output device are allocated to the audio input device; the number of audio output devices cannot guarantee that one When all the audio output channels of the audio output device are assigned to the audio input device, then assign different channels of the audio output device to different audio input devices, and ensure that the audio output channels assigned to each audio input device are different, like this , the audio data of at least part of the audio input device can be played by the complete audio output device (that is, all channels of the audio output device are used to play the audio data of one audio input device), and it is convenient for users to distinguish different audio input devices. The playback sound corresponding to the audio data of the device. In addition, the electronic device can also, according to the above display layout, enable the audio output channel allocated to the audio input device to be close to the display position of the resource to be displayed on the audio input device when allocating the audio output channel. 16, the resource A1 to be displayed corresponding to the audio input device 1 is located on the left side of the display interface of the electronic device, then the audio output channel on the left can be assigned to the audio input device 1; the audio input device 2 If the corresponding resource A2 to be displayed is located on the right side of the display interface of the electronic device, the audio output channel on the right side can be allocated to the audio input device 2 .

Step S540: Acquire audio data transmitted by the plurality of audio input devices.

Step S550: Play audio data transmitted by each audio input device based on the audio output channel allocated to each audio input device.

In this embodiment of the present application, for steps S540 and S550, reference may be made to the contents of the foregoing embodiments, and details are not described herein again.

In the audio playback method provided by the embodiment of the present application, when multiple audio input devices simultaneously input display content and audio data to the electronic device for display and playback, the display layout of the display content of the multiple audio input devices is performed, and the audio input devices are given priority according to the display layout. The principle that the device allocates all audio output channels of at least one audio output device, based on the number of audio input devices, the number of audio output devices, and the uneven display of audio input devices, assign different audio output channels to audio input devices to ensure that The audio data of different audio input devices is played through different audio output channels, and it can ensure that the audio output channels correspond to the display layout, which further facilitates the user to distinguish the playback sound of the audio data of different audio input devices, and improves the audio playback effect.

Please refer to FIG. 17. FIG. 17 shows a schematic flowchart of an audio playback method provided by yet another embodiment of the present application. The audio playback method is applied to the above-mentioned electronic equipment, and the flow shown in FIG. 17 will be described in detail below. The audio playback method may specifically include the following steps:

Step S610: Acquire the number of multiple audio input devices and the audio output devices, wherein the number of the multiple audio input devices is taken as the first number, and the number of the audio output devices is taken as the second number.

Step S620: Based on the first number and the second number, assign at least one audio output channel of at least one audio output device to each audio input device, wherein the audio output channel assigned by each audio input device different.

Step S630: Acquire audio data transmitted by the multiple audio input devices.

Step S640: Play audio data transmitted by each audio input device based on the audio output channel allocated to each audio input device.

In this embodiment of the present application, for steps S610 to S640, reference may be made to the content of the foregoing embodiments, and details are not described herein again.

Step S650: when the number of audio input devices that input audio data to the electronic device changes, reassign at least one audio output to each audio input device based on the changed number of audio input devices and the second number At least one audio output channel of the device.

In the embodiment of the present application, the electronic device can also monitor the number of audio input devices that input audio data to the electronic device in the process of playing the audio data input by each audio input device according to the audio output channels allocated above, When the number of audio input devices that input audio data to the electronic device changes, based on the changed number of audio input devices and the second number, the audio output channels are re-assigned to each audio input device, so that the assigned audio The output channel can be adapted to the current audio input device. Wherein, according to the changed number of audio input devices and the second number of audio output channels are re-allocated to each audio input device, you can refer to the foregoing embodiment, according to the first number and the second number of audio input How the device assigns at least one audio output channel.

Step S660: Play audio data transmitted by each audio input device based on the audio output channel reassigned to each audio input device.

In this embodiment of the present application, after the audio output channel is reassigned, the audio data transmitted by each audio input device may be played based on the reassigned audio output channel.

In the audio playback method provided by the embodiment of the present application, when the number of audio input devices for inputting audio data to the electronic device changes, based on the changed number of audio input devices and the second number, each audio input device is re-allocated The audio output channel ensures the real-time distribution of the audio output channel, so that the user can distinguish the audio input by different audio input devices.

Please refer to FIG. 18 , which shows a structural block diagram of an audio playback apparatus 400 provided by an embodiment of the present application. The audio playback device 400 applies the above-mentioned electronic equipment, the electronic equipment includes at least one built-in audio output device and at least one external audio output device, the audio output devices each include a plurality of audio output channels, the audio playback device 400 includes: a quantity determination module 410 , an audio distribution module 420 , an audio acquisition module 430 and a playback module 440 . The quantity determination module 410 is configured to acquire the quantity of multiple audio input devices and the audio output devices, wherein the number of the multiple audio input devices is taken as the first quantity, and the quantity of the audio output devices is taken as the first quantity. Two quantities; the audio allocation module 420 is configured to allocate at least one audio output channel of at least one audio output device to each audio input device based on the first quantity and the second quantity, wherein each audio input The audio output channels allocated by the devices are different; the audio acquisition module 430 is used to acquire the audio data transmitted by the multiple audio input devices; the playback module 440 is used to obtain the audio data based on the audio input devices allocated to each of the audio input devices The output channel plays the audio data transmitted by each audio input device.

In some embodiments, the audio distribution module 420 may include: a quantity determination unit and a first distribution unit. The quantity judgment unit is used for judging whether the second quantity is less than the first quantity; the first allocation unit is used for allocating at least the first quantity to each audio input device if the second quantity is greater than or equal to the first quantity All audio output channels of an audio output device, wherein each audio input device is assigned a different audio output device.

In this embodiment, the audio distribution module 420 may further include: a channel number acquisition unit, a ratio acquisition unit, a second distribution unit, and a third distribution unit. The channel number acquisition unit is used to acquire the number of audio output channels of all the audio output devices as the third number if the second number is less than the first number; the ratio acquisition unit is used to acquire the third number a ratio with the first number; the second allocation unit is configured to allocate all audio output channels of at least one audio output device to some audio input devices in the plurality of audio input devices if the ratio is greater than a set threshold , wherein the audio output devices assigned by different audio input devices in the part of the audio input devices are different; the third distribution unit is used to assign an audio output sound of the remaining audio output devices to each audio input device in the other audio input devices The other audio input devices are audio input devices other than the part of the audio input devices in the plurality of audio input devices, wherein the audio output channels allocated by different audio input devices in the other audio input devices different.

In this manner, the second allocating unit may be specifically configured to: determine the number of audio input devices to which all audio output channels of one audio output device are allocated among the plurality of audio input devices, as the fourth number; obtain the plurality of audio input devices the priority of each audio input device of the plurality of audio input devices; based on the priority of each audio input device, determining the fourth number of audio input devices as the partial audio from the plurality of audio input devices The input device, wherein the priority of the part of the audio input device is higher than the priority of the other audio input devices; all the audio output channels of the at least one audio output device are allocated to the part of the audio input device.

In this embodiment, the audio distribution module 420 may further include: a fourth distribution unit. The fourth allocating unit is configured to allocate at least one audio output channel to each of the plurality of audio input devices if the ratio is less than or equal to the set threshold.

In other embodiments, the audio distribution module 420 may also include: a position relationship acquisition unit and a fifth distribution unit. Wherein, the positional relationship acquisition unit is used for acquiring the relative positional relationship between each audio input device and the electronic device; the fifth allocating unit is used for acquiring the relative positional relationship between the first quantity, the second quantity and the each audio The relative positional relationship between the input device and the electronic device, at least one audio output channel of at least one audio output device is allocated to each audio input device, wherein the audio output channel allocated to each audio input device corresponding to the relative positional relationship.

In still other embodiments, the audio distribution module 420 may also include: a distance acquisition unit and a sixth distribution unit. Wherein, the distance obtaining unit is used to obtain the distance of each audio input device relative to the electronic device; the sixth allocating unit is used to obtain the relative distance of each audio input device based on the first quantity, the second quantity and the relative distance of each audio input device. The distance of the electronic device, at least one audio output channel of at least one audio output device is allocated to each audio input device, wherein the number of audio output channels allocated by each audio input device is the same as the number of audio output channels allocated by the each audio input device. distance is positively correlated.

In still other embodiments, the audio input device is further configured to transmit the resource to be displayed to the electronic device for display. The audio playback apparatus 400 may further include a display layout module configured to allocate at least one audio output of at least one audio output device to each audio input device based on the first quantity and the second quantity Before the channel, the display layout is performed on the resources to be displayed corresponding to each audio input device. The audio allocation module 420 may also be specifically configured to: based on the first quantity, the second quantity and the display layout, allocate at least one audio output channel of at least one audio output device to each audio input device, wherein, The audio output channel assigned to each audio input device corresponds to the display layout.

In some embodiments, the audio distribution module 420 is further configured to, when the number of audio input devices for inputting audio data to the electronic device changes, based on the changed number of audio input devices and the second number, re-allocate Each audio input device is assigned at least one audio output channel of at least one audio output device.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, for the specific working process of the above-described devices and modules, reference may be made to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

In several embodiments provided in this application, the coupling between the modules may be electrical, mechanical or other forms of coupling.

In addition, each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist physically alone, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules.

To sum up, the solution provided by the present application allocates at least one audio output channel of at least one audio output device to each audio input device according to the number of audio input devices and the number of audio output devices, and then obtains multiple audio output channels. The audio data transmitted by the audio input device plays the audio data transmitted by each audio input device based on the audio output channel assigned to each audio input device, thereby realizing the assignment of different audio output channels to different audio input devices. , which is convenient for users to clearly distinguish the sounds input by different audio input devices and improve the user experience.

Please refer to FIG. 19 , which shows a structural block diagram of an electronic device provided by an embodiment of the present application. The electronic device 100 may be an electronic device capable of running an application program, such as a smart TV, a notebook computer, a desktop computer, or the like. The electronic device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, a display screen 130, an audio output device 140, and one or more application programs, wherein one or more application programs may be stored in In the memory 120 and configured to be executed by the one or more processors 110, one or more programs are configured to perform the methods described in the foregoing method embodiments.

The processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes by running or executing the instructions, programs, code sets or instruction sets stored in the memory 120, and calling the data stored in the memory 120. Various functions of the electronic device 100 and processing data. Optionally, the processor 110 may adopt at least one of a digital signal processing (Digital Signal Processing, DSP), a Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and a Programmable Logic Array (Programmable Logic Array, PLA). A hardware form is implemented. The processor 110 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly handles the operating system, user interface and application programs, etc.; the GPU is used for rendering and drawing of the display content; the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may also not be integrated into the processor 110, and is implemented by a communication chip alone.

The memory 120 may include random access memory (Random Access Memory, RAM), or may include read-only memory (Read-Only Memory). Memory 120 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.) , instructions for implementing the following method embodiments, and the like. The storage data area may also store data (such as phone book, audio and video data, chat record data) created by the electronic device 100 during use.

The display screen 130 is used to display information input by the user, information provided to the user, and various graphical user interfaces of the electronic device 100, which may be composed of graphics, text, icons, numbers, videos, and any combination thereof. In one example, the display screen 130 may be a liquid crystal display (Liquid Crystal Display, LCD) or an organic light-emitting diode (Organic Light-Emitting Diode, OLED), which is not limited herein.

The audio output device 140 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio output device 140 may also be used to encode and decode audio signals. In some manners, the audio output device 140 may include speakers, receivers, microphones, etc., which are not limited herein.

Please refer to FIG. 20 , which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. The computer-readable medium 800 stores program codes, and the program codes can be invoked by the processor to execute the methods described in the above method embodiments.

The computer readable storage medium 800 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 800 includes a non-transitory computer-readable storage medium. Computer readable storage medium 800 has storage space for program code 810 to perform any of the method steps in the above-described methods. These program codes can be read from or written to one or more computer program products. Program code 810 may be compressed, for example, in a suitable form.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or some technical features thereof are equivalently replaced; and these modifications or replacements do not drive the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

An audio playback method, characterized in that it is applied to electronic equipment, the electronic equipment includes at least one built-in audio output device and at least one external audio output device, and the audio output devices each include a plurality of audio output channels, The method includes:

Acquiring the number of multiple audio input devices and the audio output devices, wherein the number of the multiple audio input devices is used as the first number, and the number of the audio output devices is used as the second number;

based on the first number and the second number, assigning at least one audio output channel of at least one audio output device to each audio input device, wherein each audio input device is assigned a different audio output channel;

obtaining audio data transmitted by the plurality of audio input devices;

The audio data transmitted by each audio input device is played based on the audio output channel assigned to each audio input device.
The method according to claim 1, wherein, based on the first quantity and the second quantity, allocating at least one audio output channel of at least one audio output device to each audio input device comprises:

determining whether the second quantity is less than the first quantity;

If the second number is greater than or equal to the first number, assign all audio output channels of at least one audio output device to each audio input device, wherein the audio output devices assigned to each audio input device are different .
The method according to claim 2, wherein the allocating all audio output channels of at least one audio output device to each audio input device comprises:

Determine the number of audio input devices to be allocated a complete audio output device as the target number;

All audio output channels of at least one audio output device are allocated to the target number of audio input devices, and each audio input device is allocated a different audio output device.
The method according to claim 2 or 3, wherein the number of audio output channels of each audio output device is the same, and based on the first number and the second number, for each audio input device Allocating at least one audio output channel of at least one audio output device, further comprising:

If the second number is less than the first number, acquiring the number of audio output channels of all the audio output devices as a third number;

obtaining the ratio of the third quantity to the first quantity;

If the ratio is greater than the set threshold, assign all audio output channels of at least one audio output device to some audio input devices in the plurality of audio input devices, wherein different audio input devices in the part of the audio input devices have all audio output channels. The assigned audio output devices are different, and the set threshold is set according to the number of audio output channels of a single audio output device;

Allocate at least one audio output channel of the remaining audio output device to each audio input device in the other audio input devices, where the other audio input devices are audios other than the part of the audio input devices in the plurality of audio input devices An input device, wherein the audio output channels assigned to different audio input devices in the other audio input devices are different.
The method according to claim 4, wherein the allocating all audio output channels of at least one audio output device to some of the audio input devices in the plurality of audio input devices comprises:

Determine the number of audio input devices that allocate all audio output channels of an audio output device in the plurality of audio input devices, as the fourth number;

obtaining the priority of each audio input device in the plurality of audio input devices;

The fourth number of audio input devices is determined from the plurality of audio input devices as the partial audio input devices based on the priority of each audio input device, wherein the priority of the partial audio input devices higher priority than said other audio input devices;

All audio output channels of an audio output device are allocated to the part of the audio input device.
The method according to claim 5, wherein the acquiring the priority of each audio input device in the plurality of audio input devices comprises:

obtaining the type of each audio input device in the plurality of audio input devices;

Based on the type of each audio input device, the priority of each audio input device is determined.
The method according to any one of claims 4-6, wherein the at least one audio output of at least one audio output device is allocated to each audio input device based on the first quantity and the second quantity soundtrack, which also includes:

If the ratio is less than or equal to the set threshold, assigning at least one audio output channel to each of the plurality of audio input devices.
The method according to any one of claims 1-7, wherein the at least one audio output of at least one audio output device is allocated to each audio input device based on the first quantity and the second quantity soundtrack, including:

acquiring the relative positional relationship between each audio input device and the electronic device;

Assigning at least one audio output sound of at least one audio output device to each audio input device based on the first number, the second number, and the relative positional relationship between each audio input device and the electronic device channel, wherein the audio output channel assigned by each audio input device corresponds to the relative positional relationship.
The method according to claim 8, wherein, based on the first quantity, the second quantity, and the relative positional relationship between each audio input device and the electronic device, for each of the audio input devices The audio input device assigns at least one audio output channel of at least one audio output device, including:

assigning a corresponding number of audio output channels to each audio input device based on the first number and the second number;

The corresponding number of audio output channels are allocated to each audio input device according to the relative positional relationship between each audio input device and the electronic device, and the position of the audio output channel.
The method according to claim 8 or 9, wherein the electronic device includes an ultra-wideband sensor, the audio input device also includes an ultra-wideband sensor, and the acquiring the relationship between each audio input device and the electronic device The relative positional relationship of , including:

The relative positional relationship between each audio input device and the electronic device is acquired through the electronic device and the ultra-wideband sensor of each audio input device.
The method according to any one of claims 1-7, wherein the at least one audio output of at least one audio output device is allocated to each audio input device based on the first quantity and the second quantity soundtrack, including:

obtaining the distance of each audio input device relative to the electronic device;

assigning to each audio input device at least one audio output channel of at least one audio output device based on the first number, the second number, and the distance of each audio input device relative to the electronic device, Wherein, the number of audio output channels allocated by each audio input device is positively correlated with the distance.
12. The method of claim 11, wherein the processing for each audio input is based on the first number, the second number, and the distance of each audio input device relative to the electronic device. The device assigns at least one audio output channel of at least one audio output device, including:

According to the distance of each audio input device relative to the electronic device, the number of audio output channels allocated to each audio input device is determined, and the number of audio output channels allocated to each audio input device is positively correlated with said distance;

Based on the number of audio output channels allocated to each audio input device, and according to the first number and the second number, the audio output channels of all audio output devices are allocated to the audio input device.
The method according to any one of claims 1-7, wherein the audio input device is further configured to transmit resources to be displayed to the electronic device for display, and the audio input device is further configured to transmit resources to be displayed to the electronic device for display. For the second quantity, before allocating at least one audio output channel of at least one audio output device to each audio input device, the method further includes:

Display layout for resources to be displayed corresponding to each audio input device;

The assigning at least one audio output channel of at least one audio output device to each audio input device based on the first number and the second number includes:

At least one audio output channel of at least one audio output device is assigned to each audio input device based on the first number, the second number, and the display layout, wherein each audio input device is assigned with at least one audio output channel of at least one audio output device Audio output channels correspond to the display layout.
The method according to claim 13, wherein the displaying layout of the resources to be displayed corresponding to each audio input device comprises:

obtaining the number of resources to be displayed corresponding to the plurality of audio input devices;

Based on the number of the resources to be displayed, a display layout of the resources to be displayed corresponding to the plurality of audio input devices in the interface is generated.
The method according to claim 14, wherein the generating a display layout of the resources to be displayed corresponding to the plurality of audio input devices in the interface based on the number of the resources to be displayed comprises:

dividing the display interface into multiple areas based on the number of resources to be displayed corresponding to the multiple audio input devices;

Corresponding each of the multiple regions to a resource to be displayed corresponding to the audio input device to obtain a display layout of the resource to be displayed corresponding to each audio input device in the display interface.
The method according to claim 13, wherein the displaying layout of the resources to be displayed corresponding to each audio input device comprises:

Based on the display parameters of the resource to be displayed corresponding to each audio input device in the corresponding audio input device, a display layout is generated.
The method according to any one of claims 1-16, wherein the method further comprises:

When the number of audio input devices that input audio data to the electronic device changes, based on the changed number of audio input devices and the second number, reassign at least one audio output device to each audio input device. One audio output channel.
An audio playback device, characterized in that it is applied to electronic equipment, the electronic equipment includes at least one built-in audio output device and at least one external audio output device, and the audio output devices each include a plurality of audio output channels, The device includes: a quantity determination module, an audio distribution module, an audio acquisition module and a playback module, wherein,

The quantity determination module is configured to obtain the quantity of multiple audio input devices and the audio output devices, wherein the number of the multiple audio input devices is used as the first quantity, and the number of the audio output devices is used as the second quantity;

The audio distribution module is configured to allocate at least one audio output channel of at least one audio output device to each audio input device based on the first quantity and the second quantity, wherein the Different audio output channels;

The audio acquisition module is used to acquire audio data transmitted by the plurality of audio input devices;

The playing module is configured to play the audio data transmitted by each audio input device based on the audio output channel allocated to each audio input device.
An electronic device, comprising:

one or more processors;

memory;

one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs are configured to perform such as The method of any of claims 1-17.
A computer-readable storage medium, wherein a program code is stored in the computer-readable storage medium, and the program code can be invoked by a processor to execute the method according to any one of claims 1-17 .