WO2022052529A1

WO2022052529A1 - Sound source localization-based audio playback method, audio playback apparatuses, projection device, and medium

Info

Publication number: WO2022052529A1
Application number: PCT/CN2021/098493
Authority: WO
Inventors: 姜彦兮; 王鑫
Original assignee: 成都极米科技股份有限公司
Priority date: 2020-09-09
Filing date: 2021-06-05
Publication date: 2022-03-17
Also published as: CN112083379B; CN112083379A

Abstract

A sound source localization-based audio playback method, audio playback apparatuses, a projection device, and a medium, relating to the field of audio playback. The sound source localization-based audio playback method comprises: sequentially playing back audio data of channels, obtaining, by means of a microphone array, sound emitted by sound boxes corresponding to the channels, and measuring and calculating spatial positions of the sound boxes corresponding to the channels (S101); determining relative positions among the sound boxes according to the spatial positions of the sound boxes (S102); and setting an audio stream data format according to the relative positions among the sound boxes (S103). The audio stream data format is set according to the positions of the sound boxes, so that the audio stream data format conforms to a sound box placement position of a user, even if the user places the sound box wrongly, the position of the sound box does not need to be readjusted, and the original effect of a multi-channel sound box system can also be achieved or basically achieved. Moreover, according to the positions of the sound boxes, sending time of corresponding sound box data in the audio stream data format is changed, synchronization of the audio data is ensured, and the user experience is improved.

Description

Audio playback method, device, projection device and medium based on sound source localization

technical field

The present application relates to the field of audio playback, and in particular, to an audio playback method, device, projection device and medium based on sound source localization.

Background technique

With people's pursuit of high-quality audio and video playback, multi-channel speaker systems have gradually become popular, such as 5.1 speakers and 7.1 speakers. A multi-channel speaker system usually includes multiple speakers, and users need to place multiple speakers in corresponding positions in order to achieve the ideal listening effect. Since some speakers in the multi-channel speaker system have basically the same appearance, it is difficult for users to identify them. During installation, users may place the speakers in the wrong position, which affects the listening effect. Taking 5.1 speakers as an example, it usually consists of L (front left), R (front right), Ls (rear left), Rs (rear right), Lfe (bass) and C (center) speakers. When installing, the user needs to look at the logo behind each speaker, and then place it in the corresponding position. When the content (Dolby or DTS multi-channel) is played, the corresponding audio information can be heard in the correct direction. The appearance of C (center) and Lfe (bass) is relatively easy to identify, and the appearance is relatively unique; while the four speakers of L (left front), R (right front), Ls (left rear) and Rs (right rear) are often possible The appearance is the same, and it is not easy for users to identify them, and there may be cases where they are placed incorrectly.

SUMMARY OF THE INVENTION

In view of this, the present application proposes an audio playback method, device, projection device and medium based on sound source localization, which locates the placed speakers through the sound source localization of the microphone array, and then sets the sound playback according to the actual placement position information. The audio stream data format of the terminal to match the current speaker placement.

In the first aspect, the present application provides an audio playback method based on sound source localization, including: playing audio data of each channel in sequence, acquiring the sound emitted by the speaker corresponding to each channel through a microphone array, and measuring the space of the speaker corresponding to each channel. position, wherein one channel corresponds to one speaker; according to the spatial position of each speaker, determine the relative position between each speaker; according to the relative position between each speaker, set the audio stream data format.

In a possible implementation manner, the setting of the audio stream data format according to the relative positions between the respective speakers includes: setting the audio data format corresponding to each relative position in the audio stream to the corresponding one of the speakers located at the relative position. The format of the channel.

In a possible implementation manner, the method further includes: calculating the spatial position of the center point of the space surrounded by each sound box according to the spatial position of each sound box.

In a possible implementation manner, the method further includes: calculating the distance from each sound box to the center point, and delaying or advancing the audio data of some sound boxes according to the distance between each sound box and the center point.

In a possible implementation manner, the delaying or advancing the audio data of some speakers according to the distance from each speaker to the center point includes: calculating the average value of the distances from each speaker to the center point; The difference ΔSi between the distance from the speaker to the center point and the average value, where i=1, 2, 3, ..., n, n is the total number of speakers to be tested; if ΔSi is less than or equal to the preset distance value If ΔSi is greater than or equal to the preset distance value, the audio data of speaker i is processed in advance or Delay the audio data of speakers other than speaker i.

In a possible implementation manner, the preset distance value is directly preset, or calculated according to the preset time value multiplied by the speed of sound.

In a possible implementation manner, the calculation formula of the delay time of the delay processing or the advance time ti of the advance processing is:

where C is the speed of sound.

In a possible implementation manner, the determining the relative positions between the respective speakers according to the spatial positions of the respective speakers includes: determining the relative positions between the respective speakers according to the spatial positions of the respective speakers and the spatial position of the center point. relative position.

In a possible implementation, the spatial position includes spatial coordinates.

In a second aspect, the present application also provides an audio playback device, comprising: a spatial position measurement unit for sequentially playing the audio data of each channel, acquiring the sound emitted by the speaker corresponding to each channel through a microphone array, and measuring the corresponding sound of each channel. The spatial position of the speakers, in which one channel corresponds to one speaker; the relative position determination unit is used to determine the relative position of each speaker according to the spatial position of each speaker; the audio stream data format setting unit is used to determine the relative position of each speaker according to the spatial position of each speaker. The relative position of , set the audio stream data format.

In a possible implementation manner, the method for setting the audio stream data format by the audio stream data format setting unit includes: setting the audio data format corresponding to each relative position in the audio stream to the format of the channel corresponding to the speaker located at the relative position.

In a possible implementation manner, it further includes: a center point position calculation unit for calculating the spatial position of the center point of the space surrounded by each speaker according to the spatial position of each speaker; a synchronization processing unit for calculating each The distance from the speaker to the center point, delay or advance processing is performed on the audio data of some speakers according to the distance from each speaker to the center point.

In a third aspect, the present application provides an audio playback device, comprising: a memory for storing a program; a processor coupled to the memory, and the program is executed by the processor to implement the first aspect or the first The audio playback method based on sound source localization according to any one of the possible implementation manners of the aspect.

In a fourth aspect, the present application provides a projection device, including the second aspect or a possible implementation manner of the second aspect or the audio playback device according to any one of the third aspect.

In a possible implementation manner, the method further includes: a microphone array, where the microphone array is used to acquire the sound emitted by each sound box, and measure the spatial position of each sound box.

In a fifth aspect, the present application provides a computer-readable storage medium, comprising computer instructions, when the computer instructions are executed by a processor, the sound-based sound-based sound-based sound-based sound-based system as described in any one of the first aspect or the possible implementation manners of the first aspect is implemented when the computer instructions are executed by a processor. Source-located audio playback method.

It should be noted that the audio playback device described in the second aspect and the third aspect, the projection device described in the fourth aspect, and the computer-readable storage medium described in the fifth aspect of the present application are used to execute the above-mentioned first aspect. Therefore, the provided method can achieve the same beneficial effects as the method described in the first aspect, and the embodiments of the present application will not be repeated here.

In this application, the audio stream data format is set according to the position of the speaker to make it conform to the position of the user's speaker. Even if the user places the speaker in the wrong position, there is no need to re-adjust the position of the speaker, and a multi-channel speaker system can also be realized or basically realized. the original effect. In addition, according to the position of the speaker, the present application also changes the time when the data of the corresponding speaker in the audio stream data format is sent, so as to ensure the synchronization of the audio data and improve the user experience.

Description of drawings

The present application will be described by way of example and with reference to the accompanying drawings, wherein:

1 is a flowchart of an audio playback method based on sound source localization according to an embodiment of the application;

2 is a schematic diagram of the correct placement of the 5.1 sound box according to an embodiment of the application;

FIG. 3 is a schematic diagram of a wrong placement of a 5.1 sound box according to an embodiment of the present application.

detailed description

In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described The embodiments are only a part of the embodiments of the present application, but not all of the embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the scope of protection of the present application. In addition, although the disclosures in this application are presented in terms of one or several exemplary examples, it should be understood that each aspect of these disclosures can also constitute a complete technical solution individually. The embodiments described below and features in the embodiments may be combined with each other without conflict.

In the embodiments of the present application, words such as "exemplarily" and "for example" are used to represent examples, illustrations or illustrations. Any embodiment or design described in this application as "exemplary" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of the word example is intended to present a concept in a concrete way.

Unless otherwise defined, technical or scientific terms used in this application shall have the ordinary meaning as understood by those of ordinary skill in the art to which this application belongs. As used in this application, "first," "second," and similar words do not denote any order, quantity, or importance, but are merely used to differentiate the description. "Comprises" or "comprising" and similar words mean that the elements or things appearing before the word encompass the elements or things recited after the word and their equivalents, but do not exclude other elements or things. The term "and/or" includes any and all combinations of one or more of the associated listed items.

The technical solutions in the present application will be described below with reference to the accompanying drawings.

In the following specific embodiments, the present application uses a 5.1 speaker as an example to illustrate. The 5.1 speaker is usually composed of L, R, Ls, Rs, Lfe and C speakers. The Lfe speaker is a bass speaker, and the C speaker is a center speaker. The R, Ls, and Rs speakers are used to play the audio data of the L, R, Ls, and Rs channels, respectively. When placed correctly, the positions of the L, R, Ls, and Rs speakers are front left, front right, rear left, and rear right, respectively. , the C speaker is usually located between L and R, and the position of the Lfe speaker is more random. For example, the Lfe speaker is located between the R and Rs speakers, as shown in Figure 2. Since the appearance of the C and Lfe speakers is relatively easy to identify, this application assumes that the positions of these two speakers will not be wrong, so only the positions of the other four speakers need to be considered, that is, the total number of speakers to be tested is 4. However, the solution of the present application is not limited to this, and is also applicable to other multi-channel speaker systems such as 7.1 speakers.

As shown in FIG. 1 , the audio playback method based on sound source localization according to an embodiment of the present application includes the following steps:

S101. Play the audio data of each channel in turn, obtain the sound emitted by the speakers corresponding to each channel through the microphone array, and measure the spatial position of the speakers corresponding to each channel, wherein one channel corresponds to one speaker.

It should be noted that one channel corresponds to one speaker, that is, the audio data of one channel can only be played by the speaker corresponding to the channel. Therefore, each time the audio data of one channel is played, correspondingly only one speaker emits sound, which is transmitted through the microphone. The array acquires the sound emitted by the speaker and measures the spatial position of the speaker. For locating the position of the sound source by using the microphone array, reference may be made to the related art, which will not be repeated here.

The audio data played by the sound player emits sound through the speaker, and then obtains the sound from the speaker through the microphone array, and calculates the spatial position of the speaker. It is necessary to ensure that the sound player and the microphone array are located in the same position, but the microphone array can be included in the sound player. Inside, as a component of the sound playback side, the microphone array can also be a separate component outside the sound playback side.

S102. Determine the relative positions of the respective speakers according to the spatial positions of the respective speakers.

The spatial position can be spatial coordinates, or can be a direction, a distance, or the like. The relative positions between the respective speakers include front, rear, left and right, such as left front, right front, left rear and right rear. For example, the spatial positions are spatial coordinates, and the relative positions of the respective speakers can be determined according to the spatial coordinates of the respective speakers. For example, assuming that the positive direction of the vertical axis is the front, and the positive direction of the horizontal axis is the right, as shown in Figure 3, the z-axis is not shown in the figure, if the spatial coordinates of the four speakers L, R, Ls and Rs to be tested are (1,2,0), (-1,2,0), (2,-5,0) and (-1,-2,0), the two speakers with the smaller x-coordinate are on the left, and the x-coordinate The two larger speakers are on the right, the two speakers with a larger y coordinate are in the front, and the two speakers with a smaller y coordinate are in the back. It can be determined that the relative positions of the L, R, Ls and Rs speakers are the front right, Front left, rear right and rear left.

In some embodiments, the spatial position of the center point of the space enclosed by each sound box can also be calculated according to the spatial position of each sound box. Then, the relative position between each sound box is determined according to the spatial position of each sound box and the spatial position of the center point. At this time, it is equivalent to regard the center point as the origin, and then determine the relative positions of the respective speakers according to the relative positions of the respective speakers and the origin.

S103. Set the audio stream data format according to the relative positions of the respective speakers.

For example, setting the audio stream data format includes: setting the audio data format corresponding to each relative position in the audio stream to the format of the channel corresponding to the speaker located at the relative position. For example, in step S102, it is confirmed that the relative position of the L speaker in the 5.1 speaker is the front right, the relative position of the R speaker is the left front, the relative position of the Ls speaker is the right rear, the relative position of the Rs speaker is the left rear, and the audio stream data is usually press The sequence of left front_center_right front_left rear_right rear_bass is compiled circularly, therefore, set the audio stream data format to R_C_L_Rs_Ls_Lfe.

Due to the non-standard installation by users, the relative distance between each speaker may vary greatly. For example, the actual position of one or several speakers is closer or farther than other speakers, which will cause the sound to be out of sync and the user experience will be poor. By calculating the distance from each speaker to the center point, the audio data of some speakers can be delayed or processed in advance according to the distance from each speaker to the center point, so that the sound from each speaker reaches the human ear at the same time, improving the user experience. experience.

In some embodiments, delaying or advancing the audio data of some speakers according to the distance from each speaker to the center point specifically includes: calculating the average value of the distances from each speaker to the center point; calculating the distance from each speaker to the center point; The difference ΔSi between the distance between the center point and the average value, where i=1, 2, 3, ..., n, n is the total number of speakers to be tested; if ΔSi is less than or equal to the inverse of the preset distance value, Then the audio data of speaker i is delayed or the audio data of speakers other than speaker i is processed in advance; if ΔSi is greater than or equal to the preset distance value, the audio data of speaker i is processed in advance or the audio data of speaker i is processed in advance. The audio data of the external speakers is delayed. For example, the calculation formula of the delay time of the delayed processing or the advance time ti of the advanced processing is:

Among them, C is the speed of sound, and the speed of sound in air is about 340m/s under the conditions of 1 standard atmosphere and 15°C. The preset distance value can be directly preset. If the preset distance value is a time value, the preset distance value can be obtained by multiplying the preset time value by the speed of sound.

As shown in Figure 2, when the 5.1 speakers are placed in the correct positions, the data sequence of each frame of the audio of the sound player (such as a projection device) is L_C_R_Ls_Rs_Lfe; and the data of different speakers are sent synchronously.

When installing, the user may place the speaker in the wrong position, for example, as shown in Figure 3. When the user connects the speaker for the first time or manually triggers the detection, the sound player first plays the audio data of the R channel that is only valid for the R speaker, and at the same time obtains the sound from the R speaker through the microphone array, locates the sound source, and measures the spatial position of the R speaker, such as , measured by the DOA (localization of sound source) method. By analogy, the audio data of the L, Ls and Rs channels are played respectively, and the spatial positions of the L, Ls and Rs speakers are measured in turn. Then, according to the spatial positions of the R, L, Ls, and Rs speakers, the relative positions between the four speakers are determined as front left, front right, rear right, and rear left. Set the audio stream data format to R_C_L_Rs_Ls_Lfe according to the determined relative positions of the four speakers.

In some embodiments, it is also necessary to delay or advance the audio data of some speakers to ensure sound synchronization. Assuming that the preset time value is 1ms, the time difference between the sound of each speaker reaching the human ear cannot exceed 1ms, that is, the absolute value of the difference between the distance between each speaker and the center point cannot exceed 0.34m, and the distance value can also be preset directly. 0.34m. In order to simplify the calculation, the embodiment of the present application uses the difference between the distance from the speaker to the center point and the average value of the distance from each speaker to the center point for calculation. If the difference is within the range, no processing is required. The value is less than or equal to the opposite of the preset value, that is, the speaker is too close, and the audio data of the speaker needs to be delayed or processed in advance; if the difference is greater than or It is equal to the preset value, that is, the distance of the speaker is too far, and the audio data of the speaker needs to be processed in advance, or the audio data of the speakers other than the speaker needs to be delayed.

The specific method includes: calculating the spatial position of the center point of the space surrounded by the four speakers according to the spatial positions of the four speakers, such as averaging the coordinate values of the four speakers to obtain the coordinate value of the center point, Alternatively, the intersection of the diagonal lines may be used as the center point, etc. The method for confirming the center point is not limited in the present application. Then calculate the distances S ₁ , S ₂ , S ₃ and S ₄ from the R, L, Ls and Rs speakers to the center point respectively, and average these four distance values S*=(S ₁ +S ₂ + S ₃ +S ₄ )/4, and then calculate the difference ΔSi between S ₁ , S ₂ , S ₃ and S ₄ and S*, respectively, where i=1, 2, 3, 4. Assuming that the absolute values of ΔS ₁ , ΔS ₂ and ΔS ₄ are all less than 0.34m, and ΔS ₃ =3 is greater than 0.34m, it is necessary to preprocess the audio data of the Ls speaker, or delay the audio data of the R, L and Rs speakers. processing, and processing time

That is, the audio data of the Ls speaker is sent 8.8ms in advance, or the audio data of the R, L and Rs speakers is sent with a delay of 8.8ms. If ΔS ₁ =-1, ΔS ₄ =2, and the absolute values of ΔS ₁ and ΔS ₃ are both less than 0.34m, then the audio data of the R speaker needs to be delayed, and the audio data of the Rs speaker needs to be processed in advance, and

That is, the audio data of the R speaker is sent with a delay of 2.9ms, and the audio data of the Rs speaker is sent 5.9ms in advance.

Embodiments of the present application further provide an audio playback device, which is used to implement the audio playback method based on sound source localization involved in the embodiment in FIG. 1 , which can be implemented by hardware or by executing corresponding software in hardware. The hardware or software includes one or more units corresponding to the above-mentioned functions, for example, a spatial position measurement unit, a relative position determination unit and an audio stream data format setting unit, and the spatial position measurement unit is used to play the audio data of each channel in turn, through the The microphone array obtains the sound emitted by the speakers corresponding to each channel, and calculates the spatial position of the speakers corresponding to each channel, where one channel corresponds to one speaker; the relative position determination unit is used to determine the space between the speakers according to the spatial position of each speaker. Relative position; the audio stream data format setting unit is used to set the audio stream data format according to the relative position between each speaker.

In some embodiments, the method for setting the audio stream data format by the audio stream data format setting unit includes: setting the audio data format corresponding to each relative position in the audio stream to the format of the channel corresponding to the speaker located at the relative position.

In some embodiments, the audio playback device further includes: a center point position calculation unit, configured to calculate the spatial position of the center point of the space surrounded by each speaker according to the spatial position of each speaker; a synchronization processing unit, used to calculate each speaker The distance from the speaker to the center point, delay or advance processing is performed on the audio data of some speakers according to the distance from each speaker to the center point.

An embodiment of the present application further provides an audio playback device, including a memory for storing a program, and a processor coupled to the memory, wherein, when the processor runs the program, the implementation as shown in FIG. 1 is implemented. method involved.

Embodiments of the present application further provide a projection device, including the above-mentioned audio playback device. In some embodiments, the projection device further includes the above-mentioned microphone array, which is used for acquiring sound and testing the spatial position of each sound box to be tested.

Embodiments of the present application further provide a computer-readable storage medium, including computer instructions, and when the computer instructions are executed by a processor, the method involved in the embodiment in FIG. 1 is implemented.

It should be understood that, in various embodiments of the present application, the size of the sequence numbers of the above-mentioned processes does not imply the sequence of execution, some or all of the steps may be executed in parallel or sequentially, and the execution sequence of each process should be based on its functions and It is determined by the internal logic and should not constitute any limitation on the implementation process of the embodiments of the present application.

Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described systems, devices and units may refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, a network device or a terminal device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, removable hard disk, ROM, RAM) disk or optical disk and other media that can store program codes.

The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. As used in the embodiments of this application and the appended claims, the singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items. The character "/" in this article generally indicates that the related objects are an "or" relationship.

Depending on the context, the words "if" or "if" as used herein may be interpreted as "at" or "when" or "in response to determining" or "in response to detecting." Similarly, the phrases "if determined" or "if detected (the stated condition or event)" can be interpreted as "when determined" or "in response to determining" or "when detected (the stated condition or event)," depending on the context )" or "in response to detection (a stated condition or event)".

Those of ordinary skill in the art can understand that all or part of the steps in the methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a readable storage medium of a device, and when the program is executed , including all or part of the above steps, the storage medium, such as: FLASH, EEPROM, etc.

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited to this. should be covered within the scope of protection of this application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

An audio playback method based on sound source localization, comprising:

Play the audio data of each channel in turn, obtain the sound emitted by the speakers corresponding to each channel through the microphone array, and measure the spatial position of the speakers corresponding to each channel, where one channel corresponds to one speaker;

According to the spatial position of each speaker, determine the relative position of each speaker;

Set the audio stream data format according to the relative position of each speaker.
A kind of audio playback method based on sound source localization according to claim 1, it is characterized in that, described according to the relative position between each sound box, set the audio stream data format, including:

The audio data format corresponding to each relative position in the audio stream is set to the format of the channel corresponding to the speaker located at the relative position.
A kind of audio playback method based on sound source localization according to claim 1, is characterized in that, also comprises:

According to the spatial position of each speaker, the spatial position of the center point of the space enclosed by each speaker is calculated.
A kind of audio playback method based on sound source localization according to claim 3, is characterized in that, also comprises:

Calculate the distance from each sound box to the center point, and perform delay or advance processing on the audio data of some sound boxes according to the distance from each sound box to the center point.
A kind of audio playback method based on sound source localization according to claim 4, is characterized in that, described according to each sound box to the described center point The audio data of some sound boxes is delayed or processed ahead of time, comprising:

Calculate the average value of the distances from each speaker to the center point;

Calculate the difference ΔSi between the distance from each speaker to the center point and the average value, where i=1, 2, 3, ..., n, n is the total number of speakers to be tested;

If ΔSi is less than or equal to the inverse of the preset distance value, delay processing is performed on the audio data of speaker i or advanced processing is performed on the audio data of speakers other than speaker i;

If ΔSi is greater than or equal to the preset distance value, the audio data of speaker i is processed in advance or the audio data of speakers other than speaker i is processed with delay.
The audio playback method based on sound source localization according to claim 5, wherein the preset distance value is preset, or calculated according to the preset time value multiplied by the speed of sound.
A kind of audio playback method based on sound source localization according to claim 5, is characterized in that, the calculation formula of the delay time of described delay processing or the advance time ti of advance processing is:

where C is the speed of sound.
The method for audio playback based on sound source localization according to claim 3, wherein the determining the relative positions between the respective speakers according to the spatial positions of the respective speakers, comprising:

According to the spatial position of each sound box and the spatial position of the center point, the relative position between each sound box is determined.
The audio playback method based on sound source localization according to any one of claims 1-8, wherein the spatial position includes spatial coordinates.
An audio playback device, comprising:

The spatial position measurement unit is used to play the audio data of each channel in turn, obtain the sound emitted by the speakers corresponding to each channel through the microphone array, and measure the spatial position of the speakers corresponding to each channel, wherein one channel corresponds to one speaker;

The relative position determination unit is used to determine the relative position of each speaker according to the spatial position of each speaker;

The audio stream data format setting unit is used for setting the audio stream data format according to the relative positions between the respective speakers.
A kind of audio playback device according to claim 10, is characterized in that, the method that audio stream data format setting unit sets audio stream data format comprises:

The audio data format corresponding to each relative position in the audio stream is set to the format of the channel corresponding to the speaker located at the relative position.
An audio playback device according to claim 10, further comprising:

The center point position calculation unit is used to calculate the spatial position of the center point of the space surrounded by each speaker according to the spatial position of each speaker;

The synchronization processing unit is used to calculate the distance from each speaker to the center point, and delay or advance the audio data of some speakers according to the distance from each speaker to the center point.
An audio playback device, comprising:

memory for storing programs;

A processor, coupled to the memory, implements the audio playback method based on sound source localization according to any one of claims 1-9 when the program is executed by the processor.
A projection device, characterized in that it comprises the audio playback device according to any one of claims 10-13.
The projection device according to claim 14, further comprising: a microphone array, wherein the microphone array is used to acquire the sound emitted by each sound box, and measure the spatial position of each sound box.
A computer-readable storage medium, comprising computer instructions, when the computer instructions are executed by a processor, the audio playback method based on sound source localization according to any one of claims 1-9 is implemented.