USRE47820E1 - Apparatus and method for providing a loudspeaker-enclosure-microphone system description - Google Patents

Abstract

An apparatus for providing a current loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system is provided. The apparatus has a first transformation unit for generating a plurality of wave-domain loudspeaker audio signals. Moreover, the apparatus has a second transformation unit for generating a plurality of wave-domain microphone audio signals. Furthermore, the apparatus has a system description generator for generating the current loudspeaker-enclosure-microphone system description based on the plurality of wave-domain loudspeaker audio signals, based on the plurality of wave-domain microphone audio signals, and based on a plurality of coupling values, wherein the system description generator is configured to determine each coupling value assigned to a wave-domain pair of a plurality of wave-domain pairs by determining a relation indicator indicating a relation between a loudspeaker-signal-transformation value and a microphone-signal-transformation value.

Description

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of copending International Application No. PCT/EP2012/064827, filed Jul. 27, 2012, which is incorporated herein by reference in its entirety.

BACKGROUND OF THE INVENTION

The present invention relates to audio signal processing and, in particular, to an apparatus and method for identifying a loudspeaker-enclosure-microphone system.

Spatial audio reproduction technologies become increasingly important. Emerging spatial audio reproduction technologies, such as wave field synthesis (WFS) (see [1]) or higher-order Ambisonics (see [2]) aim at creating or reproducing acoustic wave fields that provide a perfect spatial impression of the desired acoustic scene in an extended listening area. Reproduction technologies like WFS or HOA provide a high-quality spatial impression to the listener, utilizing a large number of reproduction channels. To this end, typically, loudspeaker arrays with dozens to hundreds of elements are used. The combination of these techniques with spatial recording systems opens up new fields of applications such as immersive telepresence and natural acoustic human/machine interaction. To obtain a more immersive user experience, such reproduction systems may be complemented by a spatial recording system to approach new application fields or to improve the reproduction quality. The combination of the loudspeaker array, the enclosing room and the microphone array is referred to as loudspeaker-enclosure-microphone system and is identified in many application scenarios by observing the present loudspeaker and microphone signals. As an example, the local acoustic scene in a room is often recorded in a room where another acoustic scene is played back by a reproduction system.

However, the desired microphone signals of the local acoustic scene cannot be observed without the echo of the loudspeakers in such scenarios. In a teleconference, the resulting signals would annoy the far-end party [3], while a speech recognizer in a voice-based human/machine front end will generally exhibit poor recognition rates [4]. Acoustic echo cancellation (AEC) is commonly used to remove the unwanted loudspeaker echo from the recorded microphone signals while preserving the desired signals of the local acoustic scene without quality degradation. To this end, the loudspeaker-enclosure-microphone system (LEMS) is modeled by an adaptive filter which produces an estimate of the loudspeaker echos contained in the microphone signals which is subtracted from the actual microphone signals. This task comprises an identification of the LEMS, ideally leading to a unique solution. In the following, the term LEMS refers to a MIMO LEMS (Multiple-Input Multiple-Output LEMS).

AEC is significantly more challenging in the case of multichannel (MC) reproduction compared to the single-channel case, because the nonuniqueness problem [5] will generally occur: Due to the strong cross-correlation between the loudspeaker signals (e.g., those for the left and the right channel in a stereo setup), the identification problem is ill-conditioned and it may not be possible to uniquely identify the impulse responses of the corresponding LEMSs [6]. The system identified instead, denotes only one of infinitely many solutions defined by the correlation properties of the loudspeaker signals. Therefore the true LEMS is only incompletely identified. The nonuniqueness problem is already known from the stereophonic AEC (see, e.g. [6]) and becomes severe for massive multichannel reproduction systems like, e. g., wavefield synthesis systems.

An incompletely identified system still describes the behavior of the true LEMS for the present loudspeaker signals and may therefore be used for different adaptive filtering applications, although the identified impulse responses may differ from the true impulse responses. In the case of AEC, the obtained impulse responses describe the LEMS sufficiently well to significantly suppress the loudspeaker echo.

However, when the cross-correlation properties of the loudspeaker signals change, this is no longer true and the behavior of systems relying on adaptive filters may in fact be uncontrollable. When there is a change in the cross-correlation of the loudspeaker signals, a breakdown of the echo cancellation performance is the typical consequence. This lack of robustness constitutes a major obstacle for the application of MCAEC. Moreover, other applications, such as listen room equalization (also called listening room equalization) or active noise cancellation (also called active noise control) do also rely on a system identification and are strongly affected in a similar way.

To increase robustness under these conditions, the loudspeaker signals are often altered to achieve a decorrelation so that the true LEMS can be uniquely identified. A decorrelation of the loudspeaker signals is a common choice.

For this purpose, three options are known: Adding mutually independent noise signals to the loudspeaker signals [5,7,8] different nonlinear preprocessing [6,9] or differently time-varying filtering [10,11] for each loudspeaker signal. Although perfect solutions are unknown, a time-varying phase modulation has been shown to be applicable even to high-quality audio. [11]. While the mentioned techniques should ideally not impair the perceived sound quality, an application of these approaches for the mentioned reproduction techniques might not be an optimum choice: As the loudspeaker signals for WFS and HOA are analytically determined, time-varying filtering might significantly distort the reproduced wave field and when aiming at high-quality audio reproduction, a listener will probably not accept the addition of noise signals or non-linear preprocessing.

There might be scenarios where an alteration of the loudspeaker signals is unwanted or impractical. An example is given by WFS, where the loudspeaker signals are determined according to the underlying theory and a deviation in phase would distort the reproduced wave field. Another example is the extension of reproduction systems, where the loudspeaker signals are observable, but cannot be altered. However, in such cases it is still possible to mitigate the consequences of the nonuniqueness problem by heuristic approaches to improve the system description. Such heuristics can be based on knowledge about the transducer positions and the resulting impulse responses of the LEMS. For a stereophonic AEC in a symmetric array setup this was proposed by Shimauchi et al. [12], assuming that the symmetric array setup results in a symmetry of the impulse responses for the corresponding loudspeaker-to-microphone paths.

Allowing no alteration of the loudspeaker signals, it is still possible to improve system description when the nonuniqueness problem occurs, although this possibility has barely been investigated in the past. To this end, knowledge of the LEMS geometry can be used to derive additional constraints to choose an improved solution for the system description in a heuristic sense. One such approach was presented in [12] where the symmetry of a stereophonic array setup was exploited accordingly.

However, in [12] no solution is presented for systems with large numbers of loudspeakers and microphones, such as loudspeaker-enclosure-microphone systems.

Wave-domain adaptive filtering was proposed by Buchner et al. in 2004 for various adaptive filtering tasks in acoustic signal processing, including multichannel acoustic echo cancellation (MCAEC) [13], multichannel listening room equalization [27] and multichannel active noise control [28]. In 2008, Buchner and Spors published a formulation of the generalized frequency-domain adaptive filtering (GFDAF) algorithm [15] with application to MCAEC [14] for the use with wave-domain adaptive filtering (WDAF), however, disregarding the nonuniqueness problem [15].

SUMMARY

According to an embodiment, an apparatus for providing a current loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system, wherein the loudspeaker-enclosure-microphone system has a plurality of loudspeakers and a plurality of microphones, may have: a first transformation unit for generating a plurality of wave-domain loudspeaker audio signals, wherein the first transformation unit is configured to generate each of the wave-domain loudspeaker audio signals based on a plurality of time-domain loudspeaker audio signals and based on one or more of a plurality of loudspeaker-signal-transformation values, said one or more of the plurality of loudspeaker-signal-transformation values being assigned to said generated wave-domain loudspeaker audio signal, a second transformation unit for generating a plurality of wave-domain microphone audio signals, wherein the second transformation unit is configured to generate each of the wave-domain microphone audio signals based on a plurality of time-domain microphone audio signals and based on one or more of a plurality of microphone-signal-transformation values, said one or more of the plurality of microphone-signal-transformation values being assigned to said generated wave-domain loudspeaker audio signal, and a system description generator for generating the current loudspeaker-enclosure-microphone system description based the plurality of wave-domain loudspeaker audio signals, and based on the plurality of wave-domain microphone audio signals, wherein the system description generator is configured to generate the loudspeaker-enclosure-microphone system description based on a plurality of coupling values, wherein each of the plurality of coupling values is assigned to one of a plurality of wave-domain pairs, each of the plurality of wave-domain pairs being a pair of one of the plurality of loudspeaker-signal-transformation values and one of the plurality of microphone-signal-transformation values, and wherein the system description generator is configured to determine each coupling value assigned to a wave-domain pair of the plurality of wave-domain pairs by determining for said wave-domain pair at least one relation indicator indicating a relation between one of the one or more loudspeaker-signal-transformation values of said wave-domain pair and one of the microphone-signal-transformation values of said wave-domain pair to generate the loudspeaker-enclosure-microphone system description.

According to another embodiment, a system may have: a plurality of loudspeakers of a loudspeaker-enclosure-microphone system, a plurality of microphones of the loudspeaker-enclosure-microphone system, and an apparatus for providing a current loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system as mentioned above, wherein the plurality of loudspeakers are arranged to receive a plurality of loudspeaker input signals, wherein the above apparatus is arranged to receive the plurality of loudspeaker input signals, wherein the plurality of microphones are configured to record a plurality of microphone input signals, wherein the above apparatus is arranged to receive the plurality of microphone input signals, and wherein the above apparatus is configured to adjust a loudspeaker-enclosure-microphone system description based on the received loudspeaker input signals and based on the received microphone input signals.

According to another embodiment, a system for generating filtered loudspeaker signals for a plurality of loudspeakers of a loudspeaker-enclosure-microphone system may have: a filter unit, and an apparatus for providing a current loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system as mentioned above, wherein the above apparatus is configured to provide a current loudspeaker-enclosure-microphone system description of the loudspeaker-enclosure-microphone system to the filter unit, wherein the filter unit is configured to adjust a loudspeaker signal filter based on the current loudspeaker-enclosure-microphone system description to obtain an adjusted filter, wherein the filter unit is arranged to receive a plurality of loudspeaker input signals, and wherein the filter unit is configured to filter the plurality of loudspeaker input signals by applying the adjusted filter on the loudspeaker input signals to obtain the filtered loudspeaker signals.

According to still another embodiment, a method for providing a current loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system, wherein the loudspeaker-enclosure-microphone system has a plurality of loudspeakers and a plurality of microphones, may have the steps of: generating a plurality of wave-domain loudspeaker audio signals by generating each of the wave-domain loudspeaker audio signals based on a plurality of time-domain loudspeaker audio signals and based on one or more of a plurality of loudspeaker-signal-transformation values, said one or more of the plurality of loudspeaker-signal-transformation values being assigned to said generated wave-domain loudspeaker audio signal, generating a plurality of wave-domain microphone audio signals by generating each of the wave-domain microphone audio signals based on a plurality of time-domain microphone audio signals and based on one or more of a plurality of microphone-signal-transformation values, said one or more of the plurality of microphone-signal-transformation values being assigned to said generated wave-domain loudspeaker audio signal, and generating the current loudspeaker-enclosure-microphone system description based the plurality of wave-domain loudspeaker audio signals, and based on the plurality of wave-domain microphone audio signals, wherein the loudspeaker-enclosure-microphone system description is generated based on a plurality of coupling values, wherein each of the plurality of coupling values is assigned to one of a plurality of wave-domain pairs, each of the plurality of wave-domain pairs being a pair of one of the plurality of loudspeaker-signal-transformation values and one of the plurality of microphone-signal-transformation values, and wherein each coupling value assigned to a wave-domain pair of the plurality of wave-domain pairs is determined by determining for said wave-domain pair at least one relation indicator indicating a relation between one of the one or more loudspeaker-signal-transformation values of said wave-domain pair and one of the microphone-signal-transformation values of said wave-domain pair to generate the loudspeaker-enclosure-microphone system description.

According to another embodiment, a method for determining at least two filter configurations of a loudspeaker signal filter for at least two different loudspeaker-enclosure-microphone system states, wherein the loudspeaker signal filter is arranged to filter a plurality of loudspeaker input signals to obtain a plurality of filtered loudspeaker signals for steering a plurality of loudspeakers of a loudspeaker-enclosure-microphone system, may have the steps of: determining a first loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system according to the above method for providing a current loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system, when the loudspeaker-enclosure-microphone system has a first state, determining a first filter configuration of the loudspeaker signal filter based on the first loudspeaker-enclosure-microphone system description, storing the first filter configuration in a memory, determining a second loudspeaker-enclosure-microphone system description of the loudspeaker-enclosure-microphone system according to the above method, when the loudspeaker-enclosure-microphone system second a second state, determining a second filter configuration of the loudspeaker signal filter based on the second loudspeaker-enclosure-microphone system description, and storing the second filter configuration in the memory.

Another embodiment may have a computer program for implementing the above method for providing a current loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system or the above method for determining at least two filter configurations of a loudspeaker signal filter for at least two different loudspeaker-enclosure-microphone system states when being executed by a computer or processor.

Embodiments provide a wave-domain representation for the LEMS, where the relative weights of the true mode couplings depict a predictable structure to a certain extend. An adaptive filter is used, where the adaptation algorithm for adapting the LEMS identification is modified in a way such that the mode coupling weights of the identified LEMS show the same structure as it can be expected for the true LEMS represented in the wave-domain. A wave-domain representation is characterized by using fundamental solutions of the wave-equation as basis functions for the loudspeaker and microphone signals.

In embodiments, concepts for multichannel Acoustic Echo Cancellation (MCAEC) systems are provided, which maintain robustness in the presence of the nonuniqueness problem without altering the loudspeaker signals. To this end, wave-domain adaptive filtering (WDAF) concepts are provided which use solutions of the wave equation as basis functions for a transform domain for the adaptive filtering. Consequently, the considered signal representations can be directly interpreted in terms of an ideally reproduced wave field and an actually reproduced wave field within the loudspeaker-enclosure-microphone system (LEMS). Using the fact that the relation between these two wave fields is predictable to a certain extent, additional nonrestrictive assumptions for an improved system description in the wave domain are provided. These assumptions are used to provide a modified version of the generalized frequency-domain adaptive filtering algorithm which was previously introduced for MCAEC. Moreover, a corresponding algorithm along with the necessitated transforms and the results of an experimental evaluation are provided.

Embodiments provide concepts to mitigate the consequences of the nonuniqueness problem by using WDAF with a modified version of the GFDAF algorithm presented in [14]. The system description in the wave domain according to the provided embodiment leads to an increased robustness to the nonuniqueness problem. In embodiments, a wave-domain model is provided which reveals predictable properties of the LEMS. It can be shown that this approach significantly improves the robustness of an AEC for reproduction systems with many reproduction channels. Major benefits will also result for other applications by applying the proposed concepts. According to embodiments, predictable wave-domain properties are provided to improve the system description when the nonuniqueness problem occurs. This can significantly increase the robustness to changing correlation properties of the loudspeaker signals, while the loudspeaker signals themselves are not altered. Any technique necessitating a MIMO system description with a large number of reproduction channels can benefit from the provided embodiments. Notable examples are active noise control (ANC), AEC and listening room equalization.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the present invention will be explained with reference to the drawings, in which:

FIG. 1a illustrates an apparatus for identifying a loudspeaker-enclosure-microphone system according to an embodiment,

FIG. 1b illustrates an apparatus for identifying a loudspeaker-enclosure-microphone system according to another embodiment,

FIG. 2 illustrates a loudspeaker and microphone setup used in the LEMS to be identified, wherein the z=0 plane is depicted in cylindrical coordinates,

FIG. 3 illustrates a block diagram of a WDAF AEC system. G_RS illustrates a reproduction system, H illustrates a LEMS, T₁,T₂, and T₂ ⁻¹ illustrate transforms to and from the wave domain, and {tilde over (H)}(n) illustrates an adaptive LEMS model in the wave domain,

FIG. 4 illustrates logarithmic magnitudes (absolute values) of H_μ,λ(jω) and {tilde over (H)}_m′,1′(jω) in dB with μ=0, . . . , N_M−1, λ=0, . . . , N_L−1, and m′=−4, . . . , 5, l′=−23, . . . , 24, for different frequencies ω=2πf,f=1 kHz, 2 kHz, 4 kHz normalized to the maximum of the subfigures in each row,

FIG. 5 is an exemplary illustration of mode coupling weights and additionally introduced cost. Illustration (a) of FIG. 5 depicts weights of couplings of the wave field components for the true LEMS {tilde over (H)}_m,l(jω) illustration (b) of FIG. 5 depicts the additional cost introduced by formula (4), and illustration (c) of FIG. 5 depicts the resulting weights of the identified LEMS Ĥ_m,l(jω),

FIG. 6a shows an exemplary loudspeaker and microphone setup used for ANC according to an embodiment,

FIG. 6b illustrates a block diagram of an ANC system according to an embodiment,

FIG. 6c illustrates a block diagram of an LRE system according to an embodiment,

FIG. 6d illustrates an algorithm of a signal model of an LRE system according to an embodiment,

FIG. 6e illustrates a signal model for the Filtered-X GFDAF according to an embodiment,

FIG. 6f illustrates a system for generating filtered loudspeaker signals for a plurality of loudspeakers of a loudspeaker-enclosure-microphone system according to an embodiment,

FIG. 6g illustrates a system for generating filtered loudspeaker signals for a plurality of loudspeakers of a loudspeaker-enclosure-microphone system according to an embodiment showing more details,

FIG. 7 illustrates ERLE and the normalized misalignment (NMA) for a first WDAF AEC according to the state of the art and for a second WDAF AEC according to an embodiment.

FIG. 8 illustrates ERLE and the normalized misalignment (NMA) for a WDAF AEC with a suboptimal initialization value S(0), and

FIG. 9 illustrates ERLE and the normalized misalignment (NMA) for a WDAF AEC in the presence of short interfering signals, wherein the interferers are present at t=5 s and t=15 s for 50 ms, and wherein at t=25 s the incidence angle of the synthesized plane wave was changed.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1a illustrates an apparatus for providing a current loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system according to an embodiment. In particular, an apparatus for providing a current loudspeaker-enclosure-microphone system description ({tilde over (H)}(n)) of a loudspeaker-enclosure-microphone system is provided. The loudspeaker-enclosure-microphone system comprises a plurality of loudspeakers (110; 210; 610) and a plurality of microphones (120; 220; 620).

The apparatus comprises a first transformation unit (130; 330; 630) for generating a plurality of wave-domain loudspeaker audio signals ({tilde over (x)}₀(n), . . . {tilde over (x)}_l(n), . . . , {tilde over (x)}_{N L −1}(n)), wherein the first transformation unit (130; 330; 630) is configured to generate each of the wave-domain loudspeaker audio signals ({tilde over (x)}₀(n), . . . {tilde over (x)}_l(n), . . . , {tilde over (x)}_{N L −1}(n)) based on a plurality of time-domain loudspeaker audio signals (x₀(n), . . . x_λ(n), . . . , x_{N L −1}(n)) and based on one or more of a plurality of loudspeaker-signal-transformation values (l; l′), said one or more of the plurality of loudspeaker-signal-transformation values (l; l′) being assigned to said generated wave-domain loudspeaker audio signal.

Moreover, the apparatus comprises a second transformation unit (140; 340; 640) for generating a plurality of wave-domain microphone audio signals ({tilde over (d)}₀(n), . . . {tilde over (d)}_m(n), . . . , {tilde over (d)}_{N M −1}(n)), wherein the second transformation unit (330) is configured to generate each of the wave-domain microphone audio signals ({tilde over (d)}₀(n), . . . {tilde over (d)}_m(n), . . . , {tilde over (d)}_{N M −1}(n)) based on a plurality of time-domain microphone audio signals (d₀(n), . . . d_μ(n), . . . , d_{N M −1}(n)) and based on one or more of a plurality of microphone-signal-transformation values (m, m′), said one or more of the plurality of microphone-signal-transformation values (m; m′) being assigned to said generated wave-domain loudspeaker audio signal.

Furthermore, the apparatus comprises a system description generator (150) for generating the current loudspeaker-enclosure-microphone system description based the plurality of wave-domain loudspeaker audio signals ({tilde over (x)}₀(n), . . . {tilde over (x)}_l(n), . . . , {tilde over (x)}_{N L −1}(n)), and based on the plurality of wave-domain microphone audio signals ({tilde over (d)}₀(n), . . . {tilde over (d)}_m(n), . . . , {tilde over (d)}_{N M −1}(n))

The system description generator (150) is configured to generate the loudspeaker-enclosure-microphone system description based on a plurality of coupling values, wherein each of the plurality of coupling values is assigned to one of a plurality of wave-domain pairs, each of the plurality of wave-domain pairs being a pair of one of the plurality of loudspeaker-signal-transformation values (l; l′) and one of the plurality of microphone-signal-transformation values (m; m′).

Moreover, the system description generator (150) is configured to determine each coupling value assigned to a wave-domain pair of the plurality of wave-domain pairs by determining for said wave-domain pair at least one relation indicator indicating a relation between one of the one or more loudspeaker-signal-transformation values of said wave-domain pair and one of the microphone-signal-transformation values of said wave-domain pair to generate the loudspeaker-enclosure-microphone system description.

FIG. 1b illustrates an apparatus for providing a current loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system according to another embodiment. The loudspeaker-enclosure-microphone system comprises a plurality of loudspeakers and a plurality of microphones.

A plurality of time-domain loudspeaker audio signals x₀(n), . . . , x_λ(n), . . . , x_{N L −1}(n) are fed into a plurality of loudspeakers 110 of a loudspeaker-enclosure-microphone system (LEMS). The plurality of time-domain loudspeaker audio signals x₀(n), . . . , x_λ(n), . . . , x_{N L −1}(n) is also fed into a first transformation unit 130. Although, for illustrative purposes, only three time-domain loudspeaker audio signals are depicted in FIG. 1b, it is assumed that all loudspeakers of the LEMS are connected to time-domain loudspeaker audio signals and these time-domain loudspeaker audio signals are also fed into the first transformation unit 130.

The apparatus comprises a first transformation unit 130 for generating a plurality of wave-domain loudspeaker audio signals {tilde over (x)}₀(n), . . . {tilde over (x)}_l(n), . . . , {tilde over (x)}_{N L −1}(n), wherein the first transformation unit 130 is configured to generate each of the wave-domain loudspeaker audio signals {tilde over (x)}₀(n), . . . {tilde over (x)}_l(n), . . . , {tilde over (x)}_{N L −1}(n), based on the plurality of time-domain loudspeaker audio signals x₀(n), . . . , x_λ(n), . . . , x_{N L −1}(n) and based on one of a plurality of loudspeaker-signal-transformation mode orders (not shown). In other words: The mode order employed determines how the first transformation unit 130 conducts the transformation to obtain the corresponding wave domain loudspeaker audio signal. The loudspeaker-signal-transformation mode order employed is a loudspeaker-signal-transformation value.

Furthermore, the plurality of microphones 120 of the LEMS record a plurality of time-domain microphone audio signals d₀(n), . . . , d_μ(n), . . . , d_{N M −1}(n), Although, for illustrative purposes, only three time-domain audio signals d₀(n), . . . , d_μ(n), . . . , d_{N M −1}(n) recorded by three microphones 120 of the LEMS are shown, it is assumed that each microphone 120 of the LEMS records a time-domain microphone audio signal and all these microphone audio signals are fed into a second transformation unit 140.

The second transformation unit 140 is adapted to generate a plurality of wave-domain microphone audio signals {tilde over (d)}₀(n), . . . {tilde over (d)}_m(n), . . . , {tilde over (d)}_{N M −1}(n), wherein the second transformation unit 140 is configured to generate each of the wave-domain microphone audio signals {tilde over (d)}₀(n), . . . {tilde over (d)}_m(n), . . . , {tilde over (d)}_{N M −1}(n) based on a plurality of time-domain microphone audio signals d₀(n), . . . , d_μ(n), . . . , d_{N M −1}(n) and based on one of a plurality of microphone-signal-transformation mode orders (not shown). In other words: The mode order employed determines how the second transformation unit 140 conducts the transformation to obtain the corresponding wave domain microphone audio signal. The microphone-signal-transformation mode order employed is a microphone-signal-transformation value.

Furthermore, the apparatus comprises a system description generator 150. The system description generator 150 comprises a system description application unit 160, an error determiner 170 and a system description generation unit 180.

The system description application unit 160 is configured to generate a plurality of wave-domain microphone estimation signals {tilde over (y)}₀(n), . . . , {tilde over (y)}_m(n), . . . , {tilde over (y)}_{N M −1}(n) based on the wave-domain loudspeaker audio signals {tilde over (x)}₀(n), . . . {tilde over (x)}_l(n), . . . , {tilde over (x)}_{N L −1}(n) and based on a previous loudspeaker-enclosure-microphone system description of the loudspeaker-enclosure-microphone system.

The error determiner 170 is configured to determine a plurality of wave-domain error signals {tilde over (d)} ₀(n), . . . {tilde over (d)} _m(n), . . . , {tilde over (d)} _{N M −1}(n) based on the plurality of wave-domain microphone audio signals {tilde over (d)}₀(n), . . . {tilde over (d)}_m(n), . . . , {tilde over (d)}_{N M −1}(n) and based on the plurality of wave-domain microphone estimation signals {tilde over (y)}₀(n), . . . , {tilde over (y)}_m(n), . . . , {tilde over (y)}_{N M −1}(n).

The system description generation unit 180 is configured to generate the current loudspeaker-enclosure-microphone system description based on the wave-domain loudspeaker audio signals {tilde over (x)}₀(n), . . . {tilde over (x)}_l(n), . . . , {tilde over (x)}_{N L −1}(n) and based on the plurality of error signals {tilde over (d)} ₀(n), . . . {tilde over (d)} _m(n), . . . , {tilde over (d)} _{N M −1}(n).

The system description generation unit 180 is configured to generate the loudspeaker-enclosure-microphone system description based on a first coupling value β₁ of the plurality of coupling values, when a first relation value indicating a first difference between a first loudspeaker-signal-transformation mode order l of the plurality of loudspeaker-signal mode orders (l; l′) and a first microphone-signal-transformation mode order m of the plurality of microphone-signal mode orders (m; m′) has a first difference value. Moreover, the system description generation unit 180 is configured to assign the first coupling value β₁ to a first wave-domain pair of the plurality of wave-domain pairs, when the first relation value has the first difference value. In this context, the first wave-domain pair is a pair of the first loudspeaker-signal mode order and the first microphone-signal mode order, and wherein the first relation value is one of the plurality of relation indicators.

Furthermore, the system description generation unit 180 is configured to generate the loudspeaker-enclosure-microphone system description based on a second coupling value β₂ of the plurality of coupling values, when a second relation value indicating a second difference between a second loudspeaker-signal-transformation mode order l of the plurality of loudspeaker-signal-transformation mode orders l and a second microphone-signal-transformation mode order m of the plurality of microphone-signal-transformation mode orders m has a second difference value, being different from the first difference value. Moreover, the system description generation unit 180 is configured to assign the second coupling value β₂ to the second wave-domain pair of the plurality of wave-domain pairs, when the second relation value has the second difference value. In this context, the second wave-domain pair is a pair of the second loudspeaker-signal mode order of the plurality of loudspeaker-signal mode orders and the second microphone-signal mode order of the plurality of microphone-signal mode orders, wherein the second wave-domain pair is different from the first wave-domain pair, and wherein the second relation value is one of the plurality of relation indicators.

An example for coupling values is, for example provided in formula (60) below, wherein c_q(n) are coupling values. In particular, in formula (60), β₁ is a first coupling value, β₂ is a second coupling value, and l is a third coupling value.

See formula (60):

$\begin{array}{cc}{c}_q\left(n\right)=\{\begin{array}{cc}{\mathrm{<figure-callout\; id="1"\; label="\beta "\; filenames="USRE047820-20200114-D00002.png,USRE047820-20200114-D00014.png"\; state="\{\{state\}\}">\beta </figure-callout>}}_1& \mathrm{when}\Delta m\left(q\right)=0,\\ {\mathrm{<figure-callout\; id="2"\; label="\beta "\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">\beta </figure-callout>}}_2& \mathrm{when}\Delta m\left(q\right)=1,\\ 1& \mathrm{elsewhere},\end{array}& \left(60\right)\end{array}$

An example for relation indicators is provided in formulae (60) and formulae (61) below, wherein Δm(q) represents relation indicators. In particular, a first relation value being a relation indicator may have the value Δm(q)=0 and a second relation value being a relation indicator may have the value Δm(q)=1.

As can be seen in formula (61) below, the relation values represented by Δm(q) indicates a relation between one of the one or more loudspeaker-signal-transformation values and one of the one or more microphone-signal-transformation values, e.g. a relation between the loudspeaker-signal-transformation mode order l and the microphone-signal-transformation mode order m. In particular, Δm(q) represents a difference of the mode orders l′ and m′.

See formula (61):
Δm(q)=min(|└q/L_H┘−m|,|└q/L_H┘−N_L)  (61)
wherein the microphone-signal-transformation mode order is m, and wherein the loudspeaker-signal-transformation mode order I is defined by:
l=└q/L_H┘

As can be seen in formulae (60) and (61), when the absolute difference between the third loudspeaker-signal-transformation mode order (1=q/L_H) and the third microphone-signal-transformation mode order (m) is greater than the predefined threshold value (here: greater than 1.0), then the coupling value is a third value (1.0), being different from the first coupling value (β₁) and the second coupling value (β₂).

The coupling value determined by employing formulae (60) and (61) may then, for example be employed in formula (58):
{tilde over (h)} _m(n)={tilde over (h)} _m(n−1)+(1−λ_a)(S(n)+C _m(n))⁻¹·(W ₁₀ ^H X ^H(n)W ₁₀ ^H{tilde over (e)}_m(n)−C _m(n){tilde over (h)} _m(n−1)).   (58)
to obtain an updated LEMS description (see below).

For more details regarding formulae (58), (60) and (61) see the explanations provided below.

In other embodiments, the loudspeaker-signal transformation values are not mode orders of circular harmonics, but mode indices of spherical harmonics, see below.

In further embodiments, the loudspeaker-signal transformation values are not mode orders of circular harmonics, but components representing a direction of plane waves, for example {tilde over (k)}_x, {tilde over (k)}_y, and {tilde over (k)}_z explained below with reference to formula (6k).

In the following, an overview of basic concepts of embodiments is provided.

Afterwards, a prototype will be described in general terms. Later on, embodiments are described in more detail.

At first, an overview of basic concepts of embodiments is provided. Please note that in the following l and m are used instead of l′ and m′ to increase readability of the formulae.

FIG. 2 illustrates a loudspeaker and microphone setup used in the LEMS to be identified, wherein the z=0 plane is depicted in cylindrical coordinates. A plurality of loudspeakers 210 and a plurality of microphones 220 are depicted. It is assumed that the LEMS comprises N_L loudspeakers and N_M microphones. Angle α and radius

describe polar coordinates.

FIG. 3 illustrates a block diagram of a corresponding WDAF AEC system for identifying a LEMS. G_RS (310) illustrates a reproduction system, H (320) illustrates a LEMS, T₁ (330),T₂ (340), and T₂ ⁻¹ (350) illustrate transforms to and from the wave domain, and {tilde over (H)}(n) (360) illustrates an adaptive LEMS model in the wave domain.

When considering the sound pressure P_λ ^(x)(jω) emitted by the loudspeaker λ and the sound pressure P_μ ^(d)(jω) measured by microphone p in the frequency domain, a LEMS can be modeled through

$\begin{array}{cc}{P}_{\mu }^{\left(d\right)}\left(j\omega \right)=\sum _{\lambda =0}^{N_L-1}{P}_{\lambda }^{\left(x\right)}\left(j\omega \right)H_{\mu ,\lambda }\left(j\omega \right),\mu =0,1,\dots ,N_M-1,& \left(1\right)\end{array}$
where H_μ,λ(jω) denotes the frequency responses between all N_L loudspeakers and N_M microphones. For many applications, the LEMS has to be identified, e.g., H_μ,λ(jω)∀λ, μ have to be estimated. To this end, the present P_λ ^(x)(jω) and p^(d)(jω) are observed and the filter Ĥ_μ,λ(jω)∀λ, μ is adapted, so that the P_μ ^(d)(jω) can be obtained by filtering P_λ ^(x)(jω). Often, the loudspeaker signals are strongly cross-correlated, so estimating H_μ,λ(jω) is an underdetermined problem and the nonuniqueness problem occurs. When the observed signals are the only considered information, as present for the vast majority of system description approaches, this problem cannot be solved without altering the loudspeaker signals. However, even when leaving the loudspeaker signals untouched, it is possible to exploit additional knowledge to narrow the set of plausible estimates for H_μ,λ(jω), so that an estimate near the true solution can be heuristically determined. Corresponding concepts are provided in the following.

Modeling the LEMS in the wave domain uses knowledge about the transducer array geometries to exploit certain properties of the LEMS. For a wave-domain model of the LEMS, the loudspeaker signals P_λ ^(x)(jω) and the microphone signals P_μ ^(d)(jω) are transformed to their wave-domain representations. The wave-domain representation of the microphone signals, the so-called measured wave field, describes the sound pressure measured by the microphones using fundamental solutions of the wave equation. The wave-domain representation of the loudspeaker signals is called free-field description as it describes the wave field as it was ideally excited by the loudspeakers in the free-field case. This is done at the microphone positions using the same basis functions as for the measured wave field. The class of wave-domain basis functions includes (but is not limited to) plane waves, spherical harmonics and circular harmonics. For the sake of brevity, in the following, the description relates to circular harmonics and transform P_λ ^(x)(jω) to {tilde over (P)}_l ^(x)(jω) and P_μ ^(d)(jω) to {tilde over (P)}_m ^(d)(jω) according to [23]. Other embodiments cover plane waves, spherical harmonics.

The sound pressure P(α,

, jω) at angle α and radius

describing polar coordinates is represented according to

$\begin{array}{cc}P\left(\alpha ,\varrho ,j\omega \right)=\sum _{l=-\infty }^{\infty }\left({\tilde{P}}_l^{\left(1\right)}\left(j\omega \right){\mathscr{H}}_l^{\left(1\right)}\left(\frac{\omega }{c}\varrho \right)+{\tilde{P}}_1^{\left(2\right)}\left(j\omega \right){\mathscr{H}}_l^{\left(2\right)}\left(\frac{\omega }{c}\varrho \right)\right)e^{jl\alpha },& \left(2\right)\end{array}$
where {tilde over (P)}_l ⁽¹⁾(jω) and {tilde over (P)}_l ⁽²⁾(jω) are spectra of outgoing and incoming waves, respectively. Both signal representations, {tilde over (P)}_l ^(x)(jω) and {tilde over (P)}_m ^(d)(jω) result from a superposition of {tilde over (P)}_l ⁽¹⁾(jω) and {tilde over (P)}_l ⁽²⁾(jω) as described in [23]. This choice of this basis functions was motivated by the circular array setup considered in [23], which is illustrated by FIG. 2. Circular harmonics are just one example of a whole class of basis functions which can be used for a wave-domain representation. Other examples are plane waves [13], cylindrical harmonics, or spherical harmonics, as they all denote fundamental solutions of the wave equation.

Using the wave-domain signal representations, an equivalent to (1) may be formulated by

$\begin{array}{cc}{\tilde{P}}_{\mu }^{\left(d\right)}\left(j\omega \right)=\sum _{l=N_L/2+1}^{N_L/2}{H}_{m,l}\left(j\omega \right){\tilde{P}}_l^{\left(x\right)}\left(j\omega \right),m=-N_M/2+1,\dots ,N_M/2& \left(3\right)\end{array}$
where {tilde over (H)}_m,l(jω) describes the coupling of mode l in {tilde over (P)}_l ^(x)(jω) and mode m in {tilde over (P)}_m ^(d)(jω). An example of H_μ,λ(jω) and {tilde over (H)}_m,l(jω) for an LEMS with N_L=48 loudspeakers on a circle of radius R_L=1.5 m, N_M=10 microphones on a circle of radius R_M=0.05 m, and a real room with a reverberation time T₆₀ of 0.3 s is shown in FIG. 4 to illustrate the different properties of both models. While the weights of H_μ,λ(jω) appear to be similar for all λ and μ, {tilde over (H)}_m,l(jω) shows a clearly distinguishable structure with dominant {tilde over (H)}_m,l(jω) for certain combinations of m and l. For a wave-domain model, this structure may be formulated for any LEMS, in contrast to a conventional model, where the weights may differ significantly, depending on the loudspeaker and microphone positions. This property has already been used to obtain an approximate model for the LEMS to increase computational efficiency [13, 23].

Embodiments exploit this property in a different way. As the weights of {tilde over (H)}_m,l(jω) are predictable to a certain extent, they allow to assess the plausibility of a particular estimate. Moreover, it is possible to modify adaptation algorithms for system description so that estimates of {tilde over (H)}_m,l(jω) depicting similar weights to the true solution are obtained. Those estimates can then be expected to be close to the true solution. For a system description in the wave domain without following the proposed approach, an estimate Ĥ_m,l(jω) would be implicitly determined for {tilde over (H)}_m,l(jω) by obtaining a least squares estimate for {tilde over (P)}_m ^(d)(jω) with a model according to (3). One possibility to realize the proposed approach is to modify the resulting least squares cost function, which originally only considered the deviation of {tilde over (P)}_m ^(d)(jω) from its estimate. Such a modification can be the addition of a term representing
∫_−∞ ^∞|Ĥ _m,l(jω)|²C(|m−l|)dω  (4a)
with C(|m−l|) being a monotonically growing cost function for increasing |m−l| for the considered example of circular harmonics. For other wave-domain basis functions C(|m−l|) is replaced by an appropriate function, possibly depending on multiple variables. Such a modification regularizes the problem of system description in a physically motivated manner, but is in general independent of a possibly used regularization of the underlying adaptation algorithm.

A minimization of the modified cost function leads to an estimate Ĥ_m,l(jω) depicting similar weights than shown for {tilde over (H)}_m,l(jω) in FIG. 4. An illustration of mode coupling weight and corresponding cost is shown in FIG. 5. A modification according to (4a) is just one of several ways to implement the concepts provided by embodiments As the set of possible estimates Ĥ_m,l(jω) is still unbounded, we refer to this modification as introducing a non-restrictive constraint.

Another possibility is to necessitate an estimate Ĥ_m,l(jω) to fulfill

$\begin{array}{cc}{\int }_{-\infty }^{\infty }{{\hat{H}}_{m,{\mathrm{<figure-callout\; id="1"\; label="l"\; filenames="USRE047820-20200114-D00002.png,USRE047820-20200114-D00014.png"\; state="\{\{state\}\}">l</figure-callout>}}_1}\left(j\omega \right)}^{2}d\omega >{\int }_{-\infty }^{\infty }{{\hat{H}}_{m,{\mathrm{<figure-callout\; id="2"\; label="l"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">l</figure-callout>}}_2}\left(j\omega \right)}^{2}d\omega \forall l_2-m>l_1-m& \left(4b\right)\end{array}$
which would then be a restrictive constraint.

According to embodiments, a variety of constraints may be formulated, where (4a) and (4b) describe just two possible realizations.

In the following, a prototype is described in general terms.

The prototype of an AEC according to an embodiment is briefly described and an excerpt of its experimental evaluation is given. AEC is commonly used to remove the unwanted loudspeaker echo from the recorded microphone signals while preserving the desired signals of the local acoustic scene without quality degradation. This is necessitated to use a reproduction system in communication scenarios like teleconferencing and acoustic human-machine-interaction.

FIG. 3 illustrates a block diagram depicting the signal model of a wave-domain AEC according to an embodiment. There, the continuous frequency-domain quantities used in the previous section are represented by vectors of discrete-time signals with the block time index n. The signal quantities x(n) and d(n) correspond to P_λ ^(x)(jω) and P_μ ^(d)(jω), respectively. Similarly, the wave-domain representation {tilde over (x)}(n) and {tilde over (d)}(n) correspond to P_l ^(x)(jω) to P_m ^(d)(jω), respectively. The wave-domain representation {tilde over (y)}(n) denotes an estimate for {tilde over (d)}(n) and {tilde over (e)}(n)={tilde over (d)}(n)−{tilde over (y)}(n) is the adaptation error in the wave-domain. This error is transformed back to the microphone signal domain, where it is denoted as e(n). The transforms T₁, T₂ and T₂ ⁻¹ denote transforms to and from the wave domain, H corresponds to H_μ,λ(jω) and {tilde over (H)}(n) to its wave-domain estimate Ĥ_m,l(jω)

In the following, an excerpt of an experimental evaluation of the mentioned AEC will be provided. To this end, the two most important measures for an AEC are considered. The so-called “Echo Return Loss Enhancement” (ERLE) provides a measure for the achieved echo cancellation and is here defined as

$\begin{array}{cc}\mathrm{ERLE}\left(n\right)=10{\mathrm{<figure-callout\; id="10"\; label="log"\; filenames="USRE047820-20200114-D00005.png,USRE047820-20200114-D00007.png"\; state="\{\{state\}\}">log</figure-callout>}}_{10}\left(\frac{{\tilde{d}\left(n\right)}_2^2}{{\tilde{e}\left(n\right)}_2^2}\right)=10{\mathrm{<figure-callout\; id="10"\; label="log"\; filenames="USRE047820-20200114-D00005.png,USRE047820-20200114-D00007.png"\; state="\{\{state\}\}">log</figure-callout>}}_{10}\left(\frac{{d\left(n\right)}_2^2}{{e\left(n\right)}_2^2}\right),& \left(5a\right)\end{array}$
where ∥·∥₂ stands for the Euclidean norm. The normalized misalignment is a metric to determine the distance of the identified LEMS from the true one, e.g., the distance of Ĥ_m,l(jω) and {tilde over (H)}_m,l(jω). For the system described here, this measure can be formulated as follows:

$\begin{array}{cc}{\Delta }_H\left(n\right)=10{\mathrm{<figure-callout\; id="10"\; label="log"\; filenames="USRE047820-20200114-D00005.png,USRE047820-20200114-D00007.png"\; state="\{\{state\}\}">log</figure-callout>}}_{10}\left(\frac{{{\mathrm{<figure-callout\; id="2"\; label="T"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">T</figure-callout>}}_{2}H-\tilde{H}\left(n\right){\mathrm{<figure-callout\; id="1"\; label="T"\; filenames="USRE047820-20200114-D00002.png,USRE047820-20200114-D00014.png"\; state="\{\{state\}\}">T</figure-callout>}}_1}_{\mathrm{<figure-callout\; id="2"\; label="F"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">F</figure-callout>}}^2}{{<figure-callout\; id="2"\; label="\; T"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}"></figure-callout>T_{}{}_{2}H}_F^2}\right),& \left(5b\right)\end{array}$
where ∥·∥_F stands for the Frobenius norm.

FIG. 8 shows ERLE and normalized misalignment for the built prototype in comparison to a conventional generation of a system description. In this scenario, two plane waves were synthesized by a WFS system, first alternatingly and then simultaneously. Within the first five seconds the first plane wave with an incidence angle of φ=0 was synthesized, during the following five seconds, the second plane wave with an incidence angle of φ=π/2 was synthesized. Within the last five seconds, both plane waves were simultaneously synthesized. Mutually uncorrelated white noise signals were used as source signals for the plane waves. The considered LEMS was already described above. The parameters for the adaptive filters can be considered as being nearly optimal.

The most attention in this discussion is given to the normalized misalignment, because a lower misalignment denotes a better system description. As the 48 loudspeaker signals were obtained from only two source signals, the identification of the LEMS is a severely underdetermined problem. Consequently, the achieved absolute normalized misalignment cannot be expected to be very low. However, the AEC implementing the proposed invention shows a significant improvement. We can see that the adaption algorithm with the modified cost function achieves a misalignment of −1.6 dB while the original adaptation algorithm only achieves −0.2 dB. Please note that a value of −0.2 dB is almost the minimal misalignment which can be expected, when only considering microphone and loudspeaker signals in such a scenario. Even though this experiment was conducted under optimal conditions, e.g., in absence of noise or interferences in the microphone signal, the better system description already leads to a better echo cancellation. The anticipated breakdown of the ERLE when the activity of both plane waves switches is less pronounced for the modified adaptation algorithm than for the original approach. Moreover, the modified algorithm is able to achieve a larger steady-state ERLE, which points to the fact the considered original algorithm is trapped in a local minimum due to the frequency-domain approximation [14], which is necessitated for both algorithms.

In practice, benevolent laboratory conditions, as described in the previous experiment, are typically not present. One problem for the system description can be a double-talk situation, e.g., the simultaneous activity of the loudspeaker signals and the local acoustic scene. The adaptation of the filters is then typically stalled under such conditions to avoid a diverging system description. However, such a situation cannot always be reliably detected and adaptation steps during double-talk may occur. Therefore, an experiment was conducted to study the behavior of an AEC in this case. To this end, a similar scenario as in the previous experiment was considered, where the first plane wave was synthesized during the first 25 seconds and the second plane wave was synthesized within the last 5 seconds. To simulate an undetected double-talk situation, short noise bursts we introduced into the microphone signal, leading to approximately two mislead adaptation steps. The results are shown in FIG. 9. Considering the misalignment it can be seen that both algorithms are negatively affected due to this adaptation steps. The modified adaptation algorithm can, however, recover quickly from the divergence, in contrast to the original algorithm. Regarding the ERLE, both algorithms show a significant breakdown and a following recovery with every disturbance. For the original algorithm, we can see that the steady-state ERLE worsens with every recovery, while the steady-state performance of the modified algorithm remains not significantly affected. When the activity of both plane waves changes, the ERLE breakdown of the original algorithm is clearly more pronounced than for the modified algorithm.

The shown increase of robustness is expected to be also beneficial for other applications, e.g., listening room equalization.

In the following, embodiments will be provided, wherein different WDAF basis functions will be employed. Moreover, in the following, we use {tilde over (l)}=l′ and {tilde over (m)}=m′. The explanations in the following will be focused on circular harmonics, spherical harmonics and plane waves as WDAF basis functions. It should be noted that the present invention is equally applicable with other WDAF basis functions, such as, for example, cylindrical harmonics.

At first, a LEMS description using different WDAF basis functions is provided. For WDAF, the considered loudspeaker and microphone signals are represented by a superposition of chosen basis functions which are fundamental solutions of the wave equation valuated at the microphone positions. Consequently, the wave-domain signals describe a sound field within a spatial continuum. Each individual considered fundamental solution of the wave equation is referred to as a wave field component and is uniquely identified by one or more mode orders, one or more wave numbers or any combination thereof.

The wave-domain loudspeaker signals describe the wave field as it was ideally excited at the microphone positions in the free field case decomposed into its wave field components. The wave-domain microphone signals describe the sound pressure measured by the microphones in terms of the chosen basis functions.

In the wave-domain, a LEMS is described by the way it distorts the reproduced wave field with respect to the wave field which would ideally be excited in the free field case. Consequently, this description is formulated as couplings of the wave-domain loudspeaker signals and the wave-domains microphone signals.

In the free field case, there is no distortion of the reproduced wave field and only the wave field components of the wave domain loudspeaker and microphone signals are coupled, which share identical mode orders or wave numbers. For typical room shapes with no significant obstacles between loudspeakers and microphones, the reproduced wave field is only moderately distorted. So the couplings between wave field components of the transformed loudspeaker signals and wave field components of the transformed microphone signals which describe similar sound fields are stronger than the coupling of wave field components describing very different sound fields. The difference of the sound field described by different wave field components is measured by a distance function which is described below after the review of different basis functions for WDAF.

For WDAF, different fundamental solutions of the wave equation can be used. Examples are: circular harmonics, plane waves and spherical harmonics. Those basis functions are used to describe the sound pressure P({right arrow over (x)},jω) at the position {right arrow over (x)}, here described in the continuous frequency domain, where ω is the angular frequency. Alternatively, cylindrical harmonics may be used.

At first, circular harmonics are considered. When using circular harmonics, we describe {right arrow over (x)}=(α,

)^T in polar coordinates with an angle α and a radius

and we obtain the following superposition to describe the sound pressure at this point

$\begin{array}{cc}P\left(\alpha ,\varrho ,j\omega \right)=\sum _{\tilde{m}=-\infty }^{\infty }\left({\tilde{P}}_{\tilde{m}}^{\left(1\right)}\left(j\omega \right){\mathscr{H}}_{\tilde{m}}^{\left(1\right)}\left(\frac{\omega }{c}\varrho \right)+{\tilde{P}}_{\tilde{m}}^{\left(2\right)}\left(j\omega \right){\mathscr{H}}_{\tilde{m}}^{\left(2\right)}\left(\frac{\omega }{c}\varrho \right)\right)e^{j\tilde{m}\alpha }& \left(6a\right)\end{array}$
where and are spectra of outgoing and incoming waves, respectively. Here, H_{{tilde over (m)}} ⁽¹⁾(x) and H_{{tilde over (m)}} ⁽²⁾(x) are Hankel functions of the first and second kind and order {tilde over (m)}, respectively, c is the speed of sound, and j is used as the imaginary unit. Assuming no acoustic sources in the coordinate origin, we may reduce our consideration to a superposition of incoming and outgoing waves.

$\begin{array}{cc}P\left(\alpha ,\varrho ,j\omega \right)=\sum _{\tilde{m}=-\infty }^{\infty }{\tilde{P}}_{\tilde{m}}^{\left(d\right)}\left(j\omega \right){ℬ}_{\tilde{m}}\left(j\omega \right)e^{j\tilde{m}\alpha }& \left(6b\right)\end{array}$
where B_{{tilde over (m)}}(jω) depends on the presence of a scatterer within the microphone array, and is equal to the ordinary Bessel function of the first kind I_{{tilde over (m)}}(jω) in the free field [19]. A single wave field component describes the contribution
{tilde over (P)}_{{tilde over (m)}} ^(d)(jω)B_{{tilde over (m)}}(jω)e^{j{tilde over (m)}α}  (6c)
to the resulting sound field and is identified by its mode order {tilde over (m)}. So we denote the transformed microphone signals with {tilde over (P)}_{{tilde over (m)}} ^(d)(jω) and the transformed loudspeaker signals with {tilde over (P)}_l ^(x)(jω). The wave-domain model is then described by

$\begin{array}{cc}{\tilde{P}}_{\tilde{m}}^{\left(d\right)}\left(j\omega \right)=\sum _{l=\infty }^{\infty }{\tilde{H}}_{\tilde{m},\tilde{l}}\left(j\omega \right){\tilde{P}}_l^{\left(x\right)}\left(j\omega \right).& \left(6d\right)\end{array}$

Now, spherical harmonics are considered. For spherical harmonics, we describe {right arrow over (x)}=(α, ν,

)^T in spherical coordinates with an azimuth angle α, a polar angle δ and a radius ζ and we obtain the following superposition to describe the sound pressure at this point

$\begin{array}{cc}P\left(\alpha ,\vartheta ,\varrho ,j\omega \right)=\sum _{\tilde{n}=0}^{\infty }\sum _{\tilde{m}=-\tilde{n}}^{\tilde{n}}\left({\hat{p}}_{\tilde{m},\tilde{n}}^{\left(1\right)}\left(j\omega \right)h_{\tilde{n}}^{\left(1\right)}\left(\frac{\omega }{c}\varrho \right)+{\hat{p}}_{\tilde{m},\tilde{n}}^{\left(2\right)}\left(j\omega \right)h_{\ddot{n}}^{\left(2\right)}\left(\frac{\omega }{c}\varrho \right)\right)Y_{\tilde{n}}^{\tilde{m}}\left(\partial ,a\right)& \left(6e\right)\end{array}$
Here, h_ñ ⁽¹⁾(x) and h_ñ ⁽²⁾(x) are spherical Hankel functions of the first and second kind and order n, respectively and the spherical basis functions are given by

$\begin{array}{cc}{Y}_{\tilde{n}}^{\tilde{m}}\left(\vartheta ,\phi \right)=\sqrt{\frac{2\tilde{n}+1}{4\pi }\frac{\left(\tilde{n}-\tilde{m}\right)!}{\left(\tilde{n}+\tilde{m}\right)!}}{𝒫}_{\tilde{n}}^{\tilde{m}}\left(\cos \left(\vartheta \right)\right)e^{j\tilde{m}\phi }& \left(6f\right)\end{array}$
with the associated Legendre polynomials

$\begin{array}{cc}{𝒫}_{\tilde{n}}^{\tilde{m}}\left(z\right)=\frac{{\left(-1\right)}^{\tilde{m}}}{2^{\tilde{n}}\tilde{n}!}{\left(1-z^2\right)}^{\tilde{m}/2}\frac{d^{\tilde{m}+\tilde{n}}}{d{z}^{\tilde{m}+\tilde{n}}}{\left(z^2-1\right)}^{\tilde{n}}& \left(6g\right)\end{array}$
for {tilde over (m)}≥0. For negative {tilde over (m)}, the associated Legendre polynomials are defined by

$\begin{array}{cc}{𝒫}_{\tilde{n}}^{-\tilde{m}}\left(z\right)={\left(-1\right)}^{\tilde{n}}\frac{\left(\tilde{n}-\tilde{m}\right)!}{\left(\tilde{n}+\tilde{m}\right)!}{𝒫}_{\tilde{n}}^{\tilde{m}}\left(z\right)& \left(6h\right)\end{array}$

As it can be seen from formula (6e) to (6g), the spherical harmonics are identified by two mode order indices {tilde over (m)} and ñ. Again, {tilde over (p)}_{{tilde over (m)},ñ} ⁽¹⁾(jω) and {tilde over (p)}_{{tilde over (m)},ñ} ⁽²⁾(jω) describe spectra of incoming and outgoing waves with respect to the origin and we consider the superposition of both. So each spherical harmonic wave field component describes a contribution to the sound field according to

$\begin{array}{cc}{\hat{p}}_{\tilde{m},\tilde{n}}^{\left(d\right)}\left(j\omega \right)b_{\tilde{n}}\left(\frac{\omega }{c}\varrho \right)Y_{\tilde{n}}^{\tilde{m}}\left(\theta ,\alpha \right),& \left(6i\right)\end{array}$
where

$b_{\tilde{n}}\left(\frac{\omega }{c}\varrho \right)$
is dependent on the boundary conditions at the coordinate origin, similar to

${ℬ}_{\tilde{m}}\left(\frac{\omega }{c}\varrho \right)$
for the circular harmonics. So we denote the transformed microphone signals with {tilde over (p)}_{{tilde over (m)},ñ} ^(d)(jω) and the transformed loudspeaker signals with {tilde over (p)}_{{tilde over (l)},{tilde over (k)}} ^(x)(jω). The wave-domain model is then described by

$\begin{array}{cc}{\stackrel{.}{p}}_{\tilde{m},\tilde{n}}^{\left(d\right)}\left(j\omega \right)=\sum _{\tilde{k}=0}^{\infty }\sum _{\tilde{l}=-\tilde{k}}^{\tilde{k}}{\stackrel{.}{H}}_{\tilde{m},\tilde{n},\tilde{l},\tilde{k}}\left(j\omega \right){\stackrel{.}{p}}_{\tilde{l},\tilde{k}}^{\left(x\right)}\left(j\omega \right),& \left(6j\right)\end{array}$

Now, plane waves are considered. For a plane wave signal representation in the wave domain, we describe
P(x,y,z,jω)=∫_−∞ ^∞∫_−∞ ^∞∫_−∞ ^∞{tilde over (P)}({tilde over (k)}_x,{tilde over (k)}_y,{tilde over (k)}_z)e^{−j(x{tilde over (k)} x ,y{tilde over (k)} y ,z{tilde over (k)} z )}d{tilde over (k)}_zd{tilde over (k)}_yd{tilde over (k)}_x)  (6k)
where {tilde over (P)}({tilde over (k)}_x, {tilde over (k)}_y, {tilde over (k)}_z, jω) describes the plane wave representation of the sound field and is only non-zero if

${\tilde{k}}_x^2+{\tilde{k}}_{\mathrm{<figure-callout\; id="2"\; label="y"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">y</figure-callout>}}^2+{\tilde{k}}_{\mathrm{<figure-callout\; id="2"\; label="z"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">z</figure-callout>}}^2=\frac{{\omega }^2}{{\mathrm{<figure-callout\; id="2"\; label="c"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">c</figure-callout>}}^2}.$

Now, model discretization is described. The number of components describing a real-world sound field is typically not limited. However, for a realization of an adaptive filter, we have to restrict our considerations to a subset of all available wave field components. For circular harmonics, this is simply done by limiting the considered mode order |ñ|. When using plane waves, {tilde over (k)}_x, {tilde over (k)}_y, and {tilde over (k)}_z describe continuous values in contrast to the integer mode orders of circular or spherical harmonics. Furthermore, {tilde over (k)}_x, {tilde over (k)}_y, and {tilde over (k)}_z are bounded by

${\tilde{k}}_x^2+{\tilde{k}}_{\mathrm{<figure-callout\; id="2"\; label="y"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">y</figure-callout>}}^2+{\tilde{k}}_{\mathrm{<figure-callout\; id="2"\; label="z"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">z</figure-callout>}}^2=\frac{{\omega }^2}{c^3}.$
Consequently, they are discretized within their boundaries. Considering only plane waves traveling in the x-y-plane, an example of such a discretization can be

$\begin{array}{cc}\left(\begin{array}{c}{\tilde{k}}_x\\ {\tilde{k}}_y\\ {\tilde{k}}_z\end{array}\right)=\left(\begin{array}{c}\frac{\omega }{c}\cos \left(\phi \right)\\ \frac{\omega }{c}\sin \left(\phi \right)\\ 0\end{array}\right),\phi =\frac{p2\pi }{P},p=0,1,\dots ,P-1.& \left(7a\right)\end{array}$

The microphone signals are then described by {tilde over (P)}^(d)({tilde over (k)}_x ^(d), {tilde over (k)}_y ^(d), {tilde over (k)}_z ^(d), jω, and the loudspeaker signals by {tilde over (P)}^(x)({tilde over (k)}_x ^(x), {tilde over (k)}_y ^(x), {tilde over (k)}_z ^(x), jω. Given a suitable discretization, we may also describe the LEMS system by a sum

$\begin{array}{cc}{\stackrel{\_}{P}}^{\left(d\right)}\left({\tilde{k}}_x^{\left(d\right)},{\tilde{k}}_y^{\left(d\right)},{\tilde{k}}_z^{\left(d\right)},j\omega \right)=\sum _{\left({\tilde{k}}_x^{\left(x\right)},{\tilde{k}}_y^{\left(x\right)},{\tilde{k}}_z^{\left(x\right)}\right)\in K}\stackrel{\_}{H}\left({\tilde{k}}_x^{\left(d\right)},{\tilde{k}}_y^{\left(d\right)},{\tilde{k}}_z^{\left(d\right)},{\tilde{k}}_x^{\left(x\right)},{\tilde{k}}_y^{\left(x\right)},{\tilde{k}}_z^{\left(x\right)},j\omega \right)·{\stackrel{\_}{P}}^{\left(x\right)}\left({\tilde{k}}_x^{\left(x\right)},{\tilde{k}}_y^{\left(x\right)},{\tilde{k}}_z^{\left(x\right)},j\omega \right)& \left(7b\right)\end{array}$
where the K is the set of ({tilde over (k)}_x ^(x), {tilde over (k)}_y ^(x), {tilde over (k)}_z ^(x)) considered for the model discretization, for example, as described by (7a).

In the following, realizations of improved system identification for different basis Functions according to embodiments are described. In particular, it is explained how the invention can be applied for WDAF systems using different basis functions. As mentioned above, the distortion of the reproduced wave field can be described by couplings of the wave field components in the transformed loudspeaker signals and in the transformed microphone signals (see formulae (6d), (6j), and (7b)). The couplings of the wave field components describing similar sound fields are stronger than the couplings of wave field components describing completely different sound fields. A measure of similarity can be given by the following functions.

For circular harmonics, we can simply use the absolute difference of the mode orders given by
D({tilde over (m)},{tilde over (l)})=|{tilde over (m)}−{tilde over (l)}|.  (8a)

For spherical harmonics, we have to consider two mode indices for each wave-domain signal and obtain
D({tilde over (m)},ñ,{tilde over (l)},{tilde over (k)})=|{tilde over (m)}−{tilde over (l)}|+|ñ−{tilde over (k)}|.  (8b)
independently of the chosen sampling of the wave numbers.

For system identification typically, a cost function penalizing and the difference between an estimate of the microphone signal and their estimates is minimized. One way to realize the invention is to modify an adaptation algorithm such that the obtained weights of the wave field component couplings are also considered. This can be done by simply adding an additional term to the cost function which grows with an increasing D( . . . ), resulting in
∫_−∞ ^∞|Ĥ _{{tilde over (m)},{tilde over (l)}}(jω)|²C(D({tilde over (m)},{tilde over (l)})dω  (8c)
∫_−∞ ^∞|{tilde over (H)}_{{tilde over (m)},ñ,{tilde over (l)},{tilde over (k)}}(jω)|²C(D({tilde over (m)},ñ,{tilde over (l)},{tilde over (k)})dω  (8d)
∫_−∞ ^∞|{tilde over (H)}(|²C(D(({tilde over (k)}_x ^(d),{tilde over (k)}_y ^(d),{tilde over (k)}_z ^(d),{tilde over (k)}_x ^(x),{tilde over (k)}_y ^(x),{tilde over (k)}_z ^(x),jω)dω  (8e)
for circular harmonics, spherical harmonics and plane waves, respectively. Here, Ĥ_m,l(jω) represents the estimate of estimate of {tilde over (H)}_m,l(jω),{tilde over (H)}_m,l(jω),{tilde over (H)}_{{tilde over (m)},ñ,{tilde over (l)},{tilde over (k)}}(jω) represents the estimate of {tilde over (H)}_{{tilde over (m)},ñ,{tilde over (l)},{tilde over (k)}}(jω) and {tilde over (H)}({tilde over (k)}_x ^(d), {tilde over (k)}_y ^(d), {tilde over (k)}_z ^(d), {tilde over (k)}_x ^(x), {tilde over (k)}_y ^(x), {tilde over (k)}_z ^(x), jω) represents the estimate of {tilde over (H)}({tilde over (k)}_x ^(d), {tilde over (k)}_y ^(d), {tilde over (k)}_z ^(d), {tilde over (k)}_x ^(x), {tilde over (k)}_y ^(x), {tilde over (k)}_z ^(x), jω). The cost function C(x) is a monotonically increasing function.

In the following, the concepts on which embodiments rely, and the embodiments themselves are described in more detail.

At first, the problem of multichannel acoustic echo cancellation (MCAEC) is briefly reviewed.

AEC uses observations of loudspeaker and microphone signals to estimate the loudspeaker echo in the microphone signals. Although extraction of the desired signals of the local acoustic scene is the actual motivation for AEC, it will be assumed for the analysis that the local sources are inactive. This does not limit the applicability of the obtained results, since in most practical systems the adaptation of the filters is stalled during activity of local desired sources (e.g. in a double-talk situation) [16]. For the actual detection of double-talk, see, e.g., [17].

Now, the signal model is presented. The structure of a wave-domain AEC according to FIG. 3 will be described. There are two types of signal representations used in this context: so-called point observation signals, corresponding to sound pressure measured at points in space, and wave-domain representations, corresponding to wave-field components which can be observed over a continuum in space. The latter will be discussed later on.

At first, point observation signals will be described. For block-wise processing of signals, vectors of signal samples are introduced with the block-time index n as argument. The reproduction system G_RS shown in FIG. 3 is not part of the AEC system, but is considered for describing the nonuniqueness problem below.

As input for the reproduction system we have a set of N_S uncorrelated source signals {circumflex over (x)}_s(k) captured by
{tilde over (x)}(n)=({tilde over (x)}₀ ^T(n), . . . {tilde over (x)}₁ ^T(n), . . . ,{tilde over (x)}_{N S −1} ^T(n))^T,
{tilde over (x)}_s(n)=({tilde over (x)}_s(nL_B−L_S+1),{tilde over (x)}_s(nL_B−L_S+2), . . . ,{tilde over (x)}_s(nL_B))^T,s=0,1, . . . ,N_S−1  (9)
where ·^T denotes the transposition, s denotes the source index, L_B denotes the relative block shift between data blocks, L_S denotes the length of the individual components x_s(n), and

_s(k) denotes a time-domain signal sample of source s at the time instant k. The loudspeaker signals are then determined by the reproduction system according to
x(n)=G_RS ^x(n),  (10a)
where x(n) can be decomposed into
{tilde over (x)}(n)=({tilde over (x)}₀ ^T(n), . . . {tilde over (x)}₁ ^T(n), . . . ,{tilde over (x)}_{N L −1} ^T(n))^T,
{tilde over (x)}_λ(n)=({tilde over (x)}_λ(nL_B−L_X+1),{tilde over (x)}_λ(nL_B−L_X+2), . . . ,{tilde over (x)}_λ(nL_B))^T,λ=0,1, . . . ,N_L−1  (9)
with the loudspeaker index λ, the number of loudspeakers N_L, and the length L_X of the individual components x_λ(n) which capture the time-domain samples x_λ(k) of the respective loudspeaker signals. The L_X·N_L×L_S·N_S matrix G_RS describes an arbitrary linear reproduction system, e.g., a WFS system, whose output signals are described by

$\begin{array}{cc}{x}_{\lambda }\left(k\right)=\sum _{s=1}^{N_{S-1}}\sum _{\kappa =0}^{L_G-1}{\stackrel{.}{x}}_s\left(k-\kappa \right)g_{\lambda ,s}\left(\kappa \right),& \left(11\right)\end{array}$
where g_λ,s(k) is the impulse response of length L_G used by the reproduction system to obtain the contribution of source s to the loudspeaker signal λ.

The loudspeaker signals are then fed to the LEMS. The N_M microphone signals are described by the vector d(n) which is given by
d(n)=Hx(n),  (12a)
d(n)=(d₀ ^T(n),d₁ ^T(n), . . . ,d_{N M −1} ^T)  (12b)
d_μ(n)=(d_μ(nL_B−L_B+1),d_μ(nL_B−L_B+2), . . . ,d_μ(nL_B))^T,μ=0,1, . . . ,N_M−1  (12c)
where μ is the index of the microphone, d_μ(k) a time-domain sample of the microphone signal μ, and H describes the LEMS. The L_B·N_M×L_X·N_L matrix H is structured such that

$\begin{array}{cc}{d}_{\mu }\left(k\right)=\sum _{\lambda =1}^{N_L}\sum _{\kappa =0}^{L_H-1}{x}_{\lambda }\left(k-\kappa \right)h_{\mu ,\lambda }\left(\kappa \right),& \left(13\right)\end{array}$
where h_μ,λ(k) is the discrete-time impulse response of the LEMS from loudspeaker b to microphone μ of length L_H. During double-talk, d(n) would also contain the signal of the local acoustic scene. From (9) to (13) follow L_X≥L_B+L_H−1 and L_S=L_X+L_G−1 with the given lengths L_G, L_H, and L_B. The option to choose L_X larger than L_B+L_H−1 is necessitated to maintain consistency in the notation within this paper.

Now, wave-domain signal representations are explained which are specific to WDAF. The tilde will be used to distinguish the wave-domain representations from others in this paper. From the loudspeaker signals we obtain the so-called free-field description {tilde over (x)}(n) using transform T₁:
{tilde over (x)}(n)=T₁x(n).  (14a)
The vector {tilde over (x)}(n) exhibits the same structure as x(n), replacing the segments x_λ(n) by {tilde over (x)}_l(n) and the components x_λ(k) by {tilde over (x)}_l(k) being the time-domain samples of the N_L individual wave field components with the wave field component index l. From the microphone signals the so-called measured wave field will be obtained in the same way using transform T₂:
{tilde over (d)}(n)=T₂d(n).  (14b)
Here, {tilde over (d)}(n) is structured like d(n) with the segments d_μ(n) replaced by {tilde over (d)}_m(n) and the components d_μ(k) replaced by d_m(k) denoting the time-domain samples of the N_M individual wave field components of the measured wave field, indexed by m. The frequency-independent unitary transforms T₁ and T₂ will be derived in Sec. III as described later. Replacing them with identity matrices of the appropriate dimensions leads to the description of an MCAEC without a spatial transform as a special case of a WDAF AEC [15]. This type of AEC will be referred to as conventional AEC in the following.

In the wave domain, y(n) is obtained as an estimate for d(n) by using
{tilde over (y)}(n)={tilde over (H)}(n){tilde over (x)}(n),  (14c)
where {tilde over (y)}(n) is structured like d(n) and the L_B·N_M×L_X·N_L matrix {tilde over (H)}(n) is a wave-domain estimate for H so that the time-domain samples comprised by {tilde over (y)}(n) are given through

$\begin{array}{cc}{\tilde{y}}_m\left(k\right)=\sum _{l=1}^{N_L}\sum _{\kappa =0}^{L_H-1}{\tilde{x}}_l\left(k-\kappa \right){\tilde{h}}_{m,l}\left(n,\kappa \right).& \left(14d\right)\end{array}$

Again, the vectors {tilde over (h)}_m,l(k) describe impulse responses of length L_H which are (in contrast to h_μ,λ(k)) also dependent on the block index n. This is necessitated since later, an iterative update of those impulse responses will be described. Please note that {tilde over (h)}_m,l(n,k) and h_μ,λ(k) are assumed to have the same length for the analysis conducted here. As a consequence, the effects of a possibly unmodeled impulse response tail [16] are not considered. Finally, the error in the wave domain can be defined by
{tilde over (e)}(n)={tilde over (d)}(n)−{tilde over (y)}(n),  (15)
which shares the structure with {tilde over (d)}(n), comprising the segments {tilde over (e)}_m(n). These signals can be transformed back to error signals compatible to the microphone signals d(n) by using
e(n)=T₂ ⁻¹{tilde over (e)}(n).  (16)

An AEC aims for a minimization of the error e(n) with respect to a suitable norm. The most commonly used norm in this regard is the Euclidean norm ∥e(n)∥₂. This motivated the choice of a unitary matrix T₂ leading to an equivalent error criterion in the wave domain and for the point observation signals, ∥e(n)∥₂=∥{tilde over (e)}(n)∥₂. The so-called “Echo Return Loss Enhancement” (ERLE) provides a measure for the achieved echo cancellation. During inactivity of the local acoustic sources it can be defined by

$\begin{array}{cc}\mathrm{ERLE}\left(n\right)=10{\mathrm{<figure-callout\; id="10"\; label="log"\; filenames="USRE047820-20200114-D00005.png,USRE047820-20200114-D00007.png"\; state="\{\{state\}\}">log</figure-callout>}}_{10}\left(\frac{{\tilde{d}\left(n\right)}_2^2}{{\tilde{e}\left(n\right)}_2^2}\right)=10{\mathrm{<figure-callout\; id="10"\; label="log"\; filenames="USRE047820-20200114-D00005.png,USRE047820-20200114-D00007.png"\; state="\{\{state\}\}">log</figure-callout>}}_{10}\left(\frac{{d\left(n\right)}_2^2}{{e\left(n\right)}_2^2}\right).& \left(17\right)\end{array}$

Now the nonuniqueness problem for the MCAEC, which is already known from the stereophonic AEC will be shortly reviewed. After determining the conditions for the occurrence of the nonuniqueness problem, it will be explained why the residual echo is not the only important measure for an AEC and that the mismatch of the identified impulse responses to the true impulse responses of the LEMS has to be considered as well.

At first, the conditions for the occurrence of the nonuniqueness problem are determined by considering the idealized case of an AEC where the residual echo vanishes. By using (12a), (14a), (14b), and (15) the error may be written as
{tilde over (e)}(n)=(T₂H−{tilde over (H)}(n)T₁)×(n).  (18)

In the ideal case the LEMS can be perfectly modeled and local acoustic sources are inactive. As a consequence, an optimal solution in the sense of minimizing any norm ∥{tilde over (e)}(n)∥ also achieves {tilde over (e)}(n)=0. Under these conditions, the nonuniqueness problem may be discussed independently from the algorithm used for system description.

If {tilde over (e)}(n)=0 is necessitated for all possible x(n), the unique solution
{tilde over (H)}(n)T₁=T₂H,  (19)
is obtained, where {tilde over (H)}(n) fully identifies the room described by H in the vector space spanned by T₂. This will be referred to as the perfect solution in the following, which can be identified in theory given the observed vectors d(n) for a sufficiently large set of linearly independent vectors x(n). However, according to (10a) x(n) originates from {circumflex over (x)}(n), so that the set of observable vectors x(n) is limited by G_RS. Using (10a) and (18) we obtain
{tilde over (e)}(n)=(T₂H−{tilde over (H)}(n)T₁)G_RS{tilde over (x)}(n),  (20)
so that necessitating {tilde over (e)}(n)=0 for all {circumflex over (x)}(n) does no longer guarantee a unique solution for {tilde over (H)}(n). In the following, conditions for nonunique solutions are investigated. Without loss of generality we may assume L_B=1 leading to L_X=L_H for the remainder of this section, leaving no constraints on the structures of {tilde over (H)}(n) and H(n). Obviously, the matrix G_RS has a rank of min{N_L·L_H, N_S·(L_H+L_G−1)} when being full-rank, as we will assume in the following. Whenever this rank is less than the column dimension of the term (T₂H−{tilde over (H)}(n)T₁), there are multiple solutions (T₂H−{tilde over (H)}(n)T₁)≠0 fulfilling {tilde over (e)}(n)=0, and the problem of identifying H is underdetermined. So the solution is only unique if
N_L·L_H≤N_S·(L_H+L_G−1).  (21)

It can be seen that the relation of the number of used loudspeakers and active signal sources is the most decisive property regarding the nonuniqueness problem. Whenever there are at least as many source signals as loudspeakers, e.g., N_S≥N_L the nonuniqueness problem does not occur. On the other hand, a long impulse response of the reproduction system may also prevent occurring the nonuniqueness problem. This result generalizes the results of Huang et al. [16] who analyzed the case L_H=L_G, N_S=1 for a least squares minimization of {tilde over (e)}(n). For reproduction systems like WFS an N_L>>N_S and a limited L_G are typical parameters, so the nonuniqueness problem is relevant in most practical situations.

Now, the consequences of the nonuniqueness problem are discussed. Since all solutions achieving {tilde over (e)}(n)=0 cancel the echo optimally, it is not immediately evident why obtaining a solution different from the perfect solution can be problematic. This changes, when regarding the reproduction system G_RS as being time-variant in practice. As an example, consider a WFS system synthesizing a plane wave with a suddenly changing incidence angle, modeled by two different matrices G_RS, one for the first incidence angle and another for the second. When the problem of finding {tilde over (H)}(n) is underdetermined, an adaptation algorithm will converge to one of many solutions for each of both G_RS. Without further objectives than minimizing {tilde over (e)}(n), these solutions may be arbitrarily distinct to another. So a solution found for one G_RS is not optimal for another G_RS and an instantaneous breakdown in ERLE at the time instant of change is the consequence [5,11].

This breakdown in ERLE may become quite significant in practice. There, noise, interference, double-talk, an unsuitable choice of parameters, or an insufficient model will cause divergence. Consequently, the adaptation algorithm may be driven to virtually any of the possible solutions. As the solutions for {tilde over (H)}(n) given a specific G_RS do not form a bounded set whenever the nonuniqueness problem occurs, a solution for one G_RS may be arbitrarily different to any of the solutions for another G_RS. This makes the breakdown in ERLE in fact uncontrollable and constitutes a major problem for the robustness of an MCAEC.

If the perfect solution is obtained, there will be no breakdown in ERLE for any change of G_RS, as this solution is independent from G_RS. This makes solutions in the vicinity of the perfect solution favorable in order to reduce the amount of ERLE loss following changes of G_RS. The normalized misalignment is a metric to determine the distance of a solution from the perfect solution given in (19). For the system described here, this measure can be formulated as follows:

$\begin{array}{cc}{\Delta }_H\left(n\right)=10{\mathrm{<figure-callout\; id="10"\; label="log"\; filenames="USRE047820-20200114-D00005.png,USRE047820-20200114-D00007.png"\; state="\{\{state\}\}">log</figure-callout>}}_{10}\left(\frac{{{\mathrm{<figure-callout\; id="2"\; label="T"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">T</figure-callout>}}_{2}H-\tilde{H}\left(n\right){\mathrm{<figure-callout\; id="1"\; label="T"\; filenames="USRE047820-20200114-D00002.png,USRE047820-20200114-D00014.png"\; state="\{\{state\}\}">T</figure-callout>}}_1}_{\mathrm{<figure-callout\; id="2"\; label="F"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">F</figure-callout>}}^2}{{<figure-callout\; id="2"\; label="\; T"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}"></figure-callout>T_{}{}_{2}H}_F^2}\right),& \left(22\right)\end{array}$
where ∥·∥_F stands for the Frobenius norm. The smaller the normalized misalignment, the smaller is the expected breakdown in ERLE when G_RS changes. Still, the minimization of the error signal is the most important criterion regarding the perceived echo but, in order to increase the robustness of an AEC, minimization of normalized misalignment remains the ultimate goal. Since one cannot observe H, a direct minimization of the normalized misalignment is not possible. Hence, a method to heuristically minimize this distance is presented in this work.

By considering (20) we may calculate the number of singular values of {tilde over (H)}(n) that can be uniquely determined necessitating {tilde over (e)}(n)=0 for a given number of sources N_S. Assuming all singular values of {tilde over (H)}(n) to have an equal influence on Δ_H(n) and all non-unique values to be zero, a coarse approximation of the lower bound for the normalized misalignment can be obtained. From (20) and (22) we obtain

$\begin{array}{cc}\min \left\{{\Delta }_H\left(n\right)\right\}\approx 10{\mathrm{<figure-callout\; id="10"\; label="log"\; filenames="USRE047820-20200114-D00005.png,USRE047820-20200114-D00007.png"\; state="\{\{state\}\}">log</figure-callout>}}_{10}\left(1-\frac{N_S\left(L_H+L_G-1\right)}{N_L{L}_H}\right)& \left(23\right)\end{array}$
given that the observed signals provide the only available information about the LEMS.

In the following, the wave-domain signal and system representations are provided. An explicit definition of the necessitated transforms is given and the exploited wave-domain properties of the LEMS are described.

At first, the wave-domain signal representations as key concepts of WDAF are presented. First the transforms to the wave domain will be introduced, so that we the properties of the LEMS in the wave domain can then be discussed. For the derivation of the transforms, we a fundamental solution of the wave equation will be used. Since this solution is given in the continuous frequency domain, compatibility to the discrete-time and discrete-frequency signal representations as described above should be achieved.

At first, the transforms of the point observation signals to the wave domain are derived. There are a variety of fundamental solutions of the wave equation available for the wave-domain signal representations. Some examples are plane waves [13], spherical harmonics, or cylindrical harmonics [18]. A choice can be made by considering the array setup, which is a concentric planar setup of two uniform circular arrays within this work, as it is depicted in FIG. 2. For this setup, the positions of the N_L loudspeakers may be described in polar coordinates by a circle with radius R_L and the angles determined by the loudspeaker index λ:

$\begin{array}{cc}{\overrightarrow{l}}_{\lambda }={\left(\lambda ·\frac{2\pi }{N_L},R_L\right)}^T,\lambda =0,\dots ,N_L-1.& \left(24\right)\end{array}$

In the same way the positions of the N_M microphones positioned on a circle with radius R_M are given by

$\begin{array}{cc}{\overrightarrow{m}}_{\mu }={\left(\mu ·\frac{2\pi }{N_M},R_M\right)}^T,\mu =0,\dots ,N_M-1,& \left(25\right)\end{array}$
with the microphone index μ. Limiting the considerations to two dimensions, the sound pressure may be described in the vicinity of the microphone array using so-called circular harmonics [18]

$\begin{array}{cc}P\left(\alpha ,\varrho ,j\omega \right)=\sum _{m^{\prime }=-\infty }^{\infty }\left({\tilde{P}}_{m^{\prime }}^{\left(1\right)}\left(j\omega \right){\mathscr{H}}_{m^{\prime }}^{\left(1\right)}\left(\frac{\omega }{c}\varrho \right)+{\tilde{P}}_{m^{\prime }}^{\left(2\right)}\left(j\omega \right){\mathscr{H}}_{m^{\prime }}^{\left(2\right)}\left(\frac{\omega }{c}\varrho \right)\right)e^{j{m}^{\prime }\alpha },& \left(26\right)\end{array}$
where H_m′ ⁽¹⁾(x) and H_m′ ⁽²⁾(x) are Hankel functions of the first and second kind and order m, respectively, ω=2πf denotes the angular frequency, c is the speed of sound, j is used as the imaginary unit, and

and α describe a point in polar coordinates as shown in FIG. 2. We will refer to the wave field components indexed by m′ in (26) et sqq. as modes. The quantities {tilde over (P)}_m′ ⁽¹⁾(jω) and {tilde over (P)}_m′ ⁽²⁾(jω) may be interpreted as spectra of an incoming and an outgoing wave (relative to the origin). Assuming the absence of acoustic sources within the microphone array, {tilde over (P)}_m′ ⁽²⁾(jω) is determined by {tilde over (P)}_m′ ⁽¹⁾(jω) and the scatterer within the microphone array. Consequently, we may limit our considerations to {tilde over (P)}_m′ ^(s)(jω) describing the superposition of {tilde over (P)}_m′ ⁽¹⁾(jω) and {tilde over (P)}_m′ ⁽²⁾(jω):

$\begin{array}{cc}{\tilde{P}}_{m^{\prime }}^{\left(s\right)}\left(j\omega \right)B_{m^{\prime }}\left(\frac{\omega }{c}\varrho \right)={\tilde{P}}_{m^{\prime }}^{\left(1\right)}\left(j\omega \right){\mathscr{H}}_{m^{\prime }}^{\left(1\right)}\left(\frac{\omega }{c}\varrho \right)+P_{m^{\prime }}^{\left(2\right)}\left(j\omega \right){\mathscr{H}}_{m^{\prime }}^{\left(2\right)}\left(\frac{\omega }{c}\varrho \right),& \left(27\right)\end{array}$
where B_m′(x) is dependent on the scatterer within the microphone array. If no scatterer is present, B_m′(x) is equal to the ordinary Bessel function of the first kind J_m(x) of order m′. The solution for a cylindrical baffle can be found in [19].

Now, transform T₂ is explained in more detail. The transform T₂ is used to obtain a wave-domain description of the sound pressure measured by the microphones. Using (26) and (27) we obtain {tilde over (P)}_m′ ^(s)(jω) as a Fourier series coefficient according to

$\begin{array}{cc}{B}_{m^{\prime }}\left(\frac{\omega }{c}{R}_M\right){\tilde{P}}_{m^{\prime }}^{\left(s\right)}\left(j\omega \right)=\frac{1}{2\pi }{\int }_0^{2\pi }P\left(\alpha ,R_M,j\omega \right)e^{j{m}^{\prime }\alpha }d\alpha .& \left(28\right)\end{array}$

In contrast to Ref. 13, where sound velocity and sound pressure were used, we only need to consider the sound pressure on a circle for (28) as both, {tilde over (P)}_m′ ⁽¹⁾(jω) and {tilde over (P)}_m′ ⁽²⁾(jω), are replaced by {tilde over (P)}_m′ ^(s)(jω). However, we can only sample the wave field at the N_M discrete points described by {right arrow over (m)}_μ, so that we approximate the integral in (28) by a sum and obtain

$\begin{array}{cc}{B}_{m^{\prime }}\left(\frac{\omega }{c}{R}_M\right){\tilde{P}}_{m^{\prime }}^{\left(s\right)}\left(j\omega \right)\approx \frac{1}{N_M}\sum _{\mu =0}^{N_M-1}{\hat{P}}_{\mu }^{\left(d\right)}\left(j\omega \right)e^{-j{m}^{\prime }\mu \frac{2\pi }{N_M}},& \left(29\right)\end{array}$
where {tilde over (P)}_μ ^(d)(jω) denotes the spectrum of the sound pressure measured by microphone μ. The superscript (d) refers to d(n) in Sec. II as described later. We will use the right-hand side of (29) as the signal representation of the microphone signals in the wave domain and obtain

$\begin{array}{cc}{\tilde{P}}_{m^{\prime }}^{\left(d\right)}\left(j\omega \right):=\frac{1}{N_M}\sum _{\mu =0}^{N_M-1}{\hat{P}}_{\mu }^{\left(d\right)}\left(j\omega \right)e^{-j{m}^{\prime }\mu \frac{2\pi }{N_M}},& \left(30\right)\end{array}$
which is referred as the measured wave field. The aliasing due to the spatial sampling as well as the term

$B_{m^{\prime }}\left(\frac{\omega }{c}{R}_M\right)$
is neglected in (30) as it will later be modeled by the wave-domain LEMS. Considering (30) as T₂, T₂ is equivalent to the spatial DFT and therefore unitary up to a scaling factor. Due to the spatial sampling, the sequence of modes {tilde over (P)}_m′ ^(d)(jω) is periodic in m′ with a period of N_M orders, so that we can restrict our view to the modes m′=−N_M/2+1, . . . , N_M/2 without loss of generality.

Now, transform T₁ is presented in more detail. The transform T₁ as derived in this section, is used to obtain a wave-domain description of the sound field at the position of the microphone array as it would be created by the loudspeakers under free-field conditions. One possibility to define T₁ is to simulate the free-field point-to-point propagation between loudspeakers and microphones and then transform the obtained signal according to T₂, as it was proposed in Ref. 13. This approach has the advantage to implicitly model the aliasing by the microphone array, but it has also some disadvantages: The number of resulting wave field components is limited by the number of microphones and not by the (typically higher) number of loudspeakers and the resulting transform is frequency dependent. As we aim at frequency-independent invertible transforms, we follow an alternative approach, where we determine the free-field wave field components excited by the loudspeakers at the microphone array circumference independently from the actual number of microphones. Unfortunately, determining the desired free-field sound pressure with the three-dimensional Green's function does not lead to a result that can be straightforwardly transformed using (28). So, we describe the sound pressure at the position of the microphones by approximating the wave propagation from the loudspeakers to the microphones in two stages: a three-dimensional wave propagation from the loudspeakers to the origin and a two-dimensional wave propagation along the microphone array located at the origin. As the Green's functions from the loudspeakers to the origin are not dependent on the microphone positions, the integral in (28) has only to be evaluated for the two-dimensional propagation along the microphone array, which is conveniently solvable.

The three-dimensional wave propagation from the individual loudspeaker positions to the center of the microphone array, e.g., the origin of the coordinate system, is described by the free-field Green's function [20]

$\begin{array}{cc}G\left(\overrightarrow{0}|{\overrightarrow{l}}_{\lambda }\right)=\frac{e^{-j{R}_L\frac{\omega }{c}}}{R_L}.& \left(31\right)\end{array}$

For the two-dimensional wave-propagation along the microphone array the loudspeaker contributions are regarded as plane waves, which is valid if [21]

$\begin{array}{cc}{R}_L>\frac{8{\mathrm{<figure-callout\; id="2"\; label="R\; M"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">R</figure-callout>}}_M^{}\mathrm{<figure-callout\; id="2"\; label="\omega "\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">\omega </figure-callout>}}{2\pi c},R_M⪡R_L.& \left(32\right)\end{array}$

The propagation of a loudspeaker contribution along the microphone array is approximated as a plane wave propagation with the incidence angle φ and described by
G_PW({right arrow over (x)},φ,jω)=e^−j

^{cos(α−φ)ω/c}.  (33)

Using

$\phi =\lambda ·\frac{2\pi }{N_L},$
the sound pressure P(α,R_M, jω) in the vicinity of the microphone array may be approximated by a superposition of plane waves

$\begin{array}{cc}P\left(\alpha ,R_M,j\omega \right)\approx \sum _{\lambda =0}^{N_L-1}{\hat{P}}_{\lambda }^{\left(x\right)}\left(j\omega \right)·G\left(\overrightarrow{0}|{\overrightarrow{l}}_{\lambda },j\omega \right)·G_{\mathrm{PW}}\left(\overrightarrow{x},\lambda \frac{2\pi }{N_L},j\omega \right)& \left(34\right)\\ \approx \sum _{\lambda =0}^{N_L-1}{\hat{P}}_{\lambda }^{\left(x\right)}\left(j\omega \right)\frac{e^{j\left(R_{M}cos\left(\alpha -\lambda \frac{2\pi }{N_L}\right)-R_L\right)\frac{\omega }{c}}}{R_L},& \left(35\right)\end{array}$
where {circumflex over (P)}_λ ^(x)(jω) is the spectrum of the sound field emitted by loudspeaker λ and {right arrow over (x)}=(α, R_M)^T. Again, the superscript (x) referring to x(n), as explained above, is used.

As we derive transform T₁ using the free-field assumption, B_m′(x)=J_m′(x) holds for this derivation. We insert (35) into (28), replace the index m′ by l′ and use the Jacobi-Anger expansion [22] to derive

${\int }_0^{2\pi }{e}^{j{R}_{M}cos\left(\alpha -\lambda \frac{2\pi }{N_L}\right)\frac{\omega }{c}}{e}^{-j{l}^{\prime }\alpha }d\alpha =\sum _{v=-\infty }^{\infty }{j}^v{𝒥}_v\left(R_M\frac{\omega }{c}\right)e^{-jv\lambda \frac{2\pi }{N_L}}{\int }_0^{2\pi }{e}^{j\left(v-l^{\prime }\right)\alpha }d\alpha ,$
which is used to transform (35) to the wave domain:

$\begin{array}{cc}{\tilde{P}}_{l^{\prime }}\left(j\omega \right)=j^{l^{\prime }}\sum _{\lambda =0}^{N_L-1}{\tilde{P}}_{\lambda }^{\left(x\right)}\left(j\omega \right)\frac{e^{-j\left(R_L\frac{\omega }{c}+l^{\prime }\lambda \frac{2\pi }{N_L}\right)}}{R_L}.& \left(36\right)\end{array}$

The resulting P_l′(jω) represents P(α,R_M, jω) in the wave-domain. According to (31), the wave propagation from the loudspeaker positions to the origin is identical for all loudspeakers, so we may leave it to be incorporated into the LEMS model. The same holds for the term j^l′, so that the spatial DFT for T₁ can be used:

$\begin{array}{cc}{\tilde{P}}_{l^{\prime }}^{\left(x\right)}\left(j\omega \right):=\sum _{\lambda =0}^{N_L-1}{\hat{P}}_{\lambda }^{\left(x\right)}\left(j\omega \right)e^{-j{l}^{\prime }\lambda \frac{2\pi }{N_L}},& \left(37\right)\end{array}$
where {tilde over (P)}_l′ ^(x)(jω) is now the free-field description of the loudspeaker signals and l′ denotes the mode order. Again, we limit our view to N_L non-redundant components l′=−(N_L/2−1), . . . , N_L/2 without loss of generality. When obtaining (30) from (29) and (37) from (36), we left the scattering at the microphone array, the delay and the attenuation to be described by the wave-domain LEMS model. For an AEC this is possible because a physical interpretation of the result of the system description is not needed. However, this assumption may change the properties of the LEMS modeled in the wave domain. Fortunately, for the considered array setup, the properties described later remain unchanged.

Now, the LEM System Model in the wave domain is explained. The attractive properties motivating the adaptive filtering in the wave domain are discussed in the following and are compared to the properties of the LEM model when considering the point observation signals. We model the LEMS, e.g., the coupling between the sound p(x) pressure emitted by the loudspeaker {tilde over (P)}_λ ^(x)(jω) and the sound pressure measured by the microphones {tilde over (P)}_μ ^(d)(jω)

$\begin{array}{cc}{\hat{P}}_{\mu }^{\left(d\right)}\left(j\omega \right)=\sum _{\lambda =0}^{N_L-1}{\hat{P}}_{\lambda }^{\left(x\right)}\left(j\omega \right)H_{\mu ,\lambda }\left(j\omega \right),\mu =0,1,\dots ,N_M-1,& \left(38\right)\end{array}$
where H_μ,λ(jω) is equal to the Green's function between the respective loudspeaker and the microphone position fulfilling the boundary conditions determined by the enclosing room. Using (30) and (37), it is possible to describe (38) in the wave domain:

$\begin{array}{cc}{\tilde{P}}_{m^{\prime }}^{\left(d\right)}\left(j\omega \right)=\sum _{l^{\prime }=N_L/2+1}^{N_L/2}{\tilde{H}}_{m^{\prime },l^{\prime }}\left(j\omega \right){\tilde{P}}_{l^{\prime }}^{\left(x\right)}\left(j\omega \right),& \left(39\right)\end{array}$
where H_m′,l′(jω) describes the coupling of mode l′ in the free-field description and mode m′ in the measured wave field. In the free field we would observe {tilde over (H)}_m′,l′(jω)≠0 only for m′=l′, but in a real room other couplings are expected.

While a conventional AEC aims to identify H_μ,λ(jω) directly, a WDAF AEC aims to identify {tilde over (H)}_m′,l′(jω) instead. Whenever identifying H_μ,λ(jω) does not lead to a unique solution, the same is the case for {tilde over (H)}_m′,l′(jω) regardless of the used transforms. However, while H_μ,λ(jω) and {tilde over (H)}_m′,l′(jω) are equally powerful in their ability to model the LEMS, their properties differ significantly. For illustration, a sample for {tilde over (H)}_μ,λ(jω) was obtained by measuring the frequency responses between loudspeakers and microphones located in a real room (T₆₀≈0.25 s) using the array setup depicted in FIG. 2 with R_L=1.5 m, R_M=0.05 m, N_L=48, N_M=10. From H_μ,λ(jω), H_μ,λ(jω) was calculated by using (30) and (37). The result is shown in FIG. 4, where it can be clearly seen that the couplings of different loudspeakers and microphones are similarly strong, while there are stronger couplings for modes with a small order difference |m′−l′| in their order. This can be explained by the fact that the wave field as excited by the loudspeakers in the free-field case is also the most dominant contribution to the wave field in a real room. This property may be observed for different LEMSs and was already used by the authors for a reduced complexity modeling of the LEMS [23]. It is proposed to exploit this property to improve the system description. As {tilde over (H)}_m′,l′(jω) has a reliably predictable structure, we may aim at a solution for the system description where the couplings of modes with a small difference |m′−l′| are stronger than others and reduce the mismatch in a heuristic sense. An adaptation algorithm approaching such a solution is presented later on.

Now, temporal Discretization and Approximation of the LEM System Model is explained. Compatibility between the continuous frequency-domain representations used above with the discrete quantities will be established. The quantities {circumflex over (P)}_λ ^(x)(jω) and {circumflex over (P)}_μ ^(d)(jω) may be related to x_λ(k) and d_μ(k) by a transform to the time domain and appropriate sampling with the sampling frequency f_x.

The mode order l′ and m′ in {tilde over (P)}_l′ ^(x)(jω) and {tilde over (P)}_m′ ^(d)(jω) may be mapped to the indices of the wave field components {tilde over (x)}_l(n) and {tilde over (d)}_m(n) through

$\begin{array}{cc}{l}^{\prime }=\{\begin{array}{cc}l& \mathrm{for}l\le N_L/2,\\ l-N_L& \mathrm{elsewhere}\end{array}& \left(40\right)\\ \mathrm{and}& \\ m^{\prime }=\{\begin{array}{cc}m& \mathrm{for}m\le N_M/2,\\ m-N_M& \mathrm{elsewhere}.\end{array}& \left(41\right)\end{array}$

As the transforms T₂ and T₁ are frequency-independent, they may be directly applied to the loudspeaker and microphone signals resulting in the matrices T₂ and T₁ being equal to scaled DFT matrices with respect to the indices μ and λ:

$\begin{array}{cc}{\left[T_2\right]}_{p,q}=\frac{d\left(p,q,L_D\right)}{\sqrt{N_M}}{e}^{-j\lfloor \left(p-1\right)/L_D\rfloor \lfloor \left(q-1\right)/L_D\rfloor \frac{2\pi }{N_M}},& \left(42\right)\\ {\left[T_1\right]}_{p,q}=\frac{d\left(p,q,L_X\right)}{\sqrt{N_L}}{e}^{-j\lfloor \left(p-1\right)/L_X\rfloor \lfloor \left(q-1\right)/L_X\rfloor \frac{2\pi }{N_L}},& \left(43\right)\end{array}$
where [M]_p,q indexes an entry in M located in row p and column q and

$\begin{array}{cc}d\left(p,q,L\right)=\{\begin{array}{cc}1& \mathrm{if}\mathrm{mod}\left(p-q,L\right)=0\\ 0& \mathrm{elsewhere}\end{array}.& \left(44\right)\end{array}$

The obtained discrete-time signal representations implicitly define discrete-time system representations. Here, h_μ,λ(k) and {tilde over (h)}_m′,l′(k) are the discrete-time representations of H_μ,λ(jω) and {tilde over (H)}_m′,l′(jω) respectively.

In the following, embodiments which employ adaptive filtering are provided. The proposed approach is realized by a modified version of the generalized frequency domain filtering (GFDAF) algorithm like it is described in [14]. At first, this algorithm will shortly be reviewed and then, and then, the modified version will be provided.

At first, GFDAF is explained in more detail. In [14] an efficient adaptation algorithm for the MCAEC was presented. This algorithm shows RLS-like properties and was also used as the basis for the derivation of the algorithm in [15]. For sake of clarity, this algorithm will be described operating on the signals {tilde over (e)}_m(n) separately for each wave field component indexed by m, as separate and joint minimization of ∥{tilde over (e)}_m(n)∥₂ ²∀m coincide [14]. It should be noted that we do not consider the modeled impulse responses to be partitioned as it was done in [14]since this is not necessitated to describe the proposed approach.

For the signals {tilde over (x)}_l(n), {tilde over (e)}_m(n), and {tilde over (d)}_m(n) at first the DFT-domain representations are defined by
{tilde over (x)} _l(n)=F_{2L B} {tilde over (x)}_l(n),  (45)
{tilde over (e)} _m(n)=F_{L B} {tilde over (e)}_m(n),  (46)
{tilde over (d)} _m(n)=F_{L B} {tilde over (d)}_m(n),  (47)
where F_L is the L×L DFT matrix. It may further be necessitated that L_X=2L_H and L_B=L_H. From the signal vector x(n) all wave field components l=0, 1, . . . , N_L−1 may be considered for the minimization of ∥{tilde over (e)}_m(n)∥₂ for every m respectively.
X(n)=(diag{{tilde over (x)} ₀(n)},diag{{tilde over (x)} ₁(n)}, . . . ,diag{{tilde over (x)} _{N L −1}(n)}).  (48)

For each component m, the error {tilde over (e)}_m(n) is obtained, using the discrete representation {tilde over (h)} _m(n) of {tilde over (h)}_m,l(n,k) for this particular m and all l:
{tilde over (e)} _m(n)={tilde over (d)} _m(n)−W ₀₁ X(n)W ₁₀ {tilde over (h)} _m(n−1),  (49)
where we use the matrices W ₀₁ and W ₁₀ for the time-domain windowing of the signals:
W ₀₁=F_{L B} (0_{L B ×L B} ,I_{L B ×L B} )F_{2L B} ⁻¹,  (50)
W ₁₀=bdiag^{N L} {F_{2L B} (I_{L B ×L B} ,0_{L B ×L B} )^TF_{L B} ⁻¹},  (51)
with the block-diagonal operator bdiag^N {M}forming a block-diagonal matrix with the matrix M repeated N times on its diagonal.

A matrix {tilde over (H)}(n) may be defined by the N_M vectors {tilde over (h)} ₀(n), . . . , {tilde over (h)} _m(n), . . . , {tilde over (h)} _{N M −1}(n) which may form the columns of the matrix {tilde over (H)}(n). Thus, the matrix {tilde over (H)}(n) can be considered as a loudspeaker-enclosure-microphone system description of the loudspeaker-enclosure-microphone system description. Moreover, a pseudo-inverse matrix H ⁻¹(n) of {tilde over (H)}(n) or the conjugate transpose matrix H ^T(n) of {tilde over (H)}(n) may also be considered as a loudspeaker-enclosure-microphone system description of the LEMS.

The vector {tilde over (h)} _m(n) can be subdivided into N_L parts {tilde over (h)} _m(n)=({tilde over (h)} _m,l(n), {tilde over (h)} _m,2(n), . . . , {tilde over (h)} _{m,N L} (n))^T, where each vector {tilde over (h)} _m,l(n) contains the DFT-domain representation of {tilde over (h)}_m,l(n,k).

Thus, the matrix {tilde over (H)}(n) may be considered to comprise a plurality of matrix coefficients h_0,1(n,k), h_m,2(n,k), . . . , h_{m,N L} (n,k)

The minimization of the cost function

$\begin{array}{cc}{J}_m\left(n\right)=\left(1-{\lambda }_a\right)\sum _{i=0}^n{\lambda }_a^{n-i}{\underset{\_}{\tilde{e}}}_m^H\left(i\right){\underset{\_}{\tilde{e}}}_m\left(i\right),& \left(52\right)\end{array}$
with ·^H being the conjugate transpose leads to the following adaptation algorithm [14]
{tilde over (h)} _m(n)={tilde over (h)} _m(n−1)+(1−λ_a)S ⁻¹(n)W ₁₀ ^H X ^H(n)W ₀₁ ^H {tilde over (e)} _m(n)  (53)
with
S(n)=λ_a S(n−1)+(1−λ_a)W ₁₀ ^H X ^H(n)W ₀₁ ^H W ₀₁ X(n)W ₁₀.  (54)

The described algorithm can be approximated such that S(n) is replaced by a sparse matrix which allows a frequency bin-wise inversion leading to a lower computational complexity [14].

For the scenarios considered here, the nonuniqueness problem will usually occur and there are multiple solutions for {tilde over (h)} _m(n) which minimize (52). Consequently, the matrix S(n) is singular and has to be regularized for invertibility. In [14], a regularization was proposed which maintains robustness of the algorithm in the case of insufficient power or inactivity of the individual loudspeaker signals. However, in the scenarios considered here, all wave field components are sufficiently exited and this regularization is not effective here. Instead, we propose a different regularization by defining the diagonal matrix
D(n)=βDiag{σ₀ ²(n),σ₁ ²(n), . . . ,σ_{L H N L −1} ²(n)}  (55)
where β is a scale parameter for the regularization. The individual diagonal elements σ_q ²(n) are determined such that they are equal to the arithmetic mean of all diagonal entries s_p ²(n) of S(n) corresponding to the same frequency bin as σ_q ²(n):

$\begin{array}{cc}{\mathrm{<figure-callout\; id="2"\; label="\sigma \; q"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">\sigma </figure-callout>}}_q^{}\left(n\right)=\frac{1}{N_L}\sum _{l=0}^{N_L-1}{s}_{\mathrm{<figure-callout\; id="2"\; label="p"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">p</figure-callout>}}^2\left(n\right),p=\mathrm{mod}\left(q,L_H\right)+L_{H}l,& \left(56\right)\end{array}$
where p and q index the diagonal entries starting with zero. The matrix S(n) in (53) is then replaced by (S(n)+D(n)).

In the following, the modified GFDAF according to embodiments is described. Modifications of the GFDAF according to embodiments are presented. These modifications exploit the diagonal dominance of {tilde over (H)}_m,l(jω) discussed above. For the derivation, the cost function given in (52) is modified as follows

$\begin{array}{cc}{J}_m^{\mathrm{mod}}\left(n\right)={{\underset{\_}{\tilde{h}}}_m\left(n\right)}^H{\underset{\_}{C}}_m\left(n\right){\underset{\_}{\tilde{h}}}_m\left(n\right)+\left(1-{\lambda }_a\right)\sum _{i=0}^n{\lambda }_a^{n-i}{\underset{\_}{\tilde{e}}}_m^H\left(i\right){\underset{\_}{\tilde{e}}}_m\left(i\right),& \left(57\right)\end{array}$
where the matrix C _m(n) is chosen so that components in {tilde over (h)} _m(n) corresponding to non-dominant entries in {tilde over (H)}(j,ω) are more penalized than the others. By a derivation and by using S(n)+C(n−1)≈S(n)+C _m(n), the following adaptation rule is obtained for a minimization of this cost function
{tilde over (h)} _m={tilde over (h)} _m(n−1)+(1−λ_a)(S(n)+C _m(n))⁻¹·(W ₁₀ ^H X ^H(n)W ₀₁ ^H {tilde over (e)} _m(n)−C _m(n){tilde over (h)} _m(n−1)  (58)

As for the original GFDAF, it is possible to formulate an approximation of this algorithm allowing a frequency bin-wise inversion of (S(n)+C _m(n)). The matrix C _m(n) is defined by
C _m(n)=β₀ω_c(n)Diag{c₀(n),c₁(n), . . . ,c_{N L L H −1}(n)}  (59)
with the scale parameter β₀,

$\begin{array}{cc}{c}_q\left(n\right)=\{\begin{array}{cc}{\mathrm{<figure-callout\; id="1"\; label="\beta "\; filenames="USRE047820-20200114-D00002.png,USRE047820-20200114-D00014.png"\; state="\{\{state\}\}">\beta </figure-callout>}}_1& \mathrm{when}\Delta m\left(q\right)=0,\\ {\mathrm{<figure-callout\; id="2"\; label="\beta "\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">\beta </figure-callout>}}_2& \mathrm{when}\Delta m\left(q\right)=1,\\ 1& \mathrm{elsewhere},\end{array}& \left(60\right)\end{array}$
and the weighting function ω_c(n) explained later, where
Δm(q)=min(|└q/L_H┘−m,|└q/L_H┘−m−N_L|)  (61)
is the difference of the mode orders |m′−l′| for the couplings described by {tilde over (h)} _m(n).

Thus, each c_q(n) forms a coupling value for a mode-order pair of a loudspeaker-signal-transformation mode order (q/L_H) of the plurality of loudspeaker-signal-transformation mode orders and a first microphone-signal-transformation mode order (m) of the plurality of microphone-signal-transformation mode orders.

The coupling value c_q(n) has a first value β₁, when the difference between the first loudspeaker-signal-transformation mode order l (l=└q/L_H┘) and the first microphone-signal-transformation mode order m has a first difference value (Δm(q)=0).

The coupling value c_q(n) has a second value β₂ different from the first value β₁, when the difference between the first loudspeaker-signal-transformation mode order (l=└q/L_H┘) and the first microphone-signal-transformation mode order m has a different second difference value (Δm(q)=1).

In order to exploit the property of stronger weighted mode couplings for a small |m−l|, the parameters β¹ and β₂ may be chosen inversely to the expected weights for the individual {tilde over (h)} _m,l(n), leading to 0≤β₁≤β₂≤1. This choice guides the adaptation algorithm towards identifying a LEMS with mode couplings weighted as shown in FIG. 4. The strength of this non-restrictive constraint may be controlled by the choice of 0≤β₀. However, given C _m(n)≠0 a minimization of (57) does not lead to a minimization of (52), which is still the main objective of an AEC. Therefore we introduced the weighting function

$\begin{array}{cc}{w}_c\left(n\right)=\frac{\sum _{m=0}^{N_M-1}{J}_m\left(n-1\right)}{\max \left\{\sum _{m=0}^{N_M-1}{\underset{\_}{\tilde{h}}}_m^H\left(n-1\right){\underset{\_}{\tilde{h}}}_m\left(n-1\right),1\right\}}& \left(62\right)\end{array}$
to ensure an approximate balance of both terms in (57), so that the costs introduced by C _m(n) do not hamper the steady state minimization of (52).

The plurality of vectors {tilde over (h)} ₀(n), . . . , {tilde over (h)} _m(n), . . . , {tilde over (h)} _{N M} ⁻¹(n) may be considered as a loudspeaker-enclosure-microphone system description of the loudspeaker-enclosure-microphone system description.

As has been explained above, an adaptation rule for adapting a LEMS description according to an embodiment, e.g. the adaptation rule provided in formula (58) can be derived from a modified cost function, e.g. from the modified cost function of formula (57). For this purpose, the gradient of the modified cost function may be set to zero and the adapted LEMS description is determined such that:

$\begin{array}{cc}\frac{\partial }{\partial {\underset{\_}{\tilde{h}}}_m^H}{J}_m^{\mathrm{mod}2}\left(n\right)\stackrel{!}{=}0& \left(63\right)\end{array}$

The procedure is to consider the complex gradient of the modified cost function and determine filter coefficients so that this gradient is zero. Consequently, the filter coefficients minimize the modified cost function.

This will now be explained in detail with reference to the modified cost function of formula (57) and the adaptation rule of formula (58) as an example. For this purpose, the complete derivation from (57) to (58) is provided, which is similar to the derivation of the GFDAF in [14]. As already stated above, the procedure followed here is to consider the complex gradient of (57) and determine filter coefficients so that this gradient is zero. Consequently, the filter coefficients minimize the cost function (57).

It should be noted that we exchanged λ_a for λ in order to increase the readability of the document. The remaining notation is identical to formulae (57) and (58) and all undefined quantities refer to those used there. Starting with formula (57) as

$\begin{array}{cc}{J}_m^{\mathrm{mod}}\left(n\right)={\underset{\_}{\tilde{h}}}_m^H\left(n\right){\underset{\_}{C}}_m\left(n\right){\widetilde{\underset{\_}{h}}}_m\left(n\right)+\left(1-\lambda \right)\sum _{i=0}^n{\lambda }^{n-i}{\underset{\_}{\tilde{e}}}_m^H\left(i\right){\underset{\_}{\tilde{e}}}_m\left(i\right),& \left(64\right)\end{array}$
the error {tilde over (e)} _m(n) is replaced by the error ê _m(n) if the filter coefficients ĥ _m would be used (which have to be determined) for all previous input signals. So a slightly modified cost function

$\begin{array}{cc}{J}_m^{\mathrm{mod}2}\left(n\right)={\underset{\_}{\tilde{h}}}_m^H{\underset{\_}{C}}_m\left(n\right){\widetilde{\underset{\_}{h}}}_m+\left(1-\lambda \right)\sum _{i=0}^n{\lambda }^{n-i}{\underset{\_}{\tilde{e}}}_m^H\left(i\right){\underset{\_}{\tilde{e}}}_m\left(i\right)& \left(65\right)\end{array}$
is obtained with
{tilde over (e)} _m(n)={tilde over (d)} _m(n)−W ₀₁ X(n)W ₁₀ {tilde over (h)} _m,  (66)
in contrast to formula (49) which is
{tilde over (e)} _m(n)={tilde over (d)} _m(n)−W ₀₁ X(n)W ₁₀ {tilde over (h)} _m(n−1).  (67)

This distinction is recommended to avoid ambiguities regarding the not perfectly consistent notation in [14]. Inserting (38) into (37), we obtain

$\begin{array}{cc}\begin{array}{c}{J}_m^{\mathrm{mod}2}\left(n\right)={\underset{\_}{\tilde{h}}}_m^H{\underset{\_}{C}}_m{\underset{\_}{\tilde{h}}}_m+\\ \left(1-\lambda \right)\sum _{i=0}^n{{\lambda }^{n-i}\left({\underset{\_}{\tilde{d}}}_m\left(i\right)-{\underset{\_}{W}}_{01}\underset{\_}{X}\left(i\right){\underset{\_}{W}}_{10}{\underset{\_}{\tilde{h}}}_m\right)}^H·\\ \left({\underset{\_}{\tilde{d}}}_m\left(i\right)-{\underset{\_}{W}}_{01}\underset{\_}{X}\left(i\right){\underset{\_}{W}}_{10}{\underset{\_}{\tilde{h}}}_m\right),\\ ={\underset{\_}{\tilde{h}}}_m^H{\underset{\_}{C}}_m\left(n\right){\underset{\_}{\tilde{h}}}_m+\\ \left(1-\lambda \right)\sum _{i=0}^n{\lambda }^{n-i}({\underset{\_}{\tilde{d}}}_m^H\left(i\right){\underset{\_}{\tilde{d}}}_m\left(i\right)-{\underset{\_}{\tilde{h}}}_m^H\left(i\right){\underset{\_}{W}}_{10}^H{\underset{\_}{X}}^H\left(i\right){\underset{\_}{W}}_{01}^H{\tilde{d}}_m\left(i\right)-\\ {\underset{\_}{\tilde{d}}}_m^H\left(i\right){\underset{\_}{W}}_{01}\underset{\_}{X}\left(i\right){\underset{\_}{W}}_{10}{\underset{\_}{\tilde{h}}}_m+\\ {\underset{\_}{\tilde{h}}}_m^H\left(i\right){\underset{\_}{W}}_{10}^H{\underset{\_}{X}}^H\left(i\right){\underset{\_}{W}}_{01}^H{\underset{\_}{W}}_{01}X\left(i\right){\underset{\_}{W}}_{10}{\underset{\_}{\tilde{h}}}_m)\end{array}& \left(68\right)\end{array}$
as function to be minimized by {tilde over (h)} _m. The complex gradient of (40) with respect to {tilde over (h)} _m ^H is given by

$\begin{array}{cc}\frac{\partial }{\partial {\underset{\_}{\tilde{h}}}_m^H}{J}_m^{\mathrm{mod}2}\left(n\right)={\underset{\_}{C}}_m\left(n\right){\underset{\_}{\tilde{h}}}_m+\left(1-\lambda \right)\hspace{1em}\sum _{i=0}^n{\lambda }^{n-i}(-{\underset{\_}{W}}_{10}^H{\underset{\_}{X}}^H\left(i\right){\underset{\_}{W}}_{01}^H{\widetilde{\underset{\_}{d}}}_m\left(i\right)+{\underset{\_}{W}}_{10}^H{\underset{\_}{X}}^H\left(i\right){\underset{\_}{W}}_{01}^H{\underset{\_}{W}}_{01}\underset{\_}{X}\left(i\right){\underset{\_}{W}}_{10}{\underset{\_}{\tilde{h}}}_m)& \left(69\right)\\ \mathrm{Necessitating}& \\ \frac{\partial }{\partial {\underset{\_}{\tilde{h}}}_m^H}{J}_m^{\mathrm{mod}2}\left(n\right)\stackrel{!}{=}0& \left(70\right)\end{array}$
can be used to determine ĥ _m such that J_m ^mod2(n) is minimized. Defining

$\begin{array}{cc}\begin{array}{c}\underset{\_}{S}\left(n\right)=\left(1-\lambda \right)\sum _{i=0}^n{\lambda }^{n-i}{\underset{\_}{W}}_{10}^H{\underset{\_}{X}}^H\left(i\right){\underset{\_}{W}}_{01}^H{\underset{\_}{W}}_{01}\underset{\_}{X}\left(i\right){\underset{\_}{W}}_{10}\\ =\lambda \underset{\_}{S}\left(n-1\right)+\left(1-\lambda \right){\underset{\_}{W}}_{10}^H{\underset{\_}{X}}^H\left(n\right){\underset{\_}{W}}_{01}^H{\underset{\_}{W}}_{01}\underset{\_}{X}\left(n\right){\underset{\_}{W}}_{10}\end{array}& \left(71\right)\\ \mathrm{and}& \\ \begin{array}{c}{\underset{\_}{s}}_m\left(n\right)=\left(1-\lambda \right)\sum _{i=0}^n{\lambda }^{n-i}{\underset{\_}{W}}_{10}^H{\underset{\_}{X}}^H\left(i\right){\underset{\_}{W}}_{01}^H{\underset{\_}{\tilde{d}}}_m\left(i\right)\\ =\lambda {\underset{\_}{s}}_m\left(n-1\right)+\left(1-\lambda \right){\underset{\_}{W}}_{10}^H{\underset{\_}{X}}^H\left(n\right){\underset{\_}{W}}_{01}^H{\underset{\_}{\tilde{d}}}_m\left(n\right)\end{array}& \left(72\right)\end{array}$
we may additionally consider (41) and (42) to write
(S(n)+C _m(n)){tilde over (h)} _m=s _m(n).  (73)

Now, we assume we have obtained a solution {tilde over (h)} _m(n−1) for {tilde over (h)} _m in the previous iteration which fulfills
(S(n−1)+C _m(n−1)){tilde over (h)} _m(n−1)=s _m(n−1).  (74)
and we want to obtain {tilde over (h)} _m(n) such that
Replacing s _m(n) and s _m(n−1) in (44) by (S(n)+C _m(n)){tilde over (h)} _m(n) and (S(n−1)+{tilde over (C)}_m(n−1))h _m(n−1) respectively, we obtain
{tilde over (s)} _m(n)=λ{tilde over (s)} _m(n−1)−(1−λ)W ₀₁ ^H X ^H(n)W ₁₀ ^H {tilde over (d)} _m  (76)
(S(n)+C _m(n){tilde over (h)} _m(n)=λS(n−1){tilde over (h)} _m(n−1)+λC _m(n−1){tilde over (h)} _m(n−1)+(1−λ)W ₁₀ ^H X ^H(n)W ₀₁ ^H {tilde over (d)} _m(n)  (77)
replacing λS(n−1) by reformulating (43) to
S(n)−(1−λ)W ₁₀ ^H X ^H(n)W ₀₁ ^H W ₀₁ X(n)W ₁₀=λS(n−1)  (78)
and by this formula (79) is obtained
(S(n)+C _m(n)){tilde over (h)} _m(n)=S(n){tilde over (h)} _m(n−1)+λC _m(n−1){tilde over (h)} _m(n−1)−(1−λ)W ₁₀ ^H X ^H(n)W ₀₁ ^H W ₀₁ X(n)W ₁₀ {tilde over (h)} _m(n−1)+(1−λ)W ₁₀ ^H X ^H(n)W ₀₁ ^H {tilde over (d)} _m(n)  (79)
with adding 0=C _m(n−1){tilde over (h)} _m(n−1)−C _m(n−1){tilde over (h)}_m(n−1), we may write
(S(n)+C _m(n)){tilde over (h)} _m(n)=(S(n)+C _m(n−1)){tilde over (h)} _m(n−1)−(1−λ)C _m(n−1){tilde over (h)} _m(n−1)−(1−λ)W ₁₀ ^H X ^H(n)W ₀₁ ^H W ₀₁ X(n)W ₁₀ {tilde over (h)} _m(n−1)+(1−λ)W ₁₀ ^H X ^H(n)W ₀₁ ^H {tilde over (d)} _m(n)=(S(n)+C _m(n−1)){tilde over (h)} _m(n−1)+(1−λ)(W ₁₀ ^H X ^H(n)W ₀₁ ^H {tilde over (d)} _m(n)−W ₁₀ ^H X ^H(n)W ₀₁ ^H W ₀₁ X(n)W ₁₀ {tilde over (h)} _m(n−1)−C _m(n−1){tilde over (h)} _m(n−1))  (80)
using
W ₁₀ ^H X ^H(n)W ₀₁ ^H {tilde over (e)} _m(n)=W ₁₀ ^H X ^H(n)W ₀₁ ^H {tilde over (d)} _m(n)−W ₁₀ ^H X ^H(n)W ₀₁ ^H W ₀₁ X(n)W ₁₀ {tilde over (h)} _m(n−1)  (81)
and formula (39), we obtain
(S(n)+C _m(n)){tilde over (h)} _m(n)=(S(n)+C _m(n−1){tilde over (h)} _m(n−1)+(1−λ)(W ₁₀ ^H X ^H(n)W ₀₁ ^H {tilde over (e)} _m(n)−C _m(n−1){tilde over (h)} _m(n−1))  (82)
and using S(n)+C _m(n)≈S(n)+C _m(n−1), finally
{tilde over (h)} _m(n)={tilde over (h)} _m(n−1)+(1−λ)(S(n)+C _m(n))⁻¹·(W ₁₀ ^H X ^H(n)W ₀₁ ^H {tilde over (e)} _m(n)−C _m(n−1){tilde over (h)} _m(n−1))  (83)

Some of the above-described embodiments provide a loudspeaker-enclosure-microphone system description based on determining an error signal e(n).

Another embodiment, however, provides a loudspeaker-enclosure-microphone system description without determining an error signal.

Considering formula (71) and (72), we may reformulate (73) so that we can obtain the filter coefficients {tilde over (h)} _m without determining an error signal by using
{tilde over (h)} _m(n)=(S(n)+C _m(n))⁻¹ s _m(n)  (84)

The loudspeaker-enclosure-microphone system description provided by one of the above-described embodiments can be employed for various applications. For example, the loudspeaker-enclosure-microphone system description may be employed for listening room equalization (LRE), for acoustic echo cancellation (AEC) or, e.g. for active noise control (ANC).

At first, it is explained how to employ the above-described embodiments for acoustic echo cancellation (AEC).

The application of the above-described embodiments for AEC has already been described above. For example, in FIG. 3, an error signal e(n) is output as the result of the apparatus. This error signal e(n) is the time-domain error signal of the wave-domain error signal {tilde over (e)}(n). {tilde over (e)}(n) itself depends on {tilde over (d)}(n) being the wave-domain representation of the recorded microphone signals and {tilde over (y)}(n) being the wave-domain microphone signal estimate. The wave-domain microphone signal estimate {tilde over (y)}(n) itself may be provided by the system description application unit 150 which generates the wave-domain microphone signal estimate {tilde over (y)}(n) based on the loudspeaker-enclosure-microphone system description {tilde over (h)} ₀(n), . . . , {tilde over (h)} _m(n), . . . , {tilde over (h)} _{N M −1}(n).

If, for example, a speaker, which represents a local source, is located inside a LEMS, then the voices produced by the speaker will not be compensated and still remain in the error signal e(n). All other sounds, however, should be compensated/cancelled in the error signal e(n). Thus, the error signal e(n) represents the voices produced by a local source inside the LEMS, e.g. a speaker, but without any acoustic echos, because these echos have already been cancelled by forming the difference between the actual microphone signals {tilde over (d)}(n) and the microphone signal estimation {tilde over (y)}(n)

Thus, the quantity e(n) already describes the echo compensated signal.

In the following, the application of the above-described embodiments for active noise control (ANC) is explained.

The application of state-of-the-art WDAF for ANC has already been presented in [15], but in [15], a very limited wave-domain model was used, for which the nonuniqueness problem does not occur. No measures to improve the robustness in the presence of the nonuniqueness problem were presented.

Here, we describe a conventional ANC system in order to point out that the application of this invention is not limited to systems working in the wave domain, although an integration in such a system would be a natural choice. Please note that although the filters for noise cancellation are determined according to a conventional model, the system identification is conducted in the wave domain.

FIG. 6a shows an exemplary loudspeaker and microphone setup used for ANC. The outer microphone array is termed reference array, the inner microphone array is termed error array. In FIG. 6a, a noise source is depicted emitting a sound field which should ideally be cancelled within the listening area. As the signal of the noise source is unknown, it has to be measured. To this end, an additional microphone array outside the loudspeaker array is needed in addition to the previously considered array setup. This array is referred to as the reference array, while the microphone array inside the loudspeaker array is referred to as the error array.

FIG. 6b illustrates a block diagram of an ANC system. R represents sound propagation from the noise sources to the reference array. G(n) represents prefilters to facilitate ANC. P illustrates the sound propagation from the reference array to the error array (primary path), and S is the sound propagation from the loudspeakers to the error array (secondary path).

In FIG. 6b, the unknown signal of the N_R microphones of the reference array is described by
d(n)=Rn(n)  (85)
using the previously introduced vector and matrix notation. Here, d(n) describes the signal we can obtain from the reference array. This signal is filtered according to
x(n)=G(n)d(n)  (86)
to obtain the N_L loudspeaker signals x(n), which are then emitted by the loudspeaker array to cancel the noise signal. To ensure a cancellation, the N_E signals from the error array are considered, which capture the superposition
e(n)=Pd(n)+Sx(n),  (87)
where the matrix P describes the propagation of the noise from the reference array to the error array and is referred to as the primary path. The matrix S describes the secondary path from the loudspeakers to the error array. For ANC, G(n) is ideally determined in a way such that
−SG(n)=P  (88)
so the error signal e(n) vanishes. Since the MIMO impulse responses P and S are in general unknown and may also change over time, both have to be identified. So we consider the identified systems Ŝ(n) and {circumflex over (P)}(n) to obtain G(n) such that
−Ŝ(n)G(n)={circumflex over (P)}(n)  (89)

Typically, there are less noise sources than reference microphones (N_S<N_R), so the nonuniqueness problem does occur for the identification of P. This is equivalent to the considered AEC scenario in the prototype description with n(n) in the role of {circumflex over (x)}(n) and R in the role of G_RS and P in the role of H. Moreover, there is typically also no unique solution for the identification of S, as there are typically more loudspeakers than noise sources (N_S<N_L) and x(n) only describes the filtered signals of the noise sources. Obviously, the invention can be used to improve the identification of P and S, which would then increase the robustness of the ANC system. This can be done by obtaining wave-domain identifications {circumflex over (P)}(n) and Ŝ(n) of P and S, which are then transformed to their representation in the conventional domain by
{circumflex over (P)}(n)=T₁{tilde over (P)}(n)T₂ ⁻¹  (90)
Ŝ(n)=T₃{tilde over (P)}(n)T₂ ⁻¹  (91)
with T₁ being the transform of the reference signals d(n) to the wave domain and T₃ being the transform of the loudspeaker signals x(n) to the wave domain. Given that the error signals e(n) are transformed to the wave domain by T₂, T₂ ⁻¹, describes the inverse of this transform or an appropriate approximation.

In the following, listening room equalization is considered. Here, the embodiments for providing a loudspeaker-enclosure-microphone system description may be employed for improving a wave field synthesis (WFS) reproduction by being part of a listening room equalization (LRE) system. WFS (see, e.g. [1]) is used to achieve a highly detailed spatial reproduction of an acoustic scene overcoming the limitations of a sweet spot by using an array of typically several tens to hundreds of loudspeakers. The loudspeaker signals for WFS are usually determined assuming free-field conditions. As a consequence, an enclosing room shall not exhibit significant wall reflections to avoid a distortion of the synthesized wave field.

In a lot of application scenarios, the necessitated acoustic treatment to achieve such room properties may be too expensive or impractical. An alternative to acoustical countermeasures is to compensate for the wall reflections by means of a listening room equalization (LRE), often termed listening room compensation. To this end, the reproduction signals are filtered to pre-equalize the MIMO room system response from the loudspeakers to the positions of multiple microphones, ideally achieving an equalization at any point in the listening area. The equalizers are determined according to the impulse responses for each loudspeaker-microphone path. As the MIMO loudspeaker-enclosure-microphone system (LEMS) is expected to change over time, it has to be continuously identified by adaptive filtering. The task of LRE has often been addressed in the literature. However, systems relying on a system identification of the LEMS have barely been investigated, notably because of the nonuniqueness problem. Employing a loudspeaker-enclosure microphone system description provided according to one of the above-described embodiments can significantly improve the system identification and therefore also the equalization results.

The above-described embodiments may also be employed together with any conventional LRE system. The above-described embodiments are not limited to loudspeaker-enclosure-microphone systems working in the wave domain, although such using the above-described embodiments with such loudspeaker-enclosure-microphone systems is of advantage. It should be noted that although the equalizers are determined according to a conventional model, in the following, the system identification is considered to be conducted in the wave domain.

In the following, a description of a LRE system according to an embodiment is provided. Inter alia, the integration of the invention in an LRE system is explained. For this purpose, reference is made to FIG. 6c.

FIG. 6c illustrates a block diagram of an LRE system. T₁ and T₂ depict transforms to the wave domain. G(n) depict equalizer. H shows the LEMS. {tilde over (H)}(n) illustrates the identified LEMS and H⁽⁰⁾ depicts the desired impulse response.

In the embodiment of FIG. 6c, an original loudspeaker signal x(n) is equalized such that an equalized loudspeaker signal x′(n) is obtained according to
x′(n)=G(n)x(n),  (92)
where
x′(n)=((x′₀(n))^T,(x′₁(n))^T, . . . ,(x′_{N L −1}(n))^T)^T  (93)
with the components
x′_λ′(n)=((x′_λ′(nL_F−L_X+1),x′_λ′(nL_F−L_X+2), . . . ,x′_λ′(nL_F))^T  (94)
capturing L′_X time samples x′_λ′(k) of the equalized loudspeaker signal λ′ at time instant k.

Similarly, x(n) is defined as:
x(n)=((x₀(n))^T,(x₁(n))^T, . . . ,(x_{N L −1}(n))^T)^T  (95)
with the components
x_λ(x_λ(nL_F−L_X+1),x_λ(nL_F−L_X+2) . . . ,x(nL_F)  (96)
capturing L_X≤L′_X by time samples x_λ(k) of the unequalized loudspeaker signal k at time instant k.

The matrix G(n) is structured such that it describes a convolution operation according to

$\begin{array}{cc}{x^{\prime }}_{{\lambda }^{\prime }}\left(n\right)=\sum _{\lambda =0}^{N_L-1}\sum _{\kappa =0}^{L_H-1}{x}_{\lambda }\left(k-\kappa \right)g_{{\lambda }^{\prime },\lambda }\left(\kappa ,n\right),& \left(97\right)\end{array}$
where g_λ′,λ(k,n) is the equalizer impulse response from the original loudspeaker signal λ to the equalized loudspeaker signal λ′. The matrix and vector notation above acts as a prototype for all considered system and signal descriptions. Although the dimensions of other signal vectors and system matrices may differ, the underlying structure remains the same.

Ideally, an LRE system achieves equalizers such that
H⁽⁰⁾=HG(n),  (98)
where H⁽⁰⁾ is the desired free field impulse response between the loudspeakers and the microphone. As the true LEMS impulse responses H are usually not known, this is achieved for the identified system Ĥ(n) such that
Ĥ(n)G(n)=H⁽⁰⁾,  (99)
where we assume a coefficient transform according to
Ĥ(n)=T₁Ĥ(n)T₂ ⁻¹  (100)
with T₁ being the transform of the equalized loudspeaker signals to the wave domain and T₂ ⁻¹ being the matrix formulation of the appropriate inverse transform of T₂, which transforms the microphone signals to the wave domain.

As Ĥ(n) is the identified system, there may be indefinitely many solutions for Ĥ(n) for a given LEMS H, depending on the correlation properties of the loudspeaker signals. As the solution for G(n) according to (99) depends on Ĥ(n) and the set of possible solutions for Ĥ(n) can vary with changing correlation properties of the loudspeaker signals, an LRE system shows a very poor robustness against the nonuniqueness problem. At this point, the proposed invention can improve the system identification and therefore also the robustness of the LRE.

In the following, a description of two algorithms to obtain G(n) from Ĥ(n) and H⁽⁰⁾ is provided. At first, however, the LRE signal model referred to for the description of the two algorithms is described. In particular, the signal model of a multichannel LRE system is explained considering FIG. 6d.

FIG. 6d illustrates an algorithm of a signal model of an LRE system. In FIG. 6d, G(n) represents equalizers, H is a LEMS, Ĥ(n) represents an identified LEMS, H⁽⁰⁾ is a desired impulse response, x(n) depicts an original loudspeaker signal, x′(n): equalized loudspeaker signal and d(n) illustrates the microphone signal.

The loudspeaker signal vector x(n) in FIG. 6d is illustrated comprising a block, indexed by n, of L_X time-domain samples of all N_L loudspeaker signals:
x(n)=(x₁(nL_F−L_X+1), . . . ,x₁(nL_F),x₂(nL_F−L_X+1), . . . ,x₂(nL_F), . . . ,x_{N L} (nL_F)),  (101)
where x_l(k) is a time-domain sample of the l-th loudspeaker signal at time instant k and L_F is the frame shift. This signal should be optimally reproduced under free-field conditions. To remove the unwanted influence of the enclosing room on the reproduced sound field, we pre-equalize these signals through G(n) such that

$\begin{array}{cc}{x}^{\prime }\left(n\right)=G\left(n\right)x\left(n\right),& \left(102\right)\\ x_{\lambda }^{\prime }\left(k\right)=\sum _{l=0}^{N_L-1}\sum _{\kappa =0}^{L_G-1}{x}_l\left(k-\kappa \right)g_{\lambda ,l}\left(\kappa ,n\right)& \end{array}$
where x′(n) has the same structure as x(n), but comprises only the latest L_X−L_G+1 time samples x′_λ(k) of the equalized loudspeaker signals.

It should be noted that in formulae (102) to (124) and the part of the description that refers to formulae (102) to (124) index l may be used as an index for a loudspeaker signal rather than an index for a wave-field component. Moreover, it should be noted, that in formulae (102) to (124) and the part of the description that refers to formulae (102) to (124) index m may be used as an index for a microphone signal rather than an index for a wave-field component.

The unequalized loudspeaker signals x(n) are referred to as original loudspeaker signals in the following. The equalizer impulse responses g_λ,1(k, n), of length L_G from the original loudspeaker signal l to the actual loudspeaker signal λ have to be determined via identifying the LRE system first. To this end, the signals x′(n) are fed to the LEMS and the resulting microphone signals are observed:

$\begin{array}{cc}d\left(n\right)={\mathrm{Hx}}^{\prime }\left(n\right),& \left(103\right)\\ d_m\left(k\right)=\sum _{\lambda =0}^{N_L-1}\sum _{\kappa =0}^{L_H-1}{x}_{\lambda }^{\prime }\left(k-\kappa \right)h_{m,\lambda }\left(\kappa \right)& \end{array}$
where h_m,λ(k) describes the room impulse response of length L_H from loudspeaker λ to microphone m and is assumed to be time-invariant in this paper. Here, L_X−L_G−L_H+2 time samples d_m(k) of the N_M microphone signals are comprised in d(n). Using the observations of x′(n) and d(n), the system. H is identified by {tilde over (H)}(n) by means of an adaptive filtering algorithm, e. g., the GFDAF [1] which minimizes the squared error term

$\begin{array}{cc}\sum _{i=0}^n{\lambda }_a^{n-i}{e}^H\left(i\right)e\left(i\right),& \left(104\right)\\ \mathrm{with}& \\ e\left(n\right)=d\left(n\right)-\hat{H}\left(n\right)x^{\prime }\left(n\right)& \end{array}$
with the exponential forgetting factor λ_a. The coefficients contained in {tilde over (H)}(n) are used for the equalizer determination as explained in the following section.

In the following, the determination of the equalizer coefficients is explained starting with the FxGFDAF, which was the inspiration for the proposed approach explained afterward.

The signal model for the Filtered-X GFDAF (FxGFDAF) is shown in FIG. 6e. In FIG. 6e, a filtered-X structure is illustrated. {tilde over (H)}(n) depicts an identified LEMS, Ĝ(n) shows equalizers, H⁽⁰⁾ is a free-field impulse responses, {circumflex over (x)}(n) is an excitation signal, {circumflex over (z)}(n) depicts a filtered excitation signal, {circumflex over (d)}(n) is a desired microphone signal.

The excitation signal {circumflex over (x)}(n) of FIG. 6e is structured as x(n) but comprising 2L_G+L_H−1 samples for each l and may be equal to x(n) or simply a white-noise signal [25]. The desired microphone signals comprise 2L_G samples for each m and are obtained according to
d_l(n)=H⁽⁰⁾{circumflex over (x)}_l  (105)
where H⁽⁰⁾ is structured like H containing the desired free-field impulse responses h_m,1 ⁽⁰⁾ and {circumflex over (x)}₁(n) defined as {circumflex over (x)}(n) for a sole excitation of loudspeaker l and with all other components set to zero. The equalizers for every original loudspeaker signal are determined separately, assuming that not only the superposition of all signals, but also each individual original signal should be equalized. This sufficient (although not necessary) requirement for a global equalization increases the robustness of the solution against changing correlation properties of the loudspeaker signals and reduces the dimensions of the inverse in formula (114). The equalizer responses g_λ,1(k,n) are captured by the vectors g_1,λ(n) and then transformed to the DFT-domain and concatenated
g_λ,1=(g_λ,1(0,n),g_λ,1(1,n), . . . ,g_λ,1(L_G−1,n))^T  (106)
g _l=((F_{L G} g_0,1(n))^T, . . . ,(F_{L G} g_{N L} ,l(n))^T)^T  (107)
using the unitary L_G×L_G DFT matrix F_{L G} . For time-domain zero padding and windowing operations, the following definitions are provided:

$\begin{array}{cc}{\underset{\_}{W}}_{01}=I_{N_M}\otimes \left(F_{L_G}\left(0,I_{L_G}\right){\mathrm{<figure-callout\; id="2"\; label="F"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">F</figure-callout>}}_{2L_G}^H\right)& \left(108\right)\\ {\underset{\_}{W}}_{10}=I_{N_L}\otimes \left({{\mathrm{<figure-callout\; id="2"\; label="F"\; filenames="USRE047820-20200114-D00004.png,USRE047820-20200114-D00005.png"\; state="\{\{state\}\}">F</figure-callout>}}_{2L_G}\left(0,I_{L_G},0\right)}^T{F}_{L_G}^H\right)& \left(109\right)\end{array}$
with the Kronecker product denoted by ⊗ and the N_M×N_M identity matrix I_{N M} . Thus, the error may be defined to be minimized in the DFT domain by

$\begin{array}{cc}{\hat{e}}_l\left(n\right)=\left(I_{N_M}\otimes F_{L_G}\right){\hat{d}}_l\left(n\right)-{\underset{\_}{\tilde{W}}}_{01}{\underset{\_}{\tilde{Z}}}_l\left(n\right){\underset{\_}{\tilde{W}}}_{10}{\underset{\_}{g}}_l\left(n-1\right)& \left(110\right)\end{array}$

Here, the matrix {circumflex over (Z)} _l(n) is constructed from the components of {circumflex over (z)}(n)
{tilde over (Z)} _m,λ,l(n)=Diag{F_{2L G} {tilde over (z)}_m,λ,l(n)}  (111)
according to the following example for N_L=3, N_M=2:

$\begin{array}{cc}{\underset{\_}{\stackrel{\circ }{Z}}}_l\left(n\right)=\left(\begin{array}{ccc}{\underset{\_}{\stackrel{\circ }{Z}}}_{0,0,l}\left(n\right)& {\underset{\_}{\stackrel{\circ }{Z}}}_{0,1,l}\left(n\right)& {\underset{\_}{\stackrel{\circ }{Z}}}_{0,2,l}\left(n\right)\\ {\underset{\_}{\stackrel{\circ }{Z}}}_{1,0,l}\left(n\right)& {\underset{\_}{\stackrel{\circ }{Z}}}_{1,1,l}\left(n\right)& {\underset{\_}{\stackrel{\circ }{Z}}}_{1,2,l}\left(n\right)\end{array}\right)& \left(112\right)\end{array}$

The N_L ²N_M components {circumflex over (z)}_m,λ,1(n) of {circumflex over (Z)} _l(n) are obtained by filtering each component of {circumflex over (x)}(n) (indexed by l) with every input-output path ĥ_m,λ(k,n) (indexed by λ and m, respectively) of the identified LEMS Ĥ(n). This implies a considerable computational effort scaling with approximately O(N_L ²N_M(L_H+2L_G)log(L_H+2L_G)) when using fast convolution. This is comparable to the effort for determining ŝ _l ⁻¹(n){circumflex over (z)} _l ^H(n) in formula (114) which scales approximately with O(N_L ³L_G), when using the recursive realization proposed in [14].

The cost function to be minimized for optimizing g _l(n) is then

$\begin{array}{cc}{\stackrel{\circ }{J}}_l\left(n\right)=\left(1-{\lambda }_b\right)\sum _{i=0}^n{\lambda }_b^{n-i}{\underset{\_}{\stackrel{\circ }{e}}}_l^H\left(i\right){\underset{\_}{\stackrel{\circ }{e}}}_l\left(i\right)& \left(113\right)\end{array}$
With a derivation and an approximation similar to [14] we obtain the update rule
g _l(n)=g _l(n−1)+μ_b(1−λ_b){tilde over (W)} ₁₀ ^H S _l ⁻¹(n){tilde over (Z)} _l ^H(n){tilde over (W)} ₀₁ ^H {tilde over (e)} _l(n)  (114)
with the step size parameter 0≤μ_b≤1 and

$\begin{array}{cc}{\stackrel{\circ }{\underset{\_}{S}}}_l\left(n\right)={\lambda }_b{\stackrel{\circ }{\underset{\_}{S}}}_l\left(n-1\right)+\left(1-{\lambda }_b\right)\frac{1}{2}\left({\stackrel{\circ }{\underset{\_}{Z}}}_l^H\left(n\right){\stackrel{\circ }{\underset{\_}{Z}}}_l\left(n\right)+{\stackrel{\circ }{\underset{\_}{R}}}_l\left(n\right)\right)& \left(115\right)\end{array}$
where we use a Tikhonov regularization with a weighting factor δ_b by defining

$\begin{array}{cc}{\underset{\_}{\stackrel{\circ }{R}}}_l\left(n\right)=\frac{{\delta }_b}{N_L}{I}_{N_L}\otimes \sum _{\lambda =0}^{N_L-1}\sum _{\mu =0}^{N_M-1}{\underset{\_}{\stackrel{\circ }{Z}}}_{m,\lambda ,l}\left(n\right){\underset{\_}{\stackrel{\circ }{Z}}}_{m,\lambda ,l}^H\left(n\right)& \left(116\right)\end{array}$
The matrix Ŝ(n) is a sparse matrix, which reduces the computational effort drastically [14].

In the following, the provided DFT-Domain Approximate Inverse Filtering, and the DFT-domain equalizer determination is presented. Similarly to the FxGFDAF, this algorithm is formulated for each original loudspeaker signal l independently, but in contrast to the FxGFDAF description, we consider the difference of the overall system response H(n){tilde over (W)} ₁₀ g _l(n) to the desired system responses h _l ⁽⁰⁾(n) directly and obtain
{tilde over (e)} _l=h _l ⁽⁰⁾(n)−H(n){tilde over (W)} ₁₀ g _l(n−1)  (117)
with
h_m,l ⁽⁰⁾=(h_m,l ⁽⁰⁾(0),h_m,l ⁽⁰⁾(1), . . . ,h_m,l ⁽⁰⁾(2L_G))^T,  (118)
h_l ⁽⁰⁾(n)=((F_{2L G} h_0,l ⁽⁰⁾(n))^T, . . . ,(F_{2L G} h_{N M −1,t} ⁽⁰⁾(n))^T)^T

The identified system responses of the LEMS are captured in H(n) according to the following example for N_L=3, N_M=2:

$\begin{array}{cc}\underset{\_}{H}\left(n\right)=\left(\begin{array}{ccc}{\underset{\_}{H}}_{0,0}\left(n\right)& {\underset{\_}{H}}_{0,1}\left(n\right)& {\underset{\_}{H}}_{0,2}\left(n\right)\\ {\underset{\_}{H}}_{1,0}\left(n\right)& {\underset{\_}{H}}_{1,1}\left(n\right)& {\underset{\_}{H}}_{1,2}\left(n\right)\end{array}\right)& \left(119\right)\end{array}$
with
H _m,λ(n)=Diag{F_{2L G} (I_{L G} ,0)^Tĥ_m,λ(n)}  (120)
where ĥ_m,λ(n) describes the identified impulse response from loudspeaker λ to microphone m, zero-padded or truncated to length L_G. In contrast to formula (110) we need no windowing by W ₀₁ in formula (117) because of the chosen impulse response lengths. To iteratively minimize the cost function
{tilde over (J)}_l(n)={tilde over (e)} _l ^H(n){tilde over (e)} _l(n)  (121)
we again follow a derivation similar to [14] and set the gradient to zero. From this the formula

$\begin{array}{cc}{\underset{\_}{\tilde{W}}}_{10}^H{\underset{\_}{H}}^H\left(n\right){\underset{\_}{\tilde{W}}}_{10}{\underset{\_}{g}}_l\left(n\right)={\underset{\_}{\tilde{W}}}_{10}^H{\underset{\_}{H}}^H\left(n\right){\underset{\_}{\tilde{W}}}_{10}{\underset{\_}{g}}_l\left(n+1\right)+{\underset{\_}{\tilde{W}}}_{10}^H& \left(122\right)\\ {\underset{\_}{H}}^H\left(n\right){\underset{\_}{\tilde{e}}}_l\left(n\right)& \end{array}$
is obtained as the system of equations to be solved for obtaining the optimum g _l(n). For multichannel systems this means an enormous computational effort. Therefore we propose the following adaptation rule for iteratively determining the optimum equalizer:
g _l(n):=g _l(n−1)+μ_c {tilde over (W)} ₁₀ ^H(H ^H(n)H(n)+R(n))⁻¹·H ^H(n){tilde over (e)} _l(n),  (123)
where we introduced a Tikhonov regularization with a weighting factor δ_c with

$\begin{array}{cc}\underset{\_}{R}\left(n\right)=\frac{{\delta }_b}{N_L}{I}_{N_L}\otimes \sum _{\lambda =0}^{N_L-1}\sum _{\mu =0}^{N_M-1}{\underset{\_}{H}}_{m,\lambda }\left(n\right){\underset{\_}{H}}_{m,\lambda }^H\left(n\right)& \left(124\right)\end{array}$

Here, H ^H(n)H(n) is a sparse matrix like Ŝ _l(n), allowing a computationally inexpensive inversion (see [26]). The update rule of formula (123) is similar to the approximation in [26], but in addition we introduce an iterative optimization of g_l(n) which becomes possible due the consideration of e _l(n).

FIG. 6f illustrates a system for generating filtered loudspeaker signals for a plurality of loudspeakers of a loudspeaker-enclosure-microphone system according to an embodiment. In an embodiment, the system of FIG. 6f may be configured for listening room equalization, for example as described with reference to FIG. 6c, FIG. 6d or FIG. 6e. In another embodiment, the system of FIG. 6f may be configured for active noise cancellation, for example as described with reference to FIG. 6b.

The system of the embodiment of FIG. 6f comprises a filter unit 680 and an apparatus 600 for providing a current loudspeaker-enclosure-microphone system description. Moreover, FIG. 6f illustrates a LEMS 690.

The apparatus 600 for providing the current loudspeaker-enclosure-microphone system description is configured to provide a current loudspeaker-enclosure-microphone system description of the loudspeaker-enclosure-microphone system to the filter unit (680).

The filter unit 680 is configured to adjust a loudspeaker signal filter based on the current loudspeaker-enclosure-microphone system description to obtain an adjusted filter. Moreover, the filter unit 680 is arranged to receive a plurality of loudspeaker input signals. Furthermore, the filter unit 680 is configured to filter the plurality of loudspeaker input signals by applying the adjusted filter on the loudspeaker input signals to obtain the filtered loudspeaker signals.

FIG. 6g illustrates a system for generating filtered loudspeaker signals for a plurality of loudspeakers of a loudspeaker-enclosure-microphone system according to an embodiment showing more details. The system of FIG. 6g may be employed for listening room equalization. In FIG. 6g, the first transformation unit 630, the second transformation unit 640, the system description generator 650, its system description application unit 660, its error determiner 670 and its system description generation unit 680 correspond to the first transformation unit 130, the second transformation unit 140, the system description generator 150, the system description application unit 160, the error determiner 170 and the system description generation unit 180 of FIG. 1b, respectively.

Furthermore, the system of FIG. 6g comprises a filter unit 690. As already described with reference to FIG. 6f, the filter unit 690 is configured to adjust a loudspeaker signal filter based on the current loudspeaker-enclosure-microphone system description to obtain an adjusted filter. Moreover, the filter unit 690 is arranged to receive a plurality of loudspeaker input signals. Furthermore, the filter unit 690 is configured to filter the plurality of loudspeaker input signals by applying the adjusted filter on the loudspeaker input signals to obtain the filtered loudspeaker signals.

In an embodiment, a method for determining at least two filter configurations of a loudspeaker signal filter for at least two different loudspeaker-enclosure-microphone system states is provided.

For example, the loudspeakers and the microphones of the loudspeaker-enclosure-microphone system may be arranged in a concert hall. When the concert hall is crowded with people and all seats of the concert hall, the loudspeaker-enclosure-microphone system may be in a first state, e.g. the impulse responses regarding the output loudspeaker signals and the recorded microphone signals may have first values. When only half of the seats of the concert hall are covered by people, the loudspeaker-enclosure-microphone system may be in a second state, e.g. the impulse responses regarding the output loudspeaker signals and the recorded microphone signals may have second values.

According to the method, a first loudspeaker-enclosure-microphone system description of the loudspeaker-enclosure-microphone system is determined, when the loudspeaker-enclosure-microphone system has a first state (e.g. the impulse responses of the loudspeaker signals and the recorded microphone signals have first values, e.g. the concert hall is crowded). Then a first filter configuration of a loudspeaker signal filter is determined based on the first loudspeaker-enclosure-microphone system description, for example, such that the loudspeaker signal filter realizes acoustic echo cancellation. The first filter configuration is then stored in a memory.

Then, a second loudspeaker-enclosure-microphone system description of the loudspeaker-enclosure-microphone system is determined, when the loudspeaker-enclosure-microphone system has a second state, e.g. the impulse responses of the loudspeaker signals and the recorded microphone signals have second values, e.g. only half of the concert hall are occupied. Then, a second filter configuration of the loudspeaker signal filter is determined based on the second loudspeaker-enclosure-microphone system description, for example, such that the loudspeaker signal filter realizes acoustic echo cancellation. The second filter configuration is then stored in the memory.

The loudspeaker signal itself filter may be arranged to filter a plurality of loudspeaker input signals to obtain a plurality of filtered loudspeaker signals for steering a plurality of loudspeakers of a loudspeaker-enclosure-microphone system.

For example, under test conditions, a first filter configuration may be determined when the loudspeaker-enclosure-microphone system has a first state, and a second filter configuration may be determined when the loudspeaker-enclosure-microphone system has a second state. Later, under real conditions, either the first or the second filter configuration may be used for acoustic echo cancellation depending on whether, e.g. the concert hall is crowded or whether only half of the seats are occupied.

The performance and the properties of the algorithms according to the above-described embodiments for providing a loudspeaker-enclosure-microphone system description will now be evaluated. To this end, the results from an experimental evaluation of the proposed approach are presented. At first, the results for an experiment under optimal conditions are considered.

For the simulation of the LEMS, we used the measured impulse responses for the LEMS described above with N_L=48 loudspeakers and N_M=10 microphones. Using a sampling frequency of f_s=11025 Hz, the impulse responses were truncated to 3764 samples. This is slightly shorter than the modeled length of the impulse responses which is L_H=4096, so effects resulting from an unmodeled impulse response tail are absent. The loudspeaker signals were determined by using WFS [1] so that plane waves could be synthesized within the loudspeaker array. The incidence angles of the plane waves were chosen to be φ₁1=0 and φ₂=π/2, where the plane waves were alternatingly or simultaneously synthesized to simulate a change of G_RS over time. The length of all FIR filters used for the WFS was L_G=135. To reduce the computational complexity, we used the approximations of both algorithms described by (53) and (58), respectively such that the respective matrices can be inverted frequency bin-wise [14]. Furthermore, we used a frame shift L_F of 512 samples and a forgetting factor of λ_a of 0.95, while both algorithms were regularized with β=0.05. For the modified GFDAF the parameters β₀=2, β₁=0.01, and β₂=0.1 were chosen. To avoid divergence at the beginning of the adaptation we used S(0)={circumflex over (σ)}I with the identity matrix I of appropriate dimensions and {circumflex over (σ)} being an approximation of the steady state mean value of the diagonal entries of S(n) after the first four seconds of the experiment. This can be considered as a nearly optimum initialization value. For the comparison the ERLE (17) and the normalized misalignment (22) for the different approaches are shown.

Now, model validation is provided. The results shown are used to validate the proposed model and the improved system description performance of the proposed algorithm.

Mutually uncorrelated white noise signals were used as source signals for the synthesized plane waves. The timeline for this experiment can be described as follows: For the time span 0≤t<5 s only one plane wave with an incidence angle of φ₁ was synthesized. For the time span 5≤t<10 s another plane wave with an incidence angle of φ₁ was synthesized. For 10≤t<15 s both plane waves were simultaneously synthesized.

The results for this experiment are shown in FIG. 7. It can be seen that there is a breakdown in ERLE for both considered approaches at t=5 s when the first plane wave is no longer synthesized and the second one is synthesized instead. A smaller breakdown can be seen at t=10 s when the first plane wave is synthesized again in addition to the second one. The breakdown at t=5 s can be expected for any approach because new properties of the LEMS are revealed when the second plane wave is synthesized. Those properties are then to be identified by the respective adaptation algorithm. The second breakdown can, at least in theory, be avoided because solutions for both plane waves were already found separately. Hence, this breakdown only depends on how much of the solution for the first plane wave an algorithm “forgets” to obtain a solution for the second plane wave.

As cost for the reduced misalignment shown in the lower plot, the modified GFDAF shows a slightly slower increasing ERLE during the first five seconds. However, whenever the source activity changes, there is a somewhat lower breakdown in ERLE for the modified GFDAF. Additionally, the modified GFDAF shows a larger steady state ERLE, compared to the original GFDAF. This is due to the fact that both algorithms were approximated and only an exact implementation of (53) would be guaranteed to reach the global optimum e.g. maximize ERLE. So both algorithms converge to a local minimum and the lower misalignment of the modified GFDAF is an advantage, as it denotes a lower distance to the perfect solution, which is a global optimum.

In the lower part of FIG. 7, it can be clearly seen that the modified GFDAF outperforms the original GFDAF regarding the normalized misalignment. The relatively low absolute performance of both algorithms is not surprising as the identification of the LEMS is a severely underdetermined problem in the given scenario, according to (21). Evaluating (23) we obtain only −0.2 dB as a lower bound for the normalized misalignment in this scenario. From this we can see that the original GFDAF can exploit almost all information provided by the observed signals when achieving −0.16 dB. The reduction of the misalignment by additional 1.4 dB by the modified version can be accounted to the information provided by the wave-domain assumptions on {tilde over (H)}(n). As the misalignment is relatively high for both approaches, no correlation with the results for the ERLE can be seen.

For the comparison with a conventional AEC we repeated the same experiment using T₁=I and T₂=I with the respective dimensions and the original GFDAF. As the obtained results almost perfectly coincide with the results for wave-domain AEC with the original GFDAF, they are not shown in FIG. 7. This behaviour is remarkable as the conclusion may be drawn that a transformation of the used signal representations to the wave-domain alone does not automatically lead to a different convergence behaviour. Nevertheless, using WDAF is still advantageous regardless of the used adaptation algorithm, as the computational effort for adaptation can be concluded by an approximative LEMS model.

In the following, results for two experiments with suboptimal conditions are presented to show the gain in robustness of the concepts provided by embodiments.

Up to now the experiments were conducted under almost optimal conditions, e.g., in absence of noise or interferences in the microphone signal and using a nearly optimum initialization value for S(0). In this section we present results for documenting the robustness of the proposed approach with two different experiments under suboptimal conditions.

At first, the experiment of the previous subsection was repeated, starting the adaptation with an suboptimal initialization value S(0)={circumflex over (σ)}I/10000. Such an suboptimal choice is more realistic because the chosen initialization value for S(n) used in the previous section depends on knowledge which is not available in practice. The results for this experiment are depicted in FIG. 8.

The ERLE curves show for both approaches a slower convergence in the first 5 seconds compared to the previous experiment, although the modified GFDAF is less affected in this regard. After the transition, the difference between both algorithms becomes even more evident. While the modified GFDAF only shows a short breakdown in ERLE, the original GFDAF takes significantly longer to recover. Moreover, the original GFDAF shows a significantly lower steady state ERLE than the modified version during the entire experiment. Considering the achieved misalignment for both approaches, this behavior can be explained: The original GFDAF suffers from a bad initial convergence and cannot recover throughout the whole experiment, while the modified GFDAF is only slightly affected.

In the second experiment short impulses (50 ms) of noise were introduced into the microphone signal, leading to two adaptation steps in the presence of an interfering signal. This experiment was chosen because in practice an undetected double-talk situation may also lead to an adaptation in the presence of an interfering signal and double-talk detectors are usually not perfectly reliable. Although the signals used here differ significantly from the signals present in practice, the effect on the convergence behaviour of the adaptation algorithms can be expected to be similar. The interfering signal used was generated by convolving a single white noise signal with impulse responses measured for the considered microphone array in a completely different setup. This was done to model an interferer recorded by the microphone array rather than an interference taking effect on the microphone signals directly. The noise power was chosen to be 6 dB relative to the unaltered microphone signal. The results for this experiment can be seen in FIG. 9. The timeline for this experiment differs from the previous ones. We introduced the noise interferences at t=5 s and t=15 s. From the beginning to t=25 s the first plane wave (φ₁=0) was synthesized and from t=25 s until the end the second plane wave ((φ₂=π/2) was synthesized. It can be seen that both algorithms are equally affected by the impulsive noise. However, in contrast to the original GFDAF, the modified GFDAF shows a significantly larger ERLE when having recovered from the disturbances. The difference in behavior is even more evident, when there is a transition between both waves. There, the original GFDAF shows a pronounced breakdown in ERLE while the modified GFDAF can recover quickly. Again, the normalized misalignment may be used to explain the observed behaviour. It can be clearly seen that the original GFDAF shows a growing misalignment with every disturbance while the modified GFDAF is not sensitive to this interference.

Adaptation algorithms based on robust statistics (see [24]) could also be used to increase robustness in such a scenario. However, as they only use the information provided by the observed signals, they can be expected to principally show the same behaviour as the original GFDAF, although the misalignment introduced by the interferences should be smaller.

Improved concepts for AEC in the wave domain maintaining robustness in the presence of the nonuniqueness problem have been presented.

It has been shown that the nonuniqueness problem is typically highly relevant for AEC in combination with massive multichannel reproduction systems. Considering a concentric setup of a circular loudspeaker array and a circular microphone array, it was shown that the spatial DFT can be used as transform to the wave domain. Using a model based on these transforms, distinct properties of the LEMS model were investigated. A modified version of the GFDAF was presented to exploit these properties in order to significantly reduce the consequences of the nonuniqueness problem. Results from an experimental evaluation support the claim of an increased robustness and showed an improved system description performance.

Although some aspects have been described in the context of an apparatus, it is clear that these aspects also represent a description of the corresponding method, where a block or device corresponds to a method step or a feature of a method step. Analogously, aspects described in the context of a method step also represent a description of a corresponding block or item or feature of a corresponding apparatus.

Depending on certain implementation requirements, embodiments of the invention can be implemented in hardware or in software. The implementation can be performed using a digital storage medium, for example a floppy disk, a DVD, a CD, a ROM, a PROM, an EPROM, an EEPROM or a FLASH memory, having electronically readable control signals stored thereon, which cooperate (or are capable of cooperating) with a programmable computer system such that the respective method is performed.

Some embodiments according to the invention comprise a data carrier having electronically readable control signals, which are capable of cooperating with a programmable computer system, such that one of the methods described herein is performed.

Generally, embodiments of the present invention can be implemented as a computer program product with a program code, the program code being operative for performing one of the methods when the computer program product runs on a computer. The program code may for example be stored on a machine readable carrier.

Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier or a non-transitory storage medium.

In other words, an embodiment of the inventive method is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.

A further embodiment of the inventive methods is, therefore, a data carrier (or a digital storage medium, or a computer-readable medium) comprising, recorded thereon, the computer program for performing one of the methods described herein.

A further embodiment of the inventive method is, therefore, a data stream or a sequence of signals representing the computer program for performing one of the methods described herein. The data stream or the sequence of signals may for example be configured to be transferred via a data communication connection, for example via the Internet.

A further embodiment comprises a processing means, for example a computer, or a programmable logic device, configured to or adapted to perform one of the methods described herein.

A further embodiment comprises a computer having installed thereon the computer program for performing one of the methods described herein.

In some embodiments, a programmable logic device (for example a field programmable gate array) may be used to perform some or all of the functionalities of the methods described herein. In some embodiments, a field programmable gate array may cooperate with a microprocessor in order to perform one of the methods described herein. Generally, the methods may be performed by any hardware apparatus.

While this invention has been described in terms of several embodiments, there are alterations, permutations, and equivalents which will be apparent to others skilled in the art and which fall within the scope of this invention. It should also be noted that there are many alternative ways of implementing the methods and compositions of the present invention. It is therefore intended that the following appended claims be interpreted as including all such alterations, permutations, and equivalents as fall within the true spirit and scope of the present invention.

LITERATURE

• [1] A. Berkhout, D. De Vries, and P. Vogel, “Acoustic control by wave field synthesis”, J. Acoust. Soc. Am. 93, 2764-2778 (1993).
• [2] J. Daniel, “Spatial sound encoding including near field effect: Introducing distance coding filters and a variable, new ambisonic format”, in 23rd International Conference of the Audio Eng. Soc. (2003).
• [3] M. Sondhi and D. Berkley, “Silencing echoes on the telephone network”, Proceedings of the IEEE 68, 948-963 (1980).
• [4] B. Kingsbury and N. Morgan, “Recognizing reverberant speech with RASTA-PLP”, in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), volume 2, 1259-1262 (Munich, Germany) (1997).
• [5] M. Sondhi, D. Morgan, and J. Hall, “Stereophonic acoustic echo cancellation—an overview of the fundamental problem”, IEEE Signal Process. Lett. 2, 148-151 (1995).
• [6] J. Benesty, D. Morgan, and M. Sondhi, “A better understanding and an improved solution to the specific problems of stereophonic acoustic echo cancellation”, IEEE Trans. Speech Audio Process. 6, 156-165 (1998).
• [7] A. Gilloire and V. Turbin, “Using auditory properties to improve the behaviour of stereophonic acoustic echo cancellers”, in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), volume 6, 3681-3684 (Seattle, Wash.) (1998).
• [8] T. Gänsler and P. Eneroth, “Influence of audio coding on stereophonic acoustic echo cancellation”, in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), volume 6, 3649-3652 (Seattle, Wash.) (1998).
• [9] D. Morgan, J. Hall, and J. Benesty, “Investigation of several types of nonlinearities for use in stereo acoustic echo cancellation”, IEEE Trans. Speech Audio Process. 9, 686-696 (2001).
• [10] M. Ali, “Stereophonic acoustic echo cancellation system using time-varying all-pass filtering for signal decorrelation”, in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), volume 6, 3689-3692 (Seattle, Wash.) (1998).
• [11] J. Herre, H. Buchner, and W. Kellermann, “Acoustic echo cancellation for surround sound using perceptually motivated convergence enhancement”, in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), volume 1, 1-17-1-20 (Honolulu, Hi.) (2007).
• [12] S. Shimauchi and S. Makino, “Stereo echo cancellation algorithm using imaginary input-output relationships”, in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), volume 2, 941-944 (Atlanta, Ga.) (1996).
• [13] H. Buchner, S. Spors, and W. Kellermann, “Wave-domain adaptive filtering: acoustic echo cancellation for full duplex systems based on wave-field synthesis”, in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), volume 4, IV-117-IV-120 (Montreal, Canada) (2004).
• [14] H. Buchner, J. Benesty, and W. Kellermann, “Multichannel frequency-domain adaptive algorithms with application to acoustic echo cancellation”, in Adaptive Signal Processing: Application to Real-World Problems, edited by J. Benesty and Y. Huang (Springer, Berlin) (2003).
• [15] H. Buchner and S. Spors, “A general derivation of wave-domain adaptive filtering and application to acoustic echo cancellation”, in Asilomar Conference on Signals, Systems, and Computers, 816-823 (2008).
• [16] Y. Huang, J. Benesty, and J. Chen, Acoustic MIMO Signal Processing (Springer, Berlin) (2006).
• [17] C. Breining, P. Dreiseitel, E. Hinsler, A. Mader, B. Nitsch, H. Puder, T. Schertler, G. Schmidt, and J. Tilp, “Acoustic echo control: An application of very-high-order adaptive filters”, IEEE Signal Process. Mag. 16, 42-69 (1999).
• [18] S. Spors, H. Buchner, R. Rabenstein, and W. Herbordt, “Active listening room compensation for massive multichannel sound reproduction systems using wave-domain adaptive filtering”, J. Acoust. Soc. Am. 122, 354-369 (2007).
• [19] H. Teutsch, Modal Array Signal Processing: Principles and Applications of Acoustic Wavefield Decomposition (Springer, Berlin) (2007).
• [20] P. Morse and H. Feshbach, Methods of Theoretical Physics (McGraw-Hill, New York) (1953).
• [21] C. Balanis, Antenna Theory (Wiley, New York) (1997).
• [22] M. Abramovitz and I. Stegun, Handbook of Mathematical Functions (Dover, New York) (1972).
• [23] M. Schneider and W. Kellermann, “A wave-domain model for acoustic MIMO systems with reduced complexity”, in Third Joint Workshop on Hands-free Speech Communication and Microphone Arrays (HSCMA) (Edinburgh, UK) (2011).
• [24] H. Buchner, J. Benesty, T. Gänsler, and W. Kellermann, “Robust Extended Multidelay Filter and Double-Talk Detector for Acoustic Echo Cancellation”, IEEE Trans. Audio, Speech, Language Process. 14, 1633-1644 (2006).
• [25] S. Goetze, M. Kallinger, A. Mertins, and K. D. Kammeyer, “Multichannel listening-room compensation using a decoupled filtered-X LMS algorithm,” in Proc. Asilomar Conference on Signals, Systems, and Computers, October 2008, pp. 811-815.
• [26] O. Kirkeby, P. A. Nelson, H. Hamada, and F. Orduna-Bustamante, “Fast deconvolution of multichannel systems using regularization,” Speech and Audio Processing, IEEE Transactions on, vol. 6, no. 2, pp. 189-194, March 1998.
• [27] Spors, S.; Buchner, H.; Rabenstein, R.: A novel approach to active listening room compensation for wave field synthesis using wave-domain adaptive filtering. In: Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP) Bd. 4, 2004.—ISSN 1520-6149, S. IV-29-IV-32.
• [28] Spors, S.; Buchner, H.: Efficient massive multichannel active noise control using wave-domain adaptive filtering. In: Communications, Control and Signal Processing, 2008. ISCCSP 2008. 3rd International Symposium on IEEE, 2008, S. 1480-1485.

Claims (20)

The invention claimed is:

1. An apparatus for providing a current loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system, wherein the loudspeaker-enclosure-microphone system comprises a plurality of loudspeakers and a plurality of microphones, and wherein the apparatus comprises:

a first transformation unit for generating a plurality of wave-domain loudspeaker audio signals, wherein the first transformation unit is configured to generate each of the wave-domain loudspeaker audio signals based on a plurality of time-domain loudspeaker audio signals and based on one or more of a plurality of loudspeaker-signal-transformation values, said one or more of the plurality of loudspeaker-signal-transformation values being assigned to said generated wave-domain loudspeaker audio signal,

a second transformation unit for generating a plurality of wave-domain microphone audio signals, wherein the second transformation unit is configured to generate each of the wave-domain microphone audio signals based on a plurality of time-domain microphone audio signals and based on one or more of a plurality of microphone-signal-transformation values, said one or more of the plurality of microphone-signal-transformation values being assigned to said generated wave-domain loudspeaker audio signal, and

a system description generator for generating the current loudspeaker-enclosure-microphone system description based on the plurality of wave-domain loudspeaker audio signals, and based on the plurality of wave-domain microphone audio signals,

wherein the system description generator is configured to generate the current loudspeaker-enclosure-microphone system description based on a plurality of coupling values,

wherein each of the plurality of coupling values is assigned to one of a plurality of wave-domain pairs, each of the plurality of wave-domain pairs being a pair of one of the plurality of loudspeaker-signal-transformation values and one of the plurality of microphone-signal-transformation values,

wherein the system description generator is configured to determine each coupling value assigned to a wave-domain pair of the plurality of wave-domain pairs by determining for said wave-domain pair at least one relation indicator indicating a relation between said one of the one or more loudspeaker-signal-transformation values of said wave-domain pair and said one of the microphone-signal-transformation values of said wave-domain pair to generate the current loudspeaker-enclosure-microphone system description.

2. The apparatus according to claim 1,

wherein the system description generator comprises a system description application unit, an error determiner and a system description generation unit,

wherein the system description application unit is configured to generate a plurality of wave-domain microphone estimation signals based on the wave-domain loudspeaker audio signals and based on a previous loudspeaker-enclosure-microphone system description of the loudspeaker-enclosure-microphone system,

wherein the error determiner is configured to determine a plurality of wave-domain error signals based on the plurality of wave-domain microphone audio signals and based on the plurality of wave-domain microphone estimation signals,

wherein the system description generation unit is configured to generate the current loudspeaker-enclosure-microphone system description based on the wave-domain loudspeaker audio signals, based on the plurality of error signals and based on the plurality of coupling values.

3. The apparatus according to claim 2,

wherein the first transformation unit is configured to generate each of the wave-domain loudspeaker audio signals based on the plurality of time-domain loudspeaker audio signals and based on the one or more of the plurality of loudspeaker-signal-transformation values, wherein the plurality of loudspeaker-signal-transformation values is a plurality of loudspeaker-signal-transformation mode orders,

wherein the second transformation unit is configured to generate each of the wave-domain microphone audio signals based on the plurality of time-domain microphone audio signals and based on the one or more of the plurality of microphone-signal-transformation values, wherein the plurality of microphone-signal-transformation values is a plurality of microphone-signal-transformation mode orders, and

wherein the system description generation unit is configured to generate the loudspeaker-enclosure-microphone system description based on a first coupling value of the plurality of coupling values, when a first relation value indicating a first difference between a first loudspeaker-signal-transformation mode order of the plurality of loudspeaker-signal-transformation mode orders and a first microphone-signal-transformation mode order of the plurality of microphone-signal mode orders comprises a first difference value,

wherein the system description generation unit is configured to assign the first coupling value to a first wave-domain pair of the plurality of wave-domain pairs, when the first relation value comprises the first difference value,

wherein the first wave-domain pair is a pair of the first loudspeaker-signal-transformation mode order and the first microphone-signal-transformation mode order, and wherein the first relation value is one of the plurality of relation indicators, and

wherein the system description generation unit is configured to generate the loudspeaker-enclosure-microphone system description based on a second coupling value of the plurality of coupling values, when a second relation value indicating a second difference between a second loudspeaker-signal-transformation mode order of the plurality of loudspeaker-signal-transformation mode orders and a second microphone-signal-transformation mode order of the plurality of microphone-signal-transformation mode orders comprises a second difference value, being different from the first difference value,

wherein the system description generation unit is configured to assign the second coupling value to the second wave-domain pair of the plurality of wave-domain pairs, when the second relation value comprises the second difference value,

wherein the second wave-domain pair is a pair of the second loudspeaker-signal-transformation mode order of the plurality of loudspeaker-signal-transformation mode orders and the second microphone-signal-transformation mode order of the plurality of microphone-signal-transformation mode orders,

wherein the second wave-domain pair is different from the first wave-domain pair, and

wherein the second relation value is one of the plurality of relation indicators.

4. The apparatus according to claim 3,

wherein the system description generation unit is configured to generate the current loudspeaker-enclosure-microphone system description based on the first coupling value of the first wave-domain pair, when the first loudspeaker-signal-transformation mode order is equal to the first microphone-signal-transformation mode order, and

wherein the system description generation unit is configured to generate the current loudspeaker-enclosure-microphone system description based on the second coupling value of the second wave-domain pair, when the second loudspeaker-signal-transformation mode order is not equal to the second microphone-signal-transformation mode order.

5. The apparatus according to claim 3,

wherein the system description generation unit is configured to generate the current loudspeaker-enclosure-microphone system description based on the first coupling value of the first wave-domain pair, when the first loudspeaker-signal-transformation mode order is equal to the first microphone-signal-transformation mode order,

wherein the system description generation unit is configured to generate the current loudspeaker-enclosure-microphone system description based on the second coupling value of the second wave-domain pair, when the second loudspeaker-signal-transformation mode order is not equal to the second microphone-signal-transformation mode order, and when the absolute difference between the second loudspeaker-signal-transformation mode order and the second microphone-signal-transformation mode order is smaller than or equal to a predefined threshold value, and

wherein the system description generation unit is configured to generate the current loudspeaker-enclosure-microphone system description based on a third coupling value of a third wave-domain pair being a pair of a third loudspeaker-signal-transformation mode order of the plurality of loudspeaker-signal-transformation mode orders and a third microphone-signal-transformation mode order of the plurality of microphone-signal-transformation mode orders, when the third loudspeaker-signal-transformation mode order is not equal to the third microphone-signal-transformation mode order, and when an absolute difference between the third loudspeaker-signal-transformation mode order and the third microphone-signal-transformation mode order is greater than the predefined threshold value.

6. The apparatus according to claim 5,

wherein the first coupling value is a first number β₁, wherein the second coupling value is a second value β₂, wherein 0<β₁<β₂≤1 0≤β₁<β2≤1, and wherein the third coupling value is 1.0.

7. The apparatus according to claim 3,

wherein the system description generation unit is configured to generate a current loudspeaker-enclosure-microphone system description matrix based on a previous loudspeaker-enclosure-microphone system description matrix, wherein the previous loudspeaker-enclosure-microphone system description matrix represents the previous loudspeaker-enclosure-microphone system description, and wherein the current loudspeaker-enclosure-microphone system description matrix represents the current loudspeaker-enclosure-microphone system description.

8. The apparatus according to claim 7,

wherein the system description generation unit is configured to generate the current loudspeaker-enclosure-microphone system description matrix based on the previous loudspeaker-enclosure-microphone system description matrix,

wherein the current loudspeaker-enclosure-microphone system description matrix comprises a plurality of current matrix components {tilde over (h)} _m(n) {tilde over (h)} _m(n), wherein the previous loudspeaker-enclosure-microphone system description matrix comprises a plurality of previous matrix components {tilde over (h)} _m(n) {tilde over (h)} _m(n−1), and

wherein the system description generation unit is configured to determine the current matrix components {tilde over (h)} _m(n) {tilde over (h)} _m(n) according to the formula

{tilde over (h)} _m(n)={tilde over (h)} _m(n−1)+(1−λ_a)(S(n)+C _m(n))⁻¹·(W ₁₀ ^H X ^H(n)W ₀₁ ^H {tilde over (e)} _m(n)−C _m(n){tilde over (h)} _m(n−1)) {tilde over (h)} _m(n)={tilde over (h)} _m(n−1)+(1−λ_a)(S(n)+C _m(n))⁻¹·(W ₁₀ ^H X ^H(n)W ₀₁ ^H {tilde over (e)} _m(n)−C _m(n){tilde over (h)} _m(n−1)),

wherein C _m(n) C _m(n) is a coupling matrix, comprising a plurality of coupling matrix coefficients,

wherein X ^H(n) X ^H(n) is the conjugate transpose matrix of loudspeaker signal matrix X(n) X(n),

wherein X(n) X(n) is a loudspeaker signal matrix depending on the plurality of wave-domain loudspeaker audio signals,

wherein W₀₁ W₀₁ is a first windowing matrix for time-domain windowing,

wherein W₁₀ W₁₀ is a second windowing matrix for time-domain windowing, and wherein the system description generation unit is configured to determine the matrix S(n) S(n) according to the formula

S(n)=λ_a S(n−1)+(1−λ_a)W ₁₀ ^H X ^H(n)W ₀₁ ^H W ₀₁ X(n)W ₁₀,

wherein λ_a is a number, wherein 0≤λ_a<1.

9. The apparatus according to claim 8,

wherein the weighting function ω_c is defined by the formula

$w_c\left(n\right)=\frac{\sum _{m=0}^{N_M-1}{J}_m\left(n-1\right)}{\max \left\{\sum _{m=0}^{N_M-1}{\underset{\_}{\tilde{h}}}_m^H\left(n-1\right)\underset{\_}{\tilde{h}}\left(n-1\right),1\right\}},\mathrm{wherein}$ $J_m\left(n\right)=\left(1-{\lambda }_a\right)\sum _{i=0}^n{\lambda }_a^{n-i}{\underset{\_}{\tilde{e}}}_m^H\left(i\right){\underset{\_}{\tilde{e}}}_m\left(i\right),$

wherein {tilde over (e)} _m ^H(i) represents the conjugate transpose of {tilde over (e)} _m ^H(i), and wherein {tilde over (e)} _m ^H(i) indicates one of the plurality of error signals.

10. The apparatus according to claim 8,

wherein the coupling matrix C _m(n) is defined by the formula

C _m(n)=β₀ω_c(n)Diag{c₀(n),c₁(n), . . . ,c_{N L L H −1}(n)},

wherein Diag{c₀(n), c₁(n), . . . c_{N L L H −1}(n)} indicates a diagonal matrix,

wherein c₀(n) is the first coupling value or the second coupling value indicated by the coupling information or another coupling value, being different from the first and the second coupling value, and being indicated by the coupling information,

wherein c₁(n) is the first coupling value or the second coupling value indicated by the coupling information or another coupling value, being different from the first and the second coupling value, and being indicated by the coupling information,

wherein c_{N L L H −1}(n) is the first coupling value or the second coupling value indicated by the coupling information or another coupling value, being different from the first and the second coupling value, and being indicated by the coupling information,

wherein β₀ is a scale parameter, wherein 0≤β₀,

wherein ω_c(n) is a weighting function returning a number which is greater than 0, and

wherein n is a time index.

11. The apparatus according to claim 10,

wherein the system description generation unit is configured to determine the coupling matrix C _m(n) defined by the formula

C _m(n)=β₀ω_c(n)Diag{c₀(n),c₁(n), . . . ,c_{N L L H −1}(n)},

wherein c₀(n), c₁(n), . . . , c_{N L L H −1}(n) are defined by:

$\begin{array}{cc}{c}_q\left(n\right)=\{\begin{array}{cc}{\beta }_1& \mathrm{when}\Delta m\left(q\right)=0,\\ {\beta }_2& \mathrm{when}\Delta m\left(q\right)=1,\\ 1& \mathrm{elsewhere},\end{array}& \left(60\right)\end{array}$

wherein 0≤β₁<β₂≤1,

wherein β₁ is the first coupling value,

wherein β₂ is the second coupling value,

wherein q indicates the first wave-domain pair, the second wave-domain pair or a different wave-domain pair of one of the plurality of loudspeaker-signal-transformation mode orders and one of the plurality of microphone-signal-transformation mode orders, and

wherein Δm(q) is a relation indicator of said wave-domain pair q, wherein Δm(q) indicates a difference between the loudspeaker-signal-transformation mode order of said wave-domain pair q and the microphone-signal-transformation mode order of said wave-domain pair q.

12. The apparatus according to claim 11,

wherein Δm(q) is defined by the formula:

Δm(q)=min(|└q/L_H┘−m|,|└q/L_H┘−m−N_L) Δm(q)=min(|└q/L_H┘−m|,|└q/L_H┘−m−N_L),

wherein m indicates one of the plurality of microphone-signal-transformation mode orders,

wherein N_L indicates the number of loudspeakers of the loudspeaker enclosure microphone system, and

wherein L_H indicates a length of the discrete-time impulse response of the loudspeaker-enclosure-microphone system from one of the plurality of loudspeakers of the loudspeaker-enclosure-microphone system to one of the microphones of the loudspeaker-enclosure-microphone system.

13. The apparatus according to claim 3,

wherein the first transformation unit is configured to generate the plurality of wave-domain loudspeaker audio signals by employing the formula

$\sum _{\lambda =0}^{N_L-1}{\hat{P}}_{\lambda }^{\left(x\right)}\left(j\omega \right)e^{-j{l}^{\prime }\lambda \frac{2\pi }{N_L}}$

wherein N_L indicates the number of loudspeakers of the loudspeaker-enclosure-microphone system,

wherein l′ indicates one of the plurality of loudspeaker-signal-transformation mode orders, and

wherein {circumflex over (P)}_λ ^(x)(jω) indicates a spectrum of a sound field emitted by loudspeaker λ.

14. The apparatus according to claim 3,

wherein the second transformation unit is configured to generate the plurality of wave-domain microphone audio signals by employing the formula

$\sum _{\mu =0}^{N_M-1}{\hat{P}}_{\mu }^{\left(x\right)}\left(j\omega \right)e^{-j{m}^{\prime }\mu \frac{2\pi }{M}}$

wherein N_M indicates the number of microphones of the loudspeaker-enclosure-microphone system,

wherein m′ indicates one of the plurality of microphone-signal-transformation mode orders, and

wherein {circumflex over (P)}_μ ^(d)(jω) indicates a spectrum of a sound pressure measured by microphone μ.

15. A system, comprising:

a plurality of loudspeakers of a loudspeaker-enclosure-microphone system,

a plurality of microphones of the loudspeaker-enclosure-microphone system, and

an apparatus according to claim 1,

wherein the plurality of loudspeakers are arranged to receive a plurality of loudspeaker input signals,

wherein the apparatus according to claim 1 is arranged to receive the plurality of loudspeaker input signals,

wherein the plurality of microphones are configured to record a plurality of microphone input signals,

wherein the apparatus according to claim 1 is arranged to receive the plurality of microphone input signals, and

wherein the apparatus according to claim 1 is configured to adjust a loudspeaker-enclosure-microphone system description based on the received loudspeaker input signals and based on the received microphone input signals.

16. A system for generating filtered loudspeaker signals for a plurality of loudspeakers of a loudspeaker-enclosure-microphone system, wherein the system comprises:

a filter unit, and

an apparatus according to claim 1,

wherein the apparatus according to claim 1 is configured to provide a current loudspeaker-enclosure-microphone system description of the loudspeaker-enclosure-microphone system to the filter unit,

wherein the filter unit is configured to adjust a loudspeaker signal filter based on the current loudspeaker-enclosure-microphone system description to achieve an adjusted filter,

wherein the filter unit is arranged to receive a plurality of loudspeaker input signals, and

wherein the filter unit is configured to filter the plurality of loudspeaker input signals by applying the adjusted filter on the loudspeaker input signals to acquire the filtered loudspeaker signals.

17. A method for providing a current loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system, wherein the loudspeaker-enclosure-microphone system comprises a plurality of loudspeakers and a plurality of microphones, and wherein the method comprises:

generating a plurality of wave-domain loudspeaker audio signals by generating each of the wave-domain loudspeaker audio signals based on a plurality of time-domain loudspeaker audio signals and based on one or more of a plurality of loudspeaker-signal-transformation values, said one or more of the plurality of loudspeaker-signal-transformation values being assigned to said generated wave-domain loudspeaker audio signal,

generating a plurality of wave-domain microphone audio signals by generating each of the wave-domain microphone audio signals based on a plurality of time-domain microphone audio signals and based on one or more of a plurality of microphone-signal-transformation values, said one or more of the plurality of microphone-signal-transformation values being assigned to said generated wave-domain loudspeaker audio signal, and

generating the current loudspeaker-enclosure-microphone system description based on the plurality of wave-domain loudspeaker audio signals, and based on the plurality of wave-domain microphone audio signals,

wherein the current loudspeaker-enclosure-microphone system description is generated based on a plurality of coupling values, wherein each of the plurality of coupling values is assigned to one of a plurality of wave-domain pairs, each of the plurality of wave-domain pairs being a pair of one of the plurality of loudspeaker-signal-transformation values and one of the plurality of microphone-signal-transformation values,

wherein each coupling value assigned to a wave-domain pair of the plurality of wave-domain pairs is determined by determining for said wave-domain pair at least one relation indicator indicating a relation between said one of the one or more loudspeaker-signal-transformation values of said wave-domain pair and said one of the microphone-signal-transformation values of said wave-domain pair to generate the current loudspeaker-enclosure-microphone system description.

18. A method for determining at least two filter configurations of a loudspeaker signal filter for at least two different loudspeaker-enclosure-microphone system states, wherein the loudspeaker signal filter is arranged to filter a plurality of loudspeaker input signals to acquire a plurality of filtered loudspeaker signals for steering a plurality of loudspeakers of a loudspeaker-enclosure-microphone system, wherein the method comprises:

determining a first loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system according to the method of claim 17, when the loudspeaker-enclosure-microphone system comprises a first state,

determining a first filter configuration of the loudspeaker signal filter based on the first loudspeaker-enclosure-microphone system description,

storing the first filter configuration in a memory,

determining a second loudspeaker-enclosure-microphone system description of the loudspeaker-enclosure-microphone system according to the method of claim 17, when the loudspeaker-enclosure-microphone system second comprises a second state,

determining a second filter configuration of the loudspeaker signal filter based on the second loudspeaker-enclosure-microphone system description, and

storing the second filter configuration in the memory.

19. A non-transitory computer-readable medium comprising a computer program for implementing when being executed by a computer or processor a method for providing a current loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system, wherein the loudspeaker-enclosure-microphone system comprises a plurality of loudspeakers and a plurality of microphones, and wherein the method comprises:

generating a plurality of wave-domain loudspeaker audio signals by generating each of the wave-domain loudspeaker audio signals based on a plurality of time-domain loudspeaker audio signals and based on one or more of a plurality of loudspeaker-signal-transformation values,

said one or more of the plurality of loudspeaker-signal-transformation values being assigned to said generated wave-domain loudspeaker audio signal, and

generating a plurality of wave-domain microphone audio signals by generating each of the wave-domain microphone audio signals based on a plurality of time-domain microphone audio signals and based on one or more of a plurality of microphone-signal-transformation values, and

generating the current loudspeaker-enclosure-microphone system description based on the plurality of wave-domain loudspeaker audio signals, and based on the plurality of wave-domain microphone audio signals,

wherein the current loudspeaker-enclosure-microphone system description is generated based on a plurality of coupling values,

wherein each of the plurality of coupling values is assigned to one of a plurality of wave-domain pairs, each of the plurality of wave-domain pairs being a pair of one of the plurality of loudspeaker-signal-transformation values and one of the plurality of microphone-signal-transformation values,

wherein each coupling value assigned to a wave-domain pair of the plurality of wave-domain pairs is determined by determining for said wave-domain pair at least one relation indicator indicating a relation between said one of the one or more loudspeaker-signal-transformation values of said wave-domain pair and said one of the microphone-signal-transformation values of said wave-domain pair to generate the loudspeaker-enclosure-microphone system description.

20. A non-transitory computer-readable medium comprising a computer program for implementing when being executed by a computer or processor a method for determining at least two filter configurations of a loudspeaker signal filter for at least two different loudspeaker-enclosure-microphone system states, wherein the loudspeaker signal filter is arranged to filter a plurality of loudspeaker input signals to acquire a plurality of filtered loudspeaker signals for steering a plurality of loudspeakers of a loudspeaker-enclosure-microphone system, wherein the method comprises:

determining a first loudspeaker-enclosure-microphone system description of a loudspeaker-enclosure-microphone system according to the method of claim 17, when the loudspeaker-enclosure-microphone system comprises a first state,

determining a first filter configuration of the loudspeaker signal filter based on the first loudspeaker-enclosure-microphone system description,

storing the first filter configuration in a memory,

determining a second loudspeaker-enclosure-microphone system description of the loudspeaker-enclosure-microphone system according to the method of claim 17, when the loudspeaker-enclosure-microphone system second comprises a second state,

determining a second filter configuration of the loudspeaker signal filter based on the second loudspeaker-enclosure-microphone system description, and

storing the second filter configuration in the memory.

Images