EP4634624A1 - Obtention d'une réponse impulsionnelle d'une salle - Google Patents
Obtention d'une réponse impulsionnelle d'une salleInfo
- Publication number
- EP4634624A1 EP4634624A1 EP23818504.5A EP23818504A EP4634624A1 EP 4634624 A1 EP4634624 A1 EP 4634624A1 EP 23818504 A EP23818504 A EP 23818504A EP 4634624 A1 EP4634624 A1 EP 4634624A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- velocity vector
- autoregressive
- moving average
- vector
- impulse response
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
- G01H7/00—Measuring reverberation time ; room acoustic measurements
Definitions
- each HOA channel can be recorded by specific devices (most often spherical microphone arrays called “SMA” for “Spherical Microphone Arrays”) or created artificially.
- SMA spherical microphone arrays
- each HOA channel admits a particular room impulse response (denoted “RIR” for “Room Impulse Response”).
- RIR responses provide information about the environment where the sound propagates, particularly in the first part of the responses (i.e. in the “first echoes”).
- RIRs are linked to the (unknown) source signal and, on the other hand, the recording may be contaminated by noise.
- ReTF relative transfer function
- ReIR relative impulse response
- the generalized ReIR is causal and relatively sparse, and therefore allows an estimation, based on the peak of the direction of arrival of the sound (denoted DoA), of the directions of the acoustic reflections and their associated delays.
- DoA the direction of arrival of the sound
- the GTVV vector i.e. therefore the ReIR in the ambisonic domain with beamforming
- the ReIR in the ambisonic domain with beamforming is more robust to unfavorable acoustic conditions than the “standard” ReIR for which the reference signal is generally the zero-order omnidirectional ambisonic channel.
- it is limited by the performance of the applied beamforming. For example, if maximum directivity and signal-independent beamforming is used, its directivity is a quadratic function of the given HOA order.
- conventional SMA microphone devices generally do not provide sufficiently high-order ambisonic formats: most often, they are only capable of recording first-order ambisonic (FOA) signals. This is especially true for simple devices, e.g. handheld devices, supporting FOA only. Furthermore, the frequency support of higher-order channels gradually decreases with HOA order, as noise amplification at low frequencies and spatial aliasing phenomenon at high frequencies begin to manifest. [0008] However, the favorable theoretical properties of the GTVV vector tend to decrease at low ambisonic orders, due to the inability of beamforming to effectively suppress reflections.
- the expression in the time domain of the generalized velocity vector is modeled by an autoregressive moving average ARMA defined by an autoregressive filter AR and a moving average MA, and the method then includes processing of the sound signals acquired by application of the autoregressive filter AR, to obtain an impulse response characterizing said space and resulting from the moving average MA.
- the information stored in the representation of the generalized velocity vector expressed in the time domain (and denoted “GTVV” below), can be extracted in a more robust manner because it is more general for any acoustic situation.
- this impulse response can be described as “reduced” (and denoted “RdRIR” for "Reduced Room Impulse Response”) because the temporal expression of the generalized velocity vector, of which is deduced from this impulse response, only presents reflection delays relative to the reception delay at the microphone of the direct acoustic path from the source (and not delays in absolute terms). Likewise, the amplitudes of the reflections are relative to the amplitude of reception at the microphone of the direct sound (not reflected by a wall).
- this reduced impulse response RdRIR comes from the ARMA model, and is distinguished in this from the relative impulse response ReIR, introduced previously, and which is obtained directly from the expression of the generalized velocity vector.
- the acquired signals are applied to ambisonic channels, and the autoregressive filter AR is common to all the channels.
- Such an embodiment in ambisonic representation has the advantage of not requiring too high an ambisonic order (first orders or “FOA” for “First Order Ambisonic” which may be sufficient to obtain a satisfactory impulse response).
- the expression in the time domain of the generalized velocity vector comprises a series of peaks including a peak linked to the direct path (or "DoA" for "Direction of Arrival") followed by peaks each linked to at least one reflection on a wall n.
- the method then comprises: - optimizing the autoregressive filter to model said series of peaks in the form of a multivariate autoregressive moving average.
- the temporal representation of the generalized velocity vector presents itself well for modeling by a multivariate ARMA average.
- the method may include: - from the expression of the generalized velocity vector in the time domain v(t) in the form of said series of peaks, optimize the autoregressive filter by exploiting a property causality of an impulse response.
- the generalized velocity vector can be expressed in the time domain in the form: where and are causal filters representing respectively the moving average part MA and the regressive part AR of the ARMA model, and are linked by , for a beam formation w to be received by the microphone array and according to a direction of arrival of the sound from the sound source, and where: , ⁇ ⁇ ⁇ ]0,1[ and designate the parameters of an nth plane wave reflected by a wall n of space, ⁇ ⁇ being a directional encoding vector of propagation of the nth wave, ⁇ ⁇ being an attenuation relative of the nth wave and ⁇ ⁇ being a delay of the nth wave with respect to said direct path, ⁇ 0 being a propagation vector specific to the direct path, being a response of beam formations to the nth wavefront, with .
- the autoregressive part can then be estimated by minimizing: is a channel of the generalized velocity vector, represented by a multivariate ARMA model, the autoregressive part being common to all channels of the generalized velocity vector.
- the estimation by minimization of ⁇ amounts to solving a linear prediction system, which is advantageously overdetermined.
- the impulse response can be given by the moving average, such as: [0025]
- the temporal representation of the generalized velocity vector can have positive and negative amplitudes (as illustrated by way of example in FIG. 2), an amplitude sign correction can be applied to the moving average. to obtain the usual expression of the impulse response: in positive form.
- said impulse response is chosen to have a finite duration.
- This duration can be chosen in particular to avoid taking into account a diffuse reverberation field (typically multiple high order reflections which would appear on the far right of Figure 2) and thus only treat the early reflections on the wall(s). of the space considered.
- this property can be exploited according to which the aforementioned impulse response is of finite duration to set a maximum limit of filter length for the autoregressive part AR and for the moving average part MA.
- the moving average part MA can be centered on a delay corresponding to an instant of reception at the microphone of the sound coming from the source.
- the aim is a computer program comprising instructions for implementing the above method, when these instructions are executed by a processing circuit.
- a non-transitory recording medium readable by a computer, on which such a program is recorded.
- it is also aimed at a device comprising a processing circuit comprising an interface for receiving sound signal data acquired by a network of microphones, and configured to implement the above method.
- Figure 1 illustrates an example of succession of steps of a method of the type above
- Figure 2 illustrates an example of a temporal representation of the generalized velocity vector
- Figure 3 shows real examples of generalized velocity vectors (in the center) under different conditions, the corresponding ARMA representations (on the right), and the real impulse responses (on the left), the ARMA models being more faithful to the real impulse responses
- Figure 4 illustrates the performance of results obtained by the implementation of the above method compared to other treatments (or absence of treatment), respectively for different durations of sound reverberation cycles
- Figure 7 illustrates an error evaluation on the direction of arrival of the sound (DoA) only, under experimental conditions similar to those of Figures 4 to 6, showing a clearer performance of the implementation of the method above on the reflections in particular
- DoA direction of arrival of the sound
- ambisonic signals are generally transformed into a time-frequency representation (for example by STFT, for “Short-Time-Fourier-Transform”) beforehand, and a robust estimator is used to obtain the ReTF.
- STFT short-Time-Fourier-Transform
- the temporal form of the GTVV vector is presented for illustrative purposes in Figure 2 and shows: - a peak with zero delay and linked to the direct acoustic path, associated with the main DoA of the sound (for “Direction of Arrival” or “ direction of arrival”), and - peaks linked to greater delays and linked to reflections on partitions.
- the time footprint of the GTVV vector can be considered as the realization of a multivariate autoregressive moving average or “ARMA” process, where the autoregressive filter AR (in the denominator) is common to all the channels. Consequently, once the GTVV vector has been obtained, the calculations are carried out by estimating the parameters of the corresponding ARMA model.
- the AR filter is first estimated from the time series given by the GTVV vector as illustrated by way of example in Figure 2, taken from the aforementioned document WO-2022/106765, by exploiting the fact that the RIR responses are causal (as is the case for the AR and MA filters of the ARMA model).
- the maximum limit on the length of the AR and MA filters since the first part of the RIR is supposed to have a finite duration;
- an AR filter can be efficiently calculated by estimating a linear prediction model applied to the appropriate part of the GTVV fingerprint.
- the MA filters can be estimated by simply convolving the vector GTVV by the AR filter (an efficient estimation, of the Prony type for example), or by least squares estimation ( Shanks type estimation for example); here too, one can consider more advanced inference procedures, for example by applying a certain structure between the corresponding inputs of the MA filters.
- the MA filters should approximate the normalized RIR responses, the main peak of which is centered on the zero delay of the representation (invariant to absolute gain and delay, due to the loss of information in ReIR, as mentioned previously). Due to its similarity to RIRs, such a sequence of MA filters is called RdRIR for “Reduced Room Impulse Response”. In reality, RIR responses are considered to have positive amplitude and are continuous functions over time. When represented as a discrete (multi-channel) time series, RIR responses are pre-filtered by an anti-aliasing filter, which often exhibits an impulse response containing both positive and negative amplitudes.
- the principles presented can be adapted to standard (non-ambisonic) ReIR responses, for example, with the aim of estimating the time difference of arrival (or TdoA), by considering a pair of microphones recording the same source signal.
- TdoA time difference of arrival
- the mathematical description which follows covers the definition of the GTVV vector, the wavefront inference when the latter is theoretically valid (that is to say when the convergence condition explained below is satisfied), as well as the derivation of the “GTVV preconditioning” method based on ARMA and presented above.
- SH concatenated spherical harmonic expansion coefficients
- the recorded signals are assumed to be due to a far-field sound source at the azimuth, elevation and distance of the SMA microphone array, in an indoor environment (typically a partitioned room).
- the generalized velocity vector in the frequency domain is defined as follows, as described in particular in WO- 2022/106765: [0054] where, ⁇ ⁇ ⁇ ]0.1[ and designate the parameters of the nth plane wave reflected by a partition of the room, with: [0055], the expansion vector SH in the direction [0056] ⁇ ⁇ , its relative attenuation and [0057] ⁇ ⁇ , its delay (compared to the direct propagation component).
- Equation1 makes it possible to immediately estimate the wavefront of the direct sound by evaluating , while the rest involves the summation of the infinite series corresponding to the reflected wavefronts. [0068] But since, each infinite series has an amplitude which decreases with the temporal position of the peak: [0070] When beamforming is very selective, its response is .
- the GTVV vector can always be written in the form: where and are both causal filters, linked by [0080][0081] This expression reveals a particular structure (each GTVV channel can be seen as a realization of the multivariate ARMA model, whose autoregressive part is common to all channels). [0082]
- the MA part, or the series of the RdRIR (Reduced Room Impulse Response) response thus admits an expression of the type: [0083] Since , we can estimate by minimizing under the constraint [0084] [0085] This is advantageously an overdetermined problem: the length of the filter is , while the number of data points is (the non-causal part of the GTVV vector representation).
- Each result is the median estimate of 10 repetitions of the given simulation setup (i.e. for the given reverberation time and additive white Gaussian noise level).
- the experiments simulate a rectangular room of size 5 x 4 x 3 m 3 , with the microphone array and the voice source randomly positioned, but their distance being between 0.5 and 6 m.
- Figure 8 illustrates an example of a device for implementing the above method, and typically comprising: - an INT interface for receiving signals from a MIC microphone, for example ambisonic ( with several piezoelectric capsules for example), the microphone MIC being arranged in an ESP space comprising at least one PAR wall, - a PROC processor connected to the INT interface to process the signals received for example in ambisonic representation, express the generalized velocity vector in time as a function of these signals, and deduce the ARMA model to deliver an RdRIR impulse response from the ESP space, - a MEM memory storing instruction data of a computer program within the meaning of this description, and accessible by the PROC processor to read this data and execute the above process.
- a INT interface for receiving signals from a MIC microphone, for example ambisonic ( with several piezoelectric capsules for example)
- the microphone MIC being arranged in an ESP space comprising at least one PAR wall
- - a PROC processor connected to the INT interface to
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR2213494A FR3143932A1 (fr) | 2022-12-15 | 2022-12-15 | Obtention d’une réponse impulsionnelle d’une salle |
| PCT/EP2023/084655 WO2024126242A1 (fr) | 2022-12-15 | 2023-12-07 | Obtention d'une réponse impulsionnelle d'une salle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4634624A1 true EP4634624A1 (fr) | 2025-10-22 |
Family
ID=85222347
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP23818504.5A Pending EP4634624A1 (fr) | 2022-12-15 | 2023-12-07 | Obtention d'une réponse impulsionnelle d'une salle |
Country Status (4)
| Country | Link |
|---|---|
| EP (1) | EP4634624A1 (fr) |
| CN (1) | CN120883029A (fr) |
| FR (1) | FR3143932A1 (fr) |
| WO (1) | WO2024126242A1 (fr) |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11448728B2 (en) * | 2015-07-17 | 2022-09-20 | Origin Wireless, Inc. | Method, apparatus, and system for sound sensing based on wireless signals |
| FR3102325A1 (fr) * | 2019-10-18 | 2021-04-23 | Orange | Localisation perfectionnée d’une source acoustique |
| FR3116348A1 (fr) | 2020-11-19 | 2022-05-20 | Orange | Localisation perfectionnée d’une source acoustique |
-
2022
- 2022-12-15 FR FR2213494A patent/FR3143932A1/fr not_active Ceased
-
2023
- 2023-12-07 EP EP23818504.5A patent/EP4634624A1/fr active Pending
- 2023-12-07 WO PCT/EP2023/084655 patent/WO2024126242A1/fr not_active Ceased
- 2023-12-07 CN CN202380086141.7A patent/CN120883029A/zh active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| FR3143932A1 (fr) | 2024-06-21 |
| WO2024126242A1 (fr) | 2024-06-20 |
| CN120883029A (zh) | 2025-10-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2685053C2 (ru) | Оценка импульсной характеристики помещения для подавления акустического эха | |
| EP2898707B1 (fr) | Calibration optimisee d'un systeme de restitution sonore multi haut-parleurs | |
| Pezzoli et al. | Implicit neural representation with physics-informed neural networks for the reconstruction of the early part of room impulse responses | |
| EP3807669B1 (fr) | Localisation de sources sonores dans un environnement acoustique donné | |
| Xiao et al. | Speech dereverberation for enhancement and recognition using dynamic features constrained deep neural networks and feature adaptation | |
| KR101337677B1 (ko) | 희소 필터링에 의해 링크된 신호들의 분산 감지 | |
| EP4046390B1 (fr) | Localisation perfectionnee d'une source acoustique | |
| EP3895446B1 (fr) | Procede d'interpolation d'un champ sonore, produit programme d'ordinateur et dispositif correspondants. | |
| EP3040989B1 (fr) | Procédé de séparation amélioré et produit programme d'ordinateur | |
| EP4248231A1 (fr) | Localisation perfectionnée d'une source acoustique | |
| JP2023517202A (ja) | ターゲット音声分離のためのニューラルネットワークを用いたマルチタップ最小分散無歪応答ビームフォーマ | |
| EP3025342B1 (fr) | Procédé de suppression de la réverbération tardive d'un signal sonore | |
| Sharma et al. | Development of a speech separation system using frequency domain blind source separation technique | |
| Mitianoudis et al. | Audio source separation: Solutions and problems | |
| EP4315328B1 (fr) | Estimation d'un masque optimise pour le traitement de donnees sonores acquises | |
| WO2024126242A1 (fr) | Obtention d'une réponse impulsionnelle d'une salle | |
| FR3132960A1 (fr) | Localisation d’une source acoustique en mouvement | |
| JP2012048134A (ja) | 残響除去方法とその装置とプログラム | |
| FR3051959A1 (fr) | Procede et dispositif pour estimer un signal dereverbere | |
| Amerineni | Multi Channel Sub Band Wiener Beamformer | |
| JP2012048133A (ja) | 残響除去方法とその装置とプログラム |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20250610 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20260611 |