EP4184505B1 - Komplexitätsoptimierte klangraumisierung mit raumeffekt - Google Patents
Komplexitätsoptimierte klangraumisierung mit raumeffekt Download PDFInfo
- Publication number
- EP4184505B1 EP4184505B1 EP22211949.7A EP22211949A EP4184505B1 EP 4184505 B1 EP4184505 B1 EP 4184505B1 EP 22211949 A EP22211949 A EP 22211949A EP 4184505 B1 EP4184505 B1 EP 4184505B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- frequency
- signal
- transfer function
- room
- signals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000000694 effects Effects 0.000 title claims description 27
- 238000012546 transfer Methods 0.000 claims description 60
- 230000003595 spectral effect Effects 0.000 claims description 53
- 230000005236 sound signal Effects 0.000 claims description 15
- 230000001419 dependent effect Effects 0.000 claims 2
- 230000006870 function Effects 0.000 description 63
- 235000021183 entrée Nutrition 0.000 description 15
- 230000004044 response Effects 0.000 description 12
- 238000000034 method Methods 0.000 description 11
- 230000002123 temporal effect Effects 0.000 description 10
- 238000004364 calculation method Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 9
- 238000005070 sampling Methods 0.000 description 7
- 230000006835 compression Effects 0.000 description 6
- 238000007906 compression Methods 0.000 description 6
- 230000007423 decrease Effects 0.000 description 4
- 230000003447 ipsilateral effect Effects 0.000 description 4
- 238000012216 screening Methods 0.000 description 4
- 238000004590 computer program Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 2
- 210000005069 ears Anatomy 0.000 description 2
- 230000015654 memory Effects 0.000 description 2
- 230000000750 progressive effect Effects 0.000 description 2
- -1 ... Proteins 0.000 description 1
- 241001362574 Decodes Species 0.000 description 1
- 101000743788 Homo sapiens Zinc finger protein 92 Proteins 0.000 description 1
- 101100119449 Vaccinia virus (strain Tian Tan) TF1L gene Proteins 0.000 description 1
- 240000008042 Zea mays Species 0.000 description 1
- 102100039046 Zinc finger protein 92 Human genes 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 210000005246 left atrium Anatomy 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 210000005245 right atrium Anatomy 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
- 230000003936 working memory Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/307—Frequency adjustment, e.g. tone control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
- H04S7/306—For headphones
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K15/00—Acoustics not otherwise provided for
- G10K15/08—Arrangements for producing a reverberation or echo sound
- G10K15/12—Arrangements for producing a reverberation or echo sound using electronic time-delay networks
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/07—Synergistic effects of band splitting and sub-band processing
Definitions
- the present invention relates to sound spatialization with room effect.
- the invention finds an advantageous but non-limiting application to a processing of sound signals respectively coming from L channels associated with virtual speakers (for example in a multichannel representation, or even in an ambiophonic representation, of the sound to be reproduced), for spatialized restitution on real speakers (for example two earpieces of a headset in binaural reproduction, or two separate speakers in transaural reproduction).
- L channels associated with virtual speakers for example in a multichannel representation, or even in an ambiophonic representation, of the sound to be reproduced
- real speakers for example two earpieces of a headset in binaural reproduction, or two separate speakers in transaural reproduction.
- the signal from one of these channels can be processed to have a first contribution on the left atrium and a second contribution on the right atrium, in binaural reproduction, in particular by applying a transfer function with effect of room for each of these contributions.
- the application of these room effect transfer functions then helps to offer the listener a feeling of immersion allowing him to practically “locate in space” the virtual loudspeaker associated with this channel.
- Such an achievement advantageously makes it possible to apply a common processing to all the signals, which corresponds, in a physical reality, to a “mixing” of the acoustic waves as the reverberations progress, therefore beyond a given duration. (characterizing the beginning of the presence of the diffuse field). Such an achievement then makes it possible to reduce the complexity of spatialization processing with room effect on several initial channels.
- the document US2011/170721 A1 discloses a method of processing at least one input signal through a set of binaural filters such that the outputs can be played back on headphones to provide a sensation of listening to sound in a listening room via one or multiple virtual speakers.
- the channel signals are received in encoded form, by a compression decoder.
- This decoder sends the channel signals, once decoded, to a module spatialization for sound reproduction with room effect, on two speakers. It is then appropriate for this spatialization step (which follows the decoding of the received signals) to be of reduced processing complexity so as not to delay the overall set of decoding and spatialization steps upon reception of the signals before restitution.
- the present invention improves the situation.
- the invention proposes to reduce the complexity of the application of the room effect transfer function, in particular by reducing this complexity in the spectral domain.
- the convolution by a transfer function becomes a multiplication of spectral components of the signal on the one hand, and of a filter representing the transfer function on the other hand ( figure 1 commented in detail later).
- the invention then starts from the advantageous observation according to which, after direct propagation, a sound wave tends to attenuate in high frequencies due to progressive reflections on absorbing surfaces (typically walls, face of the listener, etc.). the wave especially in high frequencies. Additionally, air itself absorbs the higher frequency spectral components of sound as it propagate. This phenomenon is all the more increased for example for the diffuse sound field, for which it is not necessary to have a frequency representation for very high frequencies (for example above a frequency in a range of 5 to 15 kHz ).
- this disclosure presents a sound spatialization method, comprising the application of at least one room effect transfer function to at least one sound signal, said application amounting to multiplying, in the spectral domain, spectral components of the sound signal by the spectral components of a filter corresponding to the aforementioned transfer function.
- Each spectral component of the filter includes a temporal evolution in a time-frequency representation (as detailed below with reference to the Figure 3 ).
- these spectral components of the filter are ignored, for the aforementioned multiplications of components, beyond a threshold frequency and after at least one given instant in said time-frequency representation.
- the spectral components of the filter are taken into account up to a cutoff frequency which can be chosen for example between 5 and 15 kHz (depending on the room effect to be applied and/or the signal to be spatialized, as described below). Beyond the cutoff frequency, the multiplication is not even performed, which mathematically is the same as multiplying the signal by zero.
- This given moment typically represents the moment when a sound wave begins to undergo reverberations (by successive reflections, or, later still, from the presence of a diffuse sound field).
- the transfer function takes into account reverberations in the room effect (taking into account for example a diffuse sound field)
- the aforementioned given instant can be chosen as a function of such reverberations.
- the aforementioned given instant may be subsequent, in the room effect, to direct sound propagation with first reflections, and then correspond to the beginning of the presence of a diffuse sound field.
- the aforementioned threshold frequency decreases as a function of time in said time-frequency representation. For example, if the signal is sampled over several successive blocks, it can be planned, for example, to keep the spectral components present in the signal, in the multiplication of the components, for a first block, then to ignore them at the same time. -beyond a first threshold frequency for a second block which follows the first block, then ignoring them beyond a second threshold frequency for a third block which follows the second block, etc., the second threshold frequency being more lower than the first.
- the aforementioned given block may include, for example, samples located temporally at times which correspond to times when a sound wave has undergone one or more reflections, with even the beginning of the presence of a diffuse sound field.
- the block which follows this given block (immediately or a few blocks later) can for example include samples located temporally after or from the beginning of the presence of a diffuse sound field.
- the signal coming from the reverberations does not normally include spectral components of higher frequency than the initial signal.
- the aforementioned threshold frequency cannot be greater than this highest frequency.
- the aforementioned threshold frequency is chosen as being the minimum among a predetermined threshold frequency (for example between 5 and 15 kHz) and said highest frequency.
- the highest frequency spectral component information can be provided by the decoder.
- the spatialization is carried out with a module capable of supporting different signal formats, particularly in terms of sampling frequency of such signals, the highest frequency, mentioned above, cannot be greater than half of the sampling frequency, and, thus, the threshold frequency for the implementation of the invention can be further chosen as a function of this sampling frequency.
- first and second transfer functions with room effect are applied respectively to these first and second channels, as explained above in the introduction (for example by adapting signals on surround channels to switch to binaural or transaural reproduction).
- first and second transfer functions with room effect
- one of the first and second transfer functions applies an ipsi-lateral acoustic path effect
- the other of the first and second transfer functions applies a contra-lateral acoustic path effect
- This “screening” frequency is explained by the fact that for a contralateral path between a virtual loudspeaker and a considered ear of the listener, the listener's head masks the acoustic path and absorbs the lower tones. highest frequencies of the acoustic wave (therefore eliminating the spectral components associated with the highest frequencies of the acoustic wave).
- the aforementioned threshold frequency for the transfer function applying a contra-lateral path effect, can be chosen as a minimum among a predetermined threshold frequency (for example chosen between 5 and 15kHz) and this screening frequency. This achievement is advantageous to be applied already for the first block of samples. On the other hand, it does not exclude the possibility of increasing the threshold frequency again for the following block to simulate a first reflection on a wall located opposite the ear considered, this first reflection being received at this ear by a path ipsi-lateral.
- the cutoff frequency can be chosen common to all the signals, in a possible embodiment, after a given instant which corresponds for example to the presence of the diffuse field.
- At least one given instant is provided for the limitation of the taking into account of the frequency components up to a cut-off frequency, this given instant being located temporally at the start of a block different from a first block in a succession of blocks. This given instant therefore occurs after direct propagation, and at the time of sound reflections or the presence of a diffuse field.
- FIG. 5 also illustrating, in an exemplary embodiment, a possible algorithm of a computer program that would be executed by a processor of a spatialization module operating the method within the meaning of the invention.
- the present disclosure also relates, outside the scope of the claims, in general, to a computer program comprising instructions for implementing the above method, when they are executed by a processor.
- the present invention relates to a sound spatialization module, comprising calculation means for applying at least one room effect transfer function to at least one input sound signal, said application amounting to multiplying, in the spectral domain, components spectral components of the sound signal by the spectral components of a filter corresponding to said transfer function, each spectral component of the filter comprising a temporal evolution in a time-frequency representation.
- these calculation means are configured to ignore said spectral components of the filter for said multiplications of components, beyond a threshold frequency and after at least one given instant in said time-frequency representation.
- This module can be integrated into a compression decoding device, or more generally into a restitution system.
- the latter comprises in the example shown an input interface IN to receive the decoded signals, as well as calculation means such as a PROC processor and a working memory MEM cooperating with the IN/OUT interfaces to spatialize the signals I ( l ) and deliver through the output interface OUT only two signals O d and O g intended to power the respective earpieces of a CAS headset.
- calculation means such as a PROC processor and a working memory MEM cooperating with the IN/OUT interfaces to spatialize the signals I ( l ) and deliver through the output interface OUT only two signals O d and O g intended to power the respective earpieces of a CAS headset.
- a plurality of virtual speakers surround, in the example shown, the head TE of a listener.
- Each of the HPV virtual speakers is initially powered by a signal I ( l ) with l ⁇ [1; L ] for example previously decoded as indicated above with reference to the Figure 6 .
- the arrangement of the virtual speakers can concern a multichannel or also surround representation of the signals I ( l ) to be processed to restore them together in a spatialized manner with a room effect on a headset with CAS earpieces ( Figure 6 ).
- a designer of such a filter can thus limit the components of his filter for the right ear up to the cutoff frequency F c d (0) (corresponding to a head screening frequency) even if the signal to be processed I( l ) can have higher spectral components and up to the frequency F c g (0) at least.
- a designer of filters representing these transfer functions can plan to limit the components of the filters for the right ear up to the cutoff frequency F c d (1) and for the left ear up to the cutoff frequency F c g (1).
- a designer of filters representing these transfer functions can plan to limit the components of the filters for the right ear up to the cutoff frequency F c d (2) and for the left ear up to the cutoff frequency F c g (2).
- L input signals 1(1), I(2), ..., I(L) are transformed into the frequency domain, respectively at steps TF11, TF12, ..., TF1L.
- input signals may already be available in frequency form (for example from the decoder).
- step BA11 a complete spatialization impulse response (typically of the BRIR type for “Binaural Room Impulse Response”) in temporal form corresponding to signal 1(1) of channel 1 is stored in memory.
- this impulse response is transformed into frequency form to obtain a corresponding filter in the spectral domain.
- the filter is stored in its spectral form to avoid repeating the calculation of the transform. We then multiply this filter to the input signal in frequency form of channel 1 (which is equivalent to a convolution in the time domain). We therefore have the spatialized signal for signal 1(1) of channel 1.
- the same operations are carried out for the other L-1 channels.
- a similar treatment is carried out for the other earpiece.
- the L spatialized channels are not accessible independently before summing: the single output signal is constructed by progressively summing each spatialized channel with the previous output signal.
- the L input signals can typically correspond to the L channels of multichannel audio content intended to feed (“virtual”) speakers.
- the L input signals can for example correspond to the L surround signals of audio content in surround representation.
- step S21 L input signals 1(1), I(2), ..., I(L) are transformed into the frequency domain in step S21.
- a spatialization impulse response A k ( l ) (typically of the BRIR type) corresponding to the signal l( l ) of the channel / is transformed into the spectral domain to obtain a frequency filter.
- This multiplication is parameterized (as shown below with reference to the figure 4 ) so that certain frequency components are ignored, within the meaning of the invention. Typically, the highest frequency components will be ignored to limit the complexity of the calculations.
- a cutoff frequency f cA(I) from which the frequency components are ignored is defined (for example the maximum frequency represented in the channel signal I( l ), or half of its sampling frequency).
- a cutoff frequency is specific to an input signal, to an ear (therefore an output signal) and to a time block.
- the summation is carried out in a particular way, because it takes into account a delay on the channels to characterize the reverberations (reflections and diffuse field), as detailed below.
- the L spatialized channels are not accessible independently before summing: the single output signal is constructed by progressively summing each spatialized channel with the previous output signal.
- the delay m is zero. In the case of a frequency representation, this delay corresponds generally at the size of a processed signal frame for the first block, and is interpreted as taking the previous input block in its frequency form.
- an incomplete spatialization impulse response B k m ( l ) (typically BRIR type) corresponding to the signal l( I ) of channel 1 is transformed into the spectral domain to obtain a frequency filter.
- the same operations are carried out for the L channels and the filter multiplication operations are repeated on the progressively delayed spectral signals by summing the contributions in step S25 repeated for each delay m until obtaining a single signal representing the L channels on the set M of the temporal blocks m considered.
- the single output signal is constructed by progressively summing each spatialized channel with the previous output signal as we will now see with reference to the figure 4 .
- step S26 we return to the time domain in step S26 to obtain an output signal intended to power one of the earpieces of the headset.
- step S40 the output signal S is initialized to 0.
- This output signal is expressed in the frequency domain. It has a limited size of a length greater than the cutoff frequency fc( l ). For example, this signal is set to [0; fs( l )/2], fs( l ) being the sampling frequency of this signal I( l ).
- a first counting variable l is also initialized to 1. This first counting variable identifies one of the channel signals 1(1), I(2), ..., I( l ), ..., I(L) on the time block [0; N-1] for the right ear.
- a second counting variable j is initialized to 0. This second counting variable identifies a frequency component of a signal I( l ) on the time block [0; N-1] for the right ear.
- step S42 the coefficient c BRIR (j; l ) is stored. This coefficient corresponds to the frequency component j of the BRIR( l ) filter on the time block [0; N-1] for the right ear.
- the coefficient c I (j; l ) is stored in memory. This coefficient corresponds to the frequency component j of the signal I( l ) on the time block [0; N-1] for the right ear.
- the coefficients c BRIR (j; l ) and c I (j; l ) correspond to the same frequency component (identified by the variable j) and can thus be subsequently multiplied term by term (step S44).
- a value MULT(j) is calculated corresponding to the multiplication of the coefficients c BRIR (j; l ) and c i (j; l ). These coefficients are indeed multiplied term by term because they correspond to the same frequency component j (for the same channel, on the same block and for the same ear).
- step S45 this value MULT(j) is incremented to the signal S at the position of frequency j.
- step S46 we increment the variable j and we resume at step S42. If the variable j is greater (for example or equal) to the cutoff frequency fc( l ), we go to test T48. Thus, we filled the signal S on the interval [0; fc( l )].
- this signal can be defined over an interval larger than [0; fc( l )] (for example [0 ; fs( l )/2]).
- this signal had been initialized to 0 over its entire definition interval. From then on, it is zero on the rest of the interval which has not been filled (for example [fc( l ); fs( l )/2]). The complexity is therefore improved here because steps of filling the signal S have not been carried out, which reduces the number of calculations necessary.
- test T48 it is verified that the counting variable l corresponding to the signal I( l ) of channel l is less (for example strictly) than the number L of channels. If the variable l is less than or equal to L, the variable l is incremented in step S49 and the process is resumed in step S41. If the variable l is greater than L, the signal S corresponding to the spatialized signal for the time block [0; N-1] for the right ear is available in step S50.
- This signal S corresponding to the time block [0; N-1] is then summed with other signals generated in a similar manner for other time blocks [N; 2N-1], [2N; 3N-1], etc., (and for which an appropriate delay has been applied in accordance with step DBD above of the figure 2 For example).
- this low-pass filter is not applied to the audio signal, but to the BRIR filter (which is itself convolved with the audio signal) which is already composed of multiple reflections; the artifacts produced will therefore, at worst, be perceived as additional reflections of the original BRIR filter, and in practice rarely perceptible. It is, however, possible to attenuate these artifacts by slightly modifying the filter frequencies preceding the cutoff frequency (for example by gentle attenuation by applying a half Hanning window (fade out type)).
- the weightings W k ( l ) and the gains G(I( l )) can be set to 1.
- the gains G(I( l )) because this figure should be read as an integration of the gains with the weights 1/W k ( l ).
- these two parameters are determined, fixed and multiplied together once and for all.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Stereophonic System (AREA)
- Reverberation, Karaoke And Other Acoustics (AREA)
Claims (1)
- Klangverräumlichungsmodul, aufweisend Rechenmittel zur Anwendung wenigstens einer Übertragungsfunktion mit Raumeffekt auf wenigstens Eingangsklangsignal, wobei das Anwenden dem Multiplizieren, im Spektralbereich, der Spektralkomponenten des Klangsignals mit den Spektralkomponenten eines Filters entspricht, der der Übertragungsfunktion entspricht, wobei jede Spektralkomponente des Filters eine zeitliche Entwicklung in einer Zeit-Frequenz-Darstellung aufweist, dadurch gekennzeichnet, dass die Rechenmittel dazu ausgebildet sind, die Spektralkomponenten des Filters für die Multiplikationen von Komponenten über einer Schwellenfrequenz und nach wenigstens einem bestimmten Zeitpunkt in der Zeit-Frequenz-Darstellung zu ignorieren und dadurch, dass das Verräumlichungsmodul, das eine Mehrzahl von Eingangssignalen empfängt, wenigstens zwei Ausgangssignale ausgibt, wobei die Rechenmittel dazu ausgebildet sind, eine Übertragungsfunktion mit Raumeffekt auf jedes Eingangssignal anzuwenden, wobei das Modul dadurch gekennzeichnet ist, dass jedes der Ausgangssignale durch Anwendung der folgenden Formel geliefert wird:- wobei Ok ein Ausgangssignal und k der Index in Bezug auf ein Ausgangssignal ist,- wobei l ∈ [1; L] der Index in Bezug auf ein Eingangssignal von den Eingangssignalen ist, L die Anzahl von Eingangssignalen ist und I( l ) ein Eingangssignal von den Eingangssignalen ist,- wobei Ak(l) eine Übertragungsfunktion mit Raumeffekt ist, die spezifisch für ein Eingangssignal ist,- wobei- wobei Wk(l) ein gewähltes Gewichtungsgewicht und G(I( l )), eine vorbestimmte Verstärkung zum Energieausgleich ist,- wobei z-iDDm eine Anwendung einer Verzögerung ist, die als Anzahl von Abtastwertblöcken gezählt wird, die einer Zeitabweichung zwischen einer Schallaussendung in einem Raum, die dem Raumeffekt entspricht, und einem Beginn des Vorhandenseins eines Diffusfelds in diesem Raum entspricht, wobei der Index m einer Anzahl von Abtastwertblöcken mit einer Dauer entspricht, die dieser Verzögerung entspricht, wobei M die Gesamtzahl von Blöcken ist, die eine Übertragungsfunktion in einer Zeit-Frequenz-Darstellung dauert,- wobei das Zeichen " . " die Multiplikation bezeichnet,- wobei das Zeichen "*[0;...;fk (l)] " den Faltungsoperator auf einer begrenzten Anzahl von Frequenzen bezeichnet und von einer tiefsten Frequenz zu einer Maximalfrequenz fk(l) reicht, die wenigstens vom Eingangssignal mit dem Index l abhängig ist, und- wobei das Zeichen "*[0;...;fk (m)]" den Faltungsoperator auf einer begrenzten Anzahl von Frequenzen bezeichnet und von einer tiefsten Frequenz zu einer Frequenz fk (m) reicht, die vom Abtastwerteblock mit dem Index m abhängig ist.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1360185A FR3012247A1 (fr) | 2013-10-18 | 2013-10-18 | Spatialisation sonore avec effet de salle, optimisee en complexite |
PCT/FR2014/052617 WO2015055946A1 (fr) | 2013-10-18 | 2014-10-14 | Spatialisation sonore avec effet de salle, optimisee en complexite |
EP14796814.3A EP3058564B1 (de) | 2013-10-18 | 2014-10-14 | Komplexitätsoptimierte klangverräumlichung mit nachhall |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14796814.3A Division-Into EP3058564B1 (de) | 2013-10-18 | 2014-10-14 | Komplexitätsoptimierte klangverräumlichung mit nachhall |
EP14796814.3A Division EP3058564B1 (de) | 2013-10-18 | 2014-10-14 | Komplexitätsoptimierte klangverräumlichung mit nachhall |
Publications (2)
Publication Number | Publication Date |
---|---|
EP4184505A1 EP4184505A1 (de) | 2023-05-24 |
EP4184505B1 true EP4184505B1 (de) | 2024-02-28 |
Family
ID=50069081
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14796814.3A Active EP3058564B1 (de) | 2013-10-18 | 2014-10-14 | Komplexitätsoptimierte klangverräumlichung mit nachhall |
EP22211949.7A Active EP4184505B1 (de) | 2013-10-18 | 2014-10-14 | Komplexitätsoptimierte klangraumisierung mit raumeffekt |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14796814.3A Active EP3058564B1 (de) | 2013-10-18 | 2014-10-14 | Komplexitätsoptimierte klangverräumlichung mit nachhall |
Country Status (8)
Country | Link |
---|---|
US (1) | US9641953B2 (de) |
EP (2) | EP3058564B1 (de) |
JP (1) | JP6518661B2 (de) |
KR (1) | KR102156650B1 (de) |
CN (1) | CN105706162B (de) |
ES (2) | ES2982054T3 (de) |
FR (1) | FR3012247A1 (de) |
WO (1) | WO2015055946A1 (de) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB201609089D0 (en) * | 2016-05-24 | 2016-07-06 | Smyth Stephen M F | Improving the sound quality of virtualisation |
CN110428802B (zh) * | 2019-08-09 | 2023-08-08 | 广州酷狗计算机科技有限公司 | 声音混响方法、装置、计算机设备及计算机存储介质 |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR1357299A (fr) | 1962-05-16 | 1964-04-03 | Ampoule pour phares de véhicules automobiles | |
US5917917A (en) * | 1996-09-13 | 1999-06-29 | Crystal Semiconductor Corporation | Reduced-memory reverberation simulator in a sound synthesizer |
WO1999014983A1 (en) * | 1997-09-16 | 1999-03-25 | Lake Dsp Pty. Limited | Utilisation of filtering effects in stereo headphone devices to enhance spatialization of source around a listener |
CA2325482C (en) * | 1998-03-25 | 2009-12-15 | Lake Technology Limited | Audio signal processing method and apparatus |
US7835535B1 (en) * | 2005-02-28 | 2010-11-16 | Texas Instruments Incorporated | Virtualizer with cross-talk cancellation and reverb |
US20080085008A1 (en) * | 2006-10-04 | 2008-04-10 | Earl Corban Vickers | Frequency Domain Reverberation Method and Device |
TWI475896B (zh) * | 2008-09-25 | 2015-03-01 | Dolby Lab Licensing Corp | 單音相容性及揚聲器相容性之立體聲濾波器 |
EP2489206A1 (de) * | 2009-10-12 | 2012-08-22 | France Telecom | Verarbeitung von in einer subbanddomäne codierten schalldaten |
EP2503800B1 (de) * | 2011-03-24 | 2018-09-19 | Harman Becker Automotive Systems GmbH | Räumlich konstanter Raumklang |
EP2840811A1 (de) * | 2013-07-22 | 2015-02-25 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Verfahren zur Verarbeitung eines Audiosignals, Signalverarbeitungseinheit, binauraler Renderer, Audiocodierer und Audiodecodierer |
-
2013
- 2013-10-18 FR FR1360185A patent/FR3012247A1/fr not_active Withdrawn
-
2014
- 2014-10-14 CN CN201480060448.0A patent/CN105706162B/zh active Active
- 2014-10-14 WO PCT/FR2014/052617 patent/WO2015055946A1/fr active Application Filing
- 2014-10-14 KR KR1020167012795A patent/KR102156650B1/ko active IP Right Grant
- 2014-10-14 JP JP2016523910A patent/JP6518661B2/ja active Active
- 2014-10-14 EP EP14796814.3A patent/EP3058564B1/de active Active
- 2014-10-14 ES ES22211949T patent/ES2982054T3/es active Active
- 2014-10-14 ES ES14796814T patent/ES2959534T3/es active Active
- 2014-10-14 US US15/029,458 patent/US9641953B2/en active Active
- 2014-10-14 EP EP22211949.7A patent/EP4184505B1/de active Active
Also Published As
Publication number | Publication date |
---|---|
KR20160073394A (ko) | 2016-06-24 |
US20160269850A1 (en) | 2016-09-15 |
ES2982054T3 (es) | 2024-10-14 |
EP3058564B1 (de) | 2023-07-26 |
EP4184505A1 (de) | 2023-05-24 |
EP3058564A1 (de) | 2016-08-24 |
JP6518661B2 (ja) | 2019-05-22 |
US9641953B2 (en) | 2017-05-02 |
CN105706162B (zh) | 2019-06-11 |
FR3012247A1 (fr) | 2015-04-24 |
ES2959534T3 (es) | 2024-02-26 |
CN105706162A (zh) | 2016-06-22 |
KR102156650B1 (ko) | 2020-09-16 |
JP2016537866A (ja) | 2016-12-01 |
WO2015055946A1 (fr) | 2015-04-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1563485B1 (de) | Verfahren zur verarbeitung von audiodateien und erfassungsvorrichtung zur anwendung davon | |
EP2000002B1 (de) | Verfahren und einrichtung zur effizienten binauralen raumklangerzeugung im transformierten bereich | |
US8515104B2 (en) | Binaural filters for monophonic compatibility and loudspeaker compatibility | |
US7487097B2 (en) | Advanced processing based on a complex-exponential-modulated filterbank and adaptive time signalling methods | |
EP3075072B1 (de) | Tonsignalverarbeitung | |
EP2005420B1 (de) | Einrichtung und verfahren zur codierung durch hauptkomponentenanalyse eines mehrkanaligen audiosignals | |
WO2004086818A1 (fr) | Procede pour traiter un signal electrique de son | |
FR2899424A1 (fr) | Procede de synthese binaurale prenant en compte un effet de salle | |
EP2518724A1 (de) | Kombinierte Audioeinheit bestehend aus Mikrofon und Kopfhörer, die Mittel zur Geräuschdämpfung eines nahen Wortsignals umfasst, insbesondere für eine telefonische Freisprechanlage | |
US20160212564A1 (en) | Apparatus and Method for Compressing a Set of N Binaural Room Impulse Responses | |
US8280062B2 (en) | Sound corrector, sound measurement device, sound reproducer, sound correction method, and sound measurement method | |
EP1479266A2 (de) | Verfahren und vorrichtung zur steuerung einer anordnung zur wiedergabe eines schallfeldes | |
EP3400599B1 (de) | Verbesserter ambisonic-codierer für eine tonquelle mit mehreren reflexionen | |
EP4184505B1 (de) | Komplexitätsoptimierte klangraumisierung mit raumeffekt | |
EP3025514B1 (de) | Klangverräumlichung mit raumwirkung | |
EP1994526B1 (de) | Gemeinsame schallsynthese und -spatialisierung | |
CN109791773B (zh) | 音频输出产生系统、音频通道输出方法和计算机可读介质 | |
EP2515300A1 (de) | Verfahren und System für die Geräuschunterdrückung | |
US20240304196A1 (en) | Multi-band ducking of audio signals | |
FR3136072A1 (fr) | Procédé de traitement de signal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
AC | Divisional application: reference to earlier application |
Ref document number: 3058564 Country of ref document: EP Kind code of ref document: P |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20230616 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20231113 |
|
RAP3 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: ORANGE |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AC | Divisional application: reference to earlier application |
Ref document number: 3058564 Country of ref document: EP Kind code of ref document: P |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602014089619 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240628 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20240228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240529 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240528 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240528 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240528 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240628 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240529 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240628 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1661985 Country of ref document: AT Kind code of ref document: T Effective date: 20240228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240628 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: MC Payment date: 20240924 Year of fee payment: 11 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240228 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240919 Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2982054 Country of ref document: ES Kind code of ref document: T3 Effective date: 20241014 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: LU Payment date: 20240919 Year of fee payment: 11 Ref country code: BE Payment date: 20240919 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240919 Year of fee payment: 11 |