EP1999998A1 - Method for binaural synthesis taking into account a theater effect - Google Patents
Method for binaural synthesis taking into account a theater effectInfo
- Publication number
- EP1999998A1 EP1999998A1 EP07731711A EP07731711A EP1999998A1 EP 1999998 A1 EP1999998 A1 EP 1999998A1 EP 07731711 A EP07731711 A EP 07731711A EP 07731711 A EP07731711 A EP 07731711A EP 1999998 A1 EP1999998 A1 EP 1999998A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- amplitude
- brir filter
- delay
- samples
- vector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 65
- 230000000694 effects Effects 0.000 title claims abstract description 29
- 230000015572 biosynthetic process Effects 0.000 title description 4
- 238000003786 synthesis reaction Methods 0.000 title description 4
- 230000003595 spectral effect Effects 0.000 claims abstract description 31
- 230000004044 response Effects 0.000 claims abstract description 18
- 239000013598 vector Substances 0.000 claims description 57
- 230000002123 temporal effect Effects 0.000 claims description 15
- 230000001934 delay Effects 0.000 claims description 13
- 238000000354 decomposition reaction Methods 0.000 claims description 10
- 238000001514 detection method Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 7
- 230000005236 sound signal Effects 0.000 claims description 7
- 238000000605 extraction Methods 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 4
- 230000009466 transformation Effects 0.000 claims description 4
- 230000006870 function Effects 0.000 description 21
- 238000012546 transfer Methods 0.000 description 12
- 238000001914 filtration Methods 0.000 description 6
- 238000009877 rendering Methods 0.000 description 6
- 238000012946 outsourcing Methods 0.000 description 4
- 238000005070 sampling Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 101000822695 Clostridium perfringens (strain 13 / Type A) Small, acid-soluble spore protein C1 Proteins 0.000 description 1
- 101000655262 Clostridium perfringens (strain 13 / Type A) Small, acid-soluble spore protein C2 Proteins 0.000 description 1
- 101000655256 Paraclostridium bifermentans Small, acid-soluble spore protein alpha Proteins 0.000 description 1
- 101000655264 Paraclostridium bifermentans Small, acid-soluble spore protein beta Proteins 0.000 description 1
- 238000010420 art technique Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 238000002592 echocardiography Methods 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S1/00—Two-channel systems
- H04S1/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
- H04S1/005—For headphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
- H04S3/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
- H04S3/004—For headphones
Definitions
- the invention relates to the so-called 3D sound spatialization of audio signals, integrating in particular a room effect, particularly in the field of binaural techniques.
- the term "binaural” aims at the reproduction on a stereo headset, or a pair of headphones, of a sound signal with nevertheless spatialization effects.
- the invention is however not limited to the aforementioned technique and applies, in particular, to techniques derived from “binaural” such as “transaural” reproduction techniques, that is to say on remote speakers.
- TRANSAURAL ® is a registered trademark of COOPER BAUCK CORPORATION.
- a specific application of the invention is, for example, the enrichment of audio contents by effectively applying acoustic transfer functions of the head of a listener to monophonic signals, in order to plunge the latter into a 3D sound scene , including in particular a room effect.
- the transfer function, or filter, of a sound signal between a position of a sound source in space and the two ears of a listener is designated HRTF for "IHead Related Transfer Function” in English in its frequency form and HRIR for "JHead Related Impulse Response” in English in its time form.
- HRTF for "IHead Related Transfer Function” in English in its frequency form
- HRIR for "JHead Related Impulse Response” in English in its time form.
- the binaural technique consists in applying such acoustic transfer functions of the head to monophonic audio signals, in order to obtain a stereophonic signal which, when listening to the headphones, to have the feeling that the sound sources come from a particular direction of space.
- the signal from the right ear is obtained by filtering the monophonic signal by the HRTF of the right ear and the left ear signal is obtained by filtering the same monophonic signal by the HRTF of the left ear.
- ITD for "English Time Difference", defined as the interaural difference in the arrival time of sound waves from the same sound source between the left ear and the right ear of the listener. ITD is mainly linked to the HRTF phase;
- the aforementioned transfer functions may take into account diffusion reflection phenomena , diffraction, which correspond to the acoustic response of the room in which these transfer functions have been measured or simulated.
- the aforementioned transfer functions are then called BRIR for "Binaural Room Impulse Response" in English in their temporal form.
- the aforementioned binaural techniques can be used, for example, to simulate a 5.1-type 3D rendering of the headphones.
- this technique at each loudspeaker position of the "surround" system in English, or multi-speaker, corresponds a pair of HRTF, an HRTF for the left ear and an HRTF for the right ear.
- the sum of the 5 channels of the 5.1 mode signal convoluted by the 5 HRTF filters for each listener's ear provides two right and left binaural channels, which simulate the 5.1 mode for listening on an audio headset.
- binaural virtual surround in English for binaural spatialization simulating a multi-speaker system we speak of binaural virtual surround in English for binaural spatialization simulating a multi-speaker system.
- the first relating to the real room effect, consists in measuring HRIRs in a non-anechoic room, thus having a room effect.
- HRIR obtained which are other than BRIR, must be of long enough duration to integrate the first sound reflections, duration greater than 500 temporal samples for a sampling frequency of 44 100 Hz, but this duration must be even longer. significant, that is to say greater than 20 000 temporal samples at the same sampling frequency, if we want to integrate the late reverberation effect. It is noted, however, that the above-mentioned BRIRs can be equivalently obtained by the convolution of HRIRs measured in anechoic environment with the desired room effect, represented by the impulse response of the room;
- the second, relating to the effect of artificial room, comes from the virtual acoustics and consists of integrating the room effect with the HRIR, so synthetic.
- This operation is carried out thanks to spatializers that introduce artificial reverberation effects.
- the disadvantage of such methods is that obtaining a realistic rendering requires significant computing power.
- a common method is to model binaural filters, breaking down HRTFs, or HRIRs, into a minimum phase component (minimum phase filter determined by the spectral modulus of the HRTF) and a pure delay.
- the difference in delay observed between the HRTF or the HRIR of the left ear and the right ear corresponds to the ITD location index.
- the spectral module is obtained by taking the module of the Fourier transform of the HRIRs.
- the number of coefficients can then be reduced, for example by averaging the energy over a reduced number of frequency bands, for example according to frequency smoothing techniques based on the integration properties of the auditory system.
- the simplest and most direct method is the bi-channel implementation of the binaural, shown in Figure 1.
- the spatialization of the sources is done independently of each other.
- a pair of HRTF filters is associated with each source.
- the filtering can be carried out either in the time domain, in the form of a convolution product, or in the frequency domain, in the form of a complex multiplication, or in any other transformed domain, such as the PQMF domain for Pseudo Quadrature Mi ⁇ or Filter in English for example.
- the multi-channel binaural implementation is an alternative to the bi-channel implementation offering a more efficient implementation that consists of a linear decomposition of the HRTFs, in the form of a sum of products of directional functions (encoding gains). and elementary filters (decoding filters).
- This decomposition makes it possible to separate the encoding and decoding steps, the number of filters then being independent of the number of sources to be spatialized.
- the elementary filters can in turn be modeled by a minimal phase filter and a pure delay to simplify their implementation. It is also possible to extract the delays from the original HRTFs and integrate them separately into the encoding.
- the BRIRs because of the long duration of the room responses, contain a number of temporal samples which can be very high, more than 20 000 samples for medium-sized rooms, this number being linked to the delay of room echoes and therefore to the dimensions of the latter.
- the corresponding BRIR filters require very large computing power and memory size;
- an object of the present invention aims to overcome the aforementioned drawbacks of the prior art.
- an object of the present invention is to provide a method for calculating BRIR filter modeling parameters, HRIR filters taking into account a room effect of the prior art, these parameters comprising one or more delays possibly associated with gains and at least one amplitude spectrum, to allow an efficient implementation either in the time domain, or in the frequency domain or transformed.
- Another object of the present invention is the implementation of a method for calculating specific BRIR filters, which, although equivalent in terms of quality to conventional or original BRIR filters allowing a satisfactory positioning and externalization of the sources, reduce strongly computing power and memory size necessary for the implementation of the corresponding filtering.
- the method of 3D spatialization of audio channels, from at least one BRIR filter incorporating a room effect, object of the present invention is remarkable in that it consists at least, for a specific number of samples corresponding to the size of the impulse response of the BRIR filter, to decompose this BRIR filter into at least one set of delay and amplitude values associated with the arrival times of the reflections, to extract on this number of samples at least one spectral module of the BRIR filter, to be constituted from each successive delay of its amplitude and associated spectral module an elementary BRIR filter directly applied to the audio channels in the time domain, frequency or transformed.
- the method according to the invention is furthermore remarkable in that the decomposition of the BRIR filter is carried out by a delay detection process by detection of the amplitude peaks, at the first amplitude peak being associated the delay corresponding to the moment of arrival the direct sound wave.
- the method which is the subject of the invention is also remarkable in that the extraction of each spectral module is performed by a time-frequency transformation.
- the method which is the subject of the invention is also remarkable in that, for a number of samples corresponding to the impulse response of the BRIR filter decomposed into frequency sub-bands of rank k determined, the value of the spectral module of the BRIR filter is defined. as a real value of gain representative of the energy of the BRIR filter in each sub-band.
- each delay is associated with a spectral module and in that the spectral module of the BRIR filter is defined in each sub-band as a real value of gain representative of the energy of the partial BRIR filter in said sub-band, this gain value being a function of the associated delay.
- This modulation of the spectral module as a function of the applied delay makes it possible to implement a reconstruction of the BRIR filter much closer to the original BRIR filter.
- each elementary BRIR filter in each frequency subband of rank k is formed by a complex multiplication, whether or not the delay associated with each amplitude peak includes a value. real gain, and by a pure delay, increased by the delay gap vis-à-vis the delay allocated to the first sample corresponding to the instant of arrival of the direct sound wave.
- FIG. 2 represents, for purely illustrative purposes, a flowchart of the essential steps for implementing the method of 3D spatialization of audio channels from at least one BRIR filter incorporating a room effect, in accordance with the purpose of the present invention
- FIG. 3a represents a detail of implementation of the step of decomposition performed in step A of Figure 2a;
- FIG. 3b shows a sample timing diagram for explaining the procedure of a sub-step A 0 of constitution of a first vector I 1 and a first offset vector s l + i of amplitude peaks Figure 3a;
- FIG. 3c represents by way of illustration a timing diagram of the amplitude peak samples explaining a process for constructing a second vector from a vector of difference between the first offset vector and the first vector illustrated in FIG. 3b , this second vector grouping the rank indices of isolated amplitude peaks;
- FIG. 3d represents a timing diagram of the amplitude peaks representative of the first reflections due to the room effect obtained from the second vector illustrated in FIG. 3c, with each of the first reflections being allocated a delay corresponding to the parameter corresponding to the instant of arrival of the direct sound wave, then specific successive delays added to the delay parameter of the direct sound wave.
- the method according to the invention consists, for a given number N of specific samples, corresponding to the size of the impulse response of the BRIR filter, to decompose in a step A, this BRIR filter into at least one set of amplitude values. and delay values describing a sequence of amplitude peaks.
- a n indicates the amplitude of the sample of rank n and A MX indicates the amplitude of each amplitude peak, ⁇ x denoting the delay associated with each of the corresponding amplitude peaks.
- Step B is then followed by a step C consisting of constituting from each successive delay, the amplitude and the spectral module associated with this delay established in step B a BRIR elementary filter rated BRIR ⁇ directly applied to audio channels in the time domain frequency or transformed, as will be described below in the description.
- the decomposition of the BRIR filter in step A is performed by a delay detection process by detection of the amplitude peaks, at the first amplitude peak being associated with the delay ⁇ o corresponding to the moment of arrival of the direct sound wave.
- the first amplitude peak is defined by the parameters
- Other methods of detecting the first peak can also be used, as is known from the state of the art, in particular to determine the value of the delay ⁇ o which can for example be taken as equal to the interaural delay.
- Step B of extracting at least one spectral module of the BRIR filter with a duration of N samples makes it possible to ensure a correspondence of the timbre between each original BRIR filter and the reconstructed BRIR filter from the elementary BRIR ⁇ filters. as will be described later in the description.
- the extraction of the module Spectral can be performed by a time-frequency transformation such as a Fourier transform, as will be described later in the description.
- BRIR elementary BRIR filters ⁇ each formed from the value of each spectral module BRIR filter and of course the amplitude and the delay Ax considered, ensures a reduction in calculation costs.
- All methods of filtering from a minimum phase filter or not, associated with all methods of implementation of delays may be suitable for the proposed decomposition.
- the method which is the subject of the invention can for example be combined with a multichannel implementation of the binaural 3D spatialization.
- the aforementioned implementation mode is implemented in the context of the decomposition of BRIR filters for an efficient implementation in the field of complex temporal subbands more particularly, but in a non-limiting manner, the complex PQMF domain.
- Such an implementation can be used by a decoder defined by the MPEG surround standard, in order to obtain a binaural 3D rendering of type 5.1.
- 5.1 is defined by the MPEG spatial audio coding standard ISO / IEC 23003-1 (doc N7947).
- the aforementioned embodiment can be transposed to the time domain, that is to say to the domain not transformed into sub-bands or to any other another transformed domain.
- the extraction of delays consists at least for any BRIR filter corresponding to a position of the space, as represented in FIG. 3a.
- This operation makes it possible to generate a first vector denoted I 1 at the substep A 0 3, and a first offset vector denoted l, + i at the substep A 04 .
- the first vector I corresponds to the rank indices of the temporal samples whose amplitude value is greater than the threshold value V.
- the first offset vector I, + i is deduced from the first vector by shifting an index.
- the first vector and the first offset vector are representative of the position of the amplitude peaks in the number N of samples.
- Step A 0 is followed by a step Ai of determining whether the time samples whose amplitude is greater than the threshold value V corresponding to amplitude peaks isolated by calculating a deviation vector I '. which represents the difference between the first offset vector l, + i and the first vector I 1 .
- Step Ai is then followed by a step A 2 of calculating a second vector P grouping the isolated amplitude peak indices on the number N of samples for a difference threshold defined by a specific value W.
- step A 2 is followed by a step A 3 of identifying, from the samples of the second vector, for each identified isolated peak, the index of the maximum amplitude sample from a determined number of samples, taken equal to the value W previously quoted according to the sample identified by the second vector.
- This value W can be determined experimentally.
- the index and the amplitude of any new maximum amplitude sample are stored in the form of a delay index vector and an amplitude vector.
- a delay index vector and an amplitude vector are stored in the form of a delay index vector and an amplitude vector.
- temporal envelope of the latter is given by:
- Step A 0 then consists in finding all the indices of the samples whose envelope value is greater than the threshold value V.
- the threshold value V is itself a function of the energy of the temporal envelope of the BRIR filter.
- C is a constant fixed at 1 for example.
- K is the number of samples whose absolute value of the amplitude exceeds the threshold value V for constitute the first vector.
- FIG. 3b the time envelope of a BRIR filter for which the threshold V is set to the real value 0.037 is shown.
- step Ai the vector I ', deviation vector, is then calculated, the difference between the first offset vector I, + i and the first vector I 1 .
- Step A 2 then consists in calculating the second vector P which groups the indices of the distinct peaks.
- the index of the following peaks corresponds to the indices increased by 1 of the values of I 'which exceed a threshold of difference defined by a value W.
- a '(i) BRIR (D' (i)) * sign (BRIR (D '(1))).
- the amplitudes A of maximum amplitudes can then be normalized in energy by the relation:
- L is the number of elements of D 'and of A, that is to say indicative and amplitude vectors representative of each peak. This number depends of course on the threshold value V and the value of the constant W above.
- FIG. 3d A representation of normalized amplitudes, peaks amplitude and their successive delay position with respect to the first amplitude peak to which the delay ⁇ o is allocated, is represented in FIG. 3d.
- SB k SB k
- delays and gains are applied to the complex samples, as will be described later in the description.
- each spectral module of the BRIR filter is defined in each sub-band as at least one real value of gain representative of the energy of the BRIR filter in said sub-band.
- the corresponding gain values denoted G (k, n) where k denotes the rank of the subband under consideration and n the rank of the sample among the N samples, are obtained by averaging spectral amplitude energy of each BRIR filter in each subband.
- the weighting window is centered on the center frequency of the sub-band k and the frequency f1 is less than or equal to the starting frequency of the sub-band k.
- each delay is associated with a spectral module.
- the value of each spectral module is defined in each sub-band as at least one gain value representative of the energy of the partial BRIR filter in said sub-band, this gain value being a function of the applied delay as a function of the index of each amplitude peak sample, from the index and amplitude vector.
- the gains G (k, n) are modulated and can therefore vary with each new I applied delay.
- the gain values are then given by the relation:
- BRIR * (f, l) is the Fourier transform of the windowed BRIR (t) temporal filter between the samples D '(1) -Z and D' (1 + 1), the calculated spectral energy being that of the partial BRIR filter thus window, and completed by 0 to obtain 8 192 samples.
- each elementary BRIR filter in each frequency subband k can then advantageously be formed by a complex multiplication, including a real value of gain, whether or not the delay applied as a function of the index of each sample of amplitude peak, according to the first or the second retained embodiment previously described in the description.
- the elementary BRIR filter is also formed by a pure delay plus the delay difference with respect to the delay ⁇ o allocated to the first amplitude peak. This delay can then be implemented via a delay line applied to the product obtained by the rotation in the form of complex multiplication mentioned above.
- E (k, n) denotes the nth complex sample of the subband k considered
- S (k, n) denotes the nth sample of the subband k after application of the gains and the delays
- M is the number of sub-bands
- d (I) and D (I) are such that they correspond to the application of the I th delay of D (1) M + d (1) samples in the non-subsampled time domain.
- the delay D (1) M + d (1) corresponds to the values of D '(1) calculated according to the amplitude peak detection process previously described in connection with FIGS. 3a to 3d.
- a (I) denotes the amplitude of the peak associated with the corresponding delay
- G (k, n) denotes the real gain applied to the nth complex sample of the sub-band SB k of rank k considered.
- the method according to the invention consists in adding to the values of detected amplitude peaks a plurality of arbitrary amplitude values distributed over an arbitrary instant from which discrete reflections are considered. are finished and where the late reverberation phenomenon begins. These amplitude values are calculated and distributed beyond the arbitrary duration, which can be taken equal to 200 milliseconds, for example, until the last sample of the number of samples corresponding to the size of the BRIR impulse response.
- the amplitude peaks of the first reflections are determined as previously described in connection with FIGS. 2 and following, and, from a sample t1 corresponding to 200 milliseconds, determined experimentally. and corresponding to the beginning of the late reverberation, until a sample t2 which corresponds to the end of the reverberation or, if appropriate, at the end of the N samples of the impulse response of the BRIR filter, R values are added to the vectors D 'and A' such that:
- L is the number of peaks detected
- r is an integer between 1 and R.
- the late reverberation phenomenon can also be processed by a delay line added to the treatment of the first reflections.
- the invention finally covers a computer program comprising a series of instructions stored on a storage medium of a computer or a dedicated 3D sound spatialization device of remarkable audio signals in that, when executed, this computer program executes the 3D sound spatialization method from at least one BRIR filter comprising a room effect previously described in the description in connection with Figures 2 and 3a to 3d.
- the above-mentioned computer program can be a directly executable program implanted in the permanent memory of a computer or a binaural synthesis device of a room effect in spatial sound spatialisation.
- the implementation of the invention can then be performed completely digitally.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0602694A FR2899424A1 (en) | 2006-03-28 | 2006-03-28 | Audio channel multi-channel/binaural e.g. transaural, three-dimensional spatialization method for e.g. ear phone, involves breaking down filter into delay and amplitude values for samples, and extracting filter`s spectral module on samples |
PCT/FR2007/050895 WO2007110520A1 (en) | 2006-03-28 | 2007-03-08 | Method for binaural synthesis taking into account a theater effect |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1999998A1 true EP1999998A1 (en) | 2008-12-10 |
EP1999998B1 EP1999998B1 (en) | 2012-07-11 |
Family
ID=37398830
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP07731711A Active EP1999998B1 (en) | 2006-03-28 | 2007-03-08 | Method for binaural synthesis taking into account a spatial effect |
Country Status (6)
Country | Link |
---|---|
US (1) | US8045718B2 (en) |
EP (1) | EP1999998B1 (en) |
JP (1) | JP4850948B2 (en) |
ES (1) | ES2390831T3 (en) |
FR (1) | FR2899424A1 (en) |
WO (1) | WO2007110520A1 (en) |
Families Citing this family (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2009128559A (en) * | 2007-11-22 | 2009-06-11 | Casio Comput Co Ltd | Reverberation effect adding device |
WO2010005413A1 (en) * | 2008-07-09 | 2010-01-14 | Hewlett-Packard Development Company, L.P. | Method and system for simultaneous rendering of multiple multi-media presentations |
CN102334348B (en) * | 2008-11-21 | 2014-12-31 | 奥罗技术公司 | Converter and method for converting an audio signal |
US9107021B2 (en) | 2010-04-30 | 2015-08-11 | Microsoft Technology Licensing, Llc | Audio spatialization using reflective room model |
US8995675B2 (en) * | 2010-12-03 | 2015-03-31 | The University Of North Carolina At Chapel Hill | Methods and systems for direct-to-indirect acoustic radiance transfer |
BR112013017070B1 (en) | 2011-01-05 | 2021-03-09 | Koninklijke Philips N.V | AUDIO SYSTEM AND OPERATING METHOD FOR AN AUDIO SYSTEM |
US9794678B2 (en) * | 2011-05-13 | 2017-10-17 | Plantronics, Inc. | Psycho-acoustic noise suppression |
US10321252B2 (en) | 2012-02-13 | 2019-06-11 | Axd Technologies, Llc | Transaural synthesis method for sound spatialization |
US20150036827A1 (en) * | 2012-02-13 | 2015-02-05 | Franck Rosset | Transaural Synthesis Method for Sound Spatialization |
JP6102179B2 (en) * | 2012-08-23 | 2017-03-29 | ソニー株式会社 | Audio processing apparatus and method, and program |
CN108806704B (en) | 2013-04-19 | 2023-06-06 | 韩国电子通信研究院 | Multi-channel audio signal processing device and method |
US10075795B2 (en) | 2013-04-19 | 2018-09-11 | Electronics And Telecommunications Research Institute | Apparatus and method for processing multi-channel audio signal |
US9319819B2 (en) | 2013-07-25 | 2016-04-19 | Etri | Binaural rendering method and apparatus for decoding multi channel audio |
CN105706467B (en) * | 2013-09-17 | 2017-12-19 | 韦勒斯标准与技术协会公司 | Method and apparatus for handling audio signal |
KR102230308B1 (en) * | 2013-09-17 | 2021-03-19 | 주식회사 윌러스표준기술연구소 | Method and apparatus for processing multimedia signals |
US9769589B2 (en) * | 2013-09-27 | 2017-09-19 | Sony Interactive Entertainment Inc. | Method of improving externalization of virtual surround sound |
CN105900455B (en) | 2013-10-22 | 2018-04-06 | 延世大学工业学术合作社 | Method and apparatus for handling audio signal |
CN104681034A (en) * | 2013-11-27 | 2015-06-03 | 杜比实验室特许公司 | Audio signal processing method |
KR102281378B1 (en) * | 2013-12-23 | 2021-07-26 | 주식회사 윌러스표준기술연구소 | Method for generating filter for audio signal, and parameterization device for same |
CN104768121A (en) * | 2014-01-03 | 2015-07-08 | 杜比实验室特许公司 | Generating binaural audio in response to multi-channel audio using at least one feedback delay network |
CN107750042B (en) | 2014-01-03 | 2019-12-13 | 杜比实验室特许公司 | generating binaural audio by using at least one feedback delay network in response to multi-channel audio |
CN105900457B (en) | 2014-01-03 | 2017-08-15 | 杜比实验室特许公司 | The method and system of binaural room impulse response for designing and using numerical optimization |
CN106105269B (en) | 2014-03-19 | 2018-06-19 | 韦勒斯标准与技术协会公司 | Acoustic signal processing method and equipment |
CN108307272B (en) | 2014-04-02 | 2021-02-02 | 韦勒斯标准与技术协会公司 | Audio signal processing method and apparatus |
US10142755B2 (en) * | 2016-02-18 | 2018-11-27 | Google Llc | Signal processing methods and systems for rendering audio on virtual loudspeaker arrays |
US9866916B1 (en) * | 2016-08-17 | 2018-01-09 | International Business Machines Corporation | Audio content delivery from multi-display device ecosystem |
US10187740B2 (en) | 2016-09-23 | 2019-01-22 | Apple Inc. | Producing headphone driver signals in a digital audio signal processing binaural rendering environment |
FR3067511A1 (en) * | 2017-06-09 | 2018-12-14 | Orange | SOUND DATA PROCESSING FOR SEPARATION OF SOUND SOURCES IN A MULTI-CHANNEL SIGNAL |
US10911855B2 (en) | 2018-11-09 | 2021-02-02 | Vzr, Inc. | Headphone acoustic transformer |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2893563B2 (en) * | 1992-12-11 | 1999-05-24 | 松下電器産業株式会社 | Sound image localization coefficient calculator |
US5438623A (en) * | 1993-10-04 | 1995-08-01 | The United States Of America As Represented By The Administrator Of National Aeronautics And Space Administration | Multi-channel spatialization system for audio signals |
US5459790A (en) * | 1994-03-08 | 1995-10-17 | Sonics Associates, Ltd. | Personal sound system with virtually positioned lateral speakers |
CA2189126C (en) * | 1994-05-11 | 2001-05-01 | Jonathan S. Abel | Three-dimensional virtual audio display employing reduced complexity imaging filters |
US5596644A (en) * | 1994-10-27 | 1997-01-21 | Aureal Semiconductor Inc. | Method and apparatus for efficient presentation of high-quality three-dimensional audio |
US6307941B1 (en) * | 1997-07-15 | 2001-10-23 | Desper Products, Inc. | System and method for localization of virtual sound |
FR2768546B1 (en) * | 1997-09-18 | 2000-07-21 | Matra Communication | METHOD FOR NOISE REDUCTION OF A DIGITAL SPOKEN SIGNAL |
GB2366975A (en) * | 2000-09-19 | 2002-03-20 | Central Research Lab Ltd | A method of audio signal processing for a loudspeaker located close to an ear |
JP2003061200A (en) * | 2001-08-17 | 2003-02-28 | Sony Corp | Sound processing apparatus and sound processing method, and control program |
FR2847376B1 (en) * | 2002-11-19 | 2005-02-04 | France Telecom | METHOD FOR PROCESSING SOUND DATA AND SOUND ACQUISITION DEVICE USING THE SAME |
US7391870B2 (en) * | 2004-07-09 | 2008-06-24 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E V | Apparatus and method for generating a multi-channel output signal |
GB0419346D0 (en) | 2004-09-01 | 2004-09-29 | Smyth Stephen M F | Method and apparatus for improved headphone virtualisation |
-
2006
- 2006-03-28 FR FR0602694A patent/FR2899424A1/en not_active Withdrawn
-
2007
- 2007-03-08 EP EP07731711A patent/EP1999998B1/en active Active
- 2007-03-08 ES ES07731711T patent/ES2390831T3/en active Active
- 2007-03-08 JP JP2009502160A patent/JP4850948B2/en active Active
- 2007-03-08 US US12/225,691 patent/US8045718B2/en active Active
- 2007-03-08 WO PCT/FR2007/050895 patent/WO2007110520A1/en active Application Filing
Non-Patent Citations (1)
Title |
---|
See references of WO2007110520A1 * |
Also Published As
Publication number | Publication date |
---|---|
EP1999998B1 (en) | 2012-07-11 |
WO2007110520A1 (en) | 2007-10-04 |
US8045718B2 (en) | 2011-10-25 |
FR2899424A1 (en) | 2007-10-05 |
JP4850948B2 (en) | 2012-01-11 |
ES2390831T3 (en) | 2012-11-16 |
US20090103738A1 (en) | 2009-04-23 |
JP2009531906A (en) | 2009-09-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1999998B1 (en) | Method for binaural synthesis taking into account a spatial effect | |
EP2000002B1 (en) | Method and device for efficient binaural sound spatialization in the transformed domain | |
EP1992198B1 (en) | Optimization of binaural sound spatialization based on multichannel encoding | |
EP1563485B1 (en) | Method for processing audio data and sound acquisition device therefor | |
CA2835463C (en) | Apparatus and method for generating an output signal employing a decomposer | |
EP3475943B1 (en) | Method for conversion and stereophonic encoding of a three-dimensional audio signal | |
FR2995754A1 (en) | OPTIMIZED CALIBRATION OF A MULTI-SPEAKER SOUND RESTITUTION SYSTEM | |
EP2005420A1 (en) | Device and method for encoding by principal component analysis a multichannel audio signal | |
EP1606974A1 (en) | Method for treating an electric sound signal | |
EP2042001A1 (en) | Binaural spatialization of compression-encoded sound data | |
EP1886535B1 (en) | Method of producing a plurality of time signals | |
EP3025514B1 (en) | Sound spatialization with room effect | |
EP2009891A2 (en) | Transmission of an audio signal in an immersive audio conference system | |
WO2012172264A1 (en) | Method for processing an audio signal for improved restitution | |
FR3065137A1 (en) | SOUND SPATIALIZATION METHOD | |
EP1994526B1 (en) | Joint sound synthesis and spatialization | |
EP3384688B1 (en) | Successive decompositions of audio filters | |
EP2815589B1 (en) | Transaural synthesis method for sound spatialization | |
CN116261086A (en) | Sound signal processing method, device, equipment and storage medium | |
EP1869949A1 (en) | Method and system for spatializing an audio signal based on its intrinsic qualities |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20080924 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: GUERIN, ALEXANDRE Inventor name: FAURE, JULIEN Inventor name: PALLONE, GREGORY Inventor name: NICOL, ROZENN |
|
17Q | First examination report despatched |
Effective date: 20101203 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RTI1 | Title (correction) |
Free format text: METHOD FOR BINAURAL SYNTHESIS TAKING INTO ACCOUNT A SPATIAL EFFECT |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
DAX | Request for extension of the european patent (deleted) | ||
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 566649 Country of ref document: AT Kind code of ref document: T Effective date: 20120715 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602007023928 Country of ref document: DE Effective date: 20120906 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2390831 Country of ref document: ES Kind code of ref document: T3 Effective date: 20121116 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20120711 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 566649 Country of ref document: AT Kind code of ref document: T Effective date: 20120711 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D Effective date: 20120711 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121111 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121112 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121012 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 |
|
26N | No opposition filed |
Effective date: 20130412 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121011 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602007023928 Country of ref document: DE Effective date: 20130412 |
|
BERE | Be: lapsed |
Owner name: FRANCE TELECOM Effective date: 20130331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130331 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130308 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130331 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130331 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120711 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20070308 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130308 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240220 Year of fee payment: 18 Ref country code: GB Payment date: 20240220 Year of fee payment: 18 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20240220 Year of fee payment: 18 Ref country code: FR Payment date: 20240220 Year of fee payment: 18 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20240402 Year of fee payment: 18 |