EP1994526A1 - Joint sound synthesis and spatialization - Google Patents
Joint sound synthesis and spatializationInfo
- Publication number
- EP1994526A1 EP1994526A1 EP07731685A EP07731685A EP1994526A1 EP 1994526 A1 EP1994526 A1 EP 1994526A1 EP 07731685 A EP07731685 A EP 07731685A EP 07731685 A EP07731685 A EP 07731685A EP 1994526 A1 EP1994526 A1 EP 1994526A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- spatialization
- parameters
- source
- channel
- synthesis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003786 synthesis reaction Methods 0.000 title claims abstract description 43
- 230000015572 biosynthetic process Effects 0.000 title claims abstract description 42
- 238000000034 method Methods 0.000 claims abstract description 40
- 230000003595 spectral effect Effects 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 5
- 230000015654 memory Effects 0.000 claims description 3
- 238000009877 rendering Methods 0.000 claims description 3
- 230000002194 synthesizing effect Effects 0.000 claims description 2
- 230000003936 working memory Effects 0.000 claims description 2
- 238000004364 calculation method Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 238000001228 spectrum Methods 0.000 description 5
- 230000006978 adaptation Effects 0.000 description 3
- 239000000654 additive Substances 0.000 description 3
- 230000000996 additive effect Effects 0.000 description 3
- 230000005236 sound signal Effects 0.000 description 3
- 238000005070 sampling Methods 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 241001362574 Decodes Species 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000001308 synthesis method Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H7/00—Instruments in which the tones are synthesised from a data store, e.g. computer organs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
- H04S3/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
- G10H2210/155—Musical effects
- G10H2210/265—Acoustic effect simulation, i.e. volume, spatial, resonance or reverberation effects added to a musical sound, usually by appropriate filtering or delays
- G10H2210/295—Spatial effects, musical uses of multiple audio channels, e.g. stereo
- G10H2210/301—Soundscape or sound field simulation, reproduction or control for musical purposes, e.g. surround or 3D sound; Granular synthesis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
- H04R2499/10—General applications
- H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
Definitions
- the present invention relates to audio processing and, more particularly, to three-dimensional spatialization of synthetic sound sources.
- non-parametric methods are known. No particular parameter is used a priori to modify samples previously stored in memory.
- the best-known representative of these methods is classical wave table synthesis.
- Parametric synthesis methods which rely on the use of a model that makes it possible to manipulate a small number of parameters, compared to the number of signal samples produced in the sense of the non-parametric methods.
- Parametric synthesis techniques typically rely on additive, subtractive, source / filter or non-linear models.
- Some techniques are based on the consideration of HRTFs ("Head Related Transfer Function") transfer functions representing the disturbance of acoustic waves by the morphology of an individual, these HRTFs functions being specific to this individual.
- HRTFs Head Related Transfer Function
- the sound reproduction is carried out in a way adapted to the HRTFs of the listener, typically on two remote speakers (“transauraf") or from the two earpieces of a headset (“binaural")
- Other techniques for example Vamphonic "or the” multichannel "(5.1 to 10.1 or more) provide rather a restitution on more than two speakers.
- some HRTFs techniques use the separation of the frequency and position variables of the HRTFs, thus giving a set of p basic filters (corresponding to the first p eigenvalues of the covariance matrix of the HRTFs whose variables statistics are the frequencies), these filters being weighted by spatial functions (obtained by projection of the HRTFs on basic filters).
- the spatial functions can then be interpolated, as described in US-5,500,900.
- Spatialization of many sound sources can be achieved through a multichannel implementation applied to the signal of each of the sound sources.
- the gains of the spatialization channels are applied directly to the sound samples of the signal, often described in the time domain (but possibly also in the frequency domain). These samples sound are processed by a spatial isation algorithm (with gain applications that depend on the desired position), irrespective of the origin of these samples.
- the proposed spatialization could apply to both natural and synthetic sounds.
- each sound source must be synthesized independently (with a temporal or frequency signal), in order to then be able to apply independent spatialization gains.
- N sound sources it is therefore necessary to perform N synthesis calculations.
- the application of the gains to sound samples, whether they come from the time or frequency domain, requires at least as many multiplications as there are samples.
- Q gains M being the number of intermediate channels (surround channels for example) and N being the number of sources.
- this technique requires a high calculation cost in the case of the spatialization of many sound sources.
- the so-called “virtual loudspeakers” method makes it possible to encode the signals to be spatialized by applying them in particular gains, the decoding being done by convolution of the signals encoded by pre-calculated filters (Jérians Daniel, "Representation of acoustic fields, application to the transmission and reproduction of complex sound scenes in a multimedia context", PhD Thesis, 2000).
- an exemplary embodiment which is referred to in this document WO-05/069272 and in which the sources are synthesized by associating amplitudes at frequencies constituting a "sound tone" (for example a fundamental frequency and its harmonics ), plans to group synthesized signals by identical frequencies, with a view to subsequent spatialization operating on the frequencies.
- a "sound tone” for example a fundamental frequency and its harmonics
- FIG. 1 This exemplary embodiment is illustrated in FIG. 1.
- S N respective amplitudes a 0 1 , ai 1 , ..., a p 1 , ..., a /, ..., a 0 N , a- ⁇ ..., a p N , where, in the general notation al, j is a source index between 1 and N and i is a frequency index between 0 and p.
- amplitudes of a set ao j , a- ⁇ j , ..., a p j to be assigned to the same source j can be zero if the corresponding frequencies are not represented in the sound signal of this source j .
- the amplitudes ai 1 , ..., ai N relative to each frequency fi are grouped ("mixed") to be applied, frequency by frequency, to the SPAT spatialization block for encoding operating on the frequencies (in binaural for example, in anticipating interaural delay to be applied to each source).
- the signals of the channels Ci,..., C k , originating from the spatialization block SPAT, are then intended to be transmitted through one or more networks, or else stored, or other, for the purpose of a subsequent restitution (preceded by where appropriate, a suitable spatialization decoding). This technique, although very promising, still deserves some optimizations.
- the present invention improves the situation.
- a method for jointly synthesizing and spatialising a plurality of sound sources in associated positions of the space comprising: a) a step of assigning to each source at least one parameter representative of a amplitude, b) a spatialization step implementing an encoding in a plurality of channels, in which each amplitude parameter is duplicated to multiply by a spatialization gain, each spatialization gain being determined, on the one hand, for an encoding channel and, secondly, for a source to be spatialised, c) a step of grouping the parameters multiplied by the gains, in respective channels, by applying a sum of said multiplied parameters to all the sources for each channel and d) a parametric synthesis step applied to each of the channels.
- the present invention proposes for this purpose to first apply a spatialization encoding, then a "pseudo-synthesis", the term “pseudo” aiming at the fact that the synthesis applies in particular to the encoded parameters, derived from spatialization and not to usual synthetic sound signals.
- a feature that the invention proposes is the spatial encoding of some synthesis parameters, rather than performing a spatial encoding of the signals corresponding directly to the sources.
- This spatial encoding applies more particularly to synthesis parameters which are representative of an amplitude and it advantageously consists in applying to these few synthesis parameters spatialization gains which are calculated as a function of respective desired positions of the sources. It will thus be understood that the parameters multiplied by the gains in step b) and grouped in step c) are not really sound signals, as in the general prior art described above.
- the present invention uses a mutual parametric synthesis where one of the parameters has the dimension of an amplitude. Unlike techniques of the prior art, it thus takes advantage of the advantages of such a synthesis to perform the spatialization.
- the combination of synthesis parameter sets obtained for each of the sources advantageously makes it possible to globally control the encoded blocks of mutual parametric synthesis.
- the present invention then makes it possible to spatialize simultaneously and independently of numerous synthesized sound sources from a parametric synthesis model, the spatialization gains being applied to the synthesis parameters rather than to the samples of the time or frequency domain. This embodiment thus ensures a substantial saving of the computing power required because it implies a low calculation cost.
- the technique in the sense of the invention requires fewer calculations than the usual techniques in the sense of the prior art. For example, at the surround order 1 and in two dimensions (ie three intermediate channels), the invention already allows a calculation gain for only four sources to spatialize.
- the present invention also makes it possible to reduce the number of gains to be applied. Indeed, the gains are applied to the synthesis parameters and not to the sound samples. Updating parameters such as the volume is generally less frequent than the sampling frequency of a signal, a calculation economy is thus achieved. For example, for a frequency of updating parameters (such as the volume in particular) of 200 Hz, a substantial saving in multiplication is achieved for a sampling frequency of the signal of 44100 Hz
- the fields of application of the present invention may concern both the musical field (including polyphonic ringtones of mobiles), the field of multimedia (including video game sound systems), the field of virtual reality (rendering of sound scenes). , simulators (synthesis of engine noise), or others.
- FIG. 2 illustrates the general processing of spatialization and synthesis provided for in a method according to the invention
- FIG. 3 illustrates a processing of the spatialized and synthesized signals for spatial decoding with a view to restitution
- FIG. 4 illustrates a particular embodiment in which several amplitude parameters are assigned to each source, each parameter being associated with a frequency component
- FIG. 5 illustrates the steps of a method in the sense of the invention, and may correspond to a flowchart of a computer program for the implementation of the invention.
- At least one parameter Pi is assigned to a source Si from among a plurality of sources Si, ..., S N to be synthesized and spatialized (i being between 1 and N ).
- Each parameter pi is duplicated in as many spatialization channels provided in the spatialization block SPAT.
- M encoding channels are provided for the spatialization
- each parameter pi is duplicated M to apply respective spatialization gains g ⁇ ..., where M (i being, as a reminder, an index of source Si).
- M i being, as a reminder, an index of source Si
- new parameters p TM (i varying from 1 to N and m varying from 1 to M) are calculated by multiplying the parameters pi by the encoding gains g TM, obtained from the position of each of the sources.
- the parameters Pi m are combined (by summation in the example described) to provide the parameters p g m which feed M mutual parametric synthesis blocks.
- These M blocks constitute the synthesis module SYNTH, which delivers M time or frequency signals ss m (m varying from 1 to M), obtained by synthesis from of the parameters p g m .
- These signals ss m can then feed a conventional block of spatial decoding, as will be seen below with reference to FIG.
- the synthesis used is an additive synthesis with application of an inverse Fourier transform (IFFT).
- IFFT inverse Fourier transform
- a set of N sources is characterized by a plurality of parameters pi, k representing the amplitude in the frequency domain of the kth frequency component for the ith source Sj.
- the time signal Si (n) that would correspond to this source If, if it were synthesized independently of the other sources, would be given by:
- the parameter Pi, k represents the amplitude of a given frequency component k for a given source Si.
- G gains are predetermined for a desired position for the source Si and according to the selected spatialization encoding.
- Y m is a spherical harmonic of order m
- ⁇ i and ⁇ i are respectively the azimuth and the desired site for the Si source.
- the parameters p m i, k are then combined frequency by frequency, so as to obtain a single global parameter:
- the value of k 1 is less than ki because common frequencies can characterize several sources at once. In one embodiment, it may be provided to associate the same global set of frequencies to all sources, even if certain amplitude parameters for certain source frequencies are zero.
- the synthesis step consists of using these parameters p m g , k (m varying from 1 to M) to synthesize each of the M frequency spectra ss m ( ⁇ ) from the SYNTH synthesis module. It may be provided for this purpose to apply the technique described in FR-2,679,689, iteratively adding spectral envelopes corresponding to the Fourier transform of a time window (for example Hanning), these spectral envelopes being previously sampled , tabulated, centered at frequencies fk and then weighted by p m g , k , which is written as:
- K amplitude parameters p iik are assigned to each source Sj.
- the index i, of source is between 1 and N.
- the index k, of frequency is between 1 and K.
- K parameters are duplicated, M times, to be multiplied each by one gain Spatialization g TM.
- the index m, of spatialization encoding channel is between 1 and M.
- the processing then continues by multiplying the global parameter of each subchannel p m g , k associated with a frequency fk by a spectral envelope envk ( ⁇ ) centered at this frequency fk, and this, for all the K subchannels ( k between 1 and K), and globally, for all M channels (m being between 1 and M). Then the sub-channels K are summed in each channel m, according to the following relation:
- ss m ( ⁇ ") env k ⁇ ), for m ranging from 1 to M channels in total.
- the signals ss, m m (/ ⁇ ) encoded for their spatialization and synthesized in the sense of the invention are then obtained. They are expressed in the frequency domain.
- SS m (n) IFFT (ss m ( ⁇ )).
- successive frames can be achieved by a conventional technique of addition / overlap.
- SS m (n) can then be supplied to a spatialization decoding block.
- the processing performed by the spatial decoding DECOD block of FIG. 3 can be of the type:
- the adaptation filters from the surround format to the binaural format can be applied directly in the frequency domain, thus avoiding convolution in the time domain and a corresponding calculation cost.
- the spectra are then summed by ear before performing the inverse Fourier transform and the addition / recovery operation, ie:
- the present invention also relates to a computer program product, whether it is stored in a memory of a central unit or a terminal, or on a removable support adapted to cooperate with a reader of this central unit.
- This program comprises in particular instructions for the implementation of the method described above and a flowchart can be illustrated by way of example in Figure 5, summarizing the steps of such a method.
- Step a) is aimed at assigning the parameters representative of an amplitude to each source Sj.
- a parameter pi, k is assigned by frequency component f k as described above.
- Step b) aims at the duplication of these parameters and their multiplication by the gains g TM of the encoding channels.
- Step c) relates to the grouping of the products obtained in step b), with in particular the calculation of their sum on all Si sources.
- Step d) targets the parametric synthesis with multiplication by a spectral envelope env k as described above, followed by a grouping of the subchannels by applying, in each channel, a sum over all the frequency components (d index k ranging from 1 to K).
- Step e) aims at decoding the spatialization of the signals ss m originating from the respective channels, synthesized, spatialised and represented in the frequency domain, for a reproduction on two loudspeakers, for example in binaural format.
- the present invention also provides a device for generating synthetic and spatialized sounds, comprising in particular a processor, and in particular a working memory adapted to store instructions of the computer program product defined above.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Stereophonic System (AREA)
- Telephone Function (AREA)
- Telephone Set Structure (AREA)
- Golf Clubs (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
Description
Claims
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PL07731685T PL1994526T3 (en) | 2006-03-13 | 2007-03-01 | Joint sound synthesis and spatialization |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0602170 | 2006-03-13 | ||
PCT/FR2007/050868 WO2007104877A1 (en) | 2006-03-13 | 2007-03-01 | Joint sound synthesis and spatialization |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1994526A1 true EP1994526A1 (en) | 2008-11-26 |
EP1994526B1 EP1994526B1 (en) | 2009-10-28 |
Family
ID=37400911
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP07731685A Active EP1994526B1 (en) | 2006-03-13 | 2007-03-01 | Joint sound synthesis and spatialization |
Country Status (8)
Country | Link |
---|---|
US (1) | US8059824B2 (en) |
EP (1) | EP1994526B1 (en) |
JP (1) | JP5051782B2 (en) |
AT (1) | ATE447224T1 (en) |
DE (1) | DE602007002993D1 (en) |
ES (1) | ES2335246T3 (en) |
PL (1) | PL1994526T3 (en) |
WO (1) | WO2007104877A1 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8786852B2 (en) | 2009-12-02 | 2014-07-22 | Lawrence Livermore National Security, Llc | Nanoscale array structures suitable for surface enhanced raman scattering and methods related thereto |
US9395304B2 (en) | 2012-03-01 | 2016-07-19 | Lawrence Livermore National Security, Llc | Nanoscale structures on optical fiber for surface enhanced Raman scattering and methods related thereto |
US9788135B2 (en) | 2013-12-04 | 2017-10-10 | The United States Of America As Represented By The Secretary Of The Air Force | Efficient personalization of head-related transfer functions for improved virtual spatial audio |
EP3523988A4 (en) * | 2016-10-04 | 2020-03-11 | Omnio Sound Limited | Stereo unfold technology |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2679689B1 (en) * | 1991-07-26 | 1994-02-25 | Etat Francais | METHOD FOR SYNTHESIZING SOUNDS. |
JPH08502867A (en) | 1992-10-29 | 1996-03-26 | ウィスコンシン アラムニ リサーチ ファンデーション | Method and device for producing directional sound |
US5596644A (en) | 1994-10-27 | 1997-01-21 | Aureal Semiconductor Inc. | Method and apparatus for efficient presentation of high-quality three-dimensional audio |
FR2782228B1 (en) | 1998-08-05 | 2001-05-25 | Ct Scient Tech Batiment Cstb | SOUND SIMULATION DEVICE AND METHOD FOR PRODUCING SUCH A DEVICE |
FR2847376B1 (en) * | 2002-11-19 | 2005-02-04 | France Telecom | METHOD FOR PROCESSING SOUND DATA AND SOUND ACQUISITION DEVICE USING THE SAME |
FI118247B (en) * | 2003-02-26 | 2007-08-31 | Fraunhofer Ges Forschung | Method for creating a natural or modified space impression in multi-channel listening |
FR2851879A1 (en) * | 2003-02-27 | 2004-09-03 | France Telecom | PROCESS FOR PROCESSING COMPRESSED SOUND DATA FOR SPATIALIZATION. |
CN1886780A (en) * | 2003-12-15 | 2006-12-27 | 法国电信 | Method for synthesizing acoustic spatialization |
SE0400998D0 (en) * | 2004-04-16 | 2004-04-16 | Cooding Technologies Sweden Ab | Method for representing multi-channel audio signals |
US8204261B2 (en) * | 2004-10-20 | 2012-06-19 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Diffuse sound shaping for BCC schemes and the like |
AU2007271532B2 (en) * | 2006-07-07 | 2011-03-17 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Apparatus and method for combining multiple parametrically coded audio sources |
JP5021809B2 (en) * | 2007-06-08 | 2012-09-12 | ドルビー ラボラトリーズ ライセンシング コーポレイション | Hybrid derivation of surround sound audio channels by controllably combining ambience signal components and matrix decoded signal components |
-
2007
- 2007-03-01 ES ES07731685T patent/ES2335246T3/en active Active
- 2007-03-01 DE DE602007002993T patent/DE602007002993D1/en active Active
- 2007-03-01 JP JP2008558857A patent/JP5051782B2/en active Active
- 2007-03-01 US US12/225,097 patent/US8059824B2/en active Active
- 2007-03-01 WO PCT/FR2007/050868 patent/WO2007104877A1/en active Application Filing
- 2007-03-01 PL PL07731685T patent/PL1994526T3/en unknown
- 2007-03-01 EP EP07731685A patent/EP1994526B1/en active Active
- 2007-03-01 AT AT07731685T patent/ATE447224T1/en not_active IP Right Cessation
Non-Patent Citations (1)
Title |
---|
See references of WO2007104877A1 * |
Also Published As
Publication number | Publication date |
---|---|
ES2335246T3 (en) | 2010-03-23 |
EP1994526B1 (en) | 2009-10-28 |
JP5051782B2 (en) | 2012-10-17 |
JP2009530883A (en) | 2009-08-27 |
US20090097663A1 (en) | 2009-04-16 |
WO2007104877A1 (en) | 2007-09-20 |
US8059824B2 (en) | 2011-11-15 |
ATE447224T1 (en) | 2009-11-15 |
PL1994526T3 (en) | 2010-03-31 |
DE602007002993D1 (en) | 2009-12-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1600042B1 (en) | Method for the treatment of compressed sound data for spatialization | |
EP2000002B1 (en) | Method and device for efficient binaural sound spatialization in the transformed domain | |
EP1992198B1 (en) | Optimization of binaural sound spatialization based on multichannel encoding | |
EP1563485B1 (en) | Method for processing audio data and sound acquisition device therefor | |
EP2042001B1 (en) | Binaural spatialization of compression-encoded sound data | |
WO2007110520A1 (en) | Method for binaural synthesis taking into account a theater effect | |
EP1999999A1 (en) | Generation of spatial downmixes from parametric representations of multi channel signals | |
FR2762467A1 (en) | MULTI-CHANNEL ACOUSTIC ECHO CANCELLATION METHOD AND MULTI-CHANNEL ACOUSTIC ECHO CANCELLATOR | |
EP1695335A1 (en) | Method for synthesizing acoustic spatialization | |
EP1886535B1 (en) | Method of producing a plurality of time signals | |
KR102660704B1 (en) | Spectrally orthogonal audio component processing | |
EP1994526B1 (en) | Joint sound synthesis and spatialization | |
EP3400599B1 (en) | Improved ambisonic encoder for a sound source having a plurality of reflections | |
EP3025514B1 (en) | Sound spatialization with room effect | |
WO2023232586A1 (en) | Signal processing method | |
CN117678014A (en) | Colorless generation of elevation-aware cues using an all-pass filter network | |
WO2006097633A1 (en) | Method and system for spatializing an audio signal based on its intrinsic qualities |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20080828 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
17Q | First examination report despatched |
Effective date: 20090616 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REF | Corresponds to: |
Ref document number: 602007002993 Country of ref document: DE Date of ref document: 20091210 Kind code of ref document: P |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2335246 Country of ref document: ES Kind code of ref document: T3 |
|
LTIE | Lt: invalidation of european patent or patent extension |
Effective date: 20091028 |
|
REG | Reference to a national code |
Ref country code: PL Ref legal event code: T3 |
|
NLV1 | Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act | ||
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100301 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100228 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FD4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100128 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 Ref country code: IE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
BERE | Be: lapsed |
Owner name: FRANCE TELECOM Effective date: 20100331 |
|
26N | No opposition filed |
Effective date: 20100729 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100331 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100129 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110331 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100429 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100301 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20091028 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240220 Year of fee payment: 18 Ref country code: GB Payment date: 20240220 Year of fee payment: 18 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: PL Payment date: 20240226 Year of fee payment: 18 Ref country code: FR Payment date: 20240220 Year of fee payment: 18 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20240402 Year of fee payment: 18 |