EP1586220A2 - Verfahren und einrichtung zur steuerung einer wiedergabeeinheitdurch verwendung eines mehrkanalsignals - Google Patents
Verfahren und einrichtung zur steuerung einer wiedergabeeinheitdurch verwendung eines mehrkanalsignalsInfo
- Publication number
- EP1586220A2 EP1586220A2 EP04703418A EP04703418A EP1586220A2 EP 1586220 A2 EP1586220 A2 EP 1586220A2 EP 04703418 A EP04703418 A EP 04703418A EP 04703418 A EP04703418 A EP 04703418A EP 1586220 A2 EP1586220 A2 EP 1586220A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- restitution
- determining
- acoustic
- sub
- filters
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 80
- 239000011159 matrix material Substances 0.000 claims description 72
- 230000004044 response Effects 0.000 claims description 56
- 230000006978 adaptation Effects 0.000 claims description 53
- 230000006870 function Effects 0.000 claims description 33
- 230000005855 radiation Effects 0.000 claims description 20
- 238000012545 processing Methods 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 4
- 230000001934 delay Effects 0.000 claims description 4
- 230000004075 alteration Effects 0.000 claims description 2
- 230000009466 transformation Effects 0.000 claims 1
- 238000001914 filtration Methods 0.000 description 19
- 239000013256 coordination polymer Substances 0.000 description 9
- 230000008569 process Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 238000009877 rendering Methods 0.000 description 7
- 230000002123 temporal effect Effects 0.000 description 6
- 238000005457 optimization Methods 0.000 description 5
- 238000009499 grossing Methods 0.000 description 4
- 238000000354 decomposition reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 239000008186 active pharmaceutical agent Substances 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000005520 electrodynamics Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/301—Automatic calibration of stereophonic sound system, e.g. with test microphone
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2205/00—Details of stereophonic arrangements covered by H04R5/00 but not provided for in any of its subgroups
- H04R2205/024—Positioning of loudspeaker enclosures for spatial sound reproduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
Definitions
- the present invention relates to a method and a device for controlling a set of restitution of an acoustic field comprising a plurality of restitution elements, from a plurality of acoustic or audiophonic signals each associated with a general direction of restitution predetermined, defined with respect to a point in the given space.
- Multichannel signal corresponds to a plurality of signals, called channels, transmitted in parallel or multiplexed with each other, each intended for one element or group of restitution elements, arranged in a general direction predefined with respect to at a given point.
- a conventional multichannel system known as “5.1 ITU-R BF 775-1” and comprises five channels intended for rendering elements placed in five predetermined general directions relative to a listening center, defined by angles 0 °, + 30 °, -30 °, + 110 ° and -110 °.
- Such an arrangement therefore corresponds to the arrangement of a loudspeaker or a group of loudspeakers front in the center, one on each side in front on the right and on the left and one on each side behind on the right and on the left.
- control signals are each associated with a determined direction, the application of these signals to a restitution unit whose elements do not correspond to the predetermined spatial configuration, results in significant deformations of the sound field restored.
- the object of the present invention is to remedy this problem, by defining a method and a system for controlling the restitution assembly the spatial configuration of which is arbitrary.
- the subject of the invention is a method for controlling a set of restitution of an acoustic field comprising a plurality of restitution elements each associated with a general direction of predetermined restitution defined with respect to a given point, to obtain a field restored acoustics with specific characteristics substantially independent of the intrinsic restitution characteristics of said assembly, characterized in that it comprises:
- a step of determining at least spatial characteristics of said restitution set allowing the determination of representative parameters for at least one element of said restitution set of its position in the three dimensions of space with respect to said given point;
- step of determining at least spatial characteristics of said restitution set comprises an input sub-step making it possible to determine all or part of the characteristics of said restitution set;
- step of determining at least spatial characteristics of said restitution set includes a calibration step making it possible to deliver all or part of the characteristics of said restitution set;
- said calibration sub-step includes, for at least one of the restitution elements:
- said calibration sub-step further comprises a sub-step of determining the position in at least one of the three dimensions of the space of said at least one element of said restitution assembly;
- said step of determining adaptation filters comprises:
- the decoding, ideal multichannel radiation and adaptation matrices are independent of the frequency, the step of determining at least one control signal of said elements of said reproduction unit by the application of said adaptation filters corresponding to simple linear combinations followed by delay.
- said step of determining the characteristics of said restitution assembly allows the determination of acoustic characteristics of said set ble of restitution and said method comprises a step of determining filters to compensate for these acoustic characteristics, said step of determining at least one control signal then comprising a substep of applying said acoustic compensation filters; - Said step of determining acoustic characteristics is adapted to deliver representative parameters for at least one element of its frequency response;
- step of determining at least one control signal comprises a sub-step of gain adjustment and application of delays in order to temporally align the wavefront of the restitution elements as a function of their distance from said given point.
- the invention also relates to a computer program comprising program code instructions for the execution of the steps of the method when said program is executed by a computer.
- Another subject of the invention is also a removable medium of the type comprising at least one processing processor and one non-volatile memory element, characterized in that said memory comprises a program comprising code instructions for the execution of the steps of the method , when said processor executes said program.
- Another subject of the invention is a device for controlling a set for restoring an acoustic field comprising a plurality of restitution elements, comprising means for inputting a plurality of input signals for acoustic information. each associated with a general direction of predetermined restitution defined with respect to a given point, characterized in that it further comprises:
- means for determining at least spatial characteristics of said restitution set allowing the determination of representative parameters for at least one element of said restitution set of its position in the three dimensions of space with respect to said given point; means for determining adaptation filters from said at least spatial characteristics of said reproduction unit and general directions of predetermined reproduction associated with said plurality of acoustic information input signals; and - Means for determining at least one control signal of said elements of said reproduction unit by applying said adaptation filters to said plurality of acoustic information input signals.
- said means for determining the at least spatial characteristics of said restitution assembly comprise means for direct input of said characteristics
- Said calibration means comprise means for acquiring a sound wave comprising four pressure sensors arranged in a general form of tetrahedron;
- said characteristics determining means are suitable for determining the acoustic characteristics of at least one of said reproduction elements of said reproduction assembly, said device comprising means for determining acoustic compensation filters from said acoustic characteristics and said means of determination of at least one control signal being adapted for the application of said acoustic compensation filters;
- Said means for determining the acoustic characteristics are suitable for determining the frequency response of said elements of the reproduction unit.
- the subject of the invention is also an apparatus for processing audio and video data comprising means for determining a plurality of acoustic information input signals each associated with a general predetermined restitution direction defined by a given point , characterized in that it further comprises a device for controlling a restitution assembly;
- Said means for determining a plurality of input signals are formed by a unit for reading and decoding digital audio and / or video discs.
- Fig.1 is a representation of a spherical coordinate system
- FIG.2 is a diagram of a rendering system according to the invention.
- - Fig.3 is a flow diagram of the method of the invention.
- - Fig.4 is a diagram of calibration means implemented in the method of the invention.
- - Fig.5 is a detailed flowchart of the calibration step
- - Fig.6 is a simplified representation of a sensor used for the implementation of the calibration step
- - Fig.7 is a detailed flowchart of the step of determining adaptation filters.
- Figs.8 and 9 are diagrams of means for determining control signals.
- FIG. 10 is a diagram of an embodiment of a device implementing the method of the invention.
- a conventional spherical coordinate system has been represented, so as to specify the coordinate system to which reference is made in the text.
- This coordinate system is an orthonormal coordinate system, of O origin and comprising three axes (OX), (07) and (02).
- a position denoted x is described by means of its spherical coordinates (r, ⁇ ,), where r denotes the distance from the origin O, ⁇ 9 orientation in the vertical plane and ⁇ orientation in the horizontal plane.
- an acoustic field is known if we define at any point at each time t the acoustic pressure noted p (r, ⁇ , ⁇ , t), whose temporal Fourier transform is noted P (r , ⁇ , ⁇ , f) where / denotes the frequency.
- the invention is based on the use of a family of spatiotemporal functions making it possible to describe the characteristics of any acoustic field.
- these functions are so-called spherical Fourier-Bessel functions of the first kind called hereinafter Fourier-Bessel functions.
- the Fourier-Bessel functions are solutions of the wave equation and constitute a base which generates all the acoustic fields produced by sound sources situated outside this zone. . Any three-dimensional acoustic field is therefore expressed by a linear combination of the Fourier-Bessel functions, according to the expression of the inverse Fourier-Bessel transform which is expressed:
- first species of order v, and y ⁇ n ( ⁇ , ⁇ ) is the real spherical harmonic of order / and of term m, with m going from - / to /, defined by:
- the Fourier-Bessel coefficients are also expressed in the time domain by p ⁇ coefficients, "(t) corresponding to the Fourier transform of the inverse temporal P ⁇ coefficients m (f).
- the method of the invention uses bases of functions expressed as linear combinations, possibly infinite, of Fourier-Bessel functions.
- FIG 2 there is shown schematically a rendering system in which the method of the invention is implemented.
- This system comprises a decoder or adapter 1 controlling a reproduction unit 2 which comprises a plurality of elements 3 ⁇ to 3 / v, such as loudspeakers, loudspeakers or any other sound source or group of sound sources, arranged in any manner in a listening location 4.
- a decoder or adapter 1 controlling a reproduction unit 2 which comprises a plurality of elements 3 ⁇ to 3 / v, such as loudspeakers, loudspeakers or any other sound source or group of sound sources, arranged in any manner in a listening location 4.
- the origin O of the reference that the center of the restitution unit is called center 5.
- the set of spatial, acoustic and electrodynamic characteristics is considered to be the intrinsic characteristics of the restitution set 2.
- the adapter 1 receives as input a signal SI of the multichannel type comprising acoustic information to be restored and a definition signal SL comprising information representative of at least spatial characteristics of the restitution assembly 2 and in particular allowing the determination of parameters representative for at least one element 3 n of the restitution assembly 2 of its position in the three dimensions of the space with respect to the given point 5.
- the adapter 1 transmits to the attention of each of the elements or groups of elements 3 ⁇ to 3 / v of the restitution assembly 2, a signal sc-i specific sc / vde piloting.
- FIG. 3 schematically represents the main steps of the method according to the invention implemented with a rendering system such as that described with reference to FIG. 2.
- This method includes a step 10 for determining operating parameters, adapted to allow at least the determination of the spatial characteristics of the restitution assembly 2.
- Step 10 includes a step 20 for entering the parameters and / or a calibration step 30 making it possible to determine and / or measure characteristics of the restitution assembly 2.
- step 10 also includes a step 40 of determining parameters for describing the predetermined general directions associated with the different channels of the multichannel input signal SI.
- a step 40 of determining parameters for describing the predetermined general directions associated with the different channels of the multichannel input signal SI At the end of step 10, information relating at least to the various predetermined general directions associated with each of the input channels as well as to the position in the three dimensions of the space of each of the elements or groups of elements 3 n of the restitution set 2, are determined.
- This information is used during a step 50 of determining the adaptation filters making it possible to take into account the spatial characteristics of the reproduction unit 2 in order to define filters for adapting the multi-channel input signal to the spatial configuration. specific to the restitution set 2.
- step 10 also makes it possible to determine the acoustic characteristics for all or part of the elements 3 ⁇ to 3 / v of the restitution assembly 2.
- the method comprises a step 60 of determining acoustic compensation filters making it possible to compensate for the influence of specific acoustic characteristics of the elements 3 ⁇ to 3 ⁇ /.
- the filters defined during steps 50 and advantageously 60 can thus be memorized, so that steps 10, 50 and 60 need only be repeated in the event of modification of the spatial configuration of the rendering unit 2 and / or the nature of the multichannel input signal.
- the method then comprises a step 70 of determining the control signals sci to sc / intended for the elements of the restitution assembly 2, comprising a sub-step 80 of applying the adaptation filters determined during step 50 to the different channels c ⁇ (t) to c Q (i) forming the multichannel input signal SI and advantageously, a substep 90 of applying the acoustic compensation filters determined during step 60.
- the signals sci to SCN thus delivered, are applied to the elements 3 ⁇ to 3N of the restitution assembly 2, in order to restore the acoustic field represented by the multichannel input signal SI with an optimum adaptation to the spatial and advantageously acoustic characteristics. , of the restitution set 2.
- the characteristics of the restored sound field are substantially independent of the intrinsic characteristics of restitution of the restitution unit 2 and in particular of its spatial configuration.
- an operator or a suitable memory system can specify all or part of the calculation parameters and in particular:
- This step 20 is implemented by means of a conventional type interface such as a microcomputer or any other suitable means.
- FIG. 4 shows the detail of the calibration means. They include a decomposition module 91, a module 92 for determining the impulse response and a module 93 for determining calibration parameters.
- the calibration means are adapted to be connected to a sound acquisition device 100 such as a microphone or any other suitable device, and to be connected in turn to each element 3radaof the reproduction assembly 2 so to collect information on this element.
- the calibration means emit a specific signal u n (t) such as a pseudo-random sequence MLS (Maximum Length Sequence) for the attention of an element 3 n .
- the acquisition device 100 receives, during a sub-step 34, the sound wave emitted by the element 3 n in response to the reception of the signal u n (t) and transmits I signals cp ⁇ (t) to cpj (t) representative of the wave received at the decomposition module 91.
- the decomposition module 91 decomposes the signals picked up by the acquisition device 100 into a finite number of Fourier-Bessel coefficients q ⁇ , m (t).
- the acquisition device 100 consists of 4 pressure sensors located at the 4 vertices of a tetrahedron of radius R, as shown with reference to FIG. 6.
- the signals from the 4 pressure sensors are then noted cp ⁇ (t) to cp (t).
- the coefficients qo, o ( ⁇ to q ⁇ , ⁇ (t) representative of the picked up acoustic field are deduced from the signals cp ⁇ (t) to cp (f) according to the following relationships:
- CP ⁇ (j) to CP ⁇ ff) are the Fourier transforms from cp ⁇ (f) to cp (t) and Q, o (f) to O, 1; 1 () are the Fourier transforms from qo, o (t) to # 1; ⁇ (t).
- the module 92 determines the response determination impulse responses hp ⁇ ttn (f) connecting the coefficients Fu mulberry-Bessel qi, m (t) and the signal u n (t) .
- the method of determination depends on the specific signal emitted.
- the embodiment described uses a method suitable for signals of the MLS type, such as for example the correlation method.
- the impulse response delivered by the response determination module 92 is addressed to the parameter determination module 93.
- the module 93 deduces information on elements of the restitution set.
- the module 93 for determining parameters determines the distance r Wennbetween the element 3 n and the center 5 from its response hpo , o (t) and from the measurement of the time taken by the sound to propagate from the element 3ußto the acquisition device 100, by means of methods for estimating delay on the response hp Q ⁇ o (t).
- the direction ( ⁇ founded, ⁇ n ) of the element 3 ⁇ is deduced by calculating the maximum of the inverse spherical Fourier transform applied to the responses hp, o (t) to hp ⁇ (t) taken at time t where hpo , o (t) has a maximum.
- the coordinates ⁇ n and ⁇ n are estimated over several instants, preferably chosen around the instant when bp 0) o (t) has a maximum.
- the final determination of the coordinates ⁇ n and ⁇ is obtained by means of averaging techniques between the different estimates.
- the acquisition device 100 is able to unambiguously encode the orientation of a source in space.
- the coordinates ⁇ n and ⁇ n are estimated from other responses among the available hp ⁇ > m (t) or are estimated in the frequency domain from the responses EP ⁇ m (f), corresponding to the Fourier transforms hp ! ⁇ tn (t) responses.
- step 30 makes it possible to determine the parameters r flick, ⁇ alt and ⁇ n .
- the module 93 also delivers the transfer function E réelle(f) of each element 3 n , from the responses hp ⁇ , m (t) from the module 92 for determining the response.
- a first solution consists in constructing the response hp ', 0 (t) corresponding to the selection of the part of the response bp 0 , o (which comprises a non-zero signal and devoid of the reflections introduced by the listening location 4
- the frequency response E réelle(f) is deduced by Fourier transform from the response hp ' 0 ⁇ (t) previously windowed.
- the window can be chosen from conventional smoothing windows, such as rectangular, Hamming, Hanning, and Blackman.
- a second more complex solution consists in applying a smoothing on the module and advantageously on the phase of the frequency response EPo, o (f) obtained by Fourier transform of the response hp 0 , o ( ⁇ .
- the smoothing is obtained by convolution of the response EP 0 , o (f) by a window centered on /
- This convolution corresponds to an averaging of the response EP 0 , o (j) around the frequency /
- the window can be chosen from classic windows, co even for example rectangular, triangles and Hamming.
- the width of the window varies with the frequency.
- the width of the window can be proportional to the frequency / to which the smoothing is applied.
- a variable window with the frequency makes it possible to at least partially eliminate the room effect in the high frequencies while avoiding a truncation effect of the response EPo, o (f) in the low frequencies.
- Substeps 32 to 39 are repeated for all the elements 3 ⁇ to 3 / v of the restitution set 2.
- the calibration means comprise other means for acquiring information relating to the elements 3-. at 3 / v, such as laser position measuring means, signal processing means implementing channel forming techniques or any other suitable means.
- the means implementing the calibration step 30 consist for example of an electronic card or a computer program or any other suitable means.
- Step 40 thus makes it possible, as has been said previously, to determine parameters describing the format of the input multichannel signal and in particular the general predetermined directions associated with each channel.
- This step 40 can correspond to a selection by an operator of a format from a list of formats each associated with stored parameters, and can also correspond to an automatic detection of format performed on the input multichannel signal.
- the method is suitable for a single given multichannel signal format.
- step 40 allows a user to specify his own format by manually entering the parameters describing the directions associated with each channel.
- steps 20, 30 and 40 forming step 10 of determining parameters allow at least the determination of positioning parameters in the space of the elements 3 ⁇ of the restitution set 2 and of the format of the SI multichannel signal.
- FIG. 7 shows a detailed flow diagram of step 50 for determining the adaptation filters. This step includes a plurality of substeps for calculating and determining matrices representative of the parameters determined beforehand.
- a parameter L called limit order representative of the spatial precision desired during the step 50 of determining the adaptation filters, is determined for example in the following manner:
- the maximum order L is automatically determined as being the largest integer respecting the following relation:
- Step 50 of determining adaptation filters then comprises a sub-step 52 of determining a matrix W for weighting the acoustic field.
- This matrix W corresponds to a spatial window W (rf) representative of the distribution in space of the precision desired during the reconstruction of the field.
- This window allows you to specify the size and shape of the area where the control must be correctly reconstructed. For example, it may be a ball centered on the center 5 of the restitution assembly.
- the spatial window and the matrix W are independent of the frequency.
- F is a diagonal matrix of size (E + l) 2 containing weighting coefficients W ⁇ and in which each coefficient W ⁇ is found 2 / + 1 time in succession on the diagonal.
- the matrix Wa therefore has the following form:
- the values taken by the coefficients W ⁇ are the values of a function such as a Hamming window of size 2E + 1 evaluated in /, so that the parameter W ⁇ is determined for / ranging from O to l.
- Step 50 then comprises a sub-step 53 for determining a matrix M representative of the radiation of the restitution unit in particular from the position parameters x aboard.
- the radiation matrix M makes it possible to deduce Fourier-Bessel coefficients representing the acoustic field emitted by each element 3 n of the restitution set as a function of the signal it receives.
- M is a matrix of size (E + l) 2 over N, consisting of elements Mi ', m, n ⁇ the indices l, m designating the line l 2 + l + m and n designating the column n.
- the matrix M therefore has the following form:
- the elements M ⁇ >m> n are obtained from a plane wave radiation model, so that:
- the matrix M thus defined is representative of the radiation of the restitution assembly.
- M is representative of the spatial configuration of the restitution set.
- Substeps 51 to 53 can be executed sequentially or simultaneously.
- the step 50 of determining adaptation filters then comprises a sub-step 54 of taking into account all the parameters of the restitution system 2 determined previously, in order to deliver a decoding matrix D representative of so-called reconstruction filters .
- the elements D nm (f) of the matrix D correspond to reconstruction filters which, applied to the Fourrier-Bessel coefficients P ⁇ , m (f) of a known acoustic field, make it possible to determine the control signals d '' a set of restitution to reproduce this acoustic field.
- the decoding matrix D is therefore the inverse of the radiation matrix M.
- the matrix D is obtained from the matrix M by means of constraint inversion methods involving additional optimization parameters.
- step 50 is adapted to perform an optimization thanks to the weighting matrix of the acoustic field W which in particular makes it possible to reduce the spatial distortion in the reproduced acoustic field.
- the matrices M and W are independent of the frequency, so that the matrix D is also independent of the frequency. It is made up of elements denoted D relieve m organized in the following way:
- Step 54 thus makes it possible to deliver the matrix D representative of so-called reconstruction filters and allowing the reconstruction of an acoustic field from any configuration of the reproduction unit. Thanks to this matrix, the method of the invention makes it possible to take into account the configuration of the restitution assembly 2 and in particular to compensate for the changes in the acoustic field due to its specific spatial configuration.
- each element D nieth , ⁇ f of the matrix D can be determined by associating with each of the N control signals a directivity function D nieth ( ⁇ , ⁇ f) specifying to each frequency / amplitude, and advantageously the desired phase on the control signal sc n in the case of a plane wave in the direction ( ⁇ , ⁇ ).
- the term directivity function D n ( ⁇ , ⁇ f) is understood to mean a function which associates a real or complex value, possibly a function of the frequency or of a frequency range, with each direction of space.
- the directivity functions are independent of the frequency and denoted D relieve( ⁇ , ⁇ ).
- These directivity functions D n ( ⁇ , ⁇ ) can be determined by specifying that certain physical quantities between an ideal field and the same field reproduced by the restitution set comply with predetermined laws. For example, these quantities can be the pressure at the center and the orientation of the velocity vector.
- the active control signals, denoted sc n - ⁇ to scnz, are those which supply the restitution elements whose directions are closest to the direction ( ⁇ , ⁇ ) of the plane wave.
- the active restitution elements denoted 3 blanket ⁇ to 3 relief 3, form a triangle containing the direction ( ⁇ , ⁇ ) of the plane wave.
- a corresponds to the vector containing [D nl ( ⁇ , ⁇ ) ... D n3 ( ⁇ , ⁇ )] and the directions ( ⁇ nl , ⁇ nl ), ( ⁇ profession 2 , ⁇ stamp 2) and ( ⁇ n3 , ⁇ t 3) correspond respectively to the directions of the elements 3 administrat ⁇ , 3 n2 and 3 n3 .
- each of the directivity functions D withdraw( ⁇ , ⁇ ) is provided in the form of a list of K samples.
- Each sample is provided in the form of a pair ⁇ (( ⁇ k , ⁇ k ⁇ D n ( ⁇ k , ⁇ k )) ⁇ where ( ⁇ k , ⁇ k) is the direction of the sample k and where D combat ( ⁇ k , ⁇ k ) is the value of the directivity function associated with the control signal sc n for the direction ( ⁇ k , ⁇ k ).
- n (f) of each directivity function are deduced from the samples ⁇ (( ⁇ k, ⁇ k), D n ( ⁇ k, ⁇ k)) ⁇ -
- These coefficients are obtained by inversion of the sampling process angular which allows to deduce the samples from the list ⁇ (( ⁇ k , ⁇ k), D n ( ⁇ k, ⁇ k)) ⁇ from a directivity function provided in the form of spherical harmonic coefficients. This inversion can take different forms in order to control the interpolation between the samples.
- the directivity functions are directly provided in the form of coefficients E ) endeavour, / ,,“ C of the Fourrier-Bessel type.
- the coefficients D nm (f) thus determined are used to form the matrix D.
- Step 50 then comprises a step 55 of determining an ideal multichannel radiation matrix S representative of the predetermined general directions associated with each channel of the input multichannel signal SI.
- the matrix S is representative of the radiation of an ideal restitution set, that is to say perfectly respecting the predetermined general directions of the multichannel format.
- Each element S ⁇ : tn , q (f) of the matrix S makes it possible to deduce the Fourier-Bessel coefficients P ⁇ , m (f) of the acoustic field ideally restored by each channel c q (t).
- the matrix S is determined by associating with each input channel c q (t) and advantageously for each frequency / a pattern of directivity representative of a distribution of sources supposed to transmit the signal of the channel c q (f).
- the distribution of sources is given in the form of spherical harmonic coefficients S ⁇ , m, q (f).
- the coefficients S., w ,? (/) are stored in the matrix S of size (E + 1) 2 over Q, where Q is the number of channels.
- the shaping step associates with each channel c q (t) a plane wave source oriented in the direction ( ⁇ q , ⁇ q ) corresponding to the direction ( ⁇ , ⁇ ) associated with channel c q (t) in the multichannel input format.
- the coefficients S /, w ,? (/) are then independent of the frequency. They are noted S jW ;? and are obtained by the relation:
- the ideal radiation matrix S associates certain channels c q (t) with a continuous distribution of plane wave sources described by a directivity function S q ( ⁇ , ⁇ ).
- the coefficients S / j7 go ;? of the matrix S are obtained directly by Spherical Fourier transform of the directivity function S q ( ⁇ , ⁇ ).
- the matrix S is independent of the frequency.
- the matrix S associates with certain channels, a distribution of sources producing a diffuse field. In this case, the matrix S varies with the frequency.
- the matrix S associates with certain channels sound sources whose response is not flat.
- the multi-channel format associates with the channel c q (t) a plane wave source of frequency response E (q) (f)
- step 50 includes a sub-step 56 of determining a spatial adaptation matrix A corresponding to the adaptation filters to be applied to the multi-channel input signal to obtain an optimum reproduction taking into account the spatial configuration of the restitution set 2.
- the spatial adaptation matrix A is obtained from the formatting matrices S and decoding D by means of the relation:
- the adaptation matrix A makes it possible to generate signals saj (t) to its N (t) adapted to the spatial configuration of the restitution set from the channels a (t) to c Q (t).
- Each element A n> q (f) is a filter specifying the contribution of the channel c q (t) to the adapted signal sa n (t). Thanks to the adaptation matrix A, the method of the invention allows optimum reproduction of the acoustic field described by the multi-channel signal by a set of restitution of any spatial configuration.
- the matrices D and S are independent of the frequency and the matrix A also.
- the elements of the matrix A are constants denoted A irritationand each of the adapted signals saj (t) à sa ⁇ t) is obtained by simple linear combinations of the input channels cj (t) to c Q (t), if necessary followed by delay as will be described below.
- step 50 of determining adaptation filters comprises a sub-step 57 to determine the filter settings for other filtering methods.
- the filter combinations A n> q (f) are converted to:
- each impulse response a n> q (f) is sampled then truncated to a length proper to each response; or - coefficients of recursive filters with infinite impulse responses calculated from A n JJ) with adaptation methods.
- the parameters of the adaptation filters A n> q (f) are provided.
- Step 60 makes it possible, as has been said previously, to determine the filters for compensating for the acoustic characteristics of the elements of the reproduction unit 2 in the case where parameters relating to these acoustic characteristics such as the frequency responses E n (f), are determined during step 10 of determining the parameters.
- the determination of such filters, denoted E (), from the frequency responses E n (f), can be carried out in a conventional manner by applying methods of inverting filters, such as for example direct inversion, the methods of deconvolution, Wiener methods or others.
- the compensation relates only to the amplitude of the response or else to the amplitude and the phase.
- This step 60 makes it possible to determine a compensation filter for each element 3 n of the restitution assembly 2 as a function of its specific acoustic characteristics.
- the filters can be implemented in different forms of filters and / or filtering methods.
- the filters used are parameterized directly with frequency responses, the responses E (f) are directly applied.
- the step 60 of determining compensation filters comprises a conversion sub-step in order to determine the parameters of the filters for other filtering methods.
- filter combinations E (f) are converted to:
- step 60 the parameters of the EJP compensation filters (f) are provided.
- step 70 of determining control signals we will now describe in more detail the step 70 of determining control signals.
- This step 70 includes a sub-step 80 of applying the adaptation filters represented by the matrix A to the multi-channel input signal SI corresponding to the acoustic field to be restored.
- the adaptation filters A originate ⁇ (f) integrate the characteristic parameters of the restitution set 2.
- signals adapted saj (t) to sa f) are obtained by applying the adaptation filters A n ⁇ (f) to the channels c ⁇ (t) to c Q (t) of the signal IF.
- the adaptation matrix A is independent of the frequency and the adaptation coefficients A réelle > q are applied as follows:
- the adaptation continues with an adjustment of the gains and the application of delays in order to temporally align the wave fronts of the elements 3 ⁇ to 3 / v of the restitution assembly 2 with respect to the most distant element.
- the adaptation matrix A varies with the frequency and the adaptation filters A n Jf) are applied in the following way:
- V n (f) f q (f) A, q (f)
- each filtering of the channels c q (t) by the adaptation filters A renders ⁇ q (f) can be produced according to conventional filtering methods, such as for example:
- the parameters are directly the frequency responses _4 Struktur, ? (/), and the filtering is carried out in the frequency domain, for example, using the usual techniques of convolution by blocks;
- the parameters are directly the finite impulse responses a n, q (f), and the filtering is carried out in the time domain by convolution; or
- the parameters are the coefficients of recursive filters with infinite impulse responses, and the filtering is carried out in the time domain by means of recurrence relations.
- Substep 80 ends with an adjustment of the gains and the application of delays in order to temporally align the wave fronts of the elements 3 ⁇ to 3 / v of the restitution unit 2 relative to the most distant element.
- the signals adapted sa ⁇ (i) to sa ⁇ t) are deduced from the signals v ⁇ (t) to v ⁇ t) according to the expression:
- step 70 includes a sub-step 90 for compensating for the acoustic characteristics of the restitution assembly.
- Each compensation filter EiP (f) is applied to the corresponding signal sa chorus(t) corresponding in order to obtain the control signal sc n (t) of the element 3 n , according to the relation:
- SC n (f) SA n (f) E! P (f)
- SC disregard(f) is the temporal Fourier transform of sc n (t)
- SA n (f) is the temporal Fourier transform of its "(t).
- each filtering of the signals sa n (f) can be carried out according to conventional filtering methods, such as for example:
- the filtering can be carried out by means of filtering methods in the frequency domain, such as for example block convolution techniques;
- filtering parameters are impulse responses h ⁇ (t)
- the filtering can be carried out in the time domain by time convolution;
- the filtering can be carried out in the time domain by means of recursive filters with infinite impulse response.
- the method of the invention does not compensate for the specific acoustic characteristics of the elements of the restitution assembly.
- step 60 and sub-step 90 are not carried out and the adapted signals sa ⁇ (t) to sa ⁇ t) correspond directly to the control signals sci to SON-
- each element 3 ⁇ to 3 / v therefore receives a control signal specific to SCN and emits an acoustic field which contributes to the optimal reconstruction of the acoustic field to be restored.
- the simultaneous control of all of the elements 3 ⁇ to 3w allows an optimal reconstruction of the acoustic field corresponding to the multichannel input signal by the restitution assembly 2 whose spatial configuration is arbitrary, or even does not correspond to a fixed configuration.
- step 50 of determining the spatial adaptation filters can take into account many optimization parameters such as:
- - W ⁇ (f) describing directly in the form of weighting of the Fourier-Bessel coefficients and for each frequency / considered, a spatial window representative of the distribution in the space of constraints of reconstruction of the acoustic field;
- - R (f) representative, for each frequency / considered, of the radius of the spatial window when the latter is a ball;
- All or part of these optimization parameters can intervene during sub-step 54 of determining the decoding matrix _D.
- the parameters, "() and RM (f) are involved in the sub-step 53 determination of the radiation matrix M
- the parameters W (r, f), W ⁇ (f), R (f) are involved in the sub-step 52 of determination of the matrix W
- the parameters ⁇ (l k , m k ) ⁇ (f) intervene in an additional sub-step in the determination of a matrix F.
- the decoding matrix D is then determined during sub-step 54, for each frequency / according to the matrices M, W and and of the parameters G n (f) and ⁇ (f).
- the calculation of the matrix D can be carried out frequency by frequency by considering only the active elements for each frequency considered.
- This method of determining the matrix D involves the parameter G Chris(f) and makes it possible to make the best use of a set of restitution whose elements have different operating frequency bands.
- FIG. 10 shows a diagram of an embodiment of an apparatus implementing the method as described above.
- This device comprises the adapter 1 which is formed by a unit 110 delivering a multi-channel signal such as an audio-video disc playback unit called a DVD player 112.
- the multi-channel signal delivered by the unit 110 is intended for the elements of the restitution unit 2.
- the format of this signal SI is recognized automatically by the adapter 1 which is adapted to make it correspond to parameters describing the predetermined general direction associated with each channel of the signal SI.
- this adapter 1 also incorporates an additional calculation unit 114 as well as means for entering information 116.
- the input means 116 are formed by an infrared interface with a remote control or even with a computer and allow a user to determine the parameters defining the positions in space of the restoring elements 3 ⁇ to 3 ⁇ /.
- the computer 114 applies these adaptation filters to the multichannel signal SI in order to deliver the control signals sc- to SCN intended for the restitution assembly 2.
- the device implementing the invention can take other forms, such as software implemented on a computer or even a complete device integrating calibration means as well as means for entering and determining characteristics. of the more complete restitution package.
- the method can also be implemented in the form of a device dedicated to the optimization of multi-channel rendering systems, external to an audio-video decoder and associated with it.
- the device is suitable for receiving a multichannel signal at the input and delivering at the output control signals for elements of a reproduction unit.
- the device is adapted to be connected to the acquisition device 100 necessary for the calibration step and / or is provided with an interface making it possible to enter parameters, in particular, the position of the elements of the assembly of restitution and possibly the multichannel input format.
- Such an acquisition device 100 can be connected in a wired or non-wired manner (radio, infrared) and can be integrated into an accessory, such as a remote control, or be independent.
- the method can be implemented by a device integrated into an element of an audio-video chain responsible for processing multichannel signals, such as for example a so-called “surround” processor or decoder, an audio-video amplifier incorporating decoding functions multichannel or a fully integrated audio-video channel.
- the method of the invention can also be implemented in an electronic card or in a dedicated chip.
- it can be integrated in the form of a program into a signal processing processor (DSP).
- DSP signal processing processor
- the method may take the form of a computer program intended to be executed by a computer. The program receives as input a multi-channel signal and delivers the control signals from a restitution set possibly integrated into this computer.
- the calibration means can be produced by implementing a process different from that described above, such as for example, a process inspired by techniques described in the patent application in France filed on May 7, 2002 under number 02 05 741.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Stereophonic System (AREA)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0300571 | 2003-01-20 | ||
FR0300571A FR2850183B1 (fr) | 2003-01-20 | 2003-01-20 | Procede et dispositif de pilotage d'un ensemble de restitution a partir d'un signal multicanal. |
PCT/FR2004/000115 WO2004068463A2 (fr) | 2003-01-20 | 2004-01-20 | Procede et dispositif de pilotage d'un ensemble de restitution a partir d'un signal multicanal |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1586220A2 true EP1586220A2 (de) | 2005-10-19 |
EP1586220B1 EP1586220B1 (de) | 2013-10-23 |
Family
ID=32605871
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP04703418.6A Expired - Lifetime EP1586220B1 (de) | 2003-01-20 | 2004-01-20 | Verfahren und einrichtung zur steuerung einer wiedergabeeinheitdurch verwendung eines mehrkanalsignals |
Country Status (7)
Country | Link |
---|---|
US (1) | US8213621B2 (de) |
EP (1) | EP1586220B1 (de) |
JP (1) | JP2006517072A (de) |
KR (1) | KR101248505B1 (de) |
CN (1) | CN1751540B (de) |
FR (1) | FR2850183B1 (de) |
WO (1) | WO2004068463A2 (de) |
Families Citing this family (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8078659B2 (en) * | 2005-10-31 | 2011-12-13 | Telefonaktiebolaget L M Ericsson (Publ) | Reduction of digital filter delay |
GB0523946D0 (en) * | 2005-11-24 | 2006-01-04 | King S College London | Audio signal processing method and system |
US7864968B2 (en) * | 2006-09-25 | 2011-01-04 | Advanced Bionics, Llc | Auditory front end customization |
FR2915041A1 (fr) * | 2007-04-13 | 2008-10-17 | Canon Kk | Procede d'attribution d'une pluralite de canaux audio a une pluralite de haut-parleurs, produit programme d'ordinateur, moyen de stockage et noeud gestionnaire correspondants. |
US20090232316A1 (en) * | 2008-03-14 | 2009-09-17 | Chieh-Hung Chen | Multi-channel blend system for calibrating separation ratio between channel output signals and method thereof |
US20100057472A1 (en) * | 2008-08-26 | 2010-03-04 | Hanks Zeng | Method and system for frequency compensation in an audio codec |
EP2309781A3 (de) | 2009-09-23 | 2013-12-18 | Iosono GmbH | Vorrichtung und Verfahren zur Berechnung der Filterkoeffizienten für vordefinierte Lautsprecheranordnung |
US9025776B2 (en) * | 2010-02-01 | 2015-05-05 | Rensselaer Polytechnic Institute | Decorrelating audio signals for stereophonic and surround sound using coded and maximum-length-class sequences |
JP5387478B2 (ja) * | 2010-03-29 | 2014-01-15 | ソニー株式会社 | 音声再生装置及び音声再生方法 |
NZ587483A (en) | 2010-08-20 | 2012-12-21 | Ind Res Ltd | Holophonic speaker system with filters that are pre-configured based on acoustic transfer functions |
US20120148075A1 (en) * | 2010-12-08 | 2012-06-14 | Creative Technology Ltd | Method for optimizing reproduction of audio signals from an apparatus for audio reproduction |
US20130051572A1 (en) * | 2010-12-08 | 2013-02-28 | Creative Technology Ltd | Method for optimizing reproduction of audio signals from an apparatus for audio reproduction |
US9031268B2 (en) | 2011-05-09 | 2015-05-12 | Dts, Inc. | Room characterization and correction for multi-channel audio |
WO2012164444A1 (en) * | 2011-06-01 | 2012-12-06 | Koninklijke Philips Electronics N.V. | An audio system and method of operating therefor |
TWI453451B (zh) * | 2011-06-15 | 2014-09-21 | Dolby Lab Licensing Corp | 擷取與播放源於多音源的聲音之方法 |
WO2014032709A1 (en) | 2012-08-29 | 2014-03-06 | Huawei Technologies Co., Ltd. | Audio rendering system |
BR122022004083B1 (pt) | 2014-01-16 | 2023-02-23 | Sony Corporation | Dispositivo e método de processamento de áudio, e, meio de armazenamento não transitório legível por computador |
KR102362121B1 (ko) * | 2015-07-10 | 2022-02-11 | 삼성전자주식회사 | 전자 장치 및 그 입출력 방법 |
CN111972928B (zh) * | 2020-08-21 | 2023-01-24 | 浙江指云信息技术有限公司 | 一种具有环绕音场的助睡眠枕头及其调控方法 |
CN112014639B (zh) * | 2020-09-02 | 2022-07-05 | 安徽一天电能质量技术有限公司 | 一种交流电力谐波向量测量方法 |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4060850A (en) * | 1977-04-25 | 1977-11-29 | The United States Of America As Represented By The Secretary Of The Navy | Beam former using bessel sequences |
US4893342A (en) * | 1987-10-15 | 1990-01-09 | Cooper Duane H | Head diffraction compensated stereo system |
US5757927A (en) * | 1992-03-02 | 1998-05-26 | Trifield Productions Ltd. | Surround sound apparatus |
US6154549A (en) * | 1996-06-18 | 2000-11-28 | Extreme Audio Reality, Inc. | Method and apparatus for providing sound in a spatial environment |
US5889867A (en) * | 1996-09-18 | 1999-03-30 | Bauck; Jerald L. | Stereophonic Reformatter |
JP3539855B2 (ja) * | 1997-12-03 | 2004-07-07 | アルパイン株式会社 | 音場制御装置 |
DE19847689B4 (de) * | 1998-10-15 | 2013-07-11 | Samsung Electronics Co., Ltd. | Vorrichtung und Verfahren zur dreidimensionalen Tonwiedergabe |
JP2000261900A (ja) * | 1999-03-09 | 2000-09-22 | Sony Corp | 音場補正方法および音響装置。 |
JP2000354300A (ja) * | 1999-06-11 | 2000-12-19 | Accuphase Laboratory Inc | マルチチャンネルオーディオ再生装置 |
JP2001157293A (ja) * | 1999-12-01 | 2001-06-08 | Matsushita Electric Ind Co Ltd | スピーカ装置 |
US7158643B2 (en) * | 2000-04-21 | 2007-01-02 | Keyhold Engineering, Inc. | Auto-calibrating surround system |
JP2002345097A (ja) * | 2001-05-15 | 2002-11-29 | Sony Corp | サラウンド音場再生システム |
FR2836571B1 (fr) * | 2002-02-28 | 2004-07-09 | Remy Henri Denis Bruno | Procede et dispositif de pilotage d'un ensemble de restitution d'un champ acoustique |
-
2003
- 2003-01-20 FR FR0300571A patent/FR2850183B1/fr not_active Expired - Lifetime
-
2004
- 2004-01-20 US US10/542,774 patent/US8213621B2/en active Active
- 2004-01-20 EP EP04703418.6A patent/EP1586220B1/de not_active Expired - Lifetime
- 2004-01-20 WO PCT/FR2004/000115 patent/WO2004068463A2/fr active Application Filing
- 2004-01-20 JP JP2006502106A patent/JP2006517072A/ja active Pending
- 2004-01-20 CN CN2004800045331A patent/CN1751540B/zh not_active Expired - Lifetime
- 2004-01-20 KR KR1020057013320A patent/KR101248505B1/ko active IP Right Grant
Non-Patent Citations (1)
Title |
---|
See references of WO2004068463A2 * |
Also Published As
Publication number | Publication date |
---|---|
FR2850183A1 (fr) | 2004-07-23 |
KR101248505B1 (ko) | 2013-04-03 |
WO2004068463A3 (fr) | 2005-08-25 |
CN1751540A (zh) | 2006-03-22 |
EP1586220B1 (de) | 2013-10-23 |
JP2006517072A (ja) | 2006-07-13 |
FR2850183B1 (fr) | 2005-06-24 |
KR20050103280A (ko) | 2005-10-28 |
WO2004068463A2 (fr) | 2004-08-12 |
CN1751540B (zh) | 2012-08-08 |
US20060167963A1 (en) | 2006-07-27 |
US8213621B2 (en) | 2012-07-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1586220B1 (de) | Verfahren und einrichtung zur steuerung einer wiedergabeeinheitdurch verwendung eines mehrkanalsignals | |
EP1563485B1 (de) | Verfahren zur verarbeitung von audiodateien und erfassungsvorrichtung zur anwendung davon | |
EP2898707B1 (de) | Optimierte kalibrierung eines klangwiedergabesystems mit mehreren lautsprechern | |
EP1546916B1 (de) | Verfahren und vorrichtung zum verarbeiten einer darstellung eines akustischen feldes | |
EP1836876B1 (de) | Verfahren und vorrichtung zur individualisierung von hrtfs durch modellierung | |
EP1479266B1 (de) | Verfahren und vorrichtung zur steuerung einer anordnung zur wiedergabe eines schallfeldes | |
EP1992198B1 (de) | Optimierung des binauralen raumklangeffektes durch mehrkanalkodierung | |
EP1946612A1 (de) | Hrtfs-individualisierung durch modellierung mit finiten elementen gekoppelt mit einem revidierungsmodell | |
JP2009512364A (ja) | 仮想オーディオシミュレーション | |
EP1652406B1 (de) | System und verfahren zur bestimmung einer repräsentation eines akustischen feldes | |
EP1502475B1 (de) | Verfahren und system zum repräsentieren eines schallfeldes | |
FR3065137A1 (fr) | Procede de spatialisation sonore | |
FR2890280A1 (fr) | Procede de filtrage numerique et de compensation pour lineariser la courbe de reponse d'une enceinte acoustique et moyens mis en oeuvre | |
EP3384688B1 (de) | Aufeinanderfolgende dekompositionen von audiofiltern | |
Fonseca et al. | Measurement of car cabin binaural impulse responses and auralization via convolution | |
Fontana et al. | A system for rapid measurement and direct customization of head related impulse responses | |
EP3934282A1 (de) | Verfahren zur umwandlung eines ersten satzes repräsentativer signale eines schallfelds in einen zweiten satz von signalen und entsprechende elektronische vorrichtung | |
Meng | Impulse response measurement and spatio-temporal response acquisition |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20050714 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL LT LV MK |
|
DAX | Request for extension of the european patent (deleted) | ||
17Q | First examination report despatched |
Effective date: 20110124 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20130503 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 638125 Country of ref document: AT Kind code of ref document: T Effective date: 20131115 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602004043628 Country of ref document: DE Effective date: 20131219 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20131023 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 638125 Country of ref document: AT Kind code of ref document: T Effective date: 20131023 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140224 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602004043628 Country of ref document: DE |
|
BERE | Be: lapsed |
Owner name: TRINNOV AUDIO Effective date: 20140131 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140120 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 |
|
26N | No opposition filed |
Effective date: 20140724 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140131 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140131 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602004043628 Country of ref document: DE Effective date: 20140724 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140120 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140131 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 13 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140124 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20040120 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131023 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20170929 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170131 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 14 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: RN Effective date: 20171128 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 15 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: FC Effective date: 20171226 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170131 |
|
PGRI | Patent reinstated in contracting state [announced from national office to epo] |
Ref country code: FR Effective date: 20171226 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 16 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20221212 Year of fee payment: 20 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230123 Year of fee payment: 20 Ref country code: DE Payment date: 20230112 Year of fee payment: 20 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R071 Ref document number: 602004043628 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: PE20 Expiry date: 20240119 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION Effective date: 20240119 |