EP1586220A2 - Verfahren und einrichtung zur steuerung einer wiedergabeeinheitdurch verwendung eines mehrkanalsignals - Google Patents

Verfahren und einrichtung zur steuerung einer wiedergabeeinheitdurch verwendung eines mehrkanalsignals

Info

Publication number
EP1586220A2
EP1586220A2 EP04703418A EP04703418A EP1586220A2 EP 1586220 A2 EP1586220 A2 EP 1586220A2 EP 04703418 A EP04703418 A EP 04703418A EP 04703418 A EP04703418 A EP 04703418A EP 1586220 A2 EP1586220 A2 EP 1586220A2
Authority
EP
European Patent Office
Prior art keywords
restitution
determining
acoustic
sub
filters
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP04703418A
Other languages
English (en)
French (fr)
Other versions
EP1586220B1 (de
Inventor
Rémy BRUNO
Arnaud Laborie
Sébastien MONTOYA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Trinnov Audio
Original Assignee
Trinnov Audio
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Trinnov Audio filed Critical Trinnov Audio
Publication of EP1586220A2 publication Critical patent/EP1586220A2/de
Application granted granted Critical
Publication of EP1586220B1 publication Critical patent/EP1586220B1/de
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S5/00Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/301Automatic calibration of stereophonic sound system, e.g. with test microphone
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2205/00Details of stereophonic arrangements covered by H04R5/00 but not provided for in any of its subgroups
    • H04R2205/024Positioning of loudspeaker enclosures for spatial sound reproduction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S3/00Systems employing more than two channels, e.g. quadraphonic

Definitions

  • the present invention relates to a method and a device for controlling a set of restitution of an acoustic field comprising a plurality of restitution elements, from a plurality of acoustic or audiophonic signals each associated with a general direction of restitution predetermined, defined with respect to a point in the given space.
  • Multichannel signal corresponds to a plurality of signals, called channels, transmitted in parallel or multiplexed with each other, each intended for one element or group of restitution elements, arranged in a general direction predefined with respect to at a given point.
  • a conventional multichannel system known as “5.1 ITU-R BF 775-1” and comprises five channels intended for rendering elements placed in five predetermined general directions relative to a listening center, defined by angles 0 °, + 30 °, -30 °, + 110 ° and -110 °.
  • Such an arrangement therefore corresponds to the arrangement of a loudspeaker or a group of loudspeakers front in the center, one on each side in front on the right and on the left and one on each side behind on the right and on the left.
  • control signals are each associated with a determined direction, the application of these signals to a restitution unit whose elements do not correspond to the predetermined spatial configuration, results in significant deformations of the sound field restored.
  • the object of the present invention is to remedy this problem, by defining a method and a system for controlling the restitution assembly the spatial configuration of which is arbitrary.
  • the subject of the invention is a method for controlling a set of restitution of an acoustic field comprising a plurality of restitution elements each associated with a general direction of predetermined restitution defined with respect to a given point, to obtain a field restored acoustics with specific characteristics substantially independent of the intrinsic restitution characteristics of said assembly, characterized in that it comprises:
  • a step of determining at least spatial characteristics of said restitution set allowing the determination of representative parameters for at least one element of said restitution set of its position in the three dimensions of space with respect to said given point;
  • step of determining at least spatial characteristics of said restitution set comprises an input sub-step making it possible to determine all or part of the characteristics of said restitution set;
  • step of determining at least spatial characteristics of said restitution set includes a calibration step making it possible to deliver all or part of the characteristics of said restitution set;
  • said calibration sub-step includes, for at least one of the restitution elements:
  • said calibration sub-step further comprises a sub-step of determining the position in at least one of the three dimensions of the space of said at least one element of said restitution assembly;
  • said step of determining adaptation filters comprises:
  • the decoding, ideal multichannel radiation and adaptation matrices are independent of the frequency, the step of determining at least one control signal of said elements of said reproduction unit by the application of said adaptation filters corresponding to simple linear combinations followed by delay.
  • said step of determining the characteristics of said restitution assembly allows the determination of acoustic characteristics of said set ble of restitution and said method comprises a step of determining filters to compensate for these acoustic characteristics, said step of determining at least one control signal then comprising a substep of applying said acoustic compensation filters; - Said step of determining acoustic characteristics is adapted to deliver representative parameters for at least one element of its frequency response;
  • step of determining at least one control signal comprises a sub-step of gain adjustment and application of delays in order to temporally align the wavefront of the restitution elements as a function of their distance from said given point.
  • the invention also relates to a computer program comprising program code instructions for the execution of the steps of the method when said program is executed by a computer.
  • Another subject of the invention is also a removable medium of the type comprising at least one processing processor and one non-volatile memory element, characterized in that said memory comprises a program comprising code instructions for the execution of the steps of the method , when said processor executes said program.
  • Another subject of the invention is a device for controlling a set for restoring an acoustic field comprising a plurality of restitution elements, comprising means for inputting a plurality of input signals for acoustic information. each associated with a general direction of predetermined restitution defined with respect to a given point, characterized in that it further comprises:
  • means for determining at least spatial characteristics of said restitution set allowing the determination of representative parameters for at least one element of said restitution set of its position in the three dimensions of space with respect to said given point; means for determining adaptation filters from said at least spatial characteristics of said reproduction unit and general directions of predetermined reproduction associated with said plurality of acoustic information input signals; and - Means for determining at least one control signal of said elements of said reproduction unit by applying said adaptation filters to said plurality of acoustic information input signals.
  • said means for determining the at least spatial characteristics of said restitution assembly comprise means for direct input of said characteristics
  • Said calibration means comprise means for acquiring a sound wave comprising four pressure sensors arranged in a general form of tetrahedron;
  • said characteristics determining means are suitable for determining the acoustic characteristics of at least one of said reproduction elements of said reproduction assembly, said device comprising means for determining acoustic compensation filters from said acoustic characteristics and said means of determination of at least one control signal being adapted for the application of said acoustic compensation filters;
  • Said means for determining the acoustic characteristics are suitable for determining the frequency response of said elements of the reproduction unit.
  • the subject of the invention is also an apparatus for processing audio and video data comprising means for determining a plurality of acoustic information input signals each associated with a general predetermined restitution direction defined by a given point , characterized in that it further comprises a device for controlling a restitution assembly;
  • Said means for determining a plurality of input signals are formed by a unit for reading and decoding digital audio and / or video discs.
  • Fig.1 is a representation of a spherical coordinate system
  • FIG.2 is a diagram of a rendering system according to the invention.
  • - Fig.3 is a flow diagram of the method of the invention.
  • - Fig.4 is a diagram of calibration means implemented in the method of the invention.
  • - Fig.5 is a detailed flowchart of the calibration step
  • - Fig.6 is a simplified representation of a sensor used for the implementation of the calibration step
  • - Fig.7 is a detailed flowchart of the step of determining adaptation filters.
  • Figs.8 and 9 are diagrams of means for determining control signals.
  • FIG. 10 is a diagram of an embodiment of a device implementing the method of the invention.
  • a conventional spherical coordinate system has been represented, so as to specify the coordinate system to which reference is made in the text.
  • This coordinate system is an orthonormal coordinate system, of O origin and comprising three axes (OX), (07) and (02).
  • a position denoted x is described by means of its spherical coordinates (r, ⁇ ,), where r denotes the distance from the origin O, ⁇ 9 orientation in the vertical plane and ⁇ orientation in the horizontal plane.
  • an acoustic field is known if we define at any point at each time t the acoustic pressure noted p (r, ⁇ , ⁇ , t), whose temporal Fourier transform is noted P (r , ⁇ , ⁇ , f) where / denotes the frequency.
  • the invention is based on the use of a family of spatiotemporal functions making it possible to describe the characteristics of any acoustic field.
  • these functions are so-called spherical Fourier-Bessel functions of the first kind called hereinafter Fourier-Bessel functions.
  • the Fourier-Bessel functions are solutions of the wave equation and constitute a base which generates all the acoustic fields produced by sound sources situated outside this zone. . Any three-dimensional acoustic field is therefore expressed by a linear combination of the Fourier-Bessel functions, according to the expression of the inverse Fourier-Bessel transform which is expressed:
  • first species of order v, and y ⁇ n ( ⁇ , ⁇ ) is the real spherical harmonic of order / and of term m, with m going from - / to /, defined by:
  • the Fourier-Bessel coefficients are also expressed in the time domain by p ⁇ coefficients, "(t) corresponding to the Fourier transform of the inverse temporal P ⁇ coefficients m (f).
  • the method of the invention uses bases of functions expressed as linear combinations, possibly infinite, of Fourier-Bessel functions.
  • FIG 2 there is shown schematically a rendering system in which the method of the invention is implemented.
  • This system comprises a decoder or adapter 1 controlling a reproduction unit 2 which comprises a plurality of elements 3 ⁇ to 3 / v, such as loudspeakers, loudspeakers or any other sound source or group of sound sources, arranged in any manner in a listening location 4.
  • a decoder or adapter 1 controlling a reproduction unit 2 which comprises a plurality of elements 3 ⁇ to 3 / v, such as loudspeakers, loudspeakers or any other sound source or group of sound sources, arranged in any manner in a listening location 4.
  • the origin O of the reference that the center of the restitution unit is called center 5.
  • the set of spatial, acoustic and electrodynamic characteristics is considered to be the intrinsic characteristics of the restitution set 2.
  • the adapter 1 receives as input a signal SI of the multichannel type comprising acoustic information to be restored and a definition signal SL comprising information representative of at least spatial characteristics of the restitution assembly 2 and in particular allowing the determination of parameters representative for at least one element 3 n of the restitution assembly 2 of its position in the three dimensions of the space with respect to the given point 5.
  • the adapter 1 transmits to the attention of each of the elements or groups of elements 3 ⁇ to 3 / v of the restitution assembly 2, a signal sc-i specific sc / vde piloting.
  • FIG. 3 schematically represents the main steps of the method according to the invention implemented with a rendering system such as that described with reference to FIG. 2.
  • This method includes a step 10 for determining operating parameters, adapted to allow at least the determination of the spatial characteristics of the restitution assembly 2.
  • Step 10 includes a step 20 for entering the parameters and / or a calibration step 30 making it possible to determine and / or measure characteristics of the restitution assembly 2.
  • step 10 also includes a step 40 of determining parameters for describing the predetermined general directions associated with the different channels of the multichannel input signal SI.
  • a step 40 of determining parameters for describing the predetermined general directions associated with the different channels of the multichannel input signal SI At the end of step 10, information relating at least to the various predetermined general directions associated with each of the input channels as well as to the position in the three dimensions of the space of each of the elements or groups of elements 3 n of the restitution set 2, are determined.
  • This information is used during a step 50 of determining the adaptation filters making it possible to take into account the spatial characteristics of the reproduction unit 2 in order to define filters for adapting the multi-channel input signal to the spatial configuration. specific to the restitution set 2.
  • step 10 also makes it possible to determine the acoustic characteristics for all or part of the elements 3 ⁇ to 3 / v of the restitution assembly 2.
  • the method comprises a step 60 of determining acoustic compensation filters making it possible to compensate for the influence of specific acoustic characteristics of the elements 3 ⁇ to 3 ⁇ /.
  • the filters defined during steps 50 and advantageously 60 can thus be memorized, so that steps 10, 50 and 60 need only be repeated in the event of modification of the spatial configuration of the rendering unit 2 and / or the nature of the multichannel input signal.
  • the method then comprises a step 70 of determining the control signals sci to sc / intended for the elements of the restitution assembly 2, comprising a sub-step 80 of applying the adaptation filters determined during step 50 to the different channels c ⁇ (t) to c Q (i) forming the multichannel input signal SI and advantageously, a substep 90 of applying the acoustic compensation filters determined during step 60.
  • the signals sci to SCN thus delivered, are applied to the elements 3 ⁇ to 3N of the restitution assembly 2, in order to restore the acoustic field represented by the multichannel input signal SI with an optimum adaptation to the spatial and advantageously acoustic characteristics. , of the restitution set 2.
  • the characteristics of the restored sound field are substantially independent of the intrinsic characteristics of restitution of the restitution unit 2 and in particular of its spatial configuration.
  • an operator or a suitable memory system can specify all or part of the calculation parameters and in particular:
  • This step 20 is implemented by means of a conventional type interface such as a microcomputer or any other suitable means.
  • FIG. 4 shows the detail of the calibration means. They include a decomposition module 91, a module 92 for determining the impulse response and a module 93 for determining calibration parameters.
  • the calibration means are adapted to be connected to a sound acquisition device 100 such as a microphone or any other suitable device, and to be connected in turn to each element 3radaof the reproduction assembly 2 so to collect information on this element.
  • the calibration means emit a specific signal u n (t) such as a pseudo-random sequence MLS (Maximum Length Sequence) for the attention of an element 3 n .
  • the acquisition device 100 receives, during a sub-step 34, the sound wave emitted by the element 3 n in response to the reception of the signal u n (t) and transmits I signals cp ⁇ (t) to cpj (t) representative of the wave received at the decomposition module 91.
  • the decomposition module 91 decomposes the signals picked up by the acquisition device 100 into a finite number of Fourier-Bessel coefficients q ⁇ , m (t).
  • the acquisition device 100 consists of 4 pressure sensors located at the 4 vertices of a tetrahedron of radius R, as shown with reference to FIG. 6.
  • the signals from the 4 pressure sensors are then noted cp ⁇ (t) to cp (t).
  • the coefficients qo, o ( ⁇ to q ⁇ , ⁇ (t) representative of the picked up acoustic field are deduced from the signals cp ⁇ (t) to cp (f) according to the following relationships:
  • CP ⁇ (j) to CP ⁇ ff) are the Fourier transforms from cp ⁇ (f) to cp (t) and Q, o (f) to O, 1; 1 () are the Fourier transforms from qo, o (t) to # 1; ⁇ (t).
  • the module 92 determines the response determination impulse responses hp ⁇ ttn (f) connecting the coefficients Fu mulberry-Bessel qi, m (t) and the signal u n (t) .
  • the method of determination depends on the specific signal emitted.
  • the embodiment described uses a method suitable for signals of the MLS type, such as for example the correlation method.
  • the impulse response delivered by the response determination module 92 is addressed to the parameter determination module 93.
  • the module 93 deduces information on elements of the restitution set.
  • the module 93 for determining parameters determines the distance r Wennbetween the element 3 n and the center 5 from its response hpo , o (t) and from the measurement of the time taken by the sound to propagate from the element 3ußto the acquisition device 100, by means of methods for estimating delay on the response hp Q ⁇ o (t).
  • the direction ( ⁇ founded, ⁇ n ) of the element 3 ⁇ is deduced by calculating the maximum of the inverse spherical Fourier transform applied to the responses hp, o (t) to hp ⁇ (t) taken at time t where hpo , o (t) has a maximum.
  • the coordinates ⁇ n and ⁇ n are estimated over several instants, preferably chosen around the instant when bp 0) o (t) has a maximum.
  • the final determination of the coordinates ⁇ n and ⁇ is obtained by means of averaging techniques between the different estimates.
  • the acquisition device 100 is able to unambiguously encode the orientation of a source in space.
  • the coordinates ⁇ n and ⁇ n are estimated from other responses among the available hp ⁇ > m (t) or are estimated in the frequency domain from the responses EP ⁇ m (f), corresponding to the Fourier transforms hp ! ⁇ tn (t) responses.
  • step 30 makes it possible to determine the parameters r flick, ⁇ alt and ⁇ n .
  • the module 93 also delivers the transfer function E réelle(f) of each element 3 n , from the responses hp ⁇ , m (t) from the module 92 for determining the response.
  • a first solution consists in constructing the response hp ', 0 (t) corresponding to the selection of the part of the response bp 0 , o (which comprises a non-zero signal and devoid of the reflections introduced by the listening location 4
  • the frequency response E réelle(f) is deduced by Fourier transform from the response hp ' 0 ⁇ (t) previously windowed.
  • the window can be chosen from conventional smoothing windows, such as rectangular, Hamming, Hanning, and Blackman.
  • a second more complex solution consists in applying a smoothing on the module and advantageously on the phase of the frequency response EPo, o (f) obtained by Fourier transform of the response hp 0 , o ( ⁇ .
  • the smoothing is obtained by convolution of the response EP 0 , o (f) by a window centered on /
  • This convolution corresponds to an averaging of the response EP 0 , o (j) around the frequency /
  • the window can be chosen from classic windows, co even for example rectangular, triangles and Hamming.
  • the width of the window varies with the frequency.
  • the width of the window can be proportional to the frequency / to which the smoothing is applied.
  • a variable window with the frequency makes it possible to at least partially eliminate the room effect in the high frequencies while avoiding a truncation effect of the response EPo, o (f) in the low frequencies.
  • Substeps 32 to 39 are repeated for all the elements 3 ⁇ to 3 / v of the restitution set 2.
  • the calibration means comprise other means for acquiring information relating to the elements 3-. at 3 / v, such as laser position measuring means, signal processing means implementing channel forming techniques or any other suitable means.
  • the means implementing the calibration step 30 consist for example of an electronic card or a computer program or any other suitable means.
  • Step 40 thus makes it possible, as has been said previously, to determine parameters describing the format of the input multichannel signal and in particular the general predetermined directions associated with each channel.
  • This step 40 can correspond to a selection by an operator of a format from a list of formats each associated with stored parameters, and can also correspond to an automatic detection of format performed on the input multichannel signal.
  • the method is suitable for a single given multichannel signal format.
  • step 40 allows a user to specify his own format by manually entering the parameters describing the directions associated with each channel.
  • steps 20, 30 and 40 forming step 10 of determining parameters allow at least the determination of positioning parameters in the space of the elements 3 ⁇ of the restitution set 2 and of the format of the SI multichannel signal.
  • FIG. 7 shows a detailed flow diagram of step 50 for determining the adaptation filters. This step includes a plurality of substeps for calculating and determining matrices representative of the parameters determined beforehand.
  • a parameter L called limit order representative of the spatial precision desired during the step 50 of determining the adaptation filters, is determined for example in the following manner:
  • the maximum order L is automatically determined as being the largest integer respecting the following relation:
  • Step 50 of determining adaptation filters then comprises a sub-step 52 of determining a matrix W for weighting the acoustic field.
  • This matrix W corresponds to a spatial window W (rf) representative of the distribution in space of the precision desired during the reconstruction of the field.
  • This window allows you to specify the size and shape of the area where the control must be correctly reconstructed. For example, it may be a ball centered on the center 5 of the restitution assembly.
  • the spatial window and the matrix W are independent of the frequency.
  • F is a diagonal matrix of size (E + l) 2 containing weighting coefficients W ⁇ and in which each coefficient W ⁇ is found 2 / + 1 time in succession on the diagonal.
  • the matrix Wa therefore has the following form:
  • the values taken by the coefficients W ⁇ are the values of a function such as a Hamming window of size 2E + 1 evaluated in /, so that the parameter W ⁇ is determined for / ranging from O to l.
  • Step 50 then comprises a sub-step 53 for determining a matrix M representative of the radiation of the restitution unit in particular from the position parameters x aboard.
  • the radiation matrix M makes it possible to deduce Fourier-Bessel coefficients representing the acoustic field emitted by each element 3 n of the restitution set as a function of the signal it receives.
  • M is a matrix of size (E + l) 2 over N, consisting of elements Mi ', m, n ⁇ the indices l, m designating the line l 2 + l + m and n designating the column n.
  • the matrix M therefore has the following form:
  • the elements M ⁇ >m> n are obtained from a plane wave radiation model, so that:
  • the matrix M thus defined is representative of the radiation of the restitution assembly.
  • M is representative of the spatial configuration of the restitution set.
  • Substeps 51 to 53 can be executed sequentially or simultaneously.
  • the step 50 of determining adaptation filters then comprises a sub-step 54 of taking into account all the parameters of the restitution system 2 determined previously, in order to deliver a decoding matrix D representative of so-called reconstruction filters .
  • the elements D nm (f) of the matrix D correspond to reconstruction filters which, applied to the Fourrier-Bessel coefficients P ⁇ , m (f) of a known acoustic field, make it possible to determine the control signals d '' a set of restitution to reproduce this acoustic field.
  • the decoding matrix D is therefore the inverse of the radiation matrix M.
  • the matrix D is obtained from the matrix M by means of constraint inversion methods involving additional optimization parameters.
  • step 50 is adapted to perform an optimization thanks to the weighting matrix of the acoustic field W which in particular makes it possible to reduce the spatial distortion in the reproduced acoustic field.
  • the matrices M and W are independent of the frequency, so that the matrix D is also independent of the frequency. It is made up of elements denoted D relieve m organized in the following way:
  • Step 54 thus makes it possible to deliver the matrix D representative of so-called reconstruction filters and allowing the reconstruction of an acoustic field from any configuration of the reproduction unit. Thanks to this matrix, the method of the invention makes it possible to take into account the configuration of the restitution assembly 2 and in particular to compensate for the changes in the acoustic field due to its specific spatial configuration.
  • each element D nieth , ⁇ f of the matrix D can be determined by associating with each of the N control signals a directivity function D nieth ( ⁇ , ⁇ f) specifying to each frequency / amplitude, and advantageously the desired phase on the control signal sc n in the case of a plane wave in the direction ( ⁇ , ⁇ ).
  • the term directivity function D n ( ⁇ , ⁇ f) is understood to mean a function which associates a real or complex value, possibly a function of the frequency or of a frequency range, with each direction of space.
  • the directivity functions are independent of the frequency and denoted D relieve( ⁇ , ⁇ ).
  • These directivity functions D n ( ⁇ , ⁇ ) can be determined by specifying that certain physical quantities between an ideal field and the same field reproduced by the restitution set comply with predetermined laws. For example, these quantities can be the pressure at the center and the orientation of the velocity vector.
  • the active control signals, denoted sc n - ⁇ to scnz, are those which supply the restitution elements whose directions are closest to the direction ( ⁇ , ⁇ ) of the plane wave.
  • the active restitution elements denoted 3 blanket ⁇ to 3 relief 3, form a triangle containing the direction ( ⁇ , ⁇ ) of the plane wave.
  • a corresponds to the vector containing [D nl ( ⁇ , ⁇ ) ... D n3 ( ⁇ , ⁇ )] and the directions ( ⁇ nl , ⁇ nl ), ( ⁇ profession 2 , ⁇ stamp 2) and ( ⁇ n3 , ⁇ t 3) correspond respectively to the directions of the elements 3 administrat ⁇ , 3 n2 and 3 n3 .
  • each of the directivity functions D withdraw( ⁇ , ⁇ ) is provided in the form of a list of K samples.
  • Each sample is provided in the form of a pair ⁇ (( ⁇ k , ⁇ k ⁇ D n ( ⁇ k , ⁇ k )) ⁇ where ( ⁇ k , ⁇ k) is the direction of the sample k and where D combat ( ⁇ k , ⁇ k ) is the value of the directivity function associated with the control signal sc n for the direction ( ⁇ k , ⁇ k ).
  • n (f) of each directivity function are deduced from the samples ⁇ (( ⁇ k, ⁇ k), D n ( ⁇ k, ⁇ k)) ⁇ -
  • These coefficients are obtained by inversion of the sampling process angular which allows to deduce the samples from the list ⁇ (( ⁇ k , ⁇ k), D n ( ⁇ k, ⁇ k)) ⁇ from a directivity function provided in the form of spherical harmonic coefficients. This inversion can take different forms in order to control the interpolation between the samples.
  • the directivity functions are directly provided in the form of coefficients E ) endeavour, / ,,“ C of the Fourrier-Bessel type.
  • the coefficients D nm (f) thus determined are used to form the matrix D.
  • Step 50 then comprises a step 55 of determining an ideal multichannel radiation matrix S representative of the predetermined general directions associated with each channel of the input multichannel signal SI.
  • the matrix S is representative of the radiation of an ideal restitution set, that is to say perfectly respecting the predetermined general directions of the multichannel format.
  • Each element S ⁇ : tn , q (f) of the matrix S makes it possible to deduce the Fourier-Bessel coefficients P ⁇ , m (f) of the acoustic field ideally restored by each channel c q (t).
  • the matrix S is determined by associating with each input channel c q (t) and advantageously for each frequency / a pattern of directivity representative of a distribution of sources supposed to transmit the signal of the channel c q (f).
  • the distribution of sources is given in the form of spherical harmonic coefficients S ⁇ , m, q (f).
  • the coefficients S., w ,? (/) are stored in the matrix S of size (E + 1) 2 over Q, where Q is the number of channels.
  • the shaping step associates with each channel c q (t) a plane wave source oriented in the direction ( ⁇ q , ⁇ q ) corresponding to the direction ( ⁇ , ⁇ ) associated with channel c q (t) in the multichannel input format.
  • the coefficients S /, w ,? (/) are then independent of the frequency. They are noted S jW ;? and are obtained by the relation:
  • the ideal radiation matrix S associates certain channels c q (t) with a continuous distribution of plane wave sources described by a directivity function S q ( ⁇ , ⁇ ).
  • the coefficients S / j7 go ;? of the matrix S are obtained directly by Spherical Fourier transform of the directivity function S q ( ⁇ , ⁇ ).
  • the matrix S is independent of the frequency.
  • the matrix S associates with certain channels, a distribution of sources producing a diffuse field. In this case, the matrix S varies with the frequency.
  • the matrix S associates with certain channels sound sources whose response is not flat.
  • the multi-channel format associates with the channel c q (t) a plane wave source of frequency response E (q) (f)
  • step 50 includes a sub-step 56 of determining a spatial adaptation matrix A corresponding to the adaptation filters to be applied to the multi-channel input signal to obtain an optimum reproduction taking into account the spatial configuration of the restitution set 2.
  • the spatial adaptation matrix A is obtained from the formatting matrices S and decoding D by means of the relation:
  • the adaptation matrix A makes it possible to generate signals saj (t) to its N (t) adapted to the spatial configuration of the restitution set from the channels a (t) to c Q (t).
  • Each element A n> q (f) is a filter specifying the contribution of the channel c q (t) to the adapted signal sa n (t). Thanks to the adaptation matrix A, the method of the invention allows optimum reproduction of the acoustic field described by the multi-channel signal by a set of restitution of any spatial configuration.
  • the matrices D and S are independent of the frequency and the matrix A also.
  • the elements of the matrix A are constants denoted A irritationand each of the adapted signals saj (t) à sa ⁇ t) is obtained by simple linear combinations of the input channels cj (t) to c Q (t), if necessary followed by delay as will be described below.
  • step 50 of determining adaptation filters comprises a sub-step 57 to determine the filter settings for other filtering methods.
  • the filter combinations A n> q (f) are converted to:
  • each impulse response a n> q (f) is sampled then truncated to a length proper to each response; or - coefficients of recursive filters with infinite impulse responses calculated from A n JJ) with adaptation methods.
  • the parameters of the adaptation filters A n> q (f) are provided.
  • Step 60 makes it possible, as has been said previously, to determine the filters for compensating for the acoustic characteristics of the elements of the reproduction unit 2 in the case where parameters relating to these acoustic characteristics such as the frequency responses E n (f), are determined during step 10 of determining the parameters.
  • the determination of such filters, denoted E (), from the frequency responses E n (f), can be carried out in a conventional manner by applying methods of inverting filters, such as for example direct inversion, the methods of deconvolution, Wiener methods or others.
  • the compensation relates only to the amplitude of the response or else to the amplitude and the phase.
  • This step 60 makes it possible to determine a compensation filter for each element 3 n of the restitution assembly 2 as a function of its specific acoustic characteristics.
  • the filters can be implemented in different forms of filters and / or filtering methods.
  • the filters used are parameterized directly with frequency responses, the responses E (f) are directly applied.
  • the step 60 of determining compensation filters comprises a conversion sub-step in order to determine the parameters of the filters for other filtering methods.
  • filter combinations E (f) are converted to:
  • step 60 the parameters of the EJP compensation filters (f) are provided.
  • step 70 of determining control signals we will now describe in more detail the step 70 of determining control signals.
  • This step 70 includes a sub-step 80 of applying the adaptation filters represented by the matrix A to the multi-channel input signal SI corresponding to the acoustic field to be restored.
  • the adaptation filters A originate ⁇ (f) integrate the characteristic parameters of the restitution set 2.
  • signals adapted saj (t) to sa f) are obtained by applying the adaptation filters A n ⁇ (f) to the channels c ⁇ (t) to c Q (t) of the signal IF.
  • the adaptation matrix A is independent of the frequency and the adaptation coefficients A réelle > q are applied as follows:
  • the adaptation continues with an adjustment of the gains and the application of delays in order to temporally align the wave fronts of the elements 3 ⁇ to 3 / v of the restitution assembly 2 with respect to the most distant element.
  • the adaptation matrix A varies with the frequency and the adaptation filters A n Jf) are applied in the following way:
  • V n (f) f q (f) A, q (f)
  • each filtering of the channels c q (t) by the adaptation filters A renders ⁇ q (f) can be produced according to conventional filtering methods, such as for example:
  • the parameters are directly the frequency responses _4 Struktur, ? (/), and the filtering is carried out in the frequency domain, for example, using the usual techniques of convolution by blocks;
  • the parameters are directly the finite impulse responses a n, q (f), and the filtering is carried out in the time domain by convolution; or
  • the parameters are the coefficients of recursive filters with infinite impulse responses, and the filtering is carried out in the time domain by means of recurrence relations.
  • Substep 80 ends with an adjustment of the gains and the application of delays in order to temporally align the wave fronts of the elements 3 ⁇ to 3 / v of the restitution unit 2 relative to the most distant element.
  • the signals adapted sa ⁇ (i) to sa ⁇ t) are deduced from the signals v ⁇ (t) to v ⁇ t) according to the expression:
  • step 70 includes a sub-step 90 for compensating for the acoustic characteristics of the restitution assembly.
  • Each compensation filter EiP (f) is applied to the corresponding signal sa chorus(t) corresponding in order to obtain the control signal sc n (t) of the element 3 n , according to the relation:
  • SC n (f) SA n (f) E! P (f)
  • SC disregard(f) is the temporal Fourier transform of sc n (t)
  • SA n (f) is the temporal Fourier transform of its "(t).
  • each filtering of the signals sa n (f) can be carried out according to conventional filtering methods, such as for example:
  • the filtering can be carried out by means of filtering methods in the frequency domain, such as for example block convolution techniques;
  • filtering parameters are impulse responses h ⁇ (t)
  • the filtering can be carried out in the time domain by time convolution;
  • the filtering can be carried out in the time domain by means of recursive filters with infinite impulse response.
  • the method of the invention does not compensate for the specific acoustic characteristics of the elements of the restitution assembly.
  • step 60 and sub-step 90 are not carried out and the adapted signals sa ⁇ (t) to sa ⁇ t) correspond directly to the control signals sci to SON-
  • each element 3 ⁇ to 3 / v therefore receives a control signal specific to SCN and emits an acoustic field which contributes to the optimal reconstruction of the acoustic field to be restored.
  • the simultaneous control of all of the elements 3 ⁇ to 3w allows an optimal reconstruction of the acoustic field corresponding to the multichannel input signal by the restitution assembly 2 whose spatial configuration is arbitrary, or even does not correspond to a fixed configuration.
  • step 50 of determining the spatial adaptation filters can take into account many optimization parameters such as:
  • - W ⁇ (f) describing directly in the form of weighting of the Fourier-Bessel coefficients and for each frequency / considered, a spatial window representative of the distribution in the space of constraints of reconstruction of the acoustic field;
  • - R (f) representative, for each frequency / considered, of the radius of the spatial window when the latter is a ball;
  • All or part of these optimization parameters can intervene during sub-step 54 of determining the decoding matrix _D.
  • the parameters, "() and RM (f) are involved in the sub-step 53 determination of the radiation matrix M
  • the parameters W (r, f), W ⁇ (f), R (f) are involved in the sub-step 52 of determination of the matrix W
  • the parameters ⁇ (l k , m k ) ⁇ (f) intervene in an additional sub-step in the determination of a matrix F.
  • the decoding matrix D is then determined during sub-step 54, for each frequency / according to the matrices M, W and and of the parameters G n (f) and ⁇ (f).
  • the calculation of the matrix D can be carried out frequency by frequency by considering only the active elements for each frequency considered.
  • This method of determining the matrix D involves the parameter G Chris(f) and makes it possible to make the best use of a set of restitution whose elements have different operating frequency bands.
  • FIG. 10 shows a diagram of an embodiment of an apparatus implementing the method as described above.
  • This device comprises the adapter 1 which is formed by a unit 110 delivering a multi-channel signal such as an audio-video disc playback unit called a DVD player 112.
  • the multi-channel signal delivered by the unit 110 is intended for the elements of the restitution unit 2.
  • the format of this signal SI is recognized automatically by the adapter 1 which is adapted to make it correspond to parameters describing the predetermined general direction associated with each channel of the signal SI.
  • this adapter 1 also incorporates an additional calculation unit 114 as well as means for entering information 116.
  • the input means 116 are formed by an infrared interface with a remote control or even with a computer and allow a user to determine the parameters defining the positions in space of the restoring elements 3 ⁇ to 3 ⁇ /.
  • the computer 114 applies these adaptation filters to the multichannel signal SI in order to deliver the control signals sc- to SCN intended for the restitution assembly 2.
  • the device implementing the invention can take other forms, such as software implemented on a computer or even a complete device integrating calibration means as well as means for entering and determining characteristics. of the more complete restitution package.
  • the method can also be implemented in the form of a device dedicated to the optimization of multi-channel rendering systems, external to an audio-video decoder and associated with it.
  • the device is suitable for receiving a multichannel signal at the input and delivering at the output control signals for elements of a reproduction unit.
  • the device is adapted to be connected to the acquisition device 100 necessary for the calibration step and / or is provided with an interface making it possible to enter parameters, in particular, the position of the elements of the assembly of restitution and possibly the multichannel input format.
  • Such an acquisition device 100 can be connected in a wired or non-wired manner (radio, infrared) and can be integrated into an accessory, such as a remote control, or be independent.
  • the method can be implemented by a device integrated into an element of an audio-video chain responsible for processing multichannel signals, such as for example a so-called “surround” processor or decoder, an audio-video amplifier incorporating decoding functions multichannel or a fully integrated audio-video channel.
  • the method of the invention can also be implemented in an electronic card or in a dedicated chip.
  • it can be integrated in the form of a program into a signal processing processor (DSP).
  • DSP signal processing processor
  • the method may take the form of a computer program intended to be executed by a computer. The program receives as input a multi-channel signal and delivers the control signals from a restitution set possibly integrated into this computer.
  • the calibration means can be produced by implementing a process different from that described above, such as for example, a process inspired by techniques described in the patent application in France filed on May 7, 2002 under number 02 05 741.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Stereophonic System (AREA)
EP04703418.6A 2003-01-20 2004-01-20 Verfahren und einrichtung zur steuerung einer wiedergabeeinheitdurch verwendung eines mehrkanalsignals Expired - Lifetime EP1586220B1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
FR0300571 2003-01-20
FR0300571A FR2850183B1 (fr) 2003-01-20 2003-01-20 Procede et dispositif de pilotage d'un ensemble de restitution a partir d'un signal multicanal.
PCT/FR2004/000115 WO2004068463A2 (fr) 2003-01-20 2004-01-20 Procede et dispositif de pilotage d'un ensemble de restitution a partir d'un signal multicanal

Publications (2)

Publication Number Publication Date
EP1586220A2 true EP1586220A2 (de) 2005-10-19
EP1586220B1 EP1586220B1 (de) 2013-10-23

Family

ID=32605871

Family Applications (1)

Application Number Title Priority Date Filing Date
EP04703418.6A Expired - Lifetime EP1586220B1 (de) 2003-01-20 2004-01-20 Verfahren und einrichtung zur steuerung einer wiedergabeeinheitdurch verwendung eines mehrkanalsignals

Country Status (7)

Country Link
US (1) US8213621B2 (de)
EP (1) EP1586220B1 (de)
JP (1) JP2006517072A (de)
KR (1) KR101248505B1 (de)
CN (1) CN1751540B (de)
FR (1) FR2850183B1 (de)
WO (1) WO2004068463A2 (de)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8078659B2 (en) * 2005-10-31 2011-12-13 Telefonaktiebolaget L M Ericsson (Publ) Reduction of digital filter delay
GB0523946D0 (en) * 2005-11-24 2006-01-04 King S College London Audio signal processing method and system
US7864968B2 (en) * 2006-09-25 2011-01-04 Advanced Bionics, Llc Auditory front end customization
FR2915041A1 (fr) * 2007-04-13 2008-10-17 Canon Kk Procede d'attribution d'une pluralite de canaux audio a une pluralite de haut-parleurs, produit programme d'ordinateur, moyen de stockage et noeud gestionnaire correspondants.
US20090232316A1 (en) * 2008-03-14 2009-09-17 Chieh-Hung Chen Multi-channel blend system for calibrating separation ratio between channel output signals and method thereof
US20100057472A1 (en) * 2008-08-26 2010-03-04 Hanks Zeng Method and system for frequency compensation in an audio codec
EP2309781A3 (de) 2009-09-23 2013-12-18 Iosono GmbH Vorrichtung und Verfahren zur Berechnung der Filterkoeffizienten für vordefinierte Lautsprecheranordnung
US9025776B2 (en) * 2010-02-01 2015-05-05 Rensselaer Polytechnic Institute Decorrelating audio signals for stereophonic and surround sound using coded and maximum-length-class sequences
JP5387478B2 (ja) * 2010-03-29 2014-01-15 ソニー株式会社 音声再生装置及び音声再生方法
NZ587483A (en) 2010-08-20 2012-12-21 Ind Res Ltd Holophonic speaker system with filters that are pre-configured based on acoustic transfer functions
US20120148075A1 (en) * 2010-12-08 2012-06-14 Creative Technology Ltd Method for optimizing reproduction of audio signals from an apparatus for audio reproduction
US20130051572A1 (en) * 2010-12-08 2013-02-28 Creative Technology Ltd Method for optimizing reproduction of audio signals from an apparatus for audio reproduction
US9031268B2 (en) 2011-05-09 2015-05-12 Dts, Inc. Room characterization and correction for multi-channel audio
WO2012164444A1 (en) * 2011-06-01 2012-12-06 Koninklijke Philips Electronics N.V. An audio system and method of operating therefor
TWI453451B (zh) * 2011-06-15 2014-09-21 Dolby Lab Licensing Corp 擷取與播放源於多音源的聲音之方法
WO2014032709A1 (en) 2012-08-29 2014-03-06 Huawei Technologies Co., Ltd. Audio rendering system
BR122022004083B1 (pt) 2014-01-16 2023-02-23 Sony Corporation Dispositivo e método de processamento de áudio, e, meio de armazenamento não transitório legível por computador
KR102362121B1 (ko) * 2015-07-10 2022-02-11 삼성전자주식회사 전자 장치 및 그 입출력 방법
CN111972928B (zh) * 2020-08-21 2023-01-24 浙江指云信息技术有限公司 一种具有环绕音场的助睡眠枕头及其调控方法
CN112014639B (zh) * 2020-09-02 2022-07-05 安徽一天电能质量技术有限公司 一种交流电力谐波向量测量方法

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4060850A (en) * 1977-04-25 1977-11-29 The United States Of America As Represented By The Secretary Of The Navy Beam former using bessel sequences
US4893342A (en) * 1987-10-15 1990-01-09 Cooper Duane H Head diffraction compensated stereo system
US5757927A (en) * 1992-03-02 1998-05-26 Trifield Productions Ltd. Surround sound apparatus
US6154549A (en) * 1996-06-18 2000-11-28 Extreme Audio Reality, Inc. Method and apparatus for providing sound in a spatial environment
US5889867A (en) * 1996-09-18 1999-03-30 Bauck; Jerald L. Stereophonic Reformatter
JP3539855B2 (ja) * 1997-12-03 2004-07-07 アルパイン株式会社 音場制御装置
DE19847689B4 (de) * 1998-10-15 2013-07-11 Samsung Electronics Co., Ltd. Vorrichtung und Verfahren zur dreidimensionalen Tonwiedergabe
JP2000261900A (ja) * 1999-03-09 2000-09-22 Sony Corp 音場補正方法および音響装置。
JP2000354300A (ja) * 1999-06-11 2000-12-19 Accuphase Laboratory Inc マルチチャンネルオーディオ再生装置
JP2001157293A (ja) * 1999-12-01 2001-06-08 Matsushita Electric Ind Co Ltd スピーカ装置
US7158643B2 (en) * 2000-04-21 2007-01-02 Keyhold Engineering, Inc. Auto-calibrating surround system
JP2002345097A (ja) * 2001-05-15 2002-11-29 Sony Corp サラウンド音場再生システム
FR2836571B1 (fr) * 2002-02-28 2004-07-09 Remy Henri Denis Bruno Procede et dispositif de pilotage d'un ensemble de restitution d'un champ acoustique

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2004068463A2 *

Also Published As

Publication number Publication date
FR2850183A1 (fr) 2004-07-23
KR101248505B1 (ko) 2013-04-03
WO2004068463A3 (fr) 2005-08-25
CN1751540A (zh) 2006-03-22
EP1586220B1 (de) 2013-10-23
JP2006517072A (ja) 2006-07-13
FR2850183B1 (fr) 2005-06-24
KR20050103280A (ko) 2005-10-28
WO2004068463A2 (fr) 2004-08-12
CN1751540B (zh) 2012-08-08
US20060167963A1 (en) 2006-07-27
US8213621B2 (en) 2012-07-03

Similar Documents

Publication Publication Date Title
EP1586220B1 (de) Verfahren und einrichtung zur steuerung einer wiedergabeeinheitdurch verwendung eines mehrkanalsignals
EP1563485B1 (de) Verfahren zur verarbeitung von audiodateien und erfassungsvorrichtung zur anwendung davon
EP2898707B1 (de) Optimierte kalibrierung eines klangwiedergabesystems mit mehreren lautsprechern
EP1546916B1 (de) Verfahren und vorrichtung zum verarbeiten einer darstellung eines akustischen feldes
EP1836876B1 (de) Verfahren und vorrichtung zur individualisierung von hrtfs durch modellierung
EP1479266B1 (de) Verfahren und vorrichtung zur steuerung einer anordnung zur wiedergabe eines schallfeldes
EP1992198B1 (de) Optimierung des binauralen raumklangeffektes durch mehrkanalkodierung
EP1946612A1 (de) Hrtfs-individualisierung durch modellierung mit finiten elementen gekoppelt mit einem revidierungsmodell
JP2009512364A (ja) 仮想オーディオシミュレーション
EP1652406B1 (de) System und verfahren zur bestimmung einer repräsentation eines akustischen feldes
EP1502475B1 (de) Verfahren und system zum repräsentieren eines schallfeldes
FR3065137A1 (fr) Procede de spatialisation sonore
FR2890280A1 (fr) Procede de filtrage numerique et de compensation pour lineariser la courbe de reponse d'une enceinte acoustique et moyens mis en oeuvre
EP3384688B1 (de) Aufeinanderfolgende dekompositionen von audiofiltern
Fonseca et al. Measurement of car cabin binaural impulse responses and auralization via convolution
Fontana et al. A system for rapid measurement and direct customization of head related impulse responses
EP3934282A1 (de) Verfahren zur umwandlung eines ersten satzes repräsentativer signale eines schallfelds in einen zweiten satz von signalen und entsprechende elektronische vorrichtung
Meng Impulse response measurement and spatio-temporal response acquisition

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20050714

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20110124

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20130503

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 638125

Country of ref document: AT

Kind code of ref document: T

Effective date: 20131115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: FRENCH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602004043628

Country of ref document: DE

Effective date: 20131219

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20131023

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 638125

Country of ref document: AT

Kind code of ref document: T

Effective date: 20131023

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140224

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602004043628

Country of ref document: DE

BERE Be: lapsed

Owner name: TRINNOV AUDIO

Effective date: 20140131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140120

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

26N No opposition filed

Effective date: 20140724

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140131

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140131

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602004043628

Country of ref document: DE

Effective date: 20140724

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140120

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 13

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140124

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20040120

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131023

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20170929

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170131

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 14

REG Reference to a national code

Ref country code: FR

Ref legal event code: RN

Effective date: 20171128

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 15

REG Reference to a national code

Ref country code: FR

Ref legal event code: FC

Effective date: 20171226

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170131

PGRI Patent reinstated in contracting state [announced from national office to epo]

Ref country code: FR

Effective date: 20171226

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 16

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20221212

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230123

Year of fee payment: 20

Ref country code: DE

Payment date: 20230112

Year of fee payment: 20

REG Reference to a national code

Ref country code: DE

Ref legal event code: R071

Ref document number: 602004043628

Country of ref document: DE

REG Reference to a national code

Ref country code: GB

Ref legal event code: PE20

Expiry date: 20240119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20240119