EP3111667B1 - Method and system for automatic acoustic equalisation - Google Patents
Method and system for automatic acoustic equalisation Download PDFInfo
- Publication number
- EP3111667B1 EP3111667B1 EP15703951.2A EP15703951A EP3111667B1 EP 3111667 B1 EP3111667 B1 EP 3111667B1 EP 15703951 A EP15703951 A EP 15703951A EP 3111667 B1 EP3111667 B1 EP 3111667B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- response
- target
- mean
- offset
- curve
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 36
- 238000005457 optimization Methods 0.000 claims description 13
- 230000005236 sound signal Effects 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 6
- 238000009499 grossing Methods 0.000 claims description 4
- 238000005259 measurement Methods 0.000 description 3
- 238000013519 translation Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000001174 ascending effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/04—Circuits for transducers, loudspeakers or microphones for correcting frequency response
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
- H04R2499/10—General applications
- H04R2499/13—Acoustic transducers and sound field adaptation in vehicles
Definitions
- the present invention relates to the field of sound signal processing.
- the present invention relates more particularly to a method and an automated acoustic equalization system.
- a case of use of the present invention is as follows: in the automotive field: a plurality of microphones are placed in a vehicle and pre-calibrated sound sequences are broadcast in the vehicle speakers. A system compares the sound signals emitted and the sound signals received and recorded. We deduce the "acoustic signature" of the passenger compartment of the vehicle. The user then defines a target acoustic signature curve, which is different from the vehicle's native acoustic signature. A second algorithm calculates digital filter coefficients so that, when these filters are applied before sound signals are broadcast in the vehicle speakers, the acoustic signature of the vehicle becomes the target sound signature curve, not the native acoustic signature of the vehicle.
- IIR Infinite Impulse Response filters
- Biquad filters of the second order are used.
- the method and the system according to the present invention concern the equalization of the amplitude of the frequency response of the passenger compartment.
- This technical solution of the prior art proposes to measure the emitting response, a theater observed at the receiver by using, in particular, a measurement signal supplied by a noise generator or any other measurement method making it possible to observe the system response in open loop.
- the equalizer device works to make said response come closest to a desired response.
- This technical solution of the prior art has for application the modification of the acoustic properties of theaters.
- the prior art is also known from US Pat. US 6,721,428 B1 (Texas Instruments), an automatic speaker equalizer.
- This prior art US patent relates more particularly to a method for generating digital filters for equalizing a loudspeaker.
- First digital data is provided, for a tolerance interval for a tone-based target response response versus frequency for the loudspeaker.
- Second digital data is generated, for an actual acoustic signal response curve as a function of frequency for the loudspeaker.
- the first digital data is compared with the second digital data, and it is determined whether the actual response curve is in the tolerance range.
- digital audio filters are iteratively generated, and the digital audio filters are applied to the second digital data to generate third digital data for a compensated response curve. .
- the frequency, gain and bandwidth of the digital audio filters are automatically optimized until the compensated response curve is within the tolerance range or a predetermined limit of the number of digital audio filters has been reached. of the two taking place first.
- the present invention provides a method for providing equalization of a signal by determining filter parameters to reduce the difference between the amplitude of a frequency response representing the acoustic signature of a set of speakers in their environment and a target sound signature curve.
- the method according to the present invention makes it possible to obtain automated acoustic equalization thanks to a precise and optimized calculation of filter parameters.
- the interpolation step of the target sound signature curve is performed using the Hermite method.
- said method further comprises a step of automatically optimizing the offset of the target response C ec , repeated at each iteration.
- said method further comprises a step of smoothing the N frequency responses.
- said method implements filters corresponding to the following types: "peak”, “notch”"high-shelf” and “ low-shelf " depending on the shape of local maxima and local minima.
- said method furthermore implements a global optimization algorithm to minimize the error.
- the Figure 1 illustrates the different steps of the process according to the present invention.
- a logarithmic frequency scale translation of said average M of the N frequency responses is performed.
- a target sound signature curve C ec is interpolated and then translated into a logarithmic frequency scale.
- the averaged response M and the target sound signature response C ec are compared by calculating the difference between the averaged response M and the target response C ec .
- the curve C diff resulting from the difference between said averaged response M and said target response C ec is analyzed.
- filter parameters are determined for reducing the difference between said averaged response M and said target response C ec by firstly processing the local maxima in descending order according to their gain, then the local minima, and performing successive iterations.
- the method according to the present invention further comprises a step of optimizing the parameters of the filters in order to improve the performance of the system.
- Frequency responses can be averaged "standard” (that is, with identical weights), or with different weights.
- the Figure 2 represents the target sound signature curve C ec within the meaning of the present invention, the frequency responses derived from the N impulse response measurements, as well as the average M.
- a comparison of the averaged response is carried out. M and the target response C ec , by calculating the difference between the averaged response M and the target response C ec .
- the Figure 3 illustrates the detection and ranking of local maxima ("peaks") and local minima ("troughs").
- the local maxima (peaks) are first processed in descending order according to their gain, then the local minima (troughs) are processed in ascending order. This makes it possible to determine filter parameters for reducing the difference between the averaged response M and the target response C ec . Successive iterations are performed.
- Parameters and number of filters are optimized using an algorithm.
- the parameters f, Q and G (respectively central frequency, quality factor and gain of the biquads) are optimized from intervals of values that can be predefined by a user, and the ranges of values of Q and G may depend on frequency. Thus, for example in high frequencies, the low gain filters are more easily eliminated because they are not perceptible.
- the objective is to find the optimal parameters (fc opt , G opt , Q opt ) of a filter and the optimal offset of the target curve Offset opt.
- the limits of the parameters are determined like this: max f vs 2 1 12 , FreqRange 1 ⁇ f vs Opt ⁇ min f vs ⁇ 2 1 12 , FreqRange 2 - BOY WUT ⁇ 0.9 ⁇ BOY WUT Opt ⁇ BOY WUT ⁇ 1.1 s i BOY WUT ⁇ 0 e t - BOY WUT ⁇ 1.1 ⁇ BOY WUT Opt ⁇ BOY WUT ⁇ 0.9 s i BOY WUT > 0 QRange 1 ⁇ Q Opt ⁇ QRange 2 TargetGain - 100 ⁇ TargetGain boy Wut Opt ⁇ TargetGain + 100 where f c and G are respectively the center frequency and the gain of a biquad filter modeling the nth peak and QRange is the range of admiss
- a post-optimization process is performed. This post-optimization process consists of reclassifying the filters by increasing frequency and reoptimizing the coefficients. If a filter is canceled during this process, a new peak / dip is searched in order to output the maximum number of filters. The optimization process is implemented until the maximum number of filters is reached.
- the interpolation step of the target curve is performed using the Hermite method.
- the method according to the present invention further comprises a step of automatically optimizing the offset of the target response C ec , repeated at each iteration.
- the method according to the present invention further comprises a step of smoothing the N frequency responses.
- filters corresponding to the following types are used: " peak”,”notch”,”high-shelf” “And” low-shelf “depending on the shape of local maxima (peaks) and local minima (troughs).
- the filter is made according to whether or not a certain threshold is exceeded by the quality factor.
- the method according to the present invention furthermore implements a global optimization algorithm to minimize the error.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
- Stereophonic System (AREA)
Description
La présente invention se rapporte au domaine du traitement du signal sonore.The present invention relates to the field of sound signal processing.
La présente invention se rapporte plus particulièrement à un procédé et à un système d'égalisation acoustique automatisé.The present invention relates more particularly to a method and an automated acoustic equalization system.
Un cas d'usage de la présente invention est le suivant : dans le domaine de l'automobile : on place une pluralité de microphones dans un véhicule et on diffuse des séquences sonores pré-calibrées dans les haut-parleurs du véhicule. Un système compare les signaux sonores émis et les signaux sonores reçus et enregistrés. On en déduit « la signature acoustique » de l'habitacle du véhicule. L'utilisateur définit ensuite une courbe de signature acoustique cible, qui est différente de la signature acoustique native du véhicule. Un second algorithme calcule des coefficients de filtres numériques de manière à ce que, lorsqu'on applique ces filtres avant diffusion de signaux sonores dans les haut-parleurs du véhicule, la signature acoustique du véhicule devienne la courbe de signature sonore cible, et non la signature acoustique native du véhicule.A case of use of the present invention is as follows: in the automotive field: a plurality of microphones are placed in a vehicle and pre-calibrated sound sequences are broadcast in the vehicle speakers. A system compares the sound signals emitted and the sound signals received and recorded. We deduce the "acoustic signature" of the passenger compartment of the vehicle. The user then defines a target acoustic signature curve, which is different from the vehicle's native acoustic signature. A second algorithm calculates digital filter coefficients so that, when these filters are applied before sound signals are broadcast in the vehicle speakers, the acoustic signature of the vehicle becomes the target sound signature curve, not the native acoustic signature of the vehicle.
Dans le cadre de la présente invention, on utilise des filtres « IIR » ou « Infinite Impulse Response » en terminologie anglo-saxonne.In the context of the present invention, "IIR" or "Infinite Impulse Response" filters are used in English terminology.
Plus particulièrement, on utilise dans le cadre de la présente invention des filtres dits « Biquad », d'ordre deux.More particularly, in the context of the present invention, so-called "Biquad" filters of the second order are used.
Le procédé et le système selon la présente invention concernent l'égalisation de l'amplitude de la réponse fréquentielle de l'habitacle.The method and the system according to the present invention concern the equalization of the amplitude of the frequency response of the passenger compartment.
Le document
L'art antérieur connaît également, par le brevet américain N°
On connaît également dans l'état de la technique la publication scientifique
La présente invention propose un procédé permettant de fournir une égalisation d'un signal en déterminant des paramètres de filtres permettant de réduire l'écart entre l'amplitude d'une réponse fréquentielle représentant la signature acoustique d'un ensemble de haut-parleurs dans leur environnement et une courbe de signature sonore cible.The present invention provides a method for providing equalization of a signal by determining filter parameters to reduce the difference between the amplitude of a frequency response representing the acoustic signature of a set of speakers in their environment and a target sound signature curve.
A cet effet, la présente invention concerne, dans son acception la plus générale, un procédé d'égalisation acoustique automatisé, caractérisé en ce qu'il comporte les étapes suivantes :
- Mesure de N réponses impulsionnelles RI1, RI2, ..., RIN après émission d'un signal sonore précalibré reçu par N microphones ;
- Calcul des N réponses fréquentielles correspondantes par Transformée de Fourier rapide ;
- Etablissement d'une moyenne M des N réponses fréquentielles ;
- Traduction en échelle fréquentielle logarithmique de ladite moyenne M des N réponses fréquentielles ;
- Interpolation d'une courbe de signature sonore cible Cec à partir d'un certain nombre de points choisis par un utilisateur ;
- Traduction en échelle fréquentielle logarithmique de ladite courbe de signature sonore cible Cec ;
- Comparaison de ladite réponse moyennée M et de ladite réponse cible Cec, en calculant la différence entre ladite réponse moyennée M et ladite réponse de signature sonore cible Cec ;
- Analyse de la courbe Cdiff résultant de la différence entre ladite réponse moyennée M et ladite réponse cible Cec ; et
- Détermination de paramètres de filtres pour la réduction de la différence entre ladite réponse moyennée M et ladite réponse cible Cec en traitant tout d'abord les maxima locaux par ordre décroissant suivant leur gain, puis les minima locaux, et en réalisant des itérations successives ;
- Measuring N impulse responses RI 1 , RI 2 , ..., RI N after emission of a precalibrated sound signal received by N microphones;
- Calculation of N corresponding frequency responses by Fast Fourier Transform;
- Establishment of an average M of N frequency responses;
- Logarithmic frequency scale translation of said average M of the N frequency responses;
- Interpolation of a target sound signature curve C ec from a number of points selected by a user;
- Logarithmic frequency scale translation of said target sound signature curve C ec ;
- Comparing said averaged response M and said target response C ec, by calculating the difference between said averaged response M and said target sound signature response C ec ;
- Analyzing the curve C diff resulting from the difference between said averaged response M and said target response C ec; and
- Determining filter parameters for reducing the difference between said averaged response M and said response target C ec by first treating the local maxima in decreasing order according to their gain, then the local minima, and performing successive iterations;
Ainsi, le procédé selon la présente invention permet d'obtenir une égalisation acoustique automatisée grâce à un calcul précis et optimisé de paramètres de filtres.Thus, the method according to the present invention makes it possible to obtain automated acoustic equalization thanks to a precise and optimized calculation of filter parameters.
De préférence, l'étape d'interpolation de la courbe de signature sonore cible est réalisée au moyen de la méthode d'Hermite.Preferably, the interpolation step of the target sound signature curve is performed using the Hermite method.
Avantageusement, ledit procédé comporte en outre une étape d'optimisation automatique de l'offset de la réponse cible Cec, répétée à chaque itération.Advantageously, said method further comprises a step of automatically optimizing the offset of the target response C ec , repeated at each iteration.
Avantageusement, ledit procédé comporte en outre une étape de lissage des N réponses fréquentielles.Advantageously, said method further comprises a step of smoothing the N frequency responses.
De préférence, ledit procédé met en oeuvre des filtres correspondants aux types suivants: « peak », « notch » « high-shelf » et « low-shelf » en fonction de la forme des maxima locaux et des minima locaux.Preferably, said method implements filters corresponding to the following types: "peak", "notch""high-shelf" and " low-shelf " depending on the shape of local maxima and local minima.
Selon un mode de mise en oeuvre particulier, ledit procédé met en outre en oeuvre un algorithme d'optimisation globale pour minimiser l'erreur.According to a particular mode of implementation, said method furthermore implements a global optimization algorithm to minimize the error.
La présente invention se rapporte également à un système d'égalisation acoustique automatisé, caractérisé en ce qu'il comporte des moyens pour :
- mesurer N réponses impulsionnelles RI1, RI2, ..., RIN après émission d'un signal sonore précalibré reçu par N microphones ;
- calculer les N réponses fréquentielles correspondantes par Transformée de Fourier rapide ;
- établir une moyenne M des N réponses fréquentielles ;
- traduire en échelle fréquentielle logarithmique ladite moyenne M des N réponses fréquentielles ;
- interpoler une courbe cible Cec à partir d'un certain nombre de points définis par un utilisateur;
- traduire en échelle fréquentielle logarithmique ladite courbe cible Cec ;
- comparer ladite réponse moyennée M et ladite réponse cible Cec, en calculant la différence entre ladite réponse moyennée M et ladite réponse cible Cec ;
- analyser la courbe Cdiff résultant de la différence entre ladite réponse moyennée M et ladite réponse cible Cec ; et
- déterminer des paramètres de filtres pour la réduction de la différence entre ladite réponse moyennée M et ladite réponse cible Cec en traitant tout d'abord les maxima locaux par ordre décroissant suivant leur gain, puis les minima locaux, et en réalisant des itérations successives ;
- measuring N impulse responses RI 1 , RI 2 , ..., RI N after emission of a precalibrated sound signal received by N microphones;
- calculate the N corresponding frequency responses by Fast Fourier Transform;
- establish an average M of the N frequency responses;
- translating into a logarithmic frequency scale said average M of the N frequency responses;
- interpolating a target curve C ec from a number of points defined by a user;
- translating into a logarithmic frequency scale said target curve C ec ;
- comparing said averaged response M and said target response C ec , by calculating the difference between said averaged response M and said target response C ec ;
- analyzing the curve C diff resulting from the difference between said averaged response M and said target response C ec; and
- determining filter parameters for reducing the difference between said averaged response M and said target response C ec by first processing local maxima in descending order according to their gain, then local minima, and performing successive iterations;
On comprendra mieux l'invention à l'aide de la description, faite ci-après à titre purement explicatif, d'un mode de réalisation de l'invention, en référence aux Figures dans lesquelles :
- la
Figure 1 illustre les différentes étapes du procédé selon la présente invention ; - la
Figure 2 représente la courbe de signature sonore cible Cec au sens de la présente invention, les réponses fréquentielles dérivées des N mesures de réponses impulsionnelles, ainsi que la moyenne M ; et - la
Figure 3 illustre la détection et le classement des maxima locaux (« pics ») et des minima locaux (« creux »).
- the
Figure 1 illustrates the different steps of the process according to the present invention; - the
Figure 2 represents the target sound signature curve C ec within the meaning of the present invention, the frequency responses derived from the N impulse response measurements, as well as the average M; and - the
Figure 3 illustrates the detection and ranking of local maxima ("peaks") and local minima ("troughs").
La
Le procédé d'égalisation acoustique automatisé conforme à la présente invention comporte les étapes suivantes :
- Dans un premier temps, on mesure N réponses impulsionnelles RI1, RI2, ..., RIN après émission d'un signal sonore précalibré reçu par N microphones.
- In a first step, N impulse responses RI 1 , RI 2 , ..., RI N are measured after transmission of a precalibrated sound signal received by N microphones.
Ensuite on calcule les N réponses fréquentielles correspondantes par Transformée de Fourier rapide.Then the corresponding N frequency responses are computed by Fast Fourier Transform.
Ensuite, on établit une moyenne M des N réponses fréquentielles calculées.Then, an average M of the N calculated frequency responses is established.
Une traduction en échelle fréquentielle logarithmique de ladite moyenne M des N réponses fréquentielles -est effectuée.A logarithmic frequency scale translation of said average M of the N frequency responses is performed.
Une courbe de signature sonore cible Cec est interpolée, puis est traduite en échelle fréquentielle logarithmique.A target sound signature curve C ec is interpolated and then translated into a logarithmic frequency scale.
Ensuite, on compare la réponse moyennée M et la réponse de signature sonore cible Cec, en calculant la différence entre la réponse moyennée M et la réponse cible Cec.Next, the averaged response M and the target sound signature response C ec are compared by calculating the difference between the averaged response M and the target response C ec .
La courbe Cdiff résultant de la différence entre ladite réponse moyennée M et ladite réponse cible Cec est analysée.The curve C diff resulting from the difference between said averaged response M and said target response C ec is analyzed.
Enfin, on détermine des paramètres de filtres pour la réduction de la différence entre ladite réponse moyennée M et ladite réponse cible Cec en traitant tout d'abord les maxima locaux par ordre décroissant suivant leur gain, puis les minima locaux, et en réalisant des itérations successives.Finally, filter parameters are determined for reducing the difference between said averaged response M and said target response C ec by firstly processing the local maxima in descending order according to their gain, then the local minima, and performing successive iterations.
Le procédé selon la présente invention comporte en outre une étape d'optimisation des paramètres des filtres afin d'améliorer la performance du système.The method according to the present invention further comprises a step of optimizing the parameters of the filters in order to improve the performance of the system.
Les réponses fréquentielles peuvent être moyennées de façon « standard » (c'est-à-dire avec des poids identiques), ou bien avec des poids différents.Frequency responses can be averaged "standard" (that is, with identical weights), or with different weights.
La
La
Il a été démontré dans des études scientifiques qu'il est préférable d'égaliser d'abord les pics, puis ensuite les creux. En effet, l'oreille humaine est plus sensible aux pics qu'aux creux.It has been shown in scientific studies that it is better to first equalize the peaks, then the troughs. Indeed, the human ear is more sensitive to peaks than hollows.
Dans un mode de réalisation, l'optimisation de l'offset de la courbe cible est réalisée comme suit :
- La courbe cible et la réponse fréquentielle moyenne sont recalculées sur une échelle logarithmique afin d'approximer la résolution non uniforme du système auditif. Ceci est réalisé par une fonction de lissage qui rééchantillonne la réponse fréquentielle sur une échelle logarithmique avec par exemple une résolution fréquentielle de 1/48 octave.
- i) La bande de fréquence d'optimisation « FreqRange » est appliquée comme un vecteur de poids FreqWeight qui vaut 0 en dehors de la bande de fréquence et 1 à l'intérieur de la bande de fréquence.
- ii) La valeur initiale de l'offset « Offset » (en dB) est calculée comme la valeur moyenne de la réponse fréquentielle moyenne dans la bande de fréquence d'égalisation :
- iii) L'algorithme d'optimisation consiste à trouver l'offset optimal, Offset, qui minimise l'erreur entre M et Cec (=Shape+Offset), définie comme suit :
- The target curve and the average frequency response are recalculated on a log scale to approximate the nonuniform resolution of the auditory system. This is achieved by a smoothing function that resamples the frequency response on a logarithmic scale with for example a 1/48 octave frequency resolution.
- i) The "FreqRange" optimization frequency band is applied as a FreqWeight weight vector that is 0 outside the frequency band and 1 within the frequency band.
- ii) The initial Offset value (in dB) is calculated as the average value of the average frequency response in the equalization frequency band:
- iii) The optimization algorithm consists in finding the optimal offset, Offset, which minimizes the error between M and C ec (= Shape + Offset), defined as follows:
Les paramètres et le nombre des filtres sont optimisés au moyen d'un algorithme. Les paramètres f, Q et G (respectivement fréquence centrale, facteur de qualité et gain des filtres biquads) sont optimisés à partir d'intervalles de valeurs qui peuvent être prédéfinis par un utilisateur, et les plages de valeurs de Q et G peuvent dépendre de la fréquence. Ainsi, par exemple dans les hautes fréquences, les filtres de faible gain sont plus facilement éliminés car ils ne sont pas perceptibles.Parameters and number of filters are optimized using an algorithm. The parameters f, Q and G (respectively central frequency, quality factor and gain of the biquads) are optimized from intervals of values that can be predefined by a user, and the ranges of values of Q and G may depend on frequency. Thus, for example in high frequencies, the low gain filters are more easily eliminated because they are not perceptible.
Dans un mode de réalisation, l'objectif est de trouver les paramètres optimaux (fcopt, Gopt, Qopt) d'un filtre et l'offset optimal de la courbe cible Offsetopt. Les limites des paramètres sont déterminées comme ceci :
Un processus de post-optimisation est réalisé. Ce processus de post-optimisation consiste à reclasser les filtres par fréquence croissante et à réoptimiser les coefficients. Si un filtre est annulé lors de ce processus, un nouveau pic/creux est recherché afin d'avoir en sortie le nombre maximum de filtres. Le processus d'optimisation est mis en oeuvre jusqu'à ce que le nombre maximum de filtres soit atteint.A post-optimization process is performed. This post-optimization process consists of reclassifying the filters by increasing frequency and reoptimizing the coefficients. If a filter is canceled during this process, a new peak / dip is searched in order to output the maximum number of filters. The optimization process is implemented until the maximum number of filters is reached.
Dans un mode de réalisation, l'étape d'interpolation de la courbe cible est réalisée au moyen de la méthode d'Hermite.In one embodiment, the interpolation step of the target curve is performed using the Hermite method.
Dans un mode de réalisation, le procédé selon la présente invention comporte en outre une étape d'optimisation automatique de l'offset de la réponse cible Cec, répétée à chaque itération.In one embodiment, the method according to the present invention further comprises a step of automatically optimizing the offset of the target response C ec , repeated at each iteration.
Dans un mode de réalisation, le procédé selon la présente invention comporte en outre une étape de lissage des N réponses fréquentielles.In one embodiment, the method according to the present invention further comprises a step of smoothing the N frequency responses.
Dans le cadre du procédé selon la présente invention, on met en oeuvre des filtres correspondants aux types suivants : « peak », « notch » « high-shelf » et « low-shelf » en fonction de la forme des maxima locaux (pics) et des minima locaux (creux).In the context of the process according to the present invention, filters corresponding to the following types are used: "peak","notch","high-shelf" "And" low-shelf "depending on the shape of local maxima (peaks) and local minima (troughs).
Dans certains cas, il est préférable de choisir un filtre de type « peak ». Dans d'autres cas, il est préférable de choisir un filtre de type « shelf ». La sélection du filtre est effectuée en fonction du dépassement ou non d'un certain seuil par le facteur de qualité.In some cases, it is better to choose a peak type filter. In other cases, it is better to choose a "shelf" filter. The selection of the filter is made according to whether or not a certain threshold is exceeded by the quality factor.
Dans un mode de réalisation, le procédé selon la présente invention met en outre en oeuvre un algorithme d'optimisation globale pour minimiser l'erreur.In one embodiment, the method according to the present invention furthermore implements a global optimization algorithm to minimize the error.
La présente invention se rapporte également à un système d'égalisation acoustique automatisé, comportant des moyens pour :
- mesurer N réponses impulsionnelles RI1, RI2, ..., RIN après émission d'un signal sonore précalibré reçu par N microphones ;
- calculer les N réponses fréquentielles correspondantes par Transformée de Fourier rapide ;
- établir une moyenne M des N réponses fréquentielles ;
- traduire en échelle fréquentielle logarithmique ladite moyenne M des N réponses fréquentielles ;
- interpoler une courbe cible Cec à partir d'un certain nombre de points définis par un utilisateur;
- traduire en échelle fréquentielle logarithmique ladite courbe cible Cec ;
- comparer ladite réponse moyennée M et ladite réponse cible Cec, en calculant la différence entre ladite réponse moyennée M et ladite réponse cible Cec ;
- analyser la courbe Cdiff résultant de la différence entre ladite réponse moyennée M et ladite réponse cible Cec ; et
- déterminer des paramètres de filtres pour la réduction de la différence entre ladite réponse moyennée M et ladite réponse cible Cec en traitant tout d'abord les maxima locaux par ordre décroissant suivant leur gain, puis les minima locaux, et en réalisant des itérations successives ;
- measuring N impulse responses RI 1 , RI 2 , ..., RI N after emission of a precalibrated sound signal received by N microphones;
- calculate the N corresponding frequency responses by Fast Fourier Transform;
- establish an average M of the N frequency responses;
- translating into a logarithmic frequency scale said average M of the N frequency responses;
- interpolating a target curve C ec from a number of points defined by a user;
- translating into a logarithmic frequency scale said target curve C ec ;
- comparing said averaged response M and said target response C ec , by calculating the difference between said averaged response M and said target response C ec;
- analyzing the curve C diff resulting from the difference between said averaged response M and said target response C ec; and
- determining filter parameters for reducing the difference between said averaged response M and said target response C ec by first processing the local maxima by order decreasing according to their gain, then the local minima, and realizing successive iterations;
L'invention est décrite dans ce qui précède à titre d'exemple. Il est entendu que l'homme du métier est à même de réaliser différentes variantes de l'invention sans pour autant sortir du cadre du brevet.The invention is described in the foregoing by way of example. It is understood that the skilled person is able to realize different variants of the invention without departing from the scope of the patent.
Claims (7)
- Method for automatic acoustic equalization, comprising the steps of:• measuring N impulse responses RI1, RI2, ..., RIN following the emission of a pre-calibrated sound signal received by N microphones;• calculating N corresponding frequency responses using fast Fourier transforms;• establishing a mean M of the N frequency responses;• transposing said mean M of the N frequency responses onto a logarithmic frequency scale;• interpolating a target sound signature curve Cec from a specific number of points defined by a user;• transposing said target sound signature curve Cec onto a logarithmic frequency scale;• comparing said mean response M and said target response Cec by calculating the offset between said mean response M and said target sound signature response Cec;• analyzing the curve Cdiff resulting from the offset between said mean response M and said target response Cec; and characterized in that it comprises the following step:• determining filter parameters for reducing the offset between said mean response M and said target response Cec by firstly processing the local maxima in descending order according to the gain thereof, then the local minima, and by carrying out successive iterations;said method further including a step of optimization of the parameters of the filters in order to improve the performance of the system.
- Automated acoustic equalization method according to Claim 1, characterized in that the step of interpolation of the target sound signature curve is carried out by means of the Hermitian method.
- Automated acoustic equalization method according to Claim 1 or 2, characterized in that it further includes a step of automatic optimization of the offset of the target response Cec repeated on each iteration.
- Automated acoustic equalization method according to Claim 1, 2 or 3, characterized in that it further includes a step of smoothing of the N frequency responses.
- Automated acoustic equalization method according to at least one of the preceding claims, characterized in that it employs filters corresponding to the following types: "peak", "notch", "high-shelf' and "low-shelf' as a function of the shape of the local maxima and the local minima.
- Automated acoustic equalization method according to at least one of the preceding claims, characterized in that it employs a global optimization algorithm to minimize the error.
- Automated acoustic equalization system, including means for:• measuring N impulse responses RI1, RI2, ..., RIN following the emission of a pre-calibrated sound signal received by N microphones;• calculating N corresponding frequency responses using fast Fourier transforms;• establishing a mean M of the N frequency responses;• transposing said mean M of the N frequency responses onto a logarithmic frequency scale;• interpolating a target sound signature curve Cec from a specific number of points defined by a user;• transposing said target sound signature curve Cec onto a logarithmic frequency scale;• comparing said mean response M and said target response Cec by calculating the offset between said mean response M and said target sound signature response Cec;• analyzing the curve Cdiff resulting from the offset between said mean response M and said target response Cec; and characterized in that it includes means for:• determining filter parameters for reducing the offset between said mean response M and said target response Cec by firstly processing the local maxima in descending order according to the gain thereof, then the local minima, and by carrying out successive iterations;said system further including means for optimization of the parameters of the filters in order to improve the performance of the system.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1451504A FR3018015B1 (en) | 2014-02-25 | 2014-02-25 | AUTOMATED ACOUSTIC EQUALIZATION METHOD AND SYSTEM |
PCT/EP2015/052199 WO2015128160A1 (en) | 2014-02-25 | 2015-02-03 | Method and system for automatic acoustic equalisation |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3111667A1 EP3111667A1 (en) | 2017-01-04 |
EP3111667B1 true EP3111667B1 (en) | 2018-04-11 |
Family
ID=50933309
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15703951.2A Active EP3111667B1 (en) | 2014-02-25 | 2015-02-03 | Method and system for automatic acoustic equalisation |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP3111667B1 (en) |
CN (1) | CN106063293B (en) |
ES (1) | ES2676577T3 (en) |
FR (1) | FR3018015B1 (en) |
WO (1) | WO2015128160A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR3107982A1 (en) * | 2020-03-05 | 2021-09-10 | Faurecia Clarion Electronics Europe | Method and system for determining sound equalization filters of an audio system |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR3050601B1 (en) | 2016-04-26 | 2018-06-22 | Arkamys | METHOD AND SYSTEM FOR BROADCASTING A 360 ° AUDIO SIGNAL |
CN106877820B (en) * | 2017-01-12 | 2020-08-11 | 广州市迪声音响有限公司 | Equalization system and method for dynamically changing equalization gain |
CN109889955B (en) * | 2019-01-28 | 2021-01-12 | 中科上声(苏州)电子有限公司 | Method and system for automatically balancing robustness of sound field in vehicle |
WO2021051377A1 (en) * | 2019-09-20 | 2021-03-25 | Harman International Industries, Incorporated | Room calibration based on gaussian distribution and k-nearestneighbors algorithm |
CN112584274B (en) * | 2019-09-27 | 2022-05-03 | 宏碁股份有限公司 | Adjusting system and adjusting method for equalization processing |
CN112769410B (en) * | 2020-12-25 | 2024-06-11 | 西安讯飞超脑信息科技有限公司 | Filter construction method, audio processing method, electronic equipment and storage device |
FR3119723B1 (en) | 2021-02-09 | 2023-08-04 | Arkamys | Process for the automated adjustment of digital processing parameters applied to signals before broadcasting by loudspeakers and device for implementing such a process |
CN113949968B (en) * | 2021-09-07 | 2024-10-01 | 万魔声学股份有限公司 | Frequency response correction method, electronic equipment and signal processing method |
CN114157965B (en) * | 2021-11-26 | 2024-03-29 | 国光电器股份有限公司 | Sound effect compensation method and device, earphone and storage medium |
CN115604628B (en) * | 2022-12-12 | 2023-04-07 | 杭州兆华电子股份有限公司 | Filter calibration method and device based on earphone loudspeaker frequency response |
GB2628409A (en) * | 2023-03-24 | 2024-09-25 | Tymphany Worldwide Enterprises Ltd | Calibration of a loudspeaker system |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7583806B2 (en) * | 2003-06-09 | 2009-09-01 | Bose Corporation | Convertible automobile sound system equalizing |
US8082051B2 (en) * | 2005-07-29 | 2011-12-20 | Harman International Industries, Incorporated | Audio tuning system |
JP4888163B2 (en) * | 2007-03-09 | 2012-02-29 | ヤマハ株式会社 | Karaoke equipment |
EP2326108B1 (en) * | 2009-11-02 | 2015-06-03 | Harman Becker Automotive Systems GmbH | Audio system phase equalizion |
FR2967861B1 (en) * | 2010-11-18 | 2013-11-22 | Ct Scient Tech Batiment Cstb | ELECTROACOUSTIC SYSTEM FOR A SHOWROOM |
-
2014
- 2014-02-25 FR FR1451504A patent/FR3018015B1/en active Active
-
2015
- 2015-02-03 EP EP15703951.2A patent/EP3111667B1/en active Active
- 2015-02-03 CN CN201580010329.9A patent/CN106063293B/en active Active
- 2015-02-03 WO PCT/EP2015/052199 patent/WO2015128160A1/en active Application Filing
- 2015-02-03 ES ES15703951.2T patent/ES2676577T3/en active Active
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR3107982A1 (en) * | 2020-03-05 | 2021-09-10 | Faurecia Clarion Electronics Europe | Method and system for determining sound equalization filters of an audio system |
WO2021175979A1 (en) * | 2020-03-05 | 2021-09-10 | Faurecia Clarion Electronics Europe | Method and system for determining sound equalising filters of an audio system |
US20230108904A1 (en) * | 2020-03-05 | 2023-04-06 | Faurecia Clarion Electronics Europe | Method and system for determining sound equalising filters of an audio system |
Also Published As
Publication number | Publication date |
---|---|
CN106063293A (en) | 2016-10-26 |
CN106063293B (en) | 2019-06-07 |
EP3111667A1 (en) | 2017-01-04 |
FR3018015B1 (en) | 2016-04-29 |
FR3018015A1 (en) | 2015-08-28 |
ES2676577T3 (en) | 2018-07-23 |
WO2015128160A1 (en) | 2015-09-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3111667B1 (en) | Method and system for automatic acoustic equalisation | |
US9118290B2 (en) | Speed dependent equalizing control system | |
EP2898707A1 (en) | Optimized calibration of a multi-loudspeaker sound restitution system | |
EP2772916B1 (en) | Method for suppressing noise in an audio signal by an algorithm with variable spectral gain with dynamically adaptive strength | |
EP1546916B1 (en) | Method and system for processing a sound field representation | |
EP1586220B1 (en) | Method and device for controlling a reproduction unit using a multi-channel signal | |
EP2042000B1 (en) | Method and device for diagnosing the operating state of a sound system | |
CN107409256B (en) | Sound field correction apparatus, sound field correction method, and computer readable medium | |
CN115862657B (en) | Noise-following gain method and device, vehicle-mounted system, electronic equipment and storage medium | |
EP4040810B1 (en) | Method for automated adjustment of parameters for digital processing applied to signals before broadcasting by loudspeakers and device for implementing such a method | |
EP2940863B1 (en) | Compression method and dynamic audio compressor | |
EP3844979A1 (en) | Method and device for controlling the distortion of a loudspeaker system on board a vehicle | |
FR2967848A1 (en) | SPECTRUM CORRECTION SYSTEM INTENDED IN PARTICULAR FOR A SHOWROOM | |
EP2515300A1 (en) | Method and System for noise reduction | |
FR3112017A1 (en) | Electronic equipment including a distortion simulator | |
FR3107982A1 (en) | Method and system for determining sound equalization filters of an audio system | |
WO2016096130A1 (en) | Blind channel equaliser | |
EP4184505A1 (en) | Complexity optimized sound spatialization with room effect | |
EP1540987B1 (en) | Public address system tuning method | |
FR3004099A1 (en) | METHOD AND SYSTEM FOR CHARACTERIZING BONE TISSUE | |
JP7020955B2 (en) | Sound field correction device, sound field correction method and sound field correction program | |
EP3934282A1 (en) | Method for converting a first set of signals representing a sound field into a second set of signals and associated electronic device | |
EP3248286B1 (en) | Amplifier with adjustment of the automatic sound level | |
EP4372986A1 (en) | Method for equalizing a broadcast audio frequency signal in a broadcast environment, computer program product and corresponding device | |
EP1271473B1 (en) | System and method for PRE-AND POST-PROCESSING of an audio signal for transmission over a strongly distorted channel |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20160819 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAX | Request for extension of the european patent (deleted) | ||
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20171016 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 989247 Country of ref document: AT Kind code of ref document: T Effective date: 20180415 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602015009826 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2676577 Country of ref document: ES Kind code of ref document: T3 Effective date: 20180723 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20180411 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180711 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180711 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180712 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 989247 Country of ref document: AT Kind code of ref document: T Effective date: 20180411 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180813 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602015009826 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
26N | No opposition filed |
Effective date: 20190114 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20190203 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190203 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20190228 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190228 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190203 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190203 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190203 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190228 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20200327 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190204 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180811 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20150203 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230512 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240226 Year of fee payment: 10 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240228 Year of fee payment: 10 |