EP3111667B1 - Method and system for automatic acoustic equalisation - Google Patents

Method and system for automatic acoustic equalisation Download PDF

Info

Publication number
EP3111667B1
EP3111667B1 EP15703951.2A EP15703951A EP3111667B1 EP 3111667 B1 EP3111667 B1 EP 3111667B1 EP 15703951 A EP15703951 A EP 15703951A EP 3111667 B1 EP3111667 B1 EP 3111667B1
Authority
EP
European Patent Office
Prior art keywords
response
target
mean
offset
curve
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP15703951.2A
Other languages
German (de)
French (fr)
Other versions
EP3111667A1 (en
Inventor
Frédéric AMADU
Delphine Devallez
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Arkamys SA
Original Assignee
Arkamys SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Arkamys SA filed Critical Arkamys SA
Publication of EP3111667A1 publication Critical patent/EP3111667A1/en
Application granted granted Critical
Publication of EP3111667B1 publication Critical patent/EP3111667B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/04Circuits for transducers, loudspeakers or microphones for correcting frequency response
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10General applications
    • H04R2499/13Acoustic transducers and sound field adaptation in vehicles

Definitions

  • the present invention relates to the field of sound signal processing.
  • the present invention relates more particularly to a method and an automated acoustic equalization system.
  • a case of use of the present invention is as follows: in the automotive field: a plurality of microphones are placed in a vehicle and pre-calibrated sound sequences are broadcast in the vehicle speakers. A system compares the sound signals emitted and the sound signals received and recorded. We deduce the "acoustic signature" of the passenger compartment of the vehicle. The user then defines a target acoustic signature curve, which is different from the vehicle's native acoustic signature. A second algorithm calculates digital filter coefficients so that, when these filters are applied before sound signals are broadcast in the vehicle speakers, the acoustic signature of the vehicle becomes the target sound signature curve, not the native acoustic signature of the vehicle.
  • IIR Infinite Impulse Response filters
  • Biquad filters of the second order are used.
  • the method and the system according to the present invention concern the equalization of the amplitude of the frequency response of the passenger compartment.
  • This technical solution of the prior art proposes to measure the emitting response, a theater observed at the receiver by using, in particular, a measurement signal supplied by a noise generator or any other measurement method making it possible to observe the system response in open loop.
  • the equalizer device works to make said response come closest to a desired response.
  • This technical solution of the prior art has for application the modification of the acoustic properties of theaters.
  • the prior art is also known from US Pat. US 6,721,428 B1 (Texas Instruments), an automatic speaker equalizer.
  • This prior art US patent relates more particularly to a method for generating digital filters for equalizing a loudspeaker.
  • First digital data is provided, for a tolerance interval for a tone-based target response response versus frequency for the loudspeaker.
  • Second digital data is generated, for an actual acoustic signal response curve as a function of frequency for the loudspeaker.
  • the first digital data is compared with the second digital data, and it is determined whether the actual response curve is in the tolerance range.
  • digital audio filters are iteratively generated, and the digital audio filters are applied to the second digital data to generate third digital data for a compensated response curve. .
  • the frequency, gain and bandwidth of the digital audio filters are automatically optimized until the compensated response curve is within the tolerance range or a predetermined limit of the number of digital audio filters has been reached. of the two taking place first.
  • the present invention provides a method for providing equalization of a signal by determining filter parameters to reduce the difference between the amplitude of a frequency response representing the acoustic signature of a set of speakers in their environment and a target sound signature curve.
  • the method according to the present invention makes it possible to obtain automated acoustic equalization thanks to a precise and optimized calculation of filter parameters.
  • the interpolation step of the target sound signature curve is performed using the Hermite method.
  • said method further comprises a step of automatically optimizing the offset of the target response C ec , repeated at each iteration.
  • said method further comprises a step of smoothing the N frequency responses.
  • said method implements filters corresponding to the following types: "peak”, “notch”"high-shelf” and “ low-shelf " depending on the shape of local maxima and local minima.
  • said method furthermore implements a global optimization algorithm to minimize the error.
  • the Figure 1 illustrates the different steps of the process according to the present invention.
  • a logarithmic frequency scale translation of said average M of the N frequency responses is performed.
  • a target sound signature curve C ec is interpolated and then translated into a logarithmic frequency scale.
  • the averaged response M and the target sound signature response C ec are compared by calculating the difference between the averaged response M and the target response C ec .
  • the curve C diff resulting from the difference between said averaged response M and said target response C ec is analyzed.
  • filter parameters are determined for reducing the difference between said averaged response M and said target response C ec by firstly processing the local maxima in descending order according to their gain, then the local minima, and performing successive iterations.
  • the method according to the present invention further comprises a step of optimizing the parameters of the filters in order to improve the performance of the system.
  • Frequency responses can be averaged "standard” (that is, with identical weights), or with different weights.
  • the Figure 2 represents the target sound signature curve C ec within the meaning of the present invention, the frequency responses derived from the N impulse response measurements, as well as the average M.
  • a comparison of the averaged response is carried out. M and the target response C ec , by calculating the difference between the averaged response M and the target response C ec .
  • the Figure 3 illustrates the detection and ranking of local maxima ("peaks") and local minima ("troughs").
  • the local maxima (peaks) are first processed in descending order according to their gain, then the local minima (troughs) are processed in ascending order. This makes it possible to determine filter parameters for reducing the difference between the averaged response M and the target response C ec . Successive iterations are performed.
  • Parameters and number of filters are optimized using an algorithm.
  • the parameters f, Q and G (respectively central frequency, quality factor and gain of the biquads) are optimized from intervals of values that can be predefined by a user, and the ranges of values of Q and G may depend on frequency. Thus, for example in high frequencies, the low gain filters are more easily eliminated because they are not perceptible.
  • the objective is to find the optimal parameters (fc opt , G opt , Q opt ) of a filter and the optimal offset of the target curve Offset opt.
  • the limits of the parameters are determined like this: max f vs 2 1 12 , FreqRange 1 ⁇ f vs Opt ⁇ min f vs ⁇ 2 1 12 , FreqRange 2 - BOY WUT ⁇ 0.9 ⁇ BOY WUT Opt ⁇ BOY WUT ⁇ 1.1 s i BOY WUT ⁇ 0 e t - BOY WUT ⁇ 1.1 ⁇ BOY WUT Opt ⁇ BOY WUT ⁇ 0.9 s i BOY WUT > 0 QRange 1 ⁇ Q Opt ⁇ QRange 2 TargetGain - 100 ⁇ TargetGain boy Wut Opt ⁇ TargetGain + 100 where f c and G are respectively the center frequency and the gain of a biquad filter modeling the nth peak and QRange is the range of admiss
  • a post-optimization process is performed. This post-optimization process consists of reclassifying the filters by increasing frequency and reoptimizing the coefficients. If a filter is canceled during this process, a new peak / dip is searched in order to output the maximum number of filters. The optimization process is implemented until the maximum number of filters is reached.
  • the interpolation step of the target curve is performed using the Hermite method.
  • the method according to the present invention further comprises a step of automatically optimizing the offset of the target response C ec , repeated at each iteration.
  • the method according to the present invention further comprises a step of smoothing the N frequency responses.
  • filters corresponding to the following types are used: " peak”,”notch”,”high-shelf” “And” low-shelf “depending on the shape of local maxima (peaks) and local minima (troughs).
  • the filter is made according to whether or not a certain threshold is exceeded by the quality factor.
  • the method according to the present invention furthermore implements a global optimization algorithm to minimize the error.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Stereophonic System (AREA)

Description

Domaine de l'inventionField of the invention

La présente invention se rapporte au domaine du traitement du signal sonore.The present invention relates to the field of sound signal processing.

La présente invention se rapporte plus particulièrement à un procédé et à un système d'égalisation acoustique automatisé.The present invention relates more particularly to a method and an automated acoustic equalization system.

Un cas d'usage de la présente invention est le suivant : dans le domaine de l'automobile : on place une pluralité de microphones dans un véhicule et on diffuse des séquences sonores pré-calibrées dans les haut-parleurs du véhicule. Un système compare les signaux sonores émis et les signaux sonores reçus et enregistrés. On en déduit « la signature acoustique » de l'habitacle du véhicule. L'utilisateur définit ensuite une courbe de signature acoustique cible, qui est différente de la signature acoustique native du véhicule. Un second algorithme calcule des coefficients de filtres numériques de manière à ce que, lorsqu'on applique ces filtres avant diffusion de signaux sonores dans les haut-parleurs du véhicule, la signature acoustique du véhicule devienne la courbe de signature sonore cible, et non la signature acoustique native du véhicule.A case of use of the present invention is as follows: in the automotive field: a plurality of microphones are placed in a vehicle and pre-calibrated sound sequences are broadcast in the vehicle speakers. A system compares the sound signals emitted and the sound signals received and recorded. We deduce the "acoustic signature" of the passenger compartment of the vehicle. The user then defines a target acoustic signature curve, which is different from the vehicle's native acoustic signature. A second algorithm calculates digital filter coefficients so that, when these filters are applied before sound signals are broadcast in the vehicle speakers, the acoustic signature of the vehicle becomes the target sound signature curve, not the native acoustic signature of the vehicle.

Dans le cadre de la présente invention, on utilise des filtres « IIR » ou « Infinite Impulse Response » en terminologie anglo-saxonne.In the context of the present invention, "IIR" or "Infinite Impulse Response" filters are used in English terminology.

Plus particulièrement, on utilise dans le cadre de la présente invention des filtres dits « Biquad », d'ordre deux.More particularly, in the context of the present invention, so-called "Biquad" filters of the second order are used.

Le procédé et le système selon la présente invention concernent l'égalisation de l'amplitude de la réponse fréquentielle de l'habitacle.The method and the system according to the present invention concern the equalization of the amplitude of the frequency response of the passenger compartment.

Etat de la techniqueState of the art

Le document US2007/0025559 décrit un système d'égalisation acoustique automatisé comportant les caractéristiques du préambule des revendications indépendantes 1 et 7. On connaît dans l'état de la technique la demande de brevet français N° FR 2 967 848 (Centre Scientifique et Technique du Bâtiment), qui se rapporte à un système de correction de spectre destiné notamment à une salle de spectacle. Cette demande de brevet de l'art antérieur décrit un système électroacoustique comportant une pluralité de cellules. Dans ces cellules sont prévus : un dispositif d'égalisation, un émetteur, un récepteur, un circuit d'amplification pour amplifier les signaux issus du récepteur vers ledit émetteur et un organe de calcul qui va agir, entre autres, sur le dispositif d'égalisation. Cette solution technique de l'art antérieur se propose de mesurer la réponse émetteur, salle de spectacle observée au niveau du récepteur en utilisant, notamment, un signal de mesure fourni par un générateur de bruit ou toute autre méthode de mesure permettant d'observer la réponse du système en boucle ouverte. Le dispositif d'égalisation oeuvre pour que ladite réponse se rapproche le plus d'une réponse désirée. Cette solution technique de l'art antérieur a pour application la modification des propriétés acoustiques de salles de spectacle.The document US2007 / 0025559 discloses an automated acoustic equalization system comprising the features of the preamble of the independent claims 1 and 7. It is known in the state of the art the French patent application No. FR 2 967 848 (Scientific and Technical Center for Building), which relates to a spectrum correction system intended in particular for a theater. This patent application of the prior art describes an electroacoustic system comprising a plurality of cells. In these cells are provided: an equalization device, a transmitter, a receiver, an amplification circuit for amplifying the signals from the receiver to said transmitter, and a computing element which will act, among other things, on the device of equalization. This technical solution of the prior art proposes to measure the emitting response, a theater observed at the receiver by using, in particular, a measurement signal supplied by a noise generator or any other measurement method making it possible to observe the system response in open loop. The equalizer device works to make said response come closest to a desired response. This technical solution of the prior art has for application the modification of the acoustic properties of theaters.

L'art antérieur connaît également, par le brevet américain N° US 6 721 428 B1 (Texas Instruments), un égaliseur automatique de haut-parleurs. Ce brevet américain de l'art antérieur se rapporte plus particulièrement à un procédé pour générer des filtres numériques pour égaliser un haut-parleur. Des premières données numériques sont fournies, pour un intervalle de tolérance pour une courbe de réponse cible de signal sonore en fonction de la fréquence pour le haut-parleur. Des secondes données numériques sont générées, pour une courbe de réponse réelle du signal sonore en fonction de la fréquence pour le haut-parleur. Les premières données numériques sont comparées avec les secondes données numériques, et il est déterminé si la courbe de réponse réelle est dans l'intervalle de tolérance. Si la courbe de réponse réelle n'est pas dans l'intervalle de tolérance, des filtres audio numériques sont générés de façon itérative, et les filtres audio numériques sont appliqués aux secondes données numériques pour générer des troisièmes données numériques pour une courbe de réponse compensée. La fréquence, le gain et la bande passante des filtres audio numériques sont optimisés de façon automatique jusqu'à ce que la courbe de réponse compensée soit dans l'intervalle de tolérance ou une limite prédéterminée du nombre de filtres audio numériques ait été atteinte, celle des deux ayant lieu en premier.The prior art is also known from US Pat. US 6,721,428 B1 (Texas Instruments), an automatic speaker equalizer. This prior art US patent relates more particularly to a method for generating digital filters for equalizing a loudspeaker. First digital data is provided, for a tolerance interval for a tone-based target response response versus frequency for the loudspeaker. Second digital data is generated, for an actual acoustic signal response curve as a function of frequency for the loudspeaker. The first digital data is compared with the second digital data, and it is determined whether the actual response curve is in the tolerance range. If the actual response curve is not in the tolerance range, digital audio filters are iteratively generated, and the digital audio filters are applied to the second digital data to generate third digital data for a compensated response curve. . The frequency, gain and bandwidth of the digital audio filters are automatically optimized until the compensated response curve is within the tolerance range or a predetermined limit of the number of digital audio filters has been reached. of the two taking place first.

On connaît également dans l'état de la technique la publication scientifique « Filter Design Method for Loudspeaker Equalization Based on IIR Parametric Filters » de German Ramos et Jose J. Lopez .It is also known in the state of the art the scientific publication "Filter Design Method for Loudspeaker Equalization Based on IIR Parametric Filters" by German Ramos and Jose J. Lopez .

Exposé de l'inventionPresentation of the invention

La présente invention propose un procédé permettant de fournir une égalisation d'un signal en déterminant des paramètres de filtres permettant de réduire l'écart entre l'amplitude d'une réponse fréquentielle représentant la signature acoustique d'un ensemble de haut-parleurs dans leur environnement et une courbe de signature sonore cible.The present invention provides a method for providing equalization of a signal by determining filter parameters to reduce the difference between the amplitude of a frequency response representing the acoustic signature of a set of speakers in their environment and a target sound signature curve.

A cet effet, la présente invention concerne, dans son acception la plus générale, un procédé d'égalisation acoustique automatisé, caractérisé en ce qu'il comporte les étapes suivantes :

  • Mesure de N réponses impulsionnelles RI1, RI2, ..., RIN après émission d'un signal sonore précalibré reçu par N microphones ;
  • Calcul des N réponses fréquentielles correspondantes par Transformée de Fourier rapide ;
  • Etablissement d'une moyenne M des N réponses fréquentielles ;
  • Traduction en échelle fréquentielle logarithmique de ladite moyenne M des N réponses fréquentielles ;
  • Interpolation d'une courbe de signature sonore cible Cec à partir d'un certain nombre de points choisis par un utilisateur ;
  • Traduction en échelle fréquentielle logarithmique de ladite courbe de signature sonore cible Cec ;
  • Comparaison de ladite réponse moyennée M et de ladite réponse cible Cec, en calculant la différence entre ladite réponse moyennée M et ladite réponse de signature sonore cible Cec ;
  • Analyse de la courbe Cdiff résultant de la différence entre ladite réponse moyennée M et ladite réponse cible Cec ; et
  • Détermination de paramètres de filtres pour la réduction de la différence entre ladite réponse moyennée M et ladite réponse cible Cec en traitant tout d'abord les maxima locaux par ordre décroissant suivant leur gain, puis les minima locaux, et en réalisant des itérations successives ;
ledit procédé comportant en outre une étape d'optimisation des paramètres des filtres afin d'améliorer la performance du système.To this end, the present invention relates, in its most general sense, to an automated acoustic equalization method, characterized in that it comprises the following steps:
  • Measuring N impulse responses RI 1 , RI 2 , ..., RI N after emission of a precalibrated sound signal received by N microphones;
  • Calculation of N corresponding frequency responses by Fast Fourier Transform;
  • Establishment of an average M of N frequency responses;
  • Logarithmic frequency scale translation of said average M of the N frequency responses;
  • Interpolation of a target sound signature curve C ec from a number of points selected by a user;
  • Logarithmic frequency scale translation of said target sound signature curve C ec ;
  • Comparing said averaged response M and said target response C ec, by calculating the difference between said averaged response M and said target sound signature response C ec ;
  • Analyzing the curve C diff resulting from the difference between said averaged response M and said target response C ec; and
  • Determining filter parameters for reducing the difference between said averaged response M and said response target C ec by first treating the local maxima in decreasing order according to their gain, then the local minima, and performing successive iterations;
said method further comprising a step of optimizing the parameters of the filters to improve the performance of the system.

Ainsi, le procédé selon la présente invention permet d'obtenir une égalisation acoustique automatisée grâce à un calcul précis et optimisé de paramètres de filtres.Thus, the method according to the present invention makes it possible to obtain automated acoustic equalization thanks to a precise and optimized calculation of filter parameters.

De préférence, l'étape d'interpolation de la courbe de signature sonore cible est réalisée au moyen de la méthode d'Hermite.Preferably, the interpolation step of the target sound signature curve is performed using the Hermite method.

Avantageusement, ledit procédé comporte en outre une étape d'optimisation automatique de l'offset de la réponse cible Cec, répétée à chaque itération.Advantageously, said method further comprises a step of automatically optimizing the offset of the target response C ec , repeated at each iteration.

Avantageusement, ledit procédé comporte en outre une étape de lissage des N réponses fréquentielles.Advantageously, said method further comprises a step of smoothing the N frequency responses.

De préférence, ledit procédé met en oeuvre des filtres correspondants aux types suivants: « peak », « notch » « high-shelf » et « low-shelf » en fonction de la forme des maxima locaux et des minima locaux.Preferably, said method implements filters corresponding to the following types: "peak", "notch""high-shelf" and " low-shelf " depending on the shape of local maxima and local minima.

Selon un mode de mise en oeuvre particulier, ledit procédé met en outre en oeuvre un algorithme d'optimisation globale pour minimiser l'erreur.According to a particular mode of implementation, said method furthermore implements a global optimization algorithm to minimize the error.

La présente invention se rapporte également à un système d'égalisation acoustique automatisé, caractérisé en ce qu'il comporte des moyens pour :

  • mesurer N réponses impulsionnelles RI1, RI2, ..., RIN après émission d'un signal sonore précalibré reçu par N microphones ;
  • calculer les N réponses fréquentielles correspondantes par Transformée de Fourier rapide ;
  • établir une moyenne M des N réponses fréquentielles ;
  • traduire en échelle fréquentielle logarithmique ladite moyenne M des N réponses fréquentielles ;
  • interpoler une courbe cible Cec à partir d'un certain nombre de points définis par un utilisateur;
  • traduire en échelle fréquentielle logarithmique ladite courbe cible Cec ;
  • comparer ladite réponse moyennée M et ladite réponse cible Cec, en calculant la différence entre ladite réponse moyennée M et ladite réponse cible Cec ;
  • analyser la courbe Cdiff résultant de la différence entre ladite réponse moyennée M et ladite réponse cible Cec ; et
  • déterminer des paramètres de filtres pour la réduction de la différence entre ladite réponse moyennée M et ladite réponse cible Cec en traitant tout d'abord les maxima locaux par ordre décroissant suivant leur gain, puis les minima locaux, et en réalisant des itérations successives ;
ledit procédé comportant en outre des moyens pour optimiser des paramètres des filtres afin d'améliorer la performance du système.The present invention also relates to an automated acoustic equalization system, characterized in that it comprises means for:
  • measuring N impulse responses RI 1 , RI 2 , ..., RI N after emission of a precalibrated sound signal received by N microphones;
  • calculate the N corresponding frequency responses by Fast Fourier Transform;
  • establish an average M of the N frequency responses;
  • translating into a logarithmic frequency scale said average M of the N frequency responses;
  • interpolating a target curve C ec from a number of points defined by a user;
  • translating into a logarithmic frequency scale said target curve C ec ;
  • comparing said averaged response M and said target response C ec , by calculating the difference between said averaged response M and said target response C ec ;
  • analyzing the curve C diff resulting from the difference between said averaged response M and said target response C ec; and
  • determining filter parameters for reducing the difference between said averaged response M and said target response C ec by first processing local maxima in descending order according to their gain, then local minima, and performing successive iterations;
said method further comprising means for optimizing filter parameters to improve system performance.

Brève description des dessinsBrief description of the drawings

On comprendra mieux l'invention à l'aide de la description, faite ci-après à titre purement explicatif, d'un mode de réalisation de l'invention, en référence aux Figures dans lesquelles :

  • la Figure 1 illustre les différentes étapes du procédé selon la présente invention ;
  • la Figure 2 représente la courbe de signature sonore cible Cec au sens de la présente invention, les réponses fréquentielles dérivées des N mesures de réponses impulsionnelles, ainsi que la moyenne M ; et
  • la Figure 3 illustre la détection et le classement des maxima locaux (« pics ») et des minima locaux (« creux »).
The invention will be better understood by means of the description, given below purely for explanatory purposes, of one embodiment of the invention, with reference to the figures in which:
  • the Figure 1 illustrates the different steps of the process according to the present invention;
  • the Figure 2 represents the target sound signature curve C ec within the meaning of the present invention, the frequency responses derived from the N impulse response measurements, as well as the average M; and
  • the Figure 3 illustrates the detection and ranking of local maxima ("peaks") and local minima ("troughs").

Description détaillée des modes de réalisation de l'inventionDETAILED DESCRIPTION OF THE EMBODIMENTS OF THE INVENTION

La Figure 1 illustre les différentes étapes du procédé selon la présente invention.The Figure 1 illustrates the different steps of the process according to the present invention.

Le procédé d'égalisation acoustique automatisé conforme à la présente invention comporte les étapes suivantes :

  • Dans un premier temps, on mesure N réponses impulsionnelles RI1, RI2, ..., RIN après émission d'un signal sonore précalibré reçu par N microphones.
The automated acoustic equalization method according to the present invention comprises the following steps:
  • In a first step, N impulse responses RI 1 , RI 2 , ..., RI N are measured after transmission of a precalibrated sound signal received by N microphones.

Ensuite on calcule les N réponses fréquentielles correspondantes par Transformée de Fourier rapide.Then the corresponding N frequency responses are computed by Fast Fourier Transform.

Ensuite, on établit une moyenne M des N réponses fréquentielles calculées.Then, an average M of the N calculated frequency responses is established.

Une traduction en échelle fréquentielle logarithmique de ladite moyenne M des N réponses fréquentielles -est effectuée.A logarithmic frequency scale translation of said average M of the N frequency responses is performed.

Une courbe de signature sonore cible Cec est interpolée, puis est traduite en échelle fréquentielle logarithmique.A target sound signature curve C ec is interpolated and then translated into a logarithmic frequency scale.

Ensuite, on compare la réponse moyennée M et la réponse de signature sonore cible Cec, en calculant la différence entre la réponse moyennée M et la réponse cible Cec.Next, the averaged response M and the target sound signature response C ec are compared by calculating the difference between the averaged response M and the target response C ec .

La courbe Cdiff résultant de la différence entre ladite réponse moyennée M et ladite réponse cible Cec est analysée.The curve C diff resulting from the difference between said averaged response M and said target response C ec is analyzed.

Enfin, on détermine des paramètres de filtres pour la réduction de la différence entre ladite réponse moyennée M et ladite réponse cible Cec en traitant tout d'abord les maxima locaux par ordre décroissant suivant leur gain, puis les minima locaux, et en réalisant des itérations successives.Finally, filter parameters are determined for reducing the difference between said averaged response M and said target response C ec by firstly processing the local maxima in descending order according to their gain, then the local minima, and performing successive iterations.

Le procédé selon la présente invention comporte en outre une étape d'optimisation des paramètres des filtres afin d'améliorer la performance du système.The method according to the present invention further comprises a step of optimizing the parameters of the filters in order to improve the performance of the system.

Les réponses fréquentielles peuvent être moyennées de façon « standard » (c'est-à-dire avec des poids identiques), ou bien avec des poids différents.Frequency responses can be averaged "standard" (that is, with identical weights), or with different weights.

La Figure 2 représente la courbe de signature sonore cible Cec au sens de la présente invention, les réponses fréquentielles dérivées des N mesures de réponses impulsionnelles, ainsi que la moyenne M. Dans le cadre de la présente invention, on procède à une comparaison de la réponse moyennée M et de la réponse cible Cec, en calculant la différence entre la réponse moyennée M et la réponse cible Cec.The Figure 2 represents the target sound signature curve C ec within the meaning of the present invention, the frequency responses derived from the N impulse response measurements, as well as the average M. In the context of the present invention, a comparison of the averaged response is carried out. M and the target response C ec , by calculating the difference between the averaged response M and the target response C ec .

La Figure 3 illustre la détection et le classement des maxima locaux (« pics ») et des minima locaux (« creux »). Conformément à la présente invention, on traite tout d'abord les maxima locaux (pics) par ordre décroissant suivant leur gain, puis on traite les minima locaux (creux) par ordre croissant. Ceci permet de déterminer des paramètres de filtres pour la réduction de la différence entre la réponse moyennée M et la réponse cible Cec. Des itérations successives sont réalisées.The Figure 3 illustrates the detection and ranking of local maxima ("peaks") and local minima ("troughs"). In accordance with the present invention, the local maxima (peaks) are first processed in descending order according to their gain, then the local minima (troughs) are processed in ascending order. This makes it possible to determine filter parameters for reducing the difference between the averaged response M and the target response C ec . Successive iterations are performed.

Il a été démontré dans des études scientifiques qu'il est préférable d'égaliser d'abord les pics, puis ensuite les creux. En effet, l'oreille humaine est plus sensible aux pics qu'aux creux.It has been shown in scientific studies that it is better to first equalize the peaks, then the troughs. Indeed, the human ear is more sensitive to peaks than hollows.

Dans un mode de réalisation, l'optimisation de l'offset de la courbe cible est réalisée comme suit :

  • La courbe cible et la réponse fréquentielle moyenne sont recalculées sur une échelle logarithmique afin d'approximer la résolution non uniforme du système auditif. Ceci est réalisé par une fonction de lissage qui rééchantillonne la réponse fréquentielle sur une échelle logarithmique avec par exemple une résolution fréquentielle de 1/48 octave.
    1. i) La bande de fréquence d'optimisation « FreqRange » est appliquée comme un vecteur de poids FreqWeight qui vaut 0 en dehors de la bande de fréquence et 1 à l'intérieur de la bande de fréquence.
    2. ii) La valeur initiale de l'offset « Offset » (en dB) est calculée comme la valeur moyenne de la réponse fréquentielle moyenne dans la bande de fréquence d'égalisation : Offset = mean C ec n i : n f
      Figure imgb0001
      ni et nf sont respectivement le premier et le dernier des points de fréquence de la bande de fréquence logarithmique d'égalisation.
    3. iii) L'algorithme d'optimisation consiste à trouver l'offset optimal, Offset, qui minimise l'erreur entre M et Cec (=Shape+Offset), définie comme suit : e mean = 1 n f n i + 1 k = n i n f | M f k C ec f k |
      Figure imgb0002
      Avec Cec =Offset+Shape
    Ceci est réalisé avec l'algorithme d'optimisation, qui calcule de façon itérative l'erreur emean, et recherche l'offset optimal dans un intervalle de +/- 100 dB autour de la valeur initiale. En plus de la minimisation de l'erreur emean, une contrainte est ajoutée au problème d'optimisation, afin de limiter le gain des pics à Gmax en dB. Il est défini comme suit : max n i k n f | M f k C ec f k | G max
    Figure imgb0003
In one embodiment, optimizing the offset of the target curve is performed as follows:
  • The target curve and the average frequency response are recalculated on a log scale to approximate the nonuniform resolution of the auditory system. This is achieved by a smoothing function that resamples the frequency response on a logarithmic scale with for example a 1/48 octave frequency resolution.
    1. i) The "FreqRange" optimization frequency band is applied as a FreqWeight weight vector that is 0 outside the frequency band and 1 within the frequency band.
    2. ii) The initial Offset value (in dB) is calculated as the average value of the average frequency response in the equalization frequency band: Offset = mean VS ec not i : not f
      Figure imgb0001
      where ni and n f are respectively the first and the last of the frequency points of the logarithmic equalization frequency band.
    3. iii) The optimization algorithm consists in finding the optimal offset, Offset, which minimizes the error between M and C ec (= Shape + Offset), defined as follows: e mean = 1 not f - not i + 1 Σ k = not i not f | M f k - VS ec f k |
      Figure imgb0002
      With C ec = Offset + Shape
    This is done with the optimization algorithm, which iteratively calculates the error e mean , and looks for the optimal offset within +/- 100 dB around the initial value. In addition to minimizing the e mean error , a constraint is added to the optimization problem, in order to limit the peak gain to G max in dB. It is defined as follows: max not i k not f | M f k - VS ec f k | BOY WUT max
    Figure imgb0003

Les paramètres et le nombre des filtres sont optimisés au moyen d'un algorithme. Les paramètres f, Q et G (respectivement fréquence centrale, facteur de qualité et gain des filtres biquads) sont optimisés à partir d'intervalles de valeurs qui peuvent être prédéfinis par un utilisateur, et les plages de valeurs de Q et G peuvent dépendre de la fréquence. Ainsi, par exemple dans les hautes fréquences, les filtres de faible gain sont plus facilement éliminés car ils ne sont pas perceptibles.Parameters and number of filters are optimized using an algorithm. The parameters f, Q and G (respectively central frequency, quality factor and gain of the biquads) are optimized from intervals of values that can be predefined by a user, and the ranges of values of Q and G may depend on frequency. Thus, for example in high frequencies, the low gain filters are more easily eliminated because they are not perceptible.

Dans un mode de réalisation, l'objectif est de trouver les paramètres optimaux (fcopt, Gopt, Qopt) d'un filtre et l'offset optimal de la courbe cible Offsetopt. Les limites des paramètres sont déterminées comme ceci : max f c 2 1 12 , FreqRange 1 f c opt min f c × 2 1 12 , FreqRange 2

Figure imgb0004
G × 0.9 G opt G × 1.1 s i G 0 e t G × 1.1 G opt G × 0.9 s i G > 0
Figure imgb0005
QRange 1 Q opt QRange 2
Figure imgb0006
TargetGain 100 TargetGain g opt TargetGain + 100
Figure imgb0007
fc et G sont respectivement la fréquence centrale et le gain d'un filtre biquad modélisant le nième pic, et QRange est la plage de valeurs admissibles du facteur de qualité Q.In one embodiment, the objective is to find the optimal parameters (fc opt , G opt , Q opt ) of a filter and the optimal offset of the target curve Offset opt. The limits of the parameters are determined like this: max f vs 2 1 12 , FreqRange 1 f vs Opt min f vs × 2 1 12 , FreqRange 2
Figure imgb0004
- BOY WUT × 0.9 BOY WUT Opt BOY WUT × 1.1 s i BOY WUT 0 e t - BOY WUT × 1.1 BOY WUT Opt BOY WUT × 0.9 s i BOY WUT > 0
Figure imgb0005
QRange 1 Q Opt QRange 2
Figure imgb0006
TargetGain - 100 TargetGain boy Wut Opt TargetGain + 100
Figure imgb0007
where f c and G are respectively the center frequency and the gain of a biquad filter modeling the nth peak and QRange is the range of admissible values of the quality factor Q.

Un processus de post-optimisation est réalisé. Ce processus de post-optimisation consiste à reclasser les filtres par fréquence croissante et à réoptimiser les coefficients. Si un filtre est annulé lors de ce processus, un nouveau pic/creux est recherché afin d'avoir en sortie le nombre maximum de filtres. Le processus d'optimisation est mis en oeuvre jusqu'à ce que le nombre maximum de filtres soit atteint.A post-optimization process is performed. This post-optimization process consists of reclassifying the filters by increasing frequency and reoptimizing the coefficients. If a filter is canceled during this process, a new peak / dip is searched in order to output the maximum number of filters. The optimization process is implemented until the maximum number of filters is reached.

Dans un mode de réalisation, l'étape d'interpolation de la courbe cible est réalisée au moyen de la méthode d'Hermite.In one embodiment, the interpolation step of the target curve is performed using the Hermite method.

Dans un mode de réalisation, le procédé selon la présente invention comporte en outre une étape d'optimisation automatique de l'offset de la réponse cible Cec, répétée à chaque itération.In one embodiment, the method according to the present invention further comprises a step of automatically optimizing the offset of the target response C ec , repeated at each iteration.

Dans un mode de réalisation, le procédé selon la présente invention comporte en outre une étape de lissage des N réponses fréquentielles.In one embodiment, the method according to the present invention further comprises a step of smoothing the N frequency responses.

Dans le cadre du procédé selon la présente invention, on met en oeuvre des filtres correspondants aux types suivants : « peak », « notch » « high-shelf » et « low-shelf » en fonction de la forme des maxima locaux (pics) et des minima locaux (creux).In the context of the process according to the present invention, filters corresponding to the following types are used: "peak","notch","high-shelf" "And" low-shelf "depending on the shape of local maxima (peaks) and local minima (troughs).

Dans certains cas, il est préférable de choisir un filtre de type « peak ». Dans d'autres cas, il est préférable de choisir un filtre de type « shelf ». La sélection du filtre est effectuée en fonction du dépassement ou non d'un certain seuil par le facteur de qualité.In some cases, it is better to choose a peak type filter. In other cases, it is better to choose a "shelf" filter. The selection of the filter is made according to whether or not a certain threshold is exceeded by the quality factor.

Dans un mode de réalisation, le procédé selon la présente invention met en outre en oeuvre un algorithme d'optimisation globale pour minimiser l'erreur.In one embodiment, the method according to the present invention furthermore implements a global optimization algorithm to minimize the error.

La présente invention se rapporte également à un système d'égalisation acoustique automatisé, comportant des moyens pour :

  • mesurer N réponses impulsionnelles RI1, RI2, ..., RIN après émission d'un signal sonore précalibré reçu par N microphones ;
  • calculer les N réponses fréquentielles correspondantes par Transformée de Fourier rapide ;
  • établir une moyenne M des N réponses fréquentielles ;
  • traduire en échelle fréquentielle logarithmique ladite moyenne M des N réponses fréquentielles ;
  • interpoler une courbe cible Cec à partir d'un certain nombre de points définis par un utilisateur;
  • traduire en échelle fréquentielle logarithmique ladite courbe cible Cec ;
  • comparer ladite réponse moyennée M et ladite réponse cible Cec, en calculant la différence entre ladite réponse moyennée M et ladite réponse cible Cec ;
  • analyser la courbe Cdiff résultant de la différence entre ladite réponse moyennée M et ladite réponse cible Cec ; et
  • déterminer des paramètres de filtres pour la réduction de la différence entre ladite réponse moyennée M et ladite réponse cible Cec en traitant tout d'abord les maxima locaux par ordre décroissant suivant leur gain, puis les minima locaux, et en réalisant des itérations successives ;
ledit système comportant en outre des moyens pour optimiser des paramètres des filtres afin d'améliorer la performance du système.The present invention also relates to an automated acoustic equalization system, comprising means for:
  • measuring N impulse responses RI 1 , RI 2 , ..., RI N after emission of a precalibrated sound signal received by N microphones;
  • calculate the N corresponding frequency responses by Fast Fourier Transform;
  • establish an average M of the N frequency responses;
  • translating into a logarithmic frequency scale said average M of the N frequency responses;
  • interpolating a target curve C ec from a number of points defined by a user;
  • translating into a logarithmic frequency scale said target curve C ec ;
  • comparing said averaged response M and said target response C ec , by calculating the difference between said averaged response M and said target response C ec;
  • analyzing the curve C diff resulting from the difference between said averaged response M and said target response C ec; and
  • determining filter parameters for reducing the difference between said averaged response M and said target response C ec by first processing the local maxima by order decreasing according to their gain, then the local minima, and realizing successive iterations;
said system further comprising means for optimizing filter parameters to improve system performance.

L'invention est décrite dans ce qui précède à titre d'exemple. Il est entendu que l'homme du métier est à même de réaliser différentes variantes de l'invention sans pour autant sortir du cadre du brevet.The invention is described in the foregoing by way of example. It is understood that the skilled person is able to realize different variants of the invention without departing from the scope of the patent.

Claims (7)

  1. Method for automatic acoustic equalization, comprising the steps of:
    • measuring N impulse responses RI1, RI2, ..., RIN following the emission of a pre-calibrated sound signal received by N microphones;
    • calculating N corresponding frequency responses using fast Fourier transforms;
    • establishing a mean M of the N frequency responses;
    • transposing said mean M of the N frequency responses onto a logarithmic frequency scale;
    • interpolating a target sound signature curve Cec from a specific number of points defined by a user;
    • transposing said target sound signature curve Cec onto a logarithmic frequency scale;
    • comparing said mean response M and said target response Cec by calculating the offset between said mean response M and said target sound signature response Cec;
    • analyzing the curve Cdiff resulting from the offset between said mean response M and said target response Cec; and characterized in that it comprises the following step:
    • determining filter parameters for reducing the offset between said mean response M and said target response Cec by firstly processing the local maxima in descending order according to the gain thereof, then the local minima, and by carrying out successive iterations;
    said method further including a step of optimization of the parameters of the filters in order to improve the performance of the system.
  2. Automated acoustic equalization method according to Claim 1, characterized in that the step of interpolation of the target sound signature curve is carried out by means of the Hermitian method.
  3. Automated acoustic equalization method according to Claim 1 or 2, characterized in that it further includes a step of automatic optimization of the offset of the target response Cec repeated on each iteration.
  4. Automated acoustic equalization method according to Claim 1, 2 or 3, characterized in that it further includes a step of smoothing of the N frequency responses.
  5. Automated acoustic equalization method according to at least one of the preceding claims, characterized in that it employs filters corresponding to the following types: "peak", "notch", "high-shelf' and "low-shelf' as a function of the shape of the local maxima and the local minima.
  6. Automated acoustic equalization method according to at least one of the preceding claims, characterized in that it employs a global optimization algorithm to minimize the error.
  7. Automated acoustic equalization system, including means for:
    • measuring N impulse responses RI1, RI2, ..., RIN following the emission of a pre-calibrated sound signal received by N microphones;
    • calculating N corresponding frequency responses using fast Fourier transforms;
    • establishing a mean M of the N frequency responses;
    • transposing said mean M of the N frequency responses onto a logarithmic frequency scale;
    • interpolating a target sound signature curve Cec from a specific number of points defined by a user;
    • transposing said target sound signature curve Cec onto a logarithmic frequency scale;
    • comparing said mean response M and said target response Cec by calculating the offset between said mean response M and said target sound signature response Cec;
    • analyzing the curve Cdiff resulting from the offset between said mean response M and said target response Cec; and characterized in that it includes means for:
    • determining filter parameters for reducing the offset between said mean response M and said target response Cec by firstly processing the local maxima in descending order according to the gain thereof, then the local minima, and by carrying out successive iterations;
    said system further including means for optimization of the parameters of the filters in order to improve the performance of the system.
EP15703951.2A 2014-02-25 2015-02-03 Method and system for automatic acoustic equalisation Active EP3111667B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1451504A FR3018015B1 (en) 2014-02-25 2014-02-25 AUTOMATED ACOUSTIC EQUALIZATION METHOD AND SYSTEM
PCT/EP2015/052199 WO2015128160A1 (en) 2014-02-25 2015-02-03 Method and system for automatic acoustic equalisation

Publications (2)

Publication Number Publication Date
EP3111667A1 EP3111667A1 (en) 2017-01-04
EP3111667B1 true EP3111667B1 (en) 2018-04-11

Family

ID=50933309

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15703951.2A Active EP3111667B1 (en) 2014-02-25 2015-02-03 Method and system for automatic acoustic equalisation

Country Status (5)

Country Link
EP (1) EP3111667B1 (en)
CN (1) CN106063293B (en)
ES (1) ES2676577T3 (en)
FR (1) FR3018015B1 (en)
WO (1) WO2015128160A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3107982A1 (en) * 2020-03-05 2021-09-10 Faurecia Clarion Electronics Europe Method and system for determining sound equalization filters of an audio system

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3050601B1 (en) 2016-04-26 2018-06-22 Arkamys METHOD AND SYSTEM FOR BROADCASTING A 360 ° AUDIO SIGNAL
CN106877820B (en) * 2017-01-12 2020-08-11 广州市迪声音响有限公司 Equalization system and method for dynamically changing equalization gain
CN109889955B (en) * 2019-01-28 2021-01-12 中科上声(苏州)电子有限公司 Method and system for automatically balancing robustness of sound field in vehicle
WO2021051377A1 (en) * 2019-09-20 2021-03-25 Harman International Industries, Incorporated Room calibration based on gaussian distribution and k-nearestneighbors algorithm
CN112584274B (en) * 2019-09-27 2022-05-03 宏碁股份有限公司 Adjusting system and adjusting method for equalization processing
CN112769410B (en) * 2020-12-25 2024-06-11 西安讯飞超脑信息科技有限公司 Filter construction method, audio processing method, electronic equipment and storage device
FR3119723B1 (en) 2021-02-09 2023-08-04 Arkamys Process for the automated adjustment of digital processing parameters applied to signals before broadcasting by loudspeakers and device for implementing such a process
CN113949968B (en) * 2021-09-07 2024-10-01 万魔声学股份有限公司 Frequency response correction method, electronic equipment and signal processing method
CN114157965B (en) * 2021-11-26 2024-03-29 国光电器股份有限公司 Sound effect compensation method and device, earphone and storage medium
CN115604628B (en) * 2022-12-12 2023-04-07 杭州兆华电子股份有限公司 Filter calibration method and device based on earphone loudspeaker frequency response
GB2628409A (en) * 2023-03-24 2024-09-25 Tymphany Worldwide Enterprises Ltd Calibration of a loudspeaker system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7583806B2 (en) * 2003-06-09 2009-09-01 Bose Corporation Convertible automobile sound system equalizing
US8082051B2 (en) * 2005-07-29 2011-12-20 Harman International Industries, Incorporated Audio tuning system
JP4888163B2 (en) * 2007-03-09 2012-02-29 ヤマハ株式会社 Karaoke equipment
EP2326108B1 (en) * 2009-11-02 2015-06-03 Harman Becker Automotive Systems GmbH Audio system phase equalizion
FR2967861B1 (en) * 2010-11-18 2013-11-22 Ct Scient Tech Batiment Cstb ELECTROACOUSTIC SYSTEM FOR A SHOWROOM

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3107982A1 (en) * 2020-03-05 2021-09-10 Faurecia Clarion Electronics Europe Method and system for determining sound equalization filters of an audio system
WO2021175979A1 (en) * 2020-03-05 2021-09-10 Faurecia Clarion Electronics Europe Method and system for determining sound equalising filters of an audio system
US20230108904A1 (en) * 2020-03-05 2023-04-06 Faurecia Clarion Electronics Europe Method and system for determining sound equalising filters of an audio system

Also Published As

Publication number Publication date
CN106063293A (en) 2016-10-26
CN106063293B (en) 2019-06-07
EP3111667A1 (en) 2017-01-04
FR3018015B1 (en) 2016-04-29
FR3018015A1 (en) 2015-08-28
ES2676577T3 (en) 2018-07-23
WO2015128160A1 (en) 2015-09-03

Similar Documents

Publication Publication Date Title
EP3111667B1 (en) Method and system for automatic acoustic equalisation
US9118290B2 (en) Speed dependent equalizing control system
EP2898707A1 (en) Optimized calibration of a multi-loudspeaker sound restitution system
EP2772916B1 (en) Method for suppressing noise in an audio signal by an algorithm with variable spectral gain with dynamically adaptive strength
EP1546916B1 (en) Method and system for processing a sound field representation
EP1586220B1 (en) Method and device for controlling a reproduction unit using a multi-channel signal
EP2042000B1 (en) Method and device for diagnosing the operating state of a sound system
CN107409256B (en) Sound field correction apparatus, sound field correction method, and computer readable medium
CN115862657B (en) Noise-following gain method and device, vehicle-mounted system, electronic equipment and storage medium
EP4040810B1 (en) Method for automated adjustment of parameters for digital processing applied to signals before broadcasting by loudspeakers and device for implementing such a method
EP2940863B1 (en) Compression method and dynamic audio compressor
EP3844979A1 (en) Method and device for controlling the distortion of a loudspeaker system on board a vehicle
FR2967848A1 (en) SPECTRUM CORRECTION SYSTEM INTENDED IN PARTICULAR FOR A SHOWROOM
EP2515300A1 (en) Method and System for noise reduction
FR3112017A1 (en) Electronic equipment including a distortion simulator
FR3107982A1 (en) Method and system for determining sound equalization filters of an audio system
WO2016096130A1 (en) Blind channel equaliser
EP4184505A1 (en) Complexity optimized sound spatialization with room effect
EP1540987B1 (en) Public address system tuning method
FR3004099A1 (en) METHOD AND SYSTEM FOR CHARACTERIZING BONE TISSUE
JP7020955B2 (en) Sound field correction device, sound field correction method and sound field correction program
EP3934282A1 (en) Method for converting a first set of signals representing a sound field into a second set of signals and associated electronic device
EP3248286B1 (en) Amplifier with adjustment of the automatic sound level
EP4372986A1 (en) Method for equalizing a broadcast audio frequency signal in a broadcast environment, computer program product and corresponding device
EP1271473B1 (en) System and method for PRE-AND POST-PROCESSING of an audio signal for transmission over a strongly distorted channel

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20160819

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20171016

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 989247

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180415

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: FRENCH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602015009826

Country of ref document: DE

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2676577

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20180723

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20180411

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180712

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 989247

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180411

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180813

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602015009826

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

26N No opposition filed

Effective date: 20190114

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20190203

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190203

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190228

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190203

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190203

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190203

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20200327

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180811

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20150203

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180411

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230512

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240226

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240228

Year of fee payment: 10