EP2717599A1 - Method for processing an audio signal with modelling of the overall response of the electro-dynamic loudspeaker - Google Patents
Method for processing an audio signal with modelling of the overall response of the electro-dynamic loudspeaker Download PDFInfo
- Publication number
- EP2717599A1 EP2717599A1 EP13174690.1A EP13174690A EP2717599A1 EP 2717599 A1 EP2717599 A1 EP 2717599A1 EP 13174690 A EP13174690 A EP 13174690A EP 2717599 A1 EP2717599 A1 EP 2717599A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- loudspeaker
- audio signal
- state vector
- response
- parameters
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/04—Circuits for transducers, loudspeakers or microphones for correcting frequency response
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R29/00—Monitoring arrangements; Testing arrangements
- H04R29/001—Monitoring arrangements; Testing arrangements for loudspeakers
- H04R29/003—Monitoring arrangements; Testing arrangements for loudspeakers of the moving-coil type
Definitions
- the invention relates to a technique for processing an audio signal based on the estimation of the overall response of a loudspeaker intended to reproduce this audio signal, that is to say taking into account all the parameters electrical, mechanical and acoustic characteristics characterizing this response.
- the excursion of the loudspeaker diaphragm that is, the amplitude of its displacement by relative to its equilibrium position, quickly becomes too important, with the risk of damage to the loudspeaker and, at the very least, the introduction of excessive distortion, clipping and saturation values which rapidly degrade rapidly. the quality of playback of the audio signal.
- Another type of treatment that can be envisaged consists in applying to the audio signal a specific compensation filtering of the non-linearities introduced by the loudspeaker, in order to reduce the audio distortions and to provide a better quality of listening.
- T / S "Thiele and Small”
- T / S "Thiele and Small”
- the response of the loudspeaker, especially in the low frequencies, can be described by a set of parameters, referenced uniformly by the loudspeaker manufacturers.
- the EP 1 799 013 A1 describes a technique for predicting the behavior of a loudspeaker, based on the T / S parameters, to compensate for non-linearities of the loudspeaker and to reduce the audio distortions introduced into the acoustic signal delivered to the user.
- T / S parameters are, however, considered as invariants, known a priori, so that the modeling of the response is fixed and can not take into account either the slow evolution of the parameters, due for example to their drift over time because of the aging of the components.
- the US 2003/0142832 A1 describes a technique for adaptively estimating the parameters of a loudspeaker, including non-linear parameters, from the measurement of the current flowing through this loudspeaker, with implementation of a gradient descent algorithm.
- This method requires a pre-determination of the parameters during a static calibration phase: during this calibration, the T / S parameters are calculated for different values of the position of the membrane (offset or offset with respect to the equilibrium position). ), with measurement of the impedance. Then, a measurement of the current is compared to an estimate of the same current (squared and filtered by a low-pass filter) to calculate the derivative of the error with respect to each parameter.
- the technique also implements a gradient descent algorithm of the least mean square type (LMS).
- LMS least mean square type
- this method has the disadvantage of requiring a prior calibration phase with impedance measurements and application of a predetermined signal, which excludes a re-estimation of subsequent parameters, at least by a consumer user.
- the simple gradient descent LMS algorithms do not take into account the measurement noises, which are inevitable, which makes the estimator rather inefficient in real cases of use.
- the US 2008/0189087 A1 describes another technique for estimating the parameters of a loudspeaker, also of LMS type by gradient descent. More particularly, the method processes separately the estimation of the linear part and that of the nonlinear part. For this, the error signal used by the LMS algorithm (difference between the measured signal and the predicted signal) is processed in order to decorrelate the linear part and the nonlinear part.
- This document also proposes to implement the estimator by applying as input a particular audio signal, modified by a comb filter selectively eliminating certain selected frequencies.
- This technique has the same drawbacks as the previous one, in particular the need for a calibration from a modified input signal likely to alter the listening comfort of the user, which does not allow the user to operate. estimate during a musical listening, transparently for the user.
- the processing applied to the audio signal may in particular be a compensation processing of the non-linearities of the loudspeaker response, as determined from the state vector delivered by the predictive filter estimator.
- the processing applied to the audio signal may comprise: c1) calculating a current value of the loudspeaker excursion as a function of i) an amplification gain of the audio signal and ii) the loudspeaker response as determined from the state vector outputted by the predictive filter estimator; c2) comparing the current excursion value thus calculated with a maximum excursion value; and c3) calculating a possible attenuation of the amplification gain in case the current excursion value exceeds the maximum excursion value.
- the state vector components may include additional acoustic parameter values representative of the loudspeaker response associated with a rear cavity provided with a decompression vent.
- step b) the determination of the state vector of step b) and carried out on the fly from the current audio signal object of the treatment of step c) and reproduced by the loudspeaker, by collecting the electrical parameters at speaker terminals while playing this audio signal.
- the method may then comprise the following steps: storing a sequence of samples of the audio signal for a predetermined duration; analyzing the sequence to calculate an energy parameter of the stored audio signal; if the calculated energy parameter is greater than a predetermined threshold, enabling the estimation by the predictive filter; if not, inhibit prediction filter estimation and retain the previously estimated state vector values.
- the left half schematizes the electrical part of the loudspeaker, to which is applied a measurable excitation voltage, Umes, from an amplifier producing a current i, also measurable, passing through the coil of the loudspeaker.
- the first report transformer BI schematizes the electrical conversion into mechanical force applied to the coil.
- the report gyrator Sd schematizes the mechanical conversion (displacement of the speaker membrane) in acoustic pressure.
- the first three parameters (R e , M ms and R eq ) are linear parameters, the equivalent mass M ms being even an invariant, assumed to be known according to the manufacturer's specifications.
- R e and R eq which can be considered constant over a short period (the time of their estimation) are parameters that can drift progressively over time as a function of the rise in temperature of the voice coil. aging of components, etc. and they must therefore be re-evaluated at regular intervals.
- X [R e , R eq , Bl 0 , Bl 1 , Bl 2 , K eq0 , K eq1 , K eq2 , L e0 , L e1 , L e2 , L e3 , L e4 ] T.
- the displacement x which is an unmeasured parameter, will be a hidden variable of the estimator.
- the present invention implements a Kalman filtering, and more precisely an extended Kalman filtering (EKF), of which we will re-outline the main lines below.
- EKF extended Kalman filtering
- the "Kalman filter” which is based on a widely known algorithm, is a state estimator comprising an infinite impulse response (IIR) filter that estimates the states of a dynamic system from a set of equations describing the behavior of the system and a series of observed measures.
- IIR infinite impulse response
- Such a filter makes it possible in particular to determine a "hidden state", which is a parameter not observed but essential for the estimation.
- the first equation of the Kalman process is the "equation of evolution" of the model:
- x k F k ⁇ x k - 1 + B k ⁇ u k + w k x k being the state vector, representing the state at time k,
- F k being the transition matrix (defined at the design of the filter) which determines the evolution of the state k-1 to the new state k
- B k being a noise vector (Gaussian noise generated by the sensors)
- u k being a control vector (parameter at the input of the filter)
- w k being a state representing noise at time k .
- the first step is the prediction of the model at time k, from the state at time k-1, given by the following equations: Prediction ( a priori ) of the estimated state x ⁇ k
- k - 1 F k ⁇ x ⁇ k - 1
- k - 1 F k ⁇ P k - 1
- k - 1 Covariance of innovation S k H k ⁇ P k
- k - 1 ⁇ H k T + R k Optimal Kalman gain K k P k
- k x ⁇ k
- k I - K k ⁇ H k ⁇ P k
- the Kalman estimate is optimal in the least squares sense of the hidden model.
- Extended Kalman filtering consists of approximating these functions f and h by their partial derivatives during the computation of the covariance matrices (prediction matrix and update matrix), in order to locally linearize the model and to apply to it at each point the systems of Kalman filter prediction and update equations discussed above.
- the transition matrix and the observation matrix are the following Jacobian matrices (partial derivative matrices):
- F k - 1 ⁇ f ⁇ x ⁇
- k - 1 , u k - 1 H k ⁇ h ⁇ x ⁇
- a digitized audio signal E coming from a media player is reproduced acoustically by a loudspeaker 10 after digital / analog conversion (block 12) and amplification (block 14).
- the response of the loudspeaker 10 is simulated by an extended Kalman filter algorithm (estimator of the block 16) using as input the signals 18 collected on the loudspeaker 10, these signals comprising the voltage Umes applied to the terminals of the loudspeaker by the amplifier 14 and the current i flowing in the voice coil of the loudspeaker.
- block 20 schematizes the estimator of the Kalman filter based on the modeling of the response of the loudspeaker, block 22 the function h of the measurement equation and block 24 the comparison between estimated state and measured state, to derive an error signal for updating the dynamic model.
- the measurement of the voltage across the loudspeaker constitutes the only component of the observation vector Umes n-1 .
- the algorithm then calculates the derivative of the function h with respect to each of the components of the vector X: dh (X) / dBl0, dh (X) / dKeq0, ... which corresponds to the partial derivative of the estimated voltage, relative to each of the parameters of the model.
- the estimate of the parameters of the loudspeaker model at time n is given by the state vector X n
- n thus obtained can be used for various purposes.
- the knowledge of the response of the loudspeaker, and in particular of the excursion x of the membrane may notably be used as input data to a limiter stage 26 ( Figure 2 ): the instantaneous value x of the excursion is compared with a determined threshold X max beyond which this excursion is considered too important, with the risk of damaging the loudspeaker, the appearance of distortions, etc. If the threshold is exceeded, the The limiter determines an attenuation gain, less than unity, that will be applied to the incident signal E to reduce its amplitude, so that the excursion remains within the allowed range.
- Another treatment that can be applied to the audio signal is compensation for non-linearities (block 28). Indeed, insofar as the speaker response is modeled, it is possible to predict the nonlinearities of this response and to compensate for them by an appropriate inverse processing applied to the signal. Such treatment is in itself known, and for this reason it will not be described in more detail.
- the extended Kalman estimator operates on the fly, directly from the current audio signal reproduced by the loudspeaker, by collecting the electrical parameters on this loudspeaker (voltage, current) during the reproduction of this audio signal.
- the system can thus be used with a high-fidelity consumer installation, operating in a manner that is transparent to the user: there is no need to ask the user to reproduce a particular type of calibration signal (white noise, succession of tones, etc.) so that the algorithm can estimate the parameters of the loudspeaker, the latter can operate continuously while the music is played.
- a particular type of calibration signal white noise, succession of tones, etc.
- the algorithm can estimate the parameters of the loudspeaker, the latter can operate continuously while the music is played.
- the signal played move this membrane sufficiently so that the estimate is the best possible.
- the displacement of the membrane is calculated continuously by applying Equations (1) and (2) of the estimator (block 32), with speaker parameters which are fixed and correspond to the results of the last estimation made by the Kalman filter.
- this effective value is greater than a given threshold x_seuil (block 34) for a number of consecutive times corresponding to the time T, then it is considered that the T last seconds of signal played are valid and the filter update is activated. Kalman so that it can use these last T seconds of signal to re-estimate the parameters of the response of the speaker.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Circuit For Audible Band Transducer (AREA)
- Stereophonic System (AREA)
- Audible-Bandwidth Dynamoelectric Transducers Other Than Pickups (AREA)
- Details Of Audible-Bandwidth Transducers (AREA)
- Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
Abstract
Description
L'invention concerne une technique de traitement d'un signal audio basée sur l'estimation de la réponse globale d'un haut-parleur destiné à reproduire ce signal audio, c'est-à-dire tenant compte de l'ensemble des paramètres électriques, mécaniques et acoustiques caractérisant cette réponse.The invention relates to a technique for processing an audio signal based on the estimation of the overall response of a loudspeaker intended to reproduce this audio signal, that is to say taking into account all the parameters electrical, mechanical and acoustic characteristics characterizing this response.
Il s'agit de modéliser le comportement physique du haut-parleur pour en simuler le fonctionnement lorsque le signal audio lui est appliqué après amplification, de manière à pouvoir opérer en amont divers traitements correcteurs de ce signal audio afin d'optimiser la qualité de la reproduction acoustique finale restituée à l'auditeur.It is a question of modeling the physical behavior of the loudspeaker to simulate the operation when the audio signal is applied to it after amplification, so as to be able to operate upstream various corrective treatments of this audio signal in order to optimize the quality of the final acoustic reproduction returned to the listener.
En particulier, il est courant de renforcer les fréquences basses pour compenser le fait que les haut-parleurs dédiés à ce registre ou woofers, qui sont généralement installés dans des enceintes ouvertes (système à évent) ou fermées, sont toujours plus ou moins limités dans la restitution des fréquences les plus graves, la limite basse (dite fréquence de coupure de l'enceinte) dépendant de la taille du haut-parleur, du volume de l'enceinte et du type de montage utilisé.In particular, it is common to reinforce the low frequencies to compensate for the fact that the speakers dedicated to this register or woofers, which are generally installed in open enclosures ( vented system) or closed, are always more or less limited in the restitution of the most serious frequencies, the low limit (so-called cutoff frequency of the speaker) depending on the size of the speaker, the volume of the speaker and the type of editing used.
Toutefois, si l'on augmente le niveau du signal électrique dans les fréquences basses par un filtrage approprié, analogique ou numérique, l'excursion de la membrane du haut-parleur, c'est-à-dire l'amplitude de son déplacement par rapport à sa position d'équilibre, devient rapidement trop importante, avec un risque d'endommagement du haut-parleur et, à tout le moins, l'introduction pour des valeurs d'excursion excessives de distorsions, écrêtages et saturations qui viennent dégrader rapidement la qualité de restitution du signal audio.However, if the level of the low frequency electric signal is increased by appropriate analog or digital filtering, the excursion of the loudspeaker diaphragm, that is, the amplitude of its displacement by relative to its equilibrium position, quickly becomes too important, with the risk of damage to the loudspeaker and, at the very least, the introduction of excessive distortion, clipping and saturation values which rapidly degrade rapidly. the quality of playback of the audio signal.
La connaissance de la réponse globale du haut-parleur permet d'anticiper ce risque, pour limiter si besoin le niveau du signal à reproduire afin d'éviter des excursions excessives ou des non-linéarités génératrices de distorsions.The knowledge of the overall response of the loudspeaker makes it possible to anticipate this risk, to limit if necessary the level of the signal to be reproduced in order to avoid excessive excursions or nonlinearities generating distortions.
Un autre type de traitement envisageable consiste à appliquer au signal audio un filtrage spécifique de compensation des non-linéarités introduites par le haut-parleur, afin de réduire les distorsions audio et procurer une meilleure qualité d'écoute.Another type of treatment that can be envisaged consists in applying to the audio signal a specific compensation filtering of the non-linearities introduced by the loudspeaker, in order to reduce the audio distortions and to provide a better quality of listening.
Il s'agit alors, indépendamment de toute limitation de l'excursion maximale, de rendre le déplacement de la membrane du haut-parleur le plus linéaire possible, notamment pour les fréquences les plus graves, en compensant les limitations physiques de la réponse du haut-parleur dans ce registre au voisinage et en deçà de la fréquence de coupure acoustique de l'ensemble haut-parleur/enceinte.It is then, independently of any limitation of the maximum excursion, to make the displacement of the speaker's membrane the most linearly possible, especially for the most serious frequencies, by compensating for the physical limitations of the loudspeaker response in this register in the vicinity of and below the acoustic cut-off frequency of the loudspeaker / speaker assembly.
La connaissance des paramètres modélisant la réponse globale du haut-parleur est primordiale pour opérer de tels traitements.Knowledge of the parameters modeling the overall response of the loudspeaker is essential to operate such treatments.
Ces paramètres sont classiquement ceux dits de "Thiele et Small" (T/S), qui décrivent une modélisation d'un haut-parleur électrodynamique prenant en compte les divers phénomènes électriques, mécaniques et acoustiques impliqués par la reproduction du signal, ainsi que les conversions électro-mécanique et mécano-acoustique. La réponse du haut-parleur, notamment dans les basses fréquences, peut être ainsi décrite par un jeu de paramètres, référencés de façon uniforme par les constructeurs de haut-parleurs.These parameters are conventionally those of "Thiele and Small" (T / S), which describe a modeling of an electrodynamic loudspeaker taking into account the various electrical, mechanical and acoustic phenomena involved in the reproduction of the signal, as well as the electro-mechanical and mechano-acoustic conversions. The response of the loudspeaker, especially in the low frequencies, can be described by a set of parameters, referenced uniformly by the loudspeaker manufacturers.
Ces paramètres T/S ne sont toutefois pas constants dans le temps, ni linéaires.
- en premier lieu, ils sont susceptibles de dériver au cours du temps, en fonction par exemple du vieillissement du haut-parleur, de l'échauffement en cours d'utilisation, etc. ;
- en second lieu, si l'on souhaite disposer d'une modélisation précise et réaliste du comportement du haut-parleur, il faut tenir compte de ce que certains de ces paramètres ne sont pas linéaires, c'est-à-dire que leurs valeurs ne sont pas fixes mais varient constamment en fonction de l'excursion instantanée, c'est-à-dire de la position à un instant donné de la bobine mobile et de la membrane du haut-parleur par rapport à la position centrale d'équilibre. Tel est notamment le cas de l'inductance électrique, de la raideur mécanique totale du système (la raideur de la membrane augmentant au fur et à mesure que celle-ci s'éloigne de sa position d'équilibre) et du "facteur de force" d'entrainement de la membrane (lié au champ magnétique dans l'entrefer de la bobine, il décroit au fur et à mesure que la bobine s'éloigne de la position d'équilibre).
- in the first place, they are likely to drift over time, depending for example on the aging of the loudspeaker, the heating during use, etc. ;
- secondly, if one wishes to have a precise and realistic modeling of the behavior of the loudspeaker, one has to take into account that some of these parameters are not linear, that is to say that their values are not fixed but vary constantly depending on the instantaneous excursion, ie the position at a given moment of the voice coil and the speaker diaphragm relative to the central equilibrium position . This is particularly the case of the electrical inductance, the total mechanical stiffness of the system (the stiffness of the membrane increasing as it moves away from its equilibrium position) and the "force factor""Training of the membrane (related to the magnetic field in the air gap of the coil, it decreases as the coil moves away from the equilibrium position).
Le
Les paramètres T/S y sont toutefois considérés comme des invariants, connus a priori, de sorte que la modélisation de la réponse est figée et ne peut prendre en compte ni les évolutions lentes des paramètres, dues par exemple à leur dérive au cours du temps du fait du vieillissement des composants.The T / S parameters are, however, considered as invariants, known a priori, so that the modeling of the response is fixed and can not take into account either the slow evolution of the parameters, due for example to their drift over time because of the aging of the components.
Le
Cette méthode présente toutefois l'inconvénient de nécessiter une phase de calibration préalable avec mesures d'impédance et application d'un signal prédéterminé, ce qui exclut une ré-estimation des paramètres ultérieurs, tout au moins par un utilisateur grand public. D'autre part, les algorithmes simples de type LMS par descente de gradient ne prennent pas en compte les bruits de mesure, qui sont inévitables, ce qui rend l'estimateur assez peu performant dans des cas réels d'utilisation.However, this method has the disadvantage of requiring a prior calibration phase with impedance measurements and application of a predetermined signal, which excludes a re-estimation of subsequent parameters, at least by a consumer user. On the other hand, the simple gradient descent LMS algorithms do not take into account the measurement noises, which are inevitable, which makes the estimator rather inefficient in real cases of use.
Le
Cette technique présente les mêmes inconvénients que la précédente, notamment la nécessité d'une calibration à partir d'un signal d'entrée modifié susceptible d'altérer le confort d'écoute de l'utilisateur, ce qui ne permet pas d'opérer l'estimation pendant une écoute musicale, de manière transparente pour l'utilisateur.This technique has the same drawbacks as the previous one, in particular the need for a calibration from a modified input signal likely to alter the listening comfort of the user, which does not allow the user to operate. estimate during a musical listening, transparently for the user.
Un autre procédé encore est décrit dans le mémoire universitaire de
Le problème de l'invention est de pouvoir disposer d'un estimateur de la réponse globale d'un haut-parleur électrodynamique :
- qui prenne en compte de la façon la plus fidèle et la plus précise l'ensemble des non-linéarités de cette réponse, ainsi que les dérives éventuelles des paramètres, par une réévaluation périodique de ces paramètres ;
- qui n'introduise aucune modification ni dégradation du signal d'entrée qui pourrait altérer le confort d'écoute de l'utilisateur ;
- qui ne nécessite pour sa mise en oeuvre aucune calibration préalable ni application d'un signal spécifique (bruit blanc, etc.) ;
- qui soit immédiatement fonctionnel à partir de n'importe quel type de signal musical, par utilisation de ce signal "à la volée" pour le réajustement des paramètres de l'estimateur - en d'autres termes, qui puisse fonctionner de manière transparente pour l'utilisateur, l'estimateur opérant pendant que la musique est jouée et sur la base de cette musique, sans qu'il soit nécessaire de demander à l'utilisateur de jouer un type particulier de signal pour mettre en oeuvre l'algorithme d'estimation des paramètres du haut-parleur ; et
- qui, pour être compatible avec des produits grand public, ne nécessite que la mesure de paramètres électriques immédiatement accessibles (tension aux bornes du haut-parleur et intensité dans la bobine) et soit utilisable avec des haut-parleurs conventionnels, dépourvus de capteur électromécanique (capteur de déplacement, de pression acoustique, etc.) - en d'autres termes, où le déplacement mécanique de la membrane (excursion) reste une "variable cachée", non mesurée, de l'estimateur.
- which takes into account in the most faithful and the most precise way all the non-linearities of this answer, as well as the possible drifts of the parameters, by a periodic reassessment of these parameters;
- that does not introduce any modification or degradation of the input signal that could affect the listening comfort of the user;
- which does not require for its implementation any prior calibration or application of a specific signal (white noise, etc.);
- which is immediately functional from any type of musical signal, by using this "on the fly" signal for readjustment of the parameters of the estimator - in other words, which can function transparently for user, the estimator operating while the music is playing and on the basis of this music, without the need to ask the user to play a particular type of signal to implement the estimation algorithm speaker settings; and
- which, to be compatible with consumer products, only requires the measurement of immediately accessible electrical parameters (voltage across the loudspeaker and current in the coil) and can be used with conventional loudspeakers, without electromechanical sensors ( displacement sensor, sound pressure sensor, etc.) - in other words, where the mechanical displacement of the diaphragm (excursion) remains an unmeasured "hidden variable" of the estimator.
À cet effet, l'invention propose un procédé de traitement d'un signal audio numérique du type général divulgué par le mémoire précité d'Arvidsson et Karlsson, à savoir un procédé comprenant :
- a) la détermination d'un vecteur d'observation ne comprenant que des mesures de paramètres électriques, avec : une mesure de la tension aux bornes du haut-parleur, et une mesure du courant traversant le haut-parleur ;
- b) la détermination d'un vecteur d'état par application des mesures de tension et de courant à un estimateur à filtre prédictif incorporant une représentation d'un modèle dynamique du haut-parleur,
ce filtre prédictif étant un filtre de Kalman étendu apte à : opérer une prédiction du vecteur d'état à partir des mesures de tension et d'intensité, et recaler cette prédiction par calcul d'une estimée de la tension et comparaison de cette estimée à la mesure de la tension ; et - c) l'application au signal audio d'un traitement fonction dudit vecteur d'état.
- a) determining an observation vector comprising only measurements of electrical parameters, with: a measurement of the voltage across the loudspeaker, and a measurement of the current flowing through the loudspeaker;
- b) determining a state vector by applying the voltage and current measurements to a predictive filter estimator incorporating a representation of a dynamic model of the loudspeaker,
this predictive filter being an extended Kalman filter able to: make a prediction of the state vector from the voltage and intensity measurements, and readjust this prediction by calculating an estimate of the voltage and comparing this estimate with the measurement of the voltage; and - c) applying to the audio signal a processing function of said state vector.
De façon caractéristique de l'invention, les composantes du vecteur d'état comprennent :
- · des valeurs de paramètres linéaires de réponse du haut-parleur compris dans le groupe : résistance électrique et résistance mécanique, et
- · des coefficients polynomiaux de paramètres non-linéaires de réponse du haut-parleur compris dans le groupe : facteur de force, raideur équivalente et inductance électrique.
- · Linear response parameter values of the loudspeaker included in the group: electrical resistance and mechanical resistance, and
- Polynomial coefficients of non-linear loudspeaker response parameters included in the group: force factor, equivalent stiffness and electrical inductance.
Le traitement appliqué au signal audio peut notamment être un traitement de compensation des non-linéarités de la réponse du haut-parleur, telles que déterminées à partir du vecteur d'état délivré par l'estimateur à filtre prédictif.The processing applied to the audio signal may in particular be a compensation processing of the non-linearities of the loudspeaker response, as determined from the state vector delivered by the predictive filter estimator.
En variante ou en complément, le traitement appliqué au signal audio peut comprendre : c1) le calcul d'une valeur courante d'excursion du haut-parleur en fonction i) d'un gain d'amplification du signal audio et ii) de la réponse du haut-parleur telle que déterminée à partir du vecteur d'état délivré par l'estimateur à filtre prédictif ; c2) la comparaison de la valeur courante d'excursion ainsi calculée avec une valeur maximale d'excursion ; et c3) le calcul d'une atténuation éventuelle du gain d'amplification au cas où la valeur courante d'excursion dépasse la valeur maximale d'excursion. Par ailleurs, les composantes du vecteur d'état peuvent comprendre des valeurs de paramètres acoustiques additionnels représentatifs de la réponse du haut-parleur associé à une cavité arrière munie d'un évent de décompression.Alternatively or additionally, the processing applied to the audio signal may comprise: c1) calculating a current value of the loudspeaker excursion as a function of i) an amplification gain of the audio signal and ii) the loudspeaker response as determined from the state vector outputted by the predictive filter estimator; c2) comparing the current excursion value thus calculated with a maximum excursion value; and c3) calculating a possible attenuation of the amplification gain in case the current excursion value exceeds the maximum excursion value. Moreover, the state vector components may include additional acoustic parameter values representative of the loudspeaker response associated with a rear cavity provided with a decompression vent.
Très avantageusement, la détermination du vecteur d'état de l'étape b) et opérée à la volée à partir du signal audio courant objet du traitement de l'étape c) et reproduit par le haut-parleur, par recueil des paramètres électriques aux bornes du haut-parleur pendant la reproduction de ce signal audio.Very advantageously, the determination of the state vector of step b) and carried out on the fly from the current audio signal object of the treatment of step c) and reproduced by the loudspeaker, by collecting the electrical parameters at speaker terminals while playing this audio signal.
Le procédé peut alors comprendre les étapes suivantes : mémoriser une séquence d'échantillons du signal audio pendant une durée prédéterminée ; analyser la séquence pour calculer un paramètre d'énergie du signal audio mémorisé ; si le paramètre d'énergie calculé est supérieur à un seuil prédéterminé, activer l'estimation par le filtre prédictif ; dans le cas contraire, inhiber l'estimation par le filtre prédictif et conserver les valeurs du vecteur d'état antérieurement estimées.The method may then comprise the following steps: storing a sequence of samples of the audio signal for a predetermined duration; analyzing the sequence to calculate an energy parameter of the stored audio signal; if the calculated energy parameter is greater than a predetermined threshold, enabling the estimation by the predictive filter; if not, inhibit prediction filter estimation and retain the previously estimated state vector values.
On va maintenant décrire un exemple de mise en oeuvre de l'invention, en référence aux dessins annexés où les mêmes références numériques désignent d'une figure à l'autre des éléments identiques ou fonctionnellement semblables.
- La
Figure 1 est un schéma équivalent d'un haut-parleur électrodynamique faisant intervenir les différents paramètres T/S modélisant la réponse globale de celui-ci. - La
Figure 2 illustre, sous forme de schéma par blocs, les principales étapes de traitement du procédé de l'invention. - La
Figure 3 illustre plus précisément le fonctionnement de l'estimateur à filtre de Kalman étendu.
- The
Figure 1 is an equivalent diagram of an electrodynamic loudspeaker involving the various T / S parameters modeling the overall response of the latter. - The
Figure 2 illustrates, in block diagram form, the main processing steps of the process of the invention. - The
Figure 3 illustrates more precisely the operation of the extended Kalman filter estimator.
On va tout d'abord exposer, en référence à la
La moitié gauche schématise la partie électrique du haut-parleur, auquel est appliquée une tension d'excitation mesurable, Umes, provenant d'un amplificateur produisant un courant i, également mesurable, traversant la bobine du haut-parleur. Le premier transformateur de rapport BI schématise la conversion électrique en force mécanique appliquée à la bobine. Enfin, le gyrateur de rapport Sd schématise la conversion mécanique (déplacement de la membrane du haut-parleur) en pression acoustique.The left half schematizes the electrical part of the loudspeaker, to which is applied a measurable excitation voltage, Umes, from an amplifier producing a current i, also measurable, passing through the coil of the loudspeaker. The first report transformer BI schematizes the electrical conversion into mechanical force applied to the coil. Finally, the report gyrator Sd schematizes the mechanical conversion (displacement of the speaker membrane) in acoustic pressure.
Les différents composants de ce schéma équivalent (résistances, inductances et capacité) modélisent des phénomènes électriques, mécaniques (par exemple la masse de l'équipage mobile bobine/membrane) ou bien acoustiques (le volume d'air de la cavité arrière du haut-parleur).The different components of this equivalent diagram (resistors, inductances and capacitance) model electrical, mechanical (for example the mass of the mobile coil / membrane) or acoustic (the air volume of the rear cavity of the speaker).
Le système est régi par les équations liées suivantes (pour un haut-parleur à l'air libre ou monté dans une cavité arrière fermée) :
u étant la tension appliquée aux bornes du haut-parleur,
i étant le courant traversant la bobine,
x étant le déplacement de la membrane,
Re étant la résistance électrique du système,
Mms étant une masse équivalente modélisant la masse de l'équipage mobile totale du système,
Req étant une résistance équivalente modélisant les frottements et pertes mécaniques du système,
Le étant l'inductance électrique du système,
BI étant le facteur de force motrice (le produit du champ magnétique dans l'entrefer par la longueur de la bobine), et
Keq étant une raideur équivalente modélisant la raideur globale de la suspension (spider, suspension externe et cavité).The system is governed by the following related equations (for a loudspeaker in the open air or mounted in a closed back cavity):
u being the voltage applied across the loudspeaker,
i being the current flowing through the coil,
x being the displacement of the membrane,
R e being the electrical resistance of the system,
M ms being an equivalent mass modeling the mass of the total mobile equipment of the system,
R eq being an equivalent resistance modeling the friction and mechanical losses of the system,
The being the electrical inductance of the system,
BI being the driving force factor (the product of the magnetic field in the air gap by the length of the coil), and
K eq being an equivalent stiffness modeling the overall stiffness of the suspension (spider, external suspension and cavity).
Les trois premiers paramètres (Re, Mms et Req) sont des paramètres linéaires, la masse équivalente Mms étant même un invariant, supposé connu d'après les spécifications du fabricant. En revanche, Re, et Req, qui peuvent être considérés comme constants sur une brève période (le temps de leur estimation) sont des paramètres susceptibles de dériver progressivement au cours du temps en fonction de la montée en température de la bobine mobile, du vieillissement des composants, etc. et ils doivent donc être réévalués à intervalles réguliers.The first three parameters (R e , M ms and R eq ) are linear parameters, the equivalent mass M ms being even an invariant, assumed to be known according to the manufacturer's specifications. On the other hand, R e and R eq , which can be considered constant over a short period (the time of their estimation) are parameters that can drift progressively over time as a function of the rise in temperature of the voice coil. aging of components, etc. and they must therefore be re-evaluated at regular intervals.
Les trois derniers paramètres (Le, BI et Keq) sont des paramètres non linéaires, qui dépendent de la valeur instantanée du déplacement x de la membrane. Ils peuvent être approximés par des modèles polynomiaux :
La connaissance complète du modèle nécessite donc la détermination des paramètres linéaires Re et Req, et celle des coefficients polynomiaux des paramètres non linéaires BI, Keq et Le.The complete knowledge of the model therefore requires the determination of the linear parameters R e and R eq , and that of the polynomial coefficients of the nonlinear parameters BI, K eq and Le.
L'ensemble de ces paramètres sera appelé par la suite "vecteur d'état" X, avec X = [Re, Req, Bl0, Bl1, Bl2, Keq0, Keq1, Keq2, Le0, Le1, Le2, Le3, Le4]T.The set of these parameters will be called later "state vector" X, with X = [R e , R eq , Bl 0 , Bl 1 , Bl 2 , K eq0 , K eq1 , K eq2 , L e0 , L e1 , L e2 , L e3 , L e4 ] T.
Le déplacement x, qui est un paramètre non mesuré, sera une variable cachée de l'estimateur.The displacement x, which is an unmeasured parameter, will be a hidden variable of the estimator.
Les équations précédentes étant écrites en temps continu, si l'on veut passer en temps discret (correspondant à un échantillonnage numérique), on utilise la transformée d'Euler, qui donne :
où vn = Fs*(xn+1-Xn) représente la vitesse de déplacement de la membrane, Fs étant la fréquence d'échantillonnage et jn = Fs*(in+1-in) étant la dérivée du courant.Since the previous equations are written in continuous time, if we want to pass in discrete time (corresponding to a numerical sampling), we use the Euler transform, which gives:
where v n = F s * (x n + 1 -X n ) represents the speed of displacement of the membrane, F s being the sampling frequency and j n = F s * (i n + 1 -i n ) being the derivative of the current.
On notera que ce système d'équations peut également être étendu à l'estimation de la réponse d'un haut-parleur monté avec une cavité arrière comportant un évent vers l'extérieur, par exemple de type "bass-reflex". Il convient alors d'ajouter au modèle une troisième équation :
où xp (qui sera une seconde variable cachée de l'estimateur) représente le déplacement de la masse d'air contenue dans l'évent, et Mpm, Rboxm, Kboxm et Rpm sont des paramètres connus dépendant de la taille de l'évent et de la cavité arrière.It should be noted that this system of equations can also be extended to the estimation of the response of a loudspeaker mounted with a rear cavity having an outward vent, for example of the "bass-reflex" type. It is then necessary to add to the model a third equation:
where xp (which will be a second hidden variable of the estimator) represents the displacement of the mass of air contained in the vent, and M pm , R boxm , K boxm and R pm are known parameters depending on the size of the the vent and the rear cavity.
En référence aux
On notera que, bien que ces schémas soient présentés sous forme de circuits interconnectés, la mise en oeuvre des différentes fonctions est essentiellement logicielle, cette représentation n'ayant aucun caractère illustratif. Le logiciel peut notamment être mis en oeuvre au sein d'une puce dédiée de traitement du signal numérique de type DSP.It will be noted that, although these diagrams are presented in the form of interconnected circuits, the implementation of the various functions is essentially software, this representation having no illustrative character. The software can in particular be implemented within a dedicated digital signal processing chip of the DSP type.
Concrètement, les traitements que l'on va décrire sont effectués sur des signaux préalablement numérisés, les algorithmes étant exécutés de façon itérative à la fréquence d'échantillonnage pour les trames successives de signal, par exemple des trames de 1024 échantillons.In concrete terms, the processes that will be described are performed on previously digitized signals, the algorithms being executed iterative at the sampling frequency for the successive signal frames, for example frames of 1024 samples.
De façon caractéristique, la présente invention met en oeuvre un filtrage de Kalman, et plus précisément un filtrage de Kalman étendu (EKF), dont on va réexposer ci-après les grandes lignes.In a characteristic way, the present invention implements a Kalman filtering, and more precisely an extended Kalman filtering (EKF), of which we will re-outline the main lines below.
Le "filtre de Kalman", qui repose sur un algorithme largement connu, est un estimateur d'état comprenant un filtre à réponse impulsionnelle infinie (IIR) qui estime les états d'un système dynamique à partir d'un ensemble d'équations décrivant le comportement du système et d'une série de mesures observées.The "Kalman filter", which is based on a widely known algorithm, is a state estimator comprising an infinite impulse response (IIR) filter that estimates the states of a dynamic system from a set of equations describing the behavior of the system and a series of observed measures.
Un tel filtre permet notamment de déterminer un "état caché", qui est un paramètre non observé mais essentiel pour l'estimation.Such a filter makes it possible in particular to determine a "hidden state", which is a parameter not observed but essential for the estimation.
Dans le cas présent :
- le système dynamique est la réponse du haut-parleur ;
- les équations décrivant le comportement du système sont les Équations (1), (2) et éventuellement (3) ci-dessus ;
- les mesures observées appliquées en entrée du filtre sont la tension appliquée aux bornes du haut-parleur et le courant traversant la bobine de celui-ci ; et
- l'état caché est l'excursion instantanée, à savoir le déplacement physique de la membrane par rapport à sa position d'équilibre, qui est un paramètre essentiel pour l'estimation des paramètres non linéaires de la réponse du haut-parleur, comme exposé plus haut.
- the dynamic system is the response of the speaker;
- the equations describing the behavior of the system are equations (1), (2) and possibly (3) above;
- the observed measurements applied at the input of the filter are the voltage applied across the loudspeaker and the current flowing through the coil thereof; and
- the hidden state is the instantaneous excursion, ie the physical displacement of the membrane with respect to its equilibrium position, which is an essential parameter for the estimation of the non-linear parameters of the loudspeaker response, as explained upper.
Le filtre de Kalman opère en deux phases, avec successivement :
- 1°) une phase de prédiction, effectuée à chaque itération du filtre : cette phase consiste à prédire la réponse du haut-parleur à l'instant courant par rapport à l'instant précédent selon une équation d'évolution ; et
- 2°) une phase de recalage, qui consiste à corriger la prédiction en utilisant les mesures courantes (tension, courant) : la modélisation de la réponse est alors adaptée et mise à jour pour tenir compte notamment des erreurs de mesure systématique.
- 1 °) a prediction phase, performed at each iteration of the filter: this phase consists in predicting the response of the loudspeaker at the current time with respect to the previous instant according to an evolution equation; and
- 2 °) a resetting phase, which consists in correcting the prediction using current measurements (voltage, current): the response modeling is then adapted and updated to take account of systematic measurement errors.
De façon générale, si l'on adopte le formalisme de la représentation d'état, la première équation du processus de Kalman est l' "équation de l'évolution" du modèle :
x k étant le vecteur d'état, représentant l'état à l'instant k,
F k étant la matrice de transition (définie à la conception du filtre) qui détermine l'évolution de l'état k-1 au nouvel état k,
B k étant un vecteur de bruit (bruit gaussien engendré par les capteurs),
u k étant un vecteur de contrôle (paramètre en entrée du filtre), et
w k étant un état représentant le bruit à l'instant k.In general, if we adopt the formalism of the state representation, the first equation of the Kalman process is the "equation of evolution" of the model:
x k being the state vector, representing the state at time k,
F k being the transition matrix (defined at the design of the filter) which determines the evolution of the state k-1 to the new state k,
B k being a noise vector (Gaussian noise generated by the sensors),
u k being a control vector (parameter at the input of the filter), and
w k being a state representing noise at time k .
Dans le cas présent, le vecteur d'état x k est le vecteur composé des paramètres du modèle du haut-parleur :
La seconde équation du processus de Kalman est l' "équation de mesure" :
z k étant le vecteur d'observation à l'instant k (mesures de tension et de courant),
H k étant la matrice de mesure à l'instant k, c'est-à-dire la matrice d'observation reliant l'état à la mesure, déterminée à la conception du filtre, et v k étant le vecteur de bruit de la mesure à l'instant k. The second equation of the Kalman process is the "measurement equation":
z k being the observation vector at instant k (voltage and current measurements),
H k being the measurement matrix at time k, that is to say the observation matrix connecting the state to the measurement, determined at the design of the filter, and v k being the noise vector of the measure at the instant k.
La première étape est la prédiction du modèle à l'instant k, à partir de l'état à l'instant k-1, donnée par les équations suivantes : Prédiction (a priori) de l'état estimé
La seconde étape est la mise à jour du modèle, grâce à l'observation de la mesure à l'instant k, par le système d'équations suivant :
Innovation ou résidu de mesure
Covariance de l'innovation
Gain de Kalman optimal
Mise à jour (a posteriori) de l'état estimé
Mise à jour (a posteriori) de la covariance
Innovation or measurement residue
Covariance of innovation
Optimal Kalman gain
Update ( a posteriori ) of the estimated state
Update ( a posteriori) of the covariance
Dans le cas d'un système linéaire, l'estimation de Kalman est optimale au sens des moindres carrés du modèle caché.In the case of a linear system, the Kalman estimate is optimal in the least squares sense of the hidden model.
Toutefois, on a vu plus haut que le modèle dynamique de réponse du haut-parleur utilisé n'est pas un modèle linéaire, de sorte que le filtrage de Kalman que l'on vient d'exposer n'est pas applicable à la présente invention.However, it has been seen above that the dynamic model of response of the loudspeaker used is not a linear model, so that the Kalman filtering that has just been described is not applicable to the present invention. .
Pour cette raison, la méthode utilisée sera celle connue sous la dénomination de "filtrage de Kalman étendu" ou EKF.For this reason, the method used will be that known under the name of "extended Kalman filtering" or EKF.
L'équation d'évolution du modèle et l'équation de mesure se présentent sous la forme :
f et h étant des fonctions non linéaires, mais différentiables.The equation of evolution of the model and the equation of measure are in the form:
f and h being nonlinear but differentiable functions.
Le filtrage de Kalman étendu consiste à approximer ces fonctions f et h par leurs dérivées partielles lors du calcul des matrices de covariance (matrice de prédiction et matrice de mise à jour), ceci afin de linéariser localement le modèle et lui appliquer en chaque point les systèmes d'équations de prédiction et de mise à jour du filtrage de Kalman exposé ci-dessus. Ces systèmes d'équations deviennent, respectivement :
Prédiction (a priori) de l'état estimé
Covariance de prédiction (a priori)
et :
Innovation ou résidu de mesure
Covariance de l'innovation
Gain de Kalman presque-optimal
Mise à jour (a posteriori) de l'état estimé
Mise à jour (a posteriori) de la covariance
Prediction ( a priori ) of the estimated state
Covariance of prediction ( a priori )
and
Innovation or measurement residue
Covariance of innovation
Near-optimal Kalman gain
Update ( a posteriori ) of the estimated state
Update (posterior) of the covariance
La matrice de transition et la matrice d'observation sont les matrices jacobiennes (matrices de dérivées partielles) suivantes :
Le mode opératoire que l'on vient de décrire peut être mis en oeuvre de la façon illustrée schématiquement sur la
Un signal audio numérisé E issu d'un lecteur de media est reproduit acoustiquement par un haut-parleur 10 après conversion numérique/analogique (bloc 12) et amplification (bloc 14).A digitized audio signal E coming from a media player is reproduced acoustically by a
La réponse du haut-parleur 10 est simulée par un algorithme à filtre de Kalman étendu (estimateur du bloc 16) utilisant en entrée les signaux 18 recueillis sur le haut-parleur 10, ces signaux comprenant la tension Umes appliquée aux bornes du haut-parleur par l'amplificateur 14 et le courant i circulant dans la bobine mobile du haut-parleur.The response of the
On va expliciter plus particulièrement le fonctionnement du filtre de Kalman étendu 16 en référence à la
Les paramètres du modèle à estimer forment à l'instant n le vecteur d'état Xn (le paramètre Mms du modèle étant supposé connu et invariant) :
On considèrera que le modèle de la réponse du haut-parleur est invariant lors du temps nécessaire à l'estimation. Par exemple, si l'on utilise une fraction de T = 10 secondes de signal pour l'estimation, on supposera que le modèle reste le même pendant cette durée T, à un bruit d'évolution près.The model of the loudspeaker response is considered to be invariant for the time required for the estimation. For example, if we use a fraction of T = 10 seconds of signal for the estimation, we will assume that the model remains the same during this duration T, with a noise of evolution.
Dès lors, l'équation d'évolution de l'état se résume simplement à :
La mesure de la tension aux bornes du haut-parleur constitue la seule composante du vecteur d'observation Umesn-1. Cette mesure est comparée à la tension estimée Uestn = h(Xn) obtenue avec les estimations des paramètres de l'instant n et le courant mesuré i :
Xn étant ici une variable cachée du déplacement, calculée récursivement à l'aide des Équations (1) et (2).The measurement of the voltage across the loudspeaker constitutes the only component of the observation vector Umes n-1 . This measurement is compared at the estimated voltage U is n = h (X n ) obtained with the estimates of the parameters of the instant n and the measured current i:
X n being here a hidden variable of the displacement, computed recursively using Equations (1) and (2).
L'algorithme calcule ensuite la dérivée de la fonction h par rapport à chacune des composantes du vecteur X : dh(X)/dBl0, dh(X)/dKeq0, ... ce qui correspond à la dérivée partielle de la tension estimée, par rapport à chacun des paramètres du modèle.The algorithm then calculates the derivative of the function h with respect to each of the components of the vector X: dh (X) / dBl0, dh (X) / dKeq0, ... which corresponds to the partial derivative of the estimated voltage, relative to each of the parameters of the model.
Si de manière générale on note p l'un de ces paramètres, on obtient en dérivant l'Équation (1) par rapport à p :
et en dérivant et réarrangeant l'Équation (2) par rapport à p :
and by deriving and rearranging Equation (2) with respect to p:
Ces équations permettent de calculer récursivement la matrice jacobienne (qui, dans le cas présent, est un simple vecteur) :
Les différentes étapes de l'algorithme peuvent être récapitulées de la manière suivante :
- 1°) Prédiction du système (par utilisation du modèle et du bruit du modèle) :
Qn étant la matrice de covariance du bruit de modèle - 2°) Mise à jour du système :
Sn étant la matrice d'erreur de la mise à jour,
Rn étant la matrice de covariance du bruit d'observation,
Kn étant le gain par lequel l'erreur est multipliée,
Xnln étant le vecteur d'état à estimer, et
Pnln étant la mise à jour de la matrice de covariance (décrivant le bruit)
- 1 °) Prediction of the system (using model and model noise):
Q n being the covariance matrix of the model noise - 2 °) Update of the system:
S n being the error matrix of the update,
R n is the covariance matrix of the observation noise,
K n being the gain by which the error is multiplied,
X nln being the state vector to be estimated, and
P nln being the update of the covariance matrix (describing the noise)
L'estimation des paramètres du modèle du haut-parleur à l'instant n est donnée par le vecteur d'état Xn|n.The estimate of the parameters of the loudspeaker model at time n is given by the state vector X n | n .
Le vecteur d'état Xn|n ainsi obtenu peut être utilisé à diverses fins.The state vector X n | n thus obtained can be used for various purposes.
La connaissance de la réponse du haut-parleur, et notamment de l'excursion x de la membrane (variable cachée, non mesurée mais estimée grâce au filtre de Kalman étendu) peut notamment servir de donnée d'entrée à un étage limiteur 26 (
Un autre traitement qu'il est possible d'appliquer au signal audio est une compensation des non-linéarités (bloc 28). En effet, dans la mesure où l'on modélise la réponse du haut-parleur, il est possible de prédire les non-linéarités de cette réponse et de les compenser par un traitement inverse approprié, appliqué au signal. Un tel traitement est en soi connu, et pour cette raison on ne le décrira pas plus en détail.Another treatment that can be applied to the audio signal is compensation for non-linearities (block 28). Indeed, insofar as the speaker response is modeled, it is possible to predict the nonlinearities of this response and to compensate for them by an appropriate inverse processing applied to the signal. Such treatment is in itself known, and for this reason it will not be described in more detail.
On notera qu'une compensation des non-linéarités est susceptible d'ajouter de la puissance au signal obtenu en sortie. Il est donc nécessaire à ce stade de vérifier que le signal compensé des non-linéarités ne dépasse pas une limite admissible d'excursion de la membrane - dans le cas contraire un gain global d'atténuation, inférieur à l'unité, sera appliqué au signal pour que cette excursion reste dans la plage autorisée.It will be noted that a compensation of the non-linearities is likely to add power to the signal obtained at the output. It is therefore necessary at this stage to check that the compensated signal of the non-linearities does not exceed a permissible limit of excursion of the membrane - in the contrary case a global gain of attenuation, lower than unity, will be applied to the signal to keep this excursion within the allowed range.
Selon un autre aspect de l'invention, l'estimateur de Kalman étendu opère à la volée, directement à partir du signal audio courant reproduit par le haut-parleur, par recueil des paramètres électriques sur ce haut-parleur (tension, courant) pendant la reproduction de ce signal audio.According to another aspect of the invention, the extended Kalman estimator operates on the fly, directly from the current audio signal reproduced by the loudspeaker, by collecting the electrical parameters on this loudspeaker (voltage, current) during the reproduction of this audio signal.
En effet, il n'existe pas de contrainte théorique sur le signal excitant la membrane du haut-parleur pour que la méthode d'estimation par filtre de Kalman étendu puisse être mise en oeuvre.Indeed, there is no theoretical constraint on the signal exciting the speaker membrane so that the extended Kalman filter estimation method can be implemented.
Le système pourra être ainsi utilisé avec une installation haute-fidélité grand public, en fonctionnant de manière transparente pour l'utilisateur : il n'est pas besoin de demander à celui-ci de reproduire un type particulier de signal de calibration (bruit blanc, succession de tonalités, etc.) pour que l'algorithme puisse estimer les paramètres du haut-parleur, ce dernier pouvant opérer de façon continue pendant que la musique est jouée. Cependant, afin d'estimer au mieux les paramètres linéaires et non-linéaires du modèle T/S, notamment les paramètres Bl(x), Keq(x) et Le(x) qui dépendent du déplacement x de la membrane, il est préférable que le signal joué fasse déplacer suffisamment cette membrane afin que l'estimation soit la meilleure possible.The system can thus be used with a high-fidelity consumer installation, operating in a manner that is transparent to the user: there is no need to ask the user to reproduce a particular type of calibration signal (white noise, succession of tones, etc.) so that the algorithm can estimate the parameters of the loudspeaker, the latter can operate continuously while the music is played. However, in order to best estimate the linear and nonlinear parameters of the T / S model, in particular the parameters B1 (x), K eq (x) and L e (x) which depend on the displacement x of the membrane, It is preferable that the signal played move this membrane sufficiently so that the estimate is the best possible.
Pour décider si un signal d'excitation E peut être utilisé pour mettre à jour l'estimateur de Kalman, lorsque de la musique est jouée, les T dernières secondes (typiquement T = 10 secondes) du signal sont en permanence gardées en mémoire dans un tampon 30 (
Le déplacement de la membrane est calculé en permanence par application des Équations (1) et (2) de l'estimateur (bloc 32), avec des paramètres de haut-parleur qui sont fixés et correspondent aux résultats de la dernière estimation opérée par le filtre de Kalman.The displacement of the membrane is calculated continuously by applying Equations (1) and (2) of the estimator (block 32), with speaker parameters which are fixed and correspond to the results of the last estimation made by the Kalman filter.
La valeur efficace x_eff(n) de ce déplacement est calculée (bloc 32) tous les N échantillons (typiquement N = 24000 échantillons), par exemple par la formule suivante :
Si cette valeur efficace est supérieure à un seuil donné x_seuil (bloc 34) pendant un nombre de fois consécutives correspondant au temps T, alors on considère que les T dernières secondes de signal joué sont valides et l'on active la mise à jour du filtre de Kalman afin que celui-ci puisse utiliser ces T dernières secondes de signal pour ré-estimer les paramètres de la réponse du haut-parleur.If this effective value is greater than a given threshold x_seuil (block 34) for a number of consecutive times corresponding to the time T, then it is considered that the T last seconds of signal played are valid and the filter update is activated. Kalman so that it can use these last T seconds of signal to re-estimate the parameters of the response of the speaker.
Claims (6)
ce procédé comprenant :
caractérisé en ce que les composantes du vecteur d'état comprennent :
this process comprising:
characterized in that the components of the state vector include:
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1258116A FR2995167B1 (en) | 2012-08-30 | 2012-08-30 | METHOD FOR PROCESSING AN AUDIO SIGNAL WITH MODELING OF THE GLOBAL RESPONSE OF THE ELECTRODYNAMIC SPEAKER |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2717599A1 true EP2717599A1 (en) | 2014-04-09 |
EP2717599B1 EP2717599B1 (en) | 2015-09-16 |
Family
ID=47427379
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13174690.1A Not-in-force EP2717599B1 (en) | 2012-08-30 | 2013-07-02 | Method for processing an audio signal with modelling of the overall response of the electro-dynamic loudspeaker |
Country Status (5)
Country | Link |
---|---|
US (1) | US9232311B2 (en) |
EP (1) | EP2717599B1 (en) |
JP (1) | JP2014050106A (en) |
CN (1) | CN103686530A (en) |
FR (1) | FR2995167B1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3111669B1 (en) * | 2014-02-26 | 2019-09-18 | Devialet | Device for controlling a loudspeaker |
RU2778274C1 (en) * | 2019-02-13 | 2022-08-17 | Моззаик.Ио.Д.О.О. | Audio signal processing method |
Families Citing this family (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6322339B2 (en) * | 2014-10-15 | 2018-05-09 | ヴェーデクス・アクティーセルスカプ | Hearing aid system operating method and hearing aid system |
EP3010251B1 (en) * | 2014-10-15 | 2019-11-13 | Nxp B.V. | Audio system |
JP6343397B2 (en) * | 2014-10-15 | 2018-06-13 | ヴェーデクス・アクティーセルスカプ | Hearing aid system operating method and hearing aid system |
US20160134982A1 (en) * | 2014-11-12 | 2016-05-12 | Harman International Industries, Inc. | System and method for estimating the displacement of a speaker cone |
US9813812B2 (en) * | 2014-12-12 | 2017-11-07 | Analog Devices Global | Method of controlling diaphragm excursion of electrodynamic loudspeakers |
CN108028984B (en) | 2015-09-10 | 2021-02-26 | 雅玉玛音频公司 | Method of adjusting an audio system using an electroacoustic transducer |
TWI587711B (en) * | 2016-03-15 | 2017-06-11 | 瑞昱半導體股份有限公司 | Device and method of calculating excursion of diaphragm of loudspeaker and method of controlling loudspeaker |
CN105916079B (en) * | 2016-06-07 | 2019-09-13 | 瑞声科技(新加坡)有限公司 | A kind of nonlinear loudspeaker compensation method and device |
CN106454679B (en) * | 2016-11-17 | 2019-05-21 | 矽力杰半导体技术(杭州)有限公司 | Diaphragm of loudspeaker method for estimating state and the loudspeaker driving circuit for applying it |
CN106341763B (en) * | 2016-11-17 | 2019-07-30 | 矽力杰半导体技术(杭州)有限公司 | Speaker driving apparatus and loudspeaker driving method |
US10341767B2 (en) * | 2016-12-06 | 2019-07-02 | Cirrus Logic, Inc. | Speaker protection excursion oversight |
US10462565B2 (en) * | 2017-01-04 | 2019-10-29 | Samsung Electronics Co., Ltd. | Displacement limiter for loudspeaker mechanical protection |
DE102017010048A1 (en) * | 2017-10-27 | 2019-05-02 | Paragon Ag | Method for designing and manufacturing loudspeakers for public address systems, in particular, used in motor vehicle interiors |
US10701485B2 (en) * | 2018-03-08 | 2020-06-30 | Samsung Electronics Co., Ltd. | Energy limiter for loudspeaker protection |
WO2020143472A1 (en) * | 2019-01-11 | 2020-07-16 | Goertek Inc. | Method for correcting acoustic properties of a loudspeaker, an audio device and an electronics device |
CN112533115B (en) * | 2019-09-18 | 2022-03-08 | 华为技术有限公司 | Method and device for improving tone quality of loudspeaker |
US11425476B2 (en) * | 2019-12-30 | 2022-08-23 | Harman Becker Automotive Systems Gmbh | System and method for adaptive control of online extraction of loudspeaker parameters |
US11399247B2 (en) | 2019-12-30 | 2022-07-26 | Harman International Industries, Incorporated | System and method for providing advanced loudspeaker protection with over-excursion, frequency compensation and non-linear correction |
CN111741408A (en) * | 2020-06-12 | 2020-10-02 | 瑞声科技(新加坡)有限公司 | Nonlinear compensation method, system, equipment and storage medium for loudspeaker |
CN114137032B (en) * | 2021-09-07 | 2024-07-12 | 北京联合大学 | Device and method for measuring resistivity of sandstone model with large dynamic range |
CN116055951B (en) * | 2022-07-20 | 2023-10-20 | 荣耀终端有限公司 | Signal processing method and electronic equipment |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030142832A1 (en) | 1999-12-17 | 2003-07-31 | Klaus Meerkoetter | Adaptive method for detecting parameters of loudspeakers |
EP1799013A1 (en) | 2005-12-14 | 2007-06-20 | Harman/Becker Automotive Systems GmbH | Method and system for predicting the behavior of a transducer |
US20080189087A1 (en) | 2007-02-01 | 2008-08-07 | Wolfgang Klippel | Optimal estimation of transducer parameters |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6128541A (en) * | 1997-10-15 | 2000-10-03 | Fisher Controls International, Inc. | Optimal auto-tuner for use in a process control network |
US6058195A (en) * | 1998-03-30 | 2000-05-02 | Klippel; Wolfgang J. | Adaptive controller for actuator systems |
US6940981B2 (en) * | 2003-03-12 | 2005-09-06 | Qsc Audio Products, Inc. | Apparatus and method of limiting power applied to a loudspeaker |
US20060104451A1 (en) * | 2003-08-07 | 2006-05-18 | Tymphany Corporation | Audio reproduction system |
AU2006217448A1 (en) * | 2005-02-22 | 2006-08-31 | Health-Smart Limited | Methods and systems for physiological and psycho-physiological monitoring and uses thereof |
US7312654B2 (en) * | 2005-12-20 | 2007-12-25 | Freescale Semiconductor, Inc. | Quiet power up and power down of a digital audio amplifier |
-
2012
- 2012-08-30 FR FR1258116A patent/FR2995167B1/en not_active Expired - Fee Related
-
2013
- 2013-06-26 US US13/927,980 patent/US9232311B2/en not_active Expired - Fee Related
- 2013-07-02 EP EP13174690.1A patent/EP2717599B1/en not_active Not-in-force
- 2013-07-24 CN CN201310315155.XA patent/CN103686530A/en active Pending
- 2013-08-23 JP JP2013172797A patent/JP2014050106A/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030142832A1 (en) | 1999-12-17 | 2003-07-31 | Klaus Meerkoetter | Adaptive method for detecting parameters of loudspeakers |
EP1799013A1 (en) | 2005-12-14 | 2007-06-20 | Harman/Becker Automotive Systems GmbH | Method and system for predicting the behavior of a transducer |
US20080189087A1 (en) | 2007-02-01 | 2008-08-07 | Wolfgang Klippel | Optimal estimation of transducer parameters |
Non-Patent Citations (4)
Title |
---|
DAVID JAKOBOSSON ET AL: "Modelling and Compensation of Nonlinear Loudspeaker", MASTER'S THESIS IN SYSTEMS, CONTROL AND MECHATRONICS, 1 January 2010 (2010-01-01), XP055053800, Retrieved from the Internet <URL:http://publications.lib.chalmers.se/records/fulltext/126003.pdf> [retrieved on 20130219] * |
DE MAR- CUS ARVIDSSON; DANIEL KARLSSON, ATTENUATION OF HARMONIC DISTORSION IN LOUDSPEAKERS USING NON-LINEAR CONTROL, 18 June 2012 (2012-06-18) |
MARCUS ARVIDSSON ET AL: "Attenuation of Harmonic Distortion in Loudspeakers Using Non-linear Control", MASTER THESIS, DEPARTMENT OF ELECTRICAL ENGINEERING, 18 June 2012 (2012-06-18), XP055053802, Retrieved from the Internet <URL:http://liu.diva-portal.org/smash/get/diva2:534340/FULLTEXT01> [retrieved on 20130219] * |
RIBEIRO R A ET AL: "Application of Kalman and RLS Adaptive Algorithms to Non-linear Loudspeaker Controler Parameter Estimation: a Case Study", 2005 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING - 18-23 MARCH 2005 - PHILADELPHIA, PA, USA, IEEE, PISCATAWAY, NJ, vol. 3, 18 March 2005 (2005-03-18), pages 145 - 148, XP010792350, ISBN: 978-0-7803-8874-1, DOI: 10.1109/ICASSP.2005.1415667 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3111669B1 (en) * | 2014-02-26 | 2019-09-18 | Devialet | Device for controlling a loudspeaker |
RU2778274C1 (en) * | 2019-02-13 | 2022-08-17 | Моззаик.Ио.Д.О.О. | Audio signal processing method |
Also Published As
Publication number | Publication date |
---|---|
US20140064502A1 (en) | 2014-03-06 |
EP2717599B1 (en) | 2015-09-16 |
US9232311B2 (en) | 2016-01-05 |
FR2995167A1 (en) | 2014-03-07 |
CN103686530A (en) | 2014-03-26 |
JP2014050106A (en) | 2014-03-17 |
FR2995167B1 (en) | 2014-11-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2717599B1 (en) | Method for processing an audio signal with modelling of the overall response of the electro-dynamic loudspeaker | |
EP3111668B1 (en) | Device for controlling a loudspeaker | |
US10015593B2 (en) | Digital signal processor for audio extensions and correction of nonlinear distortions in loudspeakers | |
JP5362894B2 (en) | Neural network filtering technique to compensate for linear and nonlinear distortion of speech converters | |
JP7064489B2 (en) | Gain Phase Equalization (GPEQ) Filters and Tuning Methods for Asymmetric Transoral Audio Playback | |
US9948261B2 (en) | Method and apparatus to equalize acoustic response of a speaker system using multi-rate FIR and all-pass IIR filters | |
JP2008197284A (en) | Filter coefficient calculation device, filter coefficient calculation method, control program, computer-readable recording medium, and audio signal processing apparatus | |
US9838783B2 (en) | Adaptive phase-distortionless magnitude response equalization (MRE) for beamforming applications | |
JP2013537321A (en) | Speech signal dynamic correction for perceptual spectral imbalance improvement | |
KR20170023941A (en) | Digital encapsulation of audio signals | |
EP3248285B1 (en) | Device for controlling a loudspeaker with current limitation | |
EP3844981A1 (en) | Method for the spatial sound reproduction of a sound field that is audible in a position of a moving listener and system implementing such a method | |
EP3637792B1 (en) | Device for controlling a speaker and associated sound playback system | |
US9992573B1 (en) | Phase inversion filter for correcting low frequency phase distortion in a loudspeaker system | |
JP5762797B2 (en) | Signal processing apparatus and signal processing method | |
FR3112017A1 (en) | Electronic equipment including a distortion simulator | |
JP4443118B2 (en) | Inverse filtering method, synthesis filtering method, inverse filter device, synthesis filter device, and device having such a filter device | |
JP2010181448A (en) | Sound adjusting device and sound adjusting method | |
JP2005286712A (en) | Sound picking-up device | |
US11558705B2 (en) | System and method for a digital calibration filter device | |
WO2022014325A1 (en) | Signal processing device and method, and program | |
FR3051959A1 (en) | METHOD AND DEVICE FOR ESTIMATING A DEREVERBERE SIGNAL | |
FR3131972A1 (en) | Method for managing the low frequencies of a loudspeaker and device for implementing said method | |
FR3015847A1 (en) | METHOD AND DEVICE FOR ESTIMATING PARAMETERS CHARACTERIZING AN ACOUTISQUE ASSEMBLY | |
WO2021140089A1 (en) | Method and associated device for transforming characteristics of an audio signal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20130702 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04R 29/00 20060101AFI20150205BHEP Ipc: H04R 3/04 20060101ALN20150205BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04R 29/00 20060101AFI20150226BHEP Ipc: H04R 3/04 20060101ALN20150226BHEP |
|
INTG | Intention to grant announced |
Effective date: 20150316 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04R 3/04 20060101ALN20150306BHEP Ipc: H04R 29/00 20060101AFI20150306BHEP Ipc: H04R 9/02 20060101ALI20150306BHEP |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 750613 Country of ref document: AT Kind code of ref document: T Effective date: 20151015 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602013003036 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151216 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151217 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D Ref country code: NL Ref legal event code: FP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 750613 Country of ref document: AT Kind code of ref document: T Effective date: 20150916 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160116 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160118 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602013003036 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 4 |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: PARROT DRONES |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602013003036 Country of ref document: DE Owner name: PARROT DRONES, FR Free format text: FORMER OWNER: PARROT, PARIS, FR |
|
26N | No opposition filed |
Effective date: 20160617 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20160811 AND 20160817 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: PD Owner name: PARROT DRONES; FR Free format text: DETAILS ASSIGNMENT: VERANDERING VAN EIGENAAR(S), OVERDRACHT; FORMER OWNER NAME: PARROT Effective date: 20160804 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: GEVERS SA, CH Ref country code: CH Ref legal event code: PUE Owner name: PARROT DRONES, FR Free format text: FORMER OWNER: PARROT, FR |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20160726 Year of fee payment: 4 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160702 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160702 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20170720 Year of fee payment: 5 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20170724 Year of fee payment: 5 Ref country code: DE Payment date: 20170724 Year of fee payment: 5 Ref country code: IT Payment date: 20170721 Year of fee payment: 5 Ref country code: GB Payment date: 20170724 Year of fee payment: 5 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20180330 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170731 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20130702 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150916 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602013003036 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MM Effective date: 20180801 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20180702 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180702 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180731 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180731 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190201 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180801 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180702 |