EP1989705B1 - Method for limiting adaptive excitation gain in an audio decoder - Google Patents

Method for limiting adaptive excitation gain in an audio decoder Download PDF

Info

Publication number
EP1989705B1
EP1989705B1 EP07731604A EP07731604A EP1989705B1 EP 1989705 B1 EP1989705 B1 EP 1989705B1 EP 07731604 A EP07731604 A EP 07731604A EP 07731604 A EP07731604 A EP 07731604A EP 1989705 B1 EP1989705 B1 EP 1989705B1
Authority
EP
European Patent Office
Prior art keywords
gain
adaptive excitation
long
error indication
decoder
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP07731604A
Other languages
German (de)
French (fr)
Other versions
EP1989705A2 (en
Inventor
Balazs Kovesi
David Virette
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Orange SA
Original Assignee
France Telecom SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by France Telecom SA filed Critical France Telecom SA
Publication of EP1989705A2 publication Critical patent/EP1989705A2/en
Application granted granted Critical
Publication of EP1989705B1 publication Critical patent/EP1989705B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • G10L19/083Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being an excitation gain
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/005Correction of errors induced by the transmission channel, if related to the coding algorithm
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • G10L19/12Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders

Definitions

  • the present invention relates to a method of limiting adaptive excitation gain in a decoder of an audio signal. It also relates to a decoder of an audio signal encoded by means of an encoder comprising a long-term predictive filter.
  • the invention finds an advantageous application in the field of coding and decoding of digital signals such as audio-frequency signals.
  • the invention is particularly well suited to the transmission of speech and / or audio signals over packet networks, of the VoIP type, for example, to provide an acceptable quality during decoding after a loss of packets, in particular avoiding the saturation of the data.
  • CELP encoder is the G.729 system recommended in the ITU-T, designed for voiceband speech between 300 and 3400 Hz sampled at 8 kHz and transmitted at a fixed rate of 8 kbit / s with frames of 10 ms.
  • the detailed operation of this encoder is specified in the article of A: Salami, C. Laflamme, JP Adoul, A. Kataoka, S. Hayashi, T. Moriya, C. Lamblin, D. Massaloux, S. Proust, P. Kroon and Y. Shoham.
  • CS-ACELP a toll quality 8 kb / s speech coder
  • FIG. 1 (a) is represented a high level view of a G.729 encoder.
  • This figure shows a high-pass filtering 101 of pre-processing for removing frequency signals below 50 Hz.
  • the speech signal S (n) thus filtered is then analyzed by the block 102 to determine a filter ( z) Linear Prediction Coding (LPC), which is transmitted to the multiplexer 104 in the form of an index indexing the quantized vector (QV) in a dictionary.
  • LPC Linear Prediction Coding
  • the original signal S (n) filtered by the filter ⁇ (z) is processed by the block 103 in order to extract the parameters mentioned in the table of the figure 2 . These parameters are then coded and then transmitted to the MUX multiplexer 104.
  • the excitation thus decoded is shaped by the synthesis filter 120 LPC 1 / ⁇ (z) whose coefficients are decoded by the block 119 in the domain of the spectral line pairs (LSF) and interpolated by subframe 5. ms.
  • the reconstructed signal is then processed by an adaptive post-filter 121 and a post-processing high-pass filter 122.
  • the decoder of the Figure 1 (c) therefore relies on the source-filter model to synthesize the signal.
  • the CELP type encoders In the case of excitation from the long-term prediction LTP filter, and in order to generate an excitation signal capable of rapidly following the signal attacks, the CELP type encoders generally allow the choice of a gain g p pitch greater than 1. As a result, the decoder is locally unstable. However, this instability is controlled by the synthesis analysis model which permanently minimizes the difference between the LTP excitation signal and the original target signal.
  • this instability can lead to significant degradation due to the offset between the encoder and the decoder.
  • the gain value g p of pitch not received in a frame is generally replaced by the value of g p in the previous frame, and although the variable nature of the speech signal consists of an alternation periods of voices with a pitch gain close to 1 and unvoiced with a pitch gain of less than 1 allows, in general, to limit the potential problems related to this local instability, it remains nonetheless true that, for certain signals, especially the voiced signals, transmission errors in periodic stationary zones can cause significant damage when, for example, the gain g p of replacement is higher than the actual gain and the affected frame is followed by high gain frames, as happens during attacks. This situation can then quickly lead to a saturation of the LTP filter by cumulative effect linked to the recursive character of long-term predictive filtering.
  • a first solution to this problem is to limit the gp pitch gain to 1, but this constraint has the effect of degrading the performance of the CELP coders for attacks.
  • the technical problem to be solved by the object of the present invention is to propose a method for limiting adaptive excitation gain in a decoder of an audio signal encoded by means of an encoder comprising a long-term predictive filter. , following a loss of transmission frame between said encoder and said decoder, which would limit the adaptive excitation g p gain, or pitch gain, only in the case where an instability LTP filter is actually noted, and to ensure the best possible compromise between the quality of the decoding and its robustness vis-à-vis the frame loss.
  • frame loss is used here to mean the non-reception of a frame as well as the transmission errors in a frame.
  • said arbitrary value is equal to a value of the adaptive excitation gain determined during said lost frame by an error concealment algorithm.
  • said arbitrary value is equal to the value of the adaptive excitation gain for the non-lost frame preceding said lost frame.
  • said arbitrary value is defined from a voicing detection of the previous frame.
  • said arbitrary value is equal to 1, otherwise the arbitrary value is equal to 0.
  • the excitation is composed of a random noise.
  • the method according to the invention has the advantage of modifying the gain g p of pitch only when a possible instability of the LTP filter is detected at the decoder itself and not at the encoder as in known techniques.
  • the method of the invention takes into account both the actual state of the decoder and the exact information on the transmission errors reached.
  • the method, object of the invention can be used autonomously, that is to say in coding structures that do not provide for limiting the pitch gain at the coder.
  • the invention provides that said adaptive excitation gain is supplied to said decoder by an encoder equipped with a gain limitation device.
  • the method according to the invention can therefore also be used in combination with a known taming technique, installed at the encoder.
  • the prior technique makes it possible to limit the long sequences of pitch gains greater than 1. Indeed, such sequences cause a large propagation of the error, forcing the method of the invention to modify the signal over long periods.
  • a too low trigger threshold of the "taming" technique a priori degrades the signal.
  • the invention thus makes it possible to reduce the number of triggers of the "taming" technique a priori by increasing the threshold, because even if this technique does not detect the risk of explosion, the posterior method according to the invention detects it and cure it.
  • the order N of the LTP filter can be taken as 1.
  • the gain g p of adaptive excitation of a long-term predictive filter of order 1 is limited to the value 1 if said parameter of indication of error is greater than said given threshold.
  • the invention provides that a correction factor is applied to the gains g i of adaptive excitation of a long-term predictive filter of order greater than 1 if said error indication parameter is greater than said given threshold.
  • said at least one adaptive excitation gain is limited by a linear function of said given threshold if said error indication parameter is greater than said threshold.
  • the invention also relates to a program comprising instructions recorded on a computer-readable medium for carrying out the steps of the method according to the invention, when said program is executed on a computer.
  • the invention finally relates to a decoder of an audio signal encoded by means of an encoder comprising the features of claim 11.
  • Adaptive excitation depends solely on the past excitation and makes it possible to efficiently model the periodic signals, especially voiced signals, where the excitation itself is repeated almost periodically.
  • the fixed part c (n) brings the innovation in the total excitation to model the difference between the periods, that is to say to correct the error between the adaptive excitation and the prediction residue.
  • this excitation signal is optimized to the encoder using the technique of synthesis analysis.
  • the synthesis filtering of this excitation is thus performed with the quantized filter to check the result that will be obtained at the decoder.
  • This explains why it is possible to use a locally unstable long-term filtering, that is with a value of g p greater than 1, to model a signal attack because the increase in energy due to this instability is controlled. On the other hand, this control is disturbed by the possible frame losses.
  • the error concealment algorithm uses an estimated excitation signal from the past excitation signal.
  • the decoder comprises a processing line of the excitation signal from the demultiplexer 112 constituted by the blocks 211 to 215.
  • This processing line of the decoder thus described also serves to illustrate the main steps of the adaptive excitation gain limiting method according to the invention.
  • a module 213 calculates from the values of the function x t (n) provided by the module 212, an error indication parameter S t .
  • a comparator 214 checks whether the parameter S t does not exceed a certain threshold S 0 . In case of overshoot and if the decoded pitch gain g p is greater than 1, the value of g p is limited, because in this case there is a risk of saturation of the LTP filter.
  • the error indication parameter S t may be the sum of the values of the function x t (n) , or the maximum value, the average or the sum of the squares of these values.
  • the comparator 214 is followed by a discriminator 215 able to determine the value g ' t of the pitch gain to be applied to the block 117 for the current frame, namely the decoded pitch value g p or a limited value.
  • the LTP, P and g p parameters are transmitted for each 5 ms subframe containing 40 samples.
  • the treatment to avoid saturation of the LTP filter, which is the subject of the invention, is also carried out at the rate of the subframes.
  • the error indication parameter S t for example the sum of the function x t (n) , is calculated for each subframe.
  • the memory of the signal x t (n) is updated with the new value g ' t .
  • the pitch gain of the current sub-frame is less than 1 or the value of S t is less than 80, corresponding to a cumulative error in the long-term weak synthesis filter, the value is not modified.
  • the decoded pitch gain and g ' t g t .
  • the long-term filter of the encoder is a filter of order 1.
  • the pseudo-LTP filter used to define the error indication function may be the equivalent filter of order 1 or more advantageously a filter identical to that used in the encoder, in particular of the same order.
  • the equivalent filter of order 1 is always used.
  • the gain g ' t can be calculated in the same way as for a filter of order 1. It then applies the corrective factor g ' t / g e to the gains g i of the higher order filter.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

The invention concerns a decoder for an audio signal coded by an encoder comprising a long-term predictive filter. According to the invention, said decoder comprises: a block (211) for detecting losses of transmission frames, a module (222) for calculating values of an error indicating function, representing the accumulated error in decoding on the adaptive excitation following said transmission frame loss, an arbitrary value being assigned to said adaptive excitation for the lost frame, a module (213) for calculating an error indicating parameter based on said values of the error indicating function, a comparator (214) of said error indicating parameter with at least one given threshold, a discriminator (215) for determining based on of the result provided by the comparator (214) a value of at least one adaptive excitation gain to be used by the decoder. The invention is applicable to encoding and decoding digital signals such as audiofrequency signals.

Description

La présente invention concerne un procédé de limitation de gain d'excitation adaptative dans un décodeur d'un signal audio. Elle concerne également un décodeur d'un signal audio codé au moyen d'un codeur comprenant un filtre prédictif à long terme.The present invention relates to a method of limiting adaptive excitation gain in a decoder of an audio signal. It also relates to a decoder of an audio signal encoded by means of an encoder comprising a long-term predictive filter.

L'invention trouve une application avantageuse dans le domaine du codage et du décodage de signaux numériques tels que les signaux audiofréquences.The invention finds an advantageous application in the field of coding and decoding of digital signals such as audio-frequency signals.

L'invention est particulièrement bien adaptée à la transmission de signaux de parole et/ou audio sur réseaux de paquets, de type voix sur IP par exemple, pour fournir une qualité acceptable lors du décodage après une perte de paquets en évitant notamment la saturation des filtres prédictifs à long terme (LTP pour « Long Term Prediction ») utilisés au décodage dans le contexte de codage CELP (« Code Exciting Linear Prediction »).The invention is particularly well suited to the transmission of speech and / or audio signals over packet networks, of the VoIP type, for example, to provide an acceptable quality during decoding after a loss of packets, in particular avoiding the saturation of the data. Long Term Prediction (LTP) filters used for decoding in the Code Exciting Linear Prediction (CELP) context.

On peut citer comme exemple de codeur CELP le système G.729 recommandé à l'UIT-T, conçu pour des signaux de parole en bande téléphonique entre 300 et 3400 Hz échantillonnés à 8 kHz et transmis à un débit fixe de 8 kbit/s avec des trames de 10 ms. Le fonctionnement détaillé de ce codeur est spécifié dans l'article de R: Salami, C. Laflamme, J. P. Adoul, A. Kataoka, S. Hayashi, T. Moriya, C. Lamblin, D. Massaloux, S. Proust, P. Kroon et Y. Shoham. "Design and description of CS-ACELP : a toll quality 8 kb/s speech coder", IEEE Trans. on Speech and Audio Processing, Vol.6-2, mars 1998, PP.116-130 .An example of a CELP encoder is the G.729 system recommended in the ITU-T, designed for voiceband speech between 300 and 3400 Hz sampled at 8 kHz and transmitted at a fixed rate of 8 kbit / s with frames of 10 ms. The detailed operation of this encoder is specified in the article of A: Salami, C. Laflamme, JP Adoul, A. Kataoka, S. Hayashi, T. Moriya, C. Lamblin, D. Massaloux, S. Proust, P. Kroon and Y. Shoham. "Design and description of CS-ACELP: a toll quality 8 kb / s speech coder", IEEE Trans. on Speech and Audio Processing, Vol.6-2, March 1998, PP.116-130 .

Sur la figure 1(a) est représentée une vue haut niveau d'un codeur G.729. Cette figure fait apparaître un filtrage passe-haut 101 de pré-traitement destiné à éliminer les signaux de fréquence inférieure à 50 Hz. Le signal de parole S(n) ainsi filtré est ensuite analysé par le bloc 102 afin de déterminer un filtre Â(z) de prédiction linéaire (LPC pour « Linear Prediction Coding »), lequel est transmis au multiplexeur 104 sous la forme d'un indice indexant le vecteur quantifié (QV) dans un dictionnaire.On the Figure 1 (a) is represented a high level view of a G.729 encoder. This figure shows a high-pass filtering 101 of pre-processing for removing frequency signals below 50 Hz. The speech signal S (n) thus filtered is then analyzed by the block 102 to determine a filter ( z) Linear Prediction Coding (LPC), which is transmitted to the multiplexer 104 in the form of an index indexing the quantized vector (QV) in a dictionary.

Le signal original S(n) filtré par le filtre Â(z), appelé alors excitation, est traité par le bloc 103 de manière à en extraire les paramètres mentionnés sur le tableau de la figure 2. Ces paramètres sont ensuite codés puis transmis au multiplexeur MUX 104.The original signal S (n) filtered by the filter λ (z) , called excitation, is processed by the block 103 in order to extract the parameters mentioned in the table of the figure 2 . These parameters are then coded and then transmitted to the MUX multiplexer 104.

Le fonctionnement du bloc 103 de codage de l'excitation est détaillé à la figure 1(b). Comme on peut le voir sur cette figure, l'excitation est codée en trois étapes :

  • dans une première étape, un filtrage de prédiction à long terme (LTP) est effectué par les blocs 106, 107, 110 Le filtre LTP du codeur G.729 est un filtre d'ordre égal à 1. La période P d'excitation adaptative, ou période de « pitch », exprimée en valeur entière P0 complétée éventuellement par une valeur fractionnaire P0 _fractionnaire, ainsi que le gain gp d'excitation adaptative, ou gain de « pitch », sont déterminés par analyse par synthèse de façon à minimiser l'erreur entre le signal d'excitation cible issu du bloc 105 et le signal synthétisé donné par x(n) = gp.x(n-P), n représentant un échantillon du signal,
  • puis, dans une deuxième étape, la différence résiduelle entre ces deux signaux est modélisée, d'une part, par un code fixe c(n), ou code innovateur, extrait d'un dictionnaire innovateur ACELP 108 à quatre impulsions ± 1, et, d'autre part, par un gain gc d'excitation fixe 109. Le code fixe c(n) et la gain gc sont déterminés en minimisant en 111' l'erreur entre le signal résiduel issu de l'étage de LTP précédent et le signal gc.c(n),
  • enfin, dans une dernière étape, les paramètres résultant, à savoir la période P de pitch, le code fixe c(n) et les gains gp de pitch et gc d'excitation fixe, sont codés et transmis au multiplexeur 104.
The operation of the excitation coding block 103 is detailed in FIG. Figure 1 (b) . As can be seen in this figure, the excitation is coded in three steps:
  • in a first step, a long-term prediction filtering (LTP) is performed by the blocks 106, 107, 110 The LTP filter of the G.729 encoder is a filter of order equal to 1. The period P of adaptive excitation , or "pitch" period, expressed as an integer value P 0 supplemented optionally by a fractional fraction P 0 -fractional value, as well as the gain g p of adaptive excitation, or "pitch" gain, are determined by synthesis analysis of minimizing the error between the target excitation signal from block 105 and the synthesized signal given by x (n) = g p .x (nP) , n representing a sample of the signal,
  • then, in a second step, the residual difference between these two signals is modeled, on the one hand, by a fixed code c (n) , or innovative code, extracted from an innovatory dictionary ACELP 108 with four pulses ± 1, and on the other hand, by a fixed excitation gain g c 109. The fixed code c (n) and the gain g c are determined by minimizing the error between the residual signal from the LTP stage at 111 '. previous and the signal g c .c (n),
  • finally, in a last step, the resulting parameters, namely the pitch period P , the fixed code c (n) and the gains g p of pitch and g c of fixed excitation, are coded and transmitted to the multiplexer 104.

La figure 1(c) montre comment un décodeur G.729 classique reconstruit le signal de parole à partir des données reçues du multiplexeur 104 par le démultiplexeur 112. L'excitation est reconstituée par sous-trames de 5 ms en ajoutant deux contributions :

  • une première contribution résultant du décodage 115 de la période P de pitch et du décodage 118 du gain gp de pitch pour reconstituer en sortie des blocs 116, 117 le signal LTP d'excitation adaptative x(n) = gp.x(n-P),
  • une deuxième contribution résultant du décodage 113 de l'excitation fixe c(n) mise à l'échelle par le gain ge décodé par le bloc 118 pour reconstituer l'excitation fixe ge .c(n).
  • ces deux contributions sont ensuite additionnées pour fournir l'excitation décodée x(n) = gp.x(n-P) + ge.c(n).
The Figure 1 (c) shows how a conventional G.729 decoder reconstructs the speech signal from the data received from the multiplexer 104 by the demultiplexer 112. The excitation is reconstituted by subframes of 5 ms by adding two contributions:
  • a first contribution resulting from the decoding 115 of the pitch period P and the decoding 118 of the gain g p of pitch to reconstitute at the output of the blocks 116, 117 the adaptive excitation LTP signal x (n) = g p .x (nP ) ,
  • a second contribution resulting from the decoding 113 of the fixed excitation c (n) scaled by the gain g e decoded by the block 118 to reconstitute the fixed excitation g e . c (n) .
  • these two contributions are then added to provide the decoded excitation x (n) = g p .x (nP) + g e .c (n).

L'excitation ainsi décodée est mise en forme par le filtre 120 de synthèse LPC 1/Â(z) dont les coefficients sont décodés par le bloc 119 dans le domaine des paires de raies spectrales (LSF) et interpolés par sous-trame de 5 ms. Afin d'améliorer la qualité et masquer certains artefacts de codage, le signal reconstruit est ensuite traité par un post-filtre adaptatif 121 et un filtre passe-haut 122 de post-traitement. Le décodeur de la figure 1 (c) s'appuie donc sur le modèle source-filtre pour synthétiser le signal.The excitation thus decoded is shaped by the synthesis filter 120 LPC 1 / Â (z) whose coefficients are decoded by the block 119 in the domain of the spectral line pairs (LSF) and interpolated by subframe 5. ms. In order to improve the quality and to mask certain coding artifacts, the reconstructed signal is then processed by an adaptive post-filter 121 and a post-processing high-pass filter 122. The decoder of the Figure 1 (c) therefore relies on the source-filter model to synthesize the signal.

Dans le cas de l'excitation issue du filtre LTP de prédiction à long terme, et dans le but de générer un signal d'excitation capable de suivre rapidement les attaques du signal, les codeurs de type CELP autorisent généralement le choix d'un gain gp de pitch supérieur à 1. En conséquence, le décodeur est localement instable. Cependant, cette instabilité est contrôlée par le modèle d'analyse par synthèse qui minimise en permanence l'écart entre le signal d'excitation LTP et le signal cible original.In the case of excitation from the long-term prediction LTP filter, and in order to generate an excitation signal capable of rapidly following the signal attacks, the CELP type encoders generally allow the choice of a gain g p pitch greater than 1. As a result, the decoder is locally unstable. However, this instability is controlled by the synthesis analysis model which permanently minimizes the difference between the LTP excitation signal and the original target signal.

Lors d'erreurs de transmission ou de perte de trames, cette instabilité peut entraîner d'importantes dégradations dues au décalage entre codeur et décodeur. En effet, dans ces circonstances, la valeur de gain gp de pitch non reçue dans une trame est généralement remplacée par la valeur de gp dans la trame précédente, et, bien que la nature variable du signal de parole constitué d'une alternance de périodes voisées avec un gain de pitch proche de 1 et non voisées avec un gain de pitch inférieur à 1 permet, en général, de limiter les problèmes potentiels liés à cette instabilité locale, il n'en reste pas moins vrai cependant que, pour certains signaux, notamment les signaux voisés, des erreurs de transmission dans des zones stationnaires périodiques peuvent provoquer des dégradations importantes lorsque par exemple le gain gp de remplacement est plus élevé que le gain réel et que la trame affectée est suivie de trames à gain élevé, comme cela se produit lors des attaques. Cette situation peut alors entraîner rapidement une saturation du filtre LTP par effet cumulatif lié au caractère récursif du filtrage prédictif à long terme.During transmission or frame loss errors, this instability can lead to significant degradation due to the offset between the encoder and the decoder. Indeed, in these circumstances, the gain value g p of pitch not received in a frame is generally replaced by the value of g p in the previous frame, and although the variable nature of the speech signal consists of an alternation periods of voices with a pitch gain close to 1 and unvoiced with a pitch gain of less than 1 allows, in general, to limit the potential problems related to this local instability, it remains nonetheless true that, for certain signals, especially the voiced signals, transmission errors in periodic stationary zones can cause significant damage when, for example, the gain g p of replacement is higher than the actual gain and the affected frame is followed by high gain frames, as happens during attacks. This situation can then quickly lead to a saturation of the LTP filter by cumulative effect linked to the recursive character of long-term predictive filtering.

Une première solution à ce problème est de limiter le gain gp de pitch à 1, mais cette contrainte a pour effet de dégrader les performances des codeurs CELP pour les attaques.A first solution to this problem is to limit the gp pitch gain to 1, but this constraint has the effect of degrading the performance of the CELP coders for attacks.

D'autres solutions proposent de ne limiter le gain gp de pitch à une valeur inférieure ou égale à 1 que lorsque cela est jugé nécessaire. En particulier:

  • La méthode décrite dans le brevet américain n° 5,960,386 peut se décomposer en plusieurs étages situés au codeur. Tout d'abord, une procédure de détection d'une possible instabilité utilisant le gain de pitch préalablement calculé et une moyenne des gains de pitch précédents. Ensuite, dans le cas où il n'y a pas de risque d'instabilité, le gain de pitch préalablement calculé est conservé. Dans le cas contraire, une procédure itérative de contrôle du gain de pitch permet d'adapter ce gain pour éliminer le risque d'instabilité.
  • Dans les brevets américains n° 5,893,060 et 5,987,406 , une procédure de détection des instabilités au codeur est décrite. Cette procédure utilise les paramètres spectraux LSP pour déterminer la présence de résonances dans le spectre, calcule la durée de la résonance en nombre de trames, et évalue la possible instabilité en fonction de la valeur du gain de pitch. Dans le cas où une instabilité est détectée, la valeur du gain de pitch est saturée à un seuil et la recherche du vecteur de gain dans la quantification vectorielle des gains de pitch est modifiée pour que le vecteur choisi ait une valeur de gain de pitch inférieure à ce seuil.
  • Dans l'article de R. Salami précité et le brevet américain n° 5'708757 est décrite une procédure de détection d'une possible saturation et du calcul de la valeur de gain de pitch associée, présente au codeur dans la norme G729, est décrite. Cette méthode, appelée "taming", prend en compte l'erreur maximum potentielle commise par le décodeur sur le calcul de l'excitation. Si cette erreur dépasse un certain seuil quand le gain de pitch est supérieur à 1, correspondant à un filtre instable, le gain est modifié pour prendre une valeur inférieure à 1 afin de rendre le filtre stable. L'idée est donc de détecter au codeur des zones où l'accumulation des erreurs de transmission précédentes peut causer une saturation du filtre à long terme localement instable, notamment lors de longues zones fortement voisées. Ces zones sont détectées en examinant la sortie d'un deuxième filtrage à long terme avec une excitation constante qui simule l'erreur maximum potentielle. Une technique identique est utilisée dans la norme ITU-T G.723.1. Ce codeur utilise un prédicteur à long terme d'ordre 5 pour lequel le gain de pitch est un vecteur de 5 coefficients appliqués sur 5 échantillons consécutifs du passé. Ces vecteurs de gain sont quantifiés par quantification vectorielle. Alors que la stabilité d'un filtre à long terme d'ordre 1, comme celui du codeur G.729, se vérifie très facilement en comparant le seul coefficient de gain avec la valeur 1, cette vérification est beaucoup plus compliquée pour un filtre à long terme d'ordre supérieur. En effet, la stabilité d'un filtre à long terme utilisant un jeu de gain dépend également de la nature du signal, par exemple du pitch. Donc, le même jeu de gain peut être stable dans une situation et instable dans une autre. C'est pourquoi il est difficile d'estimer la propagation d'une erreur, car la nature d'erreur potentielle ne peut pas être connue au codeur, et il n'est pas simple de détecter les zones potentiellement instables ni de déterminer l'atténuation à appliquer pour rétablir la stabilité du filtre. La solution mise en oeuvre dans la norme G.723.1 est de trouver, par apprentissage, pour chaque vecteur de gain possible du codeur un gain moyen équivalent d'ordre 1. Ces valeurs sont stockées dans un tableau. On utilise donc ce filtre équivalent d'ordre 1 pour estimer l'erreur maximum potentielle accumulée dans le filtre à long terme, et ainsi identifier les zones instables où il faut limiter le gain en cas d'une erreur accumulée importante et calculer le gain à appliquer pour rendre le filtre stable.
Other solutions propose to limit the gain g p of pitch to a value less than or equal to 1 only when it is deemed necessary. In particular:
  • The method described in US Patent No. 5,960,386 can be broken down into several stages located at the encoder. First, a procedure for detecting a possible instability using the previously calculated pitch gain and an average of the previous pitch gains. Then, in the case where there is no risk of instability, the previously calculated pitch gain is retained. In the opposite case, an iterative procedure for controlling the pitch gain makes it possible to adapt this gain to eliminate the risk of instability.
  • In US Patents No. 5893060 and 5987406 , a procedure for detecting instabilities at the encoder is described. This procedure uses the spectral parameters LSP to determine the presence of resonances in the spectrum, calculates the duration of the resonance in number of frames, and evaluates the possible instability as a function of the value of the pitch gain. In the case where an instability is detected, the value of the pitch gain is saturated at a threshold and the search of the gain vector in the vector quantization of the pitch gains is modified so that the selected vector has a lower pitch gain value. at this threshold.
  • In the article by R. Salami supra and US Patent No. 5'708757 A procedure for detecting a possible saturation and calculating the associated pitch gain value, present at the encoder in the G729 standard, is described. This method, called "taming", takes into account the maximum potential error committed by the decoder on the computation of the excitation. If this error exceeds a certain threshold when the pitch gain is greater than 1, corresponding to an unstable filter, the gain is modified to take a value less than 1 in order to make the filter stable. The idea is therefore to detect at the encoder areas where the accumulation of previous transmission errors can cause saturation of the long-term filter locally unstable, especially during long, highly voiced areas. These areas are detected by examining the output of a second long-term filter with constant excitation that simulates the potential maximum error. An identical technique is used in the ITU-T G.723.1 standard. This coder uses a long-term predictor of order 5 for which the pitch gain is a vector of 5 coefficients applied to 5 consecutive samples of the past. These gain vectors are quantified by vector quantization. While the stability of a first-order long-term filter, like that of the G.729 encoder, is very easy to verify by comparing the single gain coefficient with the value 1, this check is much more complicated for a filter with long-term higher order. Indeed, the stability of a long-term filter using a gain game also depends on the nature of the signal, for example the pitch. So the same winning game can be stable in one situation and unstable in another. This is why it is difficult to estimate the propagation of an error, because the nature of potential error can not be known to the coder, and it is not easy to detect potentially unstable areas or to determine the attenuation to apply to restore the stability of the filter. The solution implemented in the G.723.1 standard is to find, by learning, for each vector of possible gain of the encoder an equivalent average gain of order 1. These values are stored in a table. This equivalent filter of order 1 is then used to estimate the maximum potential error accumulated in the long-term filter, and thus to identify the unstable zones where the gain must be limited in the event of a large accumulated error and to calculate the gain at apply to make the filter stable.

Toutefois, les solutions proposées par ces techniques connues pour éviter le risque de saturation des filtres LTP en cas de pertes ou d'erreurs de transmission posent les problèmes suivants :

  • La décision de modifier le gain gp associé à la prédiction à long terme étant réalisée au codeur a priori, il n'est pas possible de contrôler complètement l'état du décodeur et son comportement après une perte de trame, lesquels sont par hypothèse ignorés du codeur. Aussi, les techniques existantes peuvent continuer à générer des dégradations audio au décodage lors d'erreurs de transmission, ceci malgré la décision prise par le codeur de modifier le gain.
  • La limitation à 1 du gain gp de pitch associée aux techniques décrites plus haut peut entraîner une légère dégradation de la qualité par exemple sur les attaques qui génèrent normalement des gains supérieurs à 1. Le choix du seuil de déclenchement est en effet un compromis entre qualité et sécurité. Un seuil bas déclencherait la limitation trop souvent, entraînant une dégradation inutile, surtout en cas d'absence d'erreurs de transmission. Inversement, un seuil plus élevé ne garantirait pas une protection suffisante en cas de taux d'erreur élevés.
However, the solutions proposed by these known techniques to avoid the risk of saturation LTP filters in case of loss or transmission errors pose the following problems:
  • Since the decision to modify the gain g p associated with the long-term prediction is carried out at the coder a priori, it is not possible to control completely the state of the decoder and its behavior after a loss of frame, which are supposedly ignored by the encoder. Also, existing techniques can continue to generate audio degradations during decoding during transmission errors, despite the decision made by the coder to change the gain.
  • The limitation to 1 of the gain g p of pitch associated with the techniques described above can lead to a slight deterioration of the quality, for example on the attacks which normally generate gains greater than 1. The choice of the triggering threshold is indeed a compromise between quality and safety. A low threshold would trigger the limitation too often, causing unnecessary degradation, especially in the absence of transmission errors. Conversely, a higher threshold would not guarantee sufficient protection in case of high error rates.

Aussi, le problème technique à résoudre par l'objet de la présente invention est de proposer un procédé de limitation de gain d'excitation adaptative dans un décodeur d'un signal audio codé au moyen d'un codeur comprenant un filtre prédictif à long terme, à la suite d'une perte de trame de transmission entre ledit codeur et ledit décodeur, qui permettrait de ne limiter le gain gp d'excitation adaptative, ou gain de pitch, que dans le cas où une instabilité du filtre LTP est effectivement constatée, et d'assurer le meilleur compromis possible entre la qualité du décodage et sa robustesse vis-à-vis des pertes de trame.Also, the technical problem to be solved by the object of the present invention is to propose a method for limiting adaptive excitation gain in a decoder of an audio signal encoded by means of an encoder comprising a long-term predictive filter. , following a loss of transmission frame between said encoder and said decoder, which would limit the adaptive excitation g p gain, or pitch gain, only in the case where an instability LTP filter is actually noted, and to ensure the best possible compromise between the quality of the decoding and its robustness vis-à-vis the frame loss.

La solution au problème technique posé consiste, selon la présente invention, en ce que ledit procédé comprend les étapes correspondantes à la revendication 1.The solution to the technical problem posed consists, in the present invention, in that said method comprises the steps corresponding to claim 1.

D'une manière générale, on entend ici par « perte de trame » aussi bien la non-réception d'une trame que des erreurs de transmission dans une trame.In general, the term "frame loss" is used here to mean the non-reception of a frame as well as the transmission errors in a frame.

Selon un mode de réalisation, ladite valeur arbitraire est égale à une valeur du gain d'excitation adaptative déterminée lors de ladite trame perdue par un algorithme de dissimulation d'erreur.According to one embodiment, said arbitrary value is equal to a value of the adaptive excitation gain determined during said lost frame by an error concealment algorithm.

A titre d'exemple d'algorithme de dissimulation d'erreur, ladite valeur arbitraire est égale à la valeur du gain d'excitation adaptative pour la trame non perdue précédant ladite trame perdue.As an example of an error concealment algorithm, said arbitrary value is equal to the value of the adaptive excitation gain for the non-lost frame preceding said lost frame.

Selon un autre exemple, ladite valeur arbitraire est définie à partir d'une détection de voisement de la trame précédente. Pour une trame voisée, ladite valeur arbitraire est égale à 1, sinon la valeur arbitraire est égale à 0. Dans ce dernier cas, l'excitation est composée d'un bruit aléatoire.In another example, said arbitrary value is defined from a voicing detection of the previous frame. For a voiced frame, said arbitrary value is equal to 1, otherwise the arbitrary value is equal to 0. In the latter case, the excitation is composed of a random noise.

Comme on le verra en détail plus loin, le procédé conforme à l'invention présente l'avantage de ne modifier le gain gp de pitch que lorsqu'une possible instabilité du filtre LTP est détectée au décodeur lui-même et non au codeur comme dans les techniques connues. De plus, le procédé de l'invention prend en compte à la fois l'état réel du décodeur et l'information exacte sur les erreurs de transmission parvenues.As will be seen in detail below, the method according to the invention has the advantage of modifying the gain g p of pitch only when a possible instability of the LTP filter is detected at the decoder itself and not at the encoder as in known techniques. In addition, the method of the invention takes into account both the actual state of the decoder and the exact information on the transmission errors reached.

Le procédé, objet de l'invention, peut être utilisée de manière autonome, c'est-à-dire dans des structures de codage qui ne prévoient pas de limitation du gain de pitch au niveau du codeur.The method, object of the invention, can be used autonomously, that is to say in coding structures that do not provide for limiting the pitch gain at the coder.

Cependant, et de manière avantageuse, l'invention prévoit que ledit gain d'excitation adaptative est fourni audit décodeur par un codeur équipé d'un dispositif de limitation de gain. Le procédé conforme à l'invention peut donc être aussi utilisé en combinaison avec une technique de « taming » a priori connue, installée au codeur. Les avantages des deux techniques sont alors cumulés : la technique a priori permet de limiter les trop longues séquences de gains de pitch supérieurs à 1. En effet, de telles séquences entraînent une importante propagation de l'erreur, contraignant le procédé de l'invention à modifier le signal sur de longues périodes. Cependant un seuil trop bas de déclenchement de la technique de « taming » a priori dégrade le signal. L'invention permet alors de réduire le nombre de déclenchements de la technique de « taming » a priori en augmentant le seuil, car même si cette technique ne détecte pas le risque d'explosion, le procédé a posteriori selon l'invention le détecte et y remédie.However, and advantageously, the invention provides that said adaptive excitation gain is supplied to said decoder by an encoder equipped with a gain limitation device. The method according to the invention can therefore also be used in combination with a known taming technique, installed at the encoder. The advantages of the two techniques are then cumulated: the prior technique makes it possible to limit the long sequences of pitch gains greater than 1. Indeed, such sequences cause a large propagation of the error, forcing the method of the invention to modify the signal over long periods. However, a too low trigger threshold of the "taming" technique a priori degrades the signal. The invention thus makes it possible to reduce the number of triggers of the "taming" technique a priori by increasing the threshold, because even if this technique does not detect the risk of explosion, the posterior method according to the invention detects it and cure it.

Selon l'invention, ladite fonction d'indication d'erreur est de la forme : x t n = e t n + i g it . x t n - P + i i - N - 1 / 2 , N - 1 / 2

Figure imgb0001

où:

  • N est l'ordre du filtre prédictif à long terme, généralement impair,
  • les gains git sont égaux aux gains d'excitation adaptative gi dudit filtre prédictif à long terme pour les trames reçues ou aux gains d'excitation adaptative g i_FEC (FEC pour « Frame Erasure Concealment») dudit filtre prédictif à long terme dans la trame précédente pour les trames perdues,
  • et(n) vaut 0 pour les trames reçues et 1 pour les trames perdues.
  • P est la période d'excitation adaptative.
According to the invention, said error indication function is of the form: x t not = e t not + Σ i boy Wut it . x t not - P + i i - NOT - 1 / 2 , NOT - 1 / 2
Figure imgb0001

or:
  • N is the order of the long-term, generally odd, predictive filter
  • the gains g it are equal to the adaptive excitation gains g i of said long-term predictive filter for the received frames or to the adaptive excitation gains g i _ FEC (FEC for "Frame Erasure Concealment") of said long-term predictive filter in the previous frame for lost frames,
  • e t (n) is 0 for received frames and 1 for lost frames.
  • P is the period of adaptive excitation.

Bien entendu, dans le cas le plus simple, l'ordre N du filtre LTP peut être pris égal à 1.Of course, in the simplest case, the order N of the LTP filter can be taken as 1.

Dans un premier mode de mise en oeuvre du procédé conforme à l'invention, le gain gp d'excitation adaptative d'un filtre prédictif à long terme d'ordre 1 est limité à la valeur 1 si ledit paramètre d'indication d'erreur est supérieur audit seuil donné.In a first embodiment of the method according to the invention, the gain g p of adaptive excitation of a long-term predictive filter of order 1 is limited to the value 1 if said parameter of indication of error is greater than said given threshold.

De même, l'invention prévoit qu'un facteur correctif est appliqué aux gains gi d'excitation adaptative d'un filtre prédictif à long terme d'ordre supérieur à 1 si ledit paramètre d'indication d'erreur est supérieur audit seuil donné.Likewise, the invention provides that a correction factor is applied to the gains g i of adaptive excitation of a long-term predictive filter of order greater than 1 if said error indication parameter is greater than said given threshold. .

Dans un deuxième mode de mise en oeuvre, ledit au moins un gain d'excitation adaptative est limité par une fonction linéaire dudit seuil donné si ledit paramètre d'indication d'erreur est supérieur audit seuil. Cette disposition avantageuse permet de rendre la limitation de gain plus progressive et d'éviter un effet de seuil brutal.In a second embodiment, said at least one adaptive excitation gain is limited by a linear function of said given threshold if said error indication parameter is greater than said threshold. This provision advantage makes it possible to make the gain limitation more progressive and to avoid a sudden threshold effect.

L'invention concerne également un programme comprenant des instructions enregistrées sur un support lisible par un ordinateur pour mettre en oeuvre les étapes du procédé selon l'invention, lorsque ledit programme est exécuté sur un ordinateur.The invention also relates to a program comprising instructions recorded on a computer-readable medium for carrying out the steps of the method according to the invention, when said program is executed on a computer.

L'invention concerne enfin un décodeur d'un signal audio codé au moyen d'un codeur comprenant les caractéristiques de la revendication 11.The invention finally relates to a decoder of an audio signal encoded by means of an encoder comprising the features of claim 11.

La description qui va suivre en regard des dessins annexés, donnés à titre d'exemples non limitatifs, fera bien comprendre en quoi consiste l'invention et comment elle peut être réalisée.

  • La figure 1 (a) est un schéma de haut niveau d'un codeur G.729.
  • La figure 1 (b) est un schéma détaillé du bloc de codage de l'excitation du codeur de la figure 1 (a).
  • La figure 1 (c) est un schéma du décodeur associé au codeur de la figure 1 (a).
  • La figure 2 est un tableau donnant les divers paramètres de codage du codeur de la figure 1 (a)
  • La figure 3 est un schéma d'un décodeur conforme à l'invention.
The following description with reference to the accompanying drawings, given by way of non-limiting examples, will make it clear what the invention consists of and how it can be achieved.
  • The Figure 1 (a) is a high-level schema of a G.729 encoder.
  • The Figure 1 (b) is a detailed diagram of the coding block of the encoder excitation of the Figure 1 (a) .
  • The Figure 1 (c) is a diagram of the decoder associated with the coder of the Figure 1 (a) .
  • The figure 2 is a table giving the various coding parameters of the coder of the Figure 1 (a)
  • The figure 3 is a diagram of a decoder according to the invention.

L'invention va maintenant être décrite de manière détaillée dans le cadre d'un décodeur G.729 et d'un filtrage de prédiction à long terme LTP d'ordre N=1. Le cas d'un filtre LTP d'ordre N quelconque sera traité à la fin de la présente description.The invention will now be described in detail in the context of a G.729 decoder and long-term prediction filtering LTP of order N = 1. The case of an LTP filter of any order N will be treated at the end of the present description.

On rappelle que le signal d'excitation xc(n) issu du bloc 103 de codage de l'excitation de la figure 1 (a) et explicité à la figure 1 (b) est la somme de l'excitation adaptative gp.xc(n-P) et de l'excitation fixe gp.c(n) : x e n = g p , x e n - P + g c . c n

Figure imgb0002

où :

  • gp est le gain de l'excitation adaptative ou gain de pitch,
  • P est la valeur du pitch ou longueur de la période. Le codeur G.729 utilise une résolution fractionnelle par pas de 1/3 pour les petites valeurs de pitch (P < 85) pour mieux modéliser les sons voisés aigus. L'excitation adaptative avec un pitch fractionnel est obtenue par interpolation avec sur-échantillonnage,
  • gc est le gain de l'excitation fixe,
  • c(n) est le mot de code fixe, ou innovateur.
It is recalled that the excitation signal x c (n) from block 103 coding the excitation of the Figure 1 (a) and explained to the Figure 1 (b) is the sum of the adaptive excitation g p .x c (nP) and the fixed excitation g p .c (n) : x e not = boy Wut p , x e not - P + boy Wut vs . vs not
Figure imgb0002

or :
  • g p is the gain of the adaptive excitation or pitch gain,
  • P is the value of the pitch or length of the period. The G.729 encoder uses fractional resolution in 1/3 increments for small pitch values ( P <85) to better model high-pitched voices. Adaptive excitation with a fractional pitch is obtained by interpolation with oversampling,
  • g c is the gain of the fixed excitation,
  • c (n) is the fixed code word, or innovator.

L'excitation adaptative dépend uniquement de l'excitation passée et permet de modéliser efficacement les signaux périodiques, notamment voisés, où l'excitation elle-même se répète quasi périodiquement. La partie fixe c(n) apporte l'innovation dans l'excitation totale pour modéliser la différence entre les périodes, c'est-à-dire pour corriger l'erreur entre l'excitation adaptative et le résidu de prédiction.Adaptive excitation depends solely on the past excitation and makes it possible to efficiently model the periodic signals, especially voiced signals, where the excitation itself is repeated almost periodically. The fixed part c (n) brings the innovation in the total excitation to model the difference between the periods, that is to say to correct the error between the adaptive excitation and the prediction residue.

Comme on l'a vu plus haut, ce signal d'excitation est optimisé au codeur en utilisant la technique d'analyse par synthèse. On effectue donc le filtrage de synthèse de cette excitation avec le filtre quantifié pour vérifier le résultat qu'on obtiendra au décodeur. Ceci explique pourquoi il est possible d'utiliser un filtrage à long terme localement instable, c'est-à-dire avec une valeur de gp supérieur à 1, pour modéliser une attaque du signal car l'augmentation de l'énergie due à cette instabilité est contrôlée. Par contre, ce contrôle est perturbé par les éventuelles pertes de trame.As seen above, this excitation signal is optimized to the encoder using the technique of synthesis analysis. The synthesis filtering of this excitation is thus performed with the quantized filter to check the result that will be obtained at the decoder. This explains why it is possible to use a locally unstable long-term filtering, that is with a value of g p greater than 1, to model a signal attack because the increase in energy due to this instability is controlled. On the other hand, this control is disturbed by the possible frame losses.

Au décodeur, dans le cas d'une trame perdue, ou erronée, l'algorithme de dissimulation des erreurs utilise un signal d'excitation estimé à partir du signal d'excitation passé. Typiquement, on réutilise uniquement le filtrage à long terme LTP en gardant la dernière valeur du pitch correctement décodéeAt the decoder, in the case of a lost frame, or erroneous, the error concealment algorithm uses an estimated excitation signal from the past excitation signal. Typically, we only reuse the filtering long-term LTP by keeping the last value of the pitch correctly decoded

. On injecte donc une perturbation dans le signal d'excitation du décodeur, noté xd(n). Pour les trames valides suivantes, même si il est possible de décoder correctement tous les paramètres gp , P, gc et c(n) de génération de l'excitation, l'excitation obtenue ne sera pas exacte car l'excitation passée xd(n-P) est perturbée. L'erreur injectée pendant la trame perdue peut donc se propager par la suite sur de nombreuses trames à cause de la récursivité du filtrage à long terme dans les périodes voisées, en particulier quand gp est proche de 1. Par contre, quand gp a une valeur faible ou égale à zéro pendant plusieurs zones non-voisées, l'effet de la perturbation s'affaiblit ou s'annule car le poids du code innovateur c(n) est plus important que le poids du passé.. A disturbance is thus injected into the decoder excitation signal, denoted x d (n). For the following valid frames, even if it is possible to correctly decode all the excitation parameters g p , p , g c and c (n) , the excitation obtained will not be exact because the excitation is past x d (nP) is disturbed. The error injected during the lost frame can therefore propagate later on many frames because of the recursion of the long-term filtering in the voiced periods, in particular when g p is close to 1. By cons, when g p has a low or zero value during several voiceless zones, the effect of the perturbation weakens or vanishes because the weight of the innovating code c (n) is greater than the weight of the past.

Il est donc essentiel de pouvoir estimer l'importance de l'erreur accumulée dans la partie adaptative, due aux erreurs de transmission. A cet effet, il est proposé de modifier selon la figure 3 le décodeur représenté sur la figure 1 (c).It is therefore essential to be able to estimate the magnitude of the error accumulated in the adaptive part, due to transmission errors. For this purpose, it is proposed to amend the figure 3 the decoder shown on the Figure 1 (c) .

On peut voir sur la figure 3 que, parallèlement au filtrage à long terme LTP, le décodeur comprend une ligne de traitement du signal d'excitation issu du démultiplexeur 112 constituée par les blocs 211 à 215. Cette ligne de traitement du décodeur ainsi décrit sert également d'illustration des principales étapes du procédé de limitation du gain d'excitation adaptative selon l'invention.We can see on the figure 3 that, in parallel with the long-term filtering LTP, the decoder comprises a processing line of the excitation signal from the demultiplexer 112 constituted by the blocks 211 to 215. This processing line of the decoder thus described also serves to illustrate the main steps of the adaptive excitation gain limiting method according to the invention.

Le bloc 211 est destiné à détecter si une trame est correctement reçue ou non. Ce bloc de détection est suivi d'un module 212 qui effectue une opération analogue à un filtrage à long terme LTP. Plus précisément, le module 212 calcule une fonction xt(n) d'indication d'erreur dont les valeurs sont représentatives de l'erreur accumulée au décodage sur l'excitation adaptative à la suite d'une perte de transmission. Dans un mode de réalisation, cette fonction est donnée par : x t n = g t . x t n - p + e t n

Figure imgb0003

et(n) est égal à :

  • 1 pour les trames non reçues ou erronées afin de modéliser l'erreur injectée dans la boucle adaptative,
  • 0 pour les trames valides, quand l'erreur se propage uniquement à cause de la récursivité du filtre à long terme.
    gt est égal à :
  • gp_FEC , valeur du gain de pitch de la trame précédente pour les trames non reçues,
  • gp pour les trames valides.
The block 211 is intended to detect whether a frame is correctly received or not. This detection block is followed by a module 212 which performs a similar operation to LTP long-term filtering. More precisely, the module 212 calculates an error indication function x t (n) whose values are representative of the accumulated error on decoding on the adaptive excitation as a result of a loss of transmission. In one embodiment, this function is given by: x t not = boy Wut t . x t not - p + e t not
Figure imgb0003

where e t (n) is equal to:
  • 1 for frames not received or erroneous in order to model the error injected into the adaptive loop,
  • 0 for valid frames, when the error propagates only because of the long-term filter recursion.
    g t is equal to:
  • g p_FEC , value of the pitch gain of the previous frame for the frames not received,
  • g p for valid frames.

Ensuite, un module 213 calcule à partir des valeurs de la fonction xt(n) fournies par le module 212, un paramètre St d'indication d'erreur. Pour une trame valide, un comparateur 214 vérifie si le paramètre St ne dépasse pas un certain seuil S0 . En cas de dépassement et si le gain gp de pitch décodé est supérieur à 1, la valeur de gp est limitée, car dans ce cas il y a risque de saturation du filtre LTP.Then, a module 213 calculates from the values of the function x t (n) provided by the module 212, an error indication parameter S t . For a valid frame, a comparator 214 checks whether the parameter S t does not exceed a certain threshold S 0 . In case of overshoot and if the decoded pitch gain g p is greater than 1, the value of g p is limited, because in this case there is a risk of saturation of the LTP filter.

Le paramètre St d'indication d'erreur peut être la somme des valeurs de la fonction xt(n), ou bien la valeur maximale, la moyenne ou la somme des carrés de ces valeurs.The error indication parameter S t may be the sum of the values of the function x t (n) , or the maximum value, the average or the sum of the squares of these values.

Le comparateur 214 est suivi d'un discriminateur 215 apte à déterminer la valeur g't du gain de pitch à appliquer au bloc 117 pour la trame en cours, à savoir la valeur gp de pitch décodée ou une valeur limitée.The comparator 214 is followed by a discriminator 215 able to determine the value g ' t of the pitch gain to be applied to the block 117 for the current frame, namely the decoded pitch value g p or a limited value.

Dans le cas où le paramètre St dépasse le seuil S0 et si le gain gp de pitch décodé est supérieur à 1, le gain g't peut être limité systématiquement à 1 par exemple, quelle que soit l'ampleur du dépassement. Mais on peut également prévoir une limitation plus progressive qui consiste à définir le gain g't comme une fonction linéaire du paramètre St de la forme : t = g p + g p - 1 S 0 - S t / S

Figure imgb0004

S étant un coefficient arbitraire permettant d'ajuster la pente de la variation de g't avec St .In the case where the parameter S t exceeds the threshold S 0 and the decoded pitch gain g p is greater than 1, the gain g ' t can be systematically limited to 1 for example, regardless of the magnitude of the overshoot. But we can also provide a more progressive limitation which consists in defining the gain g ' t as a linear function of the parameter S t of the form: boy Wut t = boy Wut p + boy Wut p - 1 S 0 - S t / S
Figure imgb0004

S being an arbitrary coefficient for adjusting the slope of the variation of g ' t with S t .

Il est également possible de prévoir une limitation du gain par rapport à deux seuils successifs, avec une limitation linéaire entre les deux seuils et une limitation à 1 au-delà du deuxième, comme cela est illustré dans l'exemple suivant.It is also possible to provide a limitation of the gain with respect to two successive thresholds, with a linear limitation between the two thresholds and a limitation to 1 beyond the second, as illustrated in the following example.

A titre d'exemple pratique, pour une trame valide, les paramètres LTP, P et gp , sont transmis pour chaque sous-trame de 5 ms contenant 40 échantillons. Le traitement pour éviter la saturation du filtre LTP, objet de l'invention, est également réalisé à la cadence des sous-trames. Le paramètre St d'indication d'erreur, par exemple la somme de la fonction xt(n), est calculé pour chaque sous-trame. La valeur de ce paramètre est limitée à 120, ce qui correspond à une valeur moyenne de 3 : St = min i = 0 39 xt n , 120

Figure imgb0005
As a practical example, for a valid frame, the LTP, P and g p parameters are transmitted for each 5 ms subframe containing 40 samples. The treatment to avoid saturation of the LTP filter, which is the subject of the invention, is also carried out at the rate of the subframes. The error indication parameter S t , for example the sum of the function x t (n) , is calculated for each subframe. The value of this parameter is limited to 120, which corresponds to an average value of 3: St = min Σ i = 0 39 xt not , 120
Figure imgb0005

Si le gain de pitch de la sous-trame courante est supérieur à 1 et la valeur de St est supérieure à un seuil de 80, correspondant à une valeur moyenne des échantillons xt(n) supérieure à 2, ce qui montre que l'erreur cumulée est importante, on diminue la valeur du gain de pitch selon l'équation suivante: t = 1 + g t - 1 . 120 - S t / 40

Figure imgb0006
If the pitch gain of the current subframe is greater than 1 and the value of S t is greater than a threshold of 80, corresponding to an average value of the samples x t (n) greater than 2, which shows that the Cumulative error is important, we reduce the value of the pitch gain according to the following equation: boy Wut t = 1 + boy Wut t - 1 . 120 - S t / 40
Figure imgb0006

Pour la valeur maximale de St (St = 120) le nouveau gain de pitch sera g't =1, pour les autres valeurs de St 80 <St <120, 1 >g't >gt .For the maximum value of S t ( S t = 120) the new pitch gain will be g ' t = 1, for the other values of S t 80 < S t <120, 1>g' t > g t .

Quand la valeur du gain de pitch est modifiée par le procédé décrit ci-dessus, on effectue une mise à jour de la mémoire du signal xt(n) avec la nouvelle valeur g't .When the value of the pitch gain is modified by the method described above, the memory of the signal x t (n) is updated with the new value g ' t .

Au contraire, si le gain de pitch de la sous-trame actuelle est inférieur à 1 ou la valeur de St est inférieure à 80, correspondant à une erreur cumulée dans le filtre de synthèse à long terme faible, on ne modifie pas la valeur du gain de pitch décodée et g't =gt .On the contrary, if the pitch gain of the current sub-frame is less than 1 or the value of S t is less than 80, corresponding to a cumulative error in the long-term weak synthesis filter, the value is not modified. the decoded pitch gain and g ' t = g t .

Finalement, pour générer l'excitation du filtre de synthèse, à la place du gain de pitch décodé on utilise g't : x d n = t . x d n - P + g c n . c n

Figure imgb0007
Finally, to generate the excitation of the synthesis filter, instead of the decoded pitch gain, we use g ' t : x d not = boy Wut t . x d not - P + boy Wut vs not . vs not
Figure imgb0007

Dans l'exemple de réalisation présenté ici, le filtre à long terme du codeur est un filtre d'ordre 1. Cependant, si le codeur utilise un filtre à long terme LTP d'ordre N supérieur, comme par exemple pour le codeur G.723.1, le pseudo-filtre LTP utilisé pour définir la fonction d'indication d'erreur peut être le filtre équivalent d'ordre 1 ou plus avantageusement un filtre identique à celui utilisé dans le codeur, en particulier de même ordre. Pour identifier pendant les trames valides les zones instables où il convient de limiter le gain en cas d'une erreur cumulée importante et pour déterminer l'atténuation nécessaire, on utilise toujours le filtre équivalent d'ordre 1.In the exemplary embodiment presented here, the long-term filter of the encoder is a filter of order 1. However, if the encoder uses a long-term filter LTP of higher order N, as for example for the encoder G. 723.1, the pseudo-LTP filter used to define the error indication function may be the equivalent filter of order 1 or more advantageously a filter identical to that used in the encoder, in particular of the same order. To identify the unstable areas where the gain must be limited in the event of a large cumulative error during the valid frames and to determine the necessary attenuation, the equivalent filter of order 1 is always used.

Dans le cas où le paramètre St dépasse le seuil S0 et si le gain équivalent gc est supérieur à 1, le gain g't peut être calculé de la même manière que pour un filtre d'ordre 1. On applique alors le facteur correctif g' t/ ge aux gains gi du filtre d'ordre supérieur.In the case where the parameter S t exceeds the threshold S 0 and if the equivalent gain g c is greater than 1, the gain g ' t can be calculated in the same way as for a filter of order 1. It then applies the corrective factor g ' t / g e to the gains g i of the higher order filter.

Claims (11)

  1. Method for limiting the adaptive excitation gain in a decoder of an audio signal coded by a coder comprising a long-term predictive filter, following transmission frame loss between said coder and said decoder, characterized in that said method comprises the steps consisting, in the decoder, in:
    - detecting whether a frame is correctly received or not,
    - establishing an error indication function of the form: x t n = e t n + i g it . x t n - P + i i - N - 1 / 2 , N - 1 / 2
    Figure imgb0010

    in which:
    - N is the order of the long-term predictive filter,
    - the gains git are equal to the adaptive excitation gains of said long-term predictive filter for the frames received or to the adaptive excitation gains of said long-term predictive filter in the preceding frame for the frames lost,
    - et(n) has the value 0 for the frames received and 1 for the frames lost.
    - P is the adaptive excitation period decoded for the frames received or most recently correctly decoded for the frames lost,
    - calculating, during the decoding, the values of said error indication function,
    - calculating an error indication parameter on the basis of said values of the error indication function,
    - comparing said error indication parameter to at least one given threshold,
    - applying a limitation to at least one adaptive excitation gain in case of a positive comparison if a gain equivalent to said at least one adaptive excitation gain is greater than a given value.
  2. Method according to Claim 1, characterized in that said equivalent gain is the adaptive excitation gain gp of a 1st order long-term predictive filter.
  3. Method according to Claim 1, characterized in that said equivalent gain is the equivalent gain ge of a long-term predictive filter of an order greater than 1.
  4. Method according to any one of Claims 1 to 3, characterized in that said error indication parameter is a parameter representative of the energy of said error indication function.
  5. Method according to Claim 4, characterized in that said representative parameter is given by the sum of the values of the error indication function.
  6. Method according to any one of Claims 1 to 5, characterized in that the adaptive excitation gain gp of a first order long-term predictive filter is limited to the value 1 if said error indication parameter is greater than said given threshold.
  7. Method according to any one of Claims 1 to 5, characterized in that a corrective factor is applied to the adaptive excitation gains gi of a long-term predictive filter of an order greater than 1 if said error indication parameter is greater than said given threshold.
  8. Method according to any one of Claims 1 to 5, characterized in that said at least one adaptive excitation gain is limited by a linear function of said given threshold if said error indication parameter is greater than said threshold.
  9. Method according to any one of Claims 1 to 8, characterized in that said adaptive excitation gain is supplied to said decoder by a coder equipped with a gain limiting device.
  10. Program comprising instructions stored on a computer-readable medium for implementing the steps of the method according to Claims 1 to 9, when said program is executed on a computer.
  11. Decoder of an audio signal coded by a coder comprising a long-term predictive filter, characterized in that said decoder comprises:
    - a block (211) for detecting transmission frame losses,
    - a module (222) for calculating values of an error indication function, the error indication function being of the form: x t n = e t n + i g it . x t n - P + i i - N - 1 / 2 , N - 1 / 2
    Figure imgb0011

    in which:
    - N is the order of the long-term predictive filter,
    - the gains g it are equal to the adaptive excitation gains of said long-term predictive filter for the frames received or to the adaptive excitation gains of said long-term predictive filter in the preceding frame for the frames lost,
    - et(n) has the value 0 for the frames received and 1 for the frames lost,
    - P is the adaptive excitation period decoded for the frames received or most recently correctly decoded for the frames lost,
    - a module (213) for calculating an error indication parameter on the basis of said values of the error indication function,
    - a comparator (214) for comparing said error indication parameter to at least one given threshold,
    - a discriminator (215) suitable for determining, according to the result supplied by the comparator (214), a value of at least one adaptive excitation gain to be used by the decoder.
EP07731604A 2006-02-28 2007-02-13 Method for limiting adaptive excitation gain in an audio decoder Not-in-force EP1989705B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR0650688A FR2897977A1 (en) 2006-02-28 2006-02-28 Coded digital audio signal decoder`s e.g. G.729 decoder, adaptive excitation gain limiting method for e.g. voice over Internet protocol network, involves applying limitation to excitation gain if excitation gain is greater than given value
PCT/FR2007/050779 WO2007099244A2 (en) 2006-02-28 2007-02-13 Method for limiting adaptive excitation gain in an audio decoder

Publications (2)

Publication Number Publication Date
EP1989705A2 EP1989705A2 (en) 2008-11-12
EP1989705B1 true EP1989705B1 (en) 2012-08-15

Family

ID=36407997

Family Applications (1)

Application Number Title Priority Date Filing Date
EP07731604A Not-in-force EP1989705B1 (en) 2006-02-28 2007-02-13 Method for limiting adaptive excitation gain in an audio decoder

Country Status (7)

Country Link
US (1) US8180632B2 (en)
EP (1) EP1989705B1 (en)
JP (1) JP4988774B2 (en)
KR (1) KR101372460B1 (en)
CN (1) CN101395659B (en)
FR (1) FR2897977A1 (en)
WO (1) WO2007099244A2 (en)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7877253B2 (en) * 2006-10-06 2011-01-25 Qualcomm Incorporated Systems, methods, and apparatus for frame erasure recovery
CN101604525B (en) * 2008-12-31 2011-04-06 华为技术有限公司 Pitch gain obtaining method, pitch gain obtaining device, coder and decoder
US8886346B2 (en) 2009-10-21 2014-11-11 Dolby International Ab Oversampling in a combined transposer filter bank
CN101969372B (en) * 2010-10-29 2012-11-28 上海交通大学 Frame loss prediction based cellular network uplink video communication QoS (Quality of Service) optimization method
TR201903388T4 (en) 2011-02-14 2019-04-22 Fraunhofer Ges Forschung Encoding and decoding the pulse locations of parts of an audio signal.
MX2013009344A (en) 2011-02-14 2013-10-01 Fraunhofer Ges Forschung Apparatus and method for processing a decoded audio signal in a spectral domain.
SG192748A1 (en) 2011-02-14 2013-09-30 Fraunhofer Ges Forschung Linear prediction based coding scheme using spectral domain noise shaping
AR085218A1 (en) * 2011-02-14 2013-09-18 Fraunhofer Ges Forschung APPARATUS AND METHOD FOR HIDDEN ERROR UNIFIED VOICE WITH LOW DELAY AND AUDIO CODING
PL2550653T3 (en) 2011-02-14 2014-09-30 Fraunhofer Ges Forschung Information signal representation using lapped transform
CA2827266C (en) 2011-02-14 2017-02-28 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for coding a portion of an audio signal using a transient detection and a quality result
KR102138320B1 (en) 2011-10-28 2020-08-11 한국전자통신연구원 Apparatus and method for codec signal in a communication system
US9449607B2 (en) 2012-01-06 2016-09-20 Qualcomm Incorporated Systems and methods for detecting overflow
US9842598B2 (en) 2013-02-21 2017-12-12 Qualcomm Incorporated Systems and methods for mitigating potential frame instability
EP2922055A1 (en) 2014-03-19 2015-09-23 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus, method and corresponding computer program for generating an error concealment signal using individual replacement LPC representations for individual codebook information
EP2922054A1 (en) 2014-03-19 2015-09-23 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus, method and corresponding computer program for generating an error concealment signal using an adaptive noise estimation
EP2922056A1 (en) 2014-03-19 2015-09-23 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus, method and corresponding computer program for generating an error concealment signal using power compensation
EP2980795A1 (en) * 2014-07-28 2016-02-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoding and decoding using a frequency domain processor, a time domain processor and a cross processor for initialization of the time domain processor

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5479559A (en) * 1993-05-28 1995-12-26 Motorola, Inc. Excitation synchronous time encoding vocoder and method
US5708757A (en) * 1996-04-22 1998-01-13 France Telecom Method of determining parameters of a pitch synthesis filter in a speech coder, and speech coder implementing such method
US5960386A (en) * 1996-05-17 1999-09-28 Janiszewski; Thomas John Method for adaptively controlling the pitch gain of a vocoder's adaptive codebook
US5987406A (en) * 1997-04-07 1999-11-16 Universite De Sherbrooke Instability eradication for analysis-by-synthesis speech codecs
JP4464488B2 (en) * 1999-06-30 2010-05-19 パナソニック株式会社 Speech decoding apparatus, code error compensation method, speech decoding method
US6574593B1 (en) * 1999-09-22 2003-06-03 Conexant Systems, Inc. Codebook tables for encoding and decoding
US6636829B1 (en) * 1999-09-22 2003-10-21 Mindspeed Technologies, Inc. Speech communication system and method for handling lost frames
CA2388439A1 (en) * 2002-05-31 2003-11-30 Voiceage Corporation A method and device for efficient frame erasure concealment in linear predictive based speech codecs
JP4733939B2 (en) * 2004-01-08 2011-07-27 パナソニック株式会社 Signal decoding apparatus and signal decoding method
US8725501B2 (en) * 2004-07-20 2014-05-13 Panasonic Corporation Audio decoding device and compensation frame generation method
CN101138174B (en) * 2005-03-14 2013-04-24 松下电器产业株式会社 Scalable decoder and scalable decoding method
US7831421B2 (en) * 2005-05-31 2010-11-09 Microsoft Corporation Robust decoder
EP1898397B1 (en) * 2005-06-29 2009-10-21 Panasonic Corporation Scalable decoder and disappeared data interpolating method

Also Published As

Publication number Publication date
FR2897977A1 (en) 2007-08-31
JP4988774B2 (en) 2012-08-01
JP2009528563A (en) 2009-08-06
KR20080102262A (en) 2008-11-24
EP1989705A2 (en) 2008-11-12
WO2007099244A3 (en) 2007-10-25
CN101395659B (en) 2012-11-07
WO2007099244A2 (en) 2007-09-07
US20090204412A1 (en) 2009-08-13
US8180632B2 (en) 2012-05-15
CN101395659A (en) 2009-03-25
KR101372460B1 (en) 2014-03-11

Similar Documents

Publication Publication Date Title
EP1989705B1 (en) Method for limiting adaptive excitation gain in an audio decoder
CA2285650C (en) Method for decoding an audio signal with transmission error correction
EP1316087B1 (en) Transmission error concealment in an audio signal
EP2586133B1 (en) Controlling a noise-shaping feedback loop in a digital audio signal encoder
EP2080195B1 (en) Synthesis of lost blocks of a digital audio signal
EP2867893B1 (en) Effective pre-echo attenuation in a digital audio signal
EP1994531B1 (en) Improved celp coding or decoding of a digital audio signal
WO2008049221A1 (en) Method and device for coding transition frames in speech signals
EP2727107B1 (en) Delay-optimized overlap transform, coding/decoding weighting windows
EP2080194B1 (en) Attenuation of overvoicing, in particular for generating an excitation at a decoder, in the absence of information
EP2153438B1 (en) Post-processing for reducing quantification noise of an encoder during decoding
EP0801790A1 (en) Speech coding method using synthesis analysis
FR3024582A1 (en) MANAGING FRAME LOSS IN A FD / LPD TRANSITION CONTEXT
EP2347411B1 (en) Pre-echo attenuation in a digital audio signal
EP3138095A1 (en) Improved frame loss correction with voice information
EP2652735B1 (en) Improved encoding of an improvement stage in a hierarchical encoder
CA2304013A1 (en) Method for conditioning a digital speech signal
EP2589045B1 (en) Adaptive linear predictive coding/decoding
EP2162883B1 (en) Limitation of distortion introduced by a post-processing step during digital signal decoding

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20080911

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

17Q First examination report despatched

Effective date: 20111013

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

DAX Request for extension of the european patent (deleted)
GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 571182

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120815

Ref country code: CH

Ref legal event code: EP

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: FRENCH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602007024781

Country of ref document: DE

Effective date: 20121011

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20120815

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 571182

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120815

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121215

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121217

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121116

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121126

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20130516

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121115

REG Reference to a national code

Ref country code: CH

Ref legal event code: PUE

Owner name: ORANGE, FR

Free format text: FORMER OWNER: FRANCE TELECOM, FR

BERE Be: lapsed

Owner name: FRANCE TELECOM

Effective date: 20130228

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602007024781

Country of ref document: DE

Effective date: 20130516

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130228

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130228

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130228

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130213

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120815

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130213

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20070213

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20160121

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20160121

Year of fee payment: 10

Ref country code: GB

Payment date: 20160127

Year of fee payment: 10

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602007024781

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20170213

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20171031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170901

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170213