EP0850470A1 - Vektorquantisierungsverfahren für vokoder mit niedriger datenrate - Google Patents

Vektorquantisierungsverfahren für vokoder mit niedriger datenrate

Info

Publication number
EP0850470A1
EP0850470A1 EP96930202A EP96930202A EP0850470A1 EP 0850470 A1 EP0850470 A1 EP 0850470A1 EP 96930202 A EP96930202 A EP 96930202A EP 96930202 A EP96930202 A EP 96930202A EP 0850470 A1 EP0850470 A1 EP 0850470A1
Authority
EP
European Patent Office
Prior art keywords
envelope
points
code
coordinates
coefficients
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP96930202A
Other languages
English (en)
French (fr)
Other versions
EP0850470B1 (de
Inventor
Pierre André LAURENT
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thales SA
Original Assignee
Thomson CSF SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson CSF SA filed Critical Thomson CSF SA
Publication of EP0850470A1 publication Critical patent/EP0850470A1/de
Application granted granted Critical
Publication of EP0850470B1 publication Critical patent/EP0850470B1/de
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/032Quantisation or dequantisation of spectral components
    • G10L19/038Vector quantisation, e.g. TwinVQ audio

Definitions

  • the present invention relates to a vector quantization method for low bit rate vocoders.
  • the quantization begins to be only approximately transparent, and that it is necessary to compensate auditively for this artifact by roughly quantifying the filters located in the transitions of the speech signal and finely those corresponding to stable zones.
  • the object of the invention is to overcome the aforementioned drawbacks.
  • the subject of the invention is a method for vectoring quantification of low bit rate vocoders, characterized in that it consists in determining the field of coding by surrounding by an envelope the point cloud of the auto-correlation matrix of reflection coefficients of the vocal tract modeling filter, to determine the main axes of the volume of interior points to the envelope, to project the coefficients of the autocorrelation matrix on the main axes, to cut the interior volume of the envelope into elementary volumes and to code the coefficients results of the projection according to their coordinates in space defined by the main axes of the volume of points inside the envelope by assigning as code values only those corresponding to the locations of the elementary volumes in which they are found.
  • the main advantage of the invention is that it implements a method for quantifying the prediction filters which requires practically no more binary elements to quantify the points representative of the prediction filters than a vector quantization method using a dictionary. while remaining simple, fast, occupying only a reduced memory space.
  • Figure 1 a flowchart illustrating the speech coding method implemented by the invention.
  • FIG. 2 a two-dimensional vector space showing a distribution of area coefficients derived from the reflection coefficients modeling the vocal tract.
  • FIG. 3 an illustration of the coding method according to the invention in a three-dimensional space.
  • FIGS. 4 to 8b of examples of distribution of the coding of points in a three-dimensional space obtained by the implementation of the method according to the invention.
  • the coding method according to the invention consists, after cutting the speech signal into frames of constant length of approximately 20 to 25 ms, as is usually the case in vocoders, determining and coding the characteristics of the speech signal on successive frames by determining the energy of the signal P times per frame.
  • the synthesis of the speech signal on each frame then takes place by descrambling and decoding the values of the coded characteristics of the speech signal.
  • the steps representative of the coding method according to the invention which are shown in FIG. 1 consist in calculating in step 1, after a step not shown of sampling the speech signal SK on each frame and quantizing the samples on a determined number of bits followed by a pre-emphasis of these samples, the coefficients Kj of a filter of modeling of the vocal tract from autocorrelation coefficients Rj of samples Sf ⁇ according to a relation of the form
  • the calculation of the coefficients Kj is carried out for example by applying the algorithm known to M. LEROUX-GUEGEN, a description of which can be found in the article of the journal IEEE Transaction on Acoustics Speech, and
  • step 2 consists in non-linearly distorting the reflection coefficients by transforming them into area coefficients noted LARj from the Anglo-Saxon abbreviation LOG AREA RATIO by the relation
  • the point cloud represented in FIG. 2 in a space with only two dimensions makes appear two privileged directions symbolized by the eigenvectors
  • NQ l n / l n 2 (6)
  • the quantification method according to the invention applied to this space consists in associating a unique number with each set of integer coordinates xO, yO, zO verifying the relation:
  • a first step consists in traversing the x-axis and calculating the total number of points located in the slices of the ellipsoid which are perpendicular to it and intersecting the x-axis at points for which x takes the successive integer values - X, -X + 1, ..., x-2, x-1.
  • the second stage consists in traversing the axis of y by adding to the previous result the sum of the numbers of points located in the slices of the ellipsoid for which the abscissa is worth x and the ordinate is successively worth -Y (x), -Y (x + 1), .. ..
  • the z axis is traversed by adding to the previous result the sum of the numbers of points located in the slices for which the abscissa is x, the ordinate is y and the altitude is successively -Z ( x, y), -Z (x, y) +1, ..., z-2, z-1 where Z (x, y) ⁇ Z and is the largest value for which the point of coordinates (x, y, Z (x, y) is located in the ellipsoid or its surface.
  • V m (A) the volume of a slice with m dimensions (m ⁇ or equal to
  • the relation (14) makes it possible to deduce without difficulty a recurrence relation linking two volumes of consecutive dimensions either: ⁇
  • the number of points to be quantified can then be obtained from the preceding relationships by considering for example that the quantization step is worth 1 and that the dimensions of the axes Ai are positive integers. This determination can be obtained by successively considering the isolated points (dimension 0), the series of contiguous points (dimension 1), then by iteratively calculating the volumes of dimensions 2 ... N-1.
  • a firmware enabling this result to be obtained is provided in Annex 1.
  • the quantification algorithm according to the invention is deduced from the above example in 3 dimensions. This algorithm consists in accumulating in the code value the number of points encountered starting from a minimum value of the coordinates to arrive at the code value of the point considered. To perform this processing, the real values of the coordinates Xj are first converted to their nearest integer value. The resulting values are then corrected so as to be sure that the corresponding point is indeed located inside the ellipsoid, because for possibly external points, it is accepted that the quantization error can be greater than that obtained for points inside. An optimum process for dealing with these points would be to find the points that appear closest to the interior of the ellipsoid.
  • the instructions of the previous algorithm must be included in the coding firmware proper by using the volumes V n (A) already calculated.
  • This algorithm consists of an accumulation in the final code of the number of points left behind the coded point of coordinates (X-
  • a firmware for the execution of this coding algorithm is provided in Annex 2.
  • the maximum execution time of the previous algorithm can be shortened thanks to the symmetries. Indeed, if CodeO represents the code of the coordinate origin point (00 ...
  • the previous algorithms can still be modified by considering half-whole rather than whole coordinates.
  • a first possibility may consist in making a quantizer whose axes are twice the size of the axes Aj required.
  • a vector of N real values can then be quantified after doubling, using only odd integers.
  • the previous algorithm can then be used, the exit code obtained being converted by a table giving the final code. This transcoding is necessary for the reason that if only about a quarter of the original centroids are to be considered, this reduction does not facilitate the execution of the algorithm.
  • a second possibility may consist in modifying the initialization of the algorithm, the coding and the decoding so as to use only even coordinates.
  • Corresponding modified firmware is provided in Annex 4. Codes are transmitted using binary words. However, since the number of points included inside an ellipsoid has, a priori no reason particular to form an exact power of two, it seems highly desirable to use an optimal number of bits in the formation of the code, that this number is as close as possible to an exact power of two. This can be achieved by adjusting the volume of the ellipsoid by fractional rather than whole axis lengths.
  • the fractions representing the axes Aj have a common denominator.
  • the denominator values of 1, 2, 3 are sufficient to easily obtain ellipsoids containing a number of centroids as close as possible with an exact power of two.
  • FIG. 7a and 7b An example of ellipsoidal vector quantization for D3 Q and D3 - j is shown in Figures 7a and 7b.
  • the three axes have respectively dimensions 2, 4, 5, that is to say that they are slightly larger than those of the previous examples to obtain a sufficient number of points.
  • Each centroid is connected to its closest neighbors in the same way as in Figures 4 and 6. It can be checked in these figures that the barycenter belongs (figure 7a) or does not belong (figure 7b) to the set centroids.
  • V n (A) 0
  • ANum n _ ⁇ Num n .-
  • vol maxCode - previousV n Preservation of the max values of Num in ascending order, with their associated value V
  • ANum Num A n _-j 2 (D)
  • Sum n Su m n + 1 + X n IF n> 1 if n> 1, interative computation
  • the instructions referenced by (Z) are those to be used when the axes have whole lengths.
  • the instructions referenced by (D) relate to networks of points having coordinates with odd and even sums.
  • NV a D is replaced by NVp a D
  • V a D by Vp_ a _ b and maxNumer a t ) is replaced by maxNumerp a D if the current network is D n o or D n _ ⁇ .
  • the variable parity is 0 for D n rj and 1 for D n ⁇ .
  • Function REM2 (X) calculates the remainder of the division of X by 2: it is equivalent to X - 2 INT (X / 2). Annex 6
  • Vl, n (A) V 1 ⁇ n (A) + 2 ⁇ / 1 ⁇ n . 1 ) (X n . 1 ) END IF ELSE
  • V ⁇ , n (A) V 0 ⁇ n (A) + 2 ⁇ / 1 ⁇ n . 1 ) (X n . 1 )
  • V 1 ⁇ n (A) V 1 ⁇ n (A) + 2 * V 0l nl) (Xn-l)

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
EP96930202A 1995-09-05 1996-09-04 Vektorquantisierungsverfahren für vokoder mit niedriger datenrate Expired - Lifetime EP0850470B1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
FR9510393A FR2738383B1 (fr) 1995-09-05 1995-09-05 Procede de quantification vectorielle de vocodeurs bas debit
FR9510393 1995-09-05
PCT/FR1996/001347 WO1997009711A1 (fr) 1995-09-05 1996-09-04 Procede de quantification vectorielle de vocodeurs bas debit

Publications (2)

Publication Number Publication Date
EP0850470A1 true EP0850470A1 (de) 1998-07-01
EP0850470B1 EP0850470B1 (de) 1999-06-16

Family

ID=9482279

Family Applications (1)

Application Number Title Priority Date Filing Date
EP96930202A Expired - Lifetime EP0850470B1 (de) 1995-09-05 1996-09-04 Vektorquantisierungsverfahren für vokoder mit niedriger datenrate

Country Status (5)

Country Link
US (1) US6016469A (de)
EP (1) EP0850470B1 (de)
DE (1) DE69602963T2 (de)
FR (1) FR2738383B1 (de)
WO (1) WO1997009711A1 (de)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2778041A1 (fr) * 1998-04-24 1999-10-29 Thomson Csf Procede de neutrodynage du tube d'un emetteur
FR2788390B1 (fr) 1999-01-12 2003-05-30 Thomson Csf Emetteur de radiodiffusion en ondes courtes a haut rendement optimise pour les emissions de type numerique
FR2790343B1 (fr) 1999-02-26 2001-06-01 Thomson Csf Systeme pour l'estimation du gain complexe d'un canal de transmission
FR2799592B1 (fr) 1999-10-12 2003-09-26 Thomson Csf Procede de construction et de codage simple et systematique de codes ldpc
FR2815492B1 (fr) * 2000-10-13 2003-02-14 Thomson Csf Systeme et procede de radiodiffusion assurant une continuite de service
FR2826208B1 (fr) 2001-06-19 2003-12-05 Thales Sa Systeme et procede de transmission d'un signal audio ou phonie
FR2826492B1 (fr) * 2001-06-22 2003-09-26 Thales Sa Procede et systeme de pre et de post-traitement d'un signal audio pour la transmission sur un canal fortement perturbe
FR2832879B1 (fr) * 2001-11-23 2006-08-18 Thales Sa Procede et egalisation par segmentations des donnees
FR2832877B1 (fr) * 2001-11-23 2006-08-18 Thales Sa Procede et dispositif d'egalisation par blocs avec interpolation amelioree
FR2832880B1 (fr) * 2001-11-23 2004-04-09 Thales Sa Procede et dispositif d'egalisation par blocs avec adaptation au canal de transmission

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2283592A1 (fr) * 1974-08-27 1976-03-26 Thomson Csf Dispositif extracteur de synchronisation et systeme de transmission d'informations comportant un tel dispositif
FR2431229A1 (fr) * 1978-07-12 1980-02-08 Thomson Csf Dispositif de demodulation de signaux modules en deplacement de frequence et systeme de transmission comportant un tel dispositif
FR2546001B1 (fr) * 1983-05-10 1985-07-05 Thomson Csf Demodulateur de signaux, a enveloppe constante et phase continue, modules angulairement par un train de symboles binaires
FR2604318B1 (fr) * 1986-09-23 1989-03-31 Thomson Csf Procede et dispositif de synchronisation symbole et leur application a la demodulation symbole de messages numeriques
FR2605769B1 (fr) * 1986-10-22 1988-12-09 Thomson Csf Operateur polynomial dans les corps de galois et processeur de traitement de signal numerique comportant un tel operateur
FR2605818B1 (fr) * 1986-10-27 1992-09-18 Thomson Csf Codeur-decodeur algebrique de codes en blocs reed solomon et bch, applicable aux telecommunications numeriques
FR2607987B1 (fr) * 1986-12-05 1989-02-10 Thomson Csf Procede et dispositif de modulation et de demodulation a plusieurs etats, a niveau de protection ajustable
US4907276A (en) * 1988-04-05 1990-03-06 The Dsp Group (Israel) Ltd. Fast search method for vector quantizer communication and pattern recognition systems
FR2631147B1 (fr) * 1988-05-04 1991-02-08 Thomson Csf Procede et dispositif de detection de signaux vocaux
FR2631146B1 (fr) * 1988-05-04 1991-05-10 Thomson Csf Procede et dispositif de codage de l'energie du signal vocal dans des vocodeurs a tres faibles debits
FR2635420B1 (fr) * 1988-07-19 1990-10-19 Thomson Csf Procede et dispositif de demodulation de signaux a enveloppe constante et phase continue modules angulairement par un train de symboles binaires, tolerant les derives de frequence
FR2654542B1 (fr) * 1989-11-14 1992-01-17 Thomson Csf Procede et dispositif de codage de filtres predicteurs de vocodeurs tres bas debit.
FR2670313A1 (fr) * 1990-12-11 1992-06-12 Thomson Csf Procede et dispositif pour l'evaluation de la periodicite et du voisement du signal de parole dans les vocodeurs a tres bas debit.
US5182773A (en) * 1991-03-22 1993-01-26 International Business Machines Corporation Speaker-independent label coding apparatus
FR2678407A1 (fr) * 1991-06-28 1992-12-31 Philips Electronique Lab Procede et dispositif avec un reseau neuronal pour classer des donnees, et appareil d'authentification de signature.
FR2690551B1 (fr) * 1991-10-15 1994-06-03 Thomson Csf Procede de quantification d'un filtre predicteur pour vocodeur a tres faible debit.
JP3163185B2 (ja) * 1992-11-27 2001-05-08 株式会社東芝 パターン認識装置およびパターン認識方法
JP3042886B2 (ja) * 1993-03-26 2000-05-22 モトローラ・インコーポレーテッド ベクトル量子化器の方法および装置
US5715367A (en) * 1995-01-23 1998-02-03 Dragon Systems, Inc. Apparatuses and methods for developing and using models for speech recognition

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO9709711A1 *

Also Published As

Publication number Publication date
FR2738383B1 (fr) 1997-10-03
EP0850470B1 (de) 1999-06-16
US6016469A (en) 2000-01-18
FR2738383A1 (fr) 1997-03-07
DE69602963D1 (de) 1999-07-22
WO1997009711A1 (fr) 1997-03-13
DE69602963T2 (de) 1999-11-04

Similar Documents

Publication Publication Date Title
EP0782128B1 (de) Verfahren zur Analyse eines Audiofrequenzsignals durch lineare Prädiktion, und Anwendung auf ein Verfahren zur Kodierung und Dekodierung eines Audiofrequenzsignals
EP0608174B1 (de) System zur prädiktiven Kodierung/Dekodierung eines digitalen Sprachsignals mittels einer adaptiven Transformation mit eingebetteten Kodes
WO2005083889A1 (fr) Quantification vectorielle en dimension et resolution variables
FR2690551A1 (fr) Procédé de quantification d'un filtre prédicteur pour vocodeur à très faible débit.
EP1692689B1 (de) Optimiertes mehrfach-codierungsverfahren
EP0850470B1 (de) Vektorquantisierungsverfahren für vokoder mit niedriger datenrate
EP0511095B1 (de) Verfahren und Vorrichtung zur Kodierung und Dekodierung eines numerischen Signals
EP0428445B1 (de) Verfahren und Einrichtung zur Codierung von Prädiktionsfiltern in Vocodern mit sehr niedriger Datenrate
WO1996021218A1 (fr) Procede de codage de parole a analyse par synthese
CA2725799C (fr) Procede de traitement de donnees numeriques
EP1836699B1 (de) Verfahren und Vorrichtung zur Ausführung einer optimalizierten Audiokodierung zwischen zwei Langzeitvorhersagemodellen
FR2815457A1 (fr) Procede de codage de la prosodie pour un codeur de parole a tres bas debit
WO2023165946A1 (fr) Codage et décodage optimisé d'un signal audio utilisant un auto-encodeur à base de réseau de neurones
CA2725809A1 (fr) Procede de denombrement des vecteurs dans les reseaux reguliers de points
WO2011144863A1 (fr) Codage avec mise en forme du bruit dans un codeur hierarchique
FR2687871A1 (fr) Procede et dispositif de filtrage pour la reduction des preechos d'un signal audio-numerique.
EP0667680A1 (de) Verfahren und Vorrichtung zur vektoriellen Quantifizierung eines digitalen Signals, insbesondere geeignet zur Komprimierung von digitalen Bildern
EP1192619B1 (de) Audio-kodierung, dekodierung zur interpolation
WO2009050409A1 (fr) Procede, module et programme d'ordinateur avec quantification en fonction des vecteurs de gerzon
FR2658676A1 (fr) Dispositif de quantification a debit de codage numerique variable.
WO1991017541A1 (fr) Procede et dispositif de codage bas debit de la parole
EP1194923B1 (de) Verfahren und system für audio analyse und synthese
WO2024085955A1 (en) System and method for spectral pooling in streaming speech processing
GB2626841A (en) Voice audio compression using neural networks
WO2002029786A1 (fr) Procede et dispositif de codage segmental d'un signal audio

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 19980223

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): BE CH DE DK ES FI FR GB IT LI NL SE

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

17Q First examination report despatched

Effective date: 19980818

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): BE CH DE DK ES FI FR GB IT LI NL SE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: THE PATENT HAS BEEN ANNULLED BY A DECISION OF A NATIONAL AUTHORITY

Effective date: 19990616

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 19990616

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRE;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED.SCRIBED TIME-LIMIT

Effective date: 19990616

Ref country code: FI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 19990616

Ref country code: ES

Free format text: THE PATENT HAS BEEN ANNULLED BY A DECISION OF A NATIONAL AUTHORITY

Effective date: 19990616

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REF Corresponds to:

Ref document number: 69602963

Country of ref document: DE

Date of ref document: 19990722

GBT Gb: translation of ep patent filed (gb section 77(6)(a)/1977)

Effective date: 19990802

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 19990916

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 19990930

NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
BERE Be: lapsed

Owner name: THOMSON CSF

Effective date: 19990930

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed
PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20000930

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20000930

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: GB

Ref legal event code: IF02

REG Reference to a national code

Ref country code: FR

Ref legal event code: CD

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20090902

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20090827

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20091012

Year of fee payment: 14

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20100904

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20110531

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 69602963

Country of ref document: DE

Effective date: 20110401

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100930

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110401

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100904