EP1110203A1 - Device and method for digital voice processing - Google Patents
Device and method for digital voice processingInfo
- Publication number
- EP1110203A1 EP1110203A1 EP99947314A EP99947314A EP1110203A1 EP 1110203 A1 EP1110203 A1 EP 1110203A1 EP 99947314 A EP99947314 A EP 99947314A EP 99947314 A EP99947314 A EP 99947314A EP 1110203 A1 EP1110203 A1 EP 1110203A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- generating
- melody
- speech
- generated
- modifying
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/02—Methods for producing synthetic speech; Speech synthesisers
- G10L13/033—Voice editing, e.g. manipulating the voice of the synthesiser
Definitions
- the present invention relates to an apparatus and a method for digital speech processing or speech generation.
- Current systems for digital speech output have so far been used in environments in which a synthetic
- the present invention relates to a system which enables natural-looking speech to be generated synthetically.
- the commands built into the text stream can also contain information on the characteristics of the speaker (i.e. parameters of the speaker model).
- EP 0762384 describes a system in which these speaker characteristics can be entered on the screen on a graphical user interface.
- the speech synthesis is carried out using auxiliary information which is stored in a database (for example as a “waveform sequence” in EP 0831460).
- a database for example as a “waveform sequence” in EP 0831460.
- rules for pronunciation must nevertheless be present in the program
- the composition of the individual sequences leads to distortions and acoustic artifacts if no measures are taken to suppress them.
- this problem one speaks of "segmental quality” is considered to be largely solved today (cf. eg Volker Kraft: Linking natural language modules to Speech synthesis: requirements, techniques and evaluation (Progr.-Ber.VDI series 10 No. 468, VDI-Verlag 1997), but there are also a number of other problems with modern speech synthesis systems.
- One problem in digital speech output is, for example, the ability to speak multiple languages.
- the applications range from the creation of simple texts for multimedia applications to film settings (synchronization), radio plays and audio books.
- Text generated sentence melody can be modified using an editor.
- the starting point is the written text. However, in order to achieve sufficient (in particular prosodic) quality and to achieve dramaturgical effects, the user is given extensive options for intervention in a preferred embodiment.
- the user is in the role of the director, who defines the speakers on the system and specifies the rhythm and sentence melody, pronunciation and emphasis.
- the present invention also includes generating one
- Phonetic transcription for a written text and the provision of the possibility to modify the phonetic transcription generated, or to generate the phonetic transcription based on modifiable rules. This can be used, for example, to generate a special accent for a speaker.
- the invention comprises a dictionary device in which the words of one or more languages are stored together with their pronunciation. In the latter case, this enables multilingual capability, ie the processing of texts in different languages.
- the generated phonetic transcription or sentence melody is preferably edited using an easy-to-use editor, for example a graphical user interface.
- Speech processing includes speaker models, which can either be predefined or defined or modified by the user. Characteristics of different speakers can be realized, be it male or female voices, or different accents of a speaker, such as a Bavarian, Swabian or North German accent.
- the device consists of a dictionary in which the pronunciation of all words is also stored in phonetic transcription (if phonetic transcription is mentioned below, this means any phonetic transcription, such as the SAM PA notation, cf. e.g. "Multilingual speech input / output assessment, methodology and standardization, Standard computer-compatible transscription, pp 29-31, in Esprit Project 2589 (SAM) Fin. Report SAM-UCC-037", or the international phonetic script known from language teaching aids , see e.g. "The Principles of the International Phonetic Association: Adescription of the International Phonetic Alphabet and the Manner of Using it. International Phonetic Association, Dept, Phonetics, Univ.
- a translator who typed texts in phonetic transcription converts and generates a sentence melody
- an editor with which texts can be entered and speakers can be assigned and in which both the generated The phonetic spelling as well as the sentence melody can be displayed and changed
- an input module in which speaker models can be defined a system for digital speech generation that generates signals representing speech or data representing speech together with the sentence melody from the phonetic spelling and that in the Is able to process various speaker models, a system of digital filters and other devices (for reverb, echo, etc.) with which special effects can be generated, a sound archive, and a mixing device in which the generated Speech signals can be mixed together with sounds from the archive and effects can be added.
- the invention can either be implemented hybrid in software and hardware or entirely in software.
- the generated digital voice signals can be output via a special device for digital audio or via a PC sound card.
- FIG. 1 shows a block diagram of a device for digital speech generation according to an exemplary embodiment of the present invention.
- this consists of several individual components which can be implemented by means of one or more digital computing systems, the functioning and interaction of which is described in more detail below.
- the dictionary 100 consists of simple tables (one for each language) in which the words of a language are stored together with their pronunciation.
- the tables can be expanded to include additional words and their pronunciation.
- additional tables with different phonetic entries can also be created in one language.
- a table from the dictionary is assigned to each speaker.
- the translator 110 generates the phonetic script by using the
- Words of the entered text are replaced by their phonetic counterparts in the dictionary. If in the speaker model modifiers, the later more precisely are described, he uses them to modify the pronunciation.
- heuristics are e.g. the Fujisaki (1992) model or other acoustic methods, then the perceptual models, e.g. that of d'Aiessandro and Mertens (1995).
- These, but also older linguistic models are e.g. described in "Gold Dutoit: An Introduction to Text-to-Speech Synthesis, Kluwer 1997".
- segmentation setting breaks
- the user has an instrument in his hand with which he can enter and change pronunciation, intonation, emphasis, tempo, volume, pauses, etc.
- the translator responds to this assignment by adapting the phonetics and, if necessary, the prosody to the speaker model and generating new ones.
- the phonetics are displayed to the user in phonetic transcription, the prosody e.g. in a symbolism taken from the music (musical notation).
- the user then has the option of changing these specifications, listening to individual text sections and improving his entries again, etc.
- Speaker models 130 are, for example, parameterizations for speech generation.
- the models reproduce the characteristics of the human speech tract.
- the function of the vocal cords is represented by a pulse train, of which only the frequency (pitch) can be changed.
- the remaining characteristics (oral cavity, nasal cavity) of the speech tract are realized with digital filters.
- Your parameters are stored in the speaker model.
- Standard models are stored (child, young lady, old man, etc.). The user can generate additional models from them by selecting or changing the parameters appropriately and saving the model.
- the parameters stored here are used together with the prosody information for the intonation during the speech generation, which will be explained in more detail later.
- a speaker model can, for example, relate to the rules according to which the translator generates the phonetic transcription, different speaker models can operate according to different rules. However, it can also correspond to a specific set of filter parameters in order to process the speech signals in accordance with the speaker characteristics thus specified. Any combination of these two aspects of a speaker model is of course also conceivable.
- the task of the speech generation unit 140 is to create numerical information from the given text together with the additional phonetic and prosodic information generated by the translator and edited by the user
- This Data stream can then be converted by an output device 150, for example a digital audio device or a sound card in the PC, into analog sound signals, the text to be output.
- an output device 150 for example a digital audio device or a sound card in the PC
- a conventional text-to-speech can be used for speech generation
- Rule-based synthesizers work with rules for generating the
- Chain-based synthesizers are easier to use. You work with a database that stores all possible pairs of sounds. These can be easily linked, although high-quality systems require a lot of computing time. Such systems are described in “Gold Dutoit: An Introduction to Text-to-Speech Synthesis, Kluwer 1997” and in “Volker Kraft: Linking Natural Language Building Blocks for Speech Synthesis: Requirements, Techniques and Evaluation. Progress Report VDI Series 10 No. 468 , VDI-Verlag 1997 ".
- digital filters e.g. Bandpass filters for telephone effect
- Hall generators etc.
- Archives 170 contain sounds such as Street noise, railroad, kids shouting, ocean waves, background music etc. saved.
- the archive can be expanded with your own sounds.
- the archive can simply be a collection of files with digitized sounds, but it can also be a database in which the sounds are stored as blobs (binary large objects).
- the generated speech signals are assembled with the background noise.
- the volume of all signals can be regulated before assembling. It is also possible to add effects to each signal individually or all together.
- the result of the signal generated in this way can be transferred to a suitable device for digital audio 150, for example a sound card of a PC, and can thus be acoustically checked or output.
- a suitable device for digital audio 150 for example a sound card of a PC
- a sound card of a PC for example a sound card of a PC
- Storage device is provided to store the signal so that it can later be transferred to the target medium in a suitable manner.
- a device that is classically implemented in hardware can be used as a mixing device, or it can be implemented in software and integrated into the entire program.
- the output device 150 may be replaced by a further computer which is coupled to the mixing device 180 by means of a network connection.
- a network connection for example, a Computer network, such as the Internet, the voice signal generated are transferred to another computer.
- the speech signal generated by the speech generating device 140 can also be transmitted directly to the output device 150, without the detour via the mixing device 180. Further comparable modifications result in a relaxed manner for the person skilled in the art.
Abstract
Description
Claims
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE19841683A DE19841683A1 (en) | 1998-09-11 | 1998-09-11 | Device and method for digital speech processing |
DE19841683 | 1998-09-11 | ||
PCT/EP1999/006712 WO2000016310A1 (en) | 1998-09-11 | 1999-09-10 | Device and method for digital voice processing |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1110203A1 true EP1110203A1 (en) | 2001-06-27 |
EP1110203B1 EP1110203B1 (en) | 2002-08-14 |
Family
ID=7880683
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP99947314A Expired - Lifetime EP1110203B1 (en) | 1998-09-11 | 1999-09-10 | Device and method for digital voice processing |
Country Status (7)
Country | Link |
---|---|
EP (1) | EP1110203B1 (en) |
JP (1) | JP2002525663A (en) |
AT (1) | ATE222393T1 (en) |
AU (1) | AU769036B2 (en) |
CA (1) | CA2343071A1 (en) |
DE (2) | DE19841683A1 (en) |
WO (1) | WO2000016310A1 (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE10117367B4 (en) * | 2001-04-06 | 2005-08-18 | Siemens Ag | Method and system for automatically converting text messages into voice messages |
JP2002318593A (en) * | 2001-04-20 | 2002-10-31 | Sony Corp | Language processing system and language processing method as well as program and recording medium |
AT6920U1 (en) | 2002-02-14 | 2004-05-25 | Sail Labs Technology Ag | METHOD FOR GENERATING NATURAL LANGUAGE IN COMPUTER DIALOG SYSTEMS |
DE10207875A1 (en) * | 2002-02-19 | 2003-08-28 | Deutsche Telekom Ag | Parameter-controlled, expressive speech synthesis from text, modifies voice tonal color and melody, in accordance with control commands |
KR20070004788A (en) | 2004-03-05 | 2007-01-09 | 레삭 테크놀로지스 인코포레이티드. | Prosodic speech text codes and their use in computerized speech systems |
DE102004012208A1 (en) | 2004-03-12 | 2005-09-29 | Siemens Ag | Individualization of speech output by adapting a synthesis voice to a target voice |
DE102008044635A1 (en) | 2008-07-22 | 2010-02-04 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for providing a television sequence |
US10424288B2 (en) | 2017-03-31 | 2019-09-24 | Wipro Limited | System and method for rendering textual messages using customized natural voice |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS5695295A (en) * | 1979-12-28 | 1981-08-01 | Sharp Kk | Voice sysnthesis and control circuit |
FR2494017B1 (en) * | 1980-11-07 | 1985-10-25 | Thomson Csf | METHOD FOR DETECTING THE MELODY FREQUENCY IN A SPEECH SIGNAL AND DEVICE FOR CARRYING OUT SAID METHOD |
JPS58102298A (en) * | 1981-12-14 | 1983-06-17 | キヤノン株式会社 | Electronic appliance |
US4623761A (en) * | 1984-04-18 | 1986-11-18 | Golden Enterprises, Incorporated | Telephone operator voice storage and retrieval system |
US5559927A (en) * | 1992-08-19 | 1996-09-24 | Clynes; Manfred | Computer system producing emotionally-expressive speech messages |
JP3066452B2 (en) * | 1994-09-12 | 2000-07-17 | 株式会社アルカディア | Sound characteristic conversion device, sound / label association device, and methods thereof |
US5956685A (en) * | 1994-09-12 | 1999-09-21 | Arcadia, Inc. | Sound characteristic converter, sound-label association apparatus and method therefor |
DE19503419A1 (en) * | 1995-02-03 | 1996-08-08 | Bosch Gmbh Robert | Method and device for outputting digitally coded traffic reports using synthetically generated speech |
JPH08263094A (en) * | 1995-03-10 | 1996-10-11 | Winbond Electron Corp | Synthesizer for generation of speech mixed with melody |
EP0762384A2 (en) * | 1995-09-01 | 1997-03-12 | AT&T IPM Corp. | Method and apparatus for modifying voice characteristics of synthesized speech |
DE19610019C2 (en) * | 1996-03-14 | 1999-10-28 | Data Software Gmbh G | Digital speech synthesis process |
JP3616250B2 (en) * | 1997-05-21 | 2005-02-02 | 日本電信電話株式会社 | Synthetic voice message creation method, apparatus and recording medium recording the method |
US6226614B1 (en) * | 1997-05-21 | 2001-05-01 | Nippon Telegraph And Telephone Corporation | Method and apparatus for editing/creating synthetic speech message and recording medium with the method recorded thereon |
-
1998
- 1998-09-11 DE DE19841683A patent/DE19841683A1/en not_active Withdrawn
-
1999
- 1999-09-10 AT AT99947314T patent/ATE222393T1/en not_active IP Right Cessation
- 1999-09-10 CA CA002343071A patent/CA2343071A1/en not_active Abandoned
- 1999-09-10 EP EP99947314A patent/EP1110203B1/en not_active Expired - Lifetime
- 1999-09-10 AU AU60813/99A patent/AU769036B2/en not_active Ceased
- 1999-09-10 WO PCT/EP1999/006712 patent/WO2000016310A1/en active IP Right Grant
- 1999-09-10 DE DE59902365T patent/DE59902365D1/en not_active Expired - Fee Related
- 1999-09-10 JP JP2000570766A patent/JP2002525663A/en not_active Withdrawn
Non-Patent Citations (1)
Title |
---|
See references of WO0016310A1 * |
Also Published As
Publication number | Publication date |
---|---|
AU6081399A (en) | 2000-04-03 |
AU769036B2 (en) | 2004-01-15 |
JP2002525663A (en) | 2002-08-13 |
DE59902365D1 (en) | 2002-09-19 |
EP1110203B1 (en) | 2002-08-14 |
CA2343071A1 (en) | 2000-03-23 |
DE19841683A1 (en) | 2000-05-11 |
ATE222393T1 (en) | 2002-08-15 |
WO2000016310A1 (en) | 2000-03-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP0886853B1 (en) | Microsegment-based speech-synthesis process | |
DE60216069T2 (en) | LANGUAGE-TO-LANGUAGE GENERATION SYSTEM AND METHOD | |
DE69821673T2 (en) | Method and apparatus for editing synthetic voice messages, and storage means with the method | |
DE60112512T2 (en) | Coding of expression in speech synthesis | |
DE60035001T2 (en) | Speech synthesis with prosody patterns | |
DE4237563C2 (en) | Method for synthesizing speech | |
DE60118874T2 (en) | Prosody pattern comparison for text-to-speech systems | |
DE112004000187T5 (en) | Method and apparatus of prosodic simulation synthesis | |
EP3010014B1 (en) | Method for interpretation of automatic speech recognition | |
EP1105867B1 (en) | Method and device for the concatenation of audiosegments, taking into account coarticulation | |
EP1110203B1 (en) | Device and method for digital voice processing | |
EP0058130B1 (en) | Method for speech synthesizing with unlimited vocabulary, and arrangement for realizing the same | |
EP1344211B1 (en) | Device and method for differentiated speech output | |
DE60311482T2 (en) | METHOD FOR CONTROLLING DURATION OF LANGUAGE SYNTHESIS | |
JP2577372B2 (en) | Speech synthesis apparatus and method | |
EP3144929A1 (en) | Synthetic generation of a naturally-sounding speech signal | |
DE19837661C2 (en) | Method and device for co-articulating concatenation of audio segments | |
EP1212748A1 (en) | Digital speech synthesis method with intonation reproduction | |
WO2023222287A1 (en) | Speech synthesiser and method for speech synthesis | |
EP2325836A1 (en) | Method and system for training speech processing devices | |
DE10334105A1 (en) | Face animation parameters generation method in which a person's mood is determined from a spoken word or word sequence and then used to generate face animation parameters used in animating a graphical face image | |
Vanderslice et al. | Synthetic Intonation. | |
DE3314674A1 (en) | VOICE SYNTHESATOR WITH VARIABLE RATE | |
DE2306816A1 (en) | VOICE GENERATOR | |
WO2003034403A1 (en) | Method for image-assisted speech output |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20010322 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
17Q | First examination report despatched |
Effective date: 20011015 |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20020814 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED. Effective date: 20020814 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20020814 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20020814 |
|
REF | Corresponds to: |
Ref document number: 222393 Country of ref document: AT Date of ref document: 20020815 Kind code of ref document: T |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20020910 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: GERMAN |
|
REF | Corresponds to: |
Ref document number: 59902365 Country of ref document: DE Date of ref document: 20020919 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20020930 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20020930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20021114 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20021114 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20021202 |
|
GBT | Gb: translation of ep patent filed (gb section 77(6)(a)/1977) |
Effective date: 20021223 |
|
NLV1 | Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act | ||
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20030228 |
|
ET | Fr: translation filed | ||
BERE | Be: lapsed |
Owner name: *KULL HANS Effective date: 20020930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20030401 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: SCHMAUDER & PARTNER AG PATENTANWALTSBUERO |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IE Payment date: 20030730 Year of fee payment: 5 |
|
26N | No opposition filed |
Effective date: 20030515 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20030821 Year of fee payment: 5 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20030918 Year of fee payment: 5 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: AT Payment date: 20030922 Year of fee payment: 5 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20030923 Year of fee payment: 5 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20030930 Year of fee payment: 5 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20040910 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20040910 Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20040910 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20040930 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20040930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050401 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20040910 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050531 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST |