EP0280827B1 - Pitch detection process and speech coder using said process - Google Patents

Pitch detection process and speech coder using said process Download PDF

Info

Publication number
EP0280827B1
EP0280827B1 EP87430006A EP87430006A EP0280827B1 EP 0280827 B1 EP0280827 B1 EP 0280827B1 EP 87430006 A EP87430006 A EP 87430006A EP 87430006 A EP87430006 A EP 87430006A EP 0280827 B1 EP0280827 B1 EP 0280827B1
Authority
EP
European Patent Office
Prior art keywords
samples
signal
pitch
value
block
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP87430006A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP0280827A1 (en
Inventor
Claude Galand
Michèle Rosso
Thierry Liethoudt
Philippe Elie
Emmanuel Lancon
Hubert Crepy
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Priority to EP87430006A priority Critical patent/EP0280827B1/en
Priority to ES198787430006T priority patent/ES2037101T3/es
Priority to DE8787430006T priority patent/DE3783905T2/de
Priority to JP63008601A priority patent/JP2505015B2/ja
Priority to US07/155,459 priority patent/US4924508A/en
Publication of EP0280827A1 publication Critical patent/EP0280827A1/en
Application granted granted Critical
Publication of EP0280827B1 publication Critical patent/EP0280827B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/90Pitch determination of speech signals

Definitions

  • This invention deals with methods for efficiently coding speech signals.
  • vocoder and Linear Prediction Coder are already known among which one may include so called vocoder and Linear Prediction Coder (LPC) families.
  • LPC Linear Prediction Coder
  • the vocoder family is based on deriving from the original speech signal a set of coefficients used to process the original speech signal and derive therefrom a residual signal.
  • a pitch information is then derived from the residual for voiced speech sections, otherwise the residual signal is simply made to be noise.
  • the correlative decoding process involves modulating back a synthesized pitch or noise signal by the coefficients.
  • the relative efficiency (quality versus bit rate) of such a coding scheme is rather poor unless performing a very precise determination of the pitch value. This already shows the significance of any efficient method for determining the pitch.
  • the LPC coder family provides valuable improvement to the coding/decoding operation.
  • Saving in computing complexity enables minimizing processor workload, while saving in bit rate is of major importance in voice transmission or in storage facilities.
  • VEPC Voice Excited Predictive Coder
  • MPE Multi-Pulse Excited Coder
  • RPE Regular Pulse Excited Coder
  • One object of this invention is thus to provide an efficient method for determining a voice pitch related information.
  • Another object of this invention is to provide a coder architecture wherein said pitch related information may be used to improve the speech signal coding scheme from an efficiency standpoint.
  • a digital process for determining a number representing pitch or an harmonic thereof and a digital speech coder are as claimed in claims 1 and 8, respectively.
  • the original speech signal is processed to derive therefrom a speech representative residual signal, compute residual prediction signal using long term prediction means adjusted by using pitch detection operations, then combine both current predicted residual to generate a residual error signal and code the latter using Pulse Excitation Coding techniques.
  • a significant improvement to the coding scheme efficiency is provided by detecting the pitch or an harmonic of said pitch (hereafter simply designated by pitch or pitch representative information or pitch related information) using dual-steps process including first a coarse pitch determination through peak detection, then followed by auto-correlation operations about the detected pitched peaks.
  • Figure 1 Block diagram of a Voice Coder using the invention.
  • Figure 2 speech representative waveforms.
  • FIGS 3 and 4 illustrations of the pitch detection process of the invention.
  • Figures 5 and 6 block diagrams of the coder.
  • Figure 7 block diagram of the decoder.
  • Figure 8 general block diagram for implementing the pitch determination.
  • Figure 9 block diagram of the algorithm for the selection of candidate values for pitch.
  • Figure 10 block diagram of the algorithm for the elimination of unsignificant values and averaging for the determination of the rough pitch value.
  • Figure 11 block diagram of the algorithm for the fine determination of the pitch value.
  • FIG. 1 Represented in figure 1 is a block diagram of a coder made to implement the invention.
  • the original speech signal s(n) sampled at Nyquist frequency and PCM encoded with 12 bits per sample is fed into an adaptive short term prediction filter (10) by consecutive blocks 160 samples long.
  • the filter equation in the z domain is of the form ⁇ a i . z -i (1)
  • the short term prediction filter is made of a conventional transversal digital filter the tap coefficients of which are the a i parameters.
  • the a i are derived by a step-up procedure in device 13 from so called PARCOR coefficients k(i) in turn derived from the original speech signal using a conventional Leroux-Guegen method and then coded with 28 bits using the Un/Yang algorithm.
  • PARCOR coefficients k(i) in turn derived from the original speech signal using a conventional Leroux-Guegen method and then coded with 28 bits using the Un/Yang algorithm.
  • the short term prediction filter is made to deliver a residual signal r(n) showing a relatively flat frequency spectrum, with some redundancy at a pitch related frequency.
  • a device (12) processes the residual signal to derive therefrom a pitch or harmonic representative data in other words, a pitch related information M and a gain parameter b to be used to adjust a long term prediction filter (14) performing the operations in the z domain as shown by the following equation. b.z -M (2)
  • the device for performing the operation of equation (2) should thus essentially include a delay line whose length should be dynamically adjusted to M (pitch or harmonic) and a gain device b. A more specific device will be described further.
  • a prediction residual signal output x(n) of the long term predictor filter is subtracted from the residual signal to derive a long term decorrelated prediction error signal e(n), which e(n) is then to be coded into sequences of pulses using any Pulse Excitation (PE) method.
  • PE Pulse Excitation
  • a PE device (16) is used to convert for instance each sub-group of 40 consecutive PCM encoded e(n) samples into a smaller number, say less than 15, of most significant pulses.
  • Either one of the MPE or RPE techniques could be used.
  • Lower the dynamic of e(n) is, more efficient its quantizing/coding at a given bit rate is.
  • M may either be representative of the pitch or of a pitch harmonic, i.e. it needs only be a pitch related parameter.
  • the new samples provided by device (16) are coded using two set of parameters, one characterizing each pulse position with respect to a significant reference, e.g. the beginning of the sub-block of forty samples being processed, the other one representing each pulse amplitude. Characterizing the pulse position is particularly critical and any error on said position would alter considerably the speech coding quality.
  • RPE the computing workload to be devoted to the pulses is lowered as compared to MPE but this assumes a slightly higher number of pulses (e.g. 13 to 15) is used to describe each sub-group of e(n) samples. Then a higher protection against line errors could be obtained with a lower number of bits.
  • each sub-group of 40 samples is split into interleaved sequences. For instance two 13 samples and one 14 samples long interleaved sequences.
  • the RPE device (16) is then made to select the one sequence among the three interleaved sequences again providing the least mean squared error. There is then no need to code each sample position. Identifying the selected sequence with two bits is sufficient. For further information on the RPE coding operation one may refer to the above cited Kroon reference.
  • the long term prediction associated with regular pulse excitation enables optimizing the overall bit rate versus quality parameter, more particularly when feeding the long term prediction filter (14) with a pulse train r ⁇ (n) as close as possible to r(n), i.e. wherein the coding noise and quantizing noise provided by device 16 and quantizer 20 have been compensated for.
  • decoding operations are performed in device (22) the output of which p ⁇ (n) is added to the predicted residual x(n) to provide a reconstructed residual r ⁇ (n) .
  • the closed loop structure around the RPE coder is made operable in real time by setting minimal and maximal limits to the pitch detection window as will be explained further.
  • LTP Long Term Predictor
  • b and M are determined four times over each block of 160 samples, using 40 samples (sub-window) and their 120 predecessors.
  • the device (12) fed with these data computes the long Term Prediction coefficient M as will be described later on and uses it to derive the gain coefficient b according to the following equation:
  • the method for determining M is essential not only to make the whole coder efficient from both quality and complexity standpoints, but also to make the long term prediction arrangement operable in real time. This is achieved by forcing M>N and by splitting the M determination process into two steps. A first step enabling a rough determination of a coarse pitch related M value requiring a fairly low computing power, is then followed by a fine M adjustment using auto-correlation methods over a limited number of values.
  • K being the sample rank index locating the peaks at multiples of rough M rate
  • Delta 5 for instance defining a number of sample locations about said pitched peaks.
  • the autocorrelation operation of equation (4) is operated between the 40 samples of sub-block (k) and 40 samples, the first of which is one of the autocorrelation zones samples, then jumping to the next autocorrelation zone. This enables thus saving on computing load.
  • the second step illustrated in figure 4 includes:
  • the value of Delta has been set to 5 and the autocorrelation zones limited to the three first coarse M spaced peaks.
  • a saving on data storage is achieved by using reconstructed shifted samples r'(n-k') instead of samples r(n-k') in relation (4) and by using samples r'(n) instead of samples r(n) in relation (3), as shown in figure 5.
  • Main Subroutine HPITCH deals with fine pitch and gain b determination through autocorrelation operations for fine pitch ( Figure 8).
  • FIG. 5 An implementation of Long Term Prediction filter (14) is represented in figure 5 (see figure 1 for similar references).
  • the reconstructed residual signal is fed into a 160 samples long delay line (or shift register) D L the output of which is fed into the LTP coefficients computing means(12) for further processing through cross-correlations with r(n).
  • a tap on the delay line DL is adjusted to the previously computed fine M value.
  • a gain factor b is applied to the data available on said tap, before being subtracted from r(n) as a residual prediction x(n) to generate e(n).
  • the long term predicted residual signal is thus subtracted from the residual signal to derive the error signal e(n) to be coded through Pulse Excitation device (16) before being quantized in quantizer (20).
  • Represented in figure 6 is a device implementing the RPE function as considered with the coder of figure 1.
  • the residual is low-pass filtered in (52) to a low bandwidth limited at 1,66 Khz.
  • each sub block of 40, x(n) samples is split in device (54) into three interleaved sequences X0, X1 and X2 as represented hereunder: Where "X" represents a non zero pulse taken among the x(n) samples.
  • the three pulse trains X0, X1 and X2 energies are computed, and the pulse train showing the highest energy is selected to represent the residual signal e(n) for the considered 40 samples long operating time window.
  • a two bits long parameter L is used to define the selected sequence X0, X1 or X2. This parameter is thus provided by the coder output four times every block of 160 samples.
  • the pulses selected are quantized into a sequence "X”. Therefore both L and "X" parameters define the e(n) coded signal.
  • block companded PCM techniques are used to encode the X sample sequence. These technique have been presented by A. Croisier et al in a presentation at the International Seminar on Digital Communications, Zurich 1974.
  • Each 40 samples long e(n) sequence is finally encoded into a characteristic term encoded with five bits and 13 or 14 samples each encoded with three bits.
  • the received data train is first demultiplexed in 70 to separate the various components (C, X, L, b, M and k(i) from each other.
  • C and X are used in a conventional BCPCM decoder to regenerate in (72) the e(n) pulse train the time position of which is adjusted with reference to the block time origin using the parameter L.
  • L enables setting an additional time delay to either zero, one or two sampling periods depending whether L indicates that the selected pulse train was X0 ⁇ , X1 or X2.
  • the decoded pulses p ⁇ (n) are then fed into an inverse long term prediction filter (74) the parameters of which are adjusted by b and M. These operations are performed every 40 samples, i.e. one sub-block window duration.
  • the inverse filter provides a decoded residual signal r ⁇ (n) fed into an inverse short term prediction filter (76) the coefficients of which are adjusted each 160 samples long period of time using the PARCOR coefficients k(i) (or the corresponding coefficients a(i)).
  • the decoded speech signal s ⁇ (n) is provided at the output of inverse short term filter (76).
  • the bits assignment have been made as follows: For each block of 20ms long speech signal section: which corresponds to a rate of 13 Kbps leaving 3 Kbps for error protection for a 16 Kbps coder.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
EP87430006A 1987-03-05 1987-03-05 Pitch detection process and speech coder using said process Expired - Lifetime EP0280827B1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
EP87430006A EP0280827B1 (en) 1987-03-05 1987-03-05 Pitch detection process and speech coder using said process
ES198787430006T ES2037101T3 (es) 1987-03-05 1987-03-05 Procedimiento de deteccion de tono y codificador de voz que utiliza dicho procedimiento.
DE8787430006T DE3783905T2 (de) 1987-03-05 1987-03-05 Verfahren zur grundfrequenzbestimmung und sprachkodierer unter verwendung dieses verfahrens.
JP63008601A JP2505015B2 (ja) 1987-03-05 1988-01-20 ピツチ検出方法
US07/155,459 US4924508A (en) 1987-03-05 1988-02-12 Pitch detection for use in a predictive speech coder

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP87430006A EP0280827B1 (en) 1987-03-05 1987-03-05 Pitch detection process and speech coder using said process

Publications (2)

Publication Number Publication Date
EP0280827A1 EP0280827A1 (en) 1988-09-07
EP0280827B1 true EP0280827B1 (en) 1993-01-27

Family

ID=8198298

Family Applications (1)

Application Number Title Priority Date Filing Date
EP87430006A Expired - Lifetime EP0280827B1 (en) 1987-03-05 1987-03-05 Pitch detection process and speech coder using said process

Country Status (5)

Country Link
US (1) US4924508A (es)
EP (1) EP0280827B1 (es)
JP (1) JP2505015B2 (es)
DE (1) DE3783905T2 (es)
ES (1) ES2037101T3 (es)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1990013112A1 (en) * 1989-04-25 1990-11-01 Kabushiki Kaisha Toshiba Voice encoder
US5105464A (en) * 1989-05-18 1992-04-14 General Electric Company Means for improving the speech quality in multi-pulse excited linear predictive coding
DE68914147T2 (de) * 1989-06-07 1994-10-20 Ibm Sprachcodierer mit niedriger Datenrate und niedriger Verzögerung.
US5097508A (en) * 1989-08-31 1992-03-17 Codex Corporation Digital speech coder having improved long term lag parameter determination
JPH03123113A (ja) * 1989-10-05 1991-05-24 Fujitsu Ltd ピッチ周期探索方式
DE9006717U1 (de) * 1990-06-15 1991-10-10 Philips Patentverwaltung GmbH, 22335 Hamburg Anrufbeantworter für die digitale Aufzeichnung und Wiedergabe von Sprachsignalen
US5528629A (en) * 1990-09-10 1996-06-18 Koninklijke Ptt Nederland N.V. Method and device for coding an analog signal having a repetitive nature utilizing over sampling to simplify coding
NL9001985A (nl) * 1990-09-10 1992-04-01 Nederland Ptt Werkwijze voor het coderen van een analoog signaal met een herhalend karakter en een inrichting voor het volgens deze werkwijze coderen.
US5765127A (en) * 1992-03-18 1998-06-09 Sony Corp High efficiency encoding method
US5495555A (en) * 1992-06-01 1996-02-27 Hughes Aircraft Company High quality low bit rate celp-based speech codec
JP2947685B2 (ja) * 1992-12-17 1999-09-13 シャープ株式会社 音声コーデック装置
JPH06250697A (ja) * 1993-02-26 1994-09-09 Fujitsu Ltd 音声符号化方法及び音声符号化装置並びに音声復号化方法及び音声復号化装置
US5659659A (en) * 1993-07-26 1997-08-19 Alaris, Inc. Speech compressor using trellis encoding and linear prediction
US5673364A (en) * 1993-12-01 1997-09-30 The Dsp Group Ltd. System and method for compression and decompression of audio signals
US5784532A (en) * 1994-02-16 1998-07-21 Qualcomm Incorporated Application specific integrated circuit (ASIC) for performing rapid speech compression in a mobile telephone system
AU725711B2 (en) * 1994-02-16 2000-10-19 Qualcomm Incorporated Block normalisation processor
JP3500690B2 (ja) 1994-03-28 2004-02-23 ソニー株式会社 オーディオピッチ抽出装置及びオーディオ処理装置
US5602961A (en) * 1994-05-31 1997-02-11 Alaris, Inc. Method and apparatus for speech compression using multi-mode code excited linear predictive coding
JP3601074B2 (ja) * 1994-05-31 2004-12-15 ソニー株式会社 信号処理方法及び信号処理装置
US5497337A (en) * 1994-10-21 1996-03-05 International Business Machines Corporation Method for designing high-Q inductors in silicon technology without expensive metalization
JP3409962B2 (ja) * 1996-03-04 2003-05-26 キッコーマン株式会社 生物発光試薬及びその試薬を用いたアデノシンリン酸エステルの定量法並びにその試薬を用いたatp変換反応系に関与する物質の定量法
JPH10105194A (ja) 1996-09-27 1998-04-24 Sony Corp ピッチ検出方法、音声信号符号化方法および装置
US5832443A (en) * 1997-02-25 1998-11-03 Alaris, Inc. Method and apparatus for adaptive audio compression and decompression
AU740951C (en) * 1997-04-16 2004-01-22 Emma Mixed Signal C.V. Method for Noise Reduction, Particularly in Hearing Aids
KR100578265B1 (ko) * 1997-07-11 2006-05-11 코닌클리케 필립스 일렉트로닉스 엔.브이. 개선된 고조파 스피치 인코더를 갖는 송신기
JP4641620B2 (ja) * 1998-05-11 2011-03-02 エヌエックスピー ビー ヴィ ピッチ検出の精密化
US6470311B1 (en) 1999-10-15 2002-10-22 Fonix Corporation Method and apparatus for determining pitch synchronous frames
US6917912B2 (en) * 2001-04-24 2005-07-12 Microsoft Corporation Method and apparatus for tracking pitch in audio analysis
EP1513137A1 (en) * 2003-08-22 2005-03-09 MicronasNIT LCC, Novi Sad Institute of Information Technologies Speech processing system and method with multi-pulse excitation
US8583772B2 (en) 2008-08-14 2013-11-12 International Business Machines Corporation Dynamically configurable session agent
US10249325B2 (en) 2016-03-31 2019-04-02 OmniSpeech LLC Pitch detection algorithm based on PWVT of Teager Energy Operator

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1170306A (en) * 1967-11-16 1969-11-12 Standard Telephones Cables Ltd Apparatus for Analysing Complex Waveforms
US3916105A (en) * 1972-12-04 1975-10-28 Ibm Pitch peak detection using linear prediction
US4015088A (en) * 1975-10-31 1977-03-29 Bell Telephone Laboratories, Incorporated Real-time speech analyzer
DE2621693C3 (de) * 1976-05-15 1979-09-13 Licentia Patent-Verwaltungs-Gmbh, 6000 Frankfurt Einrichtung zum Bestimmen der Grundperiode eines Sprachsignals aus dem bei Prädiktionsvocodern entstehenden Differenzsignal
JPS5918717B2 (ja) * 1979-02-28 1984-04-28 ケイディディ株式会社 適応形ピツチ抽出方式
GB2102254B (en) * 1981-05-11 1985-08-07 Kokusai Denshin Denwa Co Ltd A speech analysis-synthesis system
JPS6050720A (ja) * 1983-08-31 1985-03-20 Ricoh Co Ltd 磁気記録媒体
JPS60116000A (ja) * 1983-11-28 1985-06-22 ケイディディ株式会社 音声符号化装置
JPS62234435A (ja) * 1986-04-04 1987-10-14 Kokusai Denshin Denwa Co Ltd <Kdd> 符号化音声の復号化方式

Also Published As

Publication number Publication date
JP2505015B2 (ja) 1996-06-05
DE3783905D1 (de) 1993-03-11
EP0280827A1 (en) 1988-09-07
JPS63223799A (ja) 1988-09-19
DE3783905T2 (de) 1993-08-19
ES2037101T3 (es) 1993-06-16
US4924508A (en) 1990-05-08

Similar Documents

Publication Publication Date Title
EP0280827B1 (en) Pitch detection process and speech coder using said process
US5787391A (en) Speech coding by code-edited linear prediction
US4933957A (en) Low bit rate voice coding method and system
EP0331858B1 (en) Multi-rate voice encoding method and device
EP0392126B1 (en) Fast pitch tracking process for LTP-based speech coders
US5125030A (en) Speech signal coding/decoding system based on the type of speech signal
US5233660A (en) Method and apparatus for low-delay celp speech coding and decoding
US4860355A (en) Method of and device for speech signal coding and decoding by parameter extraction and vector quantization techniques
CA2166140C (en) Speech pitch lag coding apparatus and method
US5173941A (en) Reduced codebook search arrangement for CELP vocoders
US6246979B1 (en) Method for voice signal coding and/or decoding by means of a long term prediction and a multipulse excitation signal
EP0235180B1 (en) Voice synthesis utilizing multi-level filter excitation
EP0049271B1 (en) Predictive signals coding with partitioned quantization
US6169970B1 (en) Generalized analysis-by-synthesis speech coding method and apparatus
US6009388A (en) High quality speech code and coding method
EP0578436B1 (en) Selective application of speech coding techniques
EP0557940A2 (en) Speech coding system
Chen et al. Vector adaptive predictive coding of speech at 9.6 kb/s
CA1321025C (en) Speech signal coding/decoding system
US5673361A (en) System and method for performing predictive scaling in computing LPC speech coding coefficients
US6751585B2 (en) Speech coder for high quality at low bit rates
JP3168238B2 (ja) 再構成音声信号の周期性を増大させる方法および装置
EP0351479B1 (en) Low bit rate voice coding method and device
US6438517B1 (en) Multi-stage pitch and mixed voicing estimation for harmonic speech coders
EP0333425A2 (en) Speech coding

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): BE CH DE ES FR GB IT LI NL SE

17P Request for examination filed

Effective date: 19890117

17Q First examination report despatched

Effective date: 19910705

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): BE CH DE ES FR GB IT LI NL SE

ET Fr: translation filed
REF Corresponds to:

Ref document number: 3783905

Country of ref document: DE

Date of ref document: 19930311

ITF It: translation for a ep patent filed
REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2037101

Country of ref document: ES

Kind code of ref document: T3

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed
EAL Se: european patent in force in sweden

Ref document number: 87430006.4

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 19950308

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 19950331

Year of fee payment: 9

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 19960306

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Effective date: 19961001

NLV4 Nl: lapsed or anulled due to non-payment of the annual fee

Effective date: 19961001

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 19990301

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 19990629

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: BE

Payment date: 20000211

Year of fee payment: 14

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20000331

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20000331

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20010331

BERE Be: lapsed

Owner name: INTERNATIONAL BUSINESS MACHINES CORP.

Effective date: 20010331

REG Reference to a national code

Ref country code: GB

Ref legal event code: IF02

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20060303

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20060322

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20060328

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20060331

Year of fee payment: 20

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20070304

REG Reference to a national code

Ref country code: GB

Ref legal event code: PE20

EUG Se: european patent has lapsed
PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20060309

Year of fee payment: 20