EP2394271B1 - Procédé de séparation de cheminements de signaux et application de ce procédé pour améliorer la qualité de la voix d'un larynx électronique - Google Patents

Procédé de séparation de cheminements de signaux et application de ce procédé pour améliorer la qualité de la voix d'un larynx électronique Download PDF

Info

Publication number
EP2394271B1
EP2394271B1 EP10708882.5A EP10708882A EP2394271B1 EP 2394271 B1 EP2394271 B1 EP 2394271B1 EP 10708882 A EP10708882 A EP 10708882A EP 2394271 B1 EP2394271 B1 EP 2394271B1
Authority
EP
European Patent Office
Prior art keywords
signal
frequency
speech
time
carried out
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP10708882.5A
Other languages
German (de)
English (en)
Other versions
EP2394271A1 (fr
Inventor
Martin HAGMÜLLER
Gernot Kubin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Heimomed Heinze & Co KG GmbH
Original Assignee
Heimomed Heinze & Co KG GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Heimomed Heinze & Co KG GmbH filed Critical Heimomed Heinze & Co KG GmbH
Publication of EP2394271A1 publication Critical patent/EP2394271A1/fr
Application granted granted Critical
Publication of EP2394271B1 publication Critical patent/EP2394271B1/fr
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0316—Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude
    • G10L21/0364—Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude for improving intelligibility
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
    • G10L25/18—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being spectral information of each sub-band

Definitions

  • this algorithm adapts the subtraction parameters in the frequency domain based on auditory masking. It is assumed that speech and background noise are uncorrelated and therefore the background noise can be estimated and subtracted from the signal in the frequency domain.
  • WO 2006/099670 A1 a device for monitoring the airway is described, wherein sound in the audible frequency range is introduced into the respiratory tract of an object and from the reflected or processed sound, the state of the respiratory tract is determined. For example, it is possible to detect airway obstruction.
  • the exceeding of specific threshold values is checked by means of the FFT (fast Fourier transformation), from which conclusions are drawn regarding the treatment of the measured signal.
  • the implementation of the method according to the invention can be done for example by a software plug-in, as a hard-wired solution or as an analog circuit.
  • Fig. 2 shows a simplified model representation of the situation to which the inventive method for the suppression of a disturbing second signal 6 (see Fig. 1 ) is applied. It is readily apparent that in the method according to the invention there is no separation of signal sources, but of propagation paths.
  • the changes in the fundamental frequency must not be too large.
  • the frequency channels into which the signal is split would have to be expanded, or the filtering by means of a high-pass filter would have to start at a somewhat higher frequency.

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Quality & Reliability (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
  • Telephone Function (AREA)
  • Prostheses (AREA)

Claims (5)

  1. Procédé d'amélioration de la qualité vocale d'un appareil phonatoire du type électro-larynx (EL), dont le signal vocal S(w,t) est numérisé par des moyens appropriés, caractérisé par les étapes suivantes :
    a) subdivision d'un signal vocal S(w,t) mono-canal, qui est constitué de la somme des composantes d'une fraction variable dans le temps x(w)H(w,t), et d'une fraction invariable dans le temps x(w)F(w), en une série de canaux de fréquences, par la conversion du domaine temporel à un domaine discret de fréquences,
    b) filtrage de la fraction invariable dans le temps x(w)F(w) par filtrage de la fréquence de modulation 0 Hz au moyen d'un filtre passe-haut ou filtre coupe-bande à bande étroite dit filtre 'notch' dans chaque canal de fréquence, et
    c) transformation retour du signal vocal filtré, du domaine de fréquences au domaine temporel, et réunification en un signal de sortie mono-canal.
  2. Procédé selon la revendication 1, caractérisé en ce que la conversion du signal vocal dans l'étape a) s'effectue par une transformation de Fourier, et la transformation retour dans l'étape c) s'effectue par une transformation de Fourier inverse.
  3. Procédé selon la revendication 1, caractérisé en ce que la conversion du signal vocal dans l'étape a) et la synthèse des canaux de fréquences dans l'étape c), s'effectue à l'aide d'une banque de filtres.
  4. Procédé selon l'une des revendications 1 à 3, caractérisé en ce qu'une compression de signal est effectuée avant le filtrage dans l'étape b), et une décompression est effectuée après l'étape b).
  5. Procédé selon l'une des revendications 1 à 4, caractérisé en ce qu'un redressement des composantes de signal négatives est effectué avant la transformation retour dans l'étape c).
EP10708882.5A 2009-02-04 2010-02-01 Procédé de séparation de cheminements de signaux et application de ce procédé pour améliorer la qualité de la voix d'un larynx électronique Not-in-force EP2394271B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
AT0019309A AT507844B1 (de) 2009-02-04 2009-02-04 Methode zur trennung von signalpfaden und anwendung auf die verbesserung von sprache mit elektro-larynx
PCT/AT2010/000032 WO2010088709A1 (fr) 2009-02-04 2010-02-01 Procédé de séparation de cheminements de signaux et application de ce procédé pour améliorer la qualité de la voix d'un larynx électronique

Publications (2)

Publication Number Publication Date
EP2394271A1 EP2394271A1 (fr) 2011-12-14
EP2394271B1 true EP2394271B1 (fr) 2017-03-22

Family

ID=42272699

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10708882.5A Not-in-force EP2394271B1 (fr) 2009-02-04 2010-02-01 Procédé de séparation de cheminements de signaux et application de ce procédé pour améliorer la qualité de la voix d'un larynx électronique

Country Status (10)

Country Link
US (1) US20120004906A1 (fr)
EP (1) EP2394271B1 (fr)
JP (1) JP5249431B2 (fr)
CN (1) CN102341853B (fr)
AT (1) AT507844B1 (fr)
CA (1) CA2749617C (fr)
DK (1) DK2394271T3 (fr)
ES (1) ES2628521T3 (fr)
PT (1) PT2394271T (fr)
WO (1) WO2010088709A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105310806B (zh) * 2014-08-01 2017-08-25 北京航空航天大学 具有语音转换功能的电子人工喉系统及其语音转换方法
CN114051391B (zh) * 2019-09-24 2024-06-04 松下知识产权经营株式会社 菜谱输出方法、菜谱输出系统
WO2024158407A1 (fr) * 2023-01-24 2024-08-02 Rowan University Atténuation d'attaques acoustiques malveillantes sur des dispositifs informatiques à base vocale

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3746789A (en) * 1971-10-20 1973-07-17 E Alcivar Tissue conduction microphone utilized to activate a voice operated switch
US3872250A (en) * 1973-02-28 1975-03-18 David C Coulter Method and system for speech compression
US4139732A (en) * 1975-01-24 1979-02-13 Larynogograph Limited Apparatus for speech pattern derivation
US4343969A (en) * 1978-10-02 1982-08-10 Trans-Data Associates Apparatus and method for articulatory speech recognition
JPH03228097A (ja) * 1989-12-22 1991-10-09 Bridgestone Corp 振動制御装置
US5171930A (en) * 1990-09-26 1992-12-15 Synchro Voice Inc. Electroglottograph-driven controller for a MIDI-compatible electronic music synthesizer device
JPH08265891A (ja) * 1993-01-28 1996-10-11 Tatsu Ifukube 電気人工喉頭
JP3451022B2 (ja) * 1998-09-17 2003-09-29 松下電器産業株式会社 拡声音の明瞭度改善方法及び装置
US20050004604A1 (en) * 1999-03-23 2005-01-06 Jerry Liebler Artificial larynx using coherent processing to remove stimulus artifacts
US6359988B1 (en) 1999-09-03 2002-03-19 Trustees Of Boston University Process for introduce realistic pitch variation in artificial larynx speech
JP2001086583A (ja) * 1999-09-09 2001-03-30 Sentan Kagaku Gijutsu Incubation Center:Kk 代用原音発生器とその制御方法
US6975984B2 (en) 2000-02-08 2005-12-13 Speech Technology And Applied Research Corporation Electrolaryngeal speech enhancement for telephony
US7708697B2 (en) 2000-04-20 2010-05-04 Pulmosonix Pty Ltd Method and apparatus for determining conditions of biological tissues
US7191134B2 (en) * 2002-03-25 2007-03-13 Nunally Patrick O'neal Audio psychological stress indicator alteration method and apparatus
CA2399159A1 (fr) * 2002-08-16 2004-02-16 Dspfactory Ltd. Amelioration de la convergence pour filtres adaptifs de sous-bandes surechantilonnees
JP2007501957A (ja) * 2003-08-11 2007-02-01 ファクルテ ポリテクニーク デ モン 共振周波数を推定するための方法
US20050281412A1 (en) * 2004-06-16 2005-12-22 Hillman Robert E Voice prosthesis with neural interface
JP4568826B2 (ja) * 2005-09-08 2010-10-27 株式会社国際電気通信基礎技術研究所 声門閉鎖区間検出装置および声門閉鎖区間検出プログラム
CN100576320C (zh) * 2007-03-27 2009-12-30 西安交通大学 一种自动电子喉的电子喉语音增强系统与控制方法
US8311831B2 (en) * 2007-10-01 2012-11-13 Panasonic Corporation Voice emphasizing device and voice emphasizing method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
WO2010088709A1 (fr) 2010-08-12
ES2628521T3 (es) 2017-08-03
EP2394271A1 (fr) 2011-12-14
AT507844A1 (de) 2010-08-15
CA2749617A1 (fr) 2010-08-12
AT507844B1 (de) 2010-11-15
JP5249431B2 (ja) 2013-07-31
CA2749617C (fr) 2016-11-01
US20120004906A1 (en) 2012-01-05
CN102341853A (zh) 2012-02-01
DK2394271T3 (en) 2017-07-10
PT2394271T (pt) 2017-04-26
JP2012517031A (ja) 2012-07-26
CN102341853B (zh) 2014-06-04

Similar Documents

Publication Publication Date Title
DE69509555T2 (de) Verfahren zur veränderung eines sprachsignales mittels grundfrequenzmanipulation
DE102006051071B4 (de) Pegelabhängige Geräuschreduktion
DE69131095T2 (de) Verständlichkeitsverbesserungsanordnung für eine Beschallungsanlage
DE3871711T2 (de) Verfahren und geraet zur verbesserung der verstaendlichkeit von stimmen in hoher geraeuschumgebung.
DE102008031150B3 (de) Verfahren zur Störgeräuschunterdrückung und zugehöriges Hörgerät
EP2229010B1 (fr) Appareil auditif et procédé de compensation du bruit dans un appareil auditif
EP3074974B1 (fr) Dispositif de correction auditive avec modification de la fréquence fondamentale
WO2021114545A1 (fr) Procédé d'amélioration de son et système d'amélioration de son
EP3588498B1 (fr) Procédé de suppression d'une réverbération acoustique dans un signal audio
DE60016144T2 (de) Hörhilfegerät
EP2394271B1 (fr) Procédé de séparation de cheminements de signaux et application de ce procédé pour améliorer la qualité de la voix d'un larynx électronique
WO2001047335A2 (fr) Procede pour eliminer des composantes de signaux parasites dans un signal d'entree d'un systeme auditif, mise en oeuvre dudit procede et appareil auditif
DE602004006912T2 (de) Verfahren zur Verarbeitung eines akustischen Signals und ein Hörgerät
DE60033039T2 (de) Vorrichtung und verfahren zur unterdrückung von zischlauten unter verwendung von adaptiven filteralgorithmen
EP2584795B1 (fr) Procédé de détermination d'une ligne caractéristique de compression
WO2010078938A2 (fr) Procédé et dispositif de traitement de signaux acoustiques vocaux
DE102021205251B4 (de) Verfahren und Vorrichtung zur frequenzselektiven Verarbeitung eines Audiosignals mit geringer Latenz
DE102004008225B4 (de) Verfahren und Einrichtung zum Ermitteln von Merkmalsvektoren aus einem Signal zur Mustererkennung, Verfahren und Einrichtung zur Mustererkennung sowie computerlesbare Speichermedien
DE102009032238A1 (de) Verfahren zur Kontrolle der Anpassung eines Hörgerätes
DE102011006472B4 (de) Verfahren zur Verbesserung der Sprachverständlichkeit mit einem Hörhilfegerät sowie Hörhilfegerät
Yoo et al. Relative energy and intelligibility of transient speech information
EP3961624B1 (fr) Procédé de fonctionnement d'un dispositif auditif en fonction d'un signal vocal
WO2001018794A1 (fr) Accentuation spectrale de signaux acoustiques garantissant une meilleure reconnaissance de la parole
DE102022111300A1 (de) Vorrichtung zur Reduzierung des Rauschens bei der Wiedergabe eines Audiosignals mit einem Kopfhörer oder Hörgerät und entsprechendes Verfahren
DE102022201943A1 (de) Verfahren zur Unterdrückung eines akustischen Nachhalls in einem Audiosignal

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20110809

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20140214

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 502010013338

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G10L0021020000

Ipc: G10L0021036400

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 25/03 20130101ALN20160726BHEP

Ipc: G10L 25/18 20130101ALN20160726BHEP

Ipc: G10L 21/0364 20130101AFI20160726BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20161004

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 878472

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170415

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: PT

Ref legal event code: SC4A

Ref document number: 2394271

Country of ref document: PT

Date of ref document: 20170426

Kind code of ref document: T

Free format text: AVAILABILITY OF NATIONAL TRANSLATION

Effective date: 20170418

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502010013338

Country of ref document: DE

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20170705

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170622

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2628521

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20170803

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170622

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

REG Reference to a national code

Ref country code: GR

Ref legal event code: EP

Ref document number: 20170401309

Country of ref document: GR

Effective date: 20171023

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170722

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502010013338

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

26N No opposition filed

Effective date: 20180102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: LU

Payment date: 20180222

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20180314

Year of fee payment: 9

Ref country code: DK

Payment date: 20180228

Year of fee payment: 9

Ref country code: DE

Payment date: 20180226

Year of fee payment: 9

Ref country code: ES

Payment date: 20180314

Year of fee payment: 9

Ref country code: CH

Payment date: 20180228

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IE

Payment date: 20180226

Year of fee payment: 9

Ref country code: AT

Payment date: 20180226

Year of fee payment: 9

Ref country code: PT

Payment date: 20180123

Year of fee payment: 9

Ref country code: IT

Payment date: 20180223

Year of fee payment: 9

Ref country code: SE

Payment date: 20180228

Year of fee payment: 9

Ref country code: GR

Payment date: 20180221

Year of fee payment: 9

Ref country code: TR

Payment date: 20180131

Year of fee payment: 9

Ref country code: FR

Payment date: 20180227

Year of fee payment: 9

Ref country code: BE

Payment date: 20180226

Year of fee payment: 9

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20180201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180201

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 502010013338

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20190228

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: SE

Ref legal event code: EUG

REG Reference to a national code

Ref country code: NL

Ref legal event code: MM

Effective date: 20190301

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 878472

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190201

Ref country code: SE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190202

Ref country code: PT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190801

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190228

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190904

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190201

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190301

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190201

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190903

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190201

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20200327

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190202

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20100201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170322

Ref country code: MK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170322

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190201