EP2590437B1 - Adaptation périodique d'un dispositif de suppression de l'effet Larsen - Google Patents

Adaptation périodique d'un dispositif de suppression de l'effet Larsen Download PDF

Info

Publication number
EP2590437B1
EP2590437B1 EP12190159.9A EP12190159A EP2590437B1 EP 2590437 B1 EP2590437 B1 EP 2590437B1 EP 12190159 A EP12190159 A EP 12190159A EP 2590437 B1 EP2590437 B1 EP 2590437B1
Authority
EP
European Patent Office
Prior art keywords
feedback
adaptation
activation
signal
step size
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP12190159.9A
Other languages
German (de)
English (en)
Other versions
EP2590437A1 (fr
Inventor
Sebastian Pape
Tobias Wurzbacher
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos Pte Ltd
Original Assignee
Siemens Medical Instruments Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Medical Instruments Pte Ltd filed Critical Siemens Medical Instruments Pte Ltd
Publication of EP2590437A1 publication Critical patent/EP2590437A1/fr
Application granted granted Critical
Publication of EP2590437B1 publication Critical patent/EP2590437B1/fr
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/45—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback
    • H04R25/453—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback electronically
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/02—Circuits for transducers, loudspeakers or microphones for preventing acoustic reaction, i.e. acoustic oscillatory feedback

Definitions

  • the present invention relates to a method for adapting a feedback suppression device of a hearing device to a predetermined situation by activating an adaptation process of the feedback suppression device and performing the adaptation process of the feedback suppression device. Moreover, the present invention relates to a corresponding feedback suppression device.
  • hearing device here is understood to mean any device which can be worn in or on the ear and triggers a stimulus, in particular a hearing device, a headset, headphones and the like.
  • Hearing aids are portable hearing aids that are used to care for the hearing impaired.
  • different types of hearing aids such as behind-the-ear hearing aids (BTE), hearing aid with external receiver (RIC: receiver in the canal) and in-the-ear hearing aids (IDO), e.g. Concha hearing aids or canal hearing aids (ITE, CIC).
  • BTE behind-the-ear hearing aids
  • RIC hearing aid with external receiver
  • IDO in-the-ear hearing aids
  • ITE canal hearing aids
  • the hearing aids listed by way of example are worn on the outer ear or in the ear canal.
  • bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.
  • Hearing aids have in principle as essential components an input transducer, an amplifier and an output transducer.
  • the input transducer is usually a sound receiver, z. As a microphone, and / or an electromagnetic receiver, for. B. an induction coil.
  • the output transducer is usually used as an electroacoustic transducer, z. As miniature speaker, or as an electromechanical transducer, z. B. bone conduction, realized.
  • the amplifier is standard integrated into a signal processing unit. This basic structure is in FIG. 1 shown using the example of a behind-the-ear hearing aid. In a hearing aid housing 1 for carrying behind the ear, one or more microphones 2 for receiving the sound from the environment are installed.
  • a signal processing unit 3 which is also integrated in the hearing aid housing 1, processes the microphone signals and amplifies them.
  • the output signal of the signal processing unit 3 is transmitted to a loudspeaker or earpiece 4, which outputs an acoustic signal.
  • the sound is optionally transmitted via a sound tube, which is fixed with an earmold in the ear canal, to the eardrum of the device carrier.
  • the power supply of the hearing device and in particular the signal processing unit 3 is effected by a likewise integrated into the hearing aid housing 1 battery. 5
  • the present invention can be applied not only to hearing devices, but generally to audio systems that include at least one microphone for receiving ambient sound, subsequent signal processing of the microphone signal (e.g., gain), and output of the processed signal by a transducer (e.g. Speakers) to the environment.
  • a hearing aid is, for example, such an audio system.
  • feedback whistling A very unpleasant condition of such an audio system is so-called "feedback whistling".
  • acoustic feedback arises when the sound emitted by the transducer again enters through the microphone in the audio system and is amplified there again. This results in a closed loop (microphone-> gain-> transducer-> microphone, etc.), and feedback whistling occurs when the gain exceeds a certain threshold.
  • an adaptive filter models the time-variant impulse response g of the acoustic feedback path.
  • k represents the discrete time index
  • x the input signal of the feedback cancellation system
  • e mc an error signal defined by the difference of the microphone signal m and the feedback compensation signal c
  • ⁇ the adaptation parameter step size parameter and * a conjugate complex operation.
  • FIG. 2 played.
  • the representation of the time dependence (discrete time index k) is dispensed with.
  • a desired signal s is picked up by a microphone 10. This results in the microphone signal m.
  • a signal processor 11 further processes the signal. From the microphone signal m, a compensation signal c is subtracted, whereby an error signal e is obtained.
  • This error signal e is supplied to a main processing unit 12 (eg, including a filter bank).
  • a main processing unit 12 eg, including a filter bank
  • the output signal x of the main processing unit 12 is supplied to a converter (eg loudspeaker 13) and to a feedback compensator 14.
  • the feedback compensator 14 (FBC), together with its specific circuitry, constitutes a feedback compensation device. It has the transfer function h, which serves as an estimate of the acoustic path g from the loudspeaker 13 to the microphone 10.
  • the feedback compensator 14 is controlled by the error signal e.
  • the acoustic signal a reaches not only the eardrum of the user but is, as already indicated, fed back via the feedback path 15 to the microphone 10.
  • This feedback path 15 has the said transfer function g.
  • the parameter ⁇ is also called step size. With it, the adaptation speed of a filter can be controlled. A suitable, time-dependent control of the step size ⁇ is important for effective and stable feedback suppression. When ⁇ is large, the filter quickly adapts to changes in the position of the acoustic feedback path g, thereby preventing feedback whistles. Otherwise, if the step size is constantly too high, mis-adaptation to tonal signals (eg, music) may result.
  • tonal signals eg, music
  • ⁇ opt ⁇ E ⁇
  • the above formula helps to stabilize the adaptation, but it does not help to solve the above problem, to find a suitable step to avoid mis-adaptions.
  • the adaptation In a normal mode, the adaptation is "frozen" in that the step size ⁇ has a very small value. Adaptation is only allowed when the feedback detector becomes active, indicating a change in the acoustic feedback path (g). Consequently, the need for a new adaptation of the feedback suppression filter with the transfer function h is triggered by the temporal increase of the step size parameter ⁇ . On the one hand, freezing the adaptation guarantees stability (no mis-adaptions for tonal excitation signals) unless the feedback detector is activated in error. On the other hand - and this is a massive drawback - the feedback suppression device only adapts when the feedback detector becomes active at all.
  • the acoustic feedback path (g) changes only slightly (eg when passing through a door or when sitting in a couch). This usually leads to no feedback detection. Since there is no adaptation, the instantaneous transfer function h of the feedback cancellation system does not represent the current acoustic path (g), resulting in an audible, rougher sound quality. The reduced soundness will continue until the feedback detector becomes active, which is usually accompanied by a feedback whistle. As a countermeasure, the sensitivity of the feedback detector could be adjusted so that even minor changes in the acoustic path are detected. However, this leads to increased erroneous feedback detections and thus to more artifacts.
  • FIG. 3 A corresponding scenario is in FIG. 3 shown.
  • the block diagram shown is based essentially on that of FIG. 2 , Reference is made in this regard to the above description.
  • a feedback detector 16 FD
  • Step size control unit 17 SWS
  • the step size ⁇ is therefore not here as in the example of FIG. 2 controlled by the error signal e.
  • the feedback compensator 14 receives the error signal e as well as the step size control unit 17.
  • the latter receives the compensation signal c of the feedback capacitor 14 as a further input variable.
  • the US 2011/0164762 A1 describes a method for feedback suppression of an amplifier by phase shifting and a feedback suppression device.
  • the input signal is processed with an input frequency such that the output signal has the same amplitude, but an additional phase, which varies in particular temporally.
  • the US 2006/0008076 A1 describes an adaptive feedback suppression unit for amplifier systems installed in halls or auditoriums with a plurality of adaptive filters designed to update the respective filter coefficients in intervals of different lengths, the updating of the filter coefficients of the respective filter continuing to be periodic.
  • the US 2008/0279395 A1 discloses a method of feedback suppression in which an input signal is combined with a feedback signal estimated by a feedback estimator by an adder, and an input signal Frequency shift unit is supplied. At least a portion of this signal is subsequently amplified by an amplifier and combined with the unamplified output of the frequency shifting unit and output as an output.
  • the frequency shift unit is activated only from time to time, eg periodically.
  • the US 2007/0258579 A1 discloses a method for stereo reverberation cancellation for teleconferencing systems.
  • the object of the present invention is therefore to reduce artifacts in the automatic adaptation of feedback suppression devices.
  • this object is achieved by a method as in claim 1 and a corresponding device as in claim 5.
  • the adaptation process of the feedback suppression device is activated periodically. It can thus be ensured that adaptations of the feedback suppression system take place even in the case of minor path changes in which the feedback detector does not respond.
  • the adaptation is not always immediate, but at least in the foreseeable future.
  • an adaptive filter with a variable step size is adapted. This allows the adaptation to be carried out faster and less quickly as required.
  • the activation of the adaptation process takes place with a periodic activation signal which has more than two values, the values being changed as a function of a current hearing situation. Ie. the activation signal can also have several states (multiple discrete states) or even have a steady course. Thus, so-called soft decisions for the initiation of the adaptation process are possible.
  • the activation of the adaptation process can take place in that the step size is increased by leaps and bounds.
  • the erratic increase leads to a short mismatch, which initiates an immediate readjustment.
  • the adaptation process can also be activated by a feedback detector in parallel or independently of the periodic activation if a feedback is detected by it. As a result, it can also be adapted as required during a predetermined trigger period.
  • the duration of the on state or the time duration between two temporally successive individual states can be changed as a function of a current auditory situation.
  • a current hearing situation can be represented by a classification result of a classifier. Depending on this, then a "high” state and / or a "low” state is changed in its duration.
  • a frequency-shifting algorithm or a frequency-compression algorithm may be used to be started. This further improves the stability of the feedback suppression.
  • the feedback cancellation can be used in any audio system and in particular in any hearing device, especially in hearing aids.
  • the adaptation is frozen in known systems by the step size ⁇ is chosen to be very small for the adaptation.
  • the step size ⁇ is periodically set to a higher or predetermined high value. This increase in the step size independent of the current acoustic situation leads to a spontaneous readjustment of the feedback suppression. This means that the feedback suppression is transferred from a frozen state to an adaptation state.
  • This periodic triggering of the adaptation can be used in addition to or in parallel with existing step size control methods.
  • FIG. 4 A schematic block diagram of a system with inventive feedback suppression device is shown in FIG. 4 played. This figure also reproduces corresponding method steps for adapting the feedback suppression.
  • the basis is the system of FIG. 3 , It is with regard to the system according to the invention thus expressly to the description of FIG. 3 respectively.
  • FIG. 2 pointed. Same components have in FIG. 3 and in FIG. 4 The same reference numerals and they also exercise the same function, unless otherwise described.
  • FIG. 4 shows that in the signal processing device 11 of the hearing device, an additional activation device 18 is located. Its output signal is supplied to the step size controller 17.
  • the activation device 18 is formed in the simplest case so that it is a periodic binary signal 19 with unchanged structure. This binary signal 19 has only two different states, namely an on state (eg "high”) and an off state (eg "low”). As soon as the activation signal 19 is in the on state or on an edge from the off state to the on state, the step size ⁇ in the step size control 17 for the feedback compensator 14 (jump) is increased significantly.
  • the activation device 18 can also be designed such that it generates other activation signals 20, 21. It can generate only one of these activation signals 19 to 21 or even several of them.
  • activation signal 20 in which the signal period is variable, and called the activation signal 21, which is not purely binary and can also assume intermediate values.
  • the activation device 18 is actuated by other components of the signal processing device 11 in order to change the activation signal to be output as a function of current signal processing variables. Such driving possibilities are in FIG. 4 not shown.
  • the activation signal (activation trigger) for the step size ⁇ z. B. is "low” (OFF state)
  • the feedback suppression device remains in the frozen state.
  • the activation signal is "high”
  • the filter adapts to the feedback suppression device so that it adapts to the current acoustic feedback situation (g).
  • the periodic enable signal is in a "low” state and the feedback detector 16 becomes active, the step size ⁇ is also adapted.
  • the step size control of the feedback suppression device is thus triggered periodically.
  • the filter coefficients are renewed from time to time, which softens the frozen state somewhat.
  • the feedback detector it is not absolutely necessary for the feedback detector to detect a corresponding feedback event.

Claims (5)

  1. Procédé d'adaptation d'un dispositif de suppression de l'effet Larsen d'un dispositif auditif sur une situation prescrite par
    - adaptation périodique d'un processus d'adaptation du dispositif de suppression de l'effet Larsen et
    - exécution du processus d'adaptation du dispositif de suppression de l'effet Larsen, dans lequel lors du processus d'adaptation un filtre adaptatif pour s'adapter aux variations de situation d'un trajet de rétroaction acoustique (g) est adapté, dans lequel le filtre adaptatif présent un incrément variable, qui commande la vitesse d'adaptation du filtre adaptatif,
    caractérisé en ce que
    l'activation a lieu avec un signal d'activation (21) périodique, n'étant pas purement binaire, qui présente plus de deux valeurs et dans lequel les valeurs sont modifiées en fonction d'une situation auditive actuelle.
  2. Procédé selon la revendication 1, dans lequel l'activation est effectuée en augmentant par à-coups l'incrément.
  3. Procédé selon une des revendications précédentes, dans lequel le processus d'adaptation est activé en parallèle à l'activation périodique par un détecteur d'effet Larsen (16), quand un effet Larsen a été détecté par ce dernier.
  4. Procédé selon une des revendications précédentes, dans lequel avec l'activation du processus d'adaptation du dispositif de suppression d'effet Larsen, un algorithme de décalage de fréquence ou un algorithme de compression de fréquence est démarré.
  5. Procédé de suppression de l'effet Larsen pour un dispositif auditif comportant :
    - un dispositif d'adaptation pour adapter le dispositif de suppression d'effet Larsen à une situation prescrite et
    - une unité d'activation (18) pour activer le dispositif d'adaptation,
    - dans lequel le dispositif d'adaptation est activable périodiquement avec le dispositif d'activation (18),
    - dans lequel lors du processus d'adaptation un filtre adaptatif pour s'adapter aux variations de situation d'un trajet de rétroaction acoustique (g) peut être adapté, dans lequel le filtre adaptatif présente un incrément variable, qui commande la vitesse d'adaptation du filtre adaptatif,
    caractérisée en ce que
    l'unité d'activation (18) est réalisée de telle sorte que l'activation a lieu avec un signal d'activation (21) périodique, n'étant pas purement binaire, qui présente plus de deux valeurs, dans lequel les valeurs sont modifiables en fonction d'une situation auditive actuelle.
EP12190159.9A 2011-11-03 2012-10-26 Adaptation périodique d'un dispositif de suppression de l'effet Larsen Not-in-force EP2590437B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102011085668 2011-11-03

Publications (2)

Publication Number Publication Date
EP2590437A1 EP2590437A1 (fr) 2013-05-08
EP2590437B1 true EP2590437B1 (fr) 2015-09-23

Family

ID=47594258

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12190159.9A Not-in-force EP2590437B1 (fr) 2011-11-03 2012-10-26 Adaptation périodique d'un dispositif de suppression de l'effet Larsen

Country Status (3)

Country Link
US (1) US8861759B2 (fr)
EP (1) EP2590437B1 (fr)
DK (1) DK2590437T3 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016226112A1 (de) 2016-12-22 2018-06-28 Sivantos Pte. Ltd. Verfahren zum Betrieb eines Hörgerätes

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6418227B1 (en) * 1996-12-17 2002-07-09 Texas Instruments Incorporated Active noise control system and method for on-line feedback path modeling
JP3506138B2 (ja) * 2001-07-11 2004-03-15 ヤマハ株式会社 複数チャンネルエコーキャンセル方法、複数チャンネル音声伝送方法、ステレオエコーキャンセラ、ステレオ音声伝送装置および伝達関数演算装置
KR101045712B1 (ko) * 2004-01-29 2011-06-30 엔엑스피 비 브이 반향 제거 방법 및 장치
JP4297003B2 (ja) * 2004-07-09 2009-07-15 ヤマハ株式会社 適応ハウリングキャンセラ
US8477952B2 (en) * 2005-04-27 2013-07-02 Oticon A/S Audio system with feedback detection means
AU2005232314B2 (en) * 2005-11-11 2010-08-19 Phonak Ag Feedback compensation in a sound processing device
DE102006029194B4 (de) 2006-06-26 2010-04-15 Siemens Audiologische Technik Gmbh Vorrichtung und Verfahren zur Schrittweitensteuerung eines adaptiven Filters
EP2086250B1 (fr) 2008-02-01 2020-05-13 Oticon A/S Système d'écoute avec système d'annulation de rétroaction acoustique amélioré, procédé et utilisation
US8571244B2 (en) * 2008-03-25 2013-10-29 Starkey Laboratories, Inc. Apparatus and method for dynamic detection and attenuation of periodic acoustic feedback
JP2010004149A (ja) * 2008-06-18 2010-01-07 Yamaha Corp ハウリング防止装置
DE102009016845B3 (de) * 2009-04-08 2010-08-05 Siemens Medical Instruments Pte. Ltd. Anordnung und Verfahren zur Erkennung von Rückkopplungen bei Hörvorrichtungen
DE102010006154B4 (de) 2010-01-29 2012-01-19 Siemens Medical Instruments Pte. Ltd. Hörgerät mit Frequenzverschiebung und zugehöriges Verfahren

Also Published As

Publication number Publication date
US20130114837A1 (en) 2013-05-09
US8861759B2 (en) 2014-10-14
EP2590437A1 (fr) 2013-05-08
DK2590437T3 (da) 2016-01-11

Similar Documents

Publication Publication Date Title
EP3451705B1 (fr) Procédé et dispositif de reconnaissance rapide de voix propre
EP1379102B1 (fr) Localisation du son avec des prothèses auditives binauriculaires
EP1307072A2 (fr) Procédé pour actionner une prothèse auditive et prothèse auditive
EP2991379B1 (fr) Procede et dispositif de perception amelioree de sa propre voix
EP2988529B1 (fr) Frequence de division adaptative dans appareils d'aide auditive
DE102015216822B4 (de) Verfahren zur Unterdrückung einer Rückkopplung in einem Hörgerät
DE102007017761A1 (de) Verfahren zur Anpassung eines binauralen Hörgerätesystems
EP2070384B1 (fr) Appareil de correction auditive commandé par un modèle perceptif et procédé correspondant
DE102011006129B4 (de) Hörvorrichtung mit Rückkopplungsunterdrückungseinrichtung und Verfahren zum Betreiben der Hörvorrichtung
EP1906702B2 (fr) Procédé destiné au contrôle de commande d'un dispositif auditif et dispositif auditif correspondant
EP2200345A1 (fr) Procédé de sélection d'une direction préférentiel d'un microphone directionnel et dispositif auditif correspondant
EP2161949A2 (fr) Procédé de fonctionnement d'un dispositif auditif ayant une directivité et dispositif auditif correspondant
DE102014218672B3 (de) Verfahren und Vorrichtung zur Rückkopplungsunterdrückung
EP2373063B1 (fr) Dispositif auditif et procédé de réglage de celui-ci pour un fonctionnement sans contre-réaction
EP2590437B1 (fr) Adaptation périodique d'un dispositif de suppression de l'effet Larsen
EP2658289B1 (fr) Procédé de commande d'une caractéristique de guidage et système auditif
EP2023667A2 (fr) Procédé de réglage d'un système auditif doté d'un modèle perceptif pour oreilles binaurales et système auditif correspondant
DE602004010317T2 (de) Verfahren zum Betreiben eines Hörhilfegerätes und Hörhilfegerät
DE102019201879B3 (de) Verfahren zum Betrieb eines Hörsystems und Hörsystem
EP2262282A2 (fr) Procédé de détermination d'une réponse de fréquence d'un dispositif auditif et dispositif auditif correspondant
DE102010007336B4 (de) Verfahren zum Kompensieren eines Rückkopplungssignals und Hörvorrichtung
EP2592850B1 (fr) Activation et désactivation automatiques d'un système auditif binaural
DE102020201615B3 (de) Hörsystem mit mindestens einem im oder am Ohr des Nutzers getragenen Hörinstrument sowie Verfahren zum Betrieb eines solchen Hörsystems
EP2362687A2 (fr) Dispositif auditif avec réduction de contre-réaction par filtres actionnés parallèlement et procédé correspondant
DE102007030067B4 (de) Hörgerät mit passiver, eingangspegelabhängiger Geräuschreduktion und Verfahren

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20131021

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

17Q First examination report despatched

Effective date: 20131213

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150504

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 751783

Country of ref document: AT

Kind code of ref document: T

Effective date: 20151015

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 4

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502012004674

Country of ref document: DE

RAP2 Party data changed (patent owner data changed or rights of a patent transferred)

Owner name: SIVANTOS PTE. LTD.

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 502012004674

Country of ref document: DE

Representative=s name: FDST PATENTANWAELTE FREIER DOERR STAMMLER TSCH, DE

REG Reference to a national code

Ref country code: DE

Ref legal event code: R083

Ref document number: 502012004674

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20160107

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20150923

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151223

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151224

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160123

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160125

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502012004674

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20160624

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151026

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20121026

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151026

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150923

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 751783

Country of ref document: AT

Kind code of ref document: T

Effective date: 20171026

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171026

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20181025

Year of fee payment: 7

Ref country code: DE

Payment date: 20181024

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20181023

Year of fee payment: 7

Ref country code: CH

Payment date: 20181025

Year of fee payment: 7

Ref country code: GB

Payment date: 20181025

Year of fee payment: 7

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 502012004674

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20191031

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191031

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191031

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200501

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20191026

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191031

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191026

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191031