EP2506602B1 - Hörhilfegerät sowie Verfahren zum Betrieb eines Hörhilfegeräts - Google Patents

Hörhilfegerät sowie Verfahren zum Betrieb eines Hörhilfegeräts Download PDF

Info

Publication number
EP2506602B1
EP2506602B1 EP12159057.4A EP12159057A EP2506602B1 EP 2506602 B1 EP2506602 B1 EP 2506602B1 EP 12159057 A EP12159057 A EP 12159057A EP 2506602 B1 EP2506602 B1 EP 2506602B1
Authority
EP
European Patent Office
Prior art keywords
gain
signal
hearing aid
frequency
input signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP12159057.4A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP2506602A3 (de
EP2506602A2 (de
Inventor
Sebastian Pape
Maja Dr. Serman
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos Pte Ltd
Original Assignee
Sivantos Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sivantos Pte Ltd filed Critical Sivantos Pte Ltd
Publication of EP2506602A2 publication Critical patent/EP2506602A2/de
Publication of EP2506602A3 publication Critical patent/EP2506602A3/de
Application granted granted Critical
Publication of EP2506602B1 publication Critical patent/EP2506602B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/45—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback
    • H04R25/453—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback electronically
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/78—Detection of presence or absence of voice signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility

Definitions

  • the invention relates to a hearing aid according to the preamble of claim 1 and to a method for operating a hearing aid according to the preamble of claim 5.
  • the US 2011/004 468 A1 discloses a hearing aid according to the preamble of claim 1 and a method for operating a hearing aid according to the preamble of claim 5.
  • the EP 1 175 125 A2 relates to an adaptive gain and filter circuit and discloses an adaptive filter circuit for use in a hearing aid by a person having a hearing impairment comprising a predetermined frequency range.
  • the filter circuit comprises a variable filter and an amplifier having a bandwidth corresponding to the predetermined frequency range of the hearing impairment.
  • the DE 10 2009 032 238 A1 discloses a method of controlling the fitting of a hearing aid having a filter bank for spectrally selective amplification and dynamic compression of audio signals to a hearing deficit of a hearing aid wearer.
  • This document describes a maximum possible by means of the hearing aid amplification in the upper frequency bands and a feedback whistle that uses in unfavorable constructions or leaks in the earmold even at low gains, which are too low for a sufficient amplification of frikativischen energies.
  • the maximum achievable with a hearing aid gain are usually by the required, small size of the devices and the small distance between the input transducer (especially microphone) and output transducer (especially listener) set narrow limits. If the gain is too high, especially the extremely annoying feedback whistling occurs.
  • the feedback tendency of a hearing aid is frequency-dependent and usually affects the upper range of the transferable from a hearing aid frequency range.
  • a method for frequency transposition in a hearing aid device and a hearing aid device for carrying out a frequency transposition are disclosed in the document EP 1 441 562 A2 known.
  • the frequency transposition has two major disadvantages: on the one hand spectrally the destruction of the original spectral
  • a method for automatic gain adjustment in a hearing aid in which a speech signal level and a noise level is determined in several frequency bands of an input signal during operation. There is an automatic adjustment of the gain as a function of the detected signal level and the signal frequency.
  • gain parameters are determined by including a loudness model and a speech intelligibility model.
  • WO 00/05923 From the WO 00/05923 is a hearing aid with improved speech intelligibility by frequency-selective signal processing and a method for operating such a hearing aid known.
  • Object of the present invention is to understand the language of hearing loss, in which certain frequency ranges are no longer perceived even at high volume can improve.
  • This object is achieved by a hearing aid according to claim 1 and by a method for operating a hearing aid according to claim 5.
  • a hearing aid device is understood to mean any device which provides or helps to provide an output signal perceptible by a user as an audible signal, and which has means which help or compensate for an individual hearing loss of the user.
  • acts this is a hearing aid which can be worn on the body or on the head, in particular on or in the ear, and which can be implanted in whole or in part.
  • such devices are also included, whose primary purpose is not to compensate for hearing loss, such as consumer electronics (TVs, hi-fi systems, MP3 players, etc.), or communication devices (mobile phones, PDAs, headsets etc), but over Have means to compensate for an individual hearing loss.
  • a hearing aid generally includes an input transducer for receiving an input signal.
  • the input transducer is designed, for example, as a microphone which picks up an acoustic signal and converts it into an electrical input signal.
  • input transducers are also units into consideration, which have a coil or an antenna and receive an electromagnetic signal and convert it into an electrical input signal.
  • a hearing aid usually includes a signal processing unit for processing and frequency-dependent amplification of the electrical input signal.
  • a preferably digital signal processor (DSP) is used, whose operation can be influenced by means of programs or parameters which can be transmitted to the hearing aid.
  • the mode of operation of the signal processing unit can be adapted both to the individual hearing loss of a hearing aid wearer and to the current hearing situation in which the hearing aid is currently being operated.
  • the thus changed electrical input signal is finally fed to an output transducer.
  • This is usually designed as a handset, which converts the electrical output signal into an acoustic signal.
  • other embodiments are also possible here, e.g. an implantable output transducer that connects directly to an auditory ossicle and causes it to vibrate.
  • the gain is adjusted to compensate for a user's individual hearing loss becomes.
  • the gain required for this is usually dependent on the signal frequency.
  • the maximum adjustable gain physical limits are set, on the one hand result from the technical possibilities of the hearing aid used and on the other hand serve to avoid feedback. Feedbacks usually occur in the upper frequency range that can be transmitted by a hearing aid.
  • many hearing aid wearers have a large amount of hearing loss in this frequency range, which would require a high gain to compensate.
  • the gain in a respective frequency range is set so that the hearing aid in question can still be operated stably, even if it can no longer be achieved to compensate for the individual hearing loss gain.
  • the gain is set up by the mechanical stability of the devices limits.
  • the hearing aid has, in addition to the usual components (input transducer, signal processing unit, output transducer) via a sound detector device for detecting sounds, in particular consonants, in a speech signal incoming to the hearing aid.
  • a sound is generally a sound or sound produced by the human or animal voice.
  • a sound in the narrower sense is a defined sound wave produced by the flow of the breath (phonation current) at a certain position of the speech tools.
  • the generation and perception of sounds is the subject of phonetics.
  • a phoneme or phon is understood as the smallest phonetic unit of the spoken language.
  • consonant in the context of the invention is general understood a sound whose articulation includes a narrowing of the vocal tract, so that the respiratory air flow is completely or partially blocked and it comes to audible turbulence (air turbulence). Consonants are inhibitor overcoming sounds. In particular, consonants within the meaning of the invention are not limited to the consonant letters (B, C, D, F, etc.).
  • the invention now provides, in a recognized sound, in particular a consonant or fricative, the signal components in a frequency range in which the necessary to compensate for the individual hearing loss gain can not be achieved permanently, briefly, especially for the duration of the sound, to increase the gain beyond the permanently possible gain. This makes it possible for the hearing aid wearer to better perceive the sound and thus better understand the overall language.
  • a splitting of the electrical input signal into a plurality of parallel frequency bands (channels) is provided and the signal processing in the hearing aid in the signal processing unit is at least partially parallel in the individual frequency bands.
  • the gain is then raised beyond the normal gain for at least one particular frequency band if the desired gain is not permanently achievable for the reasons already stated and the detected sound has signal components in the respective frequency band.
  • the invention offers the advantage that, unlike frequency compression, the clarity of speech is not compromised to any extent.
  • FIG. 1 shows in a simplified block diagram the structure of a hearing aid according to the prior art.
  • Hearing aids have in principle as essential components one or more input transducers, an amplifier and an output transducer.
  • the input transducer is usually a sound receiver, z. As a microphone, or an electromagnetic receiver, for. B. an induction coil.
  • the output transducer is usually used as an electroacoustic transducer, z. As miniature speaker or handset, or as an electromechanical transducer, z. B. bone conduction, realized.
  • the amplifier is usually integrated in a signal processing unit. This basic structure is in FIG. 2 Exemplary a behind-the-ear hearing aid 1 shown.
  • a hearing aid housing 2 for carrying behind the ear two microphones 3 and 4 are installed for receiving the sound from the environment.
  • a signal processing unit 5 which is also integrated into the hearing aid housing 2, processes the microphone signals and amplifies them.
  • the output signal of the signal processing unit 5 is transmitted to a loudspeaker or earpiece 6, which outputs an acoustic signal. If necessary, the sound is transmitted to the eardrum of the hearing aid wearer via a sound tube, which is fixed in the auditory canal with an earmold.
  • the power supply of the hearing device and in particular of the signal processing unit 5 is effected by a likewise integrated into the hearing aid housing 2 battery. 7
  • FIG. 2 shows in a simplified block diagram how an electrical output signal AS is generated from an electrical input signal ES, which optionally contains a speech signal.
  • the acoustic input signal recorded by a microphone 12 is first converted into an electrical input signal ES and fed to a filter bank 13.
  • the filter bank 13 effects a splitting of the electrical input signal ES into a plurality of (in the exemplary embodiment three) parallel channels.
  • the further signal processing to compensate for the individual hearing loss of a user is then carried out in parallel in the three channels, in particular in the signal processing units 14, 15 and 16, before the processed signals are combined in a summer 17 again.
  • a receiver 18 finally converts the resulting electrical output signal AS into an acoustic output signal.
  • an appropriate setting of parameters sets a gain that compensates for the user's individual hearing loss.
  • the gain may need to a maximum amount can be reduced in order to prevent overloading of the amplifier included in the signal processing unit concerned or to avoid the occurrence of feedback. It is therefore set for each channel 14, 15 and 16 as a normal gain permanently possible, maximum gain, which does not overload the relevant amplifier and in which a stable operation is ensured.
  • the hearing aid according to the invention comprises as a special feature a per se known sound detector device 19 for detecting sounds, in particular consonants, in a speech signal contained in the input signal. If a specific sound, for example a consonant, has been detected, a signal in this regard is forwarded to a gain control unit 20.
  • the gain control unit 20 By means of the gain control unit 20, the amplification exerted by the signal processing units 14, 15 and 16 in the individual channels is adapted to the detected sound. It is possible that the gain briefly, in particular for the duration of the detected sound, exceeds the "normal" and in particular the permanently maximum possible gain.
  • FIG. 3 explains the procedure described again with reference to the indicated gain V as a function of the signal frequency f.
  • FIG. 3 is based on a hearing aid with 8 frequency bands (channels) K1 to K8. It is a technically conditional, partly dependent on individual factors of the hearing aid wearer dependent characteristic of a maximum gain V max on the frequency f visible.
  • the amplifications V1 to V8 are set in the exemplary embodiment, which form the characteristic of the "normal" gain V N over the frequency f. It is always V N ⁇ V Max , so that a stable operation is always guaranteed and the amplifier of the hearing aid is not overloaded.
  • the gains V6 to V8 set in the channels K6 to K8 are no longer intended to compensate completely of the user's individual hearing loss.
  • the gain briefly exceeds, in particular for the duration of the sound, the normal gain V N or the maximum gain V Max . This is indicated in FIG. 6 for the channel K6, for which a short-term gain (for a short time) assumes the value V6 '.
  • the amount at which the short-term gain V6 'exceeds the normal gain V N may be dependent on various factors. In particular, it depends on the signal strength of the detected sound in the input signal. On the other hand, it is limited to a maximum value due to technical restrictions.
  • the maximum value of the short-time gain is a certain amount, eg 5 dB, above the permanently achievable, maximum gain V Max . This measure is advantageous, in particular channel-dependent, adjustable by programming the hearing aid in question.
  • the duration of the short-term gain is adapted to the duration of the detected sound.
  • the duration of the short-term gain essentially corresponds to the duration of the detected sound.
  • the speech intelligibility especially for large hearing loss, increased without increasing the feedback tendency. It can help to avoid a frequency transposition which is often undesirable because of its serious disadvantages in the case of large hearing losses.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Acoustics & Sound (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Otolaryngology (AREA)
  • Neurosurgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Tone Control, Compression And Expansion, Limiting Amplitude (AREA)
EP12159057.4A 2011-03-31 2012-03-12 Hörhilfegerät sowie Verfahren zum Betrieb eines Hörhilfegeräts Active EP2506602B1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102011006511.3A DE102011006511B4 (de) 2011-03-31 2011-03-31 Hörhilfegerät sowie Verfahren zum Betrieb eines Hörhilfegeräts

Publications (3)

Publication Number Publication Date
EP2506602A2 EP2506602A2 (de) 2012-10-03
EP2506602A3 EP2506602A3 (de) 2015-06-10
EP2506602B1 true EP2506602B1 (de) 2016-09-28

Family

ID=45894148

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12159057.4A Active EP2506602B1 (de) 2011-03-31 2012-03-12 Hörhilfegerät sowie Verfahren zum Betrieb eines Hörhilfegeräts

Country Status (4)

Country Link
US (1) US8811641B2 (da)
EP (1) EP2506602B1 (da)
DE (1) DE102011006511B4 (da)
DK (1) DK2506602T3 (da)

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5204906A (en) 1990-02-13 1993-04-20 Matsushita Electric Industrial Co., Ltd. Voice signal processing device
US5706352A (en) * 1993-04-07 1998-01-06 K/S Himpp Adaptive gain and filtering circuit for a sound reproduction system
US6434246B1 (en) * 1995-10-10 2002-08-13 Gn Resound As Apparatus and methods for combining audio compression and feedback cancellation in a hearing aid
US6768801B1 (en) 1998-07-24 2004-07-27 Siemens Aktiengesellschaft Hearing aid having improved speech intelligibility due to frequency-selective signal processing, and method for operating same
CA2492091C (en) * 2002-07-12 2009-04-28 Widex A/S Hearing aid and a method for enhancing speech intelligibility
DE10308483A1 (de) 2003-02-26 2004-09-09 Siemens Audiologische Technik Gmbh Verfahren zur automatischen Verstärkungseinstellung in einem Hörhilfegerät sowie Hörhilfegerät
EP1333700A3 (en) 2003-03-06 2003-09-17 Phonak Ag Method for frequency transposition in a hearing device and such a hearing device
US7457741B2 (en) * 2004-03-30 2008-11-25 National Institute of Advnaced Industrial Science and Technology Device for transmitting speech information
US8015008B2 (en) 2007-10-31 2011-09-06 At&T Intellectual Property I, L.P. System and method of using acoustic models for automatic speech recognition which distinguish pre- and post-vocalic consonants
DE102009032238A1 (de) * 2008-12-30 2010-07-08 Forschungsgesellschaft für Arbeitsphysiologie und Arbeitsschutz e.V. Verfahren zur Kontrolle der Anpassung eines Hörgerätes
US8374877B2 (en) * 2009-01-29 2013-02-12 Panasonic Corporation Hearing aid and hearing-aid processing method

Also Published As

Publication number Publication date
DE102011006511A1 (de) 2012-10-04
EP2506602A3 (de) 2015-06-10
US20120250919A1 (en) 2012-10-04
DE102011006511B4 (de) 2016-07-14
DK2506602T3 (da) 2017-01-16
EP2506602A2 (de) 2012-10-03
US8811641B2 (en) 2014-08-19

Similar Documents

Publication Publication Date Title
DE102005020317B4 (de) Automatische Verstärkungseinstellung bei einem Hörhilfegerät
DE69933141T2 (de) Tonprozessor zur adaptiven dynamikbereichsverbesserung
EP3451705B1 (de) Verfahren und vorrichtung zum schnellen erkennen der eigenen stimme
EP1489885B1 (de) Verfahren zum Betrieb eines Hörhilfegerätes sowie Hörhilfegerät mit einem Mikrofonsystem, bei dem unterschiedliche Richtcharakteristiken einstellbar sind
DE102007046437B4 (de) Vollautomatisches Ein-/Ausschalten bei Hörhilfegeräten
EP2229010B1 (de) Hörgerät und Verfahren zur Störschallkompensation bei einem Hörgerät
EP2164283B1 (de) Hörgerät und Betrieb eines Hörgeräts mit Frequenztransposition
DE60207867T2 (de) Hörgerät und verfahren zur verarbeitung eines klangsignals
DE102007017761A1 (de) Verfahren zur Anpassung eines binauralen Hörgerätesystems
DE102007035171A1 (de) Verfahren zum Anpassen eines Hörgeräts mit Hilfe eines perzeptiven Modells
DE602006000772T2 (de) Hörinstrument
EP2822300B1 (de) Erkennen von Hörsituationen mit unterschiedlichen Signalquellen
EP2584795B1 (de) Verfahren zum Ermitteln einer Kompressionskennlinie
DE102009058415B4 (de) Verfahren zur Frequenztransposition bei einem Hörhilfegerät sowie Hörhilfegerät
DE102006015497A1 (de) Audiosystem und Verfahren sowie Computerprogramm und Datenträger der das Computerprogramm enthält zur Anpassung der Übertragungsfunktion eines Audiosystems mittels Sprachsteuerung
DE102011006472B4 (de) Verfahren zur Verbesserung der Sprachverständlichkeit mit einem Hörhilfegerät sowie Hörhilfegerät
EP2222096A2 (de) Verfahren zur Signalverarbeitung einer Hörvorrichtung und entsprechende Hörvorrichtung
EP2506602B1 (de) Hörhilfegerät sowie Verfahren zum Betrieb eines Hörhilfegeräts
EP2635048B1 (de) Verstärken eines Sprachsignals in Abhängigkeit vom Eingangspegel
EP2793488B1 (de) Binaurale Mikrofonanpassung mittels der eigenen Stimme
EP2648424B1 (de) Verfahren zur Ausgangspegelbegrenzung bei Hörvorrichtungen
EP2604046A1 (de) Verfahren zum betreiben eines hörgeräts und entsprechendes hörgerät
EP1909534A2 (de) Hörvorrichtung mit unsymmetrischer Klangwaage und entsprechendes Einstellverfahren
DE102008064382A1 (de) Hörvorrichtung mit Transpositionsmöglichkeit und entsprechendes Verfahren
DE102011114560A1 (de) Verfahren zur Anpassung eines Hörhilfegerätes

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: H04R 25/00 20060101AFI20150507BHEP

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIVANTOS PTE. LTD.

17P Request for examination filed

Effective date: 20151201

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 25/78 20130101ALI20160322BHEP

Ipc: H04R 25/00 20060101AFI20160322BHEP

INTG Intention to grant announced

Effective date: 20160421

RIN1 Information on inventor provided before grant (corrected)

Inventor name: SERMAN, MAJA DR.

Inventor name: PAPE, SEBASTIAN

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 833656

Country of ref document: AT

Kind code of ref document: T

Effective date: 20161015

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502012008337

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20170110

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160928

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161229

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170130

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170128

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502012008337

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20170629

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170312

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170312

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20170331

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 833656

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170312

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170312

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20120312

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160928

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160928

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230320

Year of fee payment: 12

Ref country code: DK

Payment date: 20230323

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20230402

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240321

Year of fee payment: 13

Ref country code: GB

Payment date: 20240322

Year of fee payment: 13