EP2120484B1 - Verfahren zum Betreiben eines Hörgeräts und Hörgerät - Google Patents

Verfahren zum Betreiben eines Hörgeräts und Hörgerät Download PDF

Info

Publication number
EP2120484B1
EP2120484B1 EP09155859.3A EP09155859A EP2120484B1 EP 2120484 B1 EP2120484 B1 EP 2120484B1 EP 09155859 A EP09155859 A EP 09155859A EP 2120484 B1 EP2120484 B1 EP 2120484B1
Authority
EP
European Patent Office
Prior art keywords
hearing aid
prescribable
association
acoustic
acoustic signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP09155859.3A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP2120484A3 (de
EP2120484A2 (de
Inventor
Ulrich Kornagel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos Pte Ltd
Original Assignee
Sivantos Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sivantos Pte Ltd filed Critical Sivantos Pte Ltd
Publication of EP2120484A2 publication Critical patent/EP2120484A2/de
Publication of EP2120484A3 publication Critical patent/EP2120484A3/de
Application granted granted Critical
Publication of EP2120484B1 publication Critical patent/EP2120484B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Electric hearing aids
    • H04R25/40Arrangements for obtaining a desired directivity characteristic
    • H04R25/407Circuits for combining signals of a plurality of transducers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/41Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/43Signal processing in hearing aids to enhance the speech intelligibility
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Electric hearing aids
    • H04R25/40Arrangements for obtaining a desired directivity characteristic
    • H04R25/405Arrangements for obtaining a desired directivity characteristic by combining a plurality of transducers

Definitions

  • the invention relates to a specified in claim 1 method for operating a hearing aid and a specified in claim 6 hearing aid.
  • noise or unwanted acoustic signals are omnipresent. These interfere with the human voice of a person or with a desired acoustic signal.
  • Hearing aid carriers are particularly susceptible to noise and unwanted acoustic signals. Talking in the background, audible interference with electronic devices such as cell phones, and ambient noise or sounds may make it difficult for a person with a hearing aid to understand a desired speaker. Reducing the level of noise in an acoustic signal coupled with an automatic focus on a desired acoustic signal component can significantly improve the performance of a digital speech processor as used in modern hearing aids.
  • Hearing aids with digital signal processing include one or more microphones, A / D converters, digital signal processors and speakers.
  • digital signal processors divide the incoming signals into a plurality of frequency bands. Within each band, signal amplification and processing may be individually adjusted in accordance with the requirements of a particular wearer of the hearing aid.
  • algorithms for feedback and noise minimization are available in digital signal processing, but they also have disadvantages.
  • a disadvantage of the currently existing algorithms for noise minimization is, for example, their limited improvement in hearing aid acoustics when speech and background noise are in the same frequency region and they are therefore unable to distinguish between spoken language and background noise.
  • BSS Blind Source Separation
  • the directional microphone control in the sense of a BSS is subject to ambiguity as soon as several competing sources of use, eg. B. speaker, present simultaneously.
  • the BSS allowed in principle, the separation of the different sources, if they are spatially separated.
  • the ambiguity reduces the potential benefit of a directional microphone, although it is precisely in such scenarios that a directional microphone can be very useful for improving speech intelligibility.
  • the hearing aid or the mathematical algorithms for BSS are in principle faced with the problem of having to decide which of the signals generated by the BSS should be passed on most advantageously to the hearing aid wearer. This is a problem that in principle is impossible for the hearing aid since the selection of the desired acoustic source directly depends on the momentary will of the hearing aid wearer and thus can not be present as an input variable for a selection algorithm. The choice made by this algorithm must therefore be based on assumptions about the probable will of the listener.
  • EP 1 912 472 A1 a method for operating a hearing aid and a hearing aid is known. From a recorded ambient sound electrical acoustic signals are generated from which a signal processing an electrical voice signal with a high probability of speech is identified and selected. The electrical speech signal is selectively taken into account in an output sound of the hearing aid so that it at least emerges acoustically for the hearing aid wearer in comparison with another acoustic source and is thus better perceived by the hearing aid wearer.
  • EP 1 912 474 A1 discloses a method for operating a hearing aid and a hearing aid. From a recorded ambient sound electrical acoustic signals are generated, from which by signal processing, an electrical speaker signal is identified and selected by a database with voice profiles preferred speakers. The electrical speaker signal is selectively taken into account in an output sound of the hearing aid so that it at least emerges acoustically for the hearing aid wearer in comparison with another acoustic source and is thus better perceived by the hearing aid wearer.
  • the stated object is achieved by the method of independent claim 1 and the hearing aid of independent claim 6.
  • the invention comprises a method for operating a hearing device, wherein electrical acoustic signals are generated by the hearing device from a recorded ambient sound. These are weighted according to their degree of membership to a predeterminable acoustic signal class and mixed together to form an output sound signal. The weight of the acoustic signal is greater or smaller, the higher the degree of membership.
  • the advantage of this is that a hearing aid user a desired signal from a variety of ambient sound signals can be presented.
  • the degree of membership can be determined by the characteristics volume, frequency range, basic speech frequency, cepstral coefficients and / or temporal course of the acoustic signals. This achieves high flexibility.
  • the predeterminable acoustic signal class may include the classes voice or human voice, in a predeterminable frequency band, male voice, female voice, child's voice, voice of a predefinable person, music and ambient noise. This offers the advantage of a wide choice for a hearing device user.
  • the predeterminable acoustic signal class may also comprise any combination of the classes.
  • the electrical acoustic signals are generated from the ambient sound by means of a blind-source separation method. This results in a good sound signal separation.
  • the degree of membership is determined by a feature analysis of the electrical acoustic signals, wherein a probability of belonging to a predeterminable acoustic signal class is determined for the electrical acoustic signals.
  • the advantage of this is the simple mathematical weighting.
  • a hearing aid is also provided with at least one microphone for recording ambient sound and with a demixing unit for generating electrical acoustic signals from the recorded ambient sound.
  • the hearing device comprises a signal processing unit, by the acoustic signals which are weighted according to their degree of membership to a predetermined acoustic signal class and mixed together to form an output sound signal, wherein the weight of the acoustic signal is greater or smaller, the higher the degree of affiliation. This makes it possible to switch between acoustic signal classes "soft".
  • the demixing unit may comprise a blind-source separation module.
  • the signal processing unit may comprise at least one classification module, at least one weight determination module, at least one multiplier and at least one adder.
  • the hearing device can comprise an acoustic signal class input unit with which the desired, specifiable acoustic signal class is transmitted to the hearing aid. This can be arranged on the hearing aid or in a remote control.
  • the FIG. 1 shows the state of the art of a hearing aid 1 with three microphones 2 and a demixing unit 5 according to the blind source separation method.
  • Three signal sources generate three ambient acoustic sound signals s1, s2, s3, which are received by the three microphones 2 and converted into electrical microphone signals X1, X2, X3.
  • the three microphone signals x1, x2, x3 are each supplied to a signal input of the demixing unit 5.
  • the blind-source separation process takes place with the aid of which the ambient sound signals s1, s2, s3 can be reconstructed from the mixed electrical microphone signals x1, x2, x3.
  • a hearing device user can now select between the three separately reproduced acoustic signals s1 ', s2', s3 'by means of a selection switch 7 in a post-processor module 6.
  • the electrical acoustic signal s2 ' was selected and passed on to a handset 3.
  • the demixing unit 5 and the post-processor module form a signal processing unit 4.
  • the listener 3 sends as an acoustic output signal s2 '', which corresponds approximately to the ambient acoustic signal s2.
  • acoustic output signal s2 '' which corresponds approximately to the ambient acoustic signal s2.
  • a hearing aid user does not always want such a hard switching between different input signal sources.
  • FIG. 2 shows a hearing aid 1 with three microphones 2, a signal processing unit 4 and a receiver or loudspeaker 3.
  • Three ambient sound signals s1, s2, s3 are received by the microphones 2 and forwarded as microphone signals x1, x2, x3 to the signal processing unit 4.
  • the processed by the signal processing unit 4 microphone signals x1, x2, x3 are then forwarded to an input of the handset 3 and presented as an acoustic output sound signal s the hearing device user.
  • the microphone signals x1, x2, x3 are processed with the aid of a demixing unit 5 and passed as demixed electrical acoustic signals s1 ', s2', s3 'to the further processing units.
  • a hearing device user can specify a preferred acoustic signal class. This specification is passed to the classification module 8 and processed in this.
  • the preselected acoustic signal class may include, for example, a male voice, a female voice, a child's voice or even a certain frequency range, or generally human voice, or music, etc.
  • the classification module 8 calculates the probability with which an electrical acoustic signal s1 ', s2', s3 'belongs to a specific acoustic signal class. With the help of a weight determination module 9, this degree of affiliation is now weighted accordingly. For this purpose, the degrees of membership of the classified signals are routed from outputs of the classification module 8 to inputs of the weighting module 9.
  • the weight determination module 9 now determines the weights g1, g2, g3 such that the higher the degree of belonging to the preselected class has been determined, the higher the weight of an acoustic signal is selected.
  • the weights g1, g2, g3 are routed to these respective inputs of the multipliers 10.
  • the electrical acoustic signals s1 ', s2', s3 ' are now multiplied by the weights g1, g2, g3.
  • the weighted electrical acoustic signals are passed to an adder 11. In the adder 11, these signals are added and provided to the output of the adder 11. Subsequently, the electrical signal at the output of the adder in the receiver 3 is converted into an output sound signal S.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
EP09155859.3A 2008-05-13 2009-03-23 Verfahren zum Betreiben eines Hörgeräts und Hörgerät Active EP2120484B1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102008023370A DE102008023370B4 (de) 2008-05-13 2008-05-13 Verfahren zum Betreiben eines Hörgeräts und Hörgerät

Publications (3)

Publication Number Publication Date
EP2120484A2 EP2120484A2 (de) 2009-11-18
EP2120484A3 EP2120484A3 (de) 2010-05-26
EP2120484B1 true EP2120484B1 (de) 2016-05-18

Family

ID=40957686

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09155859.3A Active EP2120484B1 (de) 2008-05-13 2009-03-23 Verfahren zum Betreiben eines Hörgeräts und Hörgerät

Country Status (4)

Country Link
US (1) US8737652B2 (da)
EP (1) EP2120484B1 (da)
DE (1) DE102008023370B4 (da)
DK (1) DK2120484T3 (da)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2670168A1 (en) * 2012-06-01 2013-12-04 Starkey Laboratories, Inc. Adaptive hearing assistance device using plural environment detection and classification
JP6216169B2 (ja) * 2012-09-26 2017-10-18 キヤノン株式会社 情報処理装置、情報処理方法
WO2017084397A1 (en) 2015-11-19 2017-05-26 The Hong Kong University Of Science And Technology Method, system and storage medium for signal separation
WO2019084214A1 (en) * 2017-10-24 2019-05-02 Whisper.Ai, Inc. AUDIO SEPARATION AND RECOMBINATION FOR INTELLIGIBILITY AND COMFORT
EP3945735A1 (en) * 2020-07-30 2022-02-02 Koninklijke Philips N.V. Sound management in an operating room
DE102022202266A1 (de) * 2022-03-07 2023-09-07 Sivantos Pte. Ltd. Verfahren zum Betrieb eines Hörgeräts

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19948907A1 (de) * 1999-10-11 2001-02-01 Siemens Audiologische Technik Verfahren zur Signalverarbeitung in einer Hörhilfe sowie Hörhilfe
DE10245567B3 (de) * 2002-09-30 2004-04-01 Siemens Audiologische Technik Gmbh Vorrichtung und Verfahren zum Anpassen eines Hörgeräts
JP2006510069A (ja) * 2002-12-11 2006-03-23 ソフトマックス,インク 改良型独立成分分析を使用する音声処理ためのシステムおよび方法
EP1489882A3 (de) * 2003-06-20 2009-07-29 Siemens Audiologische Technik GmbH Verfahren zum Betrieb eines Hörhilfegerätes, sowie Hörhilfegerät mit einem Mikrofonsystem, bei dem unterschiedliche Richtcharakteristiken einstellbar sind
US7957548B2 (en) * 2006-05-16 2011-06-07 Phonak Ag Hearing device with transfer function adjusted according to predetermined acoustic environments
DE102006047982A1 (de) 2006-10-10 2008-04-24 Siemens Audiologische Technik Gmbh Verfahren zum Betreiben einer Hörfilfe, sowie Hörhilfe
EP1912472A1 (de) * 2006-10-10 2008-04-16 Siemens Audiologische Technik GmbH Verfahren zum Betreiben einer Hörhilfe, sowie Hörhilfe

Also Published As

Publication number Publication date
DK2120484T3 (da) 2016-08-29
DE102008023370A1 (de) 2009-11-19
EP2120484A3 (de) 2010-05-26
US8737652B2 (en) 2014-05-27
EP2120484A2 (de) 2009-11-18
US20090285422A1 (en) 2009-11-19
DE102008023370B4 (de) 2013-08-01

Similar Documents

Publication Publication Date Title
EP1912474B1 (de) Verfahren zum Betreiben einer Hörhilfe, sowie Hörhilfe
DE10146886B4 (de) Hörgerät mit automatischer Umschaltung auf Hörspulenbetrieb
EP1912472A1 (de) Verfahren zum Betreiben einer Hörhilfe, sowie Hörhilfe
EP3451705B1 (de) Verfahren und vorrichtung zum schnellen erkennen der eigenen stimme
EP1307072B1 (de) Verfahren zum Betrieb eines Hörgerätes sowie Hörgerät
EP2077059B1 (de) Verfahren zum betreiben einer hörhilfe, sowie hörhilfe
DE102011087984A1 (de) Hörvorrichtung mit Sprecheraktivitätserkennung und Verfahren zum Betreiben einer Hörvorrichtung
EP2120484B1 (de) Verfahren zum Betreiben eines Hörgeräts und Hörgerät
WO2001020965A2 (de) Verfahren zur bestimmung einer momentanen akustischen umgebungssituation, anwendung des verfharens und ein hörgerät
EP1489885A2 (de) Verfahren zum Betrieb eines Hörhilfegerätes sowie Hörhilfegerät mit einem Mikrofonsystem, bei dem unterschiedliche Richtcharakteristiken einstellbar sind
EP2226795B1 (de) Hörvorrichtung und Verfahren zum Reduzieren eines Störgeräuschs für eine Hörvorrichtung
EP2991379B1 (de) Verfahren und vorrichtung zur verbesserten wahrnehmung der eigenen stimme
DE10327890A1 (de) Verfahren zum Betrieb eines Hörhilfegerätes sowie Hörhilfegerät mit einem Mikrofonsystem, bei dem unterschiedliche Richtcharakteristiken einstellbar sind
EP2200341B1 (de) Verfahren zum Betrieb eines Hörhilfegerätes sowie Hörhilfegerät mit einer Quellentrennungseinrichtung
WO2008043758A1 (de) Verfahren zum betreiben einer hörhilfe, sowie hörhilfe
DE10334396B3 (de) Hörhilfegerät sowie Verfahren zum Betrieb eines Hörhilfegerätes mit einem Mikrofonsystem, bei dem unterschiedliche Richtcharakteristiken einstellbar sind
DE10114101A1 (de) Verfahren zum Verarbeiten eines Eingangssignals in einer Signalverarbeitungseinheit eines Hörgerätes sowie Schaltung zur Durchführung des Verfahrens
EP1432282A2 (de) Verfahren zum Anpassen eines Hörgerätes an eine momentane akustische Umgebungssituation und Hörgerätesystem
EP2658289B1 (de) Verfahren zum Steuern einer Richtcharakteristik und Hörsystem
DE102019201879B3 (de) Verfahren zum Betrieb eines Hörsystems und Hörsystem
EP3048813B1 (de) Verfahren und vorrichtung zur rauschunterdrückung basierend auf inter-subband-korrelation
EP4518357A1 (de) Verfahren zur direktionalen signalverarbeitung für ein hörsystem
EP4642053A1 (de) Verfahren zur direktionalen signalverarbeitung für ein hörinstrument
DE102024203680A1 (de) Verfahren zum Betrieb eines Hörgerätesystems
EP4615005A1 (de) Verfahren zum betrieb eines hörgerätesystems

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA RS

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA RS

17P Request for examination filed

Effective date: 20100621

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

17Q First examination report despatched

Effective date: 20150421

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIVANTOS PTE. LTD.

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20160115

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

Ref country code: CH

Ref legal event code: NV

Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH

Ref country code: AT

Ref legal event code: REF

Ref document number: 801342

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160615

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502009012584

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20160825

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160518

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160818

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160919

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160819

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502009012584

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20170221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170323

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170323

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20170331

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 801342

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170323

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170323

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20090323

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160918

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250218

Year of fee payment: 17

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20250218

Year of fee payment: 17

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20250219

Year of fee payment: 17

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20250221

Year of fee payment: 17

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20250401

Year of fee payment: 17