EP1848245B1 - Appareil auditif à séparation de source en aveugle et procédé correspondant - Google Patents

Appareil auditif à séparation de source en aveugle et procédé correspondant Download PDF

Info

Publication number
EP1848245B1
EP1848245B1 EP07106037.0A EP07106037A EP1848245B1 EP 1848245 B1 EP1848245 B1 EP 1848245B1 EP 07106037 A EP07106037 A EP 07106037A EP 1848245 B1 EP1848245 B1 EP 1848245B1
Authority
EP
European Patent Office
Prior art keywords
hearing aid
source
received signals
hearing
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP07106037.0A
Other languages
German (de)
English (en)
Other versions
EP1848245A2 (fr
EP1848245A3 (fr
Inventor
Ulrich Kornagel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos GmbH
Original Assignee
Sivantos GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sivantos GmbH filed Critical Sivantos GmbH
Publication of EP1848245A2 publication Critical patent/EP1848245A2/fr
Publication of EP1848245A3 publication Critical patent/EP1848245A3/fr
Application granted granted Critical
Publication of EP1848245B1 publication Critical patent/EP1848245B1/fr
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40—Arrangements for obtaining a desired directivity characteristic
    • H04R25/407—Circuits for combining signals of a plurality of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/403—Linear arrays of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility

Definitions

  • the present invention relates to a hearing aid with a source separation device for receiving a mixed signal from a plurality of sound sources and for generating a plurality of source-specific reception signals therefrom.
  • a key issue for hearing aid users is understanding speech in an environment with multiple acoustic sources. Such a situation arises, for example, in a celebration in which many guests talk at the same time and with about the same volume. This problem is therefore referred to as the so-called cocktail party problem.
  • One way to improve speech intelligibility is to use a directional microphone.
  • the hearing aid wearer has to look in the direction from which he prefers to receive sound.
  • the disadvantage of this solution is that the head must not be turned off from the source. There is thus a lack of flexibility.
  • BSS blind source separation
  • a hearing aid which has a plurality of microphones, and which is able to record the signals of several sound sources depending on the direction. Depending on the angle of incidence, the strongest signals can be determined. One or more of these signals are then selected and processed into an output signal.
  • EP 1 538 874 A2 a hearing device with directional signal processing. It has a direction detection device for detecting a direction from which a sound signal from a sound source arrives, and a signal processing device for processing the incoming sound signal as a function of the detected direction.
  • a hearing aid wearer With the aid of a signal generator and a handset, a hearing aid wearer can be informed of the type and direction of a sound that would otherwise be so strongly attenuated by the noise suppression that the sound would no longer be perceptible to him.
  • the object of the present invention is therefore to improve the perceptibility of a desired source for the user of a hearing aid.
  • a hearing aid with a source separation device for receiving at least one mixed signal from a plurality of sound sources and generating a plurality of source-specific received signals therefrom, and a presentation device for presenting each of a corresponding output signal to each of the plurality of receive signals and a selector for selecting one of the plurality of receive signals by a user for further processing.
  • a source separation device for receiving at least one mixed signal from a plurality of sound sources and generating a plurality of source-specific received signals therefrom
  • a presentation device for presenting each of a corresponding output signal to each of the plurality of receive signals and a selector for selecting one of the plurality of receive signals by a user for further processing.
  • angle information about a reception angle is provided and presented to each of the plurality of reception signals. Based on the angle information, the user can identify the desired source more quickly.
  • the plurality of output signals are then dependent on the associated reception angles presented by the presentation device. This makes it easier for the user to orient themselves, because, for example, the
  • the invention is based on the idea that a hearing device can not automatically be clarified after a separation of the sources, which of them should preferably be presented.
  • the hearing device wearer can now according to the invention switch to one of the channels provided in order to be able to listen to the corresponding source.
  • the selection device is preferably in wireless communication with the presentation device.
  • the hearing device may have a hearing device remote control, the selection device being integrated into the hearing device remote control is.
  • the hearing aid remote control With the hearing aid remote control, a selection of a source is possible in a comfortable way.
  • the hearing device may comprise a housing, wherein the selector means a knock on the housing as a dialing signal is registered.
  • the selector means a knock on the housing as a dialing signal is registered.
  • the separate sources can be presented separately one after the other.
  • the successive presentation brings the advantage to the user that he gets all the sources offered without having to be actively involved, especially without eye contact with a switching unit.
  • the output signals from the presentation device can be presented in a predefined time sequence. In this way, the user can be spared manual switching operations.
  • a further preferred embodiment consists in that the selection device has a display unit on which sound sources can be displayed graphically as a function of the respective reception angles. Due to the graphical representation, some users can orient themselves better and faster.
  • the source separation device can automatically register an alignment of the hearing device with one of the sound sources as a selection signal on the basis of the provided angle information. This requires no special operating element for manual operation on the hearing device.
  • the hearing device If no angle information is provided by the source separation device, then it is necessary for the hearing device to have a directional microphone, so that an alignment of the hearing device with one of the sound sources for the selection device is automatically registered as a selection signal can. Also in this case, the user is released from manual operation.
  • the hearing aid according to the invention shown in FIG has a plurality of input-side microphones M1, M2, ..., Mn.
  • Each of the microphone signals consists of a mixed signal, which is caused by several signal sources.
  • a BSS unit connected to the microphones performs automatic source separation.
  • the BSS unit provides source specific output signals Q1, Q2, ..., Qm.
  • a demultiplexer DM connected downstream of the BSS unit is used to select one of the output signals Q1 to Qm, each of which preferably contains the switching signal of one of the sound sources.
  • the output signal of the demultiplexer DM is fed to a conventional signal processing unit SV. Its output signal in turn is fed to a loudspeaker L.
  • the demultiplexer DM is controlled by a control device S1 and / or S2. These control devices serve both as a presentation device, ie for the consecutive presentation of each source signal Q1 to Qm, as well as a selection device for selecting a desired source signal on the basis of a successive presentation of the individual signals.
  • a control unit S1 which has one or more keys.
  • the demultiplexer DM is controlled by a control unit S2, which has a display.
  • the recognized sources are shown on the display.
  • angle information relating to an angle is also displayed graphically or numerically. With this graphical representation, the hearing aid wearer can better visualize the different sources, and by making comparisons with the real sources, he can more easily make a choice.
  • other control interfaces can also be used as the control unit.
  • the source selection should therefore be able to be performed manually by the hearing aid wearer by means of an operator interface or an operator control device.
  • an operating device for example, an external device in question, such. B. the hearing aid remote control or extended to this operating function mobile device, a corresponding portable computer or the hearing aid itself.
  • the desired source is selected by the hearing aid wearer by preferring each source from the hearing aid (s) successively, i. H. with increased level, is presented.
  • the hearing aid wearer acknowledges the desired source by the operating device. In the simplest case, switching from one to the next source by pressing a button. For example, the further switching by pressing a button or knocking the hearing aid, if this is used as an operating device.
  • the sources in the selection process can be presented sequentially sorted in a predetermined angular direction.
  • the angular direction may be set clockwise or counterclockwise. But it can also be a switching of the angular direction allows to better meet the needs of the user.
  • the operating device has a display function, so that the positions of the found sources can be visualized. If a touch screen is used, the selection can be made directly via the screen. However, this requires that the position information of the sources be transferred to the HMI device beforehand.
  • the desired source may also be selected by the wearer of the hearing aid or hearing device looking in the direction of the desired source.
  • the control of the demultiplexer is performed directly by the BSS unit.
  • the BSS unit must be informed by pressing a button, for example, that the desired source, which is now in the 0 ° direction, should be selected.
  • the dialing process can be fully automated by automatically selecting a source when it is viewed for more than a predetermined amount of time (eg, 4 seconds) during its preferred performance.
  • the hearing aid wearer looks in the direction of the source of interest (0 ° azimuth direction) for selecting a source of interest.
  • a highly selective directional microphone works simultaneously in the hearing aid, which receives only sound from a very narrow angle range around the 0 ° direction.
  • Sound is to be processed as useful sound.
  • the useful source defined via the viewing direction is automatically selected, for example, by correlation analysis and preferably presented to the hearing device wearer. Even after this "learning process", the source no longer has to be viewed constantly.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Stereophonic System (AREA)

Claims (12)

  1. Appareil auditif présentant :
    un dispositif (BSS) de séparation de sources qui reçoit au moins un signal mélangé en provenance de plusieurs sources acoustiques et qui forme à partir de là plusieurs signaux de réception (Q1, Q2, ..., Qm) spécifiques aux sources,
    un dispositif de présentation qui présente un signal de sortie qui correspond à chacun des différents signaux de réception et
    un dispositif de sélection (S1, S2) qui permet à un utilisateur de sélectionner l'un des différents signaux de réception en vue de la poursuite de son traitement (SV),
    caractérisé en ce que
    une information d'angle concernant l'angle de réception est délivrée par le dispositif (BSS) de séparation des sources pour chacun des différents signaux de réception (Q1, Q2, ..., Qm) spécifiques aux sources et
    en ce que les différents signaux de sortie sont présentés par le dispositif de présentation en même temps que les angles de réception qui leur sont associés.
  2. Appareil auditif selon la revendication 1, dans lequel le dispositif de sélection (S1, S2) communique sans fil avec le dispositif de présentation.
  3. Appareil auditif selon la revendication 2, qui présente une commande à distance d'appareil auditif, le dispositif de sélection (S1, S2) étant intégré dans la commande à distance de l'appareil auditif.
  4. Appareil auditif selon l'une des revendications précédentes, présentant un boîtier, un coup frappé sur le boîtier étant enregistré comme signal de sélection par le dispositif de sélection.
  5. Appareil auditif selon l'une des revendications précédentes, dans lequel les signaux de sortie sont présentés successivement par le dispositif de présentation, et en particulier dans une succession temporelle prédéfinie.
  6. Appareil auditif selon l'une des revendications précédentes, dans lequel le dispositif de sélection (S1, S2) dispose d'une unité d'affichage sur laquelle des sources acoustiques sont présentées graphiquement en fonction des angles de réception respectifs.
  7. Appareil auditif selon l'une des revendications précédentes, dans lequel une orientation de l'ensemble auditif sur l'une des sources acoustiques est enregistrée automatiquement ou de manière semi-automatique comme signal de sélection par le dispositif (BSS) de séparation des sources, à l'aide des informations d'angle délivrées.
  8. Appareil auditif selon l'une des revendications 1 à 5, dans lequel le dispositif de sélection comporte un microphone directionnel qi enregistre de manière automatique ou semi-automatique l'orientation de l'ensemble auditif sur une source acoustique en tant que signal de sélection.
  9. Procédé de commande d'un appareil auditif par :
    réception d'au moins un signal mélangé provenant de plusieurs sources acoustiques,
    à partir du ou des signaux mélangés, formation de plusieurs signaux de réception (Q1, Q2, ..., Qm) spécifiques aux sources,
    présentation d'un signal de sortie correspondant à chacun des différents signaux de réception et
    sélection d'un des différents signaux de réception en vue de la poursuite de son traitement (SV), caractérisé en ce que
    une information d'angle concernant un angle de réception est délivrée pour chacun des différents signaux de réception (Q1, Q2, ..., Qm) spécifiques aux sources et
    en ce que les différents signaux de sortie sont présentés avec les angles de réception qui leurs sont associés.
  10. Procédé selon la revendication 9, dans lequel un coup frappé sur un boîtier de l'ensemble auditif est enregistré comme signal de sélection.
  11. Procédé selon les revendications 9 ou 10, dans lequel les signaux de sortie sont présentés successivement par le dispositif de présentation, en particulier dans une succession temporelle prédéfinie.
  12. Procédé selon l'une des revendications 9 à 11, dans lequel dans lequel une orientation de l'ensemble auditif sur l'une des sources acoustiques est enregistrée automatiquement ou de manière semi-automatique comme signal de sélection, à l'aide des informations d'angle délivrées.
EP07106037.0A 2006-04-21 2007-04-12 Appareil auditif à séparation de source en aveugle et procédé correspondant Not-in-force EP1848245B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102006018634.6A DE102006018634B4 (de) 2006-04-21 2006-04-21 Hörgerät mit Quellentrennung und entsprechendes Verfahren

Publications (3)

Publication Number Publication Date
EP1848245A2 EP1848245A2 (fr) 2007-10-24
EP1848245A3 EP1848245A3 (fr) 2008-03-12
EP1848245B1 true EP1848245B1 (fr) 2015-11-04

Family

ID=38180701

Family Applications (1)

Application Number Title Priority Date Filing Date
EP07106037.0A Not-in-force EP1848245B1 (fr) 2006-04-21 2007-04-12 Appareil auditif à séparation de source en aveugle et procédé correspondant

Country Status (4)

Country Link
US (1) US8199945B2 (fr)
EP (1) EP1848245B1 (fr)
DE (1) DE102006018634B4 (fr)
DK (1) DK1848245T3 (fr)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2200341B1 (fr) * 2008-12-16 2015-02-25 Siemens Audiologische Technik GmbH Procédé de fonctionnement d'un appareil d'aide auditive et appareil d'aide auditive doté d'un dispositif de séparation de sources
EP2869599B1 (fr) * 2013-11-05 2020-10-21 Oticon A/s Système d'assistance auditive biauriculaire comprenant une base de données de fonctions de transfert liées à la tête
US10388297B2 (en) * 2014-09-10 2019-08-20 Harman International Industries, Incorporated Techniques for generating multiple listening environments via auditory devices
FR3051093A1 (fr) * 2016-05-03 2017-11-10 Sebastien Thibaut Arthur Carriou Procede pour l'amelioration de la comprehension dans le bruit
WO2018154143A1 (fr) 2017-02-27 2018-08-30 Tympres Bvba Réglage d'un dispositif tel qu'une prothèse auditive ou un implant cochléaire sur la base d'une mesure
EP3373603B1 (fr) * 2017-03-09 2020-07-08 Oticon A/s Dispositif auditif comprenant un récepteur de son sans fil
CN114900771B (zh) * 2022-07-15 2022-09-23 深圳市沃特沃德信息有限公司 基于辅音耳机的音量调节优化方法、装置、设备及介质

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5737430A (en) * 1993-07-22 1998-04-07 Cardinal Sound Labs, Inc. Directional hearing aid
US5479522A (en) * 1993-09-17 1995-12-26 Audiologic, Inc. Binaural hearing aid
US6766029B1 (en) * 1997-07-16 2004-07-20 Phonak Ag Method for electronically selecting the dependency of an output signal from the spatial angle of acoustic signal impingement and hearing aid apparatus
GB9813973D0 (en) * 1998-06-30 1998-08-26 Univ Stirling Interactive directional hearing aid
CA2685434A1 (fr) 2000-05-10 2001-11-15 The Board Of Trustees Of The University Of Illinois Techniques de suppression d'interferences
DE10145994C2 (de) * 2001-09-18 2003-11-13 Siemens Audiologische Technik Hörgerät und Verfahren zur Steuerung eines Hörgeräts durch Klopfen
US7243060B2 (en) * 2002-04-02 2007-07-10 University Of Washington Single channel sound separation
US7457426B2 (en) * 2002-06-14 2008-11-25 Phonak Ag Method to operate a hearing device and arrangement with a hearing device
US7076072B2 (en) * 2003-04-09 2006-07-11 Board Of Trustees For The University Of Illinois Systems and methods for interference-suppression with directional sensing patterns
DE10356093B3 (de) 2003-12-01 2005-06-02 Siemens Audiologische Technik Gmbh Hörervorrichtung mit richtungsabhängiger Signalverarbeitung und entsprechendes Verfahren
US7319769B2 (en) * 2004-12-09 2008-01-15 Phonak Ag Method to adjust parameters of a transfer function of a hearing device as well as hearing device

Also Published As

Publication number Publication date
DK1848245T3 (da) 2016-02-15
EP1848245A2 (fr) 2007-10-24
EP1848245A3 (fr) 2008-03-12
US20070253573A1 (en) 2007-11-01
US8199945B2 (en) 2012-06-12
DE102006018634B4 (de) 2017-12-07
DE102006018634A1 (de) 2007-10-25

Similar Documents

Publication Publication Date Title
EP1848245B1 (fr) Appareil auditif à séparation de source en aveugle et procédé correspondant
EP1912474B1 (fr) Procédé pour le fonctionnement d'une prothèse auditive et prothèse auditive
EP1698908B1 (fr) Procédé d'ajustage d'une prothèse auditive, prothèse auditive et unité de commande mobile pour l'ajustage d'une prothèse auditive
DE102004034376B4 (de) Bildausgabevorrichtung mit veränderbarem Bildschirmverhältnis und Steuerungsverfahren für eine solche Vorrichtung
DE102007059694B4 (de) Mobiles Kommunikationsendgerät zur Schaffung eines taktilen Inferface
DE60307576T2 (de) Verfahren zum Einstellen eines Hörgerätes an eine momentane akustische Umgebungssituation und ein Hörgerätsystem
DE102015118553A1 (de) Systeme und Verfahren zum Auswählen von Audiofiltermethoden
EP1912472A1 (fr) Procédé pour le fonctionnement d'une prothèse auditive and prothèse auditive
EP2389753A1 (fr) Système de conférence téléphonique et procédé correspondant de signalisation
EP2077059B1 (fr) Procédé de fonctionnement d'une aide auditive et aide auditive
DE102006018155A1 (de) Funksendevorrichtung und Steuervorrichtung für Veranstaltungsräume sowie entsprechende Verfahren
WO2008043758A1 (fr) Procédé d'utilisation d'une aide auditive et aide auditive
EP2200341A1 (fr) Procédé de fonctionnement d'un appareil d'aide auditive et appareil d'aide auditive doté d'un dispositif de séparation de sources
DE10123823A1 (de) System und Verfahren zur parallelen Darbietung von mehreren Audioinformationsquellen
EP2120484B1 (fr) Procédé destiné au fonctionnement d'un appareil auditif et appareil auditif
DE102012220801A1 (de) Räumliche Separierung von Teilnehmern einer Telefonkonferenz im Fahrzeug
DE102007003551A1 (de) Medien-Playbacksystem mit Echtzeit-Kamerabildanzeige und zugehöriges Verfahren
EP2499837B1 (fr) Système de microphone
EP2111058B1 (fr) Procédé et appareil auditif destinés à la modification de la suite de places de programme
EP2820553B1 (fr) Dispositif de couplage et procédé d'occupation dynamique de points de connexion usb d'une interface usb et terminal de systèmes de négociations boursières équipé d'un dispositif de couplage
EP1351552A2 (fr) Procédé d'adaptation d'une prothèse auditive à une situation environnante momentanée et système de prothèse auditive
DE102007058585B4 (de) Vorrichtung und Verfahren zur Durchführung von Fernbesprechungen
DE102009019406B3 (de) Vorrichtung und Verfahren zur Horchpeilung
DE102006004248A1 (de) Testverfahren für ein eine Benutzerschnittstelle aufweisendes technisches Gerät
DE10243955B4 (de) Verfahren und Vorrichtung zur Übertragung von Sprachsignalen mittels einer Flugzeug-Sprachübertragungseinrichtung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

17P Request for examination filed

Effective date: 20080710

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150617

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIVANTOS GMBH

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 759900

Country of ref document: AT

Kind code of ref document: T

Effective date: 20151115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502007014368

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20160208

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20151104

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160304

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160205

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160304

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502007014368

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160430

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20160805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160412

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160412

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 759900

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160412

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160412

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20070412

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20190418

Year of fee payment: 13

Ref country code: DK

Payment date: 20190425

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20190423

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20190424

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20190424

Year of fee payment: 13

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 502007014368

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20200430

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201103

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200430

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200430

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200430

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20200412

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200430

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200412