EP1848245A2 - Hearing aid with source separation and corresponding method - Google Patents

Hearing aid with source separation and corresponding method Download PDF

Info

Publication number
EP1848245A2
EP1848245A2 EP20070106037 EP07106037A EP1848245A2 EP 1848245 A2 EP1848245 A2 EP 1848245A2 EP 20070106037 EP20070106037 EP 20070106037 EP 07106037 A EP07106037 A EP 07106037A EP 1848245 A2 EP1848245 A2 EP 1848245A2
Authority
EP
European Patent Office
Prior art keywords
hearing aid
source
hearing
signals
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP20070106037
Other languages
German (de)
French (fr)
Other versions
EP1848245A3 (en
EP1848245B1 (en
Inventor
Ulrich Kornagel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos GmbH
Original Assignee
Siemens Audioligische Technik GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Audioligische Technik GmbH filed Critical Siemens Audioligische Technik GmbH
Publication of EP1848245A2 publication Critical patent/EP1848245A2/en
Publication of EP1848245A3 publication Critical patent/EP1848245A3/en
Application granted granted Critical
Publication of EP1848245B1 publication Critical patent/EP1848245B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40—Arrangements for obtaining a desired directivity characteristic
    • H04R25/407—Circuits for combining signals of a plurality of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/403—Linear arrays of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility

Definitions

  • the present invention relates to a hearing aid with a source separation device for receiving a mixed signal from a plurality of sound sources and for generating a plurality of source-specific reception signals therefrom.
  • a key issue for hearing aid users is understanding speech in an environment with multiple acoustic sources. Such a situation arises, for example, in a celebration in which many guests talk at the same time and with about the same volume. This problem is therefore referred to as the so-called cocktail party problem.
  • One way to improve speech intelligibility is to use a directional microphone.
  • the hearing aid wearer has to look in the direction from which he prefers to receive sound.
  • the disadvantage of this solution is that the head must not be turned off from the source. There is thus a lack of flexibility.
  • BSS blind source separation
  • the object of the present invention is therefore to improve the perceptibility of a desired source for the user of a hearing aid.
  • a hearing device having a source separation device for receiving at least one composite signal from a plurality of sound sources and generating a plurality of source-specific reception signals therefrom, and a presentation device for presenting each corresponding output signal to each of the plurality of input signals and a selection device for selecting one the multiple input signals by a user for further processing.
  • a source separation device for receiving at least one composite signal from a plurality of sound sources and generating a plurality of source-specific reception signals therefrom
  • a presentation device for presenting each corresponding output signal to each of the plurality of input signals and a selection device for selecting one the multiple input signals by a user for further processing.
  • angle information about a reception angle is provided to each of the plurality of reception signals. Based on the angle information, the user can identify the desired source more quickly.
  • the plurality of output signals are then presented in response to the associated reception angles from the presentation device. This makes it easier for the user to orient themselves, because, for example, the sources can always be presented in a fixed sequence from left to
  • the invention is based on the idea that a hearing device can not automatically be clarified after a separation of the sources, which of them should preferably be presented.
  • the hearing device wearer can now according to the invention switch to one of the channels provided in order to be able to listen to the corresponding source.
  • the selection device is preferably in wireless communication with the presentation device.
  • the hearing device may have a hearing device remote control, the selection device being integrated into the hearing device remote control is.
  • the hearing aid remote control With the hearing aid remote control, a selection of a source is possible in a comfortable way.
  • the hearing device may comprise a housing, wherein the selector means a knock on the housing as a dialing signal is registered.
  • the selector means a knock on the housing as a dialing signal is registered.
  • the separate sources can be presented separately one after the other.
  • the successive presentation brings the advantage to the user that he gets all the sources offered without having to be actively involved, especially without eye contact with a switching unit.
  • the output signals from the presentation device can be presented in a predefined time sequence. In this way, the user can be spared manual switching operations.
  • a further preferred embodiment consists in that the selection device has a display unit on which sound sources can be displayed graphically as a function of the respective reception angles. Due to the graphical representation, some users can orient themselves better and faster.
  • the source separation device can automatically register an alignment of the hearing device with one of the sound sources as a selection signal on the basis of the provided angle information. This requires no special operating element for manual operation on the hearing device.
  • the hearing device If no angle information is provided by the source separation device, then it is necessary for the hearing device to have a directional microphone, so that an alignment of the hearing device with one of the sound sources for the selection device is automatically registered as a selection signal can. Also in this case, the user is released from manual operation.
  • the hearing aid according to the invention shown in FIG has a plurality of input-side microphones M1, M2, ..., Mn.
  • Each of the microphone signals consists of a mixed signal, which is caused by several signal sources.
  • a BSS unit connected to the microphones performs automatic source separation.
  • the BSS unit provides source specific output signals Q1, Q2, ..., Qm.
  • a demultiplexer DM connected downstream of the BSS unit is used to select one of the output signals Q1 to Qm, each of which preferably contains the switching signal of one of the sound sources.
  • the output signal of the demultiplexer DM is fed to a conventional signal processing unit SV. Its output signal in turn is fed to a loudspeaker L.
  • the demultiplexer DM is controlled by a control device S1 and / or S2. These control devices serve both as a presentation device, ie for the consecutive presentation of each source signal Q1 to Qm, as well as a selection device for selecting a desired source signal on the basis of a successive presentation of the individual signals.
  • a control unit S1 which has one or more keys.
  • the demultiplexer DM is controlled by a control unit S2, which has a display.
  • the recognized sources are shown on the display.
  • angle information relating to an angle is also displayed graphically or numerically. With this graphical representation, the hearing aid wearer can better visualize the different sources, and by making comparisons with the real sources, he can more easily make a choice.
  • other control interfaces can also be used as the control unit.
  • the source selection should therefore be able to be performed manually by the hearing aid wearer by means of an operator interface or an operator control device.
  • an operating device for example, an external device in question, such. B. the hearing aid remote control or extended to this operating function mobile device, a corresponding portable computer or the hearing aid itself.
  • the desired source is selected by the hearing aid wearer by preferring each source from the hearing aid (s) successively, i. H. with increased level, is presented.
  • the hearing aid wearer acknowledges the desired source by the operating device. In the simplest case, switching from one to the next source by pressing a button. For example, the further switching by pressing a button or knocking the hearing aid, if this is used as an operating device.
  • the sources in the selection process can be presented sequentially sorted in a predetermined angular direction.
  • the angular direction may be set clockwise or counterclockwise. But it can also be a switching of the angular direction allows to better meet the needs of the user.
  • the operating device has a display function, so that the positions of the found sources can be visualized. If a touch screen is used, the selection can be made directly via the screen. However, this requires that the position information of the sources be transferred to the HMI device beforehand.
  • the desired source may also be selected by the wearer of the hearing aid or hearing device looking in the direction of the desired source.
  • the control of the demultiplexer is performed directly by the BSS unit.
  • the BSS unit must be informed by pressing a button, for example, that the desired source, which is now in the 0 ° direction, should be selected.
  • the dialing process can be fully automated by automatically selecting a source when it is viewed for more than a predetermined amount of time (eg, 4 seconds) during its preferred performance.
  • the hearing aid wearer looks in the direction of the source of interest (0 ° azimuth direction) for selecting a source of interest.
  • a highly selective directional microphone works simultaneously in the hearing aid, which receives only sound from a very narrow angle range around the 0 ° direction.
  • the hearing aid is informed, for example by pressing a button, that the sound received by the directional microphone Sound is to be processed as useful sound.
  • the useful source defined via the viewing direction is automatically selected, for example, by correlation analysis and preferably presented to the hearing device wearer. Even after this "learning process", the source no longer has to be viewed constantly.

Abstract

The device has a source separation device receiving interference signals of sound sources and producing source-specified reception signals, where angle information about a reception angle is provided to the reception signals by the source separation device. A presentation device presents output signals (Q1, Q2) corresponding to input signals. The output signals are presented depending on the reception angle by the presentation device. Control devices (S1, S2) stay in wireless connection with the presentation device. The control devices are integrated in a hearing device-remote control. An independent claim is also included for a method for controlling a hearing device.

Description

Die vorliegende Erfindung betrifft ein Hörgerät mit einer Quellentrennungseinrichtung zum Empfangen eines Mischsignals von mehreren Schallquellen und zum Erzeugen mehrerer quellenspezifischer Empfangssignale daraus.The present invention relates to a hearing aid with a source separation device for receiving a mixed signal from a plurality of sound sources and for generating a plurality of source-specific reception signals therefrom.

Ein zentrales Problem für Hörgeräteträger ist das Sprachverstehen in einer Umgebung mit mehreren akustischen Quellen. Eine derartige Situation entsteht beispielsweise bei einer Feier, bei der viele Gäste gleichzeitig und mit etwa gleicher Lautstärke reden. Dieses Problem wird daher als so genanntes "cocktail party problem" bezeichnet.A key issue for hearing aid users is understanding speech in an environment with multiple acoustic sources. Such a situation arises, for example, in a celebration in which many guests talk at the same time and with about the same volume. This problem is therefore referred to as the so-called cocktail party problem.

Eine Möglichkeit zur Verbesserung der Sprachverständlichkeit besteht darin, ein Richtmikrofon einzusetzen. Hierbei muss der Hörgeräteträger in diejenige Richtung schauen, aus der er bevorzugt Schall empfangen möchte. Nachteilig an dieser Lösung ist jedoch, dass der Kopf nicht von der Quelle abgedreht werden darf. Es fehlt somit an Flexibilität. Außerdem können in dem Winkelbereich, in dem das Richtmikrofon empfindlich ist, mehrere Quellen liegen.One way to improve speech intelligibility is to use a directional microphone. In this case, the hearing aid wearer has to look in the direction from which he prefers to receive sound. The disadvantage of this solution, however, is that the head must not be turned off from the source. There is thus a lack of flexibility. In addition, there may be multiple sources in the angular range in which the directional microphone is sensitive.

Eine alternative Methode ist aus der Telefontechnik bekannt. Hier können mit so genannter BSS-Technik (blind source separation) Signale von Quellen aus unterschiedlichen Richtungen aus dem Gesamtsignalgemisch getrennt werden. Beispielsweise nehmen an einer Telefonkonferenz in einem Raum drei Sprecher teil. Mit der BSS-Technik ist es dann möglich, drei verschiedene Kanäle zur Verfügung zu stellen, auf denen je ein Sprecher bevorzugt übertragen wird.An alternative method is known from telephone technology. Here, with so-called BSS technology (blind source separation) signals from sources from different directions can be separated from the overall signal mixture. For example, three speakers attend a conference call in one room. With the BSS technique, it is then possible to provide three different channels on which one speaker is preferably transmitted.

Aus der Druckschrift US 2003/0185411 A1 ist ein Verfahren zur Quellentrennung bekannt, bei dem die Signale unterschiedlicher Quellen getrennt dargeboten werden können. Der Benutzer kann dann die gewünschte Quelle auswählen.From the publication US 2003/0185411 A1 is a method for source separation is known in which the signals from different sources can be presented separately. The user can then select the desired source.

Die Aufgabe der vorliegenden Erfindung besteht somit darin, die Wahrnehmbarkeit einer gewünschten Quelle für den Nutzer eines Hörgeräts zu verbessern.The object of the present invention is therefore to improve the perceptibility of a desired source for the user of a hearing aid.

Erfindungsgemäß wird diese Aufgabe entsprechend Patentanspruch 1 gelöst durch ein Hörgerät mit einer Quellentrennungseinrichtung zum Empfangen wenigstens eines Mischsignals von mehreren Schallquellen und zum Erzeugen mehrerer quellenspezifischer Empfangssignale daraus, sowie einer Darbietungseinrichtung zum Darbieten je eines entsprechenden Ausgangssignals zu jedem der mehreren Eingangssignale und einer Auswahleinrichtung zum Auswählen eines der mehreren Eingangssignale durch einen Benutzer zur weiteren Verarbeitung. Von der Quellentrennungseinrichtung wird zu jedem der mehreren Empfangssignale eine Winkelinformation über einen Empfangswinkel bereitgestellt. Anhand der Winkelinformation kann der Nutzer die gewünschte Quelle rascher identifizieren. Die mehreren Ausgangssignale werden dann in Abhängigkeit von den zugehörigen Empfangswinkeln von der Darbietungseinrichtung dargeboten. Hierdurch kann sich der Nutzer leichter orientieren, denn es können beispielsweise die Quellen stets in einer festen Abfolge von links nach rechts dargeboten werden.According to the invention, this object is achieved according to claim 1 by a hearing device having a source separation device for receiving at least one composite signal from a plurality of sound sources and generating a plurality of source-specific reception signals therefrom, and a presentation device for presenting each corresponding output signal to each of the plurality of input signals and a selection device for selecting one the multiple input signals by a user for further processing. From the source separation means, angle information about a reception angle is provided to each of the plurality of reception signals. Based on the angle information, the user can identify the desired source more quickly. The plurality of output signals are then presented in response to the associated reception angles from the presentation device. This makes it easier for the user to orient themselves, because, for example, the sources can always be presented in a fixed sequence from left to right.

Ferner ist erfindungsgemäß bereitgestellt ein diesbezügliches Verfahren entsprechend Patentanspruch 9.Furthermore, according to the invention, a related method according to claim 9 is provided.

Der Erfindung liegt der Gedanke zugrunde, dass es sich bei einem Hörgerät nach einer Trennung der Quellen nicht automatisch klären lässt, welche davon bevorzugt dargeboten werden soll. Der Hörgeräteträger kann nun erfindungsgemäß in einen der bereitgestellten Kanäle schalten, um der entsprechenden Quelle zuhören zu können.The invention is based on the idea that a hearing device can not automatically be clarified after a separation of the sources, which of them should preferably be presented. The hearing device wearer can now according to the invention switch to one of the channels provided in order to be able to listen to the corresponding source.

Vorzugsweise steht die Auswahleinrichtung mit der Darbietungseinrichtung in drahtloser Verbindung. Insbesondere kann die Hörvorrichtung eine Hörgerätefernbedienung aufweisen, wobei die Auswahleinrichtung in die Hörgerätefernbedienung integriert ist. Durch die Hörgerätefernbedienung ist eine Auswahl einer Quelle in komfortabler Weise möglich.The selection device is preferably in wireless communication with the presentation device. In particular, the hearing device may have a hearing device remote control, the selection device being integrated into the hearing device remote control is. With the hearing aid remote control, a selection of a source is possible in a comfortable way.

Bei einer speziellen Ausgestaltung kann die Hörvorrichtung ein Gehäuse aufweisen, wobei mit der Auswahleinrichtung ein Klopfen an das Gehäuse als Wählsignal registrierbar ist. Durch diese Gestaltung der Hörvorrichtung kann beispielsweise auf einen Schalter als Bedienelement verzichtet werden.In a specific embodiment, the hearing device may comprise a housing, wherein the selector means a knock on the housing as a dialing signal is registered. By this design of the hearing device can be dispensed with, for example, a switch as a control element.

In vorteilhafter Weise können erfindungsgemäß die getrennten Quellen separat nacheinander dargeboten werden. Das Nacheinanderdarbieten bringt für den Nutzer den Vorteil, dass er die sämtlichen Quellen dargeboten bekommt, ohne selbst konzentriert aktiv werden zu müssen, insbesondere ohne Blickkontakt auf eine Schalteinheit. Vorzugsweise können die Ausgangssignale von der Darbietungseinrichtung in einer vordefinierten Zeitfolge dargeboten werden. Auf diese Weise können dem Nutzer manuelle Schaltvorgänge erspart werden.Advantageously, according to the invention, the separate sources can be presented separately one after the other. The successive presentation brings the advantage to the user that he gets all the sources offered without having to be actively involved, especially without eye contact with a switching unit. Preferably, the output signals from the presentation device can be presented in a predefined time sequence. In this way, the user can be spared manual switching operations.

Eine weitere bevorzugte Ausgestaltung besteht darin, dass die Auswahleinrichtung über eine Display-Einheit verfügt, auf der Schallquellen in Abhängigkeit von den jeweiligen Empfangswinkeln grafisch darstellbar sind. Durch die grafische Darstellung kann sich mancher Nutzer besser und schneller orientieren.A further preferred embodiment consists in that the selection device has a display unit on which sound sources can be displayed graphically as a function of the respective reception angles. Due to the graphical representation, some users can orient themselves better and faster.

Darüber hinaus kann von der Quellentrennungseinrichtung anhand der bereitgestellten Winkelinformationen ein Ausrichten der Hörvorrichtung auf eine der Schallquellen als Wählsignal automatisch registriert werden. Dadurch bedarf es keines speziellen Bedienelements für manuelle Bedienung auf der Hörvorrichtung.In addition, the source separation device can automatically register an alignment of the hearing device with one of the sound sources as a selection signal on the basis of the provided angle information. This requires no special operating element for manual operation on the hearing device.

Wird von der Quellentrennungseinrichtung keine Winkelinformation bereitgestellt, so ist es erforderlich, dass die Hörvorrichtung ein Richtmikrofon aufweist, sodass ein Ausrichten der Hörvorrichtung auf eine der Schallquellen für die Auswahleinrichtung als Wählsignal automatisch registriert werden kann. Auch in diesem Fall ist der Nutzer von einem manuellen Bedienen befreit.If no angle information is provided by the source separation device, then it is necessary for the hearing device to have a directional microphone, so that an alignment of the hearing device with one of the sound sources for the selection device is automatically registered as a selection signal can. Also in this case, the user is released from manual operation.

Die vorliegende Erfindung wird dann anhand der beigefügten Figur näher erläutert, die ein Prinzipschaltbild einer erfindungsgemäßen Hörvorrichtung wiedergibt.The present invention will be explained in more detail with reference to the accompanying figure, which shows a schematic diagram of a hearing device according to the invention.

Die nachfolgend näher geschilderten Ausführungsbeispiele stellen bevorzugte Ausführungsformen der vorliegenden Erfindung dar.The embodiments described in more detail below represent preferred embodiments of the present invention.

Das in der FIG wiedergegebene erfindungsgemäße Hörgerät verfügt über mehrere eingangsseitige Mikrofone M1, M2, ..., Mn. Jedes der Mikrofonsignale besteht aus einem Mischsignal, das von mehreren Signalquellen hervorgerufen wird. Eine an die Mikrofone angeschlossene BSS-Einheit führt eine automatische Quellentrennung durch. Demnach stellt die BSS-Einheit quellenspezifische Ausgangssignale Q1, Q2, ..., Qm zur Verfügung. Ein der BSS-Einheit nachgeschalteter Demultiplexer DM dient zur Auswahl einer der Ausgangssignale Q1 bis Qm, die jeweils das Schaltsignal einer der Schallquellen bevorzugt beinhalten. Das Ausgangssignal des Demultiplexers DM wird einer üblichen Signalverarbeitungseinheit SV zugeführt. Deren Ausgangssignal wiederum wird einem Lautsprecher L zugeleitet.The hearing aid according to the invention shown in FIG has a plurality of input-side microphones M1, M2, ..., Mn. Each of the microphone signals consists of a mixed signal, which is caused by several signal sources. A BSS unit connected to the microphones performs automatic source separation. Thus, the BSS unit provides source specific output signals Q1, Q2, ..., Qm. A demultiplexer DM connected downstream of the BSS unit is used to select one of the output signals Q1 to Qm, each of which preferably contains the switching signal of one of the sound sources. The output signal of the demultiplexer DM is fed to a conventional signal processing unit SV. Its output signal in turn is fed to a loudspeaker L.

Zur Auswahl des gewünschten Quellsignals Q1 bis Qm wird der Demultiplexer DM von einer Steuereinrichtung S1 und/oder S2 angesteuert. Diese Steuereinrichtungen dienen sowohl als Darbietungseinrichtung, d. h. zum aufeinander folgenden Darbieten jedes Quellsignals Q1 bis Qm, als auch als Auswahleinrichtung zum Auswählen eines gewünschten Quellsignals anhand einer aufeinander folgenden Darbietung der Einzelsignale. Entsprechend einer ersten Ausführungsform wird der Demultiplexer DM mit einer Steuereinheit S1 angesteuert, die über eine oder mehrere Tasten verfügt. Dadurch kann der Nutzer beispielsweise die Darbietungsreihenfolge ändern und per Tastendruck ein Quellsignal auswählen.To select the desired source signal Q1 to Qm, the demultiplexer DM is controlled by a control device S1 and / or S2. These control devices serve both as a presentation device, ie for the consecutive presentation of each source signal Q1 to Qm, as well as a selection device for selecting a desired source signal on the basis of a successive presentation of the individual signals. According to a first embodiment of the demultiplexer DM is controlled by a control unit S1, which has one or more keys. As a result, the user can, for example, change the presentation order and select a source signal by pressing a button.

Entsprechend einer weiteren Ausführungsform wird der Demultiplexer DM durch eine Steuereinheit S2, die über ein Display verfügt, angesteuert. Auf dem Display werden die erkannten Quellen dargestellt. Gegebenenfalls werden auch Winkelinformationen bezüglich eines Winkels beispielsweise zwischen einer Schaltquelle und einer 0°-Richtung grafisch oder numerisch wiedergegeben. Mit dieser grafischen Wiedergabe kann sich der Hörgeräteträger die verschiedenen Quellen besser vorstellen und durch Vergleich mit den realen Quellen kann er leichter eine Auswahl treffen. Als Steuereinheit können grundsätzlich auch andere Bedienschnittstellen verwendet werden.According to a further embodiment, the demultiplexer DM is controlled by a control unit S2, which has a display. The recognized sources are shown on the display. Optionally, angle information relating to an angle, for example between a switching source and a 0 ° direction, is also displayed graphically or numerically. With this graphical representation, the hearing aid wearer can better visualize the different sources, and by making comparisons with the real sources, he can more easily make a choice. In principle, other control interfaces can also be used as the control unit.

Die Quellenauswahl soll also von dem Hörgeräteträger durch eine Bedienschnittstelle bzw. ein Bediengerät manuell vorgenommen werden können. Als Bediengerät kommt beispielsweise ein externes Gerät in Frage, wie z. B. die HörgeräteFernbedienung oder ein um diese Bedienfunktion erweitertes Mobilfunkgerät, ein entsprechender tragbarer Computer oder das Hörgerät selbst.The source selection should therefore be able to be performed manually by the hearing aid wearer by means of an operator interface or an operator control device. As an operating device, for example, an external device in question, such. B. the hearing aid remote control or extended to this operating function mobile device, a corresponding portable computer or the hearing aid itself.

Die gewünschte Quelle wird von dem Hörgeräteträger ausgewählt, indem ihm von dem Hörgerät bzw. den Hörgeräten nacheinander jede Quelle bevorzugt, d. h. mit erhöhtem Pegel, dargeboten wird. Der Hörgeräteträger quittiert durch das Bediengerät die von ihm gewünschte Quelle. Im einfachsten Fall wird von einer zur nächsten Quelle durch einen Knopfdruck weitergeschaltet. Beispielsweise erfolgt das Weiterschalten durch Knopfdruck oder Klopfzeichen am Hörgerät, falls dieses als Bediengerät verwendet wird.The desired source is selected by the hearing aid wearer by preferring each source from the hearing aid (s) successively, i. H. with increased level, is presented. The hearing aid wearer acknowledges the desired source by the operating device. In the simplest case, switching from one to the next source by pressing a button. For example, the further switching by pressing a button or knocking the hearing aid, if this is used as an operating device.

Für den Fall, dass das BSS-System auch die Winkelinformation zu den einzelnen Quellen liefert (DOA estimation = direction of arrival estimation), können die Quellen im Auswahlprozess nacheinander in einer festgelegten Winkelrichtung sortiert dargeboten werden. Beispielsweise kann die Winkelrichtung im Uhrzeigersinn oder entgegen dem Uhrzeigersinn festgelegt sein. Es kann aber auch ein Umschalten der Winkelrichtung ermöglicht werden, um den Bedürfnissen des Nutzers besser entgegen zu kommen.In the event that the BSS system also supplies the angle information to the individual sources (DOA estimation = direction of arrival estimation), the sources in the selection process can be presented sequentially sorted in a predetermined angular direction. For example, the angular direction may be set clockwise or counterclockwise. But it can also be a switching of the angular direction allows to better meet the needs of the user.

Bei dem Ausführungsbeispiel mit dem Steuergerät S2 verfügt das Bediengerät über eine Displayfunktion, sodass die Positionen der gefundenen Quellen visualisiert werden können. Wird ein Touchscreen verwendet, so kann die Auswahl direkt über den Bildschirm erfolgen. Hierzu ist es jedoch erforderlich, dass vorher die Positionsinformationen der Quellen zum Bediengerät übertragen werden.In the embodiment with the control unit S2, the operating device has a display function, so that the positions of the found sources can be visualized. If a touch screen is used, the selection can be made directly via the screen. However, this requires that the position information of the sources be transferred to the HMI device beforehand.

Die gewünschte Quelle kann alternativ auch dadurch ausgewählt werden, dass der Träger des Hörgeräts bzw. der Hörvorrichtung in die Richtung der gewünschten Quelle blickt. In diesem Fall wird die Steuerung des Demultiplexers unmittelbar durch die BSS-Einheit durchgeführt. Der BSS-Einheit muss in diesem Fall jedoch beispielsweise durch Knopfdruck mitgeteilt werden, dass die gewünschte Quelle, die nun in der 0°-Richtung liegt, ausgewählt werden soll. Nach diesem halbautomatischen Wählvorgang muss der Hörgeräteträger nicht mehr ständig die gewünschte Quelle ansehen und dennoch wird ihm der Schall dieser Quelle weiterhin bevorzugt dargeboten. Optional kann der Wählvorgang dadurch voll automatisiert werden, dass eine Quelle dann automatisch ausgewählt wird, wenn sie länger als eine vorgegebene Zeitdauer (z. B. 4 s) während ihrer bevorzugten Darbietung angeblickt wird.Alternatively, the desired source may also be selected by the wearer of the hearing aid or hearing device looking in the direction of the desired source. In this case, the control of the demultiplexer is performed directly by the BSS unit. In this case, however, the BSS unit must be informed by pressing a button, for example, that the desired source, which is now in the 0 ° direction, should be selected. After this semi-automatic dialing, the hearing aid wearer no longer has to constantly watch the desired source, and yet the sound of that source is still preferred to him. Optionally, the dialing process can be fully automated by automatically selecting a source when it is viewed for more than a predetermined amount of time (eg, 4 seconds) during its preferred performance.

Wird von dem BSS-System keine Winkelinformation geliefert, so besteht gemäß einer weiteren Ausführungsform dennoch die Möglichkeit, dass der Hörgeräteträger zur Auswahl einer ihn interessierenden Quelle in deren Richtung (0°-Richtung azimuth = Blickrichtung) schaut. In diesem Fall ist Voraussetzung, dass in dem Hörgerät gleichzeitig ein hochselektives Richtmikrofon arbeitet, das nur Schall aus einem sehr schmalen Winkelbereich um die 0°-Richtung empfängt. Durch einen Bedienvorgang am Hörgerät bzw. an einem mit dem Hörgerät gekoppelten Gerät wird dem Hörgerät beispielsweise durch Knopfdruck mitgeteilt, dass der vom Richtmikrofon empfangene Schall als Nutzschall zu verarbeiten ist. Aus der Menge aller Quellen, die das BSS-System gefunden hat, wird die über die Blickrichtung definierte Nutzquelle automatisch beispielsweise durch Korrelationsanalyse ausgewählt und dem Hörgeräteträger bevorzugt dargeboten. Auch nach diesem "Lernvorgang" muss die Quelle nicht mehr ständig angesehen werden.If no angle information is supplied by the BSS system, according to a further embodiment there is nevertheless the possibility that the hearing aid wearer looks in the direction of the source of interest (0 ° azimuth direction) for selecting a source of interest. In this case, it is a prerequisite that a highly selective directional microphone works simultaneously in the hearing aid, which receives only sound from a very narrow angle range around the 0 ° direction. By an operation on the hearing aid or on a device coupled to the hearing aid, the hearing aid is informed, for example by pressing a button, that the sound received by the directional microphone Sound is to be processed as useful sound. From the set of all sources that the BSS system has found, the useful source defined via the viewing direction is automatically selected, for example, by correlation analysis and preferably presented to the hearing device wearer. Even after this "learning process", the source no longer has to be viewed constantly.

Claims (12)

Hörgerät mit - einer Quellentrennungseinrichtung (BSS) zum Empfangen wenigstens eines Mischsignals von mehreren Schallquellen und zum Erzeugen mehrerer quellenspezifischer Empfangssignale (Q1, Q2, ..., Qm) daraus, - einer Darbietungseinrichtung zum Darbieten je eines entsprechenden Ausgangssignals zu jedem der mehreren Eingangssignale und - einer Auswahleinrichtung (S1, S2) zum Auswählen eines der mehreren Eingangssignale durch einen Benutzer zur weiteren Verarbeitung (SV). dadurch gekennzeichnet, dass - von der Quellentrennungseinrichtung (BSS) zu jedem der mehreren quellenspezifischen Empfangssignale (Q1, Q2, ..., Qm) eine Winkelinformation über einen Empfangswinkel bereitstellbar ist, und - die mehreren Ausgangssignale in Abhängigkeit von den zugehörigen Empfangswinkeln von der Darbietungseinrichtung darbietbar sind. Hearing aid with a source separation device (BSS) for receiving at least one composite signal from a plurality of sound sources and generating a plurality of source-specific reception signals (Q1, Q2, ..., Qm) therefrom, - A presentation device for presenting each a corresponding output signal to each of the plurality of input signals and - Selection means (S1, S2) for selecting one of the plurality of input signals by a user for further processing (SV). characterized in that - from the source separation means (BSS) to each of the plurality of source-specific receive signals (Q1, Q2, ..., Qm) an angle information on a reception angle can be provided, and - The plurality of output signals in response to the associated reception angles of the presentation device are presentable. Hörgerät nach Patentanspruch 1, wobei die Auswahleinrichtung (S1, S2) mit der Darbietungseinrichtung in drahtloser Verbindung steht.Hearing aid according to claim 1, wherein the selection device (S1, S2) is in wireless communication with the presentation device. Hörgerät nach Patentanspruch 2, die eine Hörgerätefernbedienung aufweist, wobei die Auswahleinrichtung (S1, S2) in die Hörgerätefernbedienung integriert ist.Hearing aid according to claim 2, which has a hearing aid remote control, wherein the selection device (S1, S2) is integrated in the hearing device remote control. Hörgerät nach einem der vorhergehenden Patentansprüche, die ein Gehäuse aufweist, wobei mit der Auswahleinrichtung ein Klopfen an das Gehäuse als Wählsignal registrierbar ist.Hearing aid according to one of the preceding claims, comprising a housing, wherein with the selection means a knock on the housing can be registered as a dial signal. Hörgerät nach einem der vorhergehenden Patentansprüche, wobei die Ausgangssignale von der Darbietungseinrichtung aufeinander folgend, insbesondere in einer vordefinierten Zeitfolge darbietbar sind.Hearing aid according to one of the preceding claims, wherein the output signals from the presentation device can be presented consecutively, in particular in a predefined time sequence. Hörgerät nach einem der vorhergehenden Patentansprüche, wobei die Auswahleinrichtung (S1, S2) über eine Display-Einheit verfügt, auf der Schallquellen in Abhängigkeit von den jeweiligen Empfangswinkeln grafisch darstellbar sind.Hearing aid according to one of the preceding claims, wherein the selection device (S1, S2) has a display unit on which sound sources in dependence on the respective reception angles are graphically displayed. Hörgerät nach einem der vorhergehenden Patentansprüche, wobei von der Quellentrennungseinrichtung (BSS) anhand der bereitgestellten Winkelinformationen ein Ausrichten der Hörvorrichtung auf eine der Schallquellen als Wählsignal automatisch oder halbautomatisch registrierbar ist.Hearing aid according to one of the preceding claims, wherein from the source separation device (BSS) on the basis of the provided angle information, an alignment of the hearing on one of the sound sources as a dialing signal automatically or semi-automatically registered. Hörgerät nach einem der Patentansprüche 1 bis 5, wobei die Auswahleinrichtung ein Richtmikrofon umfasst, sodass ein Ausrichten der Hörvorrichtung auf eine der Schallquellen als Wählsignal automatisch oder halbautomatisch registrierbar ist.Hearing aid according to one of the claims 1 to 5, wherein the selection device comprises a directional microphone, so that an alignment of the hearing device is automatically or semi-automatically registerable to one of the sound sources as a dial signal. Verfahren zum Steuern eines Hörgeräts durch - Empfangen wenigstens eines Mischsignals von mehreren Schallquellen, - Erzeugen mehrerer quellenspezifischer Empfangssignale (Q1, Q2, ..., Qm) aus dem wenigstens ein Mischsignal, - Darbieten je eines entsprechenden Ausgangssignals zu jedem der mehreren Eingangssignale und - Auswählen eines der mehreren Eingangssignale zur weiteren Verarbeitung (SV), dadurch gekennzeichnet, dass - zu jedem der mehreren quellenspezifischen Eingangssignale (Q1, Q2, ..., Qm) eine Winkelinformation über einen Empfangswinkel bereitgestellt wird, und - die mehreren Ausgangssignale in Abhängigkeit von den zugehörigen Empfangswinkeln dargeboten werden. A method for controlling a hearing aid Receiving at least one mixed signal from a plurality of sound sources, Generating a plurality of source-specific received signals (Q1, Q2,..., Qm) from the at least one mixed signal, Presenting a respective output signal to each of the plurality of input signals and Selecting one of the plurality of input signals for further processing (SV), characterized in that for each of the plurality of source-specific input signals (Q1, Q2, ..., Qm), angle information about a reception angle is provided, and - The plurality of output signals are presented in dependence on the associated reception angles. Verfahren nach Patentanspruch 9, wobei ein Klopfen an ein Gehäuse der Hörvorrichtung als Wählsignal registriert wird.The method of claim 9, wherein a knock is registered to a housing of the hearing device as a dial signal. Verfahren nach Patentanspruch 9 oder 10, wobei die Ausgangssignale aufeinander folgend, insbesondere in einer vordefinierten Zeitfolge dargeboten werden.Method according to claim 9 or 10, wherein the output signals are presented consecutively, in particular in a predefined time sequence. Verfahren nach einem der Patentansprüche 9 bis 11, wobei anhand der bereitgestellten Winkelinformationen ein Ausrichten der Hörvorrichtung auf eine der Schallquellen als Wählsignal automatisch oder halbautomatisch registriert wird.Method according to one of the claims 9 to 11, wherein on the basis of the provided angle information, an alignment of the hearing device is automatically or semi-automatically registered to one of the sound sources as a dial signal.
EP07106037.0A 2006-04-21 2007-04-12 Hearing aid with source separation and corresponding method Not-in-force EP1848245B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102006018634.6A DE102006018634B4 (en) 2006-04-21 2006-04-21 Hearing aid with source separation and corresponding method

Publications (3)

Publication Number Publication Date
EP1848245A2 true EP1848245A2 (en) 2007-10-24
EP1848245A3 EP1848245A3 (en) 2008-03-12
EP1848245B1 EP1848245B1 (en) 2015-11-04

Family

ID=38180701

Family Applications (1)

Application Number Title Priority Date Filing Date
EP07106037.0A Not-in-force EP1848245B1 (en) 2006-04-21 2007-04-12 Hearing aid with source separation and corresponding method

Country Status (4)

Country Link
US (1) US8199945B2 (en)
EP (1) EP1848245B1 (en)
DE (1) DE102006018634B4 (en)
DK (1) DK1848245T3 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2200341A1 (en) 2008-12-16 2010-06-23 Siemens Audiologische Technik GmbH Method for operating a hearing aid and hearing aid with a source separation device

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3796678A1 (en) * 2013-11-05 2021-03-24 Oticon A/s A binaural hearing assistance system allowing the user to modify a location of a sound source
US10388297B2 (en) * 2014-09-10 2019-08-20 Harman International Industries, Incorporated Techniques for generating multiple listening environments via auditory devices
FR3051093A1 (en) * 2016-05-03 2017-11-10 Sebastien Thibaut Arthur Carriou METHOD FOR IMPROVING NOISE UNDERSTANDING
WO2018154143A1 (en) 2017-02-27 2018-08-30 Tympres Bvba Measurement-based adjusting of a device such as a hearing aid or a cochlear implant
EP3373603B1 (en) * 2017-03-09 2020-07-08 Oticon A/s A hearing device comprising a wireless receiver of sound
CN114900771B (en) * 2022-07-15 2022-09-23 深圳市沃特沃德信息有限公司 Volume adjustment optimization method, device, equipment and medium based on consonant earphone

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001087011A2 (en) 2000-05-10 2001-11-15 The Board Of Trustees Of The University Of Illinois Interference suppression techniques
EP1538874A2 (en) 2003-12-01 2005-06-08 Siemens Audiologische Technik GmbH Hearing device with direction dependent signal processing and corresponding method

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5737430A (en) * 1993-07-22 1998-04-07 Cardinal Sound Labs, Inc. Directional hearing aid
US5479522A (en) * 1993-09-17 1995-12-26 Audiologic, Inc. Binaural hearing aid
US6766029B1 (en) * 1997-07-16 2004-07-20 Phonak Ag Method for electronically selecting the dependency of an output signal from the spatial angle of acoustic signal impingement and hearing aid apparatus
GB9813973D0 (en) * 1998-06-30 1998-08-26 Univ Stirling Interactive directional hearing aid
DE10145994C2 (en) * 2001-09-18 2003-11-13 Siemens Audiologische Technik Hearing aid and method for controlling a hearing aid by tapping
US7243060B2 (en) * 2002-04-02 2007-07-10 University Of Washington Single channel sound separation
US7457426B2 (en) * 2002-06-14 2008-11-25 Phonak Ag Method to operate a hearing device and arrangement with a hearing device
US7076072B2 (en) * 2003-04-09 2006-07-11 Board Of Trustees For The University Of Illinois Systems and methods for interference-suppression with directional sensing patterns
US7319769B2 (en) * 2004-12-09 2008-01-15 Phonak Ag Method to adjust parameters of a transfer function of a hearing device as well as hearing device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001087011A2 (en) 2000-05-10 2001-11-15 The Board Of Trustees Of The University Of Illinois Interference suppression techniques
EP1538874A2 (en) 2003-12-01 2005-06-08 Siemens Audiologische Technik GmbH Hearing device with direction dependent signal processing and corresponding method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2200341A1 (en) 2008-12-16 2010-06-23 Siemens Audiologische Technik GmbH Method for operating a hearing aid and hearing aid with a source separation device

Also Published As

Publication number Publication date
DE102006018634A1 (en) 2007-10-25
EP1848245A3 (en) 2008-03-12
US20070253573A1 (en) 2007-11-01
DE102006018634B4 (en) 2017-12-07
DK1848245T3 (en) 2016-02-15
EP1848245B1 (en) 2015-11-04
US8199945B2 (en) 2012-06-12

Similar Documents

Publication Publication Date Title
EP1848245B1 (en) Hearing aid with source separation and corresponding method
EP1912474B1 (en) Method for operating a hearing aid and hearing aid
DE60307576T2 (en) A method for adjusting a hearing aid to a current acoustic environment situation and a hearing aid system
EP2389753B1 (en) Conference system and associated signalling method
DE102004034376A1 (en) Variable screen ratio image output device and control method for such device
EP1328136A2 (en) Selection of communication connections for hearing aids
DE102014011963A1 (en) Intercom network and microphone unit
DE102015118553A1 (en) Systems and methods for selecting audio filter methods
DE19839250A1 (en) Audio signal output apparatus for simultaneous output to loudspeaker and headphones
EP1912472A1 (en) Method for operating a hearing aid and hearing aid
EP2077059B1 (en) Method for operating a hearing aid, and hearing aid
WO2008043758A1 (en) Method for operating a hearing aid, and hearing aid
EP0718994A2 (en) Processing system for audiosignals
EP2120484B1 (en) Method for operating a hearing device and hearing device
EP2820553B1 (en) Coupling device and method for dynamically allocating usb endpoints of a usb interface, and exchange trading system terminal with coupling device
EP2499837B1 (en) Microphone system
DE102007003551A1 (en) Media playback system with real-time camera image display and associated process
EP1351552A2 (en) Method for adapting a hearing aid to a momentary acoustic environment situation and hearing aid system
EP2111058A1 (en) Method and audio device for changing the sequence of programme areas
DE102007058585B4 (en) Apparatus and method for conducting remote meetings
DE102006004248A1 (en) Testing technical device with user interface, e.g. navigation device, involves detecting device function using real reaction pattern synchronized with interaction pattern, comparing actual, stored reaction patterns to give assessment data
EP1721413A1 (en) Stations that are connected to a conference system via external network units
WO2002015569A1 (en) Multimedia frame
EP1357670A3 (en) Multichannel radio receiver
DE102017100993A1 (en) Control unit of an indoor unit of a door intercom system for selecting the transmission of input and output data

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

17P Request for examination filed

Effective date: 20080710

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150617

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIVANTOS GMBH

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 759900

Country of ref document: AT

Kind code of ref document: T

Effective date: 20151115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502007014368

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20160208

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20151104

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160304

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160205

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160304

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502007014368

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160430

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20160805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160412

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160412

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 759900

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160412

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160412

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20070412

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20190418

Year of fee payment: 13

Ref country code: DK

Payment date: 20190425

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20190423

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20190424

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20190424

Year of fee payment: 13

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 502007014368

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20200430

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201103

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200430

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200430

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200430

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20200412

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200430

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200412