EP2793488B1 - Binaural microphone adjustment by means of the user's own voice - Google Patents
Binaural microphone adjustment by means of the user's own voice Download PDFInfo
- Publication number
- EP2793488B1 EP2793488B1 EP14157214.9A EP14157214A EP2793488B1 EP 2793488 B1 EP2793488 B1 EP 2793488B1 EP 14157214 A EP14157214 A EP 14157214A EP 2793488 B1 EP2793488 B1 EP 2793488B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- voice
- hearing aid
- wearer
- acousto
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 claims description 19
- 230000011664 signaling Effects 0.000 claims 1
- 230000008569 process Effects 0.000 description 6
- 210000003128 head Anatomy 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000001419 dependent effect Effects 0.000 description 3
- 210000005069 ears Anatomy 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 208000032041 Hearing impaired Diseases 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 210000000988 bone and bone Anatomy 0.000 description 2
- 210000000613 ear canal Anatomy 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011109 contamination Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 210000000883 ear external Anatomy 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 210000000867 larynx Anatomy 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000004643 material aging Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
- 210000003454 tympanic membrane Anatomy 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/43—Electronic input selection or mixing based on input signal analysis, e.g. mixing or selection between microphone and telecoil or between microphones with different directivity characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/40—Arrangements for obtaining a desired directivity characteristic
- H04R25/407—Circuits for combining signals of a plurality of transducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/552—Binaural
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R29/00—Monitoring arrangements; Testing arrangements
- H04R29/004—Monitoring arrangements; Testing arrangements for microphones
- H04R29/005—Microphone arrays
- H04R29/006—Microphone matching
Definitions
- the present invention relates to a hearing aid system, wherein the hearing aid system has a first and a second hearing aid.
- the first hearing aid has a first acousto-electrical converter and the second hearing aid has a second acousto-electrical converter.
- the transducers are designed to convert incoming acoustic signals into first and second electrical signals.
- the hearing aid system has a signal processing device, wherein the signal processing device is in signal connection with the first and the second acousto-electrical converter.
- Hearing aids are portable hearing aids that are used to care for the hearing impaired.
- different types of hearing aids such as behind-the-ear hearing aids (BTE), hearing aid with external receiver (RIC: receiver in the canal) and in-the-ear hearing aids (ITE), e.g. Concha hearing aids or canal hearing aids (ITE, CIC).
- BTE behind-the-ear hearing aids
- RIC hearing aid with external receiver
- ITE in-the-ear hearing aids
- ITE in-the-ear hearing aids
- ITE in-the-ear hearing aids
- ITE concha hearing aids or canal hearing aids
- the hearing aids listed by way of example are worn on the outer ear or in the ear canal.
- bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.
- Hearing aids have in principle as essential components an input transducer, an amplifier and an output transducer.
- the input transducer is usually an acoustoelectric transducer, z. As a microphone, and / or an electromagnetic receiver, for. B. an induction coil.
- the output transducer is usually used as an electroacoustic transducer, z. As miniature speaker, or as an electromechanical transducer, z. B. bone conduction, realized.
- the amplifier is usually integrated in a signal processing device.
- binaural hearing is an essential prerequisite for spatial hearing and sound wave localization. Because of the importance of binaural processes in analyzing hearing situations, it is understandable that hearing-impaired individuals benefit more from two hearing aids for binaural care than from a single hearing aid for monaural care.
- the binaural signal processing is particularly sensitive to differences between the signals, since the natural differences in the signals from both sides of the head differ only slightly in amplitude, phase and / or frequency distribution. Therefore, it is particularly important that the signal processing in the hearing aids not artificially deviations are added.
- the microphones are particularly susceptible because, because of their small dimensions, small mechanical manufacturing tolerances result in large deviations. For the same reason, the properties can also change during operation, for example due to contamination or material aging. Since this effect usually occurs asymmetrically, the effect is particularly severe.
- the object of the present invention is therefore to provide a hearing aid system and a method for operating the hearing aid system, which allows a simple and reliable operation over a longer period of use.
- the hearing aid system according to the invention has a first and a second hearing aid device.
- the first hearing aid has a first acousto-electrical converter and the second hearing aid has a second acousto-electrical converter.
- the transducers are designed to convert incoming acoustic signals into first and second electrical signals.
- the hearing aid system has a signal processing device, wherein the signal processing device is in signal connection with the first and the second acousto-electrical converter.
- the signal processing device is designed, signal deviations caused by the first and second acousto-electrical converter in the first and / or second electrical signals based on the first and second signals determine and compensate for the wearer's own voice.
- the hearing aid system according to the invention utilizes in an advantageous manner that the wearer's own voice is distinguished by special features, in particular the symmetry with two hearing aid devices on the two ears of the wearer. It is thus particularly easy to identify deviations between the two electrical signals and then also to compensate them in the signal processing device.
- the method of operating the hearing aid system shares its advantages.
- the hearing aid system further comprises means for recognizing the wearer's own voice.
- the means for recognizing one's own voice is in signal connection with the first and the second acousto-electrical converter and is designed to signal the signal processing device to detect a signal of the wearer's own voice.
- Such a device for recognizing the wearer's own voice advantageously makes it possible for the signal processing device to determine and compensate the deviations of the first and second electrical signals even during ongoing operation without, for example, the wearer or another person starting an adaptation process.
- the device for recognizing the wearer's own voice is designed to recognize a signal of his own voice based on a level of the first and / or the second electrical signal.
- a recognition based on the level is particularly easy to implement.
- the device for detecting the wearer's own voice is designed to detect a signal of one's own voice based on a phase relationship of the first and the second electrical signal relative to one another.
- the phase position is particularly sensitive to the position and therefore a detection of your own voice in the middle between the hearing aids can be done very safe.
- the device for detecting the wearer's own voice may be designed to recognize a signal of his own voice based on a frequency distribution of the first and / or the second electrical signal.
- the own voice of the wearer Due to the influence of the head on the sound propagation, the own voice of the wearer has a special frequency characteristic which distinguishes the voice from the voices of other persons and facilitates a recognition. This applies in particular to frequency components that are transmitted as structure-borne sound.
- Fig. 1 shows the basic structure of a hearing aid system 100 according to the invention.
- the hearing aid system 100 has two hearing aids 110, 110 '.
- a hearing aid housing 1, 1 ' for carrying behind the ear, one or more microphones 2, 2' for receiving the sound or acoustic signals from the environment are installed.
- a signal processing device 3, 3 ' which is also integrated in the hearing aid housing 1, 1', processes the first audio signals.
- the output signal of the signal processing device 3, 3 ' is transmitted to a loudspeaker or receiver 4, 4', which outputs an acoustic signal.
- the sound is optionally transmitted via a sound tube, which is fixed with an earmold in the ear canal, to the eardrum of the device carrier.
- the power supply of the hearing device and in particular that of the signal processing device 3, 3 ' is effected by a likewise integrated into the hearing aid housing 1, 1' battery 5, 5 '.
- the hearing aid system 100 has a signal connection 6, which is designed to transmit a first electrical signal from the signal processing device 3 to the signal processing device 3 '. It is provided in the preferred embodiment that also signal processing device 3 'transmits a second electrical signal to the signal processing device 3 in the opposite direction.
- the signal connection 6 can be galvanic. However, in a preferred embodiment, the first and second electrical signals are converted for transmission over the signal connection.
- the signal connection can be made, for example, inductively, via Bluetooth, optically or another wireless transmission technology.
- the hearing aid system 100 also includes means 7, 7 'for detecting a separate voice of the wearer having a signal connection with the signal processing unit 3, 3'.
- the means 7, 7 'for recognizing one's own voice can, as in Fig. 1 represented, an integral part of the signal processing means 3, 3 'be. However, it is also conceivable for the device 7, 7 'to be able to recognize its own voice as a separate device in the hearing aid device 110, 110 ".
- each hearing aid device its own signal processing means 3, 3 'and get the signals of both microphones 2, 2' supplied.
- Each of the signal processing devices 2, 2 ' is then able to independently determine and compensate for the signal differences between the microphones 2, 2'.
- only one of the hearing aid devices 110, 110 “has a signal processing device 3, 3 ', which performs the signal processing, determining and compensating and the resulting signal via the signal connection 6 to the other hearing aid 110, 110' to The same applies to the device 7, 7 'for detecting a separate voice of the wearer, which is either provided in each of the hearing aid devices 110, 110 "or even in one, jointly for both hearing aids 110, 110'.
- Fig. 2 shows a schematic flow diagram of a method according to the invention in the signal processing device 3, 3 '.
- the method comprises a step S10 of detecting a first and second acoustic signal of the own voice of the wearer of the hearing aid system with the first and second acousto-electrical converter 2, 2 '.
- the acousto-electrical converters 2, 2 'or microphones 2, 2' convert the first and second acoustic signals into first and second electrical signals.
- a signal processing means determines signal deviations caused by the first and second acousto-electric transducers. These deviations may exist between the first and second electrical signals in amplitude, phase and frequency response or any combination thereof.
- the signal processing device 3, 3 compensates for the determined signal deviations.
- this can be done, for example, by a frequency-dependent amplification of the relevant signal.
- a phase deviation can be compensated by an equally frequency-dependent delay.
- the compensation also takes place with the methods of digital signal processing.
- the particular compensation parameters are preferably stored in the signal processing means 3, 3 'and used to process the first and second electrical signals until step 30 is re-executed.
- the hearing aid system 100 detects a signal of a separate voice of the wearer in a step S20.
- the voice of the wearer is characterized by various special features.
- the source of voice with larynx and mouth is symmetrically interposed with hearing aids 110, 110 'worn on the ears arranged.
- a high degree of symmetry of the signal is to be expected. Therefore, the sound waves at the first microphone 2 and the second microphone 2 'have a nearly identical phase and amplitude.
- the means for detecting 7, 7 ' may therefore, for example, assign first and second electrical signals, which have almost identical amplitude and phase, to the wearer's own voice.
- These signals also have their own frequency response and amplitude with respect to signals from voices of other people in front of the carrier, which are caused by the attenuation of the head and also by sound conduction in the head. It would also be conceivable that the microphones 2, 2 'are specially designed to also record structure-borne sound, or that, for example, other separate transducers are provided for this purpose and in this way the wearer's own voice is recognized.
- the steps S10 to S40 can be performed once or repeated independently in response to a signal from the outside or at intervals.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Neurosurgery (AREA)
- Computer Networks & Wireless Communication (AREA)
- Circuit For Audible Band Transducer (AREA)
Description
Die vorliegende Erfindung betrifft ein Hörhilfesystem, wobei das Hörhilfesystem ein erstes und ein zweites Hörhilfegerät aufweist. Das erste Hörhilfegerät weist einen ersten akusto-elektrischen Wandler und das zweite Hörhilfegerät einen zweiten akusto-elektrischen Wandler auf. Die Wandler sind ausgelegt, eintreffende akustische Signale in erste und zweite elektrische Signale zu wandeln. Weiterhin weist das Hörhilfesystem eine Signalverarbeitungseinrichtung auf, wobei die Signalverarbeitungseinrichtung in Signalverbindung mit dem ersten und dem zweiten akusto-elektrischen Wandler steht.The present invention relates to a hearing aid system, wherein the hearing aid system has a first and a second hearing aid. The first hearing aid has a first acousto-electrical converter and the second hearing aid has a second acousto-electrical converter. The transducers are designed to convert incoming acoustic signals into first and second electrical signals. Furthermore, the hearing aid system has a signal processing device, wherein the signal processing device is in signal connection with the first and the second acousto-electrical converter.
Hörhilfegeräte sind tragbare Hörvorrichtungen, die zur Versorgung von Schwerhörenden dienen. Um den zahlreichen individuellen Bedürfnissen entgegenzukommen, werden unterschiedliche Bauformen von Hörhilfegeräten wie Hinter-dem-Ohr-Hörgeräte (HdO), Hörgerät mit externem Hörer (RIC: receiver in the canal) und In-dem-Ohr-Hörgeräte (IdO), z.B. auch Concha-Hörgeräte oder Kanal-Hörgeräte (ITE, CIC), bereitgestellt. Die beispielhaft aufgeführten Hörgeräte werden am Außenohr oder im Gehörgang getragen. Darüber hinaus stehen auf dem Markt aber auch Knochenleitungshörhilfen, implantierbare oder vibrotaktile Hörhilfen zur Verfügung. Dabei erfolgt die Stimulation des geschädigten Gehörs entweder mechanisch oder elektrisch.Hearing aids are portable hearing aids that are used to care for the hearing impaired. In order to meet the numerous individual needs, different types of hearing aids such as behind-the-ear hearing aids (BTE), hearing aid with external receiver (RIC: receiver in the canal) and in-the-ear hearing aids (ITE), e.g. Concha hearing aids or canal hearing aids (ITE, CIC). The hearing aids listed by way of example are worn on the outer ear or in the ear canal. In addition, bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.
Hörgeräte besitzen prinzipiell als wesentliche Komponenten einen Eingangswandler, einen Verstärker und einen Ausgangswandler. Der Eingangswandler ist in der Regel ein akustoelektrischer Wandler, z. B. ein Mikrofon, und/oder ein elektromagnetischer Empfänger, z. B. eine Induktionsspule. Der Ausgangswandler ist meist als elektroakustischer Wandler, z. B. Miniaturlautsprecher, oder als elektromechanischer Wandler, z. B. Knochenleitungshörer, realisiert. Der Verstärker ist üblicherweise in eine Signalverarbeitungseinrichtung integriert.Hearing aids have in principle as essential components an input transducer, an amplifier and an output transducer. The input transducer is usually an acoustoelectric transducer, z. As a microphone, and / or an electromagnetic receiver, for. B. an induction coil. The output transducer is usually used as an electroacoustic transducer, z. As miniature speaker, or as an electromechanical transducer, z. B. bone conduction, realized. The amplifier is usually integrated in a signal processing device.
Es ist bekannt, dass das Hören mit zwei Ohren es einer Person eher ermöglicht, Sprache in Störgeräusch oder in verhallter Umgebung zu verstehen. Darüber hinaus ist das binaurale Hören eine wesentliche Voraussetzung für räumliches Hören und Schallwellenlokalisation. Aufgrund der Bedeutung der binauralen Prozesse bei der Analyse von Hörsituationen ist es verständlich, dass hörgeschädigte Personen mehr von zwei Hörgeräten für eine binaurale Versorgung als von einem einzigen Hörgerät für eine monaurale Versorgung profitieren.It is known that hearing with two ears makes it easier for a person to understand speech in noise or in reverberant surroundings. In addition, binaural hearing is an essential prerequisite for spatial hearing and sound wave localization. Because of the importance of binaural processes in analyzing hearing situations, it is understandable that hearing-impaired individuals benefit more from two hearing aids for binaural care than from a single hearing aid for monaural care.
Die binaurale Signalverarbeitung reagiert besonders empfindlich auf Differenzen zwischen den Signalen, da die natürlichen Unterschiede der Signale von beiden Seiten des Kopfes nur geringfügig in der Amplitude, Phase und/oder Frequenzverteilung abweichen. Daher ist es insbesondere von Bedeutung, dass durch die Signalverarbeitung in den Hörhilfegeräten nicht künstlich Abweichungen hinzugefügt werden. Dabei sind vor allem die Mikrofone besonders anfällig, da wegen ihrer kleinen Abmessungen kleine mechanische Fertigungstoleranzen große Abweichungen zur Folge haben. Aus dem gleichen Grund können sich die Eigenschaften auch im laufenden Betrieb verändern, beispielsweise durch Verschmutzung oder Materialalterung. Da dieser Effekt meist unsymmetrisch auftritt, ist die Auswirkung besonders schwerwiegend.The binaural signal processing is particularly sensitive to differences between the signals, since the natural differences in the signals from both sides of the head differ only slightly in amplitude, phase and / or frequency distribution. Therefore, it is particularly important that the signal processing in the hearing aids not artificially deviations are added. In particular, the microphones are particularly susceptible because, because of their small dimensions, small mechanical manufacturing tolerances result in large deviations. For the same reason, the properties can also change during operation, for example due to contamination or material aging. Since this effect usually occurs asymmetrically, the effect is particularly severe.
Üblicherweise werden daher bei der Herstellung Paare von Mikrofonen zusammengestellt, die nahezu identische Eigenschaften haben. Dieser Prozess ist jedoch aufwändig und verhindert nicht Veränderungen im Betrieb.Usually, therefore, in the production of pairs of microphones are assembled, which have almost identical properties. However, this process is laborious and does not prevent changes in operation.
In der Patentanmeldung
Aus der Offenlegungsschrift
Die Aufgabe der vorliegenden Erfindung ist es daher, ein Hörhilfesystem und ein Verfahren zum Betrieb des Hörhilfesystems bereitzustellen, das einen einfachen und zuverlässigen Betrieb auch über eine längere Gebrauchsdauer ermöglicht.The object of the present invention is therefore to provide a hearing aid system and a method for operating the hearing aid system, which allows a simple and reliable operation over a longer period of use.
Erfindungsgemäß wird diese Aufgabe gelöst durch ein Hörhilfesystem nach Anspruch 1 und ein Verfahren zum Betrieb des Hörhilfesystems nach Anspruch 5. Das erfindungsgemäße Hörhilfesystem weist ein erstes und ein zweites Hörhilfegerät auf. Das erste Hörhilfegerät weist einen ersten akusto-elektrischen Wandler und das zweite Hörhilfegerät einen zweiten akusto-elektrischen Wandler auf. Die Wandler sind ausgelegt, eintreffende akustische Signale in erste und zweite elektrische Signale zu wandeln. Weiterhin weist das Hörhilfesystem eine Signalverarbeitungseinrichtung auf, wobei die Signalverarbeitungseinrichtung in Signalverbindung mit dem ersten und dem zweiten akusto-elektrischen Wandler steht. Die Signalverarbeitungseinrichtung ist ausgelegt, von dem ersten und zweiten akusto-elektrischen Wandler verursachte Signalabweichungen in den ersten und/oder zweiten elektrischen Signalen anhand der ersten und zweiten Signale einer eigene Stimme des Trägers zu bestimmen und zu kompensieren.According to the invention, this object is achieved by a hearing aid system according to claim 1 and a method for operating the hearing aid system according to
Das erfindungsgemäße Hörhilfesystem nutzt dabei auf vorteilhafte Weise aus, dass die eigene Stimme des Trägers durch besondere Merkmale, insbesondere die Symmetrie zu zwei Hörhilfegeräten an den beiden Ohren des Trägers ausgezeichnet ist. So ist es besonders einfach, Abweichungen zwischen den beiden elektrischen Signalen zu identifizieren und dann auch in der Signalverarbeitungseinrichtung zu kompensieren.The hearing aid system according to the invention utilizes in an advantageous manner that the wearer's own voice is distinguished by special features, in particular the symmetry with two hearing aid devices on the two ears of the wearer. It is thus particularly easy to identify deviations between the two electrical signals and then also to compensate them in the signal processing device.
Das Verfahren zum Betrieb des Hörhilfesystems teilt dessen Vorteile.The method of operating the hearing aid system shares its advantages.
Weitere vorteilhafte Fortbildungen der Erfindung sind in den abhängigen Ansprüchen angegeben.Further advantageous developments of the invention are specified in the dependent claims.
In einer bevorzugten Ausführungsform weist das Hörhilfesystem weiterhin eine Einrichtung zum Erkennen der eigenen Stimme des Trägers auf. Die Einrichtung zum Erkennen der eigenen Stimme steht in Signalverbindung mit dem ersten und dem zweiten akusto-elektrischen Wandler und ist ausgelegt der Signalverarbeitungseinrichtung das Erkennen eines Signals der eigenen Stimme des Trägers zu signalisieren.In a preferred embodiment, the hearing aid system further comprises means for recognizing the wearer's own voice. The means for recognizing one's own voice is in signal connection with the first and the second acousto-electrical converter and is designed to signal the signal processing device to detect a signal of the wearer's own voice.
Eine derartige Einrichtung zur Erkennung der eigenen Stimme des Trägers ermöglicht es auf vorteilhafte Weise, dass die Signalverarbeitungseinrichtung auch im laufenden Betrieb die Abweichungen der ersten und zweiten elektrischen Signale bestimmt und kompensiert, ohne dass beispielsweise der Träger oder eine andere Person einen Anpassungsvorgang startet.Such a device for recognizing the wearer's own voice advantageously makes it possible for the signal processing device to determine and compensate the deviations of the first and second electrical signals even during ongoing operation without, for example, the wearer or another person starting an adaptation process.
In einer möglichen Ausführungsform ist die Einrichtung zum Erkennen der eigenen Stimme des Trägers ausgelegt, ein Signal der eigenen Stimme anhand eines Pegels des ersten und/oder des zweiten elektrischen Signals zu erkennen.In one possible embodiment, the device for recognizing the wearer's own voice is designed to recognize a signal of his own voice based on a level of the first and / or the second electrical signal.
Eine Erkennung anhand des Pegels ist dabei besonders einfach zu realisieren.A recognition based on the level is particularly easy to implement.
In einer denkbaren Ausführungsform ist die Einrichtung zum Erkennen der eigenen Stimme des Trägers ausgelegt, ein Signal der eigenen Stimme anhand einer Phasenlage des ersten und des zweiten elektrischen Signals relativ zueinander zu erkennen.In one conceivable embodiment, the device for detecting the wearer's own voice is designed to detect a signal of one's own voice based on a phase relationship of the first and the second electrical signal relative to one another.
Die Phasenlage ist besonders empfindlich bezüglich der Position und daher kann eine Erkennung der eigenen Stimme in der Mitte zwischen den Hörhilfegeräten besonders sicher erfolgen.The phase position is particularly sensitive to the position and therefore a detection of your own voice in the middle between the hearing aids can be done very safe.
In einer Ausführungsform des Hörhilfesystem kann die Einrichtung zum Erkennen der eigenen Stimme des Trägers ausgelegt sein, ein Signal der eigenen Stimme anhand einer Frequenzverteilung des ersten und/oder des zweiten elektrischen Signals zu erkennen.In one embodiment of the hearing aid system, the device for detecting the wearer's own voice may be designed to recognize a signal of his own voice based on a frequency distribution of the first and / or the second electrical signal.
Die eigene Stimme des Trägers hat wegen der Einflüsse des Kopfes auf die Schallausbreitung eine besondere Frequenzcharakteristik, die die Stimme von den Stimmen anderer Personen unterscheidet und ein Erkennen erleichtert. Dies gilt insbesondere für Frequenzanteile, die als Körperschall übertragen werden.Due to the influence of the head on the sound propagation, the own voice of the wearer has a special frequency characteristic which distinguishes the voice from the voices of other persons and facilitates a recognition. This applies in particular to frequency components that are transmitted as structure-borne sound.
Die oben beschriebenen Eigenschaften, Merkmale und Vorteile dieser Erfindung sowie die Art und Weise, wie diese erreicht werden, werden klarer und deutlicher verständlich im Zusammenhang mit der folgenden Beschreibung der Ausführungsbeispiele, die im Zusammenhang mit den Zeichnungen näher erläutert werden.The above-described characteristics, features, and advantages of this invention, as well as the manner in which they will be achieved, will become clearer and more clearly understood in connection with the following description of the embodiments, which will be described in detail in conjunction with the drawings.
Es zeigen:
- Fig. 1
- eine schematische Darstellung eines erfindungsgemäßen Hörhilfesystems;
- Fig. 2
- ein Ablaufdiagramm eines erfindungsgemäßen Verfahrens zum Betrieb eines Hörhilfesystems.
- Fig. 1
- a schematic representation of a hearing aid system according to the invention;
- Fig. 2
- a flowchart of a method according to the invention for operating a hearing aid system.
Weiterhin weist das Hörhilfesystem 100 eine Signalverbindung 6 auf, die ausgelegt ist, ein erstes elektrisches Signal von der Signalverarbeitungseinrichtung 3 zu der Signalverarbeitungseinrichtung 3' zu übertragen. Dabei ist es in der bevorzugten Ausführungsform vorgesehen, dass auch Signalverarbeitungseinrichtung 3' ein zweites elektrisches Signal zu der Signalverarbeitungseinrichtung 3 in Gegenrichtung überträgt.Furthermore, the
Die Signalverbindung 6 kann galvanisch erfolgen. In einer bevorzugten Ausführungsform jedoch werden die ersten und zweiten elektrischen Signale zur Übertragung über die Signalverbindung umgewandelt. Die Signalverbindung kann so beispielsweise induktiv, über Bluetooth, optisch oder eine andere drahtlose Übertragungstechnik erfolgen.The signal connection 6 can be galvanic. However, in a preferred embodiment, the first and second electrical signals are converted for transmission over the signal connection. The signal connection can be made, for example, inductively, via Bluetooth, optically or another wireless transmission technology.
Weiterhin ist es denkbar, die Signale mehrerer oder aller Mikrofone 2, 2' jeweils zu dem anderen Hörhilfegerät 110, 110" zu übertragen.Furthermore, it is conceivable to transmit the signals of several or all
In der bevorzugten Ausführungsform weist das Hörhilfesystem 100 auch eine Einrichtung 7, 7' zum Erkennen einer eigenen Stimme des Trägers auf, die eine Signalverbindung mit der Signalverarbeitungseinheit 3, 3' hat.In the preferred embodiment, the
Die Einrichtung 7, 7' zum Erkennen einer eigenen Stimme kann, wie in
Grundsätzlich kann, wie in
Das Verfahren weist einen Schritt S10 des Erfassens eines ersten und zweiten akustischen Signals der eigenen Stimme des Trägers des Hörhilfesystems mit dem ersten und zweiten akusto-elektrischen Wandler 2, 2' auf. Dabei wandeln die akusto-elektrischen Wandler 2, 2' beziehungsweise Mikrofone 2, 2' die ersten und zweiten akustischen Signale in erste und zweite elektrische Signale um.The method comprises a step S10 of detecting a first and second acoustic signal of the own voice of the wearer of the hearing aid system with the first and second acousto-
In einem Schritt S30 bestimmt eine Signalverarbeitungseinrichtung durch den ersten und zweiten akusto-elektrischen Wandler verursachte Signalabweichungen. Diese Abweichungen können zwischen den ersten und zweiten elektrischen Signalen in der Amplitude, der Phase und dem Frequenzgang oder beliebigen Kombinationen davon bestehen. Die Signalverarbeitungseinrichtung 3, 3' kann diese Abweichungen beispielsweise durch Pegelmesser, Filterbänke und/oder Verfahren der digitalen Signalverarbeitung wie Fourier-Transformationen erfassen.In a step S30, a signal processing means determines signal deviations caused by the first and second acousto-electric transducers. These deviations may exist between the first and second electrical signals in amplitude, phase and frequency response or any combination thereof. The
In einem Schritt S40 kompensiert die Signalverarbeitungseinrichtung 3, 3' die bestimmten Signalabweichungen. Bei einer Amplitudenabweichung kann dies beispielsweise durch eine frequenzabhängige Verstärkung des betreffenden Signals erfolgen. Eine Phasenabweichung kann durch eine ebenfalls frequenzabhängige Verzögerung kompensiert werden. Bevorzugter Weise erfolgt die Kompensation ebenfalls mit den Methoden der digitalen Signalverarbeitung.In a step S40, the
Die bestimmten Parameter zur Kompensation werden bevorzugter Weise in der Signalverarbeitungseinrichtung 3, 3' gespeichert und zur Verarbeitung der ersten und zweiten elektrischen Signale verwendet, bis Schritt 30 wieder ausgeführt wird.The particular compensation parameters are preferably stored in the signal processing means 3, 3 'and used to process the first and second electrical signals until step 30 is re-executed.
In einer bevorzugten Ausführungsform erkennt das erfindungsgemäße Hörhilfesystem 100 in einem Schritt S20 ein Signal einer eigenen Stimme des Trägers. Die Stimme des Trägers zeichnet sich durch verschiedene besondere Eigenschaften aus. So ist die Quelle der Stimme mit Kehlkopf und Mund bei an den Ohren getragenen Hörhilfegeräten 110, 110' symmetrisch dazwischen angeordnet. Dadurch ist auch eine hochgradige Symmetrie des Signals zu erwarten. Deshalb weisen die Schallwellen an dem ersten Mikrofon 2 und dem zweiten Mikrofon 2' eine nahezu identische Phase und Amplitude auf. Die Einrichtung zum Erkennen 7, 7' kann daher beispielsweise erste und zweite elektrische Signale, die nahezu identische Amplitude und Phase aufweisen, der eigenen Stimme des Trägers zuordnen. Auch weisen diese Signale gegenüber Signalen von Stimmen anderer Personen vor dem Träger einen eigenen Frequenzverlauf und Amplitude auf, der durch die Dämpfung des Kopfes und auch durch Schalleitung im Kopf verursacht werden. Es wäre auch denkbar, dass die Mikrofone 2, 2' speziell dazu ausgelegt sind, auch Körperschall aufzunehmen, oder dass beispielsweise andere separate Wandler dafür vorgesehen sind und auf diese Weise die eigene Stimme des Trägers erkannt wird.In a preferred embodiment, the
Die Schritte S10 bis S40 können einmalig ausgeführt werden oder jeweils auf ein Signal von außen hin oder in Abständen selbstständig wiederholt werden.The steps S10 to S40 can be performed once or repeated independently in response to a signal from the outside or at intervals.
Obwohl die Erfindung im Detail durch das bevorzugte Ausführungsbeispiel näher illustriert und beschrieben wurde, so ist die Erfindung nicht durch die offenbarten Beispiele eingeschränkt und andere Variationen können vom Fachmann hieraus abgeleitet werden, ohne den Schutzumfang der Erfindung zu verlassen.Although the invention has been further illustrated and described in detail by the preferred embodiment, the invention is not limited by the disclosed examples, and other variations can be derived therefrom by those skilled in the art without departing from the scope of the invention.
Claims (8)
- Hearing aid system, wherein the hearing aid system (100) has:- a first and a second hearing aid (110, 110'), wherein the first hearing aid (110) has a first acousto-electric converter (2) and the second hearing aid has a second acousto-electric converter (2') and the converters (2, 2') are designed to convert incoming acoustic signals into first and second electrical signals;- a signal processing device (3, 3'),wherein the signal processing device (3, 3') is connected to the first and second acousto-electric converters (2, 2') by way of signal links, wherein at least one of the signal links to the first and second acousto-electric converters (2, 2') is in wireless form,
wherein
the signal processing device (3, 3') is designed to determine and compensate for signal deviations in the first and/or second electrical signal(s) that are caused by the first and second acousto-electric converters (2, 2') using the first and second electrical signals from the wearer's own voice,
and wherein the hearing aid system (100) additionally has a device (7, 7') for recognising the wearer's own voice, wherein the device (7, 7') for recognising the wearer's own voice is connected to the first and second acousto-electric converters (2, 2') by way of signal links and is designed to signal to the signal processing device (3, 3') the recognition of a signal from the wearer's own voice. - Hearing aid system according to Claim 1, wherein the device (7, 7') for recognising the wearer's own voice is designed to recognise a signal from his own voice on the basis of a level of the first and/or the second electrical signal.
- Hearing aid system according to Claim 1 or 2, wherein the device (7, 7') for recognising the wearer's own voice is designed to recognise a signal from his own voice on the basis of a phase relationship between the first and second electrical signals relative to one another.
- Hearing aid system according to one of Claims 1 to 3, wherein the device (7, 7') for recognising the wearer's own voice is designed to recognise a signal from his own voice on the basis of a frequency distribution of the first and/or the second electrical signal.
- Method for adjusting a hearing aid system (100), wherein the hearing aid system (100) has:- a first and a second hearing aid (110, 110'), wherein the first hearing aid (110) has a first acousto-electric converter (2) and the second hearing aid (110') has a second acousto-electric converter (2') ;- a signal processing device (3, 3'), wherein the signal processing device is connected to the first and second acousto-electric converters (2, 2') by way of signal links, wherein at least one of the signal links to the first and second acousto-electric converters (2, 2') is made wirelessly,wherein the method has the steps of:- acquiring a first and a second acoustic signal from the own voice of the wearer of the hearing aid system (100) with the first and second acousto-electric converters (2, 2') and converting said signals into a first and a second electrical signal;- determining signal deviations in the first and/or second electrical signal(s) that are caused by the first and second acousto-electric converters (2, 2') using the first and second electrical signals from the wearer's own voice;- compensating for the signal deviations in the first and second electrical signals in the signal processing device (3, 3'),and wherein the apparatus additionally has a device (7, 7') for recognising the wearer's own voice, wherein the device (7, 7') for recognising the wearer's own voice is connected to the first and second acousto-electric converters (2, 2') by way of signal links and wherein the method additionally has the step of the device (7, 7') for recognising the wearer's own voice signalling to the signal processing device (3, 3') the recognition of a signal from the wearer's own voice.
- Method according to Claim 5, wherein the device (7, 7') for recognising the wearer's own voice recognises a signal from his own voice on the basis of a level of the first and/or the second electrical signal.
- Method according to Claim 5 or 6, wherein the device (7, 7') for recognising the wearer's own voice recognises a signal from his own voice on the basis of a phase relationship between the first and second electrical signals relative to one another.
- Method according to one of Claims 5 to 7, wherein the device (7, 7') for recognising the wearer's own voice recognises a signal from his own voice on the basis of a frequency distribution of the first and/or the second electrical signal.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102013207080.2A DE102013207080B4 (en) | 2013-04-19 | 2013-04-19 | Binaural microphone adaptation using your own voice |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2793488A1 EP2793488A1 (en) | 2014-10-22 |
EP2793488B1 true EP2793488B1 (en) | 2017-11-08 |
Family
ID=50193295
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14157214.9A Active EP2793488B1 (en) | 2013-04-19 | 2014-02-28 | Binaural microphone adjustment by means of the user's own voice |
Country Status (4)
Country | Link |
---|---|
US (1) | US9565499B2 (en) |
EP (1) | EP2793488B1 (en) |
DE (1) | DE102013207080B4 (en) |
DK (1) | DK2793488T3 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DK3588983T3 (en) * | 2018-06-25 | 2023-04-17 | Oticon As | HEARING DEVICE ADAPTED TO MATCHING INPUT TRANSDUCER USING THE VOICE OF A USER OF THE HEARING DEVICE |
CN111464905A (en) * | 2020-04-09 | 2020-07-28 | 电子科技大学 | Hearing enhancement method and system based on intelligent wearable device and wearable device |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE60204902T2 (en) | 2001-10-05 | 2006-05-11 | Oticon A/S | Method for programming a communication device and programmable communication device |
DE10228632B3 (en) * | 2002-06-26 | 2004-01-15 | Siemens Audiologische Technik Gmbh | Directional hearing with binaural hearing aid care |
ATE430321T1 (en) | 2003-02-25 | 2009-05-15 | Oticon As | METHOD FOR DETECTING YOUR OWN VOICE ACTIVITY IN A COMMUNICATION DEVICE |
US20070147635A1 (en) * | 2005-12-23 | 2007-06-28 | Phonak Ag | System and method for separation of a user's voice from ambient sound |
DE102007037659B4 (en) * | 2007-08-09 | 2013-06-13 | Siemens Audiologische Technik Gmbh | Method for operating a hearing aid system and hearing aid system |
US8031881B2 (en) * | 2007-09-18 | 2011-10-04 | Starkey Laboratories, Inc. | Method and apparatus for microphone matching for wearable directional hearing device using wearer's own voice |
US8588441B2 (en) | 2010-01-29 | 2013-11-19 | Phonak Ag | Method for adaptively matching microphones of a hearing system as well as a hearing system |
DE102010018877A1 (en) * | 2010-04-30 | 2011-06-30 | Siemens Medical Instruments Pte. Ltd. | Method for voice-controlling of hearing aid i.e. behind-the-ear-hearing aid, involves interacting speech recognition and distinct voice detection, such that voice command spoken by wearer of hearing aid is used for voice-controlling aid |
JP5607824B2 (en) * | 2010-07-05 | 2014-10-15 | ヴェーデクス・アクティーセルスカプ | System and method for measuring and confirming the obstruction effect of a hearing aid user |
-
2013
- 2013-04-19 DE DE102013207080.2A patent/DE102013207080B4/en active Active
-
2014
- 2014-02-28 DK DK14157214.9T patent/DK2793488T3/en active
- 2014-02-28 EP EP14157214.9A patent/EP2793488B1/en active Active
- 2014-04-21 US US14/257,378 patent/US9565499B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
DE102013207080A1 (en) | 2014-10-23 |
DK2793488T3 (en) | 2018-02-12 |
EP2793488A1 (en) | 2014-10-22 |
US20140314258A1 (en) | 2014-10-23 |
US9565499B2 (en) | 2017-02-07 |
DE102013207080B4 (en) | 2019-03-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3451705B1 (en) | Method and apparatus for the rapid detection of own voice | |
EP2603018B1 (en) | Hearing aid with speaking activity recognition and method for operating a hearing aid | |
EP2180726B2 (en) | Sound localization in binaural hearing aids | |
EP2506603B1 (en) | Hearing aid system with a directional microphone system and method for operating such a hearing aid system with said directional microphone system | |
DE102007017761B4 (en) | Method for adapting a binaural hearing aid system | |
EP2164283B1 (en) | Hearing aid and operation of a hearing aid with frequency transposition | |
EP2991379B1 (en) | Method and device for improved perception of own voice | |
EP1771038A2 (en) | Method for operating a hearing-aid system for binaural treatment of a user | |
AU2015201124B2 (en) | Transmission of a wind-reduced signal with reduced latency | |
EP2811762B1 (en) | Logic-based binaural beam forming system | |
EP2172062B1 (en) | Method for adapting a hearing device using a perceptive model | |
EP2822300B1 (en) | Detection of listening situations with different signal sources | |
EP2793488B1 (en) | Binaural microphone adjustment by means of the user's own voice | |
DE102016221578B3 (en) | Method for detecting a beat by means of a hearing aid | |
EP1962554A2 (en) | Hearing device with interference signal separation and corresponding method | |
EP2434781A1 (en) | Method for reconstructing a speech signal and hearing aid | |
EP2606660B1 (en) | Method for fitting a hearing device using percentile analysis | |
EP2320679A2 (en) | Hearing aid with simulation of hearing loss and method for simulating hearing loss | |
DE102011006472B4 (en) | Method for improving speech intelligibility with a hearing aid device and hearing aid device | |
EP2897383B1 (en) | Method and device for analysis of hearing aid settings | |
EP2885926A1 (en) | Hearing system and transmission method | |
DE102011089865B4 (en) | Method for adapting a frequency compression device of a hearing device and corresponding adaptation device | |
EP4149121A1 (en) | Method for operating a hearing aid | |
WO2011107545A2 (en) | Method for adjusting a directional hearing device | |
DE102012011645A1 (en) | Hearing-aid system for person with e.g. mild hearing loss, has sound receiving units associated with signal processing units, where signal processing units convert electric signals into acoustic signals to be supplied to hearing aid device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20140228 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
R17P | Request for examination filed (corrected) |
Effective date: 20150407 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: SIVANTOS PTE. LTD. |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04R 25/00 20060101AFI20170505BHEP Ipc: H04R 29/00 20060101ALI20170505BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20170623 |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: LUGGER, MARKO Inventor name: KAMKAR PARSI, HOMAYOUN |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 945235 Country of ref document: AT Kind code of ref document: T Effective date: 20171115 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502014006112 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 5 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20180207 |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: SIVANTOS PTE. LTD. |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20171108 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180208 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180308 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180208 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180209 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502014006112 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 |
|
26N | No opposition filed |
Effective date: 20180809 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20180228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180228 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 945235 Country of ref document: AT Kind code of ref document: T Effective date: 20190228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20140228 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171108 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171108 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240216 Year of fee payment: 11 Ref country code: CH Payment date: 20240301 Year of fee payment: 11 Ref country code: GB Payment date: 20240222 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240222 Year of fee payment: 11 Ref country code: DK Payment date: 20240221 Year of fee payment: 11 |