EP3355592B1 - Method for operating a binaural hearing aid system - Google Patents
Method for operating a binaural hearing aid system Download PDFInfo
- Publication number
- EP3355592B1 EP3355592B1 EP17207542.6A EP17207542A EP3355592B1 EP 3355592 B1 EP3355592 B1 EP 3355592B1 EP 17207542 A EP17207542 A EP 17207542A EP 3355592 B1 EP3355592 B1 EP 3355592B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- frequency
- hearing aid
- signal
- division
- audio signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 21
- 230000005236 sound signal Effects 0.000 claims description 77
- 230000001629 suppression Effects 0.000 claims description 21
- 230000008859 change Effects 0.000 claims description 17
- 238000012545 processing Methods 0.000 claims description 14
- 230000004044 response Effects 0.000 claims description 4
- 230000003044 adaptive effect Effects 0.000 description 9
- 230000005540 biological transmission Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000035807 sensation Effects 0.000 description 5
- 230000008447 perception Effects 0.000 description 4
- 230000003321 amplification Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000003199 nucleic acid amplification method Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005562 fading Methods 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 208000016354 hearing loss disease Diseases 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000017105 transposition Effects 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/552—Binaural
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/45—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback
- H04R25/453—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback electronically
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/50—Customised settings for obtaining desired overall acoustical characteristics
- H04R25/505—Customised settings for obtaining desired overall acoustical characteristics using digital signal processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility
Definitions
- the invention relates to a method for operating a binaural hearing aid system with a first hearing aid and a second hearing aid, wherein a first audio signal of the first hearing aid is divided into a first high-frequency component and a first low-frequency component, and a second audio signal of the second hearing aid in a second high-frequency component and a second low-frequency component is divided.
- a sound signal from the environment is typically converted into an electrical signal by means of an input converter, and is processed in a signal processing unit in accordance with the audiological requirements of the user and, in particular, is amplified as a function of frequency.
- the processed signal is then converted by an output converter into an output sound signal, which is fed to the hearing of the user.
- Binaural hearing aid systems with two hearing aids are often used for an improved spatial hearing sensation and an improved spatial resolution of the sound signals, of which the user wears one on the left and one on the right ear.
- the hearing aids mutually transmit their input signals generated by the respective input transducers and / or further audio signals derived therefrom by signal processing and possibly additional control signals and generate the respective output signals for the local output transducers from the local signals and the received signals.
- an acoustic feedback loop can be created by coupling the output sound signal into the input transducer, since the output sound signal thus again amplifies the signal processing learns what can lead to significant whistling or general noise.
- the acoustic feedback is therefore mostly suppressed by means of an internal, electrical feedback loop, in which a compensation signal is generated on the basis of the fully amplified audio signal, for example in an adaptive filter, which is fed to the input signal to compensate for the acoustic feedback.
- the amplified audio signal is often frequency-distorted before it is fed to the adaptive filter in order to decorrelate it from the input signal, which results in formation counteracts artifacts.
- the EP 2 988 529 A1 mentions, for example, a method for suppressing acoustic feedback in a hearing aid, a division frequency being adaptively determined as a function of the acoustic feedback, and a frequency change being applied only to the signal components above the division frequency.
- the frequency of division is chosen to be as high as possible in order to minimize the frequency range in which the signal of the hearing aid which is frequency-modified by the hearing aid is superimposed on the non-frequency-altered direct sound for a user of the hearing aid, but on the other hand, at least the frequency range which is potentially critical for acoustic feedback should be in frequency to be changed.
- the document EP 1 841 285 A1 discloses a binaural hearing aid system in which information is exchanged between the hearing aids to reduce the amount of redundant data stored in the memory of each of the respective hearing aids.
- an acoustic feedback loop can form for each of the two hearing aids.
- additional requirements result from the transmission of the individual signals between the two hearing aids and their mutual use for the generation of the output signals.
- Frequency distortions in binaural hearing aids are known to the person skilled in the art, for example, in the form of frequency transpositions from the US 2013/0 051 566 A1 known in connection with the improvement of the spatial perception of an environment.
- the known findings on suppression are of acoustic feedback in binaural hearing aids can only be used to a very limited extent due to the different target directions.
- the invention is therefore based on the object of specifying a method for operating a binaural hearing aid system which is intended to permit the suppression of acoustic feedback with a spatial sensation of hearing that is as natural as possible.
- the stated object is achieved according to the invention by a method for operating a binaural hearing aid system according to claim 1 and a binaural hearing aid system according to claim 9.
- the first audio signal is preferably generated locally in the first hearing device and the second audio signal locally in the second hearing device.
- the first or the second audio signal can be given by an intermediate signal in the signal processing process of the hearing aid in question.
- an intermediate signal is usually branched off from the main signal path to suppress acoustic feedback and fed to a specially provided feedback suppression device, for example an adaptive filter, where a compensation signal is generated from the intermediate signal, which is fed back into the main signal path, so that in the main signal path Signal components based on acoustic feedback are extinguished as far as possible.
- a specially provided feedback suppression device for example an adaptive filter
- the main signal path includes, in particular, an input signal which is generated by an input transducer of the hearing aid from a sound signal in the environment, the input signal comprises signal components which are fed to the user-specific signal processing of the hearing aid, the user-specific signal processing particularly including frequency-dependent amplification and noise suppression, a correspondingly user-specific one processed signal and an output signal derived therefrom, which is converted by an output transducer of the hearing aid into an output sound signal for the user.
- the suppression of the feedback can lead to losses in the sound quality, since on the one hand, for particularly tonal and / or stationary useful signals, it is difficult to distinguish between a feedback-related whistle and a useful signal component in a frequency range relevant for feedback, as a result of which signal components of the useful signal are also potentially affected by cancellation the compensation signal may be affected.
- stationary signal components of background noise can also be audibly modulated, which can impair the hearing perception of a hearing situation even if the useful signal is not impaired.
- the compensation signal can be generated in such a way that it contains signal components only in the relevant frequency ranges. This can now be done can be achieved that the feedback suppression device, the corresponding intermediate signal branched off from the main signal path is divided at a division frequency into a high-frequency component and a low-frequency component, and only the high-frequency component is used to generate the compensation signal.
- each local acoustic feedback path - i.e. from the output transducer back to the input transducer of the same hearing aid - is usually considered separately a priori due to the strong attenuation of a crosswise feedback.
- an acoustic feedback path changes locally, e.g. Due to a changed fit of the hearing aid in question in the ear as a result of jaw movements when the user speaks or the like, the suppression of the feedback should preferably be adapted to the changed circumstances, which is actually a change in the frequency range of the suppression that is optimal with regard to the local hearing sensation Frequency of division includes.
- a first frequency distortion which is different for the first high-frequency component and the first low-frequency component, is expediently applied to the first audio signal, thereby producing a first frequency-distorted audio signal, and one for the second high-frequency component and the second low-frequency component each for the second audio signal different second frequency distortion applied and generated a second frequency-distorted audio signal.
- the use of the first frequency distortion thus distorts the first high-frequency component and the first low-frequency component of the first audio signal, the distortion taking place to different degrees for the first high-frequency component and the first low-frequency component.
- the first frequency distortion and the second frequency distortion can each have an identical effect on the first audio signal and the second audio signal, ie, the same frequency distortion is applied to the first high-frequency component as to the second high-frequency component, and to the first low-frequency component.
- the same frequency distortion is applied to the second low-frequency component.
- the first frequency distortion and the second frequency distortion only frequency-distorted the respective high-frequency component, while the respective low-frequency component of the relevant audio signal remains unchanged.
- the proposed determination of the division frequency is therefore particularly advantageous for the use of frequency distortions in the suppression of acoustic feedback in a binaural hearing aid system.
- the first provisional division frequency is transmitted from the first hearing aid to the second hearing aid, the second provisional division frequency being transmitted from the second hearing aid to the first hearing aid after receipt of the first provisional division frequency, and the division frequency in each case in the first hearing aid and in the second hearing aid same predetermined rule is determined based on the first provisional division frequency and the second provisional division frequency.
- the two preliminary division frequencies are local in both hearing aids, and on the basis of a rule that is identical for both hearing aids and is stored, for example, in advance in a memory of each of the two hearing aids, the final division frequency at which the both audio signals are to be divided.
- further communication can take place for this, for example communication requests to set up a transmission channel for the provisional division frequency, confirmation of receipt of a provisional division frequency regardless of the transmission of the value of the local provisional division frequency and / or synchronization requests for time synchronization, etc.
- the first is preferred provisional division frequency only after a determined change in local requirements, in particular of the first acoustic feedback path, transmitted to the second hearing aid, and the synchronization process started. This considerably limits the effort and scope of communication required between the two hearing aids in order to determine the division frequency as best as possible.
- the division frequency is advantageously determined in each case on the basis of the minimum of the first provisional division frequency and the second provisional division frequency.
- the division frequency is determined directly as the minimum of the first provisional division frequency and the second provisional division frequency, or as a minimum within a plurality of predefined possible values for the division frequency, which in particular can form a discrete grid of possible values, so that e.g. on the basis of the lower of the two provisional division frequencies, the next lowest predetermined possible value is determined as the division frequency ("floor function").
- a first input signal is generated from a sound signal in the environment in the first hearing aid by a first input converter, the first audio signal being generated in the first hearing aid on the basis of the first input signal by a first signal processing.
- a second input signal is generated from the sound signal in the second hearing aid by a second input transducer, the second audio signal being generated in the second hearing aid on the basis of the second input signal by a second signal processing.
- an input signal is generated from a sound signal in the environment using the input transducer, the signal components of which are usually subjected to user-specific signal processing are, for example a frequency band-wise amplification and noise suppression as well as dynamic compression, etc.
- the amplification factors in the individual frequency bands are usually determined as a function of a hearing impairment to be corrected by the user, for example using an audiogram.
- the frequency distortion of the audio signal resulting from the signal processing, and thus the proposed determination of the division frequency in a binaural hearing aid system, are particularly favorable, since this advantageously enables acoustic feedback to be corrected.
- a first output signal is preferably generated on the basis of the first audio signal and is converted into a first output sound signal by a first output transducer of the first hearing device, with acoustic feedback being suppressed on the basis of the first frequency-distorted audio signal via a first acoustic feedback path from the first output transducer to the first input transducer.
- the first output signal is generated on the basis of the first frequency-distorted audio signal.
- a second output signal is generated, which is converted into a second output sound signal by a second output converter of the second hearing device, with acoustic feedback via a second acoustic feedback path from the second using the second frequency-distorted audio signal
- Output converter to the second input converter is suppressed.
- the division frequency is expediently updated in response to an external triggering event.
- the triggering event here is preferably a change in the sound signal in the environment, a change in the first and / or in the second feedback path, a user input, a change in the first output signal resulting from a user input and a changed classification of the hearing situation by the hearing aid or the binaural hearing aid system.
- the division frequency is always adapted when the external circumstances change, that is to say the sound signal of the surroundings and / or in particular the first acoustic feedback path, so that the division frequency is always adapted to the current circumstances.
- the external conditions, in particular the first acoustic feedback path remain stable, no adjustment is necessary, so that an update is not carried out. This saves battery power because there are no unnecessary updating processes, which would also be associated with transmission power for the transmission processes.
- the division frequency is updated in response to an internal triggering event.
- the internal triggering event can be formed by a periodic transmitter value, so that, for example, the division frequency is temporarily set to a predetermined, preferably low value, particularly preferably the lowest possible value at regular time intervals, in order to make a valid estimate for the respective feedback path even at low values To get frequencies.
- the frequency of division is then updated again using the method described above.
- the invention further specifies a binaural hearing aid system with a first hearing aid and a second hearing aid, the binaural hearing aid system being set up to carry out the method described above.
- the advantages specified for the method and for its further developments can be applied here analogously to the binaural hearing aid system.
- a binaural hearing aid system 2 is shown in a block diagram.
- the binaural hearing aid system 2 comprises a first hearing aid 4a and a second hearing aid 4b.
- a first input signal 10a is generated from a sound signal 6 of the environment in the first hearing aid 4a by means of a first input converter 8a
- a second input signal 10b is generated in the second hearing aid 4b by means of a second input converter 8b.
- the first input converter 8a and the second input converter 8b are each provided by a microphone.
- the respective input signal 10a, 10b is now mixed with a first or second compensation signal 12a, 12b and the resulting first or second compensated signal 14a, 14b is fed to a first or second signal processing 16a, 16b, which in each case generates an intermediate signal which is to be referred to here as the first or second audio signal 18a, 18b.
- a first output signal 20a and a second output signal 20b are generated on the basis of the first and second audio signals 18a, 18b, which are converted into first and second output sound signals 24a, 24b by a first output converter 22a and a second output converter 22b, respectively.
- the first and second output converters 22a, 22b are each given by a loudspeaker.
- a first acoustic feedback path 26a is formed, via which an acoustic feedback takes place.
- the first or second compensation signal 12a, 12b is now generated in a first or second adaptive filter 28a, 28b.
- the first frequency distortion 30a which is given here by a frequency shift by a constant amount, is applied to the first audio signal 18a only above a division frequency tf, which divides the first audio signal 18a into a first high-frequency component HF1 and a first low-frequency component NF1 divides.
- the resulting first frequency-distorted audio signal 32a - which comprises the frequency-shifted first high-frequency component HF1 of the first audio signal 18a - is now supplied on the one hand to the first adaptive filter 28a for generating the first compensation signal 12a, and on the other hand passed as the first output signal 20a to the first output converter 22a.
- the respective compensation signal 12a, 12b is only generated in those frequency bands in which suppression of the acoustic feedback is necessary at all.
- frequency distortion 30a, 30b is used for decorrelation over the entire frequency range in which the feedback is to be suppressed. That is to say, by determining the division frequency tf not only the application range of the respective frequency distortion 30a, 30b is determined in the present case, but also the frequency range of the two compensation signals 12a, 12b and thus the application range of the suppression of the acoustic feedback.
- a first provisional division frequency tf1 is first transmitted from the first hearing device 4a to the second hearing device 4b when the first acoustic feedback path 26a changes physically.
- the second hearing aid 4b receives the first provisional division frequency tf1 and, in turn, uses the second acoustic feedback path 26b, which could also have changed slightly, to determine a second provisional division frequency tf2, which is transmitted to the first hearing aid 4a. If there has been no change in the second acoustic feedback path 26b since the division frequency tf was last updated, then the current division frequency tf can also be transmitted as the value of the second provisional division frequency tf2.
- Both hearing aids 4a, 4b now each have the first and the second provisional division frequency tf1, tf2.
- the minimum of the first provisional division frequency tf1 and the second provisional division frequency tf2 is now defined as the division frequency tf.
- the first audio signal 18a is then divided at the division frequency tf as described into a first high-frequency component HF1 and a first low-frequency component NF1, the first high-frequency component HF1 being frequency-shifted and, as the first frequency-distorted audio signal 32a, the first adaptive filter 28a for the Generation of the first compensation signal 12a is supplied.
Description
Die Erfindung betrifft ein Verfahren zum Betrieb eines binauralen Hörgerätesystems mit einem ersten Hörgerät und einem zweiten Hörgerät, wobei ein erstes Audiosignal des ersten Hörgerätes in einen ersten Hochfrequenz-Anteil und einen ersten Niederfrequenz-Anteil aufgeteilt wird, und wobei ein zweites Audiosignal des zweiten Hörgerätes in einen zweiten Hochfrequenz-Anteil und einen zweiten Niederfrequenz-Anteil aufgeteilt wird.The invention relates to a method for operating a binaural hearing aid system with a first hearing aid and a second hearing aid, wherein a first audio signal of the first hearing aid is divided into a first high-frequency component and a first low-frequency component, and a second audio signal of the second hearing aid in a second high-frequency component and a second low-frequency component is divided.
In einem Hörgerät wird typischerweise ein Schallsignal der Umgebung mittels eines Eingangswandlers in ein elektrisches Signal umgewandelt, und in einer Signalverarbeitungseinheit gemäß den audiologischen Anforderungen des Benutzers aufbereitet und dabei insbesondere frequenzabhängig verstärkt. Das aufbereitete Signal wird nun durch einen Ausgangswandler in ein Ausgangsschallsignal umgewandelt, welches dem Gehör des Benutzers zugeführt wird. Für ein verbessertes räumliches Hörempfinden sowie eine verbesserte räumliche Auflösung der Schallsignale werden oftmals binaurale Hörgerätesysteme mit zwei Hörgeräten verwendet, von denen der Benutzer jeweils eines am linken bzw. am rechten Ohr trägt. Die Hörgeräte übertragen dabei gegenseitig ihre von den jeweiligen Eingangswandlern erzeugten Eingangssignale und/oder daraus durch Signalverarbeitung abgeleitete weitere Audiosignale sowie ggf. zusätzliche Kontrollsignale und erzeugen aus den lokalen Signalen sowie den empfangenen Signalen die jeweiligen Ausgangssignale für die lokalen Ausgangswandler.In a hearing aid, a sound signal from the environment is typically converted into an electrical signal by means of an input converter, and is processed in a signal processing unit in accordance with the audiological requirements of the user and, in particular, is amplified as a function of frequency. The processed signal is then converted by an output converter into an output sound signal, which is fed to the hearing of the user. Binaural hearing aid systems with two hearing aids are often used for an improved spatial hearing sensation and an improved spatial resolution of the sound signals, of which the user wears one on the left and one on the right ear. The hearing aids mutually transmit their input signals generated by the respective input transducers and / or further audio signals derived therefrom by signal processing and possibly additional control signals and generate the respective output signals for the local output transducers from the local signals and the received signals.
Im Betrieb eines Hörgerätes kann durch ein Einkoppeln des Ausgangsschallsignals in den Eingangswandler eine akustische Rückkopplungsschleife entstehen, da das Ausgangsschallsignal so erneut die Verstärkung der Signalverarbeitung erfährt, was zu erheblichen Pfeif- oder allgemein zu Störgeräuschen führen kann. Die akustische Rückkopplung wird daher meist mittels einer internen, elektrischen Rückkopplungsschleife unterdrückt, in welcher anhand des fertig verstärkten Audiosignals, beispielsweise in einem adaptiven Filter, ein Kompensationssignal erzeugt wird, welches dem Eingangssignal zur Kompensation der akustischen Rückkopplung zugeführt wird. Um zu verhindern, dass hierdurch stark tonale Signalkomponenten des Eingangssignals ausgelöscht werden, und es zur Bildung von Artefakten im Ausgangssignal kommt, wird dabei das verstärkte Audiosignal oftmals frequenzverzerrt, bevor es dem adaptiven Filter zugeführt wird, um es vom Eingangssignal zu dekorrelieren, was einer Bildung von Artfakten entgegenwirkt.When a hearing aid is in operation, an acoustic feedback loop can be created by coupling the output sound signal into the input transducer, since the output sound signal thus again amplifies the signal processing learns what can lead to significant whistling or general noise. The acoustic feedback is therefore mostly suppressed by means of an internal, electrical feedback loop, in which a compensation signal is generated on the basis of the fully amplified audio signal, for example in an adaptive filter, which is fed to the input signal to compensate for the acoustic feedback. In order to prevent strong tonal signal components of the input signal from being extinguished thereby and artifacts from forming in the output signal, the amplified audio signal is often frequency-distorted before it is fed to the adaptive filter in order to decorrelate it from the input signal, which results in formation counteracts artifacts.
Die
Das Dokument
Bei einem binauralen Hörgerätesystem kann sich eine akustische Rückkopplungsschleife für jedes der beiden Hörgeräte bilden. Für die Unterdrückung der Rückkopplung lokal in jedem Hörgerät ergeben sich jedoch aus der Übertragung der einzelnen Signale zwischen den beiden Hörgeräten und deren wechselseitige Verwendung für die Erzeugung der Ausgangssignale zusätzliche Anforderungen.In a binaural hearing aid system, an acoustic feedback loop can form for each of the two hearing aids. For the suppression of the feedback locally in each hearing aid, however, additional requirements result from the transmission of the individual signals between the two hearing aids and their mutual use for the generation of the output signals.
Frequenzverzerrungen in binauralen Hörgeräten sind dem Fachmann z.B. in der Form von Frequenztranspositionen aus der
Der Erfindung liegt daher die Aufgabe zugrunde, ein Verfahren zum Betrieb eines binauralen Hörgerätesystems anzugeben, welches die Unterdrückung einer akustischen Rückkopplung bei einem möglichst natürlichen räumlichen Hörempfinden erlauben soll.The invention is therefore based on the object of specifying a method for operating a binaural hearing aid system which is intended to permit the suppression of acoustic feedback with a spatial sensation of hearing that is as natural as possible.
Die genannte Aufgabe wird erfindungsgemäß gelöst durch ein Verfahren zum Betrieb eines binauralen Hörgerätesystems nach Anspruch 1 und ein binaurales Hörgerätesystem nach Anspruch 9.The stated object is achieved according to the invention by a method for operating a binaural hearing aid system according to claim 1 and a binaural hearing aid system according to claim 9.
Bevorzugt werden das erste Audiosignal lokal im ersten Hörgerät und das zweite Audiosignal lokal im zweiten Hörgerät erzeugt. Insbesondere können dabei das erste bzw. das zweite Audiosignal jeweils durch ein Zwischensignal im Signalverarbeitungsprozess des betreffenden Hörgerätes gegeben sein.The first audio signal is preferably generated locally in the first hearing device and the second audio signal locally in the second hearing device. In particular, the first or the second audio signal can be given by an intermediate signal in the signal processing process of the hearing aid in question.
In einem Hörgerät wird zur Unterdrückung von akustischen Rückkopplungen meist ein Zwischensignal aus dem Hauptsignalweg abgezweigt und einer eigens vorgesehenen Rückkopplungsunterdrückungseinrichtung, beispielsweise einem adaptiven Filter, zugeführt, wo anhand des Zwischensignals ein Kompensationssignal erzeugt wird, welches wieder in den Hauptsignalweg eingespeist wird, so dass im Hauptsignalweg Signalanteile, welche auf der akustischen Rückkopplung basieren, möglichst ausgelöscht werden. Der Hauptsignalweg umfasst dabei insbesondere ein Eingangssignal, welches von einem Eingangswandler des Hörgerätes aus einem Schallsignal der Umgebung erzeugt wird, das Eingangssignal umfassende Signalanteile, welche der benutzerspezifischen Signalverarbeitung des Hörgerätes zugeführt werden, wobei die benutzerspezifische Signalverarbeitung insbesondere frequenzabhängige Verstärkung sowie Rauschunterdrückung beinhaltet, ein entsprechend benutzerspezifisch verarbeitetes Signal sowie ein hieraus abgeleitetes Ausgangssignal, welches durch einen Ausgangswandler des Hörgerätes in ein Ausgangsschallsignal für den Benutzer umgewandelt wird.In a hearing aid, an intermediate signal is usually branched off from the main signal path to suppress acoustic feedback and fed to a specially provided feedback suppression device, for example an adaptive filter, where a compensation signal is generated from the intermediate signal, which is fed back into the main signal path, so that in the main signal path Signal components based on acoustic feedback are extinguished as far as possible. The main signal path includes, in particular, an input signal which is generated by an input transducer of the hearing aid from a sound signal in the environment, the input signal comprises signal components which are fed to the user-specific signal processing of the hearing aid, the user-specific signal processing particularly including frequency-dependent amplification and noise suppression, a correspondingly user-specific one processed signal and an output signal derived therefrom, which is converted by an output transducer of the hearing aid into an output sound signal for the user.
Die Unterdrückung der Rückkopplung kann hierbei zu Verlusten der Klangqualität führen, da einerseits für besonders tonale und/oder stationäre Nutzsignale eine Unterscheidung zwischen einem rückkopplungsbedingten Pfeifen und einer Nutzsignalkomponente in einem für Rückkopplung relevanten Frequenzbereich schwierig ist, wodurch auch Signalanteile des Nutzsignals potentiell von der Auslöschung durch das Kompensationssignal betroffen sein können. Andererseits können zudem auch stationäre Signalanteile von Hintergrundgeräuschen hörbar moduliert werden, was das Hörempfinden einer Hörsituation auch dann beeinträchtigen kann, wenn das Nutzsignal nicht beeinträchtigt wird.The suppression of the feedback can lead to losses in the sound quality, since on the one hand, for particularly tonal and / or stationary useful signals, it is difficult to distinguish between a feedback-related whistle and a useful signal component in a frequency range relevant for feedback, as a result of which signal components of the useful signal are also potentially affected by cancellation the compensation signal may be affected. On the other hand, stationary signal components of background noise can also be audibly modulated, which can impair the hearing perception of a hearing situation even if the useful signal is not impaired.
Aus den genannten Gründen wird oftmals versucht, die Unterdrückung der Rücckopplung nur auf diejenigen Frequenzbereiche zu beschränken, in welchen auch wirklich eine Rückkopplung vorhanden ist bzw. aufzutreten droht. Dies sind, abhängig von den mechanischen und elektro-akustischen Bedingungen des Hörgerätes, meist mittlere bis höhere Frequenzen ab ca. 2 kHz, vereinzelt auch ab 1 kHz. Hierfür kann das Kompensationssignal derart generiert werden, dass es nur in den relevanten Frequenzbereichen Signalanteile enthält. Dies kann nun dadurch erreicht werden, dass der Rückkopplungsunterdrückungseinrichtung das entsprechende, aus dem Hauptsignalweg abgezweigte Zwischensignal entsprechend an einer Teilungsfrequenz in einen Hochfrequenz-Anteil und einen Niederfrequenz-Anteil aufgeteilt wird, und nur der Hochfrequenz-Anteil zur Erzeugung des Kompensationssignals herangezogen wird.For the reasons mentioned, attempts are often made to limit the suppression of the feedback only to those frequency ranges in which a feedback actually exists or is in danger of occurring. Depending on the mechanical and electro-acoustic conditions of the hearing aid, these are mostly medium to higher frequencies from approx. 2 kHz, occasionally also from 1 kHz. For this purpose, the compensation signal can be generated in such a way that it contains signal components only in the relevant frequency ranges. This can now be done can be achieved that the feedback suppression device, the corresponding intermediate signal branched off from the main signal path is divided at a division frequency into a high-frequency component and a low-frequency component, and only the high-frequency component is used to generate the compensation signal.
Für die Unterdrückung von akustischen Rückkopplungen in einem binauralen Hörgerätesystem wird a priori meist jeder lokale akustische Rückkopplungspfad - also jeweils vom Ausgangswandler zurück zum Eingangswandler desselben Hörgerätes - infolge der starken Dämpfung einer kreuzweisen Rückkopplung separat betrachtet. Verändert sich nun ein akustischer Rückkopplungspfad lokal, z.B. aufgrund eines veränderten Sitzes des betreffenden Hörgerätes im Ohr infolge von Kieferbewegungen beim Sprechen des Benutzers o.ä., so ist bevorzugt die Unterdrückung der Rückkopplung an die veränderten Gegebenheiten anzupassen, was für einen hinsichtlich des lokalen Hörempfindens optimalen Frequenzbereich der Unterdrückung eigentlich auch eine Änderung der Teilungsfrequenz beinhaltet.For the suppression of acoustic feedback in a binaural hearing aid system, each local acoustic feedback path - i.e. from the output transducer back to the input transducer of the same hearing aid - is usually considered separately a priori due to the strong attenuation of a crosswise feedback. Now an acoustic feedback path changes locally, e.g. Due to a changed fit of the hearing aid in question in the ear as a result of jaw movements when the user speaks or the like, the suppression of the feedback should preferably be adapted to the changed circumstances, which is actually a change in the frequency range of the suppression that is optimal with regard to the local hearing sensation Frequency of division includes.
Jedoch kann eine rein lokal erfolgende Ermittlung der jeweiligen Teilungsfrequenz, also insbesondere nur anhand des lokal vorliegenden akustischen Rücckopplungspfades vom jeweiligen Ausgangswandler zurück zum Eingangswandler desselben Hörgerätes, bei einer Aktualisierung der Teilungsfrequenzen zu weiteren Problemen im Hörempfinden führen. Um nämlich das Gehör des Benutzers keinen unnatürlich wirkenden, sprunghaften Veränderungen auszusetzen, erfolgen Aktualisierungen von Teilungsfrequenzen meist mit einer gewissen stetigen "Überblendung", also beispielsweise durch eine Verschiebung der Teilungsfrequenz bis zum neuen Wert hin in einem geeignet zu wählenden Zeitfenster. Sind nun aber für die beiden Hörgeräte die Zielwerte für die jeweils aktualisierte Teilungsfrequenz unterschiedlich, kann dies überraschenderweise dazu führen, dass Schallquellen vom Benutzer als um ihn herum rotierend wahrgenommen werden, was aufgrund der gleichbleibenden optischen Wahrnehmung seiner Umgebung in einer klaren Diskrepanz resultiert. Diese empfundene Fehllokalisation wird hauptsächlich von der veränderlichen Gruppenlaufzeit, also der Signallaufzeit über der Frequenz, hervorgerufen, wodurch die interauralen Zeitdifferenzen verfälscht werden können.However, a purely local determination of the respective division frequency, that is to say in particular only on the basis of the locally available acoustic feedback path from the respective output transducer back to the input transducer of the same hearing aid, can lead to further problems in hearing perception when the division frequencies are updated. In order not to expose the user's hearing to unnaturally appearing, sudden changes, division frequencies are usually updated with a certain constant "cross-fading", that is to say, for example, by shifting the division frequency up to the new value in a suitably selected time window. However, if the target values for the respectively updated division frequency are different for the two hearing aids, this can surprisingly lead to sound sources being perceived by the user as rotating around him, which results in a clear discrepancy due to the constant visual perception of his surroundings. This perceived incorrect localization is mainly due to the variable group delay, i.e. the signal delay over the Frequency, caused by which the interaural time differences can be falsified.
Um einer derartigen, fälschlicherweise wahrgenommenen Rotation der Schallquellen entgegenzuwirken, wird nun im Rahmen der Erfindung vorgeschlagen, in einem ersten Schritt zunächst lokal jeweils einen Wert für eine vorläufige Teilungsfrequenz vorzugeben, und in einem zweiten Schritt die reale Teilungsfrequenz, an welcher sowohl das erste als auch das zweite Audiosignal in ihre jeweiligen Hochfrequenz- und Niederfrequenz-Anteile aufzuteilen sind, anhand der beiden vorläufigen Teilungsfrequenzen der einzelnen Hörgeräte zu bestimmen. Hierdurch kann in vorteilhafter Weise sowohl den Anforderungen zur lokalen Unterdrückung der Rückkopplungen, welche sich aus den beiden akustischen Rückkopplungspfaden ergeben, als auch dem Wunsch nach einer möglichst realistischen räumlichen Hörwahrnehmung Rechnung getragen werden.In order to counteract such an erroneously perceived rotation of the sound sources, it is now proposed within the scope of the invention to first locally specify a value for a provisional division frequency in a first step, and in a second step to specify the real division frequency at which both the first and the second audio signal is to be divided into its respective high-frequency and low-frequency components, based on the two provisional division frequencies of the individual hearing aids. In this way, both the requirements for local suppression of the feedback, which result from the two acoustic feedback paths, and the desire for the most realistic spatial hearing perception possible can be taken into account.
Zweckmäßigerweise wird auf das erste Audiosignal eine für den ersten Hochfrequenz-Anteil und den ersten Niederfrequenz-Anteil jeweils unterschiedliche erste Frequenzverzerrung angewandt und hierdurch ein erstes frequenzverzerrtes Audiosignal erzeugt sowie auf das zweite Audiosignal eine für den zweiten Hochfrequenz-Anteil und den zweiten Niederfrequenz-Anteil jeweils unterschiedliche zweite Frequenzverzerrung angewandt und daraus ein zweites frequenzverzerrtes Audiosignal erzeugt. Durch die Anwendung der ersten Frequenzverzerrung werden somit der erste Hochfrequenz-Anteil und der erste Niederfrequenz-Anteil des ersten Audiosignals verzerrt, wobei die Verzerrung für den ersten Hochfrequenz-Anteil und den ersten Niederfrequenz-Anteil in unterschiedlichem Maße erfolgt. Entsprechendes gilt für die zweite Frequenzverzerrung hinsichtlich des zweiten Hochfrequenz-Anteils und des zweiten Niederfrequenz-Anteils. Insbesondere können hierbei die erste Frequenzverzerrung und die zweite Frequenzverzerrung jeweils eine identische Wirkung auf das erste Audiosignal und das zweite Audiosignal entfalten, d.h., auf den ersten Hochfrequenz-Anteil wird dieselbe Frequenzverzerrung angewandt wie auf den zweiten Hochfrequenz-Anteil, und auf den ersten Niederfrequenz-Anteil wird dieselbe Frequenzverzerrung angewandt wie auf den zweiten Niederfrequenz-Anteil. Insbesondere wird durch die erste Frequenzverzerrung und die zweite Frequenzverzerrung nur der jeweilige Hochfrequenz-Anteil frequenzverzerrt, während der jeweilige Niederfrequenz-Anteil des betreffenden Audiosignals unverändert bleibt.A first frequency distortion, which is different for the first high-frequency component and the first low-frequency component, is expediently applied to the first audio signal, thereby producing a first frequency-distorted audio signal, and one for the second high-frequency component and the second low-frequency component each for the second audio signal different second frequency distortion applied and generated a second frequency-distorted audio signal. The use of the first frequency distortion thus distorts the first high-frequency component and the first low-frequency component of the first audio signal, the distortion taking place to different degrees for the first high-frequency component and the first low-frequency component. The same applies to the second frequency distortion with regard to the second high-frequency component and the second low-frequency component. In particular, the first frequency distortion and the second frequency distortion can each have an identical effect on the first audio signal and the second audio signal, ie, the same frequency distortion is applied to the first high-frequency component as to the second high-frequency component, and to the first low-frequency component. The same frequency distortion is applied to the second low-frequency component. In particular, the first frequency distortion and the second frequency distortion only frequency-distorted the respective high-frequency component, while the respective low-frequency component of the relevant audio signal remains unchanged.
Die Anwendung einer Frequenzverzerrung auf Signalanteile, aus welchen ein Kompensationssignal zur Unterdrückung einer akustischen Rückkopplung zu erzeugen ist, dekorreliert die betreffenden Signalanteile von den entsprechenden Signalanteilen des Hauptsignalpfades. Somit kann erreicht werden, dass das anhand der frequenzverzerrten Signalanteilen erzeugte Kompensationssignal weitgehend nur die akustische Rückkopplung auslöscht, jedoch infolge der Dekorrelation keine weiteren tonalen Signalkomponenten. Für die Anwendung von Frequenzverzerrungen bei der Unterdrückung von akustischen Rückkopplungen in einem binauralen Hörgerätesystem ist die vorgeschlagene Bestimmung der Teilungsfrequenz daher besonders vorteilhaft.The application of a frequency distortion to signal components, from which a compensation signal to suppress acoustic feedback is to be generated, decorrelates the relevant signal components from the corresponding signal components of the main signal path. It can thus be achieved that the compensation signal generated on the basis of the frequency-distorted signal components largely only cancels the acoustic feedback, but no further tonal signal components due to the decorrelation. The proposed determination of the division frequency is therefore particularly advantageous for the use of frequency distortions in the suppression of acoustic feedback in a binaural hearing aid system.
Erfindungsgemäß wird die erste vorläufige Teilungsfrequenz vom ersten Hörgerät an das zweite Hörgerät übertragen, wobei nach Empfang der ersten vorläufigen Teilungsfrequenz die zweite vorläufige Teilungsfrequenz vom zweiten Hörgerät an das erste Hörgerät übertragen wird, und wobei im ersten Hörgerät und im zweiten Hörgerät die Teilungsfrequenz jeweils nach der gleichen vorgegebenen Regel anhand der ersten vorläufigen Teilungsfrequenz und der zweiten vorläufigen Teilungsfrequenz bestimmt wird. Dies bedeutet, dass nach den genannten Übertragungsvorgängen in beiden Hörgeräten beide vorläufigen Teilungsfrequenzen lokal vorliegen, und anhand einer für beide Hörgeräte identischen Regel, welche z.B. vorab jeweils in einem Speicher eines jeden der beiden Hörgeräte hinterlegt wird, die endgültige Teilungsfrequenz bestimmt wird, an welcher die beiden Audiosignale jeweils aufzuteilen sind. Insbesondere kann hierfür noch weitere Kommunikation erfolgen, so beispielsweise Kommunikationsanfragen zum Aufbau eines Übertragungskanals für die vorläufige Teilungsfrequenz, eine Bestätigung des Empfangs einer vorläufigen Teilungsfrequenz unabhängig von der Übermittlung des Wertes der lokalen vorläufigen Teilungsfrequenz und/oder Synchronisierungsanfragen zur Zeitsynchronisation etc. Bevorzugt wird dabei die erste vorläufige Teilungsfrequenz nur nach einer festgestellten Veränderung der lokalen Anforderungen, insbesondere des ersten akustischen Rückkopplungspfades, an das zweite Hörgerät übertragen, und so der Synchronisierungsprozess in Gang gesetzt. Hierdurch lässt sich der Aufwand und Umfang an erforderlicher Kommunikation zwischen den beiden Hörgeräten zur bestmöglichen Bestimmung der Teilungsfrequenz erheblich begrenzen.According to the invention, the first provisional division frequency is transmitted from the first hearing aid to the second hearing aid, the second provisional division frequency being transmitted from the second hearing aid to the first hearing aid after receipt of the first provisional division frequency, and the division frequency in each case in the first hearing aid and in the second hearing aid same predetermined rule is determined based on the first provisional division frequency and the second provisional division frequency. This means that after the above-mentioned transmission processes, the two preliminary division frequencies are local in both hearing aids, and on the basis of a rule that is identical for both hearing aids and is stored, for example, in advance in a memory of each of the two hearing aids, the final division frequency at which the both audio signals are to be divided. In particular, further communication can take place for this, for example communication requests to set up a transmission channel for the provisional division frequency, confirmation of receipt of a provisional division frequency regardless of the transmission of the value of the local provisional division frequency and / or synchronization requests for time synchronization, etc. The first is preferred provisional division frequency only after a determined change in local requirements, in particular of the first acoustic feedback path, transmitted to the second hearing aid, and the synchronization process started. This considerably limits the effort and scope of communication required between the two hearing aids in order to determine the division frequency as best as possible.
Günstigerweise wird dabei die Teilungsfrequenz jeweils anhand des Minimums aus der ersten vorläufigen Teilungsfrequenz und der zweiten vorläufigen Teilungsfrequenz bestimmt. Insbesondere wird die Teilungsfrequenz hierbei direkt als das Minimum der ersten vorläufigen Teilungsfrequenz und der zweiten vorläufigen Teilungsfrequenz bestimmt, oder als ein Minimum innerhalb einer Mehrzahl an vorgegebenen möglichen Werten für die Teilungsfrequenz, welche insbesondere ein diskretes Raster an möglichen Werten bilden kann, sodass z.B. anhand der niedrigeren der beiden vorläufigen Teilungsfrequenzen der nächst-niedrige vorgegebene mögliche Wert als Teilungsfrequenz bestimmt wird ("floor function"). Durch die Berücksichtigung des Minimums der beiden vorläufigen Teilungsfrequenzen kann erreicht werden, dass die so bestimmte Teilungsfrequenz die akustischen Gegebenheiten bei beiden Hörgeräten in ausreichendem Maße berücksichtigt, und nicht für ein Hörgerät als zu hoch angesetzt wird. Die Auswahl anhand einer Mehrzahl an vorgegebenen möglichen Werten für die Teilungsfrequenz, insbesondere diskreter Werte, erlaubt es dabei, noch weitere Randbedingungen zu berücksichtigen.The division frequency is advantageously determined in each case on the basis of the minimum of the first provisional division frequency and the second provisional division frequency. In particular, the division frequency is determined directly as the minimum of the first provisional division frequency and the second provisional division frequency, or as a minimum within a plurality of predefined possible values for the division frequency, which in particular can form a discrete grid of possible values, so that e.g. on the basis of the lower of the two provisional division frequencies, the next lowest predetermined possible value is determined as the division frequency ("floor function"). By taking the minimum of the two provisional division frequencies into account, it can be achieved that the division frequency determined in this way takes sufficient account of the acoustic conditions in both hearing aids and is not set too high for a hearing aid. The selection on the basis of a plurality of predefined possible values for the division frequency, in particular discrete values, allows further boundary conditions to be taken into account.
In einer vorteilhaften Ausgestaltung der Erfindung wird aus einem Schallsignal der Umgebung im ersten Hörgerät durch einen ersten Eingangswandler ein erstes Eingangssignal erzeugt, wobei im ersten Hörgerät anhand des ersten Eingangssignals durch eine erste Signalverarbeitung das erste Audiosignal erzeugt wird. Insbesondere wird aus dem Schallsignal im zweiten Hörgerät durch einen zweiten Eingangswandler ein zweites Eingangssignal erzeugt, wobei im zweiten Hörgerät anhand des zweiten Eingangssignals durch eine zweite Signalverarbeitung das zweite Audiosignal erzeugt wird. In einem Hörgerät wird aus einem Schallsignal der Umgebung anhand des Eingangswandlers ein Eingangssignal erzeugt, dessen Signalanteile meist einer benutzerspezifischen Signalverarbeitung unterzogen werden, so z.B. eine frequenzbandweise Verstärkung und Rauschunterdrückung sowie ggf. Dynamik-Kompression etc. Die Verstärkungsfaktoren in den einzelnen Frequenzbändern werden dabei meist in Abhängigkeit von einer zu korrigierenden Hörschwäche des Benutzers festgelegt, z.B. anhand eines Audiogramms. Die Frequenzverzerrung des aus der Signalverarbeitung resultierenden Audiosignals, und somit in einem binauralen Hörgerätesystem die vorgeschlagene Bestimmung der Teilungsfrequenz, sind dabei besonders günstig, da hierdurch in vorteilhafter Weise eine Korrektur von akustischen Rückkopplungen ermöglicht wird.In an advantageous embodiment of the invention, a first input signal is generated from a sound signal in the environment in the first hearing aid by a first input converter, the first audio signal being generated in the first hearing aid on the basis of the first input signal by a first signal processing. In particular, a second input signal is generated from the sound signal in the second hearing aid by a second input transducer, the second audio signal being generated in the second hearing aid on the basis of the second input signal by a second signal processing. In a hearing aid, an input signal is generated from a sound signal in the environment using the input transducer, the signal components of which are usually subjected to user-specific signal processing are, for example a frequency band-wise amplification and noise suppression as well as dynamic compression, etc. The amplification factors in the individual frequency bands are usually determined as a function of a hearing impairment to be corrected by the user, for example using an audiogram. The frequency distortion of the audio signal resulting from the signal processing, and thus the proposed determination of the division frequency in a binaural hearing aid system, are particularly favorable, since this advantageously enables acoustic feedback to be corrected.
Bevorzugt wird dabei anhand des ersten Audiosignals ein erstes Ausgangssignal erzeugt, welches durch einen ersten Ausgangswandler des ersten Hörgerätes in ein erstes Ausgangsschallsignal umgewandelt wird, wobei anhand des ersten frequenzverzerrten Audiosignals eine akustische Rückkopplung über einen ersten akustischen Rückkopplungspfad vom ersten Ausgangswandler zum ersten Eingangswandler unterdrückt wird. Insbesondere wird das erste Ausgangssignal dabei anhand des ersten frequenzverzerrten Audiosignals erzeugt. Insbesondere wird anhand des zweiten Audiosignals, bevorzugt anhand des zweiten frequenzverzerrten Audiosignals, ein zweites Ausgangssignal erzeugt, welches durch einen zweiten Ausgangswandler des zweiten Hörgerätes in ein zweites Ausgangsschallsignal umgewandelt wird, wobei anhand des zweiten frequenzverzerrten Audiosignals eine akustische Rückkopplung über einen zweiten akustischen Rückkopplungspfad vom zweiten Ausgangswandler zum zweiten Eingangswandler unterdrückt wird. Es ist eine in Hörgeräten übliche Praxis, zur Unterdrückung einer akustischen Rückkopplung das aus dieser benutzerspezifischen Signalverarbeitung resultierende Audiosignal heranzuziehen. Somit ist auch die Anwendung einer Frequenzverzerrung auf dieses Audiosignal im Rahmen der Unterdrückung der akustischen Rückkopplung zweckmäßig, und daher bei binauralen Hörgerätesystemen das vorgeschlagene Verfahren zur Bestimmung der Teilungsfrequenz besonders vorteilhaft.A first output signal is preferably generated on the basis of the first audio signal and is converted into a first output sound signal by a first output transducer of the first hearing device, with acoustic feedback being suppressed on the basis of the first frequency-distorted audio signal via a first acoustic feedback path from the first output transducer to the first input transducer. In particular, the first output signal is generated on the basis of the first frequency-distorted audio signal. In particular, on the basis of the second audio signal, preferably on the basis of the second frequency-distorted audio signal, a second output signal is generated, which is converted into a second output sound signal by a second output converter of the second hearing device, with acoustic feedback via a second acoustic feedback path from the second using the second frequency-distorted audio signal Output converter to the second input converter is suppressed. It is common practice in hearing aids to use the audio signal resulting from this user-specific signal processing to suppress acoustic feedback. Thus, the application of frequency distortion to this audio signal in the context of the suppression of acoustic feedback is expedient, and therefore the proposed method for determining the division frequency is particularly advantageous in binaural hearing aid systems.
Zweckmäßigerweise wird auf ein externes auslösendes Ereignis hin die Teilungsfrequenz aktualisiert. Als auslösendes Ereignis sind hierbei bevorzugt eine Veränderung im Schallsignal der Umgebung, eine Veränderung im ersten und/oder im zweiten Rückkopplungspfad, eine Benutzereingabe, eine aus einer Benutzereingabe resultierende Veränderung im ersten Ausgangssignal und eine veränderte Klassifizierung der Hörsituation durch das Hörgerät oder das binaurale Hörgerätesystem umfasst. Hierdurch wird erreicht, dass die Teilungsfrequenz immer dann angepasst wird, wenn sich die äußeren Gegebenheiten ändern, also das Schallsignal der Umgebung und/oder insbesondere der erste akustische Rückkopplungspfad, sodass die Teilungsfrequenz immer an die aktuell vorliegenden Gegebenheiten angepasst ist. Bleiben jedoch die äußeren Gegebenheiten, insbesondere der erste akustische Rückkopplungspfad, stabil, so ist keine Anpassung erforderlich, sodass eine Aktualisierung unterbleibt. Hierdurch kann Batterieleistung eingespart werden, da unnötige Aktualisierungsvorgänge, welche zudem mit Sendeleistung für die Übertragungsvorgänge verbunden wären, ausbleiben.The division frequency is expediently updated in response to an external triggering event. The triggering event here is preferably a change in the sound signal in the environment, a change in the first and / or in the second feedback path, a user input, a change in the first output signal resulting from a user input and a changed classification of the hearing situation by the hearing aid or the binaural hearing aid system. It is hereby achieved that the division frequency is always adapted when the external circumstances change, that is to say the sound signal of the surroundings and / or in particular the first acoustic feedback path, so that the division frequency is always adapted to the current circumstances. However, if the external conditions, in particular the first acoustic feedback path, remain stable, no adjustment is necessary, so that an update is not carried out. This saves battery power because there are no unnecessary updating processes, which would also be associated with transmission power for the transmission processes.
In einer weiter vorteilhaften Ausgestaltung der Erfindung wird auf ein internes auslösendes Ereignis hin die Teilungsfrequenz aktualisiert. Insbesondere kann dabei das interne auslösende Ereignis gebildet werden durch einen periodischen Geberwert, sodass beispielsweise in regelmäßigen Zeitabständen die Teilungsfrequenz vorübergehend auf einen vorgegebenen, bevorzugt niedrigen Wert, besonders bevorzugt den niedrigstmöglichen Wert, gesetzt wird, um einen validen Schätzwerd für den jeweiligen Rückkopplungspfad auch bei niedrigen Frequenzen zu erhalten. Anschließend wird die Teilungsfrequenz wieder anhand des vorbeschriebenen Verfahrens aktualisiert.In a further advantageous embodiment of the invention, the division frequency is updated in response to an internal triggering event. In particular, the internal triggering event can be formed by a periodic transmitter value, so that, for example, the division frequency is temporarily set to a predetermined, preferably low value, particularly preferably the lowest possible value at regular time intervals, in order to make a valid estimate for the respective feedback path even at low values To get frequencies. The frequency of division is then updated again using the method described above.
Die Erfindung nennt weiter ein binaurales Hörgerätesystem mit einem ersten Hörgerät und einem zweiten Hörgerät, wobei das binaurale Hörgerätesystem dazu eingerichtet ist, das vorbeschriebene Verfahren durchzuführen. Die für das Verfahren und für seine Weiterbildungen angegebenen Vorteile können hierbei sinngemäß auf das binaurale Hörgerätesystem übertragen werden.The invention further specifies a binaural hearing aid system with a first hearing aid and a second hearing aid, the binaural hearing aid system being set up to carry out the method described above. The advantages specified for the method and for its further developments can be applied here analogously to the binaural hearing aid system.
Nachfolgend wird ein Ausführungsbeispiel der Erfindung anhand einer Zeichnung näher erläutert. Hierbei zeigt schematisch:
- FIG. 1
- in einem Blockschaltbild ein binaurales Hörgerätesystem mit zwei Hörgeräten und einem Protokoll zur Synchronisierung einer Teilungsfrequenz.
- FIG. 1
- in a block diagram a binaural hearing aid system with two hearing aids and a protocol for synchronizing a division frequency.
In
Zur Unterdrückung der akustischen Rückkopplung über den ersten bzw. zweiten akustischen Rückkopplungspfad 26a, 26b wird nun jeweils in einem ersten bzw. zweiten adaptiven Filter 28a, 28b das erste bzw. zweite Kompensationssignal 12a, 12b erzeugt. Um die jeweiligen Eingangsgrößen des ersten bzw. des zweiten adaptiven Filters 28a, 28b hinreichend vom ersten bzw. zweiten Eingangssignal 10a, 10b zu dekorrelieren, werden das erste Audiosignal 18a und das zweite Audiosignal 18b einer ersten Frequenzverzerrung 30a bzw. einer zweiten Frequenzverzerrung 30b unterzogen.To suppress the acoustic feedback via the first or second
Die erste Frequenzverzerrung 30a, welche vorliegend durch eine Frequenzverschiebung um einen konstanten Betrag gegeben ist, wird hierbei auf das erste Audiosignal 18a nur oberhalb einer Teilungsfrequenz tf angewandt, welche das erste Audiosignal 18a in einen ersten Hochfrequenz-Anteil HF1 und einen ersten Niederfrequenz-Anteil NF1 aufteilt. Das resultierende erste frequenzverzerrte Audiosignal 32a - welches den frequenzverschobenen ersten Hochfrequenz-Anteil HF1 des ersten Audiosignals 18a umfasst - wird nun einerseits dem ersten adaptiven Filter 28a zur Erzeugung des ersten Kompensationssignals 12a zugeführt, andererseits als erstes Ausgangssignal 20a zum ersten Ausgangswandler 22a geleitet. Vergleichbares gilt für die zweite Frequenzverzerrung 30b hinsichtlich der Teilungsfrequenz tf und dem hieraus resultierenden zweiten Hochfrequenz- bzw. zweiten Niederfrequenz-Anteil HF2, NF2.The
In vielen Fällen wird das jeweilige Kompensationssignal 12a, 12b nur in denjenigen Frequenzbändern erzeugt, in welchen eine Unterdrückung der akustischen Rückkopplung überhaupt erforderlich ist. Für eine verbesserte, artefaktfreie Unterdrückung wird zur Dekorrelierung die Frequenzverzerrung 30a, 30b über den gesamten Frequenzbereich angewandt, in welchem die Rückkopplung zu unterdrücken ist. Das heißt, durch die Bestimmung der Teilungsfrequenz tf wird vorliegend nicht nur der Anwendungsbereich der jeweiligen Frequenzverzerrung 30a, 30b festgelegt, sondern auch der Frequenzbereich der beiden Kompensationssignale 12a, 12b und somit dem Anwendungsbereich der Unterdrückung der akustischen Rückkopplung.In many cases, the
Findet nun in einem der beiden akustischen Rückkopplungspfade 26a, 26b eine physikalische Änderung und somit eine Änderung der Übertragungsfunktion statt, wirkt sich diese Änderung unmittelbar auf die entsprechende Korrektur der Rücckopplung durch das jeweilige adaptive Filter 28a, 28b aus. Hierfür wären nun in den beiden Hörgeräten 4a, 4b jeweils Teilungsfrequenzen erforderlich, wobei die jeweils optimale Teilungsfrequenz - also mit größtmöglicher Unterdrückung der akustischen Rückkopplung bei geringstmöglicher Beeinflussung des Klangeindrucks im jeweiligen Ausgangsschallsignal 24a, 24b - jeweils von den lokalen Begebenheiten abhängt, und somit eigentlich zwei unterschiedliche Teilungsfrequenzen zu wählen wären, auf die dann jeweils lokal im Hörgerät 4a, 4b zu überblenden wäre. Dieses Überblenden mit unterschiedlichen Teilungsfrequenzen kann jedoch beim Benutzer des binauralen Hörgerätesystems 2 zu einem unvorteilhaften Hörempfinden derart führen, dass ihn umgebende Schallquellen scheinbar ihre Position verändern.If a physical change and thus a change in the transfer function now takes place in one of the two
Um nun diesem Höreindruck entgegenzuwirken, wird bei einer physikalischen Änderung des ersten akustischen Rückkopplungspfades 26a zunächst eine erste vorläufige Teilungsfrequenz tf1 vom ersten Hörgerät 4a an das zweite Hörgerät 4b übermittelt. Das zweite Hörgerät 4b empfängt die erste vorläufige Teilungsfrequenz tf1 und ermittelt seinerseits anhand des zweiten akustischen Rückkopplungspfades 26b, welcher sich ggf. auch leicht verändert haben könnte, eine zweite vorläufige Teilungsfrequenz tf2, welche an das erste Hörgerät 4a übertragen wird. Hat seit der letzten Aktualisierung der Teilungsfrequenz tf keine Veränderung im zweiten akustischen Rückkopplungspfad 26b stattgefunden, so kann als Wert der zweiten vorläufigen Teilungsfrequenz tf2 auch die aktuelle Teilungsfrequenz tf übermittelt werden.In order to counteract this auditory impression, a first provisional division frequency tf1 is first transmitted from the
Beide Hörgeräte 4a, 4b verfügen nun jeweils über die erste und über die zweite vorläufige Teilungsfrequenz tf1, tf2. Um ein gleichmäßiges Hörempfinden zu erreichen und dennoch eine hinreichende Unterdrückung der Rückkopplung an beiden Hörgeräten 4a, 4b sicherzustellen, wird als Teilungsfrequenz tf nun das Minimum aus der ersten vorläufigen Teilungsfrequenz tf1 und der zweiten vorläufigen Teilungsfrequenz tf2 festgelegt. Das erste Audiosignal 18a wird dann bei der Teilungsfrequenz tf wie beschrieben in einen ersten Hochfrequenz-Anteil HF1 und einen ersten Niederfrequenz-Anteil NF1 aufgeteilt, wobei der erste Hochfrequenz-Anteil HF1 frequenzverschoben wird und als erstes frequenzverzerrtes Audiosignal 32a dem ersten adaptiven Filter 28a für die Erzeugung des ersten Kompensationssignals 12a zugeführt wird. Vergleichbares gilt für das zweite Audiosignal 18b und das zweite frequenzverzerrte Audiosignal 32b hinsichtlich derselben Teilungsfrequenz tf.Both
- 22nd
- binaurales Hörgerätesystembinaural hearing aid system
- 4a, 4b4a, 4b
- erstes/zweites Hörgerätfirst / second hearing aid
- 66
- Schallsignal der UmgebungSound signal from the environment
- 8a, 8b8a, 8b
- erster/zweiter Eingangswandlerfirst / second input converter
- 10a, 10b10a, 10b
- erstes/zweites Eingangssignalfirst / second input signal
- 12a, 12b12a, 12b
- erstes/zweites Kompensationssignalfirst / second compensation signal
- 14a, 14b14a, 14b
- erstes/zweites kompensiertes Signalfirst / second compensated signal
- 16a, 16b16a, 16b
- erste/zweite Signalverarbeitungfirst / second signal processing
- 18a, 18b18a, 18b
- erstes/zweites Audiosignalfirst / second audio signal
- 20a, 20b20a, 20b
- erstes/zweites Ausgangssignalfirst / second output signal
- 22a, 22b22a, 22b
- erster/zweiter Ausgangswandlerfirst / second output converter
- 24a, 24b24a, 24b
- erstes/zweites Ausgangsschallsignalfirst / second output sound signal
- 26a, 26b26a, 26b
- erster/zweiter akustischer Rückkopplungspfadfirst / second acoustic feedback path
- 28a, 28b28a, 28b
- erstes/zweites adaptives Filterfirst / second adaptive filter
- 30a, 30b30a, 30b
- erste/zweite Frequenzverzerrungfirst / second frequency distortion
- 32a, 32b32a, 32b
- erstes/zweites frequenzverzerrtes Audiosignalfirst / second frequency distorted audio signal
- HF1, HF2HF1, HF2
- erster/zweiter Hochfrequenz-Anteilfirst / second high-frequency component
- NF1, NF2NF1, NF2
- erster/zweiter Niederfrequenz-Anteilfirst / second low frequency component
- tftf
- TeilungsfrequenzDivision frequency
- tf1, tf2tf1, tf2
- erste/zweite vorläufige Teilungsfrequenzfirst / second provisional division frequency
Claims (9)
- Method for operating a binaural hearing aid system (2) with a first hearing aid (4a) and a second hearing aid (4b),
wherein, for a suppression of acoustic feedback, a first audio signal (18a) of the first hearing aid (4a) is divided at a division frequency (tf) into a first high-frequency component (HF1) and a first low-frequency component (NF1), and a second audio signal (18b) of the second hearing aid (4b) is divided at the division frequency (tf) into a second high-frequency component (HF2) and a second low-frequency component (NF2),
wherein to update the division frequency (tf) for the division of the first audio signal (18a) into the first high-frequency component (HF1) and the first low-frequency component (NF1), a first provisional division frequency (tf1) is specified on the basis of a physical change in a first acoustic feedback path (26a) from a first output transducer (22a) of the first hearing aid (4a) to a first input transducer (8a) of the first hearing aid (4a), and a second provisional division frequency (tf2) is specified on the basis of a physical change in a second acoustic feedback path (26b) from a second output transducer (22b) of the second hearing aid (4b) to a second input transducer (8b) of the second hearing aid (4b),
wherein the first provisional division frequency (tf1) is transmitted from the first hearing aid (4a) to the second hearing aid (4b), wherein, following the reception of the first provisional division frequency (tf1), the second provisional division frequency (tf2) is transmitted from the second hearing aid (4b) to the first hearing aid (4a), and
wherein the division frequency (tf) is defined in the first hearing aid (4a) and in the second hearing aid (4b) according to the same specified rule on the basis of the first provisional division frequency (tf1) and the second provisional division frequency (tf2). - Method according to Claim 1,
wherein a first frequency distortion (30a) which differs in each case for the first high-frequency component (HF1) and the first low-frequency component (NF1) is applied to the first audio signal (18a) and a first frequency-distorted audio signal (32a) is generated as a result, and
wherein a second frequency distortion (30b) which differs in each case for the second high-frequency component (HF2) and the second low-frequency component (NF2) is applied to the second audio signal (18b) and a second frequency-distorted audio signal (32b) is generated therefrom. - Method according to Claim 1 or according to Claim 2,
wherein the division frequency (tf) is defined in each case on the basis of the minimum from the first provisional division frequency (tf1) and the second provisional division frequency (tf2). - Method according to one of the preceding claims,
wherein a first input signal (10a) is generated from a sound signal (6) of the environment in the first hearing aid (4a) by the first input transducer (8a), and
wherein the first audio signal (18a) is generated in the first hearing aid (4a) from the first input signal (8a) by a first signal processing (16a). - Method according to Claim 4,
wherein a first output signal (20a) which is converted by the first output transducer (22a) of the first hearing aid (4a) into a first output sound signal (24a) is generated from the first audio signal (18a),
wherein acoustic feedback via the first acoustic feedback path (26a) from the first output transducer (22a) to the first input transducer (8a) is suppressed using the first frequency-distorted audio signal (32a). - Method according to Claim 5,
wherein the division frequency (tf) is updated in response to an external triggering event. - Method according to Claim 6,
wherein an external triggering event comprises a change in the sound signal (6) of the environment, a change in the first feedback path and/or in the second feedback path (26a, 26b), a user input, a change in the first output signal (24a) resulting from a user input and a changed classification of a hearing situation by the hearing aid (4a, 4b) or the binaural hearing aid system (2). - Method according to one of Claims 5 to 7,
wherein the division frequency (tf) is updated in response to an internal triggering event. - Binaural hearing aid system (2) with a first hearing aid (4a) and a second hearing aid (4b), wherein the binaural hearing aid system (2) is configured to carry out the method according to one of the preceding claims.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102017201195.5A DE102017201195A1 (en) | 2017-01-25 | 2017-01-25 | Method for operating a binaural hearing aid system |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3355592A1 EP3355592A1 (en) | 2018-08-01 |
EP3355592B1 true EP3355592B1 (en) | 2020-05-20 |
Family
ID=60673633
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP17207542.6A Active EP3355592B1 (en) | 2017-01-25 | 2017-12-15 | Method for operating a binaural hearing aid system |
Country Status (5)
Country | Link |
---|---|
US (1) | US10277991B2 (en) |
EP (1) | EP3355592B1 (en) |
CN (1) | CN108347684B (en) |
DE (1) | DE102017201195A1 (en) |
DK (1) | DK3355592T3 (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3625791A4 (en) | 2017-05-18 | 2021-03-03 | Telepathy Labs, Inc. | Artificial intelligence-based text-to-speech system and method |
US10986447B2 (en) * | 2019-06-21 | 2021-04-20 | Analog Devices, Inc. | Doppler compensation in coaxial and offset speakers |
DE102020213051A1 (en) * | 2020-10-15 | 2022-04-21 | Sivantos Pte. Ltd. | Method for operating a hearing aid device and hearing aid device |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1699261B1 (en) * | 2005-03-01 | 2011-05-25 | Oticon A/S | System and method for determining directionality of sound detected by a hearing aid |
DK1992193T3 (en) * | 2006-03-03 | 2011-07-11 | Widex As | Hearing aid and method of applying gain limitation in a hearing aid |
DE102006014022A1 (en) | 2006-03-27 | 2007-10-11 | Siemens Audiologische Technik Gmbh | Hearing aid system with binaural data logging and corresponding procedure |
DE102008015263B4 (en) * | 2008-03-20 | 2011-12-15 | Siemens Medical Instruments Pte. Ltd. | Hearing system with subband signal exchange and corresponding method |
DE102009021310B4 (en) * | 2009-05-14 | 2011-02-24 | Siemens Medical Instruments Pte. Ltd. | Binaural hearing apparatus and method for operating a binaural hearing apparatus with frequency distortion |
CN102293017B (en) * | 2009-11-25 | 2014-10-15 | 松下电器产业株式会社 | System, method and integrated circuit for hearing aid |
JP5500125B2 (en) * | 2010-10-26 | 2014-05-21 | パナソニック株式会社 | Hearing aid |
DK2563045T3 (en) | 2011-08-23 | 2014-10-27 | Oticon As | Method and a binaural listening system to maximize better ear effect |
US9414150B2 (en) * | 2013-03-14 | 2016-08-09 | Cirrus Logic, Inc. | Low-latency multi-driver adaptive noise canceling (ANC) system for a personal audio device |
JP6285300B2 (en) * | 2014-07-07 | 2018-02-28 | リオン株式会社 | Hearing aid and feedback canceller |
DK2988529T3 (en) | 2014-08-20 | 2020-02-24 | Sivantos Pte Ltd | ADAPTIVE DISTRIBUTION FREQUENCY IN HEARING AID DEVICES |
-
2017
- 2017-01-25 DE DE102017201195.5A patent/DE102017201195A1/en active Pending
- 2017-12-15 DK DK17207542.6T patent/DK3355592T3/en active
- 2017-12-15 EP EP17207542.6A patent/EP3355592B1/en active Active
-
2018
- 2018-01-18 US US15/873,939 patent/US10277991B2/en active Active
- 2018-01-24 CN CN201810067586.1A patent/CN108347684B/en active Active
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
US10277991B2 (en) | 2019-04-30 |
US20180213336A1 (en) | 2018-07-26 |
EP3355592A1 (en) | 2018-08-01 |
CN108347684A (en) | 2018-07-31 |
DE102017201195A1 (en) | 2018-07-26 |
DK3355592T3 (en) | 2020-08-24 |
CN108347684B (en) | 2020-08-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2180726B2 (en) | Sound localization in binaural hearing aids | |
DE69631781T2 (en) | DIGITAL HEARING AID SYSTEM | |
EP3451705B1 (en) | Method and apparatus for the rapid detection of own voice | |
DE102005020317B4 (en) | Automatic gain adjustment on a hearing aid | |
DE102006020832B4 (en) | Method for suppressing feedback in hearing devices | |
EP1912471B1 (en) | Processing of an input signal in a hearing aid | |
EP3461147B1 (en) | Method for operating a hearing device | |
EP2164283B1 (en) | Hearing aid and operation of a hearing aid with frequency transposition | |
EP3355592B1 (en) | Method for operating a binaural hearing aid system | |
EP2645743B1 (en) | Hearing aid for a binaural supply and method for providing a binaural supply | |
EP1912473A1 (en) | Processing an input signal in a hearing aid | |
EP2840809A2 (en) | Control of the strength of the effect of a binaural directional microphone | |
DE102011006129B4 (en) | Hearing device with feedback suppression device and method for operating the hearing device | |
EP3926982A2 (en) | Method for direction-dependent noise suppression for a hearing system comprising a hearing device | |
EP2276272B1 (en) | Hearing aid and method for suppressing feedback | |
DE102010006154B4 (en) | Hearing aid with frequency shift and associated method | |
DE202019107201U1 (en) | Binaural hearing aid for improved spatial hearing perception | |
DE102021103769B4 (en) | Methods for signal processing | |
DE102019213810B3 (en) | Method for operating a hearing aid and hearing aid | |
DE102010003225A1 (en) | In-ear monitor system and method for controlling an in-ear monitor system | |
EP1909534A2 (en) | Hearing device with asymmetric audio balance and corresponding adjusting method | |
EP4109929A1 (en) | Method for directional signal processing of microphone array signals | |
EP4236371A1 (en) | Method for reducing echo in a hearing instrument | |
EP4243448A1 (en) | Method for operating a hearing aid |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20190125 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20190411 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20191219 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502017005374 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1273435 Country of ref document: AT Kind code of ref document: T Effective date: 20200615 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20200819 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20200520 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200921 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200920 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200821 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200820 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200820 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502017005374 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20210223 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20201231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201215 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201215 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200520 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201231 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20230103 Year of fee payment: 6 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20231220 Year of fee payment: 7 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20231219 Year of fee payment: 7 Ref country code: DK Payment date: 20231219 Year of fee payment: 7 Ref country code: DE Payment date: 20231214 Year of fee payment: 7 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 1273435 Country of ref document: AT Kind code of ref document: T Effective date: 20221215 |