EP2890154B1 - Hearing aid with feedback suppression - Google Patents

Hearing aid with feedback suppression Download PDF

Info

Publication number
EP2890154B1
EP2890154B1 EP13199680.3A EP13199680A EP2890154B1 EP 2890154 B1 EP2890154 B1 EP 2890154B1 EP 13199680 A EP13199680 A EP 13199680A EP 2890154 B1 EP2890154 B1 EP 2890154B1
Authority
EP
European Patent Office
Prior art keywords
signal
output
feedback
adaptive filter
hearing aid
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP13199680.3A
Other languages
German (de)
French (fr)
Other versions
EP2890154A1 (en
Inventor
Erik Cornelis Diederik Van Der Werf
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GN Hearing AS
Original Assignee
GN Resound AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GN Resound AS filed Critical GN Resound AS
Priority to DK13199680.3T priority Critical patent/DK2890154T3/en
Priority to EP13199680.3A priority patent/EP2890154B1/en
Priority to US14/144,474 priority patent/US9628923B2/en
Publication of EP2890154A1 publication Critical patent/EP2890154A1/en
Application granted granted Critical
Publication of EP2890154B1 publication Critical patent/EP2890154B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/45Prevention of acoustic reaction, i.e. acoustic oscillatory feedback
    • H04R25/453Prevention of acoustic reaction, i.e. acoustic oscillatory feedback electronically
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40Arrangements for obtaining a desired directivity characteristic
    • H04R25/405Arrangements for obtaining a desired directivity characteristic by combining a plurality of transducers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40Arrangements for obtaining a desired directivity characteristic
    • H04R25/407Circuits for combining signals of a plurality of transducers

Definitions

  • a hearing aid performing adaptive feedback suppression is provided. Accordingly, feedback suppression is performed with a slow adaptive filter modelling slow changes of a feedback path and a fast adaptive filter modelling rapid changes of the feedback path.
  • acoustical signals arriving at a microphone of the hearing aid are amplified and output with a small loudspeaker to restore audibility. The small distance between the microphone and the loudspeaker may cause feedback.
  • Feedback is generated when a part of the amplified acoustic output signal propagates back to the microphone for repeated amplification. When the feedback signal exceeds the level of the original signal at the microphone, the feedback loop becomes unstable, typically leading to audible distortions or howling.
  • One way to stop feedback is to lower the gain. The risk of feedback, limits the maximum gain that can be used with a hearing aid.
  • the feedback model signal is provided by a digital feedback suppression circuit configured to model the feedback path of propagation along which an output signal of the hearing aid propagates back to an input of the hearing aid for repeated amplification.
  • the transfer function of the receiver in the art of hearing aids, a loudspeaker of the hearing aid is usually denoted the receiver, and the transfer function of the microphone are included in the model of the feedback path of propagation.
  • the digital feedback suppression circuit includes one or more digital adaptive filters to model the feedback path.
  • An output of the feedback suppression circuit is subtracted from the audio signal of the microphone to remove the feedback signal part of the audio signal.
  • the hearing aid may comprise separate digital feedback suppression circuits for individual microphones and groups of microphones.
  • WO 99/26453 A1 provides a useful review of methods of feedback suppression in hearing aids.
  • WO 99/26453 A1 discloses feedback suppression with two adaptive filters connected in series, see Fig. 1 .
  • the first filter is adapted during fitting of the hearing aid to the intended user and/or when the hearing aid is turned on in the ear. This filter adapts quickly using a white noise probe signal, and then the filter coefficients are frozen, i.e. during normal operation of the hearing aid; the first filter operates as a fixed filter.
  • the first filter models those parts of the hearing aid feedback path that are assumed to be essentially constant while the hearing aid is in use, such as the microphone, amplifier driving the receiver, and receiver resonances, and the basic acoustic feedback path.
  • the second filter adapts while the hearing aid is in use and does not use a separate probe signal.
  • This filter provides a rapid correction to the feedback suppression circuit when the hearing aid goes unstable, and tracks perturbations in the feedback path that occur in daily use, such as caused by chewing, sneezing, or using a telephone handset.
  • the series connection of a fixed filter and an adaptive filter provides a good trade-off between speed and accuracy.
  • a single long filter tends to be slow and/or inaccurate.
  • the fixed filter is an IIR-filterwith relatively low processor requirements.
  • the filter coefficients of the fixed filter are determined for each individual user when the hearing aid is fitted to the user by a dispenser or another trained person. This not only requires an additional fitting step, but also fails to capture the true invariant part of the feedback path because the feedback path measured by the dispenser already includes some of the variant parts.
  • the fitting of the hearing aid in the ear canal is included in the invariant part, but it may be subject to changes, e.g. when the hearing aid is re-inserted in the ear.
  • WO 99/26453 A1 also mentions the possibility of allowing the first filter to adapt slowly to follow slow changes in the hearing aid, such as component drift. However, no further explanation on how to allow the first filter to slowly adapt, i.e. no method of adaptation for the slow adaptive filter, is disclosed in WO 99/26453 A1 .
  • claim 1 proposes a hearing aid comprising inter alia a slowly adapting filter whereby initialisation during fitting or during power-up of the hearing aid in order to determine values of filter coefficients is avoided.
  • a hearing aid comprising an input transducer for generating an audio signal, a feedback suppression circuit configured for modelling a feedback path of the hearing aid, a subtractor for subtracting an output signal of the feedback suppression circuit from the audio signal to form a feedback compensated audio signal, a hearing loss processor that is coupled to an output of the subtractor for processing the feedback compensated audio signal to perform hearing loss compensation, and preferably, an output transducer, preferably a receiver, that is coupled to an output of the hearing loss processor for providing a sound signal based on the processed feedback compensated audio signal, wherein the feedback suppression circuit comprises
  • the output of the fast adaptive filter may constitute an output of the feedback suppression circuit.
  • a transducer is a device that converts a signal in one form of energy to a corresponding signal in another form of energy.
  • the input transducer may comprise a microphone that converts an acoustic signal arriving at the microphone into a corresponding analogue audio signal in which the instantaneous voltage of the audio signal varies continuously with the sound pressure of the acoustic signal.
  • the input transducer may also comprise a telecoil that converts a magnetic field at the telecoil into a corresponding analogue audio signal in which the instantaneous voltage of the audio signal varies continuously with the magnetic field strength at the telecoil.
  • Telecoils are typically used to increase the signal to noise ratio of speech from a speaker addressing a number of people in a public place, e.g. in a church, an auditorium, a theatre, a cinema, etc., or through a public address systems, such as in a railway station, an airport, a shopping mall, etc. Speech from the speaker is converted to a magnetic field with an induction loop system (also denoted "hearing loop"), and the telecoil is used to magnetically pick up the magnetically transmitted speech signal.
  • an induction loop system also denoted "hearing loop”
  • feedback may be generated when the telecoil picks up a magnetic field generated by the hearing aid, e.g. generated by the receiver.
  • the input transducer may further comprise at least two spaced apart microphones, and a beamformer configured for combining microphone output signals of the at least two spaced apart microphones into a directional microphone signal, e.g. as is well-known in the art.
  • the input transducer may comprise one or more microphones and a telecoil and a switch, e.g. for selection of an omni-directional microphone signal, or a directional microphone signal, or a telecoil signal, either alone or in any combination, as the audio signal.
  • a switch e.g. for selection of an omni-directional microphone signal, or a directional microphone signal, or a telecoil signal, either alone or in any combination, as the audio signal.
  • the output transducer preferably comprises a receiver, i.e. a small loudspeaker, which converts an analogue audio signal into a corresponding acoustic sound signal in which the instantaneous sound pressure varies continuously in accordance with the amplitude of the analogue audio signal.
  • a receiver i.e. a small loudspeaker
  • the analogue audio signal is made suitable for digital signal processing by conversion into a corresponding digital audio signal in an analogue-to-digital converter whereby the amplitude of the analogue audio signal is represented by a binary number.
  • a discrete-time and discrete-amplitude digital audio signal in the form of a sequence of digital values represents the continuous-time and continuous-amplitude analogue audio signal.
  • the feedback signal part of the audio signal is termed the feedback signal part of the audio signal; or in short, the feedback signal.
  • the feedback suppression circuit is provided in the hearing aid in order to model the feedback path, i.e. desirably the feedback suppression circuit has the same transfer function as the feedback path itself so that an output signal of the feedback suppression circuit matches the feedback signal part of the audio signal as closely as possible.
  • a subtractor is provided for subtraction of the output signal of the feedback suppression circuit from the audio signal to form a feedback compensated audio signal in which the feedback signal part has been removed or at least reduced.
  • the feedback suppression circuit comprises an adaptive filter that tracks the current transfer function of the feedback path.
  • the feedback suppression circuit may comprise one or more electronic delays corresponding to the delay of the feedback signal propagating along the feedback path of the hearing aid.
  • the feedback suppression circuit may comprise at least one fixed filter configured for modelling stationary parts of the feedback path of the hearing aid.
  • the feedback suppression circuit may comprise at least one slow adaptive filter and at least one fast adaptive filter configured for modelling the feedback path.
  • the slow adaptive filter eliminates the need for initialisation of the feedback suppression circuit during fitting to the intended user or during power-up of the hearing aid.
  • the slow adaptive filter improves the performance of the feedback suppression circuit with relation to slow changes of the feedback path, such as accumulation of ear wax, changes due to reinsertion of the hearing aid in the ear canal of the user, drift of electronic components of the hearing aid, etc.
  • the slow adaptive filter may track changes taking place in minutes or even slower, while the fast adaptive filter may track changes, such as smiling, chewing, sneezing, using a telephone handset, etc, taking place in tens of milliseconds and up to seconds.
  • the filter coefficients of the slow adaptive filter may be based at least in part on a difference between the output signal of the slow adaptive filter and the audio signal.
  • the filter coefficients of the slow adaptive filter may be based at least in part on a difference between the output signal of the slow adaptive filter and the output signal of fast adaptive filter.
  • the filter coefficients of the slow adaptive filter may be based at least in part on a difference between an output signal of the slow adaptive filter and a weighted sum of the output signal of the fast adaptive filter and first audio signal.
  • the above components and signals of the hearing aid mentioned for the first time are denoted the first respective components and signals to distinguish them from the second respective components and signals mentioned below.
  • the hearing aid may further comprise a second input transducer for generating a second audio signal, a second feedback suppression circuit configured for modelling a second feedback path of the hearing aid, a second subtractor for subtracting a second output signal of the second feedback suppression circuit from the second audio signal to form a second feedback compensated audio signal, and wherein the hearing loss processor is coupled to the second subtractor for processing the second feedback compensated audio signal to perform hearing loss compensation, and wherein the second feedback suppression circuit comprises
  • the output of the second fast adaptive filter may constitute an output of second feedback suppression circuit.
  • the distances between the input transducers are usually small due to the small sizes of hearing aid housings.
  • the feedback paths to individual input transducers proximate to each other are expected to have similar transfer functions and therefore one filter may be used to model one of the feedback paths to a respective one of the input transducers and simpler filters, in the following denoted "correction filters", may be used to model differences between the modelled feedback path and other feedback paths to respective other input transducers, whereby duplication of common features of the slow adaptive filters are substantially avoided.
  • the feedback path differences may lead to sub-sample delays and minor shaping of the magnitude responses due to the small differences in physical distances between the output transducer and the input transducers in question.
  • the primary purpose of the correction filters may be to implement a form of interpolation which ideally requires an anti-causal impulse response, since interpolation is desirably based on samples on both sides of the interpolated point.
  • interpolation is desirably based on samples on both sides of the interpolated point.
  • Normally such a filter is difficult to implement, but for the feedback suppression circuit this is possible due to a total bulk delay in the feedback loop of typically at least up to two blocks of samples. Some of this bulk delay can be used to provide the response a bit ahead of time so that the correction filters have sufficient information to perform the desired interpolation.
  • the idea of modelling differences in feedback paths may also be applied to the fast adaptive filters. Changes in the dynamic feedback paths may also cause sub-sample time differences in the feedback loop and may also cause minor shaping of the magnitude responses suitable for modelling by interpolation.
  • Electronic delays corresponding to the delays caused by propagation of signals along the feedback path may be arranged in the feedback suppression circuit. This simplifies the adaptive filters and also facilitates interpolation based on samples before and after the interpolation point in time.
  • Delays of the feedback suppression circuit corresponding to propagation delays along the corresponding feedback paths may be provided in the form of one common delay, preferably the shortest delay between the output transducer and one of the input transducers, and individual delays modelling the additional delay from the output transducer to the respective other input transducers.
  • the slow adaptive filter may be FIR filters which are less complex and more stable than IIR filters.
  • the output signals of the slow filters may be scaled, preferably scaled adaptively, using bit shifters. Scaling, such as adaptive scaling, maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths.
  • the filter coefficients of the second slow adaptive filter may be based at least in part on a difference between the output signal of the second slow adaptive filter and the second audio signal.
  • the filter coefficients of the second slow adaptive filter may be based at least in part on a difference between the output signal of the second slow adaptive filter and the output signal of second fast adaptive filter.
  • the filter coefficients of the second slow adaptive filter may be based at least in part on a difference between an output signal of the second slow adaptive filter and a weighted sum of the output signal of the second fast adaptive filter and the second audio signal.
  • the slow filter desirably models properties of the feedback path subject to slow changes only
  • the fast adaptive filter desirably models rapid changes only. Consequently, a different error criterion for the slow adaptive filter and the fast adaptive filter may be more appropriate.
  • Error signal e 1 is less sensitive to bias because the fast adaptive filter uses an adaptive signal model, but it may lead to local minima that may trap the slow adaptive filter preventing it for further adaptation.
  • Error signal e 2 is optimal for uncorrelated signals, but may suffer more from bias caused by tonal input.
  • Derivation for the front-to-rear correction filter coefficient may be analogous except that the cross correlation is now performed with the output signal of the common slow adaptive filter d(n), which is input to the correction filter.
  • the step size may be determined in a way well known in the art of adaptive filters, such as by the least mean squares (LMS) algorithm, the normalized least mean squares (NLMS) algorithm, or by line searches, conjugate gradients, Hessian estimation techniques, etc.
  • LMS least mean squares
  • NLMS normalized least mean squares
  • the filter coefficients In order to minimize complexity of the adjustment of the filter coefficients, only some of the coefficients, i.e. at least one coefficient, may be adjusted, i.e. updated, for each block of samples. Since only cross-correlations are used, the computational complexity for a single weight is roughly equivalent to that of adding a single FIR filter coefficient. Updating more than e.g. four filter coefficients per block may not be desired, at least for the slow adaptive filter.
  • a good step size for the sign-based update is defined proportional to the feedback path magnitude response. Once, at least a rough indication of, the feedback magnitude is known, this approach provides nearly constant accuracy for tracking changes of the feedback path independent of the feedback signal level.
  • Another approach may be used directly after power up of the hearing aid, when the feedback path is not known yet.
  • a faster, and initially even non-proportional, step size may be used to speed up convergence and quickly silence possible initial feedback, such as howling.
  • the transition time from initial to final rate may be configurable, and may be in the order of a few seconds up to around a minute.
  • a slow gain ramp-up and loading of coefficients previously stored in persistent memory may be performed.
  • one or more criteria for adaptation may be added for the slow adaptive filter, whereby the slow adaptive filter may be configured to adjust one or more of its filter coefficients only under certain conditions.
  • the slow adaptive filter may only be configured to adjust one or more of its filter coefficients when (1) the signal level is above a predefined threshold, and/or, (2) the (direct error) signal and corresponding signal model are considered save for adaptation, and/or (3) the hearing aid is in its initial start-up phase (directly after power up).
  • the level threshold (1) primarily prevents adapting to meaningless input signals, e.g., microphone noise. This may also extend the start-up phase when the algorithm is booted in quiet or in a muted condition.
  • the signal is considered save for adaptation when it is not too predictable, e.g. a pure tone is too predictable, which is determined by comparing the signal level of a de-correlated error signal, e.g. as used for updating the fast adaptive filter, with the level of the direct error signal itself.
  • the error signal is considered save when a p-norm, preferably the 1-norm, of the coefficient vector of the fast adaptive filter (representing the signal model) is below a predetermined threshold value (a large one-norm indicates tonal input).
  • the hearing aid may be a multi-band hearing aid performing hearing loss compensation differently in different frequency bands, thus accounting for the frequency dependence of the hearing loss of the intended user.
  • the audio signal from the input transducer is divided into two or more frequency channels or bands; and, typically, the audio signal is amplified differently in each frequency band.
  • a compressor may be utilized to compress the dynamic range of the audio signal in accordance with the hearing loss of the intended user.
  • the compressor performs compression differently in each of the frequency bands varying not only the compression ratio, but also the time constants associated with each band.
  • the time constants refer to compressor attack and release time constants.
  • the compressor attack time is the time required for the compressor to lower the gain at the onset of a loud sound.
  • the release time is the time required for the compressor to increase the gain after the cessation of the loud sound.
  • the frequency bands may be warped frequency bands.
  • the hearing aid may have a compressor that performs dynamic range compression using digital frequency warping as disclosed in more detail in WO 03/015468 , in particular the basic operating principles of a warped compressor are illustrated in Fig. 11 and the corresponding parts of the description of WO 03/015468 .
  • the feedback suppression circuit e.g. including one or more adaptive filters, may be a broad band model, i.e. the model may operate substantially in the entire frequency range of operation of the hearing aid, or in a significant part of the frequency range of the hearing aid, without being divided into a set of frequency bands.
  • the feedback suppression circuit may be divided into a set of frequency bands for individual modelling of the feedback path in each frequency band.
  • the estimate of the residual feedback signal may be provided individually in each frequency band m of the feedback suppression circuit.
  • the frequency bands m of the feedback suppression circuit and the frequency bands k of the hearing loss compensation may be identical, but preferably, they are different, and preferably the number of frequency bands m of the feedback suppression circuit is less than the number of frequency bands of the hearing loss compensation.
  • audio signal is used to identify any analogue or digital signal forming part of the signal path from an output of the microphone to an input of the hearing loss processor.
  • the feedback suppression circuit may be implemented as one or more dedicated electronic hardware circuits or may form part of a signal processor in combination with suitable signal processing software, or may be a combination of dedicated hardware and one or more signal processors with suitable signal processing software.
  • Signal processing in the new hearing aid may be performed by dedicated hardware or may be performed in a signal processor, or performed in a combination of dedicated hardware and one or more signal processors.
  • processor As used herein, the terms "processor”, “signal processor”, “controller”, “system”, etc., are intended to refer to CPU-related entities, either hardware, a combination of hardware and software, software, or software in execution.
  • a "processor”, “signal processor”, “controller”, “system”, etc. may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
  • processor designate both an application running on a processor and a hardware processor.
  • processors may reside within a process and/or thread of execution, and one or more "processors”, “signal processors”, “controllers”, “systems”, etc., or any combination hereof, may be localized on one hardware processor, possibly in combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
  • a processor may be any component or any combination of components that is capable of performing signal processing.
  • the signal processor may be an ASIC processor, a FPGA processor, a general purpose processor, a microprocessor, a circuit component, or an integrated circuit.
  • Fig. 1 schematically illustrates a hearing aid 10 and a feedback path 12 along which signals generated by the hearing aid 10 propagates back to an input of the hearing aid 10.
  • an acoustical signal 14 is received at a microphone 16 that converts the acoustical signal 14 into an audio signal 18 that is input to the hearing loss processor 20 for hearing loss compensation.
  • the audio signal 18 is amplified in accordance with the hearing loss of the user.
  • the hearing loss processor 20 may for example comprise a multi-band compressor.
  • the output signal 22 of the hearing loss processor 20 is converted into an acoustical output signal 24 by the receiver 26 that emits the acoustical signal towards the eardrum of the user when the hearing aid 10 is worn in its proper operational position at an ear of the user.
  • a part of the acoustical signal 24 from the receiver 26 propagates back to the microphone 16 as indicated by feedback path 12 in Fig. 1 .
  • the feedback signal level at the microphone 16 may exceed the level of the original acoustical signal 14 thereby causing audible distortion and possibly howling.
  • Fig. 2 schematically illustrates a hearing aid 10 with a feedback suppression circuit 28.
  • the feedback suppression circuit 28 models the feedback path 12, i.e. the feedback suppression circuit seeks to generate a signal that is identical to the signal propagated along the feedback path 12. It is noted that the feedback suppression circuit 28 includes models of the receiver 26 and the microphone 16 so that the transfer function of the feedback suppression circuit 28 desirably equals the sum of the transfer function of the receiver 26, the transfer function of the feedback path 12, and the transfer function of the microphone 16.
  • the feedback suppression circuit 28 generates an output signal 30 to the subtractor 32 in order to suppress or cancel the feedback signal part of the audio signal 18 before processing takes place in the hearing loss processor 20.
  • the feedback suppression circuit 28 is typically an adaptive digital filter which adapts to changes in the feedback path 12.
  • WO 99/26453 A1 discloses feedback suppression with a series connection of two adaptive filters.
  • a first filter 36 is adapted when the hearing aid is fitted to the intended user at a dispenser's office. During the fitting, the filter 36 adapts quickly using a white noise probe signal, and then the filter coefficients are frozen, i.e. subsequently, during normal operation of the hearing aid, the first filter 36 operates as a fixed filter 36.
  • the first filter 36 models those parts of the hearing aid feedback path 12 that are assumed to be essentially constant while the hearing aid 10 is in use, such as the transfer function of the microphone 16, and the transfer function of the receiver 26, and a basic part of the feedback path 12.
  • the second filter 38 adapts while the hearing aid 10 is in use and does not use a separate probe signal.
  • This filter 38 provides a rapid correction of the feedback suppression circuit 28 when the hearing aid 10 goes unstable, and tracks perturbations in the feedback path 12 that occur in daily use, such as caused by chewing, sneezing, or using a telephone handset.
  • the fast adaptive filter 38 may track changes taking place in tens of milliseconds up to seconds.
  • the fixed filter 26 fails to capture the true invariant part of the modelled transfer functions, because the determined fixed filter coefficients already include some of the variant parts.
  • the fitting of the hearing aid 10 in the ear canal is included in the invariant part, but it may be subject to changes, e.g. when the hearing aid 10 is re-inserted in the ear.
  • new hearing aids are illustrated that do not require an additional fitting step and also copes with the true variant parts of the modelled transfer functions.
  • Fig. 3 shows a first example of a hearing aid 10 according to the appended claims.
  • the hearing aid 10 has an input transducer, namely a microphone 16a, for generating an audio signal 18a, and feedback suppression circuit 28a that models the feedback path 12a, i.e. the feedback suppression circuit 28a seeks to generate a signal that is identical to the signal propagated along the feedback path 12a.
  • the feedback suppression circuit 28a includes models of the receiver 26 and the microphone 16a so that the transfer function of the feedback suppression circuit 28a desirably equals the sum of the transfer function of the receiver 26, the transfer function of the feedback path 12a, and the transfer function of the microphone 16a.
  • the feedback suppression circuit 28a generates an output signal 30a to the subtractor 32a in order to suppress or cancel the feedback signal part of the audio signal 18a before processing takes place in the hearing loss processor 20.
  • a hearing loss processor 20 is coupled to an output of the subtractor 32a for processing the feedback compensated audio signal 34a to perform hearing loss compensation, and a receiver 26 that is coupled to an output of the hearing loss processor 20 for converting the processed feedback compensated audio signal 22 into a sound signal.
  • the feedback suppression circuit 28a comprises a slow adaptive filter 36a with an input coupled to the output of the hearing loss processor 20 and an output, and a fast adaptive filter 38a with an input coupled to the output of the slow adaptive filter 36a and an output constituting the output of feedback suppression circuit 28a.
  • the cancellation signal 30a in most situations constitutes a good estimate of the feedback signal part of the audio signal 18a, and therefore the slow adaptive filter 36a is connected for tracking the signal 30a, thus absorbing innovations from the fast adaptive filter 38a.
  • filter coefficients of the slow adaptive filter 36a are based, at least in part, on an error signal 42a equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and the cancellation signal 30a output by the fast adaptive filter 38a.
  • Filter coefficients of the fast adaptive filter 38a are based, at least in part, on the error signal 34a output by subtractor 32a.
  • slow adaptive filter 36a With the slow adaptive filter 36a, it is not required to initialize the feedback suppression circuit 28a. Also, slow changes in the feedback path are adequately modelled by the slow adaptive filter 36a
  • a fixed filter may be connected in series with the slow adaptive filter 36a and the fast adaptive filter 38a configured for modelling true invariant parts of the feedback path 12a, such as initial values of the transfer function of the microphone 16a, the transfer function of an amplifier (not shown) driving the receiver 26, and the transfer function of the receiver 26, and a basic part of the feedback path 12a, so that the adaptive filters 36a, 38a are only required to cope with variations from the initial values.
  • a bulk delay may be connected in series with the slow adaptive filter 36a and the fast adaptive filter 38a configured for modelling the propagation delay of the feedback signal propagating along the feedback path and thereby relieving the adaptive filters 36a, 38a of this task.
  • Barrel shifters may be connected at the output of the slow adaptive filter 36a and/or the fast adaptive filter 38a in order to scale the output signals, preferably adaptively.
  • Scaling such as adaptive scaling, maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths.
  • the hearing aid 10 shown in Fig. 4 is similar to the hearing aid of Fig. 3 except for the fact that the hearing aid 10 of Fig. 4 has two microphones 16a, 16b, namely a front microphone 16a and a rear microphone 16b, and the hearing loss processor 20 comprises a beamformer for selectable beamforming as is well-known in the art of hearing aids.
  • the feedback path 12a to the front microphone 16a is modelled by first feedback suppression circuit 28a identical to the feedback circuit 28a shown in Fig. 3 .
  • the feedback path 12b to the rear microphone 16b is modelled by second feedback suppression circuit 28b corresponding to the feedback circuit 28a shown in Fig. 3 except for the fact that the input of the second slow adaptive filter 36b is coupled to the output 44a of the first slow adaptive filter 36a instead of to the output 22 of the hearing loss processor 20.
  • the distance between the receiver 26 to the front microphone 12a is shorter than the distance between the receiver 26 and the rear microphone 12b. If the opposite is true, i.e. the distance between the receiver 26 and the rear microphone 12b is the shortest, then microphone 12a is the rear microphone and microphone 12b is the front microphone.
  • the first slow adaptive filter 36a models slow varying parts of the feedback path to the front microphone 12a
  • the second slow adaptive filter 36b models the difference between the feedback path to front microphone 12a and the feedback path to rear microphone 12b, so that the series connection of the first slow adaptive filter 36a and the second slow adaptive filter 36b together model the feedback path to the rear microphone 12b.
  • the distance between the front and rear microphones 16a, 16b is small, and the respective feedback paths 12a, 12b have similar transfer functions with sub-sample delay differences and minor differences in the shaping of the magnitude responses. Therefore, the second slow adaptive filter 36b is simpler than first slow adaptive filter 36a.
  • the second slow adaptive filter 36b performs anti-causal interpolation made possible by bulk delays; see Fig. 11 , of the feedback suppression circuits 28a, 28b.
  • the feedback paths 12a, 12b to the front microphone 16a and the rear microphone 16b, respectively may be modelled by independent feedback circuits 28a, 28b, each of which is similar to the feedback circuit 28a shown in Fig. 3 with the inputs of both the first and the second slow adaptive filters 36a, 36b coupled to the output 22 of the hearing loss processor 20.
  • a first fixed filter may be connected in series with the first slow adaptive filter 36a and the first fast adaptive filter 38a configured for modelling true invariant parts of the first feedback path 12a, such as initial values of the transfer function of the microphone 16a, the transfer function of an amplifier (not shown) driving the receiver 26, and the transfer function of the receiver 26, and a basic part of the first feedback path 12a, so that the first slow and fast adaptive filters 36a, 38a are only required to cope with variations from the initial values.
  • a second fixed filter may be connected in series with the second slow adaptive filter 36b and the second fast adaptive filter 38b configured for modelling invariant parts of the second feedback path 12b, such as initial values of the transfer function of the microphone 16b, the transfer function of an amplifier (not shown) driving the receiver 26, and the transfer function of the receiver 26, and a basic part of the second feedback path 12b, so that the second slow and fast adaptive filters 36b, 38b are only required to cope with variations from the initial values.
  • Respective bulk delays are connected in series with the slow adaptive filters 36a, 36b and the fast adaptive filters 38a, 38b configured for modelling the propagation delays of the respective feedback signals propagating along the feedback paths 12a, 12b, and thereby relieving the adaptive filters 36a, 36b, 38a, 38b of this task.
  • the bulk delays are distributed to facilitate anti-causal interpolation in the second slow adaptive filter 36b.
  • Respective barrel shifters are connected at the outputs of the slow adaptive filters 36a, 36b in order to adaptively scale the respective output signals 44a, 44b. Scaling maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths.
  • the hearing aid 10 shown in Fig. 5 is similar to the hearing aid of Fig. 3 except for the fact that the filter coefficients of slow adaptive filter 36a of the hearing aid 10 of Fig. 5 are based, at least in part, on an error signal 42a that is equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and the audio signal 18a; rather than being equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and the cancellation signal 30a output by the fast adaptive filter 38a.
  • the error signal 42a is also denoted a direct approach error and it is effectively the signal that would be the output of the feedback suppression circuit, if the fast adaptive filter was frozen in its reference state.
  • the error signal 42a is optimal for uncorrelated signals, but may suffer more from bias caused by tonal input, whereas the error signal 42a of Fig. 3 is less sensitive to bias because the fast adaptive filter uses an adaptive signal model, but it may lead to local minima that may trap the slow adaptive filter preventing it for further adaptation.
  • the hearing aid 10 shown in Fig. 6 is similar to the hearing aid of Fig. 4 except for the fact that as in Fig. 5 , the filter coefficients of first slow adaptive filter 36a of the hearing aid 10 of Fig. 5 are based, at least in part, on a first error signal 42a equal to a difference output by first subtractor 40a between a first output signal 44a of the first slow adaptive filter 36a and the first audio signal 18a; rather than being equal to a difference output by first subtractor 40a between a first output signal 44a of the first slow adaptive filter 36a and the first cancellation signal 30a output by the first fast adaptive filter 38a.
  • the filter coefficients of second slow adaptive filter 36b are based, at least in part, on second error signal 42b equal to a difference output by second subtractor 40b between a second output signal 44b of the second slow adaptive filter 36b and the second audio signal 18b; rather than being equal to a difference output by second subtractor 40b between a second output signal 44b of the second slow adaptive filter 36b and the second cancellation signal 30b output by the second fast adaptive filter 38b.
  • the hearing aid 10 shown in Fig. 7 combines the error signals 42a shown in Figs. 3 and 5 , respectively.
  • the hearing aid 10 shown in Fig. 7 is similar to the hearing aid of Figs. 3 except for the fact that the filter coefficients of slow adaptive filter 36a of the hearing aid 10 of Fig. 7 are based, at least in part, on an error signal 42a that is equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and a weighted sum of the audio signal 18a and the cancellation signal 30a output by the fast adaptive filter 38a; rather than being equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and the cancellation signal 30a output by the fast adaptive filter 38a.
  • the hearing aid 10 shown in Fig. 8 is similar to the hearing aid of Figs. 4 or 6 except for the fact that as in Fig. 7 , the filter coefficients of the first slow adaptive filter 36a of the hearing aid 10 of Fig. 7 are based, at least in part, on a first error signal 42a that is equal to a difference output by first subtractor 40a between a first output signal 44a of the first slow adaptive filter 36a and a weighted sum of the first audio signal 18a and the first cancellation signal 30a output by first fast adaptive filter 38a.
  • the filter coefficients of second slow adaptive filter 36b are based, at least in part, on second error signal 42b equal to a difference output by second subtractor 40b between a second output signal 44b of the second slow adaptive filter 36b and a weighted sum of second audio signal 18b and second cancellation signal 30b output by second fast adaptive filter 38b.
  • Fig. 9 shows a hearing aid 10 according to the appended claims, having a fast adaptive filter 38a included in signal modelling circuitry 64.
  • the signal modelling circuitry 64 may substitute the adaptive filters 38a, 38b of the hearing aids shown in Figs. 3-8 .
  • the fast adaptive filters 38a, 38b shown in Figs. 3-8 operate according to the so-called "direct approach” to minimize the expected signal strength of the error signal 34a, 34b.
  • the "direct approach” is well-known in the art of hearing aids, and the minimization of the error signal is typically performed using the least mean squares (LMS) algorithm, the normalized least mean squares (NLMS) algorithm, preferably the Block Normalized Least Mean Squares (BNLMS) algorithm, wherein the square error criterion is minimized over a block of samples
  • LMS least mean squares
  • NLMS normalized least mean squares
  • BNLMS Block Normalized Least Mean Squares
  • De-correlation circuit 54 applies adaptive de-correlation to error signal 34a to obtain filtered error signal 58.
  • De-correlation circuit 56 applies adaptive de-correlation symmetrically to fast adaptive filter input 44a to obtain filtered input 60 so that cross-correlating both signals in algorithm block 62 provides a gradient estimate to minimize the filtered error criterion, which is known to be more robust for tonal or self-correlated external signals.
  • the signal model used in the de-correlation filters 54, 56 is obtained from error signal 34a.
  • a fixed de-correlation filter may alternatively be used.
  • the signal modelling circuitry 64 may further be configured for maintaining a statistical model of the external signal 18a for distinguishing correlations between the hearing aid output and input caused by feedback from correlations already present in the external signal (tonal input) whereby sensitivity to tonal input is reduced.
  • Fig. 10 shows an embodiment of the signal modelling circuitry 64 in more detail.
  • the illustrated signal modelling circuitry 64 comprises adaptive de-correlation circuits 54, 56. Adaptive de-correlation is applied to the error signal 34a to obtain the filtered error signal 58. Further, adaptive de-correlation is applied symmetrically to the input 44a to the fast adaptive filter 38a, i.e. the filter of de-correlation circuit 56 is identical to the filter of de-correlation circuit 54, so that cross-correlating the de-correlated signals 58, 60 in algorithm 62 provides a gradient estimate to minimize the filtered error criterion, which is known to be more robust with tonal or self-correlated external signal conditions.
  • the de-correlation filters subtract a linear prediction of the signal after cancellation (which ideally matches the external signal). In some sense it is quite similar to the well-known Linear Predictive Coding, except that in the present circuitry, the models are updated incrementally. Standard FIR filters are used for the linear prediction, so consequently the generating model (for the external signal) is IIR and can be interpreted as an Auto-Regressive model. However, it is not necessary to restrict to Auto-Regressive models; e.g., Autoregressive-moving-average models (ARMA) could also be used, although extra care may be needed to ensure stability and efficiency.
  • ARMA Autoregressive-moving-average models
  • Fixed de-correlation filters may alternatively be used in the signal modelling circuitry 64.
  • adaptive non-linear de-correlation may be applied in the signal path.
  • Non-linear de-correlation in the signal path decreases the correlation of the external signal with the hearing aid output.
  • the contribution to the input signal caused by feedback remains equally correlated (because the applied non-linearity is known) so it becomes easier to distinguish feedback from tonal input and consequently the feedback models will improve.
  • Fig. 11 shows a feedback suppression circuit except the fast adaptive filters. Some or all of the illustrated fixed filter 46, the delays 48, 52a, 52b, and the barrel shifters 50a, 50b may be included in the feedback suppression circuits 28 shown in Figs. 3-8 .
  • the output 22 of the hearing loss processor (not shown) is input to a fixed filter 46 connected in series with the first slow adaptive filter 36a and the first fast adaptive filter (not shown).
  • the fixed filter 46 is configured for modelling true invariant parts of the feedback path (not shown), such as initial values of the transfer function of the microphone (not shown), the transfer function of an amplifier (not shown) driving the receiver (not shown), and the transfer function of the receiver (not shown), and a basic part of the feedback path (not shown), so that the adaptive filters of the feedback suppression circuit are only required to cope with variations from the initial values.
  • Bulk delays 48, 52a, 52b are connected in series with the slow adaptive filters 36a, 36b and the fast adaptive filters (not shown) configured for modelling the propagation delays of the respective feedback signals propagating along respective feedback paths (not shown) and thereby relieving the adaptive filters of the feedback suppression circuit of this task.
  • the bulk delays are distributed to facilitate anti-causal interpolation in the second slow adaptive filter 36b.
  • Barrel shifters 50a, 50b are connected at the respective outputs of the first and second slow adaptive filters 36a, 36b in order to adaptively scale the respective output signals 44a, 44b. Scaling maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths.
  • Fig. 12 shows plots of feedback path transfer functions upon repeated re-insertions for illustration of variations of the feedback path modelled by the slow adaptive filter.
  • Fig. 13 shows plots of transfer functions of the feedback path 80 and the model 82 learned by the slow adaptive filter after 60 seconds of speech.

Description

  • A hearing aid performing adaptive feedback suppression is provided. Accordingly, feedback suppression is performed with a slow adaptive filter modelling slow changes of a feedback path and a fast adaptive filter modelling rapid changes of the feedback path. In a hearing aid, acoustical signals arriving at a microphone of the hearing aid are amplified and output with a small loudspeaker to restore audibility. The small distance between the microphone and the loudspeaker may cause feedback. Feedback is generated when a part of the amplified acoustic output signal propagates back to the microphone for repeated amplification. When the feedback signal exceeds the level of the original signal at the microphone, the feedback loop becomes unstable, typically leading to audible distortions or howling. One way to stop feedback is to lower the gain. The risk of feedback, limits the maximum gain that can be used with a hearing aid.
  • It is well-known to use feedback suppression in a hearing aid. With feedback suppression, the feedback signal arriving at the microphone is suppressed by subtraction of a feedback model signal from the microphone signal. The feedback model signal is provided by a digital feedback suppression circuit configured to model the feedback path of propagation along which an output signal of the hearing aid propagates back to an input of the hearing aid for repeated amplification. The transfer function of the receiver (in the art of hearing aids, a loudspeaker of the hearing aid is usually denoted the receiver), and the transfer function of the microphone are included in the model of the feedback path of propagation.
  • Typically, the digital feedback suppression circuit includes one or more digital adaptive filters to model the feedback path. An output of the feedback suppression circuit is subtracted from the audio signal of the microphone to remove the feedback signal part of the audio signal.
  • In a hearing aid with more than one microphone, e.g. having a directional microphone system, the hearing aid may comprise separate digital feedback suppression circuits for individual microphones and groups of microphones.
  • WO 99/26453 A1 provides a useful review of methods of feedback suppression in hearing aids.
  • WO 99/26453 A1 discloses feedback suppression with two adaptive filters connected in series, see Fig. 1.
  • The first filter is adapted during fitting of the hearing aid to the intended user and/or when the hearing aid is turned on in the ear. This filter adapts quickly using a white noise probe signal, and then the filter coefficients are frozen, i.e. during normal operation of the hearing aid; the first filter operates as a fixed filter.
  • The first filter models those parts of the hearing aid feedback path that are assumed to be essentially constant while the hearing aid is in use, such as the microphone, amplifier driving the receiver, and receiver resonances, and the basic acoustic feedback path.
  • The second filter adapts while the hearing aid is in use and does not use a separate probe signal. This filter provides a rapid correction to the feedback suppression circuit when the hearing aid goes unstable, and tracks perturbations in the feedback path that occur in daily use, such as caused by chewing, sneezing, or using a telephone handset.
  • The series connection of a fixed filter and an adaptive filter provides a good trade-off between speed and accuracy. A single long filter tends to be slow and/or inaccurate. Further, the fixed filter is an IIR-filterwith relatively low processor requirements.
  • However, in practice the filter coefficients of the fixed filter are determined for each individual user when the hearing aid is fitted to the user by a dispenser or another trained person. This not only requires an additional fitting step, but also fails to capture the true invariant part of the feedback path because the feedback path measured by the dispenser already includes some of the variant parts. For example, the fitting of the hearing aid in the ear canal is included in the invariant part, but it may be subject to changes, e.g. when the hearing aid is re-inserted in the ear.
  • WO 99/26453 A1 also mentions the possibility of allowing the first filter to adapt slowly to follow slow changes in the hearing aid, such as component drift. However, no further explanation on how to allow the first filter to slowly adapt, i.e. no method of adaptation for the slow adaptive filter, is disclosed in WO 99/26453 A1 .
  • According to the new invention, claim 1 proposes a hearing aid comprising inter alia a slowly adapting filter whereby initialisation during fitting or during power-up of the hearing aid in order to determine values of filter coefficients is avoided.
  • A hearing aid is provided, comprising
    an input transducer for generating an audio signal,
    a feedback suppression circuit configured for modelling a feedback path of the hearing aid,
    a subtractor for subtracting an output signal of the feedback suppression circuit from the audio signal to form a feedback compensated audio signal,
    a hearing loss processor that is coupled to an output of the subtractor for processing the feedback compensated audio signal to perform hearing loss compensation, and preferably,
    an output transducer, preferably a receiver, that is coupled to an output of the hearing loss processor for providing a sound signal based on the processed feedback compensated audio signal,
    wherein the feedback suppression circuit comprises
    • a slow adaptive filter with an input coupled to the hearing loss processor and an output, and
    • a fast adaptive filter with an input coupled to the slow adaptive filter, and output.
  • The output of the fast adaptive filter may constitute an output of the feedback suppression circuit.
  • A transducer is a device that converts a signal in one form of energy to a corresponding signal in another form of energy. For example, the input transducer may comprise a microphone that converts an acoustic signal arriving at the microphone into a corresponding analogue audio signal in which the instantaneous voltage of the audio signal varies continuously with the sound pressure of the acoustic signal.
  • The input transducer may also comprise a telecoil that converts a magnetic field at the telecoil into a corresponding analogue audio signal in which the instantaneous voltage of the audio signal varies continuously with the magnetic field strength at the telecoil. Telecoils are typically used to increase the signal to noise ratio of speech from a speaker addressing a number of people in a public place, e.g. in a church, an auditorium, a theatre, a cinema, etc., or through a public address systems, such as in a railway station, an airport, a shopping mall, etc. Speech from the speaker is converted to a magnetic field with an induction loop system (also denoted "hearing loop"), and the telecoil is used to magnetically pick up the magnetically transmitted speech signal.
  • With a telecoil, feedback may be generated when the telecoil picks up a magnetic field generated by the hearing aid, e.g. generated by the receiver.
  • The input transducer may further comprise at least two spaced apart microphones, and a beamformer configured for combining microphone output signals of the at least two spaced apart microphones into a directional microphone signal, e.g. as is well-known in the art.
  • The input transducer may comprise one or more microphones and a telecoil and a switch, e.g. for selection of an omni-directional microphone signal, or a directional microphone signal, or a telecoil signal, either alone or in any combination, as the audio signal.
  • The output transducer preferably comprises a receiver, i.e. a small loudspeaker, which converts an analogue audio signal into a corresponding acoustic sound signal in which the instantaneous sound pressure varies continuously in accordance with the amplitude of the analogue audio signal.
  • Typically, the analogue audio signal is made suitable for digital signal processing by conversion into a corresponding digital audio signal in an analogue-to-digital converter whereby the amplitude of the analogue audio signal is represented by a binary number. In this way, a discrete-time and discrete-amplitude digital audio signal in the form of a sequence of digital values represents the continuous-time and continuous-amplitude analogue audio signal.
  • Throughout the present disclosure, a part of the audio signal generated by the hearing aid itself, e.g., as a result of sound, mechanical vibration, electromagnetic fields, etc, generated by the hearing aid, is termed the feedback signal part of the audio signal; or in short, the feedback signal.
  • The feedback suppression circuit is provided in the hearing aid in order to model the feedback path, i.e. desirably the feedback suppression circuit has the same transfer function as the feedback path itself so that an output signal of the feedback suppression circuit matches the feedback signal part of the audio signal as closely as possible.
  • A subtractor is provided for subtraction of the output signal of the feedback suppression circuit from the audio signal to form a feedback compensated audio signal in which the feedback signal part has been removed or at least reduced.
  • The feedback suppression circuit comprises an adaptive filter that tracks the current transfer function of the feedback path.
  • The feedback suppression circuit may comprise one or more electronic delays corresponding to the delay of the feedback signal propagating along the feedback path of the hearing aid.
  • The feedback suppression circuit may comprise at least one fixed filter configured for modelling stationary parts of the feedback path of the hearing aid.
  • The feedback suppression circuit may comprise at least one slow adaptive filter and at least one fast adaptive filter configured for modelling the feedback path.
  • The slow adaptive filter eliminates the need for initialisation of the feedback suppression circuit during fitting to the intended user or during power-up of the hearing aid.
  • Further, the slow adaptive filter improves the performance of the feedback suppression circuit with relation to slow changes of the feedback path, such as accumulation of ear wax, changes due to reinsertion of the hearing aid in the ear canal of the user, drift of electronic components of the hearing aid, etc. Thus, the slow adaptive filter may track changes taking place in minutes or even slower, while the fast adaptive filter may track changes, such as smiling, chewing, sneezing, using a telephone handset, etc, taking place in tens of milliseconds and up to seconds.
  • The filter coefficients of the slow adaptive filter may be based at least in part on a difference between the output signal of the slow adaptive filter and the audio signal.
  • The filter coefficients of the slow adaptive filter may be based at least in part on a difference between the output signal of the slow adaptive filter and the output signal of fast adaptive filter.
  • The filter coefficients of the slow adaptive filter may be based at least in part on a difference between an output signal of the slow adaptive filter and a weighted sum of the output signal of the fast adaptive filter and first audio signal.
  • In the following, the above components and signals of the hearing aid mentioned for the first time are denoted the first respective components and signals to distinguish them from the second respective components and signals mentioned below.
  • The hearing aid may further comprise
    a second input transducer for generating a second audio signal,
    a second feedback suppression circuit configured for modelling a second feedback path of the hearing aid,
    a second subtractor for subtracting a second output signal of the second feedback suppression circuit from the second audio signal to form a second feedback compensated audio signal, and wherein
    the hearing loss processor is coupled to the second subtractor for processing the second feedback compensated audio signal to perform hearing loss compensation, and wherein
    the second feedback suppression circuit comprises
    • a second slow adaptive filter with an input coupled to the hearing loss processor; or, the first slow adaptive filter, and an output, and
    • a second fast adaptive filter with an input coupled to the second slow adaptive filter, and an output.
  • The output of the second fast adaptive filter may constitute an output of second feedback suppression circuit.
  • In a hearing aid with a plurality of input transducers, e.g. a front and a rear microphone, the distances between the input transducers are usually small due to the small sizes of hearing aid housings. The feedback paths to individual input transducers proximate to each other are expected to have similar transfer functions and therefore one filter may be used to model one of the feedback paths to a respective one of the input transducers and simpler filters, in the following denoted "correction filters", may be used to model differences between the modelled feedback path and other feedback paths to respective other input transducers, whereby duplication of common features of the slow adaptive filters are substantially avoided. The feedback path differences may lead to sub-sample delays and minor shaping of the magnitude responses due to the small differences in physical distances between the output transducer and the input transducers in question.
  • Consequently, the primary purpose of the correction filters may be to implement a form of interpolation which ideally requires an anti-causal impulse response, since interpolation is desirably based on samples on both sides of the interpolated point. Normally such a filter is difficult to implement, but for the feedback suppression circuit this is possible due to a total bulk delay in the feedback loop of typically at least up to two blocks of samples. Some of this bulk delay can be used to provide the response a bit ahead of time so that the correction filters have sufficient information to perform the desired interpolation.
  • The idea of modelling differences in feedback paths may also be applied to the fast adaptive filters. Changes in the dynamic feedback paths may also cause sub-sample time differences in the feedback loop and may also cause minor shaping of the magnitude responses suitable for modelling by interpolation.
  • Electronic delays corresponding to the delays caused by propagation of signals along the feedback path may be arranged in the feedback suppression circuit. This simplifies the adaptive filters and also facilitates interpolation based on samples before and after the interpolation point in time.
  • Delays of the feedback suppression circuit corresponding to propagation delays along the corresponding feedback paths may be provided in the form of one common delay, preferably the shortest delay between the output transducer and one of the input transducers, and individual delays modelling the additional delay from the output transducer to the respective other input transducers.
  • The slow adaptive filter may be FIR filters which are less complex and more stable than IIR filters.
  • The output signals of the slow filters may be scaled, preferably scaled adaptively, using bit shifters. Scaling, such as adaptive scaling, maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths.
  • The filter coefficients of the second slow adaptive filter may be based at least in part on a difference between the output signal of the second slow adaptive filter and the second audio signal.
  • The filter coefficients of the second slow adaptive filter may be based at least in part on a difference between the output signal of the second slow adaptive filter and the output signal of second fast adaptive filter.
  • The filter coefficients of the second slow adaptive filter may be based at least in part on a difference between an output signal of the second slow adaptive filter and a weighted sum of the output signal of the second fast adaptive filter and the second audio signal.
  • A FIR filter architecture, with weight vector w and input vector u , for calculating the output signal d, at time n is described as follows: u n = u n , u n 1 , , u n N w + 1 T
    Figure imgb0001
    w n = w n ,1 , w n ,2 , , w n , N w T
    Figure imgb0002
    d n = w n T u n
    Figure imgb0003
  • Convolving this signal with a fast adaptive filter wf , vectorizing d analogous to u and for simplicity disregarding a possible delay provides the output signal c of the fast adaptive filter, in the following denoted the cancellation signal c: c n = w f n T d n
    Figure imgb0004
  • Input transducer audio samples s are assumed to be a mixture of an external signal x and feedback signal f, such that s n = x n + f n
    Figure imgb0005
    and after feedback cancellation e n = s n c n = x n + f n c n
    Figure imgb0006
    which provides perfect cancellation performance when f(n) equals c(n).
  • In principle, it is possible to adapt both the fast filter coefficients wf and the slow filter coefficients w using a single error criterion.
  • However, in the following a more effective approach is disclosed that more fully exploit the fundamental differences in purpose of the slow and the fast adaptive filters, i.e. the slow filter desirably models properties of the feedback path subject to slow changes only, while the fast adaptive filter desirably models rapid changes only. Consequently, a different error criterion for the slow adaptive filter and the fast adaptive filter may be more appropriate.
  • Under normal circumstances, the cancellation signal c(n) may on average be assumed to be the best known estimate of the feedback signal, and therefore the slow adaptive filter may be connected for tracking this signal, thus absorbing innovations from the fast adaptive filter, which gives error signal e1: e 1 n = c n d n
    Figure imgb0007
  • Alternatively, a direct approach error signal defined as: e 2 n = s n d n
    Figure imgb0008
    which is effectively the signal that would be the output of the feedback suppression circuit, if the fast adaptive filter was frozen in its reference state.
  • Error signal e1 is less sensitive to bias because the fast adaptive filter uses an adaptive signal model, but it may lead to local minima that may trap the slow adaptive filter preventing it for further adaptation.
  • Error signal e2 is optimal for uncorrelated signals, but may suffer more from bias caused by tonal input.
  • Thus, another alternative is to use a weighted sum of the above-mentioned error signals e m n = 1 β e 1 n + β e 2 n = 1 β c n + βs n d n = s n 1 β e n d n = t n d n
    Figure imgb0009
    • where t(n) can be considered a target signal defined by the weighted sum.
    • β may be a fixed predetermined parameter.
  • A suitable quadratic error criterion, to be minimized, for processing a block of M samples can be formulated as J n = 1 2 i = 0 M 1 e m n i 2
    Figure imgb0010
  • Using the chain rule to calculate gradient directions for minimizing J with respect to the slow adaptive filter coefficients then gives J n = i = 0 M 1 e m n i e m n i
    Figure imgb0011
    where e m = t n d n
    Figure imgb0012
    which for coefficients w, by ignoring the term Vt(n) (the target should not depend on the current internal model), can be simplified to e m n d n = u n
    Figure imgb0013
    so that the gradient direction is estimated by cross-correlating the weighted error signal with the FIR filter input signal on respective taps.
  • Derivation for the front-to-rear correction filter coefficient may be analogous except that the cross correlation is now performed with the output signal of the common slow adaptive filter d(n), which is input to the correction filter.
  • For the slow and fast adaptive filters, the step size may be determined in a way well known in the art of adaptive filters, such as by the least mean squares (LMS) algorithm, the normalized least mean squares (NLMS) algorithm, or by line searches, conjugate gradients, Hessian estimation techniques, etc.
  • For the slow adaptive filter, however, a simple sign-based algorithm may be sufficient and an appropriate step size may be determined directly from the current filter coefficients.
  • In order to minimize complexity of the adjustment of the filter coefficients, only some of the coefficients, i.e. at least one coefficient, may be adjusted, i.e. updated, for each block of samples. Since only cross-correlations are used, the computational complexity for a single weight is roughly equivalent to that of adding a single FIR filter coefficient. Updating more than e.g. four filter coefficients per block may not be desired, at least for the slow adaptive filter.
  • Once an update cycle has been completed, i.e., all coefficients have been adjusted, i.e. updated, once, a special event is scheduled for updating administrative settings such as the coefficient step size, model scaling and constraints. For optimal accuracy, step-sizes and scaling have to be updated during normal operation of the hearing aid, because the feedback path magnitude is not known beforehand; however, a reasonable estimate may be provided to speed up initial convergence.
  • A good step size for the sign-based update is defined proportional to the feedback path magnitude response. Once, at least a rough indication of, the feedback magnitude is known, this approach provides nearly constant accuracy for tracking changes of the feedback path independent of the feedback signal level.
  • Another approach may be used directly after power up of the hearing aid, when the feedback path is not known yet. In the initial start-up phase, a faster, and initially even non-proportional, step size may be used to speed up convergence and quickly silence possible initial feedback, such as howling. The transition time from initial to final rate may be configurable, and may be in the order of a few seconds up to around a minute.
  • Alternatively, or in addition, a slow gain ramp-up and loading of coefficients previously stored in persistent memory may be performed.
  • In order to prevent adaptation of the slow adaptive filter in situations in which the slow adaptive filter may track misleading signals or signals with no information, one or more criteria for adaptation may be added for the slow adaptive filter, whereby the slow adaptive filter may be configured to adjust one or more of its filter coefficients only under certain conditions.
  • For example, the slow adaptive filter may only be configured to adjust one or more of its filter coefficients when (1) the signal level is above a predefined threshold, and/or, (2) the (direct error) signal and corresponding signal model are considered save for adaptation, and/or (3) the hearing aid is in its initial start-up phase (directly after power up).
  • The level threshold (1) primarily prevents adapting to meaningless input signals, e.g., microphone noise. This may also extend the start-up phase when the algorithm is booted in quiet or in a muted condition.
  • Regarding (2), the signal is considered save for adaptation when it is not too predictable, e.g. a pure tone is too predictable, which is determined by comparing the signal level of a de-correlated error signal, e.g. as used for updating the fast adaptive filter, with the level of the direct error signal itself.
  • Additionally or alternatively, the error signal is considered save when a p-norm, preferably the 1-norm, of the coefficient vector of the fast adaptive filter (representing the signal model) is below a predetermined threshold value (a large one-norm indicates tonal input).
  • The hearing aid may be a multi-band hearing aid performing hearing loss compensation differently in different frequency bands, thus accounting for the frequency dependence of the hearing loss of the intended user. In the multi-band hearing aid, the audio signal from the input transducer is divided into two or more frequency channels or bands; and, typically, the audio signal is amplified differently in each frequency band. For example, a compressor may be utilized to compress the dynamic range of the audio signal in accordance with the hearing loss of the intended user. In a multi-band hearing aid, the compressor performs compression differently in each of the frequency bands varying not only the compression ratio, but also the time constants associated with each band. The time constants refer to compressor attack and release time constants. The compressor attack time is the time required for the compressor to lower the gain at the onset of a loud sound. The release time is the time required for the compressor to increase the gain after the cessation of the loud sound.
  • The frequency bands may be warped frequency bands. For example, the hearing aid may have a compressor that performs dynamic range compression using digital frequency warping as disclosed in more detail in WO 03/015468 , in particular the basic operating principles of a warped compressor are illustrated in Fig. 11 and the corresponding parts of the description of WO 03/015468 .
  • The feedback suppression circuit, e.g. including one or more adaptive filters, may be a broad band model, i.e. the model may operate substantially in the entire frequency range of operation of the hearing aid, or in a significant part of the frequency range of the hearing aid, without being divided into a set of frequency bands.
  • Alternatively, the feedback suppression circuit may be divided into a set of frequency bands for individual modelling of the feedback path in each frequency band. In this case, the estimate of the residual feedback signal may be provided individually in each frequency band m of the feedback suppression circuit.
  • The frequency bands m of the feedback suppression circuit and the frequency bands k of the hearing loss compensation may be identical, but preferably, they are different, and preferably the number of frequency bands m of the feedback suppression circuit is less than the number of frequency bands of the hearing loss compensation.
  • Throughout the present disclosure, the term audio signal is used to identify any analogue or digital signal forming part of the signal path from an output of the microphone to an input of the hearing loss processor.
  • The feedback suppression circuit may be implemented as one or more dedicated electronic hardware circuits or may form part of a signal processor in combination with suitable signal processing software, or may be a combination of dedicated hardware and one or more signal processors with suitable signal processing software.
  • Signal processing in the new hearing aid may be performed by dedicated hardware or may be performed in a signal processor, or performed in a combination of dedicated hardware and one or more signal processors.
  • As used herein, the terms "processor", "signal processor", "controller", "system", etc., are intended to refer to CPU-related entities, either hardware, a combination of hardware and software, software, or software in execution.
  • For example, a "processor", "signal processor", "controller", "system", etc., may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
  • By way of illustration, the terms "processor", "signal processor", "controller", "system", etc., designate both an application running on a processor and a hardware processor. One or more "processors", "signal processors", "controllers", "systems" and the like, or any combination hereof, may reside within a process and/or thread of execution, and one or more "processors", "signal processors", "controllers", "systems", etc., or any combination hereof, may be localized on one hardware processor, possibly in combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
  • Also, a processor (or similar terms) may be any component or any combination of components that is capable of performing signal processing. For examples, the signal processor may be an ASIC processor, a FPGA processor, a general purpose processor, a microprocessor, a circuit component, or an integrated circuit.
  • Below, the new method and hearing aid are explained in more detail with reference to the drawings in which various examples are shown. In the drawings:
  • Fig. 1
    schematically illustrates a hearing aid with a feedback path,
    Fig. 2
    schematically illustrates a prior art hearing aid with feedback suppression,
    Fig. 3
    schematically illustrates a new hearing aid with feedback suppression,
    Fig. 4
    schematically illustrates another new hearing aid with feedback suppression,
    Fig. 5
    schematically illustrates yet another new hearing aid with feedback suppression,
    Fig. 6
    schematically illustrates still another new hearing aid with feedback suppression,
    Fig. 7
    schematically illustrates yet still another new hearing aid with feedback suppression,
    Fig. 8
    schematically illustrates yet still another new hearing aid with feedback suppression,
    Fig. 9
    schematically illustrates another new hearing aid with feedback suppression having a fast adaptive filter with signal modelling circuitry,
    Fig. 10
    schematically illustrates signal modelling circuitry in more detail,
    Fig. 11
    schematically illustrates part of a new feedback suppression circuit,
    Fig. 12
    shows plots of feedback path transfer functions upon repeated re-insertions, and
    Fig. 13
    shows a plot of slow filter feedback path modelling performance.
  • The accompanying drawings are schematic and simplified for clarity, and they merely show details which are essential to the understanding of the new hearing aid, while other details have been left out. The new hearing aid according to the appended claims may be embodied in different forms not shown in the accompanying drawings and should not be construed as limited to the examples set forth herein.
  • Like reference numerals refer to like elements throughout. Like elements may, thus, not be described in detail with respect to the description of each figure.
  • Fig. 1 schematically illustrates a hearing aid 10 and a feedback path 12 along which signals generated by the hearing aid 10 propagates back to an input of the hearing aid 10.
  • In Fig. 1, an acoustical signal 14 is received at a microphone 16 that converts the acoustical signal 14 into an audio signal 18 that is input to the hearing loss processor 20 for hearing loss compensation. In the hearing loss processor 20, the audio signal 18 is amplified in accordance with the hearing loss of the user. The hearing loss processor 20 may for example comprise a multi-band compressor. The output signal 22 of the hearing loss processor 20 is converted into an acoustical output signal 24 by the receiver 26 that emits the acoustical signal towards the eardrum of the user when the hearing aid 10 is worn in its proper operational position at an ear of the user.
  • Typically, a part of the acoustical signal 24 from the receiver 26 propagates back to the microphone 16 as indicated by feedback path 12 in Fig. 1.
  • At low gains, feedback only introduces harmless colouring of sound. However, with large hearing aid gain, the feedback signal level at the microphone 16 may exceed the level of the original acoustical signal 14 thereby causing audible distortion and possibly howling.
  • To overcome feedback, it is well-known to provide feedback suppression circuitry in a hearing aid as shown in Fig. 2.
  • Fig. 2 schematically illustrates a hearing aid 10 with a feedback suppression circuit 28. The feedback suppression circuit 28 models the feedback path 12, i.e. the feedback suppression circuit seeks to generate a signal that is identical to the signal propagated along the feedback path 12. It is noted that the feedback suppression circuit 28 includes models of the receiver 26 and the microphone 16 so that the transfer function of the feedback suppression circuit 28 desirably equals the sum of the transfer function of the receiver 26, the transfer function of the feedback path 12, and the transfer function of the microphone 16.
  • The feedback suppression circuit 28 generates an output signal 30 to the subtractor 32 in order to suppress or cancel the feedback signal part of the audio signal 18 before processing takes place in the hearing loss processor 20.
  • In a conventional hearing aid 10, the feedback suppression circuit 28 is typically an adaptive digital filter which adapts to changes in the feedback path 12.
  • WO 99/26453 A1 discloses feedback suppression with a series connection of two adaptive filters. A first filter 36 is adapted when the hearing aid is fitted to the intended user at a dispenser's office. During the fitting, the filter 36 adapts quickly using a white noise probe signal, and then the filter coefficients are frozen, i.e. subsequently, during normal operation of the hearing aid, the first filter 36 operates as a fixed filter 36.
  • The first filter 36 models those parts of the hearing aid feedback path 12 that are assumed to be essentially constant while the hearing aid 10 is in use, such as the transfer function of the microphone 16, and the transfer function of the receiver 26, and a basic part of the feedback path 12.
  • The second filter 38 adapts while the hearing aid 10 is in use and does not use a separate probe signal. This filter 38 provides a rapid correction of the feedback suppression circuit 28 when the hearing aid 10 goes unstable, and tracks perturbations in the feedback path 12 that occur in daily use, such as caused by chewing, sneezing, or using a telephone handset. Thus, the fast adaptive filter 38 may track changes taking place in tens of milliseconds up to seconds.
  • Apart from requiring an extra fitting step, the fixed filter 26 fails to capture the true invariant part of the modelled transfer functions, because the determined fixed filter coefficients already include some of the variant parts. For example, the fitting of the hearing aid 10 in the ear canal is included in the invariant part, but it may be subject to changes, e.g. when the hearing aid 10 is re-inserted in the ear.
  • In the following, new hearing aids are illustrated that do not require an additional fitting step and also copes with the true variant parts of the modelled transfer functions.
  • Fig. 3 shows a first example of a hearing aid 10 according to the appended claims. The hearing aid 10 has an input transducer, namely a microphone 16a, for generating an audio signal 18a, and feedback suppression circuit 28a that models the feedback path 12a, i.e. the feedback suppression circuit 28a seeks to generate a signal that is identical to the signal propagated along the feedback path 12a. It is noted that the feedback suppression circuit 28a includes models of the receiver 26 and the microphone 16a so that the transfer function of the feedback suppression circuit 28a desirably equals the sum of the transfer function of the receiver 26, the transfer function of the feedback path 12a, and the transfer function of the microphone 16a.
  • The feedback suppression circuit 28a generates an output signal 30a to the subtractor 32a in order to suppress or cancel the feedback signal part of the audio signal 18a before processing takes place in the hearing loss processor 20.
  • A hearing loss processor 20 is coupled to an output of the subtractor 32a for processing the feedback compensated audio signal 34a to perform hearing loss compensation, and a receiver 26 that is coupled to an output of the hearing loss processor 20 for converting the processed feedback compensated audio signal 22 into a sound signal.
  • The feedback suppression circuit 28a comprises a slow adaptive filter 36a with an input coupled to the output of the hearing loss processor 20 and an output, and a fast adaptive filter 38a with an input coupled to the output of the slow adaptive filter 36a and an output constituting the output of feedback suppression circuit 28a.
  • During normal operation of the illustrated hearing aid 10, the cancellation signal 30a in most situations constitutes a good estimate of the feedback signal part of the audio signal 18a, and therefore the slow adaptive filter 36a is connected for tracking the signal 30a, thus absorbing innovations from the fast adaptive filter 38a.
  • Thus, filter coefficients of the slow adaptive filter 36a are based, at least in part, on an error signal 42a equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and the cancellation signal 30a output by the fast adaptive filter 38a.
  • Filter coefficients of the fast adaptive filter 38a are based, at least in part, on the error signal 34a output by subtractor 32a.
  • With the slow adaptive filter 36a, it is not required to initialize the feedback suppression circuit 28a. Also, slow changes in the feedback path are adequately modelled by the slow adaptive filter 36a
  • A fixed filter, see Fig. 11, may be connected in series with the slow adaptive filter 36a and the fast adaptive filter 38a configured for modelling true invariant parts of the feedback path 12a, such as initial values of the transfer function of the microphone 16a, the transfer function of an amplifier (not shown) driving the receiver 26, and the transfer function of the receiver 26, and a basic part of the feedback path 12a, so that the adaptive filters 36a, 38a are only required to cope with variations from the initial values.
  • A bulk delay, see Fig. 11, may be connected in series with the slow adaptive filter 36a and the fast adaptive filter 38a configured for modelling the propagation delay of the feedback signal propagating along the feedback path and thereby relieving the adaptive filters 36a, 38a of this task.
  • Barrel shifters, see Fig. 11, may be connected at the output of the slow adaptive filter 36a and/or the fast adaptive filter 38a in order to scale the output signals, preferably adaptively. Scaling, such as adaptive scaling, maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths.
  • The hearing aid 10 shown in Fig. 4 is similar to the hearing aid of Fig. 3 except for the fact that the hearing aid 10 of Fig. 4 has two microphones 16a, 16b, namely a front microphone 16a and a rear microphone 16b, and the hearing loss processor 20 comprises a beamformer for selectable beamforming as is well-known in the art of hearing aids. The feedback path 12a to the front microphone 16a is modelled by first feedback suppression circuit 28a identical to the feedback circuit 28a shown in Fig. 3. Likewise, the feedback path 12b to the rear microphone 16b is modelled by second feedback suppression circuit 28b corresponding to the feedback circuit 28a shown in Fig. 3 except for the fact that the input of the second slow adaptive filter 36b is coupled to the output 44a of the first slow adaptive filter 36a instead of to the output 22 of the hearing loss processor 20.
  • In the illustrated hearing aid 10, the distance between the receiver 26 to the front microphone 12a is shorter than the distance between the receiver 26 and the rear microphone 12b. If the opposite is true, i.e. the distance between the receiver 26 and the rear microphone 12b is the shortest, then microphone 12a is the rear microphone and microphone 12b is the front microphone.
  • Thus, the first slow adaptive filter 36a models slow varying parts of the feedback path to the front microphone 12a, and the second slow adaptive filter 36b models the difference between the feedback path to front microphone 12a and the feedback path to rear microphone 12b, so that the series connection of the first slow adaptive filter 36a and the second slow adaptive filter 36b together model the feedback path to the rear microphone 12b. In the illustrated example, the distance between the front and rear microphones 16a, 16b is small, and the respective feedback paths 12a, 12b have similar transfer functions with sub-sample delay differences and minor differences in the shaping of the magnitude responses. Therefore, the second slow adaptive filter 36b is simpler than first slow adaptive filter 36a. The second slow adaptive filter 36b performs anti-causal interpolation made possible by bulk delays; see Fig. 11, of the feedback suppression circuits 28a, 28b.
  • In another example (not shown) in which the respective feedback paths 12a, 12b do not have similar transfer functions, the feedback paths 12a, 12b to the front microphone 16a and the rear microphone 16b, respectively, may be modelled by independent feedback circuits 28a, 28b, each of which is similar to the feedback circuit 28a shown in Fig. 3 with the inputs of both the first and the second slow adaptive filters 36a, 36b coupled to the output 22 of the hearing loss processor 20.
  • A first fixed filter, see Fig. 11, may be connected in series with the first slow adaptive filter 36a and the first fast adaptive filter 38a configured for modelling true invariant parts of the first feedback path 12a, such as initial values of the transfer function of the microphone 16a, the transfer function of an amplifier (not shown) driving the receiver 26, and the transfer function of the receiver 26, and a basic part of the first feedback path 12a, so that the first slow and fast adaptive filters 36a, 38a are only required to cope with variations from the initial values.
  • A second fixed filter, see Fig. 11, may be connected in series with the second slow adaptive filter 36b and the second fast adaptive filter 38b configured for modelling invariant parts of the second feedback path 12b, such as initial values of the transfer function of the microphone 16b, the transfer function of an amplifier (not shown) driving the receiver 26, and the transfer function of the receiver 26, and a basic part of the second feedback path 12b, so that the second slow and fast adaptive filters 36b, 38b are only required to cope with variations from the initial values.
  • Respective bulk delays, see Fig. 11, are connected in series with the slow adaptive filters 36a, 36b and the fast adaptive filters 38a, 38b configured for modelling the propagation delays of the respective feedback signals propagating along the feedback paths 12a, 12b, and thereby relieving the adaptive filters 36a, 36b, 38a, 38b of this task. The bulk delays are distributed to facilitate anti-causal interpolation in the second slow adaptive filter 36b.
  • Respective barrel shifters, see Fig. 11, are connected at the outputs of the slow adaptive filters 36a, 36b in order to adaptively scale the respective output signals 44a, 44b. Scaling maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths.
  • The hearing aid 10 shown in Fig. 5 is similar to the hearing aid of Fig. 3 except for the fact that the filter coefficients of slow adaptive filter 36a of the hearing aid 10 of Fig. 5 are based, at least in part, on an error signal 42a that is equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and the audio signal 18a; rather than being equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and the cancellation signal 30a output by the fast adaptive filter 38a.
  • The error signal 42a is also denoted a direct approach error and it is effectively the signal that would be the output of the feedback suppression circuit, if the fast adaptive filter was frozen in its reference state. The error signal 42a is optimal for uncorrelated signals, but may suffer more from bias caused by tonal input, whereas the error signal 42a of Fig. 3 is less sensitive to bias because the fast adaptive filter uses an adaptive signal model, but it may lead to local minima that may trap the slow adaptive filter preventing it for further adaptation.
  • The hearing aid 10 shown in Fig. 6 is similar to the hearing aid of Fig. 4 except for the fact that as in Fig. 5, the filter coefficients of first slow adaptive filter 36a of the hearing aid 10 of Fig. 5 are based, at least in part, on a first error signal 42a equal to a difference output by first subtractor 40a between a first output signal 44a of the first slow adaptive filter 36a and the first audio signal 18a; rather than being equal to a difference output by first subtractor 40a between a first output signal 44a of the first slow adaptive filter 36a and the first cancellation signal 30a output by the first fast adaptive filter 38a. Likewise, the filter coefficients of second slow adaptive filter 36b are based, at least in part, on second error signal 42b equal to a difference output by second subtractor 40b between a second output signal 44b of the second slow adaptive filter 36b and the second audio signal 18b; rather than being equal to a difference output by second subtractor 40b between a second output signal 44b of the second slow adaptive filter 36b and the second cancellation signal 30b output by the second fast adaptive filter 38b.
  • The hearing aid 10 shown in Fig. 7 combines the error signals 42a shown in Figs. 3 and 5, respectively. Thus, the hearing aid 10 shown in Fig. 7 is similar to the hearing aid of Figs. 3 except for the fact that the filter coefficients of slow adaptive filter 36a of the hearing aid 10 of Fig. 7 are based, at least in part, on an error signal 42a that is equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and a weighted sum of the audio signal 18a and the cancellation signal 30a output by the fast adaptive filter 38a; rather than being equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and the cancellation signal 30a output by the fast adaptive filter 38a.
  • The hearing aid 10 shown in Fig. 8 is similar to the hearing aid of Figs. 4 or 6 except for the fact that as in Fig. 7, the filter coefficients of the first slow adaptive filter 36a of the hearing aid 10 of Fig. 7 are based, at least in part, on a first error signal 42a that is equal to a difference output by first subtractor 40a between a first output signal 44a of the first slow adaptive filter 36a and a weighted sum of the first audio signal 18a and the first cancellation signal 30a output by first fast adaptive filter 38a. Likewise, the filter coefficients of second slow adaptive filter 36b are based, at least in part, on second error signal 42b equal to a difference output by second subtractor 40b between a second output signal 44b of the second slow adaptive filter 36b and a weighted sum of second audio signal 18b and second cancellation signal 30b output by second fast adaptive filter 38b.
  • Fig. 9 shows a hearing aid 10 according to the appended claims, having a fast adaptive filter 38a included in signal modelling circuitry 64. The signal modelling circuitry 64 may substitute the adaptive filters 38a, 38b of the hearing aids shown in Figs. 3-8.
  • The fast adaptive filters 38a, 38b shown in Figs. 3-8 operate according to the so-called "direct approach" to minimize the expected signal strength of the error signal 34a, 34b. The "direct approach" is well-known in the art of hearing aids, and the minimization of the error signal is typically performed using the least mean squares (LMS) algorithm, the normalized least mean squares (NLMS) algorithm, preferably the Block Normalized Least Mean Squares (BNLMS) algorithm, wherein the square error criterion is minimized over a block of samples
  • The direct approach is known to provide biased results when the input signal exhibits a long-tailed auto-correlation function. In the case of tonal signals, for example, this typically leads to sub-optimal solutions because the adaptive feedback model will attempt to suppress the external tones instead of modelling the actual feedback.
  • This problem is solved with the signal modelling circuitry 64 shown in Fig. 9 comprising de-correlation circuits 54, 56 that ensure stability in the presence of tonal input.
  • De-correlation circuit 54 applies adaptive de-correlation to error signal 34a to obtain filtered error signal 58. De-correlation circuit 56 applies adaptive de-correlation symmetrically to fast adaptive filter input 44a to obtain filtered input 60 so that cross-correlating both signals in algorithm block 62 provides a gradient estimate to minimize the filtered error criterion, which is known to be more robust for tonal or self-correlated external signals. In the illustrated signal modelling circuitry 64, the signal model used in the de-correlation filters 54, 56 is obtained from error signal 34a. However, a fixed de-correlation filter may alternatively be used.
  • The signal modelling circuitry 64 may further be configured for maintaining a statistical model of the external signal 18a for distinguishing correlations between the hearing aid output and input caused by feedback from correlations already present in the external signal (tonal input) whereby sensitivity to tonal input is reduced.
  • Fig. 10 shows an embodiment of the signal modelling circuitry 64 in more detail. The illustrated signal modelling circuitry 64 comprises adaptive de-correlation circuits 54, 56. Adaptive de-correlation is applied to the error signal 34a to obtain the filtered error signal 58. Further, adaptive de-correlation is applied symmetrically to the input 44a to the fast adaptive filter 38a, i.e. the filter of de-correlation circuit 56 is identical to the filter of de-correlation circuit 54, so that cross-correlating the de-correlated signals 58, 60 in algorithm 62 provides a gradient estimate to minimize the filtered error criterion, which is known to be more robust with tonal or self-correlated external signal conditions.
  • The de-correlation filters subtract a linear prediction of the signal after cancellation (which ideally matches the external signal). In some sense it is quite similar to the well-known Linear Predictive Coding, except that in the present circuitry, the models are updated incrementally. Standard FIR filters are used for the linear prediction, so consequently the generating model (for the external signal) is IIR and can be interpreted as an Auto-Regressive model. However, it is not necessary to restrict to Auto-Regressive models; e.g., Autoregressive-moving-average models (ARMA) could also be used, although extra care may be needed to ensure stability and efficiency.
  • Fixed de-correlation filters may alternatively be used in the signal modelling circuitry 64.
  • Further, adaptive non-linear de-correlation may be applied in the signal path. Non-linear de-correlation in the signal path decreases the correlation of the external signal with the hearing aid output. The contribution to the input signal caused by feedback remains equally correlated (because the applied non-linearity is known) so it becomes easier to distinguish feedback from tonal input and consequently the feedback models will improve.
  • Fig. 11 shows a feedback suppression circuit except the fast adaptive filters. Some or all of the illustrated fixed filter 46, the delays 48, 52a, 52b, and the barrel shifters 50a, 50b may be included in the feedback suppression circuits 28 shown in Figs. 3-8.
  • The output 22 of the hearing loss processor (not shown) is input to a fixed filter 46 connected in series with the first slow adaptive filter 36a and the first fast adaptive filter (not shown). The fixed filter 46 is configured for modelling true invariant parts of the feedback path (not shown), such as initial values of the transfer function of the microphone (not shown), the transfer function of an amplifier (not shown) driving the receiver (not shown), and the transfer function of the receiver (not shown), and a basic part of the feedback path (not shown), so that the adaptive filters of the feedback suppression circuit are only required to cope with variations from the initial values.
  • Bulk delays 48, 52a, 52b are connected in series with the slow adaptive filters 36a, 36b and the fast adaptive filters (not shown) configured for modelling the propagation delays of the respective feedback signals propagating along respective feedback paths (not shown) and thereby relieving the adaptive filters of the feedback suppression circuit of this task. The bulk delays are distributed to facilitate anti-causal interpolation in the second slow adaptive filter 36b.
  • Barrel shifters 50a, 50b are connected at the respective outputs of the first and second slow adaptive filters 36a, 36b in order to adaptively scale the respective output signals 44a, 44b. Scaling maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths.
  • Fig. 12 shows plots of feedback path transfer functions upon repeated re-insertions for illustration of variations of the feedback path modelled by the slow adaptive filter.
  • Fig. 13 shows plots of transfer functions of the feedback path 80 and the model 82 learned by the slow adaptive filter after 60 seconds of speech.

Claims (14)

  1. A hearing aid (10) comprising
    a first input transducer (16a) for generating a first audio signal (18a),
    a first feedback suppression circuit (28a) configured for modelling a first feedback path (12a) of the hearing aid (10),
    a first subtractor (32a) for subtracting a first output signal (30a) of the first feedback suppression circuit (28a) from the first audio signal (18a) to form a first feedback compensated audio signal (34a),
    a hearing loss processor (20) that is coupled to the first subtractor for processing the first feedback compensated audio signal (34a) to perform hearing loss compensation, and
    a receiver (26) that is coupled to the hearing loss processor (20) for providing a sound signal based on the processed feedback compensated audio signal (22),
    wherein the first feedback suppression circuit (28a) comprises
    a first slow adaptive filter (36a) with an input coupled to the hearing loss processor (20) and an output, and
    a first fast adaptive filter (38a) with an input coupled to the output of the first slow adaptive filter (36a) and an output generating the first output signal (30a) of the first feedback suppression circuit (28a), and
    a third subtractor (40a) connected for subtracting an output signal (44a) provided at the output of the first slow adaptive filter (36a) from at least one of the first output signal (30a) of the first feedback suppression circuit (28a) and the first audio signal (18a) to output a first error signal (42a), and wherein
    filter coefficients of the first slow adaptive filter (36a) are adjusted to minimize the first error signal (42a), and
    filter coefficients of the first fast adaptive filter (38a) are adjusted to minimize the first feedback compensated audio signal (34a).
  2. A hearing aid (10) according to claim 1, wherein the third subtractor (40a) is connected for subtracting the output signal (44a) of the first slow adaptive filter (36a) from the first audio signal (18a) to output the first error signal (42a).
  3. A hearing aid (10) according to claim 1, wherein the third subtractor (40a) is connected for subtracting the output signal (44a) of the first slow adaptive filter (36a) from the first output signal (30a) of the first feedback suppression circuit (28a) to output the first error signal (42a).
  4. A hearing aid (10) according to claim 1, wherein the third subtractor (40a) is connected for subtracting the output signal of the first slow adaptive filter (36a) from a weighted sum of the first output signal (30a) of the first feedback suppression circuit (28a) and the first audio signal (18a) to output the first error signal (42a).
  5. A hearing aid (10) according to any of the preceding claims, comprising
    a second input transducer (16b) for generating a second audio signal (18b),
    a second feedback suppression circuit (28b) configured for modelling a second feedback path (12b) of the hearing aid (10),
    a second subtractor (32b) for subtracting a second output signal (30b) of the second feedback suppression circuit (28b) from the second audio signal (18b) to form a second feedback compensated audio signal (34b), and wherein
    the hearing loss processor (20) is coupled to an output of the second subtractor for processing the second feedback compensated audio signal (34b) to perform hearing loss compensation, and wherein
    the second feedback suppression circuit (28b) comprises
    a second slow adaptive filter (36b) with an input coupled to the output of the hearing loss processor (20) and an output, and
    a second fast adaptive filter (38b) with an input coupled to the output of the second slow adaptive filter (36b) and an output generating the second output signal (30b) of the second feedback suppression circuit (28b), and
    a fourth subtractor (40b) connected for subtracting an output signal (44b) provided at the output of the second slow adaptive filter (36b) from at least one of the second output signal (30b) of the second feedback suppression circuit (28b) and the second audio signal (18b) to output a second error signal (42b), and wherein
    filter coefficients of the second slow adaptive filter (36b) are adjusted to minimize the second error signal (42b), and
    filter coefficients of the second fast adaptive filter (38b) are adjusted to minimize the second feedback compensated audio signal (34b).
  6. A hearing aid (10) according to any of claims 1 - 4, comprising
    a second input transducer (16b) for generating a second audio signal (18b),
    a second feedback suppression circuit (28b) configured for modelling a second feedback path (12b) of the hearing aid (10),
    a second subtractor (32b) for subtracting a second output signal (30b) of the second feedback suppression circuit (28b) from the second audio signal (18b) to form a second feedback compensated audio signal (34b), and wherein
    the hearing loss processor (20) is coupled to an output of the second subtractor for processing the second feedback compensated audio signal (34b) to perform hearing loss compensation, and wherein
    the second feedback suppression circuit (28b) comprises
    a second slow adaptive filter (36b) with an input coupled to the output of the first slow adaptive filter (36a) and an output, and
    a second fast adaptive filter (38b) with an input coupled to the output of the second slow adaptive filter (36b) and an output generating the second output signal (30b) of the second feedback suppression circuit (28b), and
    a fourth subtractor (40b) connected for subtracting an output signal (44b) provided at the output of the second slow adaptive filter (36b) from at least one of the second output signal (30b) of the second feedback suppression circuit (28b) and the second audio signal (18b) to output a second error signal (42b), and wherein
    filter coefficients of the second slow adaptive filter (36b) are adjusted to minimize the second error signal (42b), and
    filter coefficients of the second fast adaptive filter (38b) are adjusted to minimize the second feedback compensated audio signal (34b).
  7. A hearing aid (10) according to claim 5 or 6, wherein the fourth subtractor (40b) is connected for subtracting the output signal (44b) of the second slow adaptive filter (36b) from the second audio signal (18b) to output the second error signal (42b).
  8. A hearing aid (10) according to claim 5 or 6, wherein the fourth subtractor (40b) is connected for subtracting the output signal (44b) of the second slow adaptive filter (36b) from the second output signal (30b) of the second feedback suppression circuit (28b) to output the second error signal (42b).
  9. A hearing aid (10b) according to claim 5 or 6, wherein the fourth subtractor (40b) is connected for subtracting the output signal (44b) of the second slow adaptive filter (36b) from a weighted sum of the second output signal (30b) of the second feedback suppression circuit (28b) and the second audio signal (18b) to output the second error signal (42b).
  10. A hearing aid (10) according to any of the preceding claims, wherein the first slow adaptive filter is configured to adjust one or more of the filter coefficients when at least one criterion is fulfilled.
  11. A hearing aid (10) according to claim 10, wherein the criteria comprises that the signal level of the input signal of the feedback suppression circuit is larger than a predefined threshold.
  12. A hearing aid (10) according to claim 10 or 11, wherein the criteria comprises that an autocorrelation of the error signal is below a predetermined threshold.
  13. A hearing aid (10) according to any of claims 10- 12, wherein the criteria comprises that the adjustment constitutes a first adjustment performed immediately upon power-up of the hearing aid.
  14. A hearing aid (10) according to any of claims 10- 13, wherein the criteria comprises that a p-norm of a filter coefficient vector of the first fast adaptive filter is less than a predetermined threshold value.
EP13199680.3A 2013-12-27 2013-12-27 Hearing aid with feedback suppression Active EP2890154B1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
DK13199680.3T DK2890154T3 (en) 2013-12-27 2013-12-27 Hearing aid with feedback suppression
EP13199680.3A EP2890154B1 (en) 2013-12-27 2013-12-27 Hearing aid with feedback suppression
US14/144,474 US9628923B2 (en) 2013-12-27 2013-12-30 Feedback suppression

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP13199680.3A EP2890154B1 (en) 2013-12-27 2013-12-27 Hearing aid with feedback suppression

Publications (2)

Publication Number Publication Date
EP2890154A1 EP2890154A1 (en) 2015-07-01
EP2890154B1 true EP2890154B1 (en) 2017-12-13

Family

ID=49880631

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13199680.3A Active EP2890154B1 (en) 2013-12-27 2013-12-27 Hearing aid with feedback suppression

Country Status (2)

Country Link
EP (1) EP2890154B1 (en)
DK (1) DK2890154T3 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3613220B1 (en) * 2017-04-20 2023-05-10 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for multichannel interference cancellation

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3917169A1 (en) * 2017-08-25 2021-12-01 Oticon A/s A hearing aid device including a self-checking unit for determine status of one or more features of the hearing aid device based on feedback response
CN112397080B (en) * 2020-10-30 2023-02-28 浙江大华技术股份有限公司 Echo cancellation method and apparatus, voice device, and computer-readable storage medium
CN116055972B (en) * 2023-03-07 2023-12-22 深圳市鑫正宇科技有限公司 Signal processing system and method for hearing aid

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5016280A (en) * 1988-03-23 1991-05-14 Central Institute For The Deaf Electronic filters, hearing aids and methods
DE102009060094B4 (en) * 2009-12-22 2013-03-14 Siemens Medical Instruments Pte. Ltd. Method and hearing aid for feedback detection and suppression with a directional microphone

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3613220B1 (en) * 2017-04-20 2023-05-10 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for multichannel interference cancellation

Also Published As

Publication number Publication date
DK2890154T3 (en) 2018-02-05
EP2890154A1 (en) 2015-07-01

Similar Documents

Publication Publication Date Title
US9628923B2 (en) Feedback suppression
US20200236472A1 (en) Observer-based cancellation system for implantable hearing instruments
AU661158B2 (en) Auditory prosthesis, noise suppression apparatus and feedback suppression apparatus having focused adaptive filtering
US8737655B2 (en) System for measuring maximum stable gain in hearing assistance devices
US8442251B2 (en) Adaptive feedback cancellation based on inserted and/or intrinsic characteristics and matched retrieval
US7974428B2 (en) Hearing aid with acoustic feedback suppression
US6072884A (en) Feedback cancellation apparatus and methods
EP2080408B1 (en) Entrainment avoidance with an auto regressive filter
EP2299733A1 (en) Feedback cancellation device
US10334371B2 (en) Method for feedback suppression
JP6283413B2 (en) Adaptive residual feedback suppression
EP2890154B1 (en) Hearing aid with feedback suppression
JP6019098B2 (en) Feedback suppression
US20120213395A1 (en) Method and device for estimating interference noise, hearing device and hearing aid
US7155022B2 (en) Electromagnetic feedback reduction in communication device
EP2869600B1 (en) Adaptive residual feedback suppression
KR100363252B1 (en) Adaptive feedback cancellation apparatus and method for multi-band compression hearing aids
Jayanthi et al. IoT‐Based Bias Analysis in Acoustic Feedback Using Time‐Variant Adaptive Algorithm in Hearing Aids
Tran Robust Techniques for Acoustic Feedback Control in Hearing Aids
WO2023232955A1 (en) A hearing aid system and a method of operating a hearing aid system
Ji et al. An Efficient Adaptive Feedback cancellation using by Independent component analysis for hearing aids

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20131227

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

R17P Request for examination filed (corrected)

Effective date: 20160104

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

17Q First examination report despatched

Effective date: 20160428

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20170630

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 955398

Country of ref document: AT

Kind code of ref document: T

Effective date: 20171215

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602013030714

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20180131

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

RAP2 Party data changed (patent owner data changed or rights of a patent transferred)

Owner name: GN HEARING A/S

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20171213

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180313

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 955398

Country of ref document: AT

Kind code of ref document: T

Effective date: 20171213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180314

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180313

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180413

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602013030714

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171227

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171227

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20171231

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171227

26N No opposition filed

Effective date: 20180914

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20131227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171213

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20211221

Year of fee payment: 9

Ref country code: DK

Payment date: 20211217

Year of fee payment: 9

Ref country code: FR

Payment date: 20211215

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20211217

Year of fee payment: 9

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20221231

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20221227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221231

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221227

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221231

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231218

Year of fee payment: 11