EP2890154A1 - Hearing aid with feedback suppression - Google Patents
Hearing aid with feedback suppression Download PDFInfo
- Publication number
- EP2890154A1 EP2890154A1 EP13199680.3A EP13199680A EP2890154A1 EP 2890154 A1 EP2890154 A1 EP 2890154A1 EP 13199680 A EP13199680 A EP 13199680A EP 2890154 A1 EP2890154 A1 EP 2890154A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- adaptive filter
- signal
- feedback
- hearing aid
- output
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000001629 suppression Effects 0.000 title claims abstract description 87
- 230000003044 adaptive effect Effects 0.000 claims abstract description 209
- 230000005236 sound signal Effects 0.000 claims description 74
- 206010011878 Deafness Diseases 0.000 claims description 38
- 230000010370 hearing loss Effects 0.000 claims description 38
- 231100000888 hearing loss Toxicity 0.000 claims description 38
- 208000016354 hearing loss disease Diseases 0.000 claims description 38
- 238000012545 processing Methods 0.000 claims description 12
- 238000000034 method Methods 0.000 abstract description 13
- 230000006870 function Effects 0.000 description 34
- 238000012546 transfer Methods 0.000 description 34
- 230000001934 delay Effects 0.000 description 15
- 230000000875 corresponding effect Effects 0.000 description 12
- 230000006978 adaptation Effects 0.000 description 11
- 238000013459 approach Methods 0.000 description 8
- 238000012937 correction Methods 0.000 description 7
- 239000000523 sample Substances 0.000 description 7
- 230000004044 response Effects 0.000 description 6
- 230000001902 propagating effect Effects 0.000 description 4
- 230000001055 chewing effect Effects 0.000 description 3
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 210000000613 ear canal Anatomy 0.000 description 3
- 238000007493 shaping process Methods 0.000 description 3
- 206010041232 sneezing Diseases 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 206010050337 Cerumen impaction Diseases 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 238000005311 autocorrelation function Methods 0.000 description 1
- 210000002939 cerumen Anatomy 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 230000005672 electromagnetic field Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000013179 statistical model Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 210000003454 tympanic membrane Anatomy 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/45—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback
- H04R25/453—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback electronically
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/40—Arrangements for obtaining a desired directivity characteristic
- H04R25/405—Arrangements for obtaining a desired directivity characteristic by combining a plurality of transducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/40—Arrangements for obtaining a desired directivity characteristic
- H04R25/407—Circuits for combining signals of a plurality of transducers
Definitions
- a new method for performing adaptive feedback suppression in a hearing aid and a hearing aid utilizing the method are provided. According to the method, feedback suppression is performed with a slow adaptive filter modelling slow changes of a feedback path and a fast adaptive filter modelling rapid changes of the feedback path.
- acoustical signals arriving at a microphone of the hearing aid are amplified and output with a small loudspeaker to restore audibility.
- the small distance between the microphone and the loudspeaker may cause feedback.
- Feedback is generated when a part of the amplified acoustic output signal propagates back to the microphone for repeated amplification.
- the feedback loop becomes unstable, typically leading to audible distortions or howling.
- One way to stop feedback is to lower the gain.
- the risk of feedback limits the maximum gain that can be used with a hearing aid.
- the feedback model signal is provided by a digital feedback suppression circuit configured to model the feedback path of propagation along which an output signal of the hearing aid propagates back to an input of the hearing aid for repeated amplification.
- the transfer function of the receiver in the art of hearing aids, a loudspeaker of the hearing aid is usually denoted the receiver, and the transfer function of the microphone are included in the model of the feedback path of propagation.
- the digital feedback suppression circuit includes one or more digital adaptive filters to model the feedback path.
- An output of the feedback suppression circuit is subtracted from the audio signal of the microphone to remove the feedback signal part of the audio signal.
- the hearing aid may comprise separate digital feedback suppression circuits for individual microphones and groups of microphones.
- WO 99/26453 A1 provides a useful review of methods of feedback suppression in hearing aids.
- WO 99/26453 A1 discloses feedback suppression with two adaptive filters connected in series, see Fig. 1 .
- the first filter is adapted during fitting of the hearing aid to the intended user and/or when the hearing aid is turned on in the ear. This filter adapts quickly using a white noise probe signal, and then the filter coefficients are frozen, i.e. during normal operation of the hearing aid; the first filter operates as a fixed filter.
- the first filter models those parts of the hearing aid feedback path that are assumed to be essentially constant while the hearing aid is in use, such as the microphone, amplifier driving the receiver, and receiver resonances, and the basic acoustic feedback path.
- the second filter adapts while the hearing aid is in use and does not use a separate probe signal.
- This filter provides a rapid correction to the feedback suppression circuit when the hearing aid goes unstable, and tracks perturbations in the feedback path that occur in daily use, such as caused by chewing, sneezing, or using a telephone handset.
- the series connection of a fixed filter and an adaptive filter provides a good trade-off between speed and accuracy.
- a single long filter tends to be slow and/or inaccurate.
- the fixed filter is an IIR-filter with relatively low processor requirements.
- the filter coefficients of the fixed filter are determined for each individual user when the hearing aid is fitted to the user by a dispenser or another trained person. This not only requires an additional fitting step, but also fails to capture the true invariant part of the feedback path because the feedback path measured by the dispenser already includes some of the variant parts.
- the fitting of the hearing aid in the ear canal is included in the invariant part, but it may be subject to changes, e.g. when the hearing aid is re-inserted in the ear.
- WO 99/26453 A1 also mentions the possibility of allowing the first filter to adapt slowly to follow slow changes in the hearing aid, such as component drift. However, no further explanation on how to allow the first filter to slowly adapt, i.e. no method of adaptation for the slow adaptive filter, is disclosed in WO 99/26453 A1 .
- a hearing aid comprising an input transducer for generating an audio signal, a feedback suppression circuit configured for modelling a feedback path of the hearing aid, a subtractor for subtracting an output signal of the feedback suppression circuit from the audio signal to form a feedback compensated audio signal, a hearing loss processor that is coupled to an output of the subtractor for processing the feedback compensated audio signal to perform hearing loss compensation, and preferably, an output transducer, preferably a receiver, that is coupled to an output of the hearing loss processor for providing a sound signal based on the processed feedback compensated audio signal, wherein the feedback suppression circuit comprises a slow adaptive filter with an input coupled to the hearing loss processor and an output, and a fast adaptive filter with an input coupled to the slow adaptive filter, and output.
- the output of the fast adaptive filter may constitute an output of the feedback suppression circuit.
- a transducer is a device that converts a signal in one form of energy to a corresponding signal in another form of energy.
- the input transducer may comprise a microphone that converts an acoustic signal arriving at the microphone into a corresponding analogue audio signal in which the instantaneous voltage of the audio signal varies continuously with the sound pressure of the acoustic signal.
- the input transducer may also comprise a telecoil that converts a magnetic field at the telecoil into a corresponding analogue audio signal in which the instantaneous voltage of the audio signal varies continuously with the magnetic field strength at the telecoil.
- Telecoils are typically used to increase the signal to noise ratio of speech from a speaker addressing a number of people in a public place, e.g. in a church, an auditorium, a theatre, a cinema, etc., or through a public address systems, such as in a railway station, an airport, a shopping mall, etc. Speech from the speaker is converted to a magnetic field with an induction loop system (also denoted "hearing loop"), and the telecoil is used to magnetically pick up the magnetically transmitted speech signal.
- an induction loop system also denoted "hearing loop”
- feedback may be generated when the telecoil picks up a magnetic field generated by the hearing aid, e.g. generated by the receiver.
- the input transducer may further comprise at least two spaced apart microphones, and a beamformer configured for combining microphone output signals of the at least two spaced apart microphones into a directional microphone signal, e.g. as is well-known in the art.
- the input transducer may comprise one or more microphones and a telecoil and a switch, e.g. for selection of an omni-directional microphone signal, or a directional microphone signal, or a telecoil signal, either alone or in any combination, as the audio signal.
- a switch e.g. for selection of an omni-directional microphone signal, or a directional microphone signal, or a telecoil signal, either alone or in any combination, as the audio signal.
- the output transducer preferably comprises a receiver, i.e. a small loudspeaker, which converts an analogue audio signal into a corresponding acoustic sound signal in which the instantaneous sound pressure varies continuously in accordance with the amplitude of the analogue audio signal.
- a receiver i.e. a small loudspeaker
- the analogue audio signal is made suitable for digital signal processing by conversion into a corresponding digital audio signal in an analogue-to-digital converter whereby the amplitude of the analogue audio signal is represented by a binary number.
- a discrete-time and discrete-amplitude digital audio signal in the form of a sequence of digital values represents the continuous-time and continuous-amplitude analogue audio signal.
- the feedback signal part of the audio signal is termed the feedback signal part of the audio signal; or in short, the feedback signal.
- the feedback suppression circuit is provided in the hearing aid in order to model the feedback path, i.e. desirably the feedback suppression circuit has the same transfer function as the feedback path itself so that an output signal of the feedback suppression circuit matches the feedback signal part of the audio signal as closely as possible.
- a subtractor is provided for subtraction of the output signal of the feedback suppression circuit from the audio signal to form a feedback compensated audio signal in which the feedback signal part has been removed or at least reduced.
- the feedback suppression circuit comprises an adaptive filter that tracks the current transfer function of the feedback path.
- the feedback suppression circuit may comprise one or more electronic delays corresponding to the delay of the feedback signal propagating along the feedback path of the hearing aid.
- the feedback suppression circuit may comprise at least one fixed filter configured for modelling stationary parts of the feedback path of the hearing aid.
- the feedback suppression circuit may comprise at least one slow adaptive filter and at least one fast adaptive filter configured for modelling the feedback path.
- the slow adaptive filter eliminates the need for initialisation of the feedback suppression circuit during fitting to the intended user or during power-up of the hearing aid.
- the slow adaptive filter improves the performance of the feedback suppression circuit with relation to slow changes of the feedback path, such as accumulation of ear wax, changes due to reinsertion of the hearing aid in the ear canal of the user, drift of electronic components of the hearing aid, etc.
- the slow adaptive filter may track changes taking place in minutes or even slower, while the fast adaptive filter may track changes, such as smiling, chewing, sneezing, using a telephone handset, etc, taking place in tens of milliseconds and up to seconds.
- the filter coefficients of the slow adaptive filter may be based at least in part on a difference between the output signal of the slow adaptive filter and the audio signal.
- the filter coefficients of the slow adaptive filter may be based at least in part on a difference between the output signal of the slow adaptive filter and the output signal of fast adaptive filter.
- the filter coefficients of the slow adaptive filter may be based at least in part on a difference between an output signal of the slow adaptive filter and a weighted sum of the output signal of the fast adaptive filter and first audio signal.
- the above components and signals of the hearing aid mentioned for the first time are denoted the first respective components and signals to distinguish them from the second respective components and signals mentioned below.
- the hearing aid may further comprise a second input transducer for generating a second audio signal, a second feedback suppression circuit configured for modelling a second feedback path of the hearing aid, a second subtractor for subtracting a second output signal of the second feedback suppression circuit from the second audio signal to form a second feedback compensated audio signal, and wherein the hearing loss processor is coupled to the second subtractor for processing the second feedback compensated audio signal to perform hearing loss compensation, and wherein the second feedback suppression circuit comprises a second slow adaptive filter with an input coupled to the hearing loss processor; or, the first slow adaptive filter, and an output, and a second fast adaptive filter with an input coupled to the second slow adaptive filter, and an output.
- the output of the second fast adaptive filter may constitute an output of second feedback suppression circuit.
- the distances between the input transducers are usually small due to the small sizes of hearing aid housings.
- the feedback paths to individual input transducers proximate to each other are expected to have similar transfer functions and therefore one filter may be used to model one of the feedback paths to a respective one of the input transducers and simpler filters, in the following denoted "correction filters", may be used to model differences between the modelled feedback path and other feedback paths to respective other input transducers, whereby duplication of common features of the slow adaptive filters are substantially avoided.
- the feedback path differences may lead to sub-sample delays and minor shaping of the magnitude responses due to the small differences in physical distances between the output transducer and the input transducers in question.
- the primary purpose of the correction filters may be to implement a form of interpolation which ideally requires an anti-causal impulse response, since interpolation is desirably based on samples on both sides of the interpolated point.
- interpolation is desirably based on samples on both sides of the interpolated point.
- Normally such a filter is difficult to implement, but for the feedback suppression circuit this is possible due to a total bulk delay in the feedback loop of typically at least up to two blocks of samples. Some of this bulk delay can be used to provide the response a bit ahead of time so that the correction filters have sufficient information to perform the desired interpolation.
- the idea of modelling differences in feedback paths may also be applied to the fast adaptive filters. Changes in the dynamic feedback paths may also cause sub-sample time differences in the feedback loop and may also cause minor shaping of the magnitude responses suitable for modelling by interpolation.
- Electronic delays corresponding to the delays caused by propagation of signals along the feedback path may be arranged in the feedback suppression circuit. This simplifies the adaptive filters and also facilitates interpolation based on samples before and after the interpolation point in time.
- Delays of the feedback suppression circuit corresponding to propagation delays along the corresponding feedback paths may be provided in the form of one common delay, preferably the shortest delay between the output transducer and one of the input transducers, and individual delays modelling the additional delay from the output transducer to the respective other input transducers.
- the slow adaptive filter may be FIR filters which are less complex and more stable than IIR filters.
- the output signals of the slow filters may be scaled, preferably scaled adaptively, using bit shifters. Scaling, such as adaptive scaling, maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths.
- the filter coefficients of the second slow adaptive filter may be based at least in part on a difference between the output signal of the second slow adaptive filter and the second audio signal.
- the filter coefficients of the second slow adaptive filter may be based at least in part on a difference between the output signal of the second slow adaptive filter and the output signal of second fast adaptive filter.
- the filter coefficients of the second slow adaptive filter may be based at least in part on a difference between an output signal of the second slow adaptive filter and a weighted sum of the output signal of the second fast adaptive filter and the second audio signal.
- the slow filter desirably models properties of the feedback path subject to slow changes only
- the fast adaptive filter desirably models rapid changes only. Consequently, a different error criterion for the slow adaptive filter and the fast adaptive filter may be more appropriate.
- Error signal e 1 is less sensitive to bias because the fast adaptive filter uses an adaptive signal model, but it may lead to local minima that may trap the slow adaptive filter preventing it for further adaptation.
- Error signal e 2 is optimal for uncorrelated signals, but may suffer more from bias caused by tonal input.
- t(n) can be considered a target signal defined by the weighted sum.
- ⁇ may be a fixed predetermined parameter.
- Derivation for the front-to-rear correction filter coefficient may be analogous except that the cross correlation is now performed with the output signal of the common slow adaptive filter d(n), which is input to the correction filter.
- the step size may be determined in a way well known in the art of adaptive filters, such as by the least mean squares (LMS) algorithm, the normalized least mean squares (NLMS) algorithm, or by line searches, conjugate gradients, Hessian estimation techniques, etc.
- LMS least mean squares
- NLMS normalized least mean squares
- the filter coefficients In order to minimize complexity of the adjustment of the filter coefficients, only some of the coefficients, i.e. at least one coefficient, may be adjusted, i.e. updated, for each block of samples. Since only cross-correlations are used, the computational complexity for a single weight is roughly equivalent to that of adding a single FIR filter coefficient. Updating more than e.g. four filter coefficients per block may not be desired, at least for the slow adaptive filter.
- a good step size for the sign-based update is defined proportional to the feedback path magnitude response. Once, at least a rough indication of, the feedback magnitude is known, this approach provides nearly constant accuracy for tracking changes of the feedback path independent of the feedback signal level.
- Another approach may be used directly after power up of the hearing aid, when the feedback path is not known yet.
- a faster, and initially even non-proportional, step size may be used to speed up convergence and quickly silence possible initial feedback, such as howling.
- the transition time from initial to final rate may be configurable, and may be in the order of a few seconds up to around a minute.
- a slow gain ramp-up and loading of coefficients previously stored in persistent memory may be performed.
- one or more criteria for adaptation may be added for the slow adaptive filter, whereby the slow adaptive filter may be configured to adjust one or more of its filter coefficients only under certain conditions.
- the slow adaptive filter may only be configured to adjust one or more of its filter coefficients when (1) the signal level is above a predefined threshold, and/or, (2) the (direct error) signal and corresponding signal model are considered save for adaptation, and/or (3) the hearing aid is in its initial start-up phase (directly after power up).
- the level threshold (1) primarily prevents adapting to meaningless input signals, e.g., microphone noise. This may also extend the start-up phase when the algorithm is booted in quiet or in a muted condition.
- the signal is considered save for adaptation when it is not too predictable, e.g. a pure tone is too predictable, which is determined by comparing the signal level of a de-correlated error signal, e.g. as used for updating the fast adaptive filter, with the level of the direct error signal itself.
- the error signal is considered save when a p-norm, preferably the 1-norm, of the coefficient vector of the fast adaptive filter (representing the signal model) is below a predetermined threshold value (a large one-norm indicates tonal input).
- the hearing aid may be a multi-band hearing aid performing hearing loss compensation differently in different frequency bands, thus accounting for the frequency dependence of the hearing loss of the intended user.
- the audio signal from the input transducer is divided into two or more frequency channels or bands; and, typically, the audio signal is amplified differently in each frequency band.
- a compressor may be utilized to compress the dynamic range of the audio signal in accordance with the hearing loss of the intended user.
- the compressor performs compression differently in each of the frequency bands varying not only the compression ratio, but also the time constants associated with each band.
- the time constants refer to compressor attack and release time constants.
- the compressor attack time is the time required for the compressor to lower the gain at the onset of a loud sound.
- the release time is the time required for the compressor to increase the gain after the cessation of the loud sound.
- the frequency bands may be warped frequency bands.
- the hearing aid may have a compressor that performs dynamic range compression using digital frequency warping as disclosed in more detail in WO 03/015468 , in particular the basic operating principles of a warped compressor are illustrated in Fig. 11 and the corresponding parts of the description of WO 03/015468 .
- the feedback suppression circuit e.g. including one or more adaptive filters, may be a broad band model, i.e. the model may operate substantially in the entire frequency range of operation of the hearing aid, or in a significant part of the frequency range of the hearing aid, without being divided into a set of frequency bands.
- the feedback suppression circuit may be divided into a set of frequency bands for individual modelling of the feedback path in each frequency band.
- the estimate of the residual feedback signal may be provided individually in each frequency band m of the feedback suppression circuit.
- the frequency bands m of the feedback suppression circuit and the frequency bands k of the hearing loss compensation may be identical, but preferably, they are different, and preferably the number of frequency bands m of the feedback suppression circuit is less than the number of frequency bands of the hearing loss compensation.
- audio signal is used to identify any analogue or digital signal forming part of the signal path from an output of the microphone to an input of the hearing loss processor.
- the feedback suppression circuit may be implemented as one or more dedicated electronic hardware circuits or may form part of a signal processor in combination with suitable signal processing software, or may be a combination of dedicated hardware and one or more signal processors with suitable signal processing software.
- Signal processing in the new hearing aid may be performed by dedicated hardware or may be performed in a signal processor, or performed in a combination of dedicated hardware and one or more signal processors.
- processor As used herein, the terms "processor”, “signal processor”, “controller”, “system”, etc., are intended to refer to CPU-related entities, either hardware, a combination of hardware and software, software, or software in execution.
- a "processor”, “signal processor”, “controller”, “system”, etc. may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
- processor designate both an application running on a processor and a hardware processor.
- processors may reside within a process and/or thread of execution, and one or more "processors”, “signal processors”, “controllers”, “systems”, etc., or any combination hereof, may be localized on one hardware processor, possibly in combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
- a processor may be any component or any combination of components that is capable of performing signal processing.
- the signal processor may be an ASIC processor, a FPGA processor, a general purpose processor, a microprocessor, a circuit component, or an integrated circuit.
- Fig. 1 schematically illustrates a hearing aid 10 and a feedback path 12 along which signals generated by the hearing aid 10 propagates back to an input of the hearing aid 10.
- an acoustical signal 14 is received at a microphone 16 that converts the acoustical signal 14 into an audio signal 18 that is input to the hearing loss processor 20 for hearing loss compensation.
- the audio signal 18 is amplified in accordance with the hearing loss of the user.
- the hearing loss processor 20 may for example comprise a multi-band compressor.
- the output signal 22 of the hearing loss processor 20 is converted into an acoustical output signal 24 by the receiver 26 that emits the acoustical signal towards the eardrum of the user when the hearing aid 10 is worn in its proper operational position at an ear of the user.
- a part of the acoustical signal 24 from the receiver 26 propagates back to the microphone 16 as indicated by feedback path 12 in Fig. 1 .
- the feedback signal level at the microphone 16 may exceed the level of the original acoustical signal 14 thereby causing audible distortion and possibly howling.
- Fig. 2 schematically illustrates a hearing aid 10 with a feedback suppression circuit 28.
- the feedback suppression circuit 28 models the feedback path 12, i.e. the feedback suppression circuit seeks to generate a signal that is identical to the signal propagated along the feedback path 12. It is noted that the feedback suppression circuit 28 includes models of the receiver 26 and the microphone 16 so that the transfer function of the feedback suppression circuit 28 desirably equals the sum of the transfer function of the receiver 26, the transfer function of the feedback path 12, and the transfer function of the microphone 16.
- the feedback suppression circuit 28 generates an output signal 30 to the subtractor 32 in order to suppress or cancel the feedback signal part of the audio signal 18 before processing takes place in the hearing loss processor 20.
- the feedback suppression circuit 28 is typically an adaptive digital filter which adapts to changes in the feedback path 12.
- WO 99/26453 A1 discloses feedback suppression with a series connection of two adaptive filters.
- a first filter 36 is adapted when the hearing aid is fitted to the intended user at a dispenser's office. During the fitting, the filter 36 adapts quickly using a white noise probe signal, and then the filter coefficients are frozen, i.e. subsequently, during normal operation of the hearing aid, the first filter 36 operates as a fixed filter 36.
- the first filter 36 models those parts of the hearing aid feedback path 12 that are assumed to be essentially constant while the hearing aid 10 is in use, such as the transfer function of the microphone 16, and the transfer function of the receiver 26, and a basic part of the feedback path 12.
- the second filter 38 adapts while the hearing aid 10 is in use and does not use a separate probe signal.
- This filter 38 provides a rapid correction of the feedback suppression circuit 28 when the hearing aid 10 goes unstable, and tracks perturbations in the feedback path 12 that occur in daily use, such as caused by chewing, sneezing, or using a telephone handset.
- the fast adaptive filter 38 may track changes taking place in tens of milliseconds up to seconds.
- the fixed filter 26 fails to capture the true invariant part of the modelled transfer functions, because the determined fixed filter coefficients already include some of the variant parts.
- the fitting of the hearing aid 10 in the ear canal is included in the invariant part, but it may be subject to changes, e.g. when the hearing aid 10 is re-inserted in the ear.
- new hearing aids are illustrated that do not require an additional fitting step and also copes with the true variant parts of the modelled transfer functions.
- Fig. 3 shows a first example of a hearing aid 10 according to the appended claims.
- the hearing aid 10 has an input transducer, namely a microphone 16a, for generating an audio signal 18a, and feedback suppression circuit 28a that models the feedback path 12a, i.e. the feedback suppression circuit 28a seeks to generate a signal that is identical to the signal propagated along the feedback path 12a.
- the feedback suppression circuit 28a includes models of the receiver 26 and the microphone 16a so that the transfer function of the feedback suppression circuit 28a desirably equals the sum of the transfer function of the receiver 26, the transfer function of the feedback path 12a, and the transfer function of the microphone 16a.
- the feedback suppression circuit 28a generates an output signal 30a to the subtractor 32a in order to suppress or cancel the feedback signal part of the audio signal 18a before processing takes place in the hearing loss processor 20.
- a hearing loss processor 20 is coupled to an output of the subtractor 32a for processing the feedback compensated audio signal 34a to perform hearing loss compensation, and a receiver 26 that is coupled to an output of the hearing loss processor 20 for converting the processed feedback compensated audio signal 22 into a sound signal.
- the feedback suppression circuit 28a comprises a slow adaptive filter 36a with an input coupled to the output of the hearing loss processor 20 and an output, and a fast adaptive filter 38a with an input coupled to the output of the slow adaptive filter 36a and an output constituting the output of feedback suppression circuit 28a.
- the cancellation signal 30a in most situations constitutes a good estimate of the feedback signal part of the audio signal 18a, and therefore the slow adaptive filter 36a is connected for tracking the signal 30a, thus absorbing innovations from the fast adaptive filter 38a.
- filter coefficients of the slow adaptive filter 36a are based, at least in part, on an error signal 42a equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and the cancellation signal 30a output by the fast adaptive filter 38a.
- Filter coefficients of the fast adaptive filter 38a are based, at least in part, on the error signal 34a output by subtractor 32a.
- slow adaptive filter 36a With the slow adaptive filter 36a, it is not required to initialize the feedback suppression circuit 28a. Also, slow changes in the feedback path are adequately modelled by the slow adaptive filter 36a
- a fixed filter may be connected in series with the slow adaptive filter 36a and the fast adaptive filter 38a configured for modelling true invariant parts of the feedback path 12a, such as initial values of the transfer function of the microphone 16a, the transfer function of an amplifier (not shown) driving the receiver 26, and the transfer function of the receiver 26, and a basic part of the feedback path 12a, so that the adaptive filters 36a, 38a are only required to cope with variations from the initial values.
- a bulk delay may be connected in series with the slow adaptive filter 36a and the fast adaptive filter 38a configured for modelling the propagation delay of the feedback signal propagating along the feedback path and thereby relieving the adaptive filters 36a, 38a of this task.
- Barrel shifters may be connected at the output of the slow adaptive filter 36a and/or the fast adaptive filter 38a in order to scale the output signals, preferably adaptively.
- Scaling such as adaptive scaling, maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths.
- the hearing aid 10 shown in Fig. 4 is similar to the hearing aid of Fig. 3 except for the fact that the hearing aid 10 of Fig. 4 has two microphones 16a, 16b, namely a front microphone 16a and a rear microphone 16b, and the hearing loss processor 20 comprises a beamformer for selectable beamforming as is well-known in the art of hearing aids.
- the feedback path 12a to the front microphone 16a is modelled by first feedback suppression circuit 28a identical to the feedback circuit 28a shown in Fig. 3 .
- the feedback path 12b to the rear microphone 16b is modelled by second feedback suppression circuit 28b corresponding to the feedback circuit 28a shown in Fig. 3 except for the fact that the input of the second slow adaptive filter 36b is coupled to the output 44a of the first slow adaptive filter 36a instead of to the output 22 of the hearing loss processor 20.
- the distance between the receiver 26 to the front microphone 12a is shorter than the distance between the receiver 26 and the rear microphone 12b. If the opposite is true, i.e. the distance between the receiver 26 and the rear microphone 12b is the shortest, then microphone 12a is the rear microphone and microphone 12b is the front microphone.
- the first slow adaptive filter 36a models slow varying parts of the feedback path to the front microphone 12a
- the second slow adaptive filter 36b models the difference between the feedback path to front microphone 12a and the feedback path to rear microphone 12b, so that the series connection of the first slow adaptive filter 36a and the second slow adaptive filter 36b together model the feedback path to the rear microphone 12b.
- the distance between the front and rear microphones 16a, 16b is small, and the respective feedback paths 12a, 12b have similar transfer functions with sub-sample delay differences and minor differences in the shaping of the magnitude responses. Therefore, the second slow adaptive filter 36b is simpler than first slow adaptive filter 36a.
- the second slow adaptive filter 36b performs anti-causal interpolation made possible by bulk delays; see Fig. 11 , of the feedback suppression circuits 28a, 28b.
- the feedback paths 12a, 12b to the front microphone 16a and the rear microphone 16b, respectively may be modelled by independent feedback circuits 28a, 28b, each of which is similar to the feedback circuit 28a shown in Fig. 3 with the inputs of both the first and the second slow adaptive filters 36a, 36b coupled to the output 22 of the hearing loss processor 20.
- a first fixed filter may be connected in series with the first slow adaptive filter 36a and the first fast adaptive filter 38a configured for modelling true invariant parts of the first feedback path 12a, such as initial values of the transfer function of the microphone 16a, the transfer function of an amplifier (not shown) driving the receiver 26, and the transfer function of the receiver 26, and a basic part of the first feedback path 12a, so that the first slow and fast adaptive filters 36a, 38a are only required to cope with variations from the initial values.
- a second fixed filter may be connected in series with the second slow adaptive filter 36b and the second fast adaptive filter 38b configured for modelling invariant parts of the second feedback path 12b, such as initial values of the transfer function of the microphone 16b, the transfer function of an amplifier (not shown) driving the receiver 26, and the transfer function of the receiver 26, and a basic part of the second feedback path 12b, so that the second slow and fast adaptive filters 36b, 38b are only required to cope with variations from the initial values.
- Respective bulk delays are connected in series with the slow adaptive filters 36a, 36b and the fast adaptive filters 38a, 38b configured for modelling the propagation delays of the respective feedback signals propagating along the feedback paths 12a, 12b, and thereby relieving the adaptive filters 36a, 36b, 38a, 38b of this task.
- the bulk delays are distributed to facilitate anti-causal interpolation in the second slow adaptive filter 36b.
- Respective barrel shifters are connected at the outputs of the slow adaptive filters 36a, 36b in order to adaptively scale the respective output signals 44a, 44b. Scaling maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths.
- the hearing aid 10 shown in Fig. 5 is similar to the hearing aid of Fig. 3 except for the fact that the filter coefficients of slow adaptive filter 36a of the hearing aid 10 of Fig. 5 are based, at least in part, on an error signal 42a that is equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and the audio signal 18a; rather than being equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and the cancellation signal 30a output by the fast adaptive filter 38a.
- the error signal 42a is also denoted a direct approach error and it is effectively the signal that would be the output of the feedback suppression circuit, if the fast adaptive filter was frozen in its reference state.
- the error signal 42a is optimal for uncorrelated signals, but may suffer more from bias caused by tonal input, whereas the error signal 42a of Fig. 3 is less sensitive to bias because the fast adaptive filter uses an adaptive signal model, but it may lead to local minima that may trap the slow adaptive filter preventing it for further adaptation.
- the hearing aid 10 shown in Fig. 6 is similar to the hearing aid of Fig. 4 except for the fact that as in Fig. 5 , the filter coefficients of first slow adaptive filter 36a of the hearing aid 10 of Fig. 5 are based, at least in part, on a first error signal 42a equal to a difference output by first subtractor 40a between a first output signal 44a of the first slow adaptive filter 36a and the first audio signal 18a; rather than being equal to a difference output by first subtractor 40a between a first output signal 44a of the first slow adaptive filter 36a and the first cancellation signal 30a output by the first fast adaptive filter 38a.
- the filter coefficients of second slow adaptive filter 36b are based, at least in part, on second error signal 42b equal to a difference output by second subtractor 40b between a second output signal 44b of the second slow adaptive filter 36b and the second audio signal 18b; rather than being equal to a difference output by second subtractor 40b between a second output signal 44b of the second slow adaptive filter 36b and the second cancellation signal 30b output by the second fast adaptive filter 38b.
- the hearing aid 10 shown in Fig. 7 combines the error signals 42a shown in Figs. 3 and 5 , respectively.
- the hearing aid 10 shown in Fig. 7 is similar to the hearing aid of Figs. 3 except for the fact that the filter coefficients of slow adaptive filter 36a of the hearing aid 10 of Fig. 7 are based, at least in part, on an error signal 42a that is equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and a weighted sum of the audio signal 18a and the cancellation signal 30a output by the fast adaptive filter 38a; rather than being equal to a difference output by subtractor 40a between an output signal 44a of the slow adaptive filter 36a and the cancellation signal 30a output by the fast adaptive filter 38a.
- the hearing aid 10 shown in Fig. 8 is similar to the hearing aid of Figs. 4 or 6 except for the fact that as in Fig. 7 , the filter coefficients of the first slow adaptive filter 36a of the hearing aid 10 of Fig. 7 are based, at least in part, on a first error signal 42a that is equal to a difference output by first subtractor 40a between a first output signal 44a of the first slow adaptive filter 36a and a weighted sum of the first audio signal 18a and the first cancellation signal 30a output by first fast adaptive filter 38a.
- the filter coefficients of second slow adaptive filter 36b are based, at least in part, on second error signal 42b equal to a difference output by second subtractor 40b between a second output signal 44b of the second slow adaptive filter 36b and a weighted sum of second audio signal 18b and second cancellation signal 30b output by second fast adaptive filter 38b.
- Fig. 9 shows a hearing aid 10 according to the appended claims, having a fast adaptive filter 38a included in signal modelling circuitry 64.
- the signal modelling circuitry 64 may substitute the adaptive filters 38a, 38b of the hearing aids shown in Figs. 3 - 8 .
- the fast adaptive filters 38a, 38b shown in Figs. 3 - 8 operate according to the so-called "direct approach” to minimize the expected signal strength of the error signal 34a, 34b.
- the "direct approach” is well-known in the art of hearing aids, and the minimization of the error signal is typically performed using the least mean squares (LMS) algorithm, the normalized least mean squares (NLMS) algorithm, preferably the Block Normalized Least Mean Squares (BNLMS) algorithm, wherein the square error criterion is minimized over a block of samples
- LMS least mean squares
- NLMS normalized least mean squares
- BNLMS Block Normalized Least Mean Squares
- De-correlation circuit 54 applies adaptive de-correlation to error signal 34a to obtain filtered error signal 58.
- De-correlation circuit 56 applies adaptive de-correlation symmetrically to fast adaptive filter input 44a to obtain filtered input 60 so that cross-correlating both signals in algorithm block 62 provides a gradient estimate to minimize the filtered error criterion, which is known to be more robust for tonal or self-correlated external signals.
- the signal model used in the de-correlation filters 54, 56 is obtained from error signal 34a.
- a fixed de-correlation filter may alternatively be used.
- the signal modelling circuitry 64 may further be configured for maintaining a statistical model of the external signal 18a for distinguishing correlations between the hearing aid output and input caused by feedback from correlations already present in the external signal (tonal input) whereby sensitivity to tonal input is reduced.
- Fig. 10 shows an embodiment of the signal modelling circuitry 64 in more detail.
- the illustrated signal modelling circuitry 64 comprises adaptive de-correlation circuits 54, 56. Adaptive de-correlation is applied to the error signal 34a to obtain the filtered error signal 58. Further, adaptive de-correlation is applied symmetrically to the input 44a to the fast adaptive filter 38a, i.e. the filter of de-correlation circuit 56 is identical to the filter of de-correlation circuit 54, so that cross-correlating the de-correlated signals 58, 60 in algorithm 62 provides a gradient estimate to minimize the filtered error criterion, which is known to be more robust with tonal or self-correlated external signal conditions.
- the de-correlation filters subtract a linear prediction of the signal after cancellation (which ideally matches the external signal). In some sense it is quite similar to the well-known Linear Predictive Coding, except that in the present circuitry, the models are updated incrementally. Standard FIR filters are used for the linear prediction, so consequently the generating model (for the external signal) is IIR and can be interpreted as an Auto-Regressive model. However, it is not necessary to restrict to Auto-Regressive models; e.g., Autoregressive-moving-average models (ARMA) could also be used, although extra care may be needed to ensure stability and efficiency.
- ARMA Autoregressive-moving-average models
- Fixed de-correlation filters may alternatively be used in the signal modelling circuitry 64.
- adaptive non-linear de-correlation may be applied in the signal path.
- Non-linear de-correlation in the signal path decreases the correlation of the external signal with the hearing aid output.
- the contribution to the input signal caused by feedback remains equally correlated (because the applied non-linearity is known) so it becomes easier to distinguish feedback from tonal input and consequently the feedback models will improve.
- Fig. 11 shows a feedback suppression circuit except the fast adaptive filters. Some or all of the illustrated fixed filter 46, the delays 48, 52a, 52b, and the barrel shifters 50a, 50b may be included in the feedback suppression circuits 28 shown in Figs. 3 - 8 .
- the output 22 of the hearing loss processor (not shown) is input to a fixed filter 46 connected in series with the first slow adaptive filter 36a and the first fast adaptive filter
- the fixed filter 46 is configured for modelling true invariant parts of the feedback path (not shown), such as initial values of the transfer function of the microphone (not shown), the transfer function of an amplifier (not shown) driving the receiver (not shown), and the transfer function of the receiver (not shown), and a basic part of the feedback path (not shown), so that the adaptive filters of the feedback suppression circuit are only required to cope with variations from the initial values.
- Bulk delays 48, 52a, 52b are connected in series with the slow adaptive filters 36a, 36b and the fast adaptive filters (not shown) configured for modelling the propagation delays of the respective feedback signals propagating along respective feedback paths (not shown) and thereby relieving the adaptive filters of the feedback suppression circuit of this task.
- the bulk delays are distributed to facilitate anti-causal interpolation in the second slow adaptive filter 36b.
- Barrel shifters 50a, 50b are connected at the respective outputs of the first and second slow adaptive filters 36a, 36b in order to adaptively scale the respective output signals 44a, 44b. Scaling maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths.
- Fig. 12 shows plots of feedback path transfer functions upon repeated re-insertions for illustration of variations of the feedback path modelled by the slow adaptive filter.
- Fig. 13 shows plots of transfer functions of the feedback path 80 and the model 82 learned by the slow adaptive filter after 60 seconds of speech.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
Description
- A new method for performing adaptive feedback suppression in a hearing aid and a hearing aid utilizing the method are provided. According to the method, feedback suppression is performed with a slow adaptive filter modelling slow changes of a feedback path and a fast adaptive filter modelling rapid changes of the feedback path.
- In a hearing aid, acoustical signals arriving at a microphone of the hearing aid are amplified and output with a small loudspeaker to restore audibility. The small distance between the microphone and the loudspeaker may cause feedback. Feedback is generated when a part of the amplified acoustic output signal propagates back to the microphone for repeated amplification. When the feedback signal exceeds the level of the original signal at the microphone, the feedback loop becomes unstable, typically leading to audible distortions or howling. One way to stop feedback is to lower the gain.
- The risk of feedback, limits the maximum gain that can be used with a hearing aid.
- It is well-known to use feedback suppression in a hearing aid. With feedback suppression, the feedback signal arriving at the microphone is suppressed by subtraction of a feedback model signal from the microphone signal. The feedback model signal is provided by a digital feedback suppression circuit configured to model the feedback path of propagation along which an output signal of the hearing aid propagates back to an input of the hearing aid for repeated amplification. The transfer function of the receiver (in the art of hearing aids, a loudspeaker of the hearing aid is usually denoted the receiver), and the transfer function of the microphone are included in the model of the feedback path of propagation.
- Typically, the digital feedback suppression circuit includes one or more digital adaptive filters to model the feedback path. An output of the feedback suppression circuit is subtracted from the audio signal of the microphone to remove the feedback signal part of the audio signal.
- In a hearing aid with more than one microphone, e.g. having a directional microphone system, the hearing aid may comprise separate digital feedback suppression circuits for individual microphones and groups of microphones.
-
WO 99/26453 A1 -
WO 99/26453 A1 Fig. 1 . - The first filter is adapted during fitting of the hearing aid to the intended user and/or when the hearing aid is turned on in the ear. This filter adapts quickly using a white noise probe signal, and then the filter coefficients are frozen, i.e. during normal operation of the hearing aid; the first filter operates as a fixed filter.
- The first filter models those parts of the hearing aid feedback path that are assumed to be essentially constant while the hearing aid is in use, such as the microphone, amplifier driving the receiver, and receiver resonances, and the basic acoustic feedback path.
- The second filter adapts while the hearing aid is in use and does not use a separate probe signal. This filter provides a rapid correction to the feedback suppression circuit when the hearing aid goes unstable, and tracks perturbations in the feedback path that occur in daily use, such as caused by chewing, sneezing, or using a telephone handset.
- The series connection of a fixed filter and an adaptive filter provides a good trade-off between speed and accuracy. A single long filter tends to be slow and/or inaccurate. Further, the fixed filter is an IIR-filter with relatively low processor requirements.
- However, in practice the filter coefficients of the fixed filter are determined for each individual user when the hearing aid is fitted to the user by a dispenser or another trained person. This not only requires an additional fitting step, but also fails to capture the true invariant part of the feedback path because the feedback path measured by the dispenser already includes some of the variant parts. For example, the fitting of the hearing aid in the ear canal is included in the invariant part, but it may be subject to changes, e.g. when the hearing aid is re-inserted in the ear.
-
WO 99/26453 A1 WO 99/26453 A1 - According to the new invention, methods of adapting a slowly adapting filter are proposed, whereby initialisation during fitting or during power-up of the hearing aid in order to determine values of filter coefficients is avoided.
- A hearing aid is provided, comprising
an input transducer for generating an audio signal,
a feedback suppression circuit configured for modelling a feedback path of the hearing aid,
a subtractor for subtracting an output signal of the feedback suppression circuit from the audio signal to form a feedback compensated audio signal,
a hearing loss processor that is coupled to an output of the subtractor for processing the feedback compensated audio signal to perform hearing loss compensation, and preferably,
an output transducer, preferably a receiver, that is coupled to an output of the hearing loss processor for providing a sound signal based on the processed feedback compensated audio signal,
wherein the feedback suppression circuit comprises
a slow adaptive filter with an input coupled to the hearing loss processor and an output, and
a fast adaptive filter with an input coupled to the slow adaptive filter, and output. - The output of the fast adaptive filter may constitute an output of the feedback suppression circuit.
- A transducer is a device that converts a signal in one form of energy to a corresponding signal in another form of energy. For example, the input transducer may comprise a microphone that converts an acoustic signal arriving at the microphone into a corresponding analogue audio signal in which the instantaneous voltage of the audio signal varies continuously with the sound pressure of the acoustic signal.
- The input transducer may also comprise a telecoil that converts a magnetic field at the telecoil into a corresponding analogue audio signal in which the instantaneous voltage of the audio signal varies continuously with the magnetic field strength at the telecoil. Telecoils are typically used to increase the signal to noise ratio of speech from a speaker addressing a number of people in a public place, e.g. in a church, an auditorium, a theatre, a cinema, etc., or through a public address systems, such as in a railway station, an airport, a shopping mall, etc. Speech from the speaker is converted to a magnetic field with an induction loop system (also denoted "hearing loop"), and the telecoil is used to magnetically pick up the magnetically transmitted speech signal.
- With a telecoil, feedback may be generated when the telecoil picks up a magnetic field generated by the hearing aid, e.g. generated by the receiver.
- The input transducer may further comprise at least two spaced apart microphones, and a beamformer configured for combining microphone output signals of the at least two spaced apart microphones into a directional microphone signal, e.g. as is well-known in the art.
- The input transducer may comprise one or more microphones and a telecoil and a switch, e.g. for selection of an omni-directional microphone signal, or a directional microphone signal, or a telecoil signal, either alone or in any combination, as the audio signal.
- The output transducer preferably comprises a receiver, i.e. a small loudspeaker, which converts an analogue audio signal into a corresponding acoustic sound signal in which the instantaneous sound pressure varies continuously in accordance with the amplitude of the analogue audio signal.
- Typically, the analogue audio signal is made suitable for digital signal processing by conversion into a corresponding digital audio signal in an analogue-to-digital converter whereby the amplitude of the analogue audio signal is represented by a binary number. In this way, a discrete-time and discrete-amplitude digital audio signal in the form of a sequence of digital values represents the continuous-time and continuous-amplitude analogue audio signal.
- Throughout the present disclosure, a part of the audio signal generated by the hearing aid itself, e.g., as a result of sound, mechanical vibration, electromagnetic fields, etc, generated by the hearing aid, is termed the feedback signal part of the audio signal; or in short, the feedback signal.
- The feedback suppression circuit is provided in the hearing aid in order to model the feedback path, i.e. desirably the feedback suppression circuit has the same transfer function as the feedback path itself so that an output signal of the feedback suppression circuit matches the feedback signal part of the audio signal as closely as possible.
- A subtractor is provided for subtraction of the output signal of the feedback suppression circuit from the audio signal to form a feedback compensated audio signal in which the feedback signal part has been removed or at least reduced.
- The feedback suppression circuit comprises an adaptive filter that tracks the current transfer function of the feedback path.
- The feedback suppression circuit may comprise one or more electronic delays corresponding to the delay of the feedback signal propagating along the feedback path of the hearing aid.
- The feedback suppression circuit may comprise at least one fixed filter configured for modelling stationary parts of the feedback path of the hearing aid.
- The feedback suppression circuit may comprise at least one slow adaptive filter and at least one fast adaptive filter configured for modelling the feedback path.
- The slow adaptive filter eliminates the need for initialisation of the feedback suppression circuit during fitting to the intended user or during power-up of the hearing aid.
- Further, the slow adaptive filter improves the performance of the feedback suppression circuit with relation to slow changes of the feedback path, such as accumulation of ear wax, changes due to reinsertion of the hearing aid in the ear canal of the user, drift of electronic components of the hearing aid, etc. Thus, the slow adaptive filter may track changes taking place in minutes or even slower, while the fast adaptive filter may track changes, such as smiling, chewing, sneezing, using a telephone handset, etc, taking place in tens of milliseconds and up to seconds.
- The filter coefficients of the slow adaptive filter may be based at least in part on a difference between the output signal of the slow adaptive filter and the audio signal.
- The filter coefficients of the slow adaptive filter may be based at least in part on a difference between the output signal of the slow adaptive filter and the output signal of fast adaptive filter.
- The filter coefficients of the slow adaptive filter may be based at least in part on a difference between an output signal of the slow adaptive filter and a weighted sum of the output signal of the fast adaptive filter and first audio signal.
- In the following, the above components and signals of the hearing aid mentioned for the first time are denoted the first respective components and signals to distinguish them from the second respective components and signals mentioned below.
- The hearing aid may further comprise
a second input transducer for generating a second audio signal,
a second feedback suppression circuit configured for modelling a second feedback path of the hearing aid,
a second subtractor for subtracting a second output signal of the second feedback suppression circuit from the second audio signal to form a second feedback compensated audio signal, and wherein
the hearing loss processor is coupled to the second subtractor for processing the second feedback compensated audio signal to perform hearing loss compensation, and wherein
the second feedback suppression circuit comprises
a second slow adaptive filter with an input coupled to the hearing loss processor; or, the first slow adaptive filter, and an output, and
a second fast adaptive filter with an input coupled to the second slow adaptive filter, and an output. - The output of the second fast adaptive filter may constitute an output of second feedback suppression circuit.
- In a hearing aid with a plurality of input transducers, e.g. a front and a rear microphone, the distances between the input transducers are usually small due to the small sizes of hearing aid housings. The feedback paths to individual input transducers proximate to each other are expected to have similar transfer functions and therefore one filter may be used to model one of the feedback paths to a respective one of the input transducers and simpler filters, in the following denoted "correction filters", may be used to model differences between the modelled feedback path and other feedback paths to respective other input transducers, whereby duplication of common features of the slow adaptive filters are substantially avoided. The feedback path differences may lead to sub-sample delays and minor shaping of the magnitude responses due to the small differences in physical distances between the output transducer and the input transducers in question.
- Consequently, the primary purpose of the correction filters may be to implement a form of interpolation which ideally requires an anti-causal impulse response, since interpolation is desirably based on samples on both sides of the interpolated point. Normally such a filter is difficult to implement, but for the feedback suppression circuit this is possible due to a total bulk delay in the feedback loop of typically at least up to two blocks of samples. Some of this bulk delay can be used to provide the response a bit ahead of time so that the correction filters have sufficient information to perform the desired interpolation.
- The idea of modelling differences in feedback paths may also be applied to the fast adaptive filters. Changes in the dynamic feedback paths may also cause sub-sample time differences in the feedback loop and may also cause minor shaping of the magnitude responses suitable for modelling by interpolation.
- Electronic delays corresponding to the delays caused by propagation of signals along the feedback path may be arranged in the feedback suppression circuit. This simplifies the adaptive filters and also facilitates interpolation based on samples before and after the interpolation point in time.
- Delays of the feedback suppression circuit corresponding to propagation delays along the corresponding feedback paths may be provided in the form of one common delay, preferably the shortest delay between the output transducer and one of the input transducers, and individual delays modelling the additional delay from the output transducer to the respective other input transducers.
- The slow adaptive filter may be FIR filters which are less complex and more stable than IIR filters.
- The output signals of the slow filters may be scaled, preferably scaled adaptively, using bit shifters. Scaling, such as adaptive scaling, maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths.
- The filter coefficients of the second slow adaptive filter may be based at least in part on a difference between the output signal of the second slow adaptive filter and the second audio signal.
- The filter coefficients of the second slow adaptive filter may be based at least in part on a difference between the output signal of the second slow adaptive filter and the output signal of second fast adaptive filter.
- The filter coefficients of the second slow adaptive filter may be based at least in part on a difference between an output signal of the second slow adaptive filter and a weighted sum of the output signal of the second fast adaptive filter and the second audio signal.
-
-
-
- In principle, it is possible to adapt both the fast filter coefficients
wf and the slow filter coefficients w using a single error criterion. - However, in the following a more effective approach is disclosed that more fully exploit the fundamental differences in purpose of the slow and the fast adaptive filters, i.e. the slow filter desirably models properties of the feedback path subject to slow changes only, while the fast adaptive filter desirably models rapid changes only. Consequently, a different error criterion for the slow adaptive filter and the fast adaptive filter may be more appropriate.
- Under normal circumstances, the cancellation signal c(n) may on average be assumed to be the best known estimate of the feedback signal, and therefore the slow adaptive filter may be connected for tracking this signal, thus absorbing innovations from the fast adaptive filter, which gives error signal e1:
-
- Error signal e1 is less sensitive to bias because the fast adaptive filter uses an adaptive signal model, but it may lead to local minima that may trap the slow adaptive filter preventing it for further adaptation.
- Error signal e2 is optimal for uncorrelated signals, but may suffer more from bias caused by tonal input.
-
-
- Using the chain rule to calculate gradient directions for minimizing J with respect to the slow adaptive filter coefficients then gives
where
which for coefficients w, by ignoring the term ∇t(n) (the target should not depend on the current internal model), can be simplified to
so that the gradient direction is estimated by cross-correlating the weighted error signal with the FIR filter input signal on respective taps. - Derivation for the front-to-rear correction filter coefficient may be analogous except that the cross correlation is now performed with the output signal of the common slow adaptive filter d(n), which is input to the correction filter.
- For the slow and fast adaptive filters, the step size may be determined in a way well known in the art of adaptive filters, such as by the least mean squares (LMS) algorithm, the normalized least mean squares (NLMS) algorithm, or by line searches, conjugate gradients, Hessian estimation techniques, etc.
- For the slow adaptive filter, however, a simple sign-based algorithm may be sufficient and an appropriate step size may be determined directly from the current filter coefficients.
- In order to minimize complexity of the adjustment of the filter coefficients, only some of the coefficients, i.e. at least one coefficient, may be adjusted, i.e. updated, for each block of samples. Since only cross-correlations are used, the computational complexity for a single weight is roughly equivalent to that of adding a single FIR filter coefficient. Updating more than e.g. four filter coefficients per block may not be desired, at least for the slow adaptive filter.
- Once an update cycle has been completed, i.e., all coefficients have been adjusted, i.e. updated, once, a special event is scheduled for updating administrative settings such as the coefficient step size, model scaling and constraints. For optimal accuracy, step-sizes and scaling have to be updated during normal operation of the hearing aid, because the feedback path magnitude is not known beforehand; however, a reasonable estimate may be provided to speed up initial convergence.
- A good step size for the sign-based update is defined proportional to the feedback path magnitude response. Once, at least a rough indication of, the feedback magnitude is known, this approach provides nearly constant accuracy for tracking changes of the feedback path independent of the feedback signal level.
- Another approach may be used directly after power up of the hearing aid, when the feedback path is not known yet. In the initial start-up phase, a faster, and initially even non-proportional, step size may be used to speed up convergence and quickly silence possible initial feedback, such as howling. The transition time from initial to final rate may be configurable, and may be in the order of a few seconds up to around a minute.
- Alternatively, or in addition, a slow gain ramp-up and loading of coefficients previously stored in persistent memory may be performed.
- In order to prevent adaptation of the slow adaptive filter in situations in which the slow adaptive filter may track misleading signals or signals with no information, one or more criteria for adaptation may be added for the slow adaptive filter, whereby the slow adaptive filter may be configured to adjust one or more of its filter coefficients only under certain conditions.
- For example, the slow adaptive filter may only be configured to adjust one or more of its filter coefficients when (1) the signal level is above a predefined threshold, and/or, (2) the (direct error) signal and corresponding signal model are considered save for adaptation, and/or (3) the hearing aid is in its initial start-up phase (directly after power up).
- The level threshold (1) primarily prevents adapting to meaningless input signals, e.g., microphone noise. This may also extend the start-up phase when the algorithm is booted in quiet or in a muted condition.
- Regarding (2), the signal is considered save for adaptation when it is not too predictable, e.g. a pure tone is too predictable, which is determined by comparing the signal level of a de-correlated error signal, e.g. as used for updating the fast adaptive filter, with the level of the direct error signal itself.
- Additionally or alternatively, the error signal is considered save when a p-norm, preferably the 1-norm, of the coefficient vector of the fast adaptive filter (representing the signal model) is below a predetermined threshold value (a large one-norm indicates tonal input).
- The hearing aid may be a multi-band hearing aid performing hearing loss compensation differently in different frequency bands, thus accounting for the frequency dependence of the hearing loss of the intended user. In the multi-band hearing aid, the audio signal from the input transducer is divided into two or more frequency channels or bands; and, typically, the audio signal is amplified differently in each frequency band. For example, a compressor may be utilized to compress the dynamic range of the audio signal in accordance with the hearing loss of the intended user. In a multi-band hearing aid, the compressor performs compression differently in each of the frequency bands varying not only the compression ratio, but also the time constants associated with each band. The time constants refer to compressor attack and release time constants. The compressor attack time is the time required for the compressor to lower the gain at the onset of a loud sound. The release time is the time required for the compressor to increase the gain after the cessation of the loud sound.
- The frequency bands may be warped frequency bands. For example, the hearing aid may have a compressor that performs dynamic range compression using digital frequency warping as disclosed in more detail in
WO 03/015468 Fig. 11 and the corresponding parts of the description ofWO 03/015468 - The feedback suppression circuit, e.g. including one or more adaptive filters, may be a broad band model, i.e. the model may operate substantially in the entire frequency range of operation of the hearing aid, or in a significant part of the frequency range of the hearing aid, without being divided into a set of frequency bands.
- Alternatively, the feedback suppression circuit may be divided into a set of frequency bands for individual modelling of the feedback path in each frequency band. In this case, the estimate of the residual feedback signal may be provided individually in each frequency band m of the feedback suppression circuit.
- The frequency bands m of the feedback suppression circuit and the frequency bands k of the hearing loss compensation may be identical, but preferably, they are different, and preferably the number of frequency bands m of the feedback suppression circuit is less than the number of frequency bands of the hearing loss compensation.
- Throughout the present disclosure, the term audio signal is used to identify any analogue or digital signal forming part of the signal path from an output of the microphone to an input of the hearing loss processor.
- The feedback suppression circuit may be implemented as one or more dedicated electronic hardware circuits or may form part of a signal processor in combination with suitable signal processing software, or may be a combination of dedicated hardware and one or more signal processors with suitable signal processing software.
- Signal processing in the new hearing aid may be performed by dedicated hardware or may be performed in a signal processor, or performed in a combination of dedicated hardware and one or more signal processors.
- As used herein, the terms "processor", "signal processor", "controller", "system", etc., are intended to refer to CPU-related entities, either hardware, a combination of hardware and software, software, or software in execution.
- For example, a "processor", "signal processor", "controller", "system", etc., may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
- By way of illustration, the terms "processor", "signal processor", "controller", "system", etc., designate both an application running on a processor and a hardware processor. One or more "processors", "signal processors", "controllers", "systems" and the like, or any combination hereof, may reside within a process and/or thread of execution, and one or more "processors", "signal processors", "controllers", "systems", etc., or any combination hereof, may be localized on one hardware processor, possibly in combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
- Also, a processor (or similar terms) may be any component or any combination of components that is capable of performing signal processing. For examples, the signal processor may be an ASIC processor, a FPGA processor, a general purpose processor, a microprocessor, a circuit component, or an integrated circuit.
- Below, the new method and hearing aid are explained in more detail with reference to the drawings in which various examples are shown. In the drawings:
- Fig. 1
- schematically illustrates a hearing aid with a feedback path,
- Fig. 2
- schematically illustrates a prior art hearing aid with feedback suppression,
- Fig. 3
- schematically illustrates a new hearing aid with feedback suppression,
- Fig. 4
- schematically illustrates another new hearing aid with feedback suppression,
- Fig. 5
- schematically illustrates yet another new hearing aid with feedback suppression,
- Fig. 6
- schematically illustrates still another new hearing aid with feedback suppression,
- Fig. 7
- schematically illustrates yet still another new hearing aid with feedback suppression,
- Fig. 8
- schematically illustrates yet still another new hearing aid with feedback suppression,
- Fig. 9
- schematically illustrates another new hearing aid with feedback suppression having a fast adaptive filter with signal modelling circuitry,
- Fig. 10
- schematically illustrates signal modelling circuitry in more detail,
- Fig. 11
- schematically illustrates part of a new feedback suppression circuit,
- Fig. 12
- shows plots of feedback path transfer functions upon repeated re-insertions, and
- Fig. 13
- shows a plot of slow filter feedback path modelling performance.
- The accompanying drawings are schematic and simplified for clarity, and they merely show details which are essential to the understanding of the new hearing aid, while other details have been left out. The new hearing aid according to the appended claims may be embodied in different forms not shown in the accompanying drawings and should not be construed as limited to the examples set forth herein.
- Like reference numerals refer to like elements throughout. Like elements may, thus, not be described in detail with respect to the description of each figure.
-
Fig. 1 schematically illustrates ahearing aid 10 and afeedback path 12 along which signals generated by thehearing aid 10 propagates back to an input of thehearing aid 10. - In
Fig. 1 , anacoustical signal 14 is received at amicrophone 16 that converts theacoustical signal 14 into anaudio signal 18 that is input to thehearing loss processor 20 for hearing loss compensation. In thehearing loss processor 20, theaudio signal 18 is amplified in accordance with the hearing loss of the user. Thehearing loss processor 20 may for example comprise a multi-band compressor. Theoutput signal 22 of thehearing loss processor 20 is converted into anacoustical output signal 24 by thereceiver 26 that emits the acoustical signal towards the eardrum of the user when thehearing aid 10 is worn in its proper operational position at an ear of the user. - Typically, a part of the
acoustical signal 24 from thereceiver 26 propagates back to themicrophone 16 as indicated byfeedback path 12 inFig. 1 . - At low gains, feedback only introduces harmless colouring of sound. However, with large hearing aid gain, the feedback signal level at the
microphone 16 may exceed the level of the originalacoustical signal 14 thereby causing audible distortion and possibly howling. - To overcome feedback, it is well-known to provide feedback suppression circuitry in a hearing aid as shown in
Fig. 2 . -
Fig. 2 schematically illustrates ahearing aid 10 with afeedback suppression circuit 28. Thefeedback suppression circuit 28 models thefeedback path 12, i.e. the feedback suppression circuit seeks to generate a signal that is identical to the signal propagated along thefeedback path 12. It is noted that thefeedback suppression circuit 28 includes models of thereceiver 26 and themicrophone 16 so that the transfer function of thefeedback suppression circuit 28 desirably equals the sum of the transfer function of thereceiver 26, the transfer function of thefeedback path 12, and the transfer function of themicrophone 16. - The
feedback suppression circuit 28 generates anoutput signal 30 to thesubtractor 32 in order to suppress or cancel the feedback signal part of theaudio signal 18 before processing takes place in thehearing loss processor 20. - In a
conventional hearing aid 10, thefeedback suppression circuit 28 is typically an adaptive digital filter which adapts to changes in thefeedback path 12. -
WO 99/26453 A1 first filter 36 is adapted when the hearing aid is fitted to the intended user at a dispenser's office. During the fitting, thefilter 36 adapts quickly using a white noise probe signal, and then the filter coefficients are frozen, i.e. subsequently, during normal operation of the hearing aid, thefirst filter 36 operates as a fixedfilter 36. - The
first filter 36 models those parts of the hearingaid feedback path 12 that are assumed to be essentially constant while thehearing aid 10 is in use, such as the transfer function of themicrophone 16, and the transfer function of thereceiver 26, and a basic part of thefeedback path 12. - The
second filter 38 adapts while thehearing aid 10 is in use and does not use a separate probe signal. Thisfilter 38 provides a rapid correction of thefeedback suppression circuit 28 when thehearing aid 10 goes unstable, and tracks perturbations in thefeedback path 12 that occur in daily use, such as caused by chewing, sneezing, or using a telephone handset. Thus, the fastadaptive filter 38 may track changes taking place in tens of milliseconds up to seconds. - Apart from requiring an extra fitting step, the fixed
filter 26 fails to capture the true invariant part of the modelled transfer functions, because the determined fixed filter coefficients already include some of the variant parts. For example, the fitting of thehearing aid 10 in the ear canal is included in the invariant part, but it may be subject to changes, e.g. when thehearing aid 10 is re-inserted in the ear. - In the following, new hearing aids are illustrated that do not require an additional fitting step and also copes with the true variant parts of the modelled transfer functions.
-
Fig. 3 shows a first example of ahearing aid 10 according to the appended claims. Thehearing aid 10 has an input transducer, namely amicrophone 16a, for generating anaudio signal 18a, andfeedback suppression circuit 28a that models thefeedback path 12a, i.e. thefeedback suppression circuit 28a seeks to generate a signal that is identical to the signal propagated along thefeedback path 12a. It is noted that thefeedback suppression circuit 28a includes models of thereceiver 26 and themicrophone 16a so that the transfer function of thefeedback suppression circuit 28a desirably equals the sum of the transfer function of thereceiver 26, the transfer function of thefeedback path 12a, and the transfer function of themicrophone 16a. - The
feedback suppression circuit 28a generates anoutput signal 30a to thesubtractor 32a in order to suppress or cancel the feedback signal part of theaudio signal 18a before processing takes place in thehearing loss processor 20. - A
hearing loss processor 20 is coupled to an output of thesubtractor 32a for processing the feedback compensatedaudio signal 34a to perform hearing loss compensation, and areceiver 26 that is coupled to an output of thehearing loss processor 20 for converting the processed feedback compensatedaudio signal 22 into a sound signal. - The
feedback suppression circuit 28a comprises a slowadaptive filter 36a with an input coupled to the output of thehearing loss processor 20 and an output, and a fastadaptive filter 38a with an input coupled to the output of the slowadaptive filter 36a and an output constituting the output offeedback suppression circuit 28a. - During normal operation of the illustrated
hearing aid 10, thecancellation signal 30a in most situations constitutes a good estimate of the feedback signal part of theaudio signal 18a, and therefore the slowadaptive filter 36a is connected for tracking thesignal 30a, thus absorbing innovations from the fastadaptive filter 38a. - Thus, filter coefficients of the slow
adaptive filter 36a are based, at least in part, on anerror signal 42a equal to a difference output bysubtractor 40a between anoutput signal 44a of the slowadaptive filter 36a and thecancellation signal 30a output by the fastadaptive filter 38a. - Filter coefficients of the fast
adaptive filter 38a are based, at least in part, on theerror signal 34a output bysubtractor 32a. - With the slow
adaptive filter 36a, it is not required to initialize thefeedback suppression circuit 28a. Also, slow changes in the feedback path are adequately modelled by the slowadaptive filter 36a - A fixed filter, see
Fig. 11 , may be connected in series with the slowadaptive filter 36a and the fastadaptive filter 38a configured for modelling true invariant parts of thefeedback path 12a, such as initial values of the transfer function of themicrophone 16a, the transfer function of an amplifier (not shown) driving thereceiver 26, and the transfer function of thereceiver 26, and a basic part of thefeedback path 12a, so that theadaptive filters - A bulk delay, see
Fig. 11 , may be connected in series with the slowadaptive filter 36a and the fastadaptive filter 38a configured for modelling the propagation delay of the feedback signal propagating along the feedback path and thereby relieving theadaptive filters - Barrel shifters, see
Fig. 11 , may be connected at the output of the slowadaptive filter 36a and/or the fastadaptive filter 38a in order to scale the output signals, preferably adaptively. Scaling, such as adaptive scaling, maximizes precision, and optionally extends the coefficient range, and also makes arbitrary slow adaptation possible. Without adaptive scaling, an optimal step size may not be available for all feedback paths. - The
hearing aid 10 shown inFig. 4 is similar to the hearing aid ofFig. 3 except for the fact that thehearing aid 10 ofFig. 4 has twomicrophones front microphone 16a and arear microphone 16b, and thehearing loss processor 20 comprises a beamformer for selectable beamforming as is well-known in the art of hearing aids. Thefeedback path 12a to thefront microphone 16a is modelled by firstfeedback suppression circuit 28a identical to thefeedback circuit 28a shown inFig. 3 . Likewise, thefeedback path 12b to therear microphone 16b is modelled by secondfeedback suppression circuit 28b corresponding to thefeedback circuit 28a shown inFig. 3 except for the fact that the input of the second slowadaptive filter 36b is coupled to theoutput 44a of the first slowadaptive filter 36a instead of to theoutput 22 of thehearing loss processor 20. - In the illustrated
hearing aid 10, the distance between thereceiver 26 to thefront microphone 12a is shorter than the distance between thereceiver 26 and therear microphone 12b. If the opposite is true, i.e. the distance between thereceiver 26 and therear microphone 12b is the shortest, thenmicrophone 12a is the rear microphone andmicrophone 12b is the front microphone. - Thus, the first slow
adaptive filter 36a models slow varying parts of the feedback path to thefront microphone 12a, and the second slowadaptive filter 36b models the difference between the feedback path tofront microphone 12a and the feedback path torear microphone 12b, so that the series connection of the first slowadaptive filter 36a and the second slowadaptive filter 36b together model the feedback path to therear microphone 12b. In the illustrated example, the distance between the front andrear microphones respective feedback paths adaptive filter 36b is simpler than first slowadaptive filter 36a. The second slowadaptive filter 36b performs anti-causal interpolation made possible by bulk delays; seeFig. 11 , of thefeedback suppression circuits - In another example (not shown) in which the
respective feedback paths feedback paths front microphone 16a and therear microphone 16b, respectively, may be modelled byindependent feedback circuits feedback circuit 28a shown inFig. 3 with the inputs of both the first and the second slowadaptive filters output 22 of thehearing loss processor 20. - A first fixed filter, see
Fig. 11 , may be connected in series with the first slowadaptive filter 36a and the first fastadaptive filter 38a configured for modelling true invariant parts of thefirst feedback path 12a, such as initial values of the transfer function of themicrophone 16a, the transfer function of an amplifier (not shown) driving thereceiver 26, and the transfer function of thereceiver 26, and a basic part of thefirst feedback path 12a, so that the first slow and fastadaptive filters - A second fixed filter, see
Fig. 11 , may be connected in series with the second slowadaptive filter 36b and the second fastadaptive filter 38b configured for modelling invariant parts of thesecond feedback path 12b, such as initial values of the transfer function of themicrophone 16b, the transfer function of an amplifier (not shown) driving thereceiver 26, and the transfer function of thereceiver 26, and a basic part of thesecond feedback path 12b, so that the second slow and fastadaptive filters - Respective bulk delays, see
Fig. 11 , are connected in series with the slowadaptive filters adaptive filters feedback paths adaptive filters adaptive filter 36b. - Respective barrel shifters, see
Fig. 11 , are connected at the outputs of the slowadaptive filters respective output signals - The
hearing aid 10 shown inFig. 5 is similar to the hearing aid ofFig. 3 except for the fact that the filter coefficients of slowadaptive filter 36a of thehearing aid 10 ofFig. 5 are based, at least in part, on anerror signal 42a that is equal to a difference output bysubtractor 40a between anoutput signal 44a of the slowadaptive filter 36a and theaudio signal 18a; rather than being equal to a difference output bysubtractor 40a between anoutput signal 44a of the slowadaptive filter 36a and thecancellation signal 30a output by the fastadaptive filter 38a. - The
error signal 42a is also denoted a direct approach error and it is effectively the signal that would be the output of the feedback suppression circuit, if the fast adaptive filter was frozen in its reference state. Theerror signal 42a is optimal for uncorrelated signals, but may suffer more from bias caused by tonal input, whereas theerror signal 42a ofFig. 3 is less sensitive to bias because the fast adaptive filter uses an adaptive signal model, but it may lead to local minima that may trap the slow adaptive filter preventing it for further adaptation. - The
hearing aid 10 shown inFig. 6 is similar to the hearing aid ofFig. 4 except for the fact that as inFig. 5 , the filter coefficients of first slowadaptive filter 36a of thehearing aid 10 ofFig. 5 are based, at least in part, on afirst error signal 42a equal to a difference output byfirst subtractor 40a between afirst output signal 44a of the first slowadaptive filter 36a and thefirst audio signal 18a; rather than being equal to a difference output byfirst subtractor 40a between afirst output signal 44a of the first slowadaptive filter 36a and thefirst cancellation signal 30a output by the first fastadaptive filter 38a. Likewise, the filter coefficients of second slowadaptive filter 36b are based, at least in part, onsecond error signal 42b equal to a difference output bysecond subtractor 40b between asecond output signal 44b of the second slowadaptive filter 36b and thesecond audio signal 18b; rather than being equal to a difference output bysecond subtractor 40b between asecond output signal 44b of the second slowadaptive filter 36b and thesecond cancellation signal 30b output by the second fastadaptive filter 38b. - The
hearing aid 10 shown inFig. 7 combines the error signals 42a shown inFigs. 3 and5 , respectively. Thus, thehearing aid 10 shown inFig. 7 is similar to the hearing aid ofFigs. 3 except for the fact that the filter coefficients of slowadaptive filter 36a of thehearing aid 10 ofFig. 7 are based, at least in part, on anerror signal 42a that is equal to a difference output bysubtractor 40a between anoutput signal 44a of the slowadaptive filter 36a and a weighted sum of theaudio signal 18a and thecancellation signal 30a output by the fastadaptive filter 38a; rather than being equal to a difference output bysubtractor 40a between anoutput signal 44a of the slowadaptive filter 36a and thecancellation signal 30a output by the fastadaptive filter 38a. - The
hearing aid 10 shown inFig. 8 is similar to the hearing aid ofFigs. 4 or6 except for the fact that as inFig. 7 , the filter coefficients of the first slowadaptive filter 36a of thehearing aid 10 ofFig. 7 are based, at least in part, on afirst error signal 42a that is equal to a difference output byfirst subtractor 40a between afirst output signal 44a of the first slowadaptive filter 36a and a weighted sum of thefirst audio signal 18a and thefirst cancellation signal 30a output by first fastadaptive filter 38a. Likewise, the filter coefficients of second slowadaptive filter 36b are based, at least in part, onsecond error signal 42b equal to a difference output bysecond subtractor 40b between asecond output signal 44b of the second slowadaptive filter 36b and a weighted sum ofsecond audio signal 18b andsecond cancellation signal 30b output by second fastadaptive filter 38b. -
Fig. 9 shows ahearing aid 10 according to the appended claims, having a fastadaptive filter 38a included insignal modelling circuitry 64. Thesignal modelling circuitry 64 may substitute theadaptive filters Figs. 3 - 8 . - The fast
adaptive filters Figs. 3 - 8 operate according to the so-called "direct approach" to minimize the expected signal strength of theerror signal - The direct approach is known to provide biased results when the input signal exhibits a long-tailed auto-correlation function. In the case of tonal signals, for example, this typically leads to sub-optimal solutions because the adaptive feedback model will attempt to suppress the external tones instead of modelling the actual feedback.
- This problem is solved with the
signal modelling circuitry 64 shown inFig. 9 comprisingde-correlation circuits -
De-correlation circuit 54 applies adaptive de-correlation to errorsignal 34a to obtain filterederror signal 58.De-correlation circuit 56 applies adaptive de-correlation symmetrically to fastadaptive filter input 44a to obtain filteredinput 60 so that cross-correlating both signals inalgorithm block 62 provides a gradient estimate to minimize the filtered error criterion, which is known to be more robust for tonal or self-correlated external signals. In the illustratedsignal modelling circuitry 64, the signal model used in the de-correlation filters 54, 56 is obtained fromerror signal 34a. However, a fixed de-correlation filter may alternatively be used. - The
signal modelling circuitry 64 may further be configured for maintaining a statistical model of theexternal signal 18a for distinguishing correlations between the hearing aid output and input caused by feedback from correlations already present in the external signal (tonal input) whereby sensitivity to tonal input is reduced. -
Fig. 10 shows an embodiment of thesignal modelling circuitry 64 in more detail. The illustratedsignal modelling circuitry 64 comprises adaptivede-correlation circuits error signal 34a to obtain the filterederror signal 58. Further, adaptive de-correlation is applied symmetrically to theinput 44a to the fastadaptive filter 38a, i.e. the filter ofde-correlation circuit 56 is identical to the filter ofde-correlation circuit 54, so that cross-correlating thede-correlated signals algorithm 62 provides a gradient estimate to minimize the filtered error criterion, which is known to be more robust with tonal or self-correlated external signal conditions. - The de-correlation filters subtract a linear prediction of the signal after cancellation (which ideally matches the external signal). In some sense it is quite similar to the well-known Linear Predictive Coding, except that in the present circuitry, the models are updated incrementally. Standard FIR filters are used for the linear prediction, so consequently the generating model (for the external signal) is IIR and can be interpreted as an Auto-Regressive model. However, it is not necessary to restrict to Auto-Regressive models; e.g., Autoregressive-moving-average models (ARMA) could also be used, although extra care may be needed to ensure stability and efficiency.
- Fixed de-correlation filters may alternatively be used in the
signal modelling circuitry 64. - Further, adaptive non-linear de-correlation may be applied in the signal path. Non-linear de-correlation in the signal path decreases the correlation of the external signal with the hearing aid output. The contribution to the input signal caused by feedback remains equally correlated (because the applied non-linearity is known) so it becomes easier to distinguish feedback from tonal input and consequently the feedback models will improve.
-
Fig. 11 shows a feedback suppression circuit except the fast adaptive filters. Some or all of the illustrated fixedfilter 46, thedelays barrel shifters feedback suppression circuits 28 shown inFigs. 3 - 8 . - The
output 22 of the hearing loss processor (not shown) is input to a fixedfilter 46 connected in series with the first slowadaptive filter 36a and the first fast adaptive filter - (not shown). The fixed
filter 46 is configured for modelling true invariant parts of the feedback path (not shown), such as initial values of the transfer function of the microphone (not shown), the transfer function of an amplifier (not shown) driving the receiver (not shown), and the transfer function of the receiver (not shown), and a basic part of the feedback path (not shown), so that the adaptive filters of the feedback suppression circuit are only required to cope with variations from the initial values. - Bulk delays 48, 52a, 52b are connected in series with the slow
adaptive filters adaptive filter 36b. -
Barrel shifters adaptive filters respective output signals -
Fig. 12 shows plots of feedback path transfer functions upon repeated re-insertions for illustration of variations of the feedback path modelled by the slow adaptive filter. -
Fig. 13 shows plots of transfer functions of thefeedback path 80 and themodel 82 learned by the slow adaptive filter after 60 seconds of speech.
Claims (14)
- A hearing aid (10) comprising
a first input transducer (16a) for generating a first audio signal (18a),
a first feedback suppression circuit (28a) configured for modelling a first feedback path (12a) of the hearing aid (10),
a first subtractor (32a) for subtracting an first output signal (30a) of the first feedback suppression circuit (28a) from the first audio signal (18a) to form a first feedback compensated audio signal (34a),
a hearing loss processor (20) that is coupled to an the first subtractor for processing the first feedback compensated audio signal (34a) to perform hearing loss compensation, and
a receiver (26) that is coupled to the hearing loss processor (20) for providing a sound signal based on the processed feedback compensated audio signal (22),
wherein the first feedback suppression circuit (28a) comprises
a first slow adaptive filter (36a) with an input coupled to the hearing loss processor (20) and an output, and
a first fast adaptive filter (38a) with an input coupled to the first slow adaptive filter (36a) and output, and wherein
filter coefficients of the first slow adaptive filter (36a) are based at least in part on a difference between an output signal of the first slow adaptive filter (36a) and at least one of an output signal of the first fast adaptive filter (38a) and the first audio signal (18a). - A hearing aid (10) according to claim 1, wherein the filter coefficients of the first slow adaptive filter (36a) are based at least in part on a difference between the output signal of the first slow adaptive filter (36a) and the first audio signal (18a).
- A hearing aid (10) according to claim 1, wherein the filter coefficients of the first slow adaptive filter (36a) are based at least in part on a difference between the output signal of the first slow adaptive filter (36a) and the output signal of first fast adaptive filter (38a).
- A hearing aid (10) according to claim 1, wherein the filter coefficients of the first slow adaptive filter (36a) are based at least in part on a difference between an output signal of the first slow adaptive filter (36a) and a weighted sum of the output signal of the first fast adaptive filter (38a) and the first audio signal (18a).
- A hearing aid (10) according to any of the preceding claims, comprising a second input transducer (16b) for generating a second audio signal (18b),
a second feedback suppression circuit (28b) configured for modelling a second feedback path (12b) of the hearing aid (10),
a second subtractor (32b) for subtracting a second output signal (30b) of the second feedback suppression circuit (28b) from the second audio signal (18b) to form a second feedback compensated audio signal (34b), and wherein
the hearing loss processor (20) is coupled to an output of the second subtractor for processing the second feedback compensated audio signal (34b) to perform hearing loss compensation, and wherein
the second feedback suppression circuit (28b) comprises
a second slow adaptive filter (36b) with an input coupled to the output of the hearing loss processor (20) and an output, and
a second fast adaptive filter (38b) with an input coupled to the output of the second slow adaptive filter (36b) and output, and wherein
filter coefficients of the second slow adaptive filter (36b) are based at least in part on a difference between an output signal of the second slow adaptive filter (36b) and at least one of an output signal of the second fast adaptive filter (38b) and the second audio signal (18b). - A hearing aid (10) according to any of claims 1 - 4, comprising
a second input transducer (16b) for generating a second audio signal (18b),
a second feedback suppression circuit (28b) configured for modelling a second feedback path (12b) of the hearing aid (10),
a second subtractor (32b) for subtracting a second output signal (30b) of the second feedback suppression circuit (28b) from the second audio signal (18b) to form a second feedback compensated audio signal (34b), and wherein
the hearing loss processor (20) is coupled to an output of the second subtractor for processing the second feedback compensated audio signal (34b) to perform hearing loss compensation, and wherein
the second feedback suppression circuit (28b) comprises
a second slow adaptive filter (36b) with an input coupled to the output of the first slow adaptive filter (36a) and an output, and
a second fast adaptive filter (38b) with an input coupled to the output of the second slow adaptive filter (36b) and output, and wherein
filter coefficients of the second slow adaptive filter (36b) are based at least in part on a difference between an output signal of the second slow adaptive filter (36b) and at least one of an output signal of the second fast adaptive filter (38b) and the second audio signal (18b). - A hearing aid (10) according to claim 5 or 6, wherein the filter coefficients of the second slow adaptive filter (36b) are based at least in part on a difference between the output signal of the second slow adaptive filter (36b) and the second audio signal (18b).
- A hearing aid (10) according to claim 5 or 6, wherein the filter coefficients of the second slow adaptive filter (36b) are based at least in part on a difference between the output signal of the second slow adaptive filter (36b) and the output signal of second fast adaptive filter (38b).
- A hearing aid (10b) according to claim 5 or 6, wherein the filter coefficients of the second slow adaptive filter (36b) are based at least in part on a difference between an output signal of the second slow adaptive filter (36b) and a weighted sum of the output signal of the second fast adaptive filter (38b) and the second audio signal (18b).
- A hearing aid (10) according to any of the preceding claims, wherein the first slow adaptive filter is configured to adjust one or more of the filter coefficients when at least one criteria is fulfilled.
- A hearing aid (10) according to claim 10, wherein the criteria comprises that the signal level of the input signal of the feedback suppression circuit is larger than a predefined threshold.
- A hearing aid (10) according to claim 10 or 11, wherein the criteria comprises that an autocorrelation of the error signal is below a predetermined threshold.
- A hearing aid (10) according to any of claims 10 - 12, wherein the criteria comprises that the adjustment constitutes a first adjustment performed immediately upon power-up of the hearing aid.
- A hearing aid (10) according to any of claims 10 - 13, wherein the criteria comprises that a p-norm of a filter coefficient vector of the first fast adaptive filter is less than a predetermined threshold value.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DK13199680.3T DK2890154T3 (en) | 2013-12-27 | 2013-12-27 | Hearing aid with feedback suppression |
EP13199680.3A EP2890154B1 (en) | 2013-12-27 | 2013-12-27 | Hearing aid with feedback suppression |
US14/144,474 US9628923B2 (en) | 2013-12-27 | 2013-12-30 | Feedback suppression |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP13199680.3A EP2890154B1 (en) | 2013-12-27 | 2013-12-27 | Hearing aid with feedback suppression |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2890154A1 true EP2890154A1 (en) | 2015-07-01 |
EP2890154B1 EP2890154B1 (en) | 2017-12-13 |
Family
ID=49880631
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13199680.3A Active EP2890154B1 (en) | 2013-12-27 | 2013-12-27 | Hearing aid with feedback suppression |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP2890154B1 (en) |
DK (1) | DK2890154T3 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3393140A1 (en) * | 2017-04-20 | 2018-10-24 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for multichannel interference cancellation |
CN109429162A (en) * | 2017-08-25 | 2019-03-05 | 奥迪康有限公司 | Including the hearing aid device for the self-test unit for determining the state of one or more functions component based on feedback response |
CN112397080A (en) * | 2020-10-30 | 2021-02-23 | 浙江大华技术股份有限公司 | Echo cancellation method and apparatus, voice device, and computer-readable storage medium |
CN116055972A (en) * | 2023-03-07 | 2023-05-02 | 深圳市鑫正宇科技有限公司 | Signal processing system and method for hearing aid |
EP3437331B1 (en) * | 2016-04-01 | 2024-05-29 | Cochlear Limited | Execution and initialisation of processes for a device |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0342782A2 (en) * | 1988-03-23 | 1989-11-23 | Central Institute For The Deaf | Electroacoustic system with electronic filters |
DE102009060094A1 (en) * | 2009-12-22 | 2011-06-30 | Siemens Medical Instruments Pte. Ltd. | Method and hearing aid for feedback detection and suppression with a directional microphone |
-
2013
- 2013-12-27 EP EP13199680.3A patent/EP2890154B1/en active Active
- 2013-12-27 DK DK13199680.3T patent/DK2890154T3/en active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0342782A2 (en) * | 1988-03-23 | 1989-11-23 | Central Institute For The Deaf | Electroacoustic system with electronic filters |
DE102009060094A1 (en) * | 2009-12-22 | 2011-06-30 | Siemens Medical Instruments Pte. Ltd. | Method and hearing aid for feedback detection and suppression with a directional microphone |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3437331B1 (en) * | 2016-04-01 | 2024-05-29 | Cochlear Limited | Execution and initialisation of processes for a device |
JP2020519070A (en) * | 2017-04-20 | 2020-06-25 | フラウンホーファー−ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン | Apparatus and method for multi-channel interference cancellation |
KR20200015490A (en) * | 2017-04-20 | 2020-02-12 | 프라운호퍼-게젤샤프트 추르 푀르데룽 데어 안제반텐 포르슝 에 파우 | Multichannel Interference Cancellation Device and Method |
US20200051581A1 (en) * | 2017-04-20 | 2020-02-13 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for multichannel interference cancellation |
CN110915233A (en) * | 2017-04-20 | 2020-03-24 | 弗劳恩霍夫应用研究促进协会 | Apparatus and method for multi-channel interference cancellation |
EP3393140A1 (en) * | 2017-04-20 | 2018-10-24 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for multichannel interference cancellation |
RU2735131C1 (en) * | 2017-04-20 | 2020-10-28 | Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. | Device and method for suppression of multichannel mutual interference |
WO2018193028A1 (en) * | 2017-04-20 | 2018-10-25 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for multichannel interference cancellation |
CN109429162A (en) * | 2017-08-25 | 2019-03-05 | 奥迪康有限公司 | Including the hearing aid device for the self-test unit for determining the state of one or more functions component based on feedback response |
CN109429162B (en) * | 2017-08-25 | 2022-01-04 | 奥迪康有限公司 | Hearing system |
CN112397080A (en) * | 2020-10-30 | 2021-02-23 | 浙江大华技术股份有限公司 | Echo cancellation method and apparatus, voice device, and computer-readable storage medium |
CN112397080B (en) * | 2020-10-30 | 2023-02-28 | 浙江大华技术股份有限公司 | Echo cancellation method and apparatus, voice device, and computer-readable storage medium |
CN116055972A (en) * | 2023-03-07 | 2023-05-02 | 深圳市鑫正宇科技有限公司 | Signal processing system and method for hearing aid |
CN116055972B (en) * | 2023-03-07 | 2023-12-22 | 深圳市鑫正宇科技有限公司 | Signal processing system and method for hearing aid |
Also Published As
Publication number | Publication date |
---|---|
EP2890154B1 (en) | 2017-12-13 |
DK2890154T3 (en) | 2018-02-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9628923B2 (en) | Feedback suppression | |
JP3210494B2 (en) | Hearing assistance device, noise suppression device, and feedback suppression device having convergent adaptive filter function | |
US7974428B2 (en) | Hearing aid with acoustic feedback suppression | |
US8737655B2 (en) | System for measuring maximum stable gain in hearing assistance devices | |
EP2080408B1 (en) | Entrainment avoidance with an auto regressive filter | |
US8442251B2 (en) | Adaptive feedback cancellation based on inserted and/or intrinsic characteristics and matched retrieval | |
US10542350B2 (en) | Observer-based cancellation system for implantable hearing instruments | |
EP1545152A2 (en) | Feedback cancellation apparatus and methods | |
EP2890154B1 (en) | Hearing aid with feedback suppression | |
EP1080606A1 (en) | Feedback cancellation improvements | |
JP6283413B2 (en) | Adaptive residual feedback suppression | |
US10334371B2 (en) | Method for feedback suppression | |
EP3675517A1 (en) | Microphone apparatus and headset | |
JP6019098B2 (en) | Feedback suppression | |
US8634581B2 (en) | Method and device for estimating interference noise, hearing device and hearing aid | |
US7155022B2 (en) | Electromagnetic feedback reduction in communication device | |
EP2869600B1 (en) | Adaptive residual feedback suppression | |
Jayanthi et al. | IoT‐Based Bias Analysis in Acoustic Feedback Using Time‐Variant Adaptive Algorithm in Hearing Aids | |
Tran | Robust Techniques for Acoustic Feedback Control in Hearing Aids | |
WO2023232955A1 (en) | A hearing aid system and a method of operating a hearing aid system | |
Ji et al. | An Efficient Adaptive Feedback cancellation using by Independent component analysis for hearing aids |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20131227 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
R17P | Request for examination filed (corrected) |
Effective date: 20160104 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
17Q | First examination report despatched |
Effective date: 20160428 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20170630 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 955398 Country of ref document: AT Kind code of ref document: T Effective date: 20171215 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602013030714 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20180131 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 5 |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: GN HEARING A/S |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20171213 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180313 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 955398 Country of ref document: AT Kind code of ref document: T Effective date: 20171213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180314 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180313 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180413 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602013030714 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171227 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171227 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20171231 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171227 |
|
26N | No opposition filed |
Effective date: 20180914 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20131227 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171213 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20211221 Year of fee payment: 9 Ref country code: DK Payment date: 20211217 Year of fee payment: 9 Ref country code: FR Payment date: 20211215 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20211217 Year of fee payment: 9 |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: EBP Effective date: 20221231 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20221227 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221227 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20231218 Year of fee payment: 11 |