EP1869948B1 - Hearing aid with adaptive compressor time constants - Google Patents

Hearing aid with adaptive compressor time constants Download PDF

Info

Publication number
EP1869948B1
EP1869948B1 EP06722863.5A EP06722863A EP1869948B1 EP 1869948 B1 EP1869948 B1 EP 1869948B1 EP 06722863 A EP06722863 A EP 06722863A EP 1869948 B1 EP1869948 B1 EP 1869948B1
Authority
EP
European Patent Office
Prior art keywords
compressor
hearing aid
attack
gain
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP06722863.5A
Other languages
German (de)
French (fr)
Other versions
EP1869948A1 (en
Inventor
James Mitchell Kates
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GN Hearing AS
Original Assignee
GN Resound AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GN Resound AS filed Critical GN Resound AS
Publication of EP1869948A1 publication Critical patent/EP1869948A1/en
Application granted granted Critical
Publication of EP1869948B1 publication Critical patent/EP1869948B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/35Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using translation techniques
    • H04R25/356Amplitude, e.g. amplitude shift or compression
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03GCONTROL OF AMPLIFICATION
    • H03G7/00Volume compression or expansion in amplifiers
    • H03G7/002Volume compression or expansion in amplifiers in untuned or low-frequency amplifiers, e.g. audio amplifiers
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03GCONTROL OF AMPLIFICATION
    • H03G7/00Volume compression or expansion in amplifiers
    • H03G7/007Volume compression or expansion in amplifiers of digital or coded signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/03Aspects of the reduction of energy consumption in hearing devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/50Customised settings for obtaining desired overall acoustical characteristics
    • H04R25/505Customised settings for obtaining desired overall acoustical characteristics using digital signal processing

Definitions

  • the present invention relates to a hearing aid with a compressor with adaptive time constants whereby compression modulation distortion is reduced.
  • the input signal is multiplied by a time-varying gain.
  • the gain fluctuations introduce distortion, which may be audible for input signals such as white Gaussian noise.
  • Dynamic-range compression uses estimates of the signal level to control a time-varying multiplicative gain applied to the signal. The objective is to provide larger amounts of amplification to sounds at low intensities and reduced amplification to more-intense sounds.
  • a digital compressor typically operates on the signal in a multiplicity of frequency bands, with independent gains computed for each band. The gains are normally controlled by the output of a peak detector, and the temporal dynamics of the compressor are thus specified by the peak-detector attack and release times.
  • the compressor provides a multiplicative gain, it is a form of amplitude modulation. Compression thus creates distortion side-bands that may be audible under some listening conditions. The more rapidly the gain varies over time, the greater the magnitude of the sidebands and the greater the probability that the modulation will produce audible processing artifacts. Thus increasing the compression ratio or reducing the attack and release times will increase the amount of perceptible distortion.
  • WO 03/081947 A1 discloses a method for determining the attack and release time constants of a compressor for a hearing aid.
  • Attack and release time constants may be adjusted in response to the difference between the power spectrum of the input audiosignal and the average signal spectrum.
  • the attack and release times depend on the difference between the power spectrum for the current processing block and the smoothed peak detector output used to control the compressor. Long attack and release times are selected for small differences, and short attack and release times are selected for large differences.
  • the resultant adaptive attack and release times are simple to implement and do not affect the compressor input/output characteristic.
  • Fig. 1 is a simplified block diagram of a digital hearing aid 10.
  • the hearing aid 10 comprises an input transducer 12, preferably a microphone, an analogue-to-digital (A/D) converter 14, a signal processor 16 (e.g. a digital signal processor or DSP), a digital-to-analogue (D/A) converter 18, and an output transducer 20, preferably a receiver.
  • input transducer 12 receives acoustical sound signals and converts the signals to analogue electrical signals.
  • the analogue electrical signals are converted by A/D converter 14 into digital electrical signals that are subsequently processed by DSP 16 to form a digital output signal.
  • the digital output signal is converted by D/A converter 18 into an analogue electrical signal.
  • the analogue signal is used by output transducer 20, e.g., a receiver, to produce an audio signal that is heard by the user of the hearing aid 10.
  • Figs. 2 and 3 show parts of the signal processor 16 in more detail.
  • Figs. 1-3 are identical to Figs. 1-3 of EP 1 448 022 , however, the present illustrated compressor has adaptive attack- and release time constants in accordance with the present invention.
  • the hearing aid comprises a multi-channel compressor 22, 24, 26 with a digital input 21 for inputting a digital sound signal, and an output 27 connected to an amplifier 28 with a selectable static gain in each of its frequency channels for compensation of an individual hearing loss and connected to an output compressor 30 for limitation of the output 31 power of the hearing aid and connected to the output 29 of the amplifier 28.
  • the output compressor 30 is a single-channel output compressor 30.
  • the filter bank 22 comprises warped filters providing adjustable crossover frequencies, which are adjusted to provide the desired response in accordance with the users hearing impairment.
  • the filters are 5-tap cosine-modulated filters.
  • the warped delay unit has five outputs.
  • the vector y contains the channel signals.
  • the choice of filter coefficients is a trade-off between stop-band attenuation in the low and high frequency channels, and stop-band attenuation in the middle channel.
  • the multi-channel compressor further comprises a multi-channel power estimator 32 for calculation of the sound level or power in each of the frequency channels of the filter bank 22.
  • the calculated values are applied to the multi-channel compressor gain control unit 36 for determination of a compressor channel gain to be applied to the signal output 40 of each of the filters of the filter bank 22.
  • the compressor gains 38 are calculated and applied batch-wise for a block of samples whereby required processor power is diminished.
  • the compressor gain control unit 36 operates at a lower sample frequency than other parts of the system. This means that the compressor gains only change every N'th sample where N is the number of samples in the block. Probable artefacts caused by fast changing gain values are suppressed by three low-pass filters 34 at the gain outputs 38 of the compressor gain control unit 36 for smoothing gain changes at block boundaries.
  • the output signals 40 from the filter bank 22 are multiplied with the corresponding individual low-pass filtered gain outputs 42 of the compressor gain control unit 36, and the resulting signals 44 are added 26 to form the compressed signal 46 that is input to the amplifier 28.
  • the compressor provides attenuation only, i.e. the three compressors provide the difference between the desired gains for soft sounds and the desired gains for loud sounds.
  • the amplifier 28 provides frequency shaping that forms the desired gain for soft sounds, i.e. it compensates the frequency dependent part of the hearing impairment in question.
  • the amplifier 28 has minimum-phase FIR filters with a suitable order. Minimum-phase filters guarantee minimum group delay in the system. The filter parameters are determined when the system is fitted to a patient and does not change during operation. The design process for minimum-phase filters is well known.
  • the hearing loss compensation and the dynamic compression may take place in different frequency bands, where the term different frequency bands means different number of frequency bands and/or frequency bands with different bandwidth and/or crossover frequency.
  • B(m,k) be the input signal level measured for input block m and frequency band k
  • P(m,k) be the peak-detector output.
  • the ANSI attack time is 5 ms and the release time is 70 ms (125 ms in the lowest frequency band).
  • the adaptive time constants vary with the difference between the block signal power B(m,k) and the peak-detected power P(m,k). Let Bdb(m,k) be the block signal power converted to dB, and Pdb(m,k) be the peak detected power converted to dB.
  • the basic algorithm is then ⁇ 0 ⁇ Bdm m k - Pdb m - 1 , k Short attack time 0 ⁇ Bdm m k - Pdb m - 1 , k ⁇ ⁇ 0 Long attack time - ⁇ 1 ⁇ Bdm m k - Pdb m - 1 , k ⁇ 0 , Long release time Bdm m k - Pdb m - 1 , k ⁇ - ⁇ 1 , Short release time
  • the attack and release times for the standard and adaptive systems are shown in Fig. 4 .
  • the standard system shown by the solid line, uses an attack time of 5 ms if the band power exceeds the peak-detected power, and a release time of 70 ms if the band power is less than the peak-detected power.
  • a simple stepped adaptive time-constant system shown by the dotted line in Fig. 4 , uses one set of time constants if the band power is within 10 dB of the peak-detected power, and a different set of time constants otherwise. Thus if the band power is less than 10 dB above the peak-detected power, the attack time is 20 ms.
  • the attack time is reduced to 3 ms.
  • the release time is 200 ms, and if the band power is more than 10 dB below the peak-detected power, the release time is reduced to 70 dB.
  • An alternative to the stepped adaptive time constant is the continuously variable time constant.
  • the objective is to smoothly vary the attack and release times as the difference between the band power and the peak-detected power increases.
  • the attack time becomes proportional to the square of the ratio of the peak-detected power to the band power for differences that exceed 10 dB. If the band power exceeds the peak-detected power by less than 10 dB, a fixed attack time of 20 ms is used. If the band power is less than 10 dB below the peak-detected power, a fixed release time of 200 ms is used.
  • the compressor was used with a block size of 24 samples at a 16-kHz sampling rate, and the frequency-warping all-pass filter parameter was set to 0.5.
  • the compression parameters for the compressor are indicated in Table 1.
  • Table 1 Compression Parameter Audiometric Frequency, Hz 250 500 1000 2000 4000 6000 ANSI Attack Time, ms 5 5 5 5 5 5 ANSI Release Time. ms 125 70 70 70 70 70 Compression Ratio 2:1 2:1 2:1 2:1 2:1 2:1 2:1 2:1 Lower Knee, dB SPL 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 Upper Knee, dB SPL 100 100 100 100 100 100 100 100 100 100 Gain, Input at 50 dB SPL 0 0 10 15 30 30 30
  • Inputs below the lower knee receive linear gain, and inputs above the upper knee receive infinite compression (amplitude limiting).
  • the gain as a function of frequency corresponds to settings for a high-frequency hearing loss, and represents conditions for which the modulation distortion is most audible to a listener with normal hearing.
  • the adaptive attack- and release-time systems replaced the fixed attack and release times with the stepped or continuously variable times shown in Fig. 4 , and kept the remaining compression parameters unchanged from the standard system.
  • the input signals were adjusted to have a level of 70 dB SPL, so the compression was engaged for the entire signal.
  • the compressor modulation distortion is most audible for a white noise input signal.
  • the compression gains for the frequency band centered at 2840 Hz are plotted in Fig. 5 for a 1-sec segment of the noise signal.
  • the gain for the standard compressor using fixed attack and release times is shown by the bottom curve.
  • the gain ranges from 13.7 to 16.4 dB, a spread of 2.7 dB.
  • the offset curves for the adaptive attack and release times are plotted above the curve for the standard compressor.
  • the gain for the stepped attack and release time system ranges from 14.4 to 16.2 dB, a spread of 1.8 dB, and the gain for the continuously variable attack and release time system ranges from 14.3 to 15.9 dB, a spread of 1.6 dB.
  • the gain curves for the adaptive systems are much smoother than the curve for the standard system.
  • the adaptive systems provide much less modulation of the noise than the standard syllabic compressor.
  • the compressor modulation distortion is less audible for speech inputs.
  • the speech signal used for illustration is a 5-second segment of the "Rainbow Passage” spoken by a male talker. [The complete “Rainbow Passage” can be found on page 127 of the 2nd edition of Grant Fairbanks' Voice and Articulation Drillbook (1960, pp. 124-139, New York: Harper & Row )].
  • the envelope of the speech is plotted in Fig. 6 , where the syllabic energy variations are readily apparent.
  • the gains for the different compression systems for this segment of speech are plotted in Fig. 7 .
  • the gain for the standard compressor is shown by the dash and dot curve that for the stepped adaptive system by the dotted curve, and the gain for the variable adaptive system by the solid curve.
  • the longer time constants used in the adaptive compression systems for small variations in the signal level have only a small impact on the syllabic compression gains.
  • the gains for the stepped system are nearly identical to those for the standard compressor.
  • the longer release times of the continuously-variable system lead to somewhat slower increases in gain when the signal level drops.
  • the system with linear gain is the reference for the white noise input; we perceive white noise as a smooth continuous signal despite its envelope fluctuations, and that perception is preserved even with the high-frequency amplification provided for the simulated hearing loss.
  • the modulation distortion for the standard compressor is audible as a subtle granularity superimposed on the smooth noise envelope. The granularity is much harder to hear for the adaptive systems. The modulation distortion is much harder to hear for the speech segment, and all three compression systems have a very similar sound quality.
  • Fig. 4 shows plots of ANSI attack and release times as a function of the difference in dB between the instantaneous band levels and the peak detector output.
  • the solid line indicates the time constants of the known compressor, the dotted line indicates the stepped adaptive time constants, and the dashed line indicates the variable adaptive time constants.
  • Fig. 5 shows plots of compressor gain as a function of time over 1 ms for white Gaussian noise and a simulated high-frequency hearing loss.
  • the compression ratio is 2:1 and the gains are for the frequency band centered at 2840 Hz.
  • the curve for the stepped adaptive time constants is offset by 2 dB, and the curve for the variable adaptive time constants is offset by 4 dB.
  • Fig. 6 shows a plot of peak-detected envelope for five seconds of a speech signal.
  • the speech is the "Rainbow Passage" spoken by a male talker.
  • Fig. 7 shows compressor gain as a function of time for 5 ms for the "Rainbow Passage" and a simulated high-frequency hearing loss.
  • the compression ratio is 2:1 and the gains are for the frequency band centered at 2840 Hz.
  • the curve for the stepped adaptive time constants is indicated by the dash and dot line, the curve for the stepped adaptive time constants is indicated by the dotted line, and the curve for the variable adaptive time constants is indicated by the solid line.
  • a syllabic compressor with its fast attack and release times, can introduce audible modulation distortion for white Gaussian noise and other signals that have randomly fluctuating but statistically stationary envelopes.
  • the envelope fluctuations for Gaussian noise generally fall within a range of +10 to -10 dB from the average level. Longer attack and release times for signal envelope fluctuations that fall within this ⁇ 10 dB range reduce the audible modulation distortion introduced by the dynamic-range compression.
  • the syllabic envelope fluctuations for speech in quiet are greater than the ⁇ 10 dB range observed for noise. Shorter attack and release times for envelope fluctuations that are greater than ⁇ 10 dB from the average level therefore allow the compressor to accurately track the speech.
  • the compressor using stepped adaptive attack and release times greatly reduces the modulation distortion for noise signals while preserving the syllabic compression behavior for speech.
  • the continuously variable attack and release times give similar behavior to the stepped system, but are more complex computationally.
  • the stepped adaptive attack and release times thus give a simple and effective solution to the problem of compressor modulation distortion without sacrificing the ability of the system to limit the output to sudden increases in sound level.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Tone Control, Compression And Expansion, Limiting Amplitude (AREA)

Description

    FIELD OF THE INVENTION
  • The present invention relates to a hearing aid with a compressor with adaptive time constants whereby compression modulation distortion is reduced.
  • BACKGROUND OF THE INVENTION
  • In dynamic-range compression, the input signal is multiplied by a time-varying gain. The gain fluctuations introduce distortion, which may be audible for input signals such as white Gaussian noise.
  • Dynamic-range compression uses estimates of the signal level to control a time-varying multiplicative gain applied to the signal. The objective is to provide larger amounts of amplification to sounds at low intensities and reduced amplification to more-intense sounds. A digital compressor typically operates on the signal in a multiplicity of frequency bands, with independent gains computed for each band. The gains are normally controlled by the output of a peak detector, and the temporal dynamics of the compressor are thus specified by the peak-detector attack and release times.
  • Because the compressor provides a multiplicative gain, it is a form of amplitude modulation. Compression thus creates distortion side-bands that may be audible under some listening conditions. The more rapidly the gain varies over time, the greater the magnitude of the sidebands and the greater the probability that the modulation will produce audible processing artifacts. Thus increasing the compression ratio or reducing the attack and release times will increase the amount of perceptible distortion.
  • An additional concern in a system using block processing is that the compressor gain changes do not occur smoothly over time but rather jump in value at the processing block boundaries. Thus there is a discontinuity in the gain values that occurs at a periodic rate related to the processing block size. For a block of 24 samples at a 16-kHz sampling rate, there will be a basic periodicity at 667 Hz that will also generate distortion. Smoothing the gain over the duration of the processing block can remove the discontinuities, but is impractical in a digital hearing aid. Low-pass filtering the gain values can also reduce the discontinuities, but at the expense of increasing the compression overshoot and reducing the ability of the hearing aid to quickly respond to sudden increases in the input sound level.
  • There have recently been reports of audible compression modulation distortion in known compressors, and simulations have demonstrated audible modulation distortion. These compression systems use ANSI attack times of 5 ms and ANSI release times of 70 ms (125 ms in the lowest frequency band). Longer attack and release times would reduce the amount of audible distortion, but would increase the compression overshoot. There is thus a need for a compression algorithm that reduces the audible modulation noise while preserving the ability to quickly reduce the gain for sudden increases in the input signal level.
  • An example of a hearing aid with a compressor is disclosed in EP 1 448 022 .
  • WO 03/081947 A1 discloses a method for determining the attack and release time constants of a compressor for a hearing aid.
  • SUMMARY OF THE INVENTION
  • It is an object of the present invention to provide a hearing aid wherein compression modulation distortion is reduced without noticeably affecting the syllabic compressor behavior for speech.
  • According to the present invention, the above-mentioned and other objects are fulfilled by a hearing aid according to claim 1.
  • In one example, increases in the input signal level above the average signal level lead to decreased attack and release time constants.
  • Attack and release time constants may be adjusted in response to the difference between the power spectrum of the input audiosignal and the average signal spectrum.
  • In a preferred embodiment of the invention, the attack and release times depend on the difference between the power spectrum for the current processing block and the smoothed peak detector output used to control the compressor. Long attack and release times are selected for small differences, and short attack and release times are selected for large differences. The resultant adaptive attack and release times are simple to implement and do not affect the compressor input/output characteristic.
  • It is an advantage of the present invention that known compression input/output rules currently being used in known hearing aids may still be used with the sole modification that the attack and release time constants are adapted in response to the input signal behavior. Small signal fluctuations would cause the system to use long time constants, thus reducing the gain fluctuations and the resultant modulation distortion. Large increases in the signal level from one block to the next, however, would force the system to use short time constants, thus guaranteeing a fast reaction and the desired rapid reduction in system gain.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Below, the invention will be further described and illustrated with reference to the accompanying drawings in which:
  • Fig. 1
    is a general block diagram of a hearing aid,
    Fig. 2
    is a block diagram of one embodiment of the present invention, and
    Fig. 3
    is a more detailed block diagram of the embodiment shown in Fig. 2.
    Fig. 4
    shows a plot of ANSI attack and release times as a function of the difference in dB between the instantaneous band levels and the peak detector output,
    Fig. 5
    shows plots of compressor gain as a function of time over 1 ms for white Gaussian noise and a simulated high-frequency hearing loss,
    Fig. 6
    shows a plot of peak-detected envelope for five seconds of a speech signal, and
    Fig. 7
    shows plots of compressor gain as a function of time for 5 ms for the "Rainbow Passage" and a simulated high-frequency hearing loss.
    DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
  • Fig. 1 is a simplified block diagram of a digital hearing aid 10. The hearing aid 10 comprises an input transducer 12, preferably a microphone, an analogue-to-digital (A/D) converter 14, a signal processor 16 (e.g. a digital signal processor or DSP), a digital-to-analogue (D/A) converter 18, and an output transducer 20, preferably a receiver. In operation, input transducer 12 receives acoustical sound signals and converts the signals to analogue electrical signals. The analogue electrical signals are converted by A/D converter 14 into digital electrical signals that are subsequently processed by DSP 16 to form a digital output signal. The digital output signal is converted by D/A converter 18 into an analogue electrical signal. The analogue signal is used by output transducer 20, e.g., a receiver, to produce an audio signal that is heard by the user of the hearing aid 10.
  • Figs. 2 and 3 show parts of the signal processor 16 in more detail. Figs. 1-3 are identical to Figs. 1-3 of EP 1 448 022 , however, the present illustrated compressor has adaptive attack- and release time constants in accordance with the present invention. In the embodiment illustrated in Fig. 2 and more detailed in Fig. 3, the hearing aid comprises a multi-channel compressor 22, 24, 26 with a digital input 21 for inputting a digital sound signal, and an output 27 connected to an amplifier 28 with a selectable static gain in each of its frequency channels for compensation of an individual hearing loss and connected to an output compressor 30 for limitation of the output 31 power of the hearing aid and connected to the output 29 of the amplifier 28.
  • In the illustrated embodiment, the output compressor 30 is a single-channel output compressor 30.
  • As illustrated in Fig. 3, the filter bank 22 comprises warped filters providing adjustable crossover frequencies, which are adjusted to provide the desired response in accordance with the users hearing impairment. The filters are 5-tap cosine-modulated filters.
  • Normally FIR filters work on a tapped delay line with one sample delay between the taps. By replacing the delays with first order all-pass filters, frequency warping is achieved enabling adjustment of crossover frequencies. The warped delay unit has five outputs. The five outputs constitutes a vector w=[W0 W1 W2 W3 W4] T at a given point in time, which is led into the filter bank where the three channel output y, is formed. The filter bank is defined by: B = b 0 b 1 b 2 b 1 b 0 - 2 b 0 0 2 b 2 0 - 2 b 0 b 0 - b 1 b 2 - b 1 b 0
    Figure imgb0001
  • The output of the filter bank y is: y = Bw
    Figure imgb0002
  • The vector y contains the channel signals.
  • The choice of filter coefficients is a trade-off between stop-band attenuation in the low and high frequency channels, and stop-band attenuation in the middle channel. The higher attenuation in the low and high frequency channels, the lower attenuation in the middle channel.
  • The multi-channel compressor further comprises a multi-channel power estimator 32 for calculation of the sound level or power in each of the frequency channels of the filter bank 22. The calculated values are applied to the multi-channel compressor gain control unit 36 for determination of a compressor channel gain to be applied to the signal output 40 of each of the filters of the filter bank 22.
  • The compressor gains 38 are calculated and applied batch-wise for a block of samples whereby required processor power is diminished. When the compressor operates on blocks of signal samples, the compressor gain control unit 36 operates at a lower sample frequency than other parts of the system. This means that the compressor gains only change every N'th sample where N is the number of samples in the block. Probable artefacts caused by fast changing gain values are suppressed by three low-pass filters 34 at the gain outputs 38 of the compressor gain control unit 36 for smoothing gain changes at block boundaries.
  • The output signals 40 from the filter bank 22 are multiplied with the corresponding individual low-pass filtered gain outputs 42 of the compressor gain control unit 36, and the resulting signals 44 are added 26 to form the compressed signal 46 that is input to the amplifier 28. The compressor provides attenuation only, i.e. the three compressors provide the difference between the desired gains for soft sounds and the desired gains for loud sounds.
  • The amplifier 28 provides frequency shaping that forms the desired gain for soft sounds, i.e. it compensates the frequency dependent part of the hearing impairment in question. The amplifier 28 has minimum-phase FIR filters with a suitable order. Minimum-phase filters guarantee minimum group delay in the system. The filter parameters are determined when the system is fitted to a patient and does not change during operation. The design process for minimum-phase filters is well known.
  • The hearing loss compensation and the dynamic compression may take place in different frequency bands, where the term different frequency bands means different number of frequency bands and/or frequency bands with different bandwidth and/or crossover frequency.
  • Let B(m,k) be the input signal level measured for input block m and frequency band k, and let P(m,k) be the peak-detector output. The general algorithm for the peak detector is to use a fast attack time and a slower release time, giving If B m k > P m k , P m k = α k P m - 1 , k + 1 - α k B m k Else P m k = β k P m - 1 , k + 1 - β k B m k
    Figure imgb0003
    where β(k) > α(k), and α(k) < 1 and β(k) < 1.
  • For syllabic compression, the ANSI attack time is 5 ms and the release time is 70 ms (125 ms in the lowest frequency band).
  • The adaptive time constants vary with the difference between the block signal power B(m,k) and the peak-detected power P(m,k). Let Bdb(m,k) be the block signal power converted to dB, and Pdb(m,k) be the peak detected power converted to dB. The basic algorithm is then θ 0 < Bdm m k - Pdb m - 1 , k Short attack time 0 < Bdm m k - Pdb m - 1 , k θ 0 Long attack time - θ 1 < Bdm m k - Pdb m - 1 , k 0 , Long release time Bdm m k - Pdb m - 1 , k - θ 1 , Short release time
    Figure imgb0004
  • It has been found empirically that setting both the attack-time threshold θ0 and the release-time threshold θ1 to 10 dB yields good sound quality.
  • The attack and release times for the standard and adaptive systems are shown in Fig. 4. The standard system, shown by the solid line, uses an attack time of 5 ms if the band power exceeds the peak-detected power, and a release time of 70 ms if the band power is less than the peak-detected power. A simple stepped adaptive time-constant system, shown by the dotted line in Fig. 4, uses one set of time constants if the band power is within 10 dB of the peak-detected power, and a different set of time constants otherwise. Thus if the band power is less than 10 dB above the peak-detected power, the attack time is 20 ms. If the band power exceeds the peak-detected power by more than 10 dB, the attack time is reduced to 3 ms. Similarly, if the band power is less than 10 dB below the peak-detected power, the release time is 200 ms, and if the band power is more than 10 dB below the peak-detected power, the release time is reduced to 70 dB. These attack and release times can of course be modified given additional listening tests and subject evaluations.
  • An alternative to the stepped adaptive time constant is the continuously variable time constant. The objective is to smoothly vary the attack and release times as the difference between the band power and the peak-detected power increases. In the variable system, shown in Fig. 4 by the dashed line, the attack time becomes proportional to the square of the ratio of the peak-detected power to the band power for differences that exceed 10 dB. If the band power exceeds the peak-detected power by less than 10 dB, a fixed attack time of 20 ms is used. If the band power is less than 10 dB below the peak-detected power, a fixed release time of 200 ms is used.
  • SIMULATION RESULTS
  • The compressor was used with a block size of 24 samples at a 16-kHz sampling rate, and the frequency-warping all-pass filter parameter was set to 0.5. The compression parameters for the compressor are indicated in Table 1. Table 1
    Compression Parameter Audiometric Frequency, Hz
    250 500 1000 2000 4000 6000
    ANSI Attack Time, ms 5 5 5 5 5 5
    ANSI Release Time. ms 125 70 70 70 70 70
    Compression Ratio 2:1 2:1 2:1 2:1 2:1 2:1
    Lower Knee, dB SPL 45 45 45 45 45 45
    Upper Knee, dB SPL 100 100 100 100 100 100
    Gain, Input at 50 dB SPL 0 0 10 15 30 30
  • Inputs below the lower knee receive linear gain, and inputs above the upper knee receive infinite compression (amplitude limiting). The gain as a function of frequency corresponds to settings for a high-frequency hearing loss, and represents conditions for which the modulation distortion is most audible to a listener with normal hearing. The adaptive attack- and release-time systems replaced the fixed attack and release times with the stepped or continuously variable times shown in Fig. 4, and kept the remaining compression parameters unchanged from the standard system. The input signals were adjusted to have a level of 70 dB SPL, so the compression was engaged for the entire signal.
  • The compressor modulation distortion is most audible for a white noise input signal. The compression gains for the frequency band centered at 2840 Hz are plotted in Fig. 5 for a 1-sec segment of the noise signal. The gain for the standard compressor using fixed attack and release times is shown by the bottom curve. The gain ranges from 13.7 to 16.4 dB, a spread of 2.7 dB. The offset curves for the adaptive attack and release times are plotted above the curve for the standard compressor. The gain for the stepped attack and release time system ranges from 14.4 to 16.2 dB, a spread of 1.8 dB, and the gain for the continuously variable attack and release time system ranges from 14.3 to 15.9 dB, a spread of 1.6 dB. In addition, the gain curves for the adaptive systems are much smoother than the curve for the standard system. Thus the adaptive systems provide much less modulation of the noise than the standard syllabic compressor.
  • The compressor modulation distortion is less audible for speech inputs. The speech signal used for illustration is a 5-second segment of the "Rainbow Passage" spoken by a male talker. [The complete "Rainbow Passage" can be found on page 127 of the 2nd edition of Grant Fairbanks' Voice and Articulation Drillbook (1960, pp. 124-139, New York: Harper & Row)]. The envelope of the speech is plotted in Fig. 6, where the syllabic energy variations are readily apparent. The gains for the different compression systems for this segment of speech are plotted in Fig. 7. The gain for the standard compressor is shown by the dash and dot curve that for the stepped adaptive system by the dotted curve, and the gain for the variable adaptive system by the solid curve. The longer time constants used in the adaptive compression systems for small variations in the signal level have only a small impact on the syllabic compression gains. The gains for the stepped system are nearly identical to those for the standard compressor. The longer release times of the continuously-variable system lead to somewhat slower increases in gain when the signal level drops.
  • The system with linear gain is the reference for the white noise input; we perceive white noise as a smooth continuous signal despite its envelope fluctuations, and that perception is preserved even with the high-frequency amplification provided for the simulated hearing loss. The modulation distortion for the standard compressor is audible as a subtle granularity superimposed on the smooth noise envelope. The granularity is much harder to hear for the adaptive systems. The modulation distortion is much harder to hear for the speech segment, and all three compression systems have a very similar sound quality.
  • Fig. 4 shows plots of ANSI attack and release times as a function of the difference in dB between the instantaneous band levels and the peak detector output. The solid line indicates the time constants of the known compressor, the dotted line indicates the stepped adaptive time constants, and the dashed line indicates the variable adaptive time constants.
  • Fig. 5 shows plots of compressor gain as a function of time over 1 ms for white Gaussian noise and a simulated high-frequency hearing loss. The compression ratio is 2:1 and the gains are for the frequency band centered at 2840 Hz. The curve for the stepped adaptive time constants is offset by 2 dB, and the curve for the variable adaptive time constants is offset by 4 dB.
  • Fig. 6 shows a plot of peak-detected envelope for five seconds of a speech signal. The speech is the "Rainbow Passage" spoken by a male talker.
  • Fig. 7 shows compressor gain as a function of time for 5 ms for the "Rainbow Passage" and a simulated high-frequency hearing loss. The compression ratio is 2:1 and the gains are for the frequency band centered at 2840 Hz. The curve for the stepped adaptive time constants is indicated by the dash and dot line, the curve for the stepped adaptive time constants is indicated by the dotted line, and the curve for the variable adaptive time constants is indicated by the solid line.
  • A syllabic compressor, with its fast attack and release times, can introduce audible modulation distortion for white Gaussian noise and other signals that have randomly fluctuating but statistically stationary envelopes. The envelope fluctuations for Gaussian noise generally fall within a range of +10 to -10 dB from the average level. Longer attack and release times for signal envelope fluctuations that fall within this ±10 dB range reduce the audible modulation distortion introduced by the dynamic-range compression. However, the syllabic envelope fluctuations for speech in quiet are greater than the ±10 dB range observed for noise. Shorter attack and release times for envelope fluctuations that are greater than ±10 dB from the average level therefore allow the compressor to accurately track the speech.
  • The compressor using stepped adaptive attack and release times greatly reduces the modulation distortion for noise signals while preserving the syllabic compression behavior for speech. The continuously variable attack and release times give similar behavior to the stepped system, but are more complex computationally. The stepped adaptive attack and release times thus give a simple and effective solution to the problem of compressor modulation distortion without sacrificing the ability of the system to limit the output to sudden increases in sound level.

Claims (8)

  1. A hearing aid (10) comprising
    a microphone (12) for conversion of sound into an input audiosignal,
    a signal processor (16) for processing the input audiosignal, the signal processor (16) including a compressor (24).
    a receiver (20) for conversion of the processed signal into sound,
    characterized in that the compressor (24) is adapted to vary the attack time constant as a function of the difference between instantaneous band power and peak detected power and to vary the release time constant as a function of the difference between instantaneous band power and peak detected power.
  2. A hearing aid (10) according to claim 1, wherein the attack time constant is different from the release time constant.
  3. A hearing aid (10) according to any of the previous claims, wherein the compressor (24) is adapted to operate on blocks of samples.
  4. A hearing aid (10) according to claim 3, further comprising low-pass filters (34) at the gain outputs (38) of the compressor (24) for smoothing gain changes at block boundaries.
  5. A hearing aid (10) according to claim 3 or 4, wherein the attack and release time constants depend on the difference between instantaneous band power and a smoothed peak detected power.
  6. A hearing aid (10) according to any of the previous claims, wherein the attack time constant and the release time constant vary as a step function.
  7. A hearing aid (10) according to any of the previous claims, wherein the attack and release time constants are varied in such a way that they are kept constant for signal variations below a certain level.
  8. A hearing aid (10) according to any of the previous claims, further comprising warped filters (22).
EP06722863.5A 2005-03-29 2006-03-26 Hearing aid with adaptive compressor time constants Active EP1869948B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US66608805P 2005-03-29 2005-03-29
PCT/DK2006/000168 WO2006102892A1 (en) 2005-03-29 2006-03-26 Hearing aid with adaptive compressor time constants

Publications (2)

Publication Number Publication Date
EP1869948A1 EP1869948A1 (en) 2007-12-26
EP1869948B1 true EP1869948B1 (en) 2016-02-17

Family

ID=36650826

Family Applications (1)

Application Number Title Priority Date Filing Date
EP06722863.5A Active EP1869948B1 (en) 2005-03-29 2006-03-26 Hearing aid with adaptive compressor time constants

Country Status (4)

Country Link
US (1) US8019105B2 (en)
EP (1) EP1869948B1 (en)
DK (1) DK1869948T3 (en)
WO (1) WO2006102892A1 (en)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2413357C2 (en) * 2006-10-20 2011-02-27 Долби Лэборетериз Лайсенсинг Корпорейшн Processing dynamic properties of audio using retuning
EP2009786B1 (en) 2007-06-25 2015-02-25 Harman Becker Automotive Systems GmbH Feedback limiter with adaptive control of time constants
GB2455742B (en) * 2007-12-19 2011-11-02 Wolfson Microelectronics Plc Dynamic range controller
DE102008019374A1 (en) * 2008-04-17 2009-10-22 Siemens Medical Instruments Pte. Ltd. Method for determining a time constant of the hearing and method for adjusting a hearing device
DK2335427T3 (en) * 2008-09-10 2012-06-18 Widex As Method of sound processing in a hearing aid and a hearing aid
US20100318353A1 (en) * 2009-06-16 2010-12-16 Bizjak Karl M Compressor augmented array processing
US8842852B1 (en) 2011-07-28 2014-09-23 James K. Waller, Jr. Audio dynamics processing control system with exponential release response
DK2752031T3 (en) * 2011-09-01 2015-07-27 Widex As HEARING WITH ADAPTIVE NOISE REDUCTION AND PROCEDURE
WO2013061252A2 (en) 2011-10-24 2013-05-02 Cochlear Limited Post-filter common-gain determination
DK2658120T3 (en) 2012-04-25 2016-05-30 Gn Resound As A hearing aid with improved compression
US8913768B2 (en) 2012-04-25 2014-12-16 Gn Resound A/S Hearing aid with improved compression
US9070371B2 (en) * 2012-10-22 2015-06-30 Ittiam Systems (P) Ltd. Method and system for peak limiting of speech signals for delay sensitive voice communication
WO2015111084A2 (en) * 2014-01-27 2015-07-30 Indian Institute Of Technology Bombay Dynamic range compression with low distortion for use in hearing aids and audio systems
DE102014218672B3 (en) * 2014-09-17 2016-03-10 Sivantos Pte. Ltd. Method and apparatus for feedback suppression
WO2016155853A1 (en) * 2015-04-02 2016-10-06 Harman Becker Automotive Systems Gmbh Multii-band signal compressing
EP3358745B2 (en) 2017-02-02 2023-01-04 Oticon A/s An adaptive level estimator, a hearing device, a method and a binaural hearing system
US10951994B2 (en) 2018-04-04 2021-03-16 Staton Techiya, Llc Method to acquire preferred dynamic range function for speech enhancement
US11011180B2 (en) * 2018-06-29 2021-05-18 Guoguang Electric Company Limited Audio signal dynamic range compression
US10755722B2 (en) * 2018-08-29 2020-08-25 Guoguang Electric Company Limited Multiband audio signal dynamic range compression with overshoot suppression
JPWO2020217605A1 (en) * 2019-04-23 2020-10-29
CN113259825B (en) * 2021-06-03 2021-10-08 南京天悦电子科技有限公司 Low-complexity amplitude-frequency response later-period correction method for digital hearing aid

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4718099A (en) * 1986-01-29 1988-01-05 Telex Communications, Inc. Automatic gain control for hearing aid
JP3295443B2 (en) * 1991-10-09 2002-06-24 パイオニア株式会社 Signal processing circuit in audio equipment
US5444788A (en) * 1993-09-03 1995-08-22 Akg Acoustics, Inc. Audio compressor combining feedback and feedfoward sidechain processing
US5402498A (en) * 1993-10-04 1995-03-28 Waller, Jr.; James K. Automatic intelligent audio-tracking response circuit
US5771299A (en) * 1996-06-20 1998-06-23 Audiologic, Inc. Spectral transposition of a digital audio signal
US6240192B1 (en) * 1997-04-16 2001-05-29 Dspfactory Ltd. Apparatus for and method of filtering in an digital hearing aid, including an application specific integrated circuit and a programmable digital signal processor
US6628795B1 (en) * 1997-12-23 2003-09-30 Widex A/S Dynamic automatic gain control in a hearing aid
US6757396B1 (en) * 1998-11-16 2004-06-29 Texas Instruments Incorporated Digital audio dynamic range compressor and method
US6778966B2 (en) * 1999-11-29 2004-08-17 Syfx Segmented mapping converter system and method
US7333623B2 (en) * 2002-03-26 2008-02-19 Oticon A/S Method for dynamic determination of time constants, method for level detection, method for compressing an electric audio signal and hearing aid, wherein the method for compression is used
JP4402977B2 (en) 2003-02-14 2010-01-20 ジーエヌ リザウンド エー/エス Dynamic compression in hearing aids

Also Published As

Publication number Publication date
WO2006102892A1 (en) 2006-10-05
DK1869948T3 (en) 2016-05-02
US8019105B2 (en) 2011-09-13
EP1869948A1 (en) 2007-12-26
US20060233408A1 (en) 2006-10-19

Similar Documents

Publication Publication Date Title
EP1869948B1 (en) Hearing aid with adaptive compressor time constants
US5027410A (en) Adaptive, programmable signal processing and filtering for hearing aids
Stone et al. Comparison of different forms of compression using wearable digital hearing aids
EP1236377B1 (en) Hearing aid device incorporating signal processing techniques
US7978868B2 (en) Adaptive dynamic range optimization sound processor
US4852175A (en) Hearing aid signal-processing system
US5500902A (en) Hearing aid device incorporating signal processing techniques
AU2008361614B2 (en) Method for sound processing in a hearing aid and a hearing aid
US6104822A (en) Digital signal processing hearing aid
JP4402977B2 (en) Dynamic compression in hearing aids
EP1121834B1 (en) Hearing aids based on models of cochlear compression
US10375484B2 (en) Hearing aid having level and frequency-dependent gain
JP2002536930A (en) Adaptive dynamic range optimizing sound processor
US9319805B2 (en) Noise reduction in auditory prostheses
WO2000065872A1 (en) Loudness normalization control for a digital hearing aid
Bustamante et al. Multiband compression limiting for hearing-impaired listeners
Moore et al. Use of a loudness model for hearing aid fitting: II. Hearing aids with multi-channel compression
Li et al. Wavelet-based nonlinear AGC method for hearing aid loudness compensation
EP2658120B1 (en) A hearing aid with improved compression
WO2010000042A1 (en) Linear gain amplification for mid-to-high intensity sounds in a compressive sound processor
JPH11225398A (en) Loudness adjusting method and hearing aid
Levitt Compression amplification
AU2005203487B2 (en) Hearing aid device incorporating signal processing techniques
Hohmann et al. University of Oldenburg, Fachbereich 8/Physik, D–26111 Oldenburg, Germany

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20071029

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

DAX Request for extension of the european patent (deleted)
RIC1 Information provided on ipc code assigned before grant

Ipc: H04R 25/00 20060101AFI20150619BHEP

Ipc: H03G 3/32 20060101ALI20150619BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150806

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 776114

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160315

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602006047944

Country of ref document: DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20160425

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160217

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 776114

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160617

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160331

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602006047944

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

26N No opposition filed

Effective date: 20161118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160326

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160517

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 13

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20060326

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160217

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160326

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20220321

Year of fee payment: 17

Ref country code: DK

Payment date: 20220318

Year of fee payment: 17

Ref country code: CH

Payment date: 20220310

Year of fee payment: 17

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20220317

Year of fee payment: 17

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230524

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20230331

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20230326

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230326

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230326

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240319

Year of fee payment: 19