EP1869948B1 - Hearing aid with adaptive compressor time constants - Google Patents
Hearing aid with adaptive compressor time constants Download PDFInfo
- Publication number
- EP1869948B1 EP1869948B1 EP06722863.5A EP06722863A EP1869948B1 EP 1869948 B1 EP1869948 B1 EP 1869948B1 EP 06722863 A EP06722863 A EP 06722863A EP 1869948 B1 EP1869948 B1 EP 1869948B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- compressor
- hearing aid
- attack
- gain
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003044 adaptive effect Effects 0.000 title description 25
- 230000006870 function Effects 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 7
- 230000005236 sound signal Effects 0.000 claims description 6
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000009499 grossing Methods 0.000 claims description 3
- 230000006835 compression Effects 0.000 description 29
- 238000007906 compression Methods 0.000 description 29
- 208000000258 High-Frequency Hearing Loss Diseases 0.000 description 5
- 208000009966 Sensorineural Hearing Loss Diseases 0.000 description 5
- 208000016354 hearing loss disease Diseases 0.000 description 5
- 231100000885 high-frequency hearing loss Toxicity 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 210000003127 knee Anatomy 0.000 description 4
- 206010011878 Deafness Diseases 0.000 description 3
- 230000003321 amplification Effects 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 3
- 231100000888 hearing loss Toxicity 0.000 description 3
- 230000010370 hearing loss Effects 0.000 description 3
- 238000003199 nucleic acid amplification method Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000012938 design process Methods 0.000 description 1
- 230000003292 diminished effect Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/35—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using translation techniques
- H04R25/356—Amplitude, e.g. amplitude shift or compression
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03G—CONTROL OF AMPLIFICATION
- H03G7/00—Volume compression or expansion in amplifiers
- H03G7/002—Volume compression or expansion in amplifiers in untuned or low-frequency amplifiers, e.g. audio amplifiers
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03G—CONTROL OF AMPLIFICATION
- H03G7/00—Volume compression or expansion in amplifiers
- H03G7/007—Volume compression or expansion in amplifiers of digital or coded signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
- H04R2460/03—Aspects of the reduction of energy consumption in hearing devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/50—Customised settings for obtaining desired overall acoustical characteristics
- H04R25/505—Customised settings for obtaining desired overall acoustical characteristics using digital signal processing
Definitions
- the present invention relates to a hearing aid with a compressor with adaptive time constants whereby compression modulation distortion is reduced.
- the input signal is multiplied by a time-varying gain.
- the gain fluctuations introduce distortion, which may be audible for input signals such as white Gaussian noise.
- Dynamic-range compression uses estimates of the signal level to control a time-varying multiplicative gain applied to the signal. The objective is to provide larger amounts of amplification to sounds at low intensities and reduced amplification to more-intense sounds.
- a digital compressor typically operates on the signal in a multiplicity of frequency bands, with independent gains computed for each band. The gains are normally controlled by the output of a peak detector, and the temporal dynamics of the compressor are thus specified by the peak-detector attack and release times.
- the compressor provides a multiplicative gain, it is a form of amplitude modulation. Compression thus creates distortion side-bands that may be audible under some listening conditions. The more rapidly the gain varies over time, the greater the magnitude of the sidebands and the greater the probability that the modulation will produce audible processing artifacts. Thus increasing the compression ratio or reducing the attack and release times will increase the amount of perceptible distortion.
- WO 03/081947 A1 discloses a method for determining the attack and release time constants of a compressor for a hearing aid.
- Attack and release time constants may be adjusted in response to the difference between the power spectrum of the input audiosignal and the average signal spectrum.
- the attack and release times depend on the difference between the power spectrum for the current processing block and the smoothed peak detector output used to control the compressor. Long attack and release times are selected for small differences, and short attack and release times are selected for large differences.
- the resultant adaptive attack and release times are simple to implement and do not affect the compressor input/output characteristic.
- Fig. 1 is a simplified block diagram of a digital hearing aid 10.
- the hearing aid 10 comprises an input transducer 12, preferably a microphone, an analogue-to-digital (A/D) converter 14, a signal processor 16 (e.g. a digital signal processor or DSP), a digital-to-analogue (D/A) converter 18, and an output transducer 20, preferably a receiver.
- input transducer 12 receives acoustical sound signals and converts the signals to analogue electrical signals.
- the analogue electrical signals are converted by A/D converter 14 into digital electrical signals that are subsequently processed by DSP 16 to form a digital output signal.
- the digital output signal is converted by D/A converter 18 into an analogue electrical signal.
- the analogue signal is used by output transducer 20, e.g., a receiver, to produce an audio signal that is heard by the user of the hearing aid 10.
- Figs. 2 and 3 show parts of the signal processor 16 in more detail.
- Figs. 1-3 are identical to Figs. 1-3 of EP 1 448 022 , however, the present illustrated compressor has adaptive attack- and release time constants in accordance with the present invention.
- the hearing aid comprises a multi-channel compressor 22, 24, 26 with a digital input 21 for inputting a digital sound signal, and an output 27 connected to an amplifier 28 with a selectable static gain in each of its frequency channels for compensation of an individual hearing loss and connected to an output compressor 30 for limitation of the output 31 power of the hearing aid and connected to the output 29 of the amplifier 28.
- the output compressor 30 is a single-channel output compressor 30.
- the filter bank 22 comprises warped filters providing adjustable crossover frequencies, which are adjusted to provide the desired response in accordance with the users hearing impairment.
- the filters are 5-tap cosine-modulated filters.
- the warped delay unit has five outputs.
- the vector y contains the channel signals.
- the choice of filter coefficients is a trade-off between stop-band attenuation in the low and high frequency channels, and stop-band attenuation in the middle channel.
- the multi-channel compressor further comprises a multi-channel power estimator 32 for calculation of the sound level or power in each of the frequency channels of the filter bank 22.
- the calculated values are applied to the multi-channel compressor gain control unit 36 for determination of a compressor channel gain to be applied to the signal output 40 of each of the filters of the filter bank 22.
- the compressor gains 38 are calculated and applied batch-wise for a block of samples whereby required processor power is diminished.
- the compressor gain control unit 36 operates at a lower sample frequency than other parts of the system. This means that the compressor gains only change every N'th sample where N is the number of samples in the block. Probable artefacts caused by fast changing gain values are suppressed by three low-pass filters 34 at the gain outputs 38 of the compressor gain control unit 36 for smoothing gain changes at block boundaries.
- the output signals 40 from the filter bank 22 are multiplied with the corresponding individual low-pass filtered gain outputs 42 of the compressor gain control unit 36, and the resulting signals 44 are added 26 to form the compressed signal 46 that is input to the amplifier 28.
- the compressor provides attenuation only, i.e. the three compressors provide the difference between the desired gains for soft sounds and the desired gains for loud sounds.
- the amplifier 28 provides frequency shaping that forms the desired gain for soft sounds, i.e. it compensates the frequency dependent part of the hearing impairment in question.
- the amplifier 28 has minimum-phase FIR filters with a suitable order. Minimum-phase filters guarantee minimum group delay in the system. The filter parameters are determined when the system is fitted to a patient and does not change during operation. The design process for minimum-phase filters is well known.
- the hearing loss compensation and the dynamic compression may take place in different frequency bands, where the term different frequency bands means different number of frequency bands and/or frequency bands with different bandwidth and/or crossover frequency.
- B(m,k) be the input signal level measured for input block m and frequency band k
- P(m,k) be the peak-detector output.
- the ANSI attack time is 5 ms and the release time is 70 ms (125 ms in the lowest frequency band).
- the adaptive time constants vary with the difference between the block signal power B(m,k) and the peak-detected power P(m,k). Let Bdb(m,k) be the block signal power converted to dB, and Pdb(m,k) be the peak detected power converted to dB.
- the basic algorithm is then ⁇ 0 ⁇ Bdm m k - Pdb m - 1 , k Short attack time 0 ⁇ Bdm m k - Pdb m - 1 , k ⁇ ⁇ 0 Long attack time - ⁇ 1 ⁇ Bdm m k - Pdb m - 1 , k ⁇ 0 , Long release time Bdm m k - Pdb m - 1 , k ⁇ - ⁇ 1 , Short release time
- the attack and release times for the standard and adaptive systems are shown in Fig. 4 .
- the standard system shown by the solid line, uses an attack time of 5 ms if the band power exceeds the peak-detected power, and a release time of 70 ms if the band power is less than the peak-detected power.
- a simple stepped adaptive time-constant system shown by the dotted line in Fig. 4 , uses one set of time constants if the band power is within 10 dB of the peak-detected power, and a different set of time constants otherwise. Thus if the band power is less than 10 dB above the peak-detected power, the attack time is 20 ms.
- the attack time is reduced to 3 ms.
- the release time is 200 ms, and if the band power is more than 10 dB below the peak-detected power, the release time is reduced to 70 dB.
- An alternative to the stepped adaptive time constant is the continuously variable time constant.
- the objective is to smoothly vary the attack and release times as the difference between the band power and the peak-detected power increases.
- the attack time becomes proportional to the square of the ratio of the peak-detected power to the band power for differences that exceed 10 dB. If the band power exceeds the peak-detected power by less than 10 dB, a fixed attack time of 20 ms is used. If the band power is less than 10 dB below the peak-detected power, a fixed release time of 200 ms is used.
- the compressor was used with a block size of 24 samples at a 16-kHz sampling rate, and the frequency-warping all-pass filter parameter was set to 0.5.
- the compression parameters for the compressor are indicated in Table 1.
- Table 1 Compression Parameter Audiometric Frequency, Hz 250 500 1000 2000 4000 6000 ANSI Attack Time, ms 5 5 5 5 5 5 ANSI Release Time. ms 125 70 70 70 70 70 Compression Ratio 2:1 2:1 2:1 2:1 2:1 2:1 2:1 2:1 Lower Knee, dB SPL 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 45 Upper Knee, dB SPL 100 100 100 100 100 100 100 100 100 100 Gain, Input at 50 dB SPL 0 0 10 15 30 30 30
- Inputs below the lower knee receive linear gain, and inputs above the upper knee receive infinite compression (amplitude limiting).
- the gain as a function of frequency corresponds to settings for a high-frequency hearing loss, and represents conditions for which the modulation distortion is most audible to a listener with normal hearing.
- the adaptive attack- and release-time systems replaced the fixed attack and release times with the stepped or continuously variable times shown in Fig. 4 , and kept the remaining compression parameters unchanged from the standard system.
- the input signals were adjusted to have a level of 70 dB SPL, so the compression was engaged for the entire signal.
- the compressor modulation distortion is most audible for a white noise input signal.
- the compression gains for the frequency band centered at 2840 Hz are plotted in Fig. 5 for a 1-sec segment of the noise signal.
- the gain for the standard compressor using fixed attack and release times is shown by the bottom curve.
- the gain ranges from 13.7 to 16.4 dB, a spread of 2.7 dB.
- the offset curves for the adaptive attack and release times are plotted above the curve for the standard compressor.
- the gain for the stepped attack and release time system ranges from 14.4 to 16.2 dB, a spread of 1.8 dB, and the gain for the continuously variable attack and release time system ranges from 14.3 to 15.9 dB, a spread of 1.6 dB.
- the gain curves for the adaptive systems are much smoother than the curve for the standard system.
- the adaptive systems provide much less modulation of the noise than the standard syllabic compressor.
- the compressor modulation distortion is less audible for speech inputs.
- the speech signal used for illustration is a 5-second segment of the "Rainbow Passage” spoken by a male talker. [The complete “Rainbow Passage” can be found on page 127 of the 2nd edition of Grant Fairbanks' Voice and Articulation Drillbook (1960, pp. 124-139, New York: Harper & Row )].
- the envelope of the speech is plotted in Fig. 6 , where the syllabic energy variations are readily apparent.
- the gains for the different compression systems for this segment of speech are plotted in Fig. 7 .
- the gain for the standard compressor is shown by the dash and dot curve that for the stepped adaptive system by the dotted curve, and the gain for the variable adaptive system by the solid curve.
- the longer time constants used in the adaptive compression systems for small variations in the signal level have only a small impact on the syllabic compression gains.
- the gains for the stepped system are nearly identical to those for the standard compressor.
- the longer release times of the continuously-variable system lead to somewhat slower increases in gain when the signal level drops.
- the system with linear gain is the reference for the white noise input; we perceive white noise as a smooth continuous signal despite its envelope fluctuations, and that perception is preserved even with the high-frequency amplification provided for the simulated hearing loss.
- the modulation distortion for the standard compressor is audible as a subtle granularity superimposed on the smooth noise envelope. The granularity is much harder to hear for the adaptive systems. The modulation distortion is much harder to hear for the speech segment, and all three compression systems have a very similar sound quality.
- Fig. 4 shows plots of ANSI attack and release times as a function of the difference in dB between the instantaneous band levels and the peak detector output.
- the solid line indicates the time constants of the known compressor, the dotted line indicates the stepped adaptive time constants, and the dashed line indicates the variable adaptive time constants.
- Fig. 5 shows plots of compressor gain as a function of time over 1 ms for white Gaussian noise and a simulated high-frequency hearing loss.
- the compression ratio is 2:1 and the gains are for the frequency band centered at 2840 Hz.
- the curve for the stepped adaptive time constants is offset by 2 dB, and the curve for the variable adaptive time constants is offset by 4 dB.
- Fig. 6 shows a plot of peak-detected envelope for five seconds of a speech signal.
- the speech is the "Rainbow Passage" spoken by a male talker.
- Fig. 7 shows compressor gain as a function of time for 5 ms for the "Rainbow Passage" and a simulated high-frequency hearing loss.
- the compression ratio is 2:1 and the gains are for the frequency band centered at 2840 Hz.
- the curve for the stepped adaptive time constants is indicated by the dash and dot line, the curve for the stepped adaptive time constants is indicated by the dotted line, and the curve for the variable adaptive time constants is indicated by the solid line.
- a syllabic compressor with its fast attack and release times, can introduce audible modulation distortion for white Gaussian noise and other signals that have randomly fluctuating but statistically stationary envelopes.
- the envelope fluctuations for Gaussian noise generally fall within a range of +10 to -10 dB from the average level. Longer attack and release times for signal envelope fluctuations that fall within this ⁇ 10 dB range reduce the audible modulation distortion introduced by the dynamic-range compression.
- the syllabic envelope fluctuations for speech in quiet are greater than the ⁇ 10 dB range observed for noise. Shorter attack and release times for envelope fluctuations that are greater than ⁇ 10 dB from the average level therefore allow the compressor to accurately track the speech.
- the compressor using stepped adaptive attack and release times greatly reduces the modulation distortion for noise signals while preserving the syllabic compression behavior for speech.
- the continuously variable attack and release times give similar behavior to the stepped system, but are more complex computationally.
- the stepped adaptive attack and release times thus give a simple and effective solution to the problem of compressor modulation distortion without sacrificing the ability of the system to limit the output to sudden increases in sound level.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Tone Control, Compression And Expansion, Limiting Amplitude (AREA)
Description
- The present invention relates to a hearing aid with a compressor with adaptive time constants whereby compression modulation distortion is reduced.
- In dynamic-range compression, the input signal is multiplied by a time-varying gain. The gain fluctuations introduce distortion, which may be audible for input signals such as white Gaussian noise.
- Dynamic-range compression uses estimates of the signal level to control a time-varying multiplicative gain applied to the signal. The objective is to provide larger amounts of amplification to sounds at low intensities and reduced amplification to more-intense sounds. A digital compressor typically operates on the signal in a multiplicity of frequency bands, with independent gains computed for each band. The gains are normally controlled by the output of a peak detector, and the temporal dynamics of the compressor are thus specified by the peak-detector attack and release times.
- Because the compressor provides a multiplicative gain, it is a form of amplitude modulation. Compression thus creates distortion side-bands that may be audible under some listening conditions. The more rapidly the gain varies over time, the greater the magnitude of the sidebands and the greater the probability that the modulation will produce audible processing artifacts. Thus increasing the compression ratio or reducing the attack and release times will increase the amount of perceptible distortion.
- An additional concern in a system using block processing is that the compressor gain changes do not occur smoothly over time but rather jump in value at the processing block boundaries. Thus there is a discontinuity in the gain values that occurs at a periodic rate related to the processing block size. For a block of 24 samples at a 16-kHz sampling rate, there will be a basic periodicity at 667 Hz that will also generate distortion. Smoothing the gain over the duration of the processing block can remove the discontinuities, but is impractical in a digital hearing aid. Low-pass filtering the gain values can also reduce the discontinuities, but at the expense of increasing the compression overshoot and reducing the ability of the hearing aid to quickly respond to sudden increases in the input sound level.
- There have recently been reports of audible compression modulation distortion in known compressors, and simulations have demonstrated audible modulation distortion. These compression systems use ANSI attack times of 5 ms and ANSI release times of 70 ms (125 ms in the lowest frequency band). Longer attack and release times would reduce the amount of audible distortion, but would increase the compression overshoot. There is thus a need for a compression algorithm that reduces the audible modulation noise while preserving the ability to quickly reduce the gain for sudden increases in the input signal level.
- An example of a hearing aid with a compressor is disclosed in
EP 1 448 022 . -
WO 03/081947 A1 - It is an object of the present invention to provide a hearing aid wherein compression modulation distortion is reduced without noticeably affecting the syllabic compressor behavior for speech.
- According to the present invention, the above-mentioned and other objects are fulfilled by a hearing aid according to claim 1.
- In one example, increases in the input signal level above the average signal level lead to decreased attack and release time constants.
- Attack and release time constants may be adjusted in response to the difference between the power spectrum of the input audiosignal and the average signal spectrum.
- In a preferred embodiment of the invention, the attack and release times depend on the difference between the power spectrum for the current processing block and the smoothed peak detector output used to control the compressor. Long attack and release times are selected for small differences, and short attack and release times are selected for large differences. The resultant adaptive attack and release times are simple to implement and do not affect the compressor input/output characteristic.
- It is an advantage of the present invention that known compression input/output rules currently being used in known hearing aids may still be used with the sole modification that the attack and release time constants are adapted in response to the input signal behavior. Small signal fluctuations would cause the system to use long time constants, thus reducing the gain fluctuations and the resultant modulation distortion. Large increases in the signal level from one block to the next, however, would force the system to use short time constants, thus guaranteeing a fast reaction and the desired rapid reduction in system gain.
- Below, the invention will be further described and illustrated with reference to the accompanying drawings in which:
- Fig. 1
- is a general block diagram of a hearing aid,
- Fig. 2
- is a block diagram of one embodiment of the present invention, and
- Fig. 3
- is a more detailed block diagram of the embodiment shown in
Fig. 2 . - Fig. 4
- shows a plot of ANSI attack and release times as a function of the difference in dB between the instantaneous band levels and the peak detector output,
- Fig. 5
- shows plots of compressor gain as a function of time over 1 ms for white Gaussian noise and a simulated high-frequency hearing loss,
- Fig. 6
- shows a plot of peak-detected envelope for five seconds of a speech signal, and
- Fig. 7
- shows plots of compressor gain as a function of time for 5 ms for the "Rainbow Passage" and a simulated high-frequency hearing loss.
-
Fig. 1 is a simplified block diagram of adigital hearing aid 10. Thehearing aid 10 comprises aninput transducer 12, preferably a microphone, an analogue-to-digital (A/D)converter 14, a signal processor 16 (e.g. a digital signal processor or DSP), a digital-to-analogue (D/A)converter 18, and anoutput transducer 20, preferably a receiver. In operation,input transducer 12 receives acoustical sound signals and converts the signals to analogue electrical signals. The analogue electrical signals are converted by A/D converter 14 into digital electrical signals that are subsequently processed byDSP 16 to form a digital output signal. The digital output signal is converted by D/A converter 18 into an analogue electrical signal. The analogue signal is used byoutput transducer 20, e.g., a receiver, to produce an audio signal that is heard by the user of thehearing aid 10. -
Figs. 2 and3 show parts of thesignal processor 16 in more detail.Figs. 1-3 are identical toFigs. 1-3 ofEP 1 448 022 , however, the present illustrated compressor has adaptive attack- and release time constants in accordance with the present invention. In the embodiment illustrated inFig. 2 and more detailed inFig. 3 , the hearing aid comprises amulti-channel compressor digital input 21 for inputting a digital sound signal, and anoutput 27 connected to anamplifier 28 with a selectable static gain in each of its frequency channels for compensation of an individual hearing loss and connected to anoutput compressor 30 for limitation of theoutput 31 power of the hearing aid and connected to theoutput 29 of theamplifier 28. - In the illustrated embodiment, the
output compressor 30 is a single-channel output compressor 30. - As illustrated in
Fig. 3 , thefilter bank 22 comprises warped filters providing adjustable crossover frequencies, which are adjusted to provide the desired response in accordance with the users hearing impairment. The filters are 5-tap cosine-modulated filters. - Normally FIR filters work on a tapped delay line with one sample delay between the taps. By replacing the delays with first order all-pass filters, frequency warping is achieved enabling adjustment of crossover frequencies. The warped delay unit has five outputs. The five outputs constitutes a vector w=[W0 W1 W2 W3 W4] T at a given point in time, which is led into the filter bank where the three channel output y, is formed. The filter bank is defined by:
-
- The vector y contains the channel signals.
- The choice of filter coefficients is a trade-off between stop-band attenuation in the low and high frequency channels, and stop-band attenuation in the middle channel. The higher attenuation in the low and high frequency channels, the lower attenuation in the middle channel.
- The multi-channel compressor further comprises a
multi-channel power estimator 32 for calculation of the sound level or power in each of the frequency channels of thefilter bank 22. The calculated values are applied to the multi-channel compressorgain control unit 36 for determination of a compressor channel gain to be applied to thesignal output 40 of each of the filters of thefilter bank 22. - The compressor gains 38 are calculated and applied batch-wise for a block of samples whereby required processor power is diminished. When the compressor operates on blocks of signal samples, the compressor
gain control unit 36 operates at a lower sample frequency than other parts of the system. This means that the compressor gains only change every N'th sample where N is the number of samples in the block. Probable artefacts caused by fast changing gain values are suppressed by three low-pass filters 34 at the gain outputs 38 of the compressorgain control unit 36 for smoothing gain changes at block boundaries. - The output signals 40 from the
filter bank 22 are multiplied with the corresponding individual low-pass filtered gain outputs 42 of the compressorgain control unit 36, and the resulting signals 44 are added 26 to form thecompressed signal 46 that is input to theamplifier 28. The compressor provides attenuation only, i.e. the three compressors provide the difference between the desired gains for soft sounds and the desired gains for loud sounds. - The
amplifier 28 provides frequency shaping that forms the desired gain for soft sounds, i.e. it compensates the frequency dependent part of the hearing impairment in question. Theamplifier 28 has minimum-phase FIR filters with a suitable order. Minimum-phase filters guarantee minimum group delay in the system. The filter parameters are determined when the system is fitted to a patient and does not change during operation. The design process for minimum-phase filters is well known. - The hearing loss compensation and the dynamic compression may take place in different frequency bands, where the term different frequency bands means different number of frequency bands and/or frequency bands with different bandwidth and/or crossover frequency.
-
- For syllabic compression, the ANSI attack time is 5 ms and the release time is 70 ms (125 ms in the lowest frequency band).
-
- It has been found empirically that setting both the attack-time threshold θ0 and the release-time threshold θ1 to 10 dB yields good sound quality.
- The attack and release times for the standard and adaptive systems are shown in
Fig. 4 . The standard system, shown by the solid line, uses an attack time of 5 ms if the band power exceeds the peak-detected power, and a release time of 70 ms if the band power is less than the peak-detected power. A simple stepped adaptive time-constant system, shown by the dotted line inFig. 4 , uses one set of time constants if the band power is within 10 dB of the peak-detected power, and a different set of time constants otherwise. Thus if the band power is less than 10 dB above the peak-detected power, the attack time is 20 ms. If the band power exceeds the peak-detected power by more than 10 dB, the attack time is reduced to 3 ms. Similarly, if the band power is less than 10 dB below the peak-detected power, the release time is 200 ms, and if the band power is more than 10 dB below the peak-detected power, the release time is reduced to 70 dB. These attack and release times can of course be modified given additional listening tests and subject evaluations. - An alternative to the stepped adaptive time constant is the continuously variable time constant. The objective is to smoothly vary the attack and release times as the difference between the band power and the peak-detected power increases. In the variable system, shown in
Fig. 4 by the dashed line, the attack time becomes proportional to the square of the ratio of the peak-detected power to the band power for differences that exceed 10 dB. If the band power exceeds the peak-detected power by less than 10 dB, a fixed attack time of 20 ms is used. If the band power is less than 10 dB below the peak-detected power, a fixed release time of 200 ms is used. - The compressor was used with a block size of 24 samples at a 16-kHz sampling rate, and the frequency-warping all-pass filter parameter was set to 0.5. The compression parameters for the compressor are indicated in Table 1.
Table 1 Compression Parameter Audiometric Frequency, Hz 250 500 1000 2000 4000 6000 ANSI Attack Time, ms 5 5 5 5 5 5 ANSI Release Time. ms 125 70 70 70 70 70 Compression Ratio 2:1 2:1 2:1 2:1 2:1 2:1 Lower Knee, dB SPL 45 45 45 45 45 45 Upper Knee, dB SPL 100 100 100 100 100 100 Gain, Input at 50 dB SPL 0 0 10 15 30 30 - Inputs below the lower knee receive linear gain, and inputs above the upper knee receive infinite compression (amplitude limiting). The gain as a function of frequency corresponds to settings for a high-frequency hearing loss, and represents conditions for which the modulation distortion is most audible to a listener with normal hearing. The adaptive attack- and release-time systems replaced the fixed attack and release times with the stepped or continuously variable times shown in
Fig. 4 , and kept the remaining compression parameters unchanged from the standard system. The input signals were adjusted to have a level of 70 dB SPL, so the compression was engaged for the entire signal. - The compressor modulation distortion is most audible for a white noise input signal. The compression gains for the frequency band centered at 2840 Hz are plotted in
Fig. 5 for a 1-sec segment of the noise signal. The gain for the standard compressor using fixed attack and release times is shown by the bottom curve. The gain ranges from 13.7 to 16.4 dB, a spread of 2.7 dB. The offset curves for the adaptive attack and release times are plotted above the curve for the standard compressor. The gain for the stepped attack and release time system ranges from 14.4 to 16.2 dB, a spread of 1.8 dB, and the gain for the continuously variable attack and release time system ranges from 14.3 to 15.9 dB, a spread of 1.6 dB. In addition, the gain curves for the adaptive systems are much smoother than the curve for the standard system. Thus the adaptive systems provide much less modulation of the noise than the standard syllabic compressor. - The compressor modulation distortion is less audible for speech inputs. The speech signal used for illustration is a 5-second segment of the "Rainbow Passage" spoken by a male talker. [The complete "Rainbow Passage" can be found on page 127 of the 2nd edition of Grant Fairbanks' Voice and Articulation Drillbook (1960, pp. 124-139, New York: Harper & Row)]. The envelope of the speech is plotted in
Fig. 6 , where the syllabic energy variations are readily apparent. The gains for the different compression systems for this segment of speech are plotted inFig. 7 . The gain for the standard compressor is shown by the dash and dot curve that for the stepped adaptive system by the dotted curve, and the gain for the variable adaptive system by the solid curve. The longer time constants used in the adaptive compression systems for small variations in the signal level have only a small impact on the syllabic compression gains. The gains for the stepped system are nearly identical to those for the standard compressor. The longer release times of the continuously-variable system lead to somewhat slower increases in gain when the signal level drops. - The system with linear gain is the reference for the white noise input; we perceive white noise as a smooth continuous signal despite its envelope fluctuations, and that perception is preserved even with the high-frequency amplification provided for the simulated hearing loss. The modulation distortion for the standard compressor is audible as a subtle granularity superimposed on the smooth noise envelope. The granularity is much harder to hear for the adaptive systems. The modulation distortion is much harder to hear for the speech segment, and all three compression systems have a very similar sound quality.
-
Fig. 4 shows plots of ANSI attack and release times as a function of the difference in dB between the instantaneous band levels and the peak detector output. The solid line indicates the time constants of the known compressor, the dotted line indicates the stepped adaptive time constants, and the dashed line indicates the variable adaptive time constants. -
Fig. 5 shows plots of compressor gain as a function of time over 1 ms for white Gaussian noise and a simulated high-frequency hearing loss. The compression ratio is 2:1 and the gains are for the frequency band centered at 2840 Hz. The curve for the stepped adaptive time constants is offset by 2 dB, and the curve for the variable adaptive time constants is offset by 4 dB. -
Fig. 6 shows a plot of peak-detected envelope for five seconds of a speech signal. The speech is the "Rainbow Passage" spoken by a male talker. -
Fig. 7 shows compressor gain as a function of time for 5 ms for the "Rainbow Passage" and a simulated high-frequency hearing loss. The compression ratio is 2:1 and the gains are for the frequency band centered at 2840 Hz. The curve for the stepped adaptive time constants is indicated by the dash and dot line, the curve for the stepped adaptive time constants is indicated by the dotted line, and the curve for the variable adaptive time constants is indicated by the solid line. - A syllabic compressor, with its fast attack and release times, can introduce audible modulation distortion for white Gaussian noise and other signals that have randomly fluctuating but statistically stationary envelopes. The envelope fluctuations for Gaussian noise generally fall within a range of +10 to -10 dB from the average level. Longer attack and release times for signal envelope fluctuations that fall within this ±10 dB range reduce the audible modulation distortion introduced by the dynamic-range compression. However, the syllabic envelope fluctuations for speech in quiet are greater than the ±10 dB range observed for noise. Shorter attack and release times for envelope fluctuations that are greater than ±10 dB from the average level therefore allow the compressor to accurately track the speech.
- The compressor using stepped adaptive attack and release times greatly reduces the modulation distortion for noise signals while preserving the syllabic compression behavior for speech. The continuously variable attack and release times give similar behavior to the stepped system, but are more complex computationally. The stepped adaptive attack and release times thus give a simple and effective solution to the problem of compressor modulation distortion without sacrificing the ability of the system to limit the output to sudden increases in sound level.
Claims (8)
- A hearing aid (10) comprising
a microphone (12) for conversion of sound into an input audiosignal,
a signal processor (16) for processing the input audiosignal, the signal processor (16) including a compressor (24).
a receiver (20) for conversion of the processed signal into sound,
characterized in that the compressor (24) is adapted to vary the attack time constant as a function of the difference between instantaneous band power and peak detected power and to vary the release time constant as a function of the difference between instantaneous band power and peak detected power. - A hearing aid (10) according to claim 1, wherein the attack time constant is different from the release time constant.
- A hearing aid (10) according to any of the previous claims, wherein the compressor (24) is adapted to operate on blocks of samples.
- A hearing aid (10) according to claim 3, further comprising low-pass filters (34) at the gain outputs (38) of the compressor (24) for smoothing gain changes at block boundaries.
- A hearing aid (10) according to claim 3 or 4, wherein the attack and release time constants depend on the difference between instantaneous band power and a smoothed peak detected power.
- A hearing aid (10) according to any of the previous claims, wherein the attack time constant and the release time constant vary as a step function.
- A hearing aid (10) according to any of the previous claims, wherein the attack and release time constants are varied in such a way that they are kept constant for signal variations below a certain level.
- A hearing aid (10) according to any of the previous claims, further comprising warped filters (22).
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US66608805P | 2005-03-29 | 2005-03-29 | |
PCT/DK2006/000168 WO2006102892A1 (en) | 2005-03-29 | 2006-03-26 | Hearing aid with adaptive compressor time constants |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1869948A1 EP1869948A1 (en) | 2007-12-26 |
EP1869948B1 true EP1869948B1 (en) | 2016-02-17 |
Family
ID=36650826
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP06722863.5A Active EP1869948B1 (en) | 2005-03-29 | 2006-03-26 | Hearing aid with adaptive compressor time constants |
Country Status (4)
Country | Link |
---|---|
US (1) | US8019105B2 (en) |
EP (1) | EP1869948B1 (en) |
DK (1) | DK1869948T3 (en) |
WO (1) | WO2006102892A1 (en) |
Families Citing this family (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
RU2413357C2 (en) * | 2006-10-20 | 2011-02-27 | Долби Лэборетериз Лайсенсинг Корпорейшн | Processing dynamic properties of audio using retuning |
EP2009786B1 (en) | 2007-06-25 | 2015-02-25 | Harman Becker Automotive Systems GmbH | Feedback limiter with adaptive control of time constants |
GB2455742B (en) * | 2007-12-19 | 2011-11-02 | Wolfson Microelectronics Plc | Dynamic range controller |
DE102008019374A1 (en) * | 2008-04-17 | 2009-10-22 | Siemens Medical Instruments Pte. Ltd. | Method for determining a time constant of the hearing and method for adjusting a hearing device |
DK2335427T3 (en) * | 2008-09-10 | 2012-06-18 | Widex As | Method of sound processing in a hearing aid and a hearing aid |
US20100318353A1 (en) * | 2009-06-16 | 2010-12-16 | Bizjak Karl M | Compressor augmented array processing |
US8842852B1 (en) | 2011-07-28 | 2014-09-23 | James K. Waller, Jr. | Audio dynamics processing control system with exponential release response |
DK2752031T3 (en) * | 2011-09-01 | 2015-07-27 | Widex As | HEARING WITH ADAPTIVE NOISE REDUCTION AND PROCEDURE |
WO2013061252A2 (en) | 2011-10-24 | 2013-05-02 | Cochlear Limited | Post-filter common-gain determination |
DK2658120T3 (en) | 2012-04-25 | 2016-05-30 | Gn Resound As | A hearing aid with improved compression |
US8913768B2 (en) | 2012-04-25 | 2014-12-16 | Gn Resound A/S | Hearing aid with improved compression |
US9070371B2 (en) * | 2012-10-22 | 2015-06-30 | Ittiam Systems (P) Ltd. | Method and system for peak limiting of speech signals for delay sensitive voice communication |
WO2015111084A2 (en) * | 2014-01-27 | 2015-07-30 | Indian Institute Of Technology Bombay | Dynamic range compression with low distortion for use in hearing aids and audio systems |
DE102014218672B3 (en) * | 2014-09-17 | 2016-03-10 | Sivantos Pte. Ltd. | Method and apparatus for feedback suppression |
WO2016155853A1 (en) * | 2015-04-02 | 2016-10-06 | Harman Becker Automotive Systems Gmbh | Multii-band signal compressing |
EP3358745B2 (en) | 2017-02-02 | 2023-01-04 | Oticon A/s | An adaptive level estimator, a hearing device, a method and a binaural hearing system |
US10951994B2 (en) | 2018-04-04 | 2021-03-16 | Staton Techiya, Llc | Method to acquire preferred dynamic range function for speech enhancement |
US11011180B2 (en) * | 2018-06-29 | 2021-05-18 | Guoguang Electric Company Limited | Audio signal dynamic range compression |
US10755722B2 (en) * | 2018-08-29 | 2020-08-25 | Guoguang Electric Company Limited | Multiband audio signal dynamic range compression with overshoot suppression |
JPWO2020217605A1 (en) * | 2019-04-23 | 2020-10-29 | ||
CN113259825B (en) * | 2021-06-03 | 2021-10-08 | 南京天悦电子科技有限公司 | Low-complexity amplitude-frequency response later-period correction method for digital hearing aid |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4718099A (en) * | 1986-01-29 | 1988-01-05 | Telex Communications, Inc. | Automatic gain control for hearing aid |
JP3295443B2 (en) * | 1991-10-09 | 2002-06-24 | パイオニア株式会社 | Signal processing circuit in audio equipment |
US5444788A (en) * | 1993-09-03 | 1995-08-22 | Akg Acoustics, Inc. | Audio compressor combining feedback and feedfoward sidechain processing |
US5402498A (en) * | 1993-10-04 | 1995-03-28 | Waller, Jr.; James K. | Automatic intelligent audio-tracking response circuit |
US5771299A (en) * | 1996-06-20 | 1998-06-23 | Audiologic, Inc. | Spectral transposition of a digital audio signal |
US6240192B1 (en) * | 1997-04-16 | 2001-05-29 | Dspfactory Ltd. | Apparatus for and method of filtering in an digital hearing aid, including an application specific integrated circuit and a programmable digital signal processor |
US6628795B1 (en) * | 1997-12-23 | 2003-09-30 | Widex A/S | Dynamic automatic gain control in a hearing aid |
US6757396B1 (en) * | 1998-11-16 | 2004-06-29 | Texas Instruments Incorporated | Digital audio dynamic range compressor and method |
US6778966B2 (en) * | 1999-11-29 | 2004-08-17 | Syfx | Segmented mapping converter system and method |
US7333623B2 (en) * | 2002-03-26 | 2008-02-19 | Oticon A/S | Method for dynamic determination of time constants, method for level detection, method for compressing an electric audio signal and hearing aid, wherein the method for compression is used |
JP4402977B2 (en) | 2003-02-14 | 2010-01-20 | ジーエヌ リザウンド エー/エス | Dynamic compression in hearing aids |
-
2006
- 2006-03-26 EP EP06722863.5A patent/EP1869948B1/en active Active
- 2006-03-26 DK DK06722863.5T patent/DK1869948T3/en active
- 2006-03-26 WO PCT/DK2006/000168 patent/WO2006102892A1/en not_active Application Discontinuation
- 2006-03-29 US US11/393,360 patent/US8019105B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
WO2006102892A1 (en) | 2006-10-05 |
DK1869948T3 (en) | 2016-05-02 |
US8019105B2 (en) | 2011-09-13 |
EP1869948A1 (en) | 2007-12-26 |
US20060233408A1 (en) | 2006-10-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1869948B1 (en) | Hearing aid with adaptive compressor time constants | |
US5027410A (en) | Adaptive, programmable signal processing and filtering for hearing aids | |
Stone et al. | Comparison of different forms of compression using wearable digital hearing aids | |
EP1236377B1 (en) | Hearing aid device incorporating signal processing techniques | |
US7978868B2 (en) | Adaptive dynamic range optimization sound processor | |
US4852175A (en) | Hearing aid signal-processing system | |
US5500902A (en) | Hearing aid device incorporating signal processing techniques | |
AU2008361614B2 (en) | Method for sound processing in a hearing aid and a hearing aid | |
US6104822A (en) | Digital signal processing hearing aid | |
JP4402977B2 (en) | Dynamic compression in hearing aids | |
EP1121834B1 (en) | Hearing aids based on models of cochlear compression | |
US10375484B2 (en) | Hearing aid having level and frequency-dependent gain | |
JP2002536930A (en) | Adaptive dynamic range optimizing sound processor | |
US9319805B2 (en) | Noise reduction in auditory prostheses | |
WO2000065872A1 (en) | Loudness normalization control for a digital hearing aid | |
Bustamante et al. | Multiband compression limiting for hearing-impaired listeners | |
Moore et al. | Use of a loudness model for hearing aid fitting: II. Hearing aids with multi-channel compression | |
Li et al. | Wavelet-based nonlinear AGC method for hearing aid loudness compensation | |
EP2658120B1 (en) | A hearing aid with improved compression | |
WO2010000042A1 (en) | Linear gain amplification for mid-to-high intensity sounds in a compressive sound processor | |
JPH11225398A (en) | Loudness adjusting method and hearing aid | |
Levitt | Compression amplification | |
AU2005203487B2 (en) | Hearing aid device incorporating signal processing techniques | |
Hohmann et al. | University of Oldenburg, Fachbereich 8/Physik, D–26111 Oldenburg, Germany |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20071029 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
DAX | Request for extension of the european patent (deleted) | ||
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04R 25/00 20060101AFI20150619BHEP Ipc: H03G 3/32 20060101ALI20150619BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20150806 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 776114 Country of ref document: AT Kind code of ref document: T Effective date: 20160315 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602006047944 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20160425 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20160217 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 776114 Country of ref document: AT Kind code of ref document: T Effective date: 20160217 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160518 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160617 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160331 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602006047944 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 |
|
26N | No opposition filed |
Effective date: 20161118 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160326 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160517 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 13 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20060326 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160217 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160326 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20220321 Year of fee payment: 17 Ref country code: DK Payment date: 20220318 Year of fee payment: 17 Ref country code: CH Payment date: 20220310 Year of fee payment: 17 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20220317 Year of fee payment: 17 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230524 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: EBP Effective date: 20230331 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20230326 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230326 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230326 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240319 Year of fee payment: 19 |