EP2605547A1 - A hearing aid with improved magnetic reception during wireless communication - Google Patents
A hearing aid with improved magnetic reception during wireless communication Download PDFInfo
- Publication number
- EP2605547A1 EP2605547A1 EP11194017.7A EP11194017A EP2605547A1 EP 2605547 A1 EP2605547 A1 EP 2605547A1 EP 11194017 A EP11194017 A EP 11194017A EP 2605547 A1 EP2605547 A1 EP 2605547A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- audio signal
- time period
- estimate
- hearing aid
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Electric hearing aids
- H04R25/55—Electric hearing aids using an external connection, either wireless or wired
- H04R25/554—Electric hearing aids using an external connection, either wireless or wired using a wireless connection, e.g. between microphone and amplifier or using Tcoils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/49—Reducing the effects of electromagnetic noise on the functioning of hearing aids, by, e.g. shielding, signal processing adaptation, selective (de)activation of electronic parts in hearing aid
Definitions
- the present invention relates to a hearing aid with a telecoil, or another magnetically sensitive transducer, and an RF transceiver for wireless communication, e.g. via a wireless network, such as for wireless interconnection of two hearing aids in a binaural hearing aid system, and wireless interconnection of hearing aids with other devices, such as a remote control for a hearing aid, a fitting instrument, a mobile phone, a headset, a door bell, an alarm system, a broadcast system, etc, etc.
- a wireless network such as for wireless interconnection of two hearing aids in a binaural hearing aid system
- other devices such as a remote control for a hearing aid, a fitting instrument, a mobile phone, a headset, a door bell, an alarm system, a broadcast system, etc, etc.
- Magnetic pick-up coils often referred to as telecoils or T-coils (from “Telephone Coils")
- T-coils from “Telephone Coils”
- audio sources to be electro-magnetically, i.e. non-acoustically, connected to a hearing aid, which is intended to help the wearer filter out background noise. They can be used with telephones, FM systems (with neck loops), and induction loop systems, also called “hearing loops", that transmit sound to hearing aids from public address systems and TVs. Hearing loops are widely used in churches, shops, railway stations, and other public places.
- a telecoil consists of a metal core (or rod) around which ultra-fine wire is coiled. Telecoils generate an electrical signal in response to a varying magnetic field.
- Interference can manifest as a buzzing sound, which varies in volume depending on the distance between the wearer and the source.
- Sources are electromagnetic fields, such as CRT computer monitors, older fluorescent lighting, some dimmer switches, many household electrical appliances and airplanes.
- an RF-transceiver of the hearing aid may also generate interference.
- power consumption of hearing aid circuitry is very low.
- a hearing aid has a current consumption of 1 mA during normal operation.
- an RF transceiver in a hearing aid consumes a comparatively large amount of power during transmission or reception.
- the current consumption of the RF transceiver circuitry may increase from 50 pA to 30 mA during transmission or reception by the RF transceiver. Therefore, turning the RF transceiver on or off generates a large current transient in the hearing aid circuitry, and during the duration of the current transient, a varying magnetic field with large magnetic field gradients is generated.
- the magnetic field gradients are picked up by the telecoil and induce a disturbing signal in the electronic telecoil signal output by the telecoil, e.g. residing in a hearing loop.
- the disturbing signal interferes with the desired signal in a disturbing and bothering way for the wearer of the hearing aid.
- the characteristics of the current transients generated in the hearing aid changes over time, e.g. as a function of the degree of depletion of the hearing aid battery, the number of previous charging cycles having been applied to the battery, the type of battery currently in use, etc.
- this interference problem has been solved by turning the RF transceiver off whenever the telecoil is selected as an input source for inputting the electronic telecoil signal to the processor of the hearing aid, for example when the user desires to listen to signals of a hearing loop.
- this way of solving the problem prevents the user of the hearing aid from using a remote control to adjust the hearing aid and also prevents transmission of signals to the other hearing aid in a binaural hearing aid system.
- interference from the RF-transceiver of the hearing aid is prevented by substitution of the output signal of the magnetically sensitive transducer disturbed by current transients generated when the RF-transceiver is turned on or off with an estimated output signal, wherein the estimate is based on parts of the output signal that have not been disturbed by turning the RF-transceiver on or off.
- a new method of removing interference from a hearing aid audio signal comprising the steps of:
- the method may further comprise at least one of the following steps:
- a new hearing aid comprising
- the processor may also be configured to generate the hearing loss compensated output signal based on an estimate of the audio signal before the time period, the estimate of the audio signal before the time period being based on the audio signal that is input to the processor after the time period.
- the processor may also be configured to generate the hearing loss compensated output signal based on an estimate of the audio signal after the time period, the estimate of the audio signal after the time period being based on the audio signal that is input to the processor before the time period.
- the processor receives information that the RF transceiver is turned on or off so that the processor can substitute the audio signal with an estimated signal within an appropriate time interval.
- the auditory output signal is an acoustic signal that is transmitted towards the ear drum of the wearer of the hearing aid; however, the auditory output signal may also be an electronic signal for electronic stimulation of the auditory system of the user, for example using a cochlear implant.
- audio signal may be used to identify any analogue or digital signal forming part of the signal path from the output of the magnetically sensitive transducer to an input of the signal processor.
- the magnetically sensitive transducer may be any transducer capable of converting a varying magnetic field into an audio signal, such as a telecoil, GMR sensor (Giant M agneto R esistance sensor), Hall sensor, etc.
- the hearing aid may also include an input transducer, preferably a microphone, or an array of microphones, for conversion of an acoustic sound signal into an electronic transducer signal.
- an input transducer preferably a microphone, or an array of microphones, for conversion of an acoustic sound signal into an electronic transducer signal.
- the electronic transducer signal and the audio signal are digitized by respective AD-converters.
- the signal processor such as a digital signal processor or DSP, may be configured to process a selected one of, or a selected combination of, the audio signal and the electronic transducer signal in accordance with a selected signal processing algorithm into a processed output signal for compensation of hearing loss, for example including a compressor for compensation of dynamic range hearing loss.
- the time period includes the time during which the current transient disturbs or distorts the audio signal, and typically, the time period starts at turn-on or turn-off of the RF-transceiver.
- the audio signal is substituted by an estimated signal calculated from the audio signal outside the time period, e.g. preceding the time period, or succeeding the time period, or a combination.
- the samples of the audio signal are substituted by estimated samples calculated from samples of the audio signal outside the time period, such as samples preceding the time period, or samples succeeding the time period, or a combination of samples preceding and samples succeeding the time period.
- the estimate may be based on extrapolation of the audio signal input to the processor outside the time period, e.g. the estimate may be based on extrapolation of the audio signal input to the processor before the time period, i.e. forward prediction; or, the estimate may be based on extrapolation of the audio signal input to the processor after the time period, i.e. backward prediction; or, the estimate may be based on a combination of extrapolation of the audio signal input to the processor before and after the time period, respectively, i.e. both forward and backward prediction.
- backward prediction requires delaying the signal, parts of which are to be estimated, in order for the signal after the time period to be available for estimation of the signal within the time period.
- Samples in the time period may be estimated using Linear Predictive Coding based on samples preceding the time period, or samples succeeding the time period, or a combination of samples preceding and samples succeeding the time period.
- the estimates may be weighted with a window, such as a Hanning window. Windowing minimizes formation of artefacts in the auditory output signal of the hearing aid by transition from the audio signal itself to an estimate of the audio signal.
- the estimate may also be calculated in the frequency domain, for example based on calculation of the Fast Fourier Transform of the audio signal input to the processor before the time period, i.e. forward prediction in the frequency domain; or, the estimate may be based on calculation of the Fast Fourier Transform of the audio signal input to the processor after the time period, i.e. backward prediction in the frequency domain; or, the estimate may be based on a combination of calculation of the Fast Fourier Transform of the audio signal input to the processor before and after the time period, respectively, i.e. both forward and backward prediction in the frequency domain.
- one or more consecutive samples immediately preceding the time period, or one or more consecutive samples immediately succeeding the time period, or both may also be substituted with estimated samples, wherein the original undisturbed signal samples are included in the estimates.
- the most recent undisturbed signal sample occurring immediately before turn-on or turn-off of the RF transceiver may be substituted by an estimate calculated from samples occurring after the time period in a weighted combination with the undisturbed audio signal sample itself in order to gradually change from the undisturbed audio signal itself to an estimate of the audio signal.
- the first undisturbed signal sample occurring after turn-on or turn-off of the RF transceiver may be substituted by an estimate calculated from samples occurring before the time period in a weighted combination with the undisturbed signal sample itself in order to gradually change from an estimate of the audio signal to the undisturbed audio signal itself.
- the hearing aid including the processor may further be configured to process the signal in a plurality of frequency channels.
- An estimate of the audio signal may be provided in at least one frequency channel of the plurality of frequency channels, such as in one or more selected frequency channels, such as in all of the frequency channels.
- the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
- Fig. 1 is a simplified block diagram of an exemplary new hearing aid 10.
- the hearing aid 10 comprises a telecoil 11 for conversion of a varying magnetic field, as for example generated in a hearing loop, into an electronic telecoil signal, an analogue-to-digital (A/D) converter 12 for provision of a digitized electronic telecoil signal, an input transducer 14, preferably a microphone, or an array of microphones, an analogue-to-digital (A/D) converter 15 for provision of a digitized electronic transducer signal in response to sound signals received at the transducer 14, a signal processor 16 (e.g.
- a digital signal processor or DSP that is configured to process a selected one of, or a selected combination of, the digitized electronic telecoil signal and the digitized electronic transducer signal in accordance with a selected signal processing algorithm into a processed output signal for compensation of hearing loss, for example including a compressor for compensation of dynamic range hearing loss, a digital-to-analogue (D/A) converter 18, and an output transducer 20 for conversion of the processed digital output signal into an auditory output signal, e.g. a receiver outputting an acoustic signal for transmission towards the eardrum of the wearer of the hearing aid.
- D/A digital-to-analogue
- the hearing aid 10 has an RF transceiver 22 for wireless communication, e.g. via a wireless network, such as for wireless interconnection of two hearing aids in a binaural hearing aid system, and wireless interconnection of hearing aids with other devices, such as a remote control for a hearing aid, a fitting instrument, a mobile phone, a headset, a door bell, an alarm system, a broadcast system, etc, etc, and a communication controller 24 that is configured to turn the RF transceiver on and off in order to save power between data communication.
- a wireless network such as for wireless interconnection of two hearing aids in a binaural hearing aid system
- other devices such as a remote control for a hearing aid, a fitting instrument, a mobile phone, a headset, a door bell, an alarm system, a broadcast system, etc, etc
- a communication controller 24 that is configured to turn the RF transceiver on and off in order to save power between data communication.
- Fig. 2 schematically illustrates how the electronic telecoil signal 36 is disturbed or distorted by large current transients 34 caused by turn-on or turn-off of the RF-transceiver 22 supplied by the power source of the hearing aid.
- curve (a) in Fig. 2 indicates turn-on 30 and turn-off 32 of the RF-transceiver of the hearing aid.
- Curve (b) shows the current transients 34, i.e. dl/dt, in the power lines supplying the RF-transceiver 22, and curve (c) schematically shows the electronic telecoil signal 36 including interference 38 with the electronic telecoil signal caused by the current transients 34.
- the time period 40 starts at turn-on 30 or turn-off 32, respectively, of the RF-transceiver 22, and has the duration of 500 ⁇ s. After 500 ⁇ s, the current transient 34 has ceased to disturb the electronic telecoil signal 36 and the electronic telecoil signal 36 is no longer substituted by an estimate.
- the time between turn-on 30 and turn-off 32 of the transceiver 22 is app. 6 ms.
- a time period of 500 ⁇ s contains 25 samples.
- the 25 samples of the time period are discarded and substituted by estimated samples 50 indicated by triangles in Fig. 3 .
- the samples 50 in the time period 40 are estimated using Linear Predictive Coding based on samples preceding the time period 40, i.e. forward prediction, and samples succeeding the time period 40, i.e. backward prediction.
- Linear Predictive Coding based on samples preceding the time period 40, i.e. forward prediction, and samples succeeding the time period 40, i.e. backward prediction.
- at least twice as many samples as the samples discarded are used for forward prediction and backward prediction.
- the estimates may be weighted with a window 42, 44, such as a Hanning window. Windowing minimizes formation of artefacts in the auditory output signal of the hearing aid caused by the transition from the electronic telecoil signal itself to an estimate of the electronic telecoil signal.
- the combination of samples 46 extrapolated from samples before the time period 40 and samples 48 extrapolated from samples after the time period 40 may be formed by a weighted linear combination of Linear Predictive Coding of samples preceding the time period 40 and Linear Predictive Coding of samples succeeding the time period 40, for example weighted with windows, such as a Hanning windows 42, 44, in such a way that Linear Predictive Coding of samples preceding the time period 40 has the largest weight at the beginning of the time period 40 and decreases with time with minimum weight at the end of the time period 40, while Linear Predictive Coding of samples succeeding the time period 40 has the minimum weight at the beginning of the time period 40 and increases with time with the largest weight at the end of the time period 40.
- x ⁇ ( n ) is the predicted sample value
- x(n - i) are the previous sample values
- a i are the predictor coefficients.
- the predictor coefficients are calculated using an autoregressive model, preferably using the Levinson-Durbin recursion.
- the number of estimated samples in the time period 40 is 25, and in order to provide a good estimate, p ranges from 12 - 16, and a i is preferably based on 64 previous sample values.
- the 25 estimated samples are calculated successively using equation (1).
- x ⁇ ( n ) is the first sample in the time period 40.
- x ⁇ ( n + 1) is calculated from equation (1) incorporating the calculated value for x ⁇ ( n ) etc. until all forward predicted samples 46 of the time period 40 have been calculated.
- the predictor coefficients b i are calculated using an autoregressive model, preferably using the Levinson-Durbin recursion.
- p ranges from 12 - 16, and b i is preferably based on 64 succeeding sample values.
- the 25 estimated samples are calculated successively using equation (2).
- x ⁇ ( m ) is the last sample in the time period 40.
- x ⁇ ( m - 1) is calculated from equation (2) incorporating the calculated value for x ⁇ ( m ) etc. until all backward predicted samples 48 of the time period 40 have been calculated.
- the resulting estimated samples 50 are calculated from a weighted sum of the respective forward predicted samples 46 and backward predicted samples 48, wherein the weights are defined by respective Hanning windows 42, 44 positioned so that the weights 42 of the forward predicted samples 46 have their maximum value at the first sample of the time period 40, and the weights 44 of the backward predicted samples 48 have their maximum value at the last sample of the time period 40.
- N is the number of estimated samples in the time period 40.
- one or more undisturbed samples immediately preceding the time period 40 may also be substituted by estimated values formed by a weighted combination of the undisturbed sample values themselves and respective backward predicted estimates, and likewise, one or more undisturbed samples immediately succeeding the time period 40 may also be substituted by estimated values formed by weighted combination of the undisturbed sample values themselves and respective forward predicted estimates.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
- Prostheses (AREA)
Abstract
a magnetically sensitive transducer (11) for conversion of a varying magnetic field into an audio signal,
a processor (16) configured to generate a hearing loss compensated output signal based on the audio signal,
an output transducer (20) for conversion of the hearing loss compensated output signal to an auditory output signal that can be received by the human auditory system,
an RF transceiver (22) for wireless communication, and
a communication controller (24) that is configured to turn the RF transceiver (22) on and off, and wherein,
the processor (16) is further configured to generate, within a time period (40) comprising the event that the RF transceiver (22) changes state between on and off,
the hearing loss compensated output signal based on an estimate of the audio signal,
and wherein the estimate is based on a part of the audio signal input to the processor (16) outside the time period (40), whereby possible interference from RF-transmission is removed from the audio signal.
Description
- The present invention relates to a hearing aid with a telecoil, or another magnetically sensitive transducer, and an RF transceiver for wireless communication, e.g. via a wireless network, such as for wireless interconnection of two hearing aids in a binaural hearing aid system, and wireless interconnection of hearing aids with other devices, such as a remote control for a hearing aid, a fitting instrument, a mobile phone, a headset, a door bell, an alarm system, a broadcast system, etc, etc.
- Magnetic pick-up coils, often referred to as telecoils or T-coils (from "Telephone Coils"), in hearing aids allow audio sources to be electro-magnetically, i.e. non-acoustically, connected to a hearing aid, which is intended to help the wearer filter out background noise. They can be used with telephones, FM systems (with neck loops), and induction loop systems, also called "hearing loops", that transmit sound to hearing aids from public address systems and TVs. Hearing loops are widely used in churches, shops, railway stations, and other public places.
- A telecoil consists of a metal core (or rod) around which ultra-fine wire is coiled. Telecoils generate an electrical signal in response to a varying magnetic field.
- Although a telecoil constitutes a wide-band receiver, interference is unusual in most hearing loop situations. Interference can manifest as a buzzing sound, which varies in volume depending on the distance between the wearer and the source. Sources are electromagnetic fields, such as CRT computer monitors, older fluorescent lighting, some dimmer switches, many household electrical appliances and airplanes.
- In addition, an RF-transceiver of the hearing aid may also generate interference. During normal operation, power consumption of hearing aid circuitry is very low. In an example, a hearing aid has a current consumption of 1 mA during normal operation.
- Typically, an RF transceiver in a hearing aid consumes a comparatively large amount of power during transmission or reception. For example, the current consumption of the RF transceiver circuitry may increase from 50 pA to 30 mA during transmission or reception by the RF transceiver. Therefore, turning the RF transceiver on or off generates a large current transient in the hearing aid circuitry, and during the duration of the current transient, a varying magnetic field with large magnetic field gradients is generated.
- The magnetic field gradients are picked up by the telecoil and induce a disturbing signal in the electronic telecoil signal output by the telecoil, e.g. residing in a hearing loop. The disturbing signal interferes with the desired signal in a disturbing and bothering way for the wearer of the hearing aid.
- The characteristics of the current transients generated in the hearing aid changes over time, e.g. as a function of the degree of depletion of the hearing aid battery, the number of previous charging cycles having been applied to the battery, the type of battery currently in use, etc.
- Conventionally, this interference problem has been solved by turning the RF transceiver off whenever the telecoil is selected as an input source for inputting the electronic telecoil signal to the processor of the hearing aid, for example when the user desires to listen to signals of a hearing loop. However, this way of solving the problem prevents the user of the hearing aid from using a remote control to adjust the hearing aid and also prevents transmission of signals to the other hearing aid in a binaural hearing aid system.
- Thus, there is a need for a hearing aid that allows use of the telecoil, or another magnetically sensitive transducer, as an input source of the hearing aid and simultaneous RF-transmission without the RF-transmission causing interference in the signal output by the hearing aid in response to the output signal of the telecoil or another magnetically sensitive transducer.
- In the new hearing aid, interference from the RF-transceiver of the hearing aid is prevented by substitution of the output signal of the magnetically sensitive transducer disturbed by current transients generated when the RF-transceiver is turned on or off with an estimated output signal, wherein the estimate is based on parts of the output signal that have not been disturbed by turning the RF-transceiver on or off.
- Thus, a new method of removing interference from a hearing aid audio signal is provided, comprising the steps of:
- converting a varying magnetic field into an audio signal,
- generating a hearing loss compensated output signal based on the audio signal,
- converting the hearing loss compensated output signal to an auditory output signal that can be received by the human auditory system,
- controlling turn-on and turn-off of an RF transceiver of the hearing aid,
- forming an estimate of the audio signal that is within a time period comprising an event that the RF transceiver changes state between on and off, wherein the estimate is formed based on the audio signal obtained outside the time period, and generating the hearing loss compensated output signal based on the estimate of the audio signal that is within the time period.
- The method may further comprise at least one of the following steps:
- (a) forming an estimate of the audio signal before the time period, the estimate of the audio signal before the time period being based on a part of the audio signal input to the processor after the time period, and wherein the hearing loss compensated output signal is also based on the estimate of the audio signal before the time period, and
- (b) forming an estimate of the audio signal after the time period, the estimate of the audio signal after the time period being based on a part of the audio signal input to the processor before the time period, and wherein the hearing loss compensated output signal is also based on the estimate of the audio signal after the time period.
- Further, a new hearing aid is provided, comprising
- a magnetically sensitive transducer for conversion of a varying magnetic field into an audio signal,
- a processor configured to generate a hearing loss compensated output signal based on the audio signal,
- an output transducer for conversion of the hearing loss compensated output signal to an auditory output signal that can be received by the human auditory system, e.g. an acoustic output signal,
- an RF transceiver for wireless communication, and
- a communication controller that is configured to turn the RF transceiver on and off, and wherein,
- the processor is further configured to generate the hearing loss compensated output signal based on an estimate of the audio signal within a time period comprising an event that the RF transceiver changes state between on and off, and wherein the estimate is based on a part of the audio signal input to the processor outside the time period.
- The processor may also be configured to generate the hearing loss compensated output signal based on an estimate of the audio signal before the time period, the estimate of the audio signal before the time period being based on the audio signal that is input to the processor after the time period.
- The processor may also be configured to generate the hearing loss compensated output signal based on an estimate of the audio signal after the time period, the estimate of the audio signal after the time period being based on the audio signal that is input to the processor before the time period.
- When the communication controller turns the RF transceiver on or off, the processor receives information that the RF transceiver is turned on or off so that the processor can substitute the audio signal with an estimated signal within an appropriate time interval.
- Typically, the auditory output signal is an acoustic signal that is transmitted towards the ear drum of the wearer of the hearing aid; however, the auditory output signal may also be an electronic signal for electronic stimulation of the auditory system of the user, for example using a cochlear implant.
- Throughout the present disclosure, the term "audio signal" may be used to identify any analogue or digital signal forming part of the signal path from the output of the magnetically sensitive transducer to an input of the signal processor.
- The magnetically sensitive transducer may be any transducer capable of converting a varying magnetic field into an audio signal, such as a telecoil, GMR sensor (Giant Magneto Resistance sensor), Hall sensor, etc.
- The hearing aid may also include an input transducer, preferably a microphone, or an array of microphones, for conversion of an acoustic sound signal into an electronic transducer signal.
- In a digital hearing aid, the electronic transducer signal and the audio signal are digitized by respective AD-converters.
- The signal processor, such as a digital signal processor or DSP, may be configured to process a selected one of, or a selected combination of, the audio signal and the electronic transducer signal in accordance with a selected signal processing algorithm into a processed output signal for compensation of hearing loss, for example including a compressor for compensation of dynamic range hearing loss.
- The time period includes the time during which the current transient disturbs or distorts the audio signal, and typically, the time period starts at turn-on or turn-off of the RF-transceiver. Within the time period, the audio signal is substituted by an estimated signal calculated from the audio signal outside the time period, e.g. preceding the time period, or succeeding the time period, or a combination. In a digital hearing aid, the samples of the audio signal are substituted by estimated samples calculated from samples of the audio signal outside the time period, such as samples preceding the time period, or samples succeeding the time period, or a combination of samples preceding and samples succeeding the time period.
- Thus, the estimate may be based on extrapolation of the audio signal input to the processor outside the time period, e.g. the estimate may be based on extrapolation of the audio signal input to the processor before the time period, i.e. forward prediction; or, the estimate may be based on extrapolation of the audio signal input to the processor after the time period, i.e. backward prediction; or, the estimate may be based on a combination of extrapolation of the audio signal input to the processor before and after the time period, respectively, i.e. both forward and backward prediction.
- Obviously, backward prediction requires delaying the signal, parts of which are to be estimated, in order for the signal after the time period to be available for estimation of the signal within the time period.
- Samples in the time period may be estimated using Linear Predictive Coding based on samples preceding the time period, or samples succeeding the time period, or a combination of samples preceding and samples succeeding the time period.
- The estimates may be weighted with a window, such as a Hanning window. Windowing minimizes formation of artefacts in the auditory output signal of the hearing aid by transition from the audio signal itself to an estimate of the audio signal.
- Other estimates may be calculated using other formulas, such as Warped Linear Predictive Coding, Polynomial extrapolation, etc.
- The estimate may also be calculated in the frequency domain, for example based on calculation of the Fast Fourier Transform of the audio signal input to the processor before the time period, i.e. forward prediction in the frequency domain; or, the estimate may be based on calculation of the Fast Fourier Transform of the audio signal input to the processor after the time period, i.e. backward prediction in the frequency domain; or, the estimate may be based on a combination of calculation of the Fast Fourier Transform of the audio signal input to the processor before and after the time period, respectively, i.e. both forward and backward prediction in the frequency domain.
- In order to further smooth the transition from real samples of the audio signal to estimated samples, one or more consecutive samples immediately preceding the time period, or one or more consecutive samples immediately succeeding the time period, or both, may also be substituted with estimated samples, wherein the original undisturbed signal samples are included in the estimates.
- For example, the most recent undisturbed signal sample occurring immediately before turn-on or turn-off of the RF transceiver may be substituted by an estimate calculated from samples occurring after the time period in a weighted combination with the undisturbed audio signal sample itself in order to gradually change from the undisturbed audio signal itself to an estimate of the audio signal.
- Likewise, the first undisturbed signal sample occurring after turn-on or turn-off of the RF transceiver may be substituted by an estimate calculated from samples occurring before the time period in a weighted combination with the undisturbed signal sample itself in order to gradually change from an estimate of the audio signal to the undisturbed audio signal itself.
- The hearing aid including the processor may further be configured to process the signal in a plurality of frequency channels.
- An estimate of the audio signal may be provided in at least one frequency channel of the plurality of frequency channels, such as in one or more selected frequency channels, such as in all of the frequency channels.
- The plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
- Below, the invention will be described in more detail with reference to the exemplary binaural hearing aid systems in the drawings, wherein
-
Fig. 1 shows a block diagram of a hearing aid with a telecoil and an RF-transceiver, -
Fig. 2 shows a plot of signals in the hearing aid ofFig. 1 , and -
Fig. 3 illustrates audio signal estimation. - The new hearing aid will now be described more fully hereinafter with reference to the accompanying drawings, in which various examples are shown. The accompanying drawings are schematic and simplified for clarity, and they merely show details which are essential to the understanding of the invention, while other details have been left out. The appended patent claims may be embodied in different forms not shown in the accompanying drawings and should not be construed as limited to the examples set forth herein. Rather, these examples are provided so that this disclosure will be thorough and complete, and will convey the scope of the appended patent claims to those skilled in the art.
- Like reference numerals refer to like elements throughout.
-
Fig. 1 is a simplified block diagram of an exemplarynew hearing aid 10. - The
hearing aid 10 comprises a telecoil 11 for conversion of a varying magnetic field, as for example generated in a hearing loop, into an electronic telecoil signal, an analogue-to-digital (A/D)converter 12 for provision of a digitized electronic telecoil signal, aninput transducer 14, preferably a microphone, or an array of microphones, an analogue-to-digital (A/D)converter 15 for provision of a digitized electronic transducer signal in response to sound signals received at thetransducer 14, a signal processor 16 (e.g. a digital signal processor or DSP) that is configured to process a selected one of, or a selected combination of, the digitized electronic telecoil signal and the digitized electronic transducer signal in accordance with a selected signal processing algorithm into a processed output signal for compensation of hearing loss, for example including a compressor for compensation of dynamic range hearing loss, a digital-to-analogue (D/A)converter 18, and anoutput transducer 20 for conversion of the processed digital output signal into an auditory output signal, e.g. a receiver outputting an acoustic signal for transmission towards the eardrum of the wearer of the hearing aid. - Further, the
hearing aid 10 has anRF transceiver 22 for wireless communication, e.g. via a wireless network, such as for wireless interconnection of two hearing aids in a binaural hearing aid system, and wireless interconnection of hearing aids with other devices, such as a remote control for a hearing aid, a fitting instrument, a mobile phone, a headset, a door bell, an alarm system, a broadcast system, etc, etc, and acommunication controller 24 that is configured to turn the RF transceiver on and off in order to save power between data communication. -
Fig. 2 schematically illustrates how theelectronic telecoil signal 36 is disturbed or distorted by largecurrent transients 34 caused by turn-on or turn-off of the RF-transceiver 22 supplied by the power source of the hearing aid. - The uppermost curve (a) in
Fig. 2 indicates turn-on 30 and turn-off 32 of the RF-transceiver of the hearing aid. Curve (b) shows thecurrent transients 34, i.e. dl/dt, in the power lines supplying the RF-transceiver 22, and curve (c) schematically shows theelectronic telecoil signal 36 includinginterference 38 with the electronic telecoil signal caused by thecurrent transients 34. - In the example illustrated in
Fig. 3 , thetime period 40 starts at turn-on 30 or turn-off 32, respectively, of the RF-transceiver 22, and has the duration of 500 µs. After 500 µs, the current transient 34 has ceased to disturb theelectronic telecoil signal 36 and theelectronic telecoil signal 36 is no longer substituted by an estimate. The time between turn-on 30 and turn-off 32 of thetransceiver 22 is app. 6 ms. - At a 20 kHz sample rate, a time period of 500 µs contains 25 samples. The 25 samples of the time period are discarded and substituted by estimated
samples 50 indicated by triangles inFig. 3 . - Preferably, the
samples 50 in thetime period 40 are estimated using Linear Predictive Coding based on samples preceding thetime period 40, i.e. forward prediction, and samples succeeding thetime period 40, i.e. backward prediction. In order to provide a good estimate, at least twice as many samples as the samples discarded are used for forward prediction and backward prediction. - The estimates may be weighted with a
42, 44, such as a Hanning window. Windowing minimizes formation of artefacts in the auditory output signal of the hearing aid caused by the transition from the electronic telecoil signal itself to an estimate of the electronic telecoil signal.window - Thus, in the illustrated example, the combination of
samples 46 extrapolated from samples before thetime period 40 andsamples 48 extrapolated from samples after thetime period 40 may be formed by a weighted linear combination of Linear Predictive Coding of samples preceding thetime period 40 and Linear Predictive Coding of samples succeeding thetime period 40, for example weighted with windows, such as a 42, 44, in such a way that Linear Predictive Coding of samples preceding theHanning windows time period 40 has the largest weight at the beginning of thetime period 40 and decreases with time with minimum weight at the end of thetime period 40, while Linear Predictive Coding of samples succeeding thetime period 40 has the minimum weight at the beginning of thetime period 40 and increases with time with the largest weight at the end of thetime period 40. - For forward prediction, the following equation (1) is used:
where x̃(n) is the predicted sample value, x(n - i) are the previous sample values, and ai are the predictor coefficients. Preferably, the predictor coefficients are calculated using an autoregressive model, preferably using the Levinson-Durbin recursion. In the illustrated example, the number of estimated samples in thetime period 40 is 25, and in order to provide a good estimate, p ranges from 12 - 16, and ai is preferably based on 64 previous sample values. The 25 estimated samples are calculated successively using equation (1). x̃(n) is the first sample in thetime period 40. When x̃(n) has been calculated using equation (1), x̃(n + 1) is calculated from equation (1) incorporating the calculated value for x̃(n) etc. until all forward predictedsamples 46 of thetime period 40 have been calculated. - In the same way, the samples of the
time period 40 are estimated using backward prediction according to the following equation (2): where x̃(m) is the predicted sample value, x(m + i) are the succeeding sample values, and bi are the predictor coefficients. Preferably, the predictor coefficients bi are calculated using an autoregressive model, preferably using the Levinson-Durbin recursion. In order to provide a good estimate, p ranges from 12 - 16, and bi is preferably based on 64 succeeding sample values. The 25 estimated samples are calculated successively using equation (2). x̃(m) is the last sample in thetime period 40. When x̃(m) has been calculated from equation (2), x̃(m - 1) is calculated from equation (2) incorporating the calculated value for x̃(m) etc. until all backward predictedsamples 48 of thetime period 40 have been calculated. - Finally, the resulting estimated
samples 50 are calculated from a weighted sum of the respective forward predictedsamples 46 and backward predictedsamples 48, wherein the weights are defined by 42, 44 positioned so that therespective Hanning windows weights 42 of the forward predictedsamples 46 have their maximum value at the first sample of thetime period 40, and theweights 44 of the backward predictedsamples 48 have their maximum value at the last sample of thetime period 40. -
-
- N is the number of estimated samples in the
time period 40. - In order to further smooth the transition from the
electronic telecoil signal 36 to the estimatedsignal 50, one or more undisturbed samples immediately preceding thetime period 40 may also be substituted by estimated values formed by a weighted combination of the undisturbed sample values themselves and respective backward predicted estimates, and likewise, one or more undisturbed samples immediately succeeding thetime period 40 may also be substituted by estimated values formed by weighted combination of the undisturbed sample values themselves and respective forward predicted estimates. - Other estimates may be calculated using other formulas, such as Warped Linear Predictive Coding, Polynomial extrapolation, etc.
Claims (15)
- A hearing aid (10) comprising
a magnetically sensitive transducer (11) for conversion of a varying magnetic field into an audio signal,
a processor (16) configured to generate a hearing loss compensated output signal based on the audio signal,
an output transducer (20) for conversion of the hearing loss compensated output signal to an auditory output signal that can be received by the human auditory system,
an RF transceiver (22) for wireless communication, and
a communication controller (24) that is configured to turn the RF transceiver (22) on and off, and wherein,
the processor (16) is further configured to generate the hearing loss compensated output signal based on an estimate of the audio signal within a time period (40) comprising the event that the RF transceiver (22) changes state between on and off, and wherein the estimate is based on a part of the audio signal input to the processor (16) outside the time period (40). - A hearing aid (10) according to claim 1, wherein the estimate is based on extrapolation of the audio signal input to the processor (16) outside the time period (40).
- A hearing aid (10) according to claim 2, wherein the part of the audio signal is input to the processor (16) before the time period (40).
- A hearing aid (10) according to claim 2, wherein the part of the audio signal is input to the processor (16) after the time period (40).
- A hearing aid (10) according to any of the preceding claims, wherein the part of the audio signal on which the estimate is based has a duration that is at least twice as long as the time period.
- A hearing aid (10) according to any of the preceding claims, wherein the estimate is formed using Linear Predictive Coding.
- A hearing aid (10) according to any of the preceding claims, wherein the estimate is formed using Warped Linear Predictive Coding.
- A hearing aid (10) according to any of the preceding claims, wherein the estimate is formed using windowing (42, 44).
- A hearing aid (10) according to claim 9, wherein windowing includes utilization of a Hanning window (42, 44).
- A hearing aid (10) according to any of the preceding claims, wherein the processor (16) is also configured to generate the hearing loss compensated output signal based on an estimate of the audio signal before the time period (40), the estimate of the audio signal before the time period being based on the audio signal that is input to the processor (16) after the time period (40).
- A hearing aid (10) according to any of the preceding claims, wherein the processor (16) is also configured to generate the hearing loss compensated output signal based on an estimate of the audio signal after the time period (40), the estimate of the audio signal after the time period being based on the audio signal that is input to the processor (16) before the time period (40).
- A hearing aid (10) according to any of the preceding claims, wherein the processor (16) is further configured to process the audio signal in a plurality of frequency channels, and wherein the estimate of the audio signal is provided in at least one of the plurality of frequency channels.
- A method of removing interference from a hearing aid audio signal, comprising the steps of:converting a varying magnetic field into an audio signal,generating a hearing loss compensated output signal based on the audio signal,converting the hearing loss compensated output signal to an auditory output signal that can be received by the human auditory system,controlling turn-on and turn-off of an RF transceiver of the hearing aid,forming an estimate of the audio signal that is within a time period comprising an event that the RF transceiver changes state between on and off, wherein the estimate is formed based on the audio signal obtained outside the time period, andgenerating the hearing loss compensated output signal based on the estimate of the audio signal that is within the time period.
- A method according to claim 13, wherein the estimate is formed utilizing Linear Prediction Coding.
- A method according to claim 13 or 14, further comprising at least one of the following steps:(a) forming an estimate of the audio signal before the time period, the estimate of the audio signal before the time period being based on a part of the audio signal input to the processor after the time period, and wherein the hearing loss compensated output signal is also based on the estimate of the audio signal before the time period, and(b) forming an estimate of the audio signal after the time period, the estimate of the audio signal after the time period being based on a part of the audio signal input to the processor before the time period, and wherein the hearing loss compensated output signal is also based on the estimate of the audio signal after the time period.
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP11194017.7A EP2605547B1 (en) | 2011-12-16 | 2011-12-16 | A hearing aid with improved magnetic reception during wireless communication |
| DK11194017.7T DK2605547T3 (en) | 2011-12-16 | 2011-12-16 | Hearing aid with improved magnetic reception of wireless communication |
| US13/330,524 US8781143B2 (en) | 2011-12-16 | 2011-12-19 | Hearing aid with improved magnetic reception during wireless communication |
| JP2012272513A JP5431566B2 (en) | 2011-12-16 | 2012-12-13 | Hearing aid with improved magnetic reception during wireless communication |
| CN201210548523.0A CN103442321B (en) | 2011-12-16 | 2012-12-17 | Hearing aid with improved magnetic reception during wireless communication |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP11194017.7A EP2605547B1 (en) | 2011-12-16 | 2011-12-16 | A hearing aid with improved magnetic reception during wireless communication |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP2605547A1 true EP2605547A1 (en) | 2013-06-19 |
| EP2605547B1 EP2605547B1 (en) | 2016-03-30 |
Family
ID=45509207
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP11194017.7A Active EP2605547B1 (en) | 2011-12-16 | 2011-12-16 | A hearing aid with improved magnetic reception during wireless communication |
Country Status (2)
| Country | Link |
|---|---|
| EP (1) | EP2605547B1 (en) |
| DK (1) | DK2605547T3 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2947803A1 (en) | 2014-05-20 | 2015-11-25 | GN Resound A/S | A new method of wireless transmission of digital audio |
| US9813815B2 (en) | 2014-05-20 | 2017-11-07 | Gn Hearing A/S | Method of wireless transmission of digital audio |
| CN108781320A (en) * | 2016-03-14 | 2018-11-09 | 索诺瓦公司 | Wireless body-worn personal device with loss detection |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040052391A1 (en) * | 2002-09-12 | 2004-03-18 | Micro Ear Technology, Inc. | System and method for selectively coupling hearing aids to electromagnetic signals |
| US20050201577A1 (en) * | 2004-03-10 | 2005-09-15 | Starkey Laboratories, Inc. | Hearing instrument with data transmission interference blocking |
-
2011
- 2011-12-16 DK DK11194017.7T patent/DK2605547T3/en active
- 2011-12-16 EP EP11194017.7A patent/EP2605547B1/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040052391A1 (en) * | 2002-09-12 | 2004-03-18 | Micro Ear Technology, Inc. | System and method for selectively coupling hearing aids to electromagnetic signals |
| US20050201577A1 (en) * | 2004-03-10 | 2005-09-15 | Starkey Laboratories, Inc. | Hearing instrument with data transmission interference blocking |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2947803A1 (en) | 2014-05-20 | 2015-11-25 | GN Resound A/S | A new method of wireless transmission of digital audio |
| US9813815B2 (en) | 2014-05-20 | 2017-11-07 | Gn Hearing A/S | Method of wireless transmission of digital audio |
| CN108781320A (en) * | 2016-03-14 | 2018-11-09 | 索诺瓦公司 | Wireless body-worn personal device with loss detection |
| CN108781320B (en) * | 2016-03-14 | 2020-08-04 | 索诺瓦公司 | Wireless body-worn personal device with loss detection |
Also Published As
| Publication number | Publication date |
|---|---|
| DK2605547T3 (en) | 2016-06-27 |
| EP2605547B1 (en) | 2016-03-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8781143B2 (en) | Hearing aid with improved magnetic reception during wireless communication | |
| EP2899996B1 (en) | Signal enhancement using wireless streaming | |
| EP2071873B1 (en) | A hearing aid system comprising a matched filter and a measurement method | |
| EP3048779B1 (en) | Sound volume adjusting method and device | |
| EP2613567B1 (en) | A method of improving a long term feedback path estimate in a listening device | |
| CN106507258B (en) | Hearing device and operation method thereof | |
| EP3062531B1 (en) | A hearing device comprising an anti-feedback power down detector | |
| EP3419313B1 (en) | Hearing device with adaptive feedback-path estimation | |
| CN110035367A (en) | Feedback detector and hearing devices including feedback detector | |
| CN111050260B (en) | Hearing aid noise reduction method, corresponding hearing aid and binaural hearing aid system | |
| CN108235181B (en) | Method for noise reduction in an audio processing apparatus | |
| EP3253074B1 (en) | A hearing device comprising a filterbank and an onset detector | |
| CN106254998B (en) | Hearing device comprising a signal generator for masking tinnitus | |
| JP2016537891A (en) | Hearing aid system operating method and hearing aid system | |
| JP2016522651A (en) | Hearing aid system signal processing method and hearing aid system | |
| EP2605547B1 (en) | A hearing aid with improved magnetic reception during wireless communication | |
| CN105430586A (en) | Method and apparatus for feedback suppression | |
| EP4106346B1 (en) | A hearing device comprising an adaptive filter bank | |
| US10129661B2 (en) | Techniques for increasing processing capability in hear aids |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| 17P | Request for examination filed |
Effective date: 20131219 |
|
| RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| 17Q | First examination report despatched |
Effective date: 20140506 |
|
| 17Q | First examination report despatched |
Effective date: 20140526 |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| INTG | Intention to grant announced |
Effective date: 20151009 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 786552 Country of ref document: AT Kind code of ref document: T Effective date: 20160415 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602011024571 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20160621 |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160701 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160630 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20160330 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 786552 Country of ref document: AT Kind code of ref document: T Effective date: 20160330 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160730 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160801 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 6 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602011024571 Country of ref document: DE |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| 26N | No opposition filed |
Effective date: 20170103 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20161216 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20161216 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 7 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20111216 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20161216 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160330 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DK Payment date: 20211217 Year of fee payment: 11 Ref country code: FR Payment date: 20211215 Year of fee payment: 11 Ref country code: GB Payment date: 20211221 Year of fee payment: 11 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20211217 Year of fee payment: 11 |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230525 |
|
| REG | Reference to a national code |
Ref country code: DK Ref legal event code: EBP Effective date: 20221231 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20221216 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221216 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20251222 Year of fee payment: 15 |

