EP3059979B1 - Hörgerät mit signalerweiterung - Google Patents

Hörgerät mit signalerweiterung Download PDF

Info

Publication number
EP3059979B1
EP3059979B1 EP16164585.8A EP16164585A EP3059979B1 EP 3059979 B1 EP3059979 B1 EP 3059979B1 EP 16164585 A EP16164585 A EP 16164585A EP 3059979 B1 EP3059979 B1 EP 3059979B1
Authority
EP
European Patent Office
Prior art keywords
signal
estimate
hearing aid
noise
microphone
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Revoked
Application number
EP16164585.8A
Other languages
English (en)
French (fr)
Other versions
EP3059979A1 (de
Inventor
Karl-Fredrik Johan GRAN
Andrew Burke Dittberner
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GN Hearing AS
Original Assignee
GN Hearing AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=45470394&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=EP3059979(B1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by GN Hearing AS filed Critical GN Hearing AS
Priority to DK16164585.8T priority Critical patent/DK3059979T3/da
Priority to EP16164585.8A priority patent/EP3059979B1/de
Publication of EP3059979A1 publication Critical patent/EP3059979A1/de
Application granted granted Critical
Publication of EP3059979B1 publication Critical patent/EP3059979B1/de
Revoked legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/552—Binaural
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40—Arrangements for obtaining a desired directivity characteristic
    • H04R25/407—Circuits for combining signals of a plurality of transducers

Definitions

  • a new binaural hearing aid system that compensates for a hearing impaired user's loss of ability to understand speech in noise.
  • Hearing impaired individuals often experience at least two distinct problems: a hearing loss, which is an increase in hearing threshold level, and a loss of ability to understand high level speech in noise in comparison with normal hearing individuals. For most hearing impaired patients, the performance in speech-in-noise intelligibility tests is worse than for normal hearing people, even if the audibility of the incoming sounds is restored by amplification.
  • An individual's speech reception threshold (SRT) is the signal-to-noise ratio required in a presented signal to achieve 50 percent correct word recognition in a hearing in noise test.
  • the patient's hearing ability can thus be improved by making previously inaudible speech cues audible.
  • At least one microphone in combination with a number of filters, fixed or adaptive, is used to enhance a signal from the presumed target direction and at the same time suppress all other signals.
  • the goal is to create an estimate of the long term noise spectrum and turn down gain in frequency bands where the instantaneous target signal power is lower than the long term noise power. Even though the methods are very different from a technological standpoint, they still have the common goal; enhance the target signal and remove the noise disturbance.
  • the methods cannot take listener intent into account and they may remove parts of the audio signal which the listener is trying to focus on.
  • WO 2011/006496 A1 discloses a hearing aid system with a processing unit for adaptive wind noise suppression.
  • the processing unit comprises a first microphone and a second microphone.
  • the analogue signal from the first microphone is converted to a first digital signal in a first A/D converter and the analogue signal from the second microphone is converted to a second digital signal in a second A/D converter.
  • the output of the first A/D converter is operationally connected to a first input of a subtraction node.
  • the output of the second A/D converter is operationally connected to the input of an adaptive filter.
  • the output of the adaptive filter is branched and in a first branch operationally connected to the second input of the subtraction node and in a second branch operationally connected to the input of the remaining signal processing in the hearing aid.
  • the output from the subtraction node is operationally connected to a control input of the adaptive filter.
  • a new method of enhancement of a desired signal is disclosed.
  • the new method makes use of the human auditory system's capability of concentrating on a desired signal.
  • a new binaural hearing aid system using the new method is also disclosed.
  • ITD interaural time differences
  • ILD interaural level differences
  • the level difference is a result of diffraction and is determined by the relative position of the ears compared to the source. This cue is dominant above 2 kHz but the auditory system is equally sensitive to changes in ILD over the entire spectrum.
  • At least one of the target signal and the noise signal is estimated, and the at least one estimate is presented to the user of the binaural hearing aid system in such a way that a user's capability of understanding speech in noise is improved.
  • a listener may listen to sound with a signal S that the listener desires to listen to and noise N that the listener finds disturbing, i.e. the sound signal is S+N.
  • the desired signal S may be estimated.
  • the estimate is denoted ES.
  • S+N-ES-ES Subtracting two times the estimate ES from the sound signal S+N results in a modified signal: S+N-ES-ES, and since ES is approximately equal to S, modified signal is: N-ES which is approximately equal to -S +N, i.e. the original sound signal wherein the desired signal S has been substantially substituted with signal S phase shifted by 180°.
  • the original signal S+N may be presented to one ear of a user, and the phase shifted signal N-ES, or more accurately S+N-2ES, may be presented to the other ear for improved BMLD and SRT.
  • both the desired signal S and the noise N may be estimated and the sum of the estimates ES+EN may be presented to one ear of the user, and the phase shifted sum -ES+EN may be presented to the other ear for improved BMLD and SRT.
  • the desired signal S and the noise may be swapped so that the noise estimated is phase shifted instead of the desired signal for improved BMLD and SRT; however with decreased performance compared to phase shifting the desired signal S.
  • Noise can be background speech, restaurant clatter, music (when speech is the desired signal), traffic noise, etc.
  • the purpose for the method is not to remove any part of the signal but instead present the signals so that the auditory system can perform natural noise reduction and separate the target signal from the noise signal.
  • the target signal and the noise signal are swapped; enhancement of the target signal is still obtained, although with slightly decreased performance.
  • a new binaural hearing aid system comprising at least one microphone for provision of respective at least one microphone audio signal in response to sound received at the at least one microphone, a signal separation unit configured to provide an estimate of one of a target signal and a noise signal based on the at least one microphone audio signal, a phase shift circuit configured to phase shift the estimate of one of the target signal and the noise signal, and a phase shift adder connected to provide a phase shifted signal representing sound received at the at least one microphone in which the estimate of one of the target signal and the noise signal has substantially substituted the respective original one of the target signal and the noise signal, and a first receiver for conversion of a receiver input signal into an acoustic signal for transmission towards one of the eardrums of a user of the binaural hearing aid system, and a second receiver for conversion of a receiver input signal into an acoustic signal for transmission towards the other one of the eardrums of the user, and wherein the receiver input of one of the first and second receivers is connected to a signal
  • a new method is provided of binaural signal enhancement in a binaural hearing aid system, the method comprising the steps of providing at least one microphone audio signal in response to sound, and providing an estimate of one of a target signal and a noise signal based on the at least one audio signal, phase shifting the estimate of one of the target signal and the noise signal, and providing a phase shifted signal representing the at least one microphone audio signal in which the phase shifted estimate of one of the target signal and the noise signal has substantially substituted the respective original one of the target signal and the noise signal, and transmitting a signal representing the phase shifted signal towards one of the eardrums of a user of the binaural hearing aid system, and transmitting a signal representing the at least one microphone audio signal towards the other one of the eardrums of the user.
  • the phase shifted estimate can exactly substitute the respective original signal; however typically, the estimate of a signal will deviate from the original signal and substitution of the original signal with its estimate will typically not lead to substitution of the deviation, and thus the estimate is said to substantially substitute the original signal.
  • one signal is said to represent another signal when the one signal is a function of the other signal, for example the one signal may be formed by analogue-to-digital conversion, or digital-to analogue conversion of the other signal; or, the one signal may be formed by conversion from another acoustic signal to an electronic signal or vice versa; or the one signal may be formed by analogue or digital filtering or mixing of the other signal; or the one signal may be formed by transformation, such as frequency transformation, etc, of the other signal; etc.
  • signals that are processed by specific circuitry may be identified by a name that may be used to identify any analogue or digital signal forming part of the signal path from the source of the signal in question to an input of the circuitry, e.g. signal processor, in question.
  • a name e.g. a name that may be used to identify any analogue or digital signal forming part of the signal path from the source of the signal in question to an input of the circuitry, e.g. signal processor, in question.
  • an output signal of a microphone i.e. the microphone audio signal
  • the at least one microphone may contain a single microphone; however preferably, the at least one microphone has two microphones. Further, the at least one microphone may have more than two microphones for improved separation of the target signal and the noise signal.
  • the second hearing aid may also comprise at least one microphone for provision of microphone audio signals in response to sound received at the respective microphones.
  • the transceiver of the first hearing aid is connected for reception of signals representing the microphone audio signals of the second hearing aid, and the signal separation unit is configured to provide the estimate of the target signal and the estimate of the noise signal based on the audio signals of the first and second hearing aids.
  • the phase shift circuit phase shifts the estimate of the target signal, and preferably, the phase shift ranges from 150° to 210°, more preferred the phase shift is approximately equal to 180°, and most preferred equal to 180°.
  • the signal separation unit may be configured to provide the estimates based on spectral characteristics of the audio signals as is well-known in the art of noise reduction.
  • the noise estimate is not suppressed in the output presented to the user; rather the target estimate and the noise estimate is presented to the user in a way that improves the user's SRT.
  • the signal separation unit may be configured to provide the estimates based on statistical characteristics of the audio signals as is well-known in the art of noise reduction.
  • the noise estimate is not suppressed in the output presented to the user; rather the target estimate and the noise estimate is presented to the user in a way that improves the user's SRT.
  • the signal separation unit may comprise a beamformer, and the beam former may be configured to provide the estimates based on microphone audio signals of the first and second hearing aids.
  • the beamformer of the signal separation unit is different from conventional beamformers in that the noise estimate is not suppressed in the output presented to the user; rather the target estimate and the noise estimate is presented to the user in a way that improves the user's SRT.
  • the beamformer combines the microphone audio signals output by a plurality of microphones of the at least one microphone into a target signal with varying sensitivity to sound sources in different directions in relation to the plurality of microphones.
  • a plot of the varying sensitivity as a function of the direction is denoted the directivity pattern.
  • a directivity pattern has at least one direction wherein the microphone signals substantially cancel each other.
  • such a direction is denoted a null direction.
  • a directivity pattern may comprise several null directions depending on the number of microphones in the plurality of microphones and depending on the signal processing.
  • the beamformer may be a fixed beamformer with a directional pattern that is fixed with relation to the head of the user.
  • the beamformer may for example be based on at least two microphones, with a directional pattern that has a maximum in the front direction of the user, i.e. the forward looking direction of the user, and a null in the opposite direction, i.e. the rear direction of the user.
  • the beamformer may be based on more than two microphones, and may include microphones of both hearing aids using wireless or wired communication techniques.
  • the increased distance between the microphones may be utilized to form a directional pattern with a narrow beam providing improved spatial separation of the target estimate from the noise estimate.
  • the conventional output of the beamformer may be used as the target estimate, and the noise estimate may be provided by subtraction of the target estimate from the microphone audio signal of one of the microphones of the plurality of microphones.
  • the respective microphone signals When microphones of both hearing aids of the binaural hearing aid system cooperate with the beamformer, the respective microphone signals must be sampled substantially synchronously. Time shifts as small as 20 -30 ⁇ S between sampling instants of the respective microphone signals in the two hearing aids may lead to a perceivable shift in the beam direction. Furthermore, a slowly time varying time shift between the sampling instants of the respective microphone signals, which inevitably will occur if the hearing aids are operated asynchronously, will result in an acoustic beam that appears to drift and focus in alternating directions.
  • the hearing aids of the binaural hearing aid system may be synchronized as for example discloses in more detail in WO 02/07479 .
  • the beamformer may comprise adaptive filters configured to filter respective microphone audio signals and to adapt the respective filter coefficients for adaptive beamforming towards a sound source. For example, the beamformer may adapt to optimize the signal to noise ratio.
  • An adaptable beamformer makes it possible to focus on a moving sound source or to focus on a non-moving sound source, while the user of the hearing aid system is moving. Furthermore, the adaptable beamformer is capable of adapting to changes in the sound environment, such as appearance of a new sound source, disappearance of a noise source or movement of noise sources relative to the user of the hearing aid system.
  • the noise can consist of both directional noise and other types of noise such as diffuse noise or babble noise.
  • Finding a solution to this optimization could be done adaptively using least mean square, recursive least square, steepest descent or other types of numerical optimization algorithms.
  • the signals are presented to the user in such a way that the SRT of the user is improved.
  • the target estimate is presented in opposite phase, i.e. 180° phase shifted with relation to each other, at the two ears of the user, while the noise estimate is presented in phase at the two ears of the user.
  • a first adder may be connected to the signal separation unit, and output a sum of the target estimate and the noise estimate provided by the signal separation unit, and the output of the first adder may be connected to a signal processor for further processing, such as hearing loss compensation, and the output of the signal processor may be connected to an output transducer that outputs a corresponding output to one ear of the user, or the output of the first adder may be connected directly to the output transducer.
  • a second adder may be connected to the signal separation unit, and output a sum of the reverse phases target estimate and the noise estimate provided by the signal separation unit, and the output of the second adder is connected to a transceiver that transmits the output of the second adder to the other hearing aid having a transceiver for reception of the output of the second adder.
  • the output of the transceiver may be connected to a signal processor for further processing, such as hearing loss compensation, and the output of the signal processor may be connected to an output transducer that outputs a corresponding output to another ear of the user, or the output of the transceiver may be connected directly to the output transducer.
  • the noise signal may be presented in opposite phase, i.e. 180° phase shifted with relation to each other, at the two ears of the user, while the target estimate is presented in phase at the two ears of the user.
  • the first hearing aid includes a delay between the adder and the output transducer so that the relative phase of the signals output by the respective output transducers of the first and second hearing aids is maintained.
  • the improvement of SRT as a function of the phase shift has a maximum at 180°; however the function is sine-shape with a flat maximum so that the improvement obtained by a phase shift ranging from 150° to 210° is close to the maximum improvement.
  • the phase shift need not be exactly 180°, but preferably has a value within the range from 135° to 225°, more preferred from 150° to 210°.
  • the new binaural hearing aid system may comprise a multi-channel first hearing aid in which the microphone audio signals are divided into a plurality of frequency channels.
  • individual target signal estimates and noise estimates may be provided in each frequency channel of the plurality of frequency channels, or may be provided in one or more selected frequency channels of the plurality of frequency channels, or one or more target signal estimates and noise estimates may be provided for one or more respective groups of selected frequency channels of the plurality of frequency channels, or one target signal estimate and noise estimate may be provided based on all the frequency channels of the plurality of frequency channels.
  • the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • the new binaural hearing aid system may additionally provide circuitry used in accordance with other conventional methods of hearing loss compensation so that the new circuitry or other conventional circuitry can be selected for operation as appropriate in different types of sound environment.
  • the different sound environments may include speech, babble speech, restaurant clatter, music, traffic noise, etc.
  • the new binaural hearing aid system may for example comprise a Digital Signal Processor (DSP), the processing of which is controlled by selectable signal processing algorithms, each of which having various parameters for adjustment of the actual signal processing performed.
  • DSP Digital Signal Processor
  • the gains in each of the frequency channels of a multi-channel hearing aid are examples of such parameters.
  • One of the selectable signal processing algorithms operates in accordance with the new method.
  • various algorithms may be provided for conventional noise suppression, i.e. attenuation of undesired signals and amplification of desired signals.
  • Microphone audio signals obtained from different sound environments may possess very different characteristics, e.g. average and maximum sound pressure levels (SPLs) and/or frequency content. Therefore, each type of sound environment may be associated with a particular program wherein a particular setting of algorithm parameters of a signal processing algorithm provides processed sound of optimum signal quality in a specific sound environment.
  • a set of such parameters may typically include parameters related to broadband gain, corner frequencies or slopes of frequency-selective filter algorithms and parameters controlling e.g. knee-points and compression ratios of Automatic Gain Control (AGC) algorithms.
  • AGC Automatic Gain Control
  • Signal processing characteristics of each of the algorithms may be determined during an initial fitting session in a dispenser's office and programmed into the new binaural hearing aid system in a non-volatile memory area.
  • the new binaural hearing aid system may have a user interface, e.g. buttons, toggle switches, etc, of the hearing aid housings, or a remote control, so that the user of the new binaural hearing aid system can select one of the available signal processing algorithms to obtain the desired hearing loss compensation in the sound environment in question.
  • a user interface e.g. buttons, toggle switches, etc
  • the user of the new binaural hearing aid system can select one of the available signal processing algorithms to obtain the desired hearing loss compensation in the sound environment in question.
  • the new binaural hearing aid system may be capable of automatically classifying the user's sound environment into one of a number of sound environment categories, such as speech, babble speech, restaurant clatter, music, traffic noise, etc, and may automatically select the appropriate signal processing algorithm accordingly as known in the art.
  • Fig. 1 schematically illustrates an example of the new binaural hearing aid system 10.
  • the new binaural hearing aid system 10 has first and second hearing aids 10A, 10B.
  • the second hearing aid 10B has a receiver 48B and a transceiver (not shown) for reception of the input signal to the receiver 48B from the first hearing aid 10A by wired or wireless transmission.
  • the acoustic output signal emitted by the second hearing aid 10B is controlled by the first hearing aid 10A.
  • the first hearing aid 10A comprises one microphone 14 for provision of microphone audio signal 18 in response to sound received at the microphone 14.
  • the microphone audio signal 18 may be pre-filtered in respective pre-filters (not shown) well-known in the art, and input to the signal separation unit 12.
  • the signal separation unit 12 estimates the target signal and subtracts two times the estimated target signal from the microphone audio signal 18 to obtain a signal, in the following denoted "the phase shifted signal", representing the microphone audio signal 18; however, wherein the original target signal has been replaced by the estimate of the target signal phase shifted by 180°.
  • the phase shifted signal is output to a transceiver (not shown) in the first hearing aid 10A for transmission to the second hearing aid 10B.
  • a receiver 48 of the first hearing aid 10A converts the microphone audio signal 18 into an acoustic signal for transmission towards the eardrum of one ear of the user
  • the receiver 48B of the second hearing aid 10B converts the phase shifted signal into an acoustic signal for transmission towards the eardrum of the other ear of the user thereby improving BMLD and SRT.
  • the signal separation unit 12 may be configured to provide the estimate based on time-domain, spectral, and/or statistical characteristics of the microphone audio signal as is well-known in the art of noise reduction.
  • further processing may be applied to the respective signals before input to the respective receivers 48, 48B, e.g. for hearing loss compensation of the respective signals.
  • the new binaural hearing aid system (10) shown in Fig. 2 is similar to the hearing aid system shown in Fig. 1 except for the fact that the signal separation unit 12 shown in Fig. 2 is configured to provide both an estimate of the target signal 26 and an estimate of the noise signal 30 based on the possibly pre-filtered microphone audio signal 18.
  • the estimate of the target signal 26 is added to the estimate of the noise signal 30 in a first adder 42 and the output sum of the estimate of the target signal 26 and the estimate of the noise signal 30 is input to an output transducer 48 that converts the output of first adder 42 into an acoustic output signal that is transmitted towards the eardrum of the user wearing the binaural hearing aid system 10.
  • the estimate of the target signal 26 is subtracted; corresponding to a phase shift of 180°, from the estimate of the noise signal 30 in a second adder 50, and the output of the second adder 50 is transmitted output transducer 48Bfor conversion into an acoustic output signal that is transmitted towards the other eardrum of the user wearing the binaural hearing aid system 10.
  • the BMLD and SRT are improved.
  • the estimate of the target signal 26 and the estimate of the noise signal 30 may be swapped so that the estimate of the noise signal 20 is phase shifted 180° before presentation to one of the eardrums of the user instead of phase shifting the estimate of the target signal 26.
  • the improvement in BMLD and SRT obtained in this way is smaller than the improvement obtained by phase shift of the estimate of the target signal 26.
  • the new binaural hearing aid system (10) shown in Fig. 3 is similar to the hearing aid system shown in Fig. 1 except for the fact that a microphone audio signal 18B output by a microphone 14B in the second hearing aid 10B is transmitted by wired or wireless transmission to the first hearing aid 10A and input to the signal separation unit 12 so that the signal separation unit 12 can base the estimate of the target signal on both microphone audio signals 18, 18B, e.g. by beamforming as explained further below.
  • the new binaural hearing aid system (10) shown in Fig. 4 is similar to the hearing aid system shown in Fig. 3 except for the fact that the signal separation unit 12 shown in Fig. 4 , like the signal separation unit shown in Fig. 2 , is configured to provide both an estimate of the target signal 26 and an estimate of the noise signal 30 based on the possibly pre-filtered microphone audio signal 18.
  • the estimate of the target signal 26 is added to the estimate of the noise signal 30 in a first adder 42 and the output sum of the estimate of the target signal 26 and the estimate of the noise signal 30 is input to an output transducer 48 that converts the output of first adder 42 into an acoustic output signal that is transmitted towards the eardrum of the user wearing the binaural hearing aid system 10.
  • the estimate of the target signal 26 is subtracted; corresponding to a phase shift of 180°, from the estimate of the noise signal 30 in a second adder 50, and the output of the second adder 50 is transmitted output transducer 48Bfor conversion into an acoustic output signal that is transmitted towards the other eardrum of the user wearing the binaural hearing aid system 10.
  • the BMLD and SRT are improved.
  • Fig. 5 schematically illustrates a digital signal separation unit 12 including an adaptive beamformer 10 with two microphones 14, 16.
  • the microphone audio signals 18, 20 are pre-filtered in conventional pre-filters 22, 24 before beamforming.
  • the microphone audio signals 18, 20 may be digitized before or after the pre-filters 22, 24 by A/D converters (not shown). Signals before and after prefiltering and before and after analogue-digital conversion are all termed microphone audio signals.
  • the output 26 of first subtractor 28 generates the estimate of the target signal from the assumed target direction using adaptive beamforming.
  • the estimate of the target signal 26 is subsequently presented to one of the two ears of the user and in opposite phase to the other of the two ears of the user.
  • the output 30 of the adaptive filter 32 filtering the output of second subtractor 34 generates the noise estimate for subsequent presentation to both ears of the user.
  • h 2 ( n ) is the impulse response of sound propagation from the source emitting the signal s(n) to the second microphone 16
  • g 2 ( n ) is the the impulse response of sound propagation from the noise source emitting the signal q ( n ) to the second microphone 16.
  • the output 26 of the target signal is equal to h 1 ( n ) ⁇ s ( n ), and the output 30 of the noise estimate is equal to g 1 ( n ) ⁇ q ( n ).
  • Fig. 6 schematically illustrates a signal separation unit 12 based on four microphones 22, 24, 22B, 24B, two of which 22, 24 are located in the first hearing aid 10A and other two of which 22B, 24B are located in the second hearing aid 10B.
  • the increased distance between the microphones may be utilized to form a directional pattern with a narrow beam providing improved spatial separation of the target estimate from the noise estimate.
  • the conventional output of the beamformer may be used as the target estimate, and the noise estimate may be provided by subtraction of the target estimate from the microphone audio signal of one of the microphones in the plurality of microphones.
  • the microphone audio signals 18, 20 of the two microphones 22, 24 of the first hearing aid 10 are pre-filtered in respective pre-filters 22, 24 well-known in the art, into microphone audio signals y 1 (n), y 2 (n) and input to respective adaptive filters a 1 (n), a 2 (n).
  • the pre-filtered microphone audio signals of the two microphones 22B, 24B of the second hearing aid 10B are encoded for transmission in the second hearing aid 10B and transmitted to the first hearing aid 10A using wireless or wired data transmission.
  • the transmitted data representing the microphone audio signals of the two microphones 22B, 24B of the second hearing aid 10B are received by the transceiver 36 of the first hearing aid 10A and decoded in decoder 38 into two microphone audio signals y 3 (n), y 4 (n) and input to respective adaptive filters a 3 (n), a 4 (n).
  • the adaptive filters a 1 (n), a 2 (n), a 3 (n), a 4 (n) are configured to filter the respective microphone audio signals y 1 (n), y 2 (n), y 3 (n), y 4 (n) and to adapt the respective filter coefficients for adaptive beamforming towards a sound source.
  • the adaptable filters a 1 (n), a 2 (n), a 3 (n), a 4 (n) make it possible to focus on a moving sound source or to focus on a non-moving sound source, while the user of the hearing aid system is moving. Furthermore, the adaptable filters a 1 (n), a 2 (n), a 3 (n), a 4 (n) are capable of adapting to changes in the sound environment, such as appearance of a new sound source, disappearance of a noise source or movement of noise sources relative to the user of the hearing aid system.
  • the noise can consist of both directional noise and other types of noise such as diffuse noise or babble noise.
  • Filter adaptation is preferably performed using the least mean square (LMS) algorithm, more preferred the normalized least means square (NLMS) algorithm; however other algorithms may also be used, such as recursive least square, steepest descent or other types of numerical optimization algorithms.
  • LMS least mean square
  • NLMS normalized least means square
  • the signals are presented to the user in such a way that the SRT of the user is improved as schematically illustrated in Fig. 7 .
  • Fig. 7 shows an example of the new binaural hearing aid system 10.
  • the new binaural hearing aid system 10 has first and second hearing aids 10A, 10B with transceivers 36, 36B for data communication between the two hearing aids 10A, 10B.
  • the first hearing aid 10A comprises at least one microphone with two microphones 14, 16 for provision of microphone audio signals 18, 20 in response to sound received at the respective microphones 14, 16.
  • the microphone audio signals 18, 20 are pre-filtered in respective pre-filters 22, 24 well-known in the art, into microphone audio signals and input to the signal separation unit 12.
  • the signal separation unit 12 is shown in more detail in Fig. 6 and explained above with reference to Fig. 6 .
  • the second hearing aid 10B also comprises at least one microphone with two microphones 14B, 16B for provision of microphone audio signals 18B, 20B in response to sound received at the respective microphones 14B, 16B.
  • the microphone audio signals 18B, 20B are pre-filtered by pre-filters 22B, 24B as is well-known in the art.
  • the pre-filtered microphone audio signals of the two microphones 22B, 24B are encoded in Codec 40B for transmission to the first hearing aid 10A using wireless data transmission.
  • the transmitted data representing the microphone audio signals of the second hearing aid 10B are received by the transceiver 36 of the first hearing aid 10A and decoded in decoder 38 into two microphone audio signals that are input to the signal separation unit 12 as explained above with reference to Fig. 6 .
  • the signal separation unit 12 is configured to provide the estimate of the target signal 26 and the estimate of the noise signal 30 based on the pre-filtered microphone audio signals of the first and second hearing aids 10A, 10B.
  • the conventional output of the beamformer is used as the estimate of the target signal 26, and the estimate of the noise signal 30 is provided by subtraction of the estimate of the target signal 26 from the pre-filtered microphone audio signal of one of the microphones in the plurality of four microphones 14,16, 14B, 16B.
  • the signals are presented to the user in such a way that the SRT of the user is improved:
  • the estimate of the target signal 26 is added to the estimate of the noise signal 30 in a first adder 42 and the output sum of the estimate of the target signal 26 and the estimate of the noise signal 30 is delayed in delay 44 and input to a signal processor 46 for hearing loss compensation.
  • the delay 44 maintains the desired relative phase of the signals output by the first and second hearing aids 10A, 10B, respectively.
  • An output transducer 48 in the illustrated example a receiver 48, converts the output of the signal processor 46 into an acoustic output signal that is transmitted towards the eardrum of the user wearing the binaural hearing aid system 10.
  • the estimate of the target signal 26 is subtracted; corresponding to a phase shift of 180°, from the estimate of the noise signal 30 in a second adder 50, and the output of the second adder 50 is encoded in Codec 40 for transmission by transceiver 36 to the second hearing aid 10B.
  • the transmitted sum is received by the transceiver 36B and decoded by decoder 38B and input to signal processor 46B for hearing loss compensation.
  • An output transducer 48B in the illustrated example a receiver 48B, converts the output of the signal processor 46B into an acoustic output signal that is transmitted towards the eardrum of the user wearing the binaural hearing aid system 10. In this way, the SRT of the user may be improved up to 20 dB depending on the sound environment.
  • the estimate of the target signal 26 and the estimate of the noise signal 30 may be swapped so that the estimate of the noise signal 20 is phase shifted 180° before presentation to one of the eardrums of the user instead of phase shifting the estimate of the target signal 26.
  • the improvement in SRT obtained in this way is smaller than the improvement obtained by phase shift of the estimate of the target signal 26.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)

Claims (7)

  1. Binaurales Hörgerätesystem (10) umfassend
    eine Vielzahl von Mikrofonen (14, 16, 14B, 16B) zum Bereitstellen einer entsprechenden Vielzahl von Mikrofonaudiosignalen (18, 20, 18B, 20B) als Reaktion auf Schall, der an der Vielzahl von Mikrofonen (14, 16, 14B, 16B) empfangen wird,
    eine Signaltrennungseinheit mit einem Strahlformer (12), der konfiguriert ist, um eine Schätzung eines Zielsignals (26) und eine Schätzung eines Rauschsignals (30) basierend auf der Vielzahl von Mikrofonaudiosignalen (18, 20, 18B, 20B) bereitzustellen, wobei der Strahlformer (12) adaptive Filter (32) umfasst, von denen jeder konfiguriert ist, um ein entsprechendes der Vielzahl von Mikrofonaudiosignalen (18, 20, 18B, 20B) zu filtern,
    dadurch gekennzeichnet, dass
    der Strahlformer (12) einen Addierer (34) aufweist, mit
    einer Vielzahl von Eingängen, von denen jeder mit einem Ausgang eines jeweiligen der adaptiven Filter (32) verbunden ist, und
    einem Ausgang zum Bereitstellen der Summe der Ausgänge der adaptiven Filter (32), und wobei
    der Ausgang mit einem Eingang jedes der adaptiven Filter (32) verbunden ist, um die Summe der Ausgänge der adaptiven Filter (32) als Fehlerfunktion für jeden der adaptiven Filter (32) bereitzustellen, wobei jeder der adaptiven Filter (32) konfiguriert ist, um die Filterkoeffizienten anzupassen, um die Summe der Ausgänge der adaptiven Filter (32) zum Bereitstellen der Schätzung des Zielsignals (26) zu minimieren, und wobei
    der Strahlformer (12) einen Subtrahierer (28) umfasst, der konfiguriert ist, um die Schätzung des Zielsignals (26) von einem der Vielzahl von Mikrofonaudiosignalen (18, 20, 18B, 20B) zum Bereitstellen der Schätzung des Rauschsignals (30) zu subtrahieren.
  2. Binaurales Hörgerätesystem (10) nach Anspruch 1, wobei die adaptiven Filter (32) zum adaptiven Bestimmen der Filterkoeffizienten konfiguriert sind, durch Lösen des Optimierungsproblems: a i n i = 1 N = arg min a i n i = 1 N ‖ z n ‖ 2
    Figure imgb0014
     unter Berücksichtigung von: ∑ i = 1 N a i n ∗ h i n = h 1 n
    Figure imgb0015
     wobei
    z(n) die Summe der Ausgänge der adaptiven Filter (32) ist,
    n die Abtastzahl ist,
    N die Anzahl der adaptiven Filter (32) ist,
    i die Indexzahl der adaptiven Filter (32) ist,
    ai(n) der n-te Filterkoeffizient des i-ten adaptiven Filters ist, und
    hi(n) der n-te Abtastwert der Impulsantwort von Schallausbreitung von der Quelle ist, die das Signal an das i-te Mikrofon der Vielzahl von Mikrofonen (14, 16, 14B, 16B) sendet.
  3. Binaurales Hörgerätesystem (10) nach einem der vorstehenden Ansprüche, wobei die Anzahl von adaptiven Filtern 4 ist.
  4. Binaurales Hörgerätesystem (10) nach einem der vorstehenden Ansprüche, weiter umfassend
    ein erstes Hörgerät (10A), das mindestens ein Mikrofon (14, 16) zum Bereitstellen mindestens eines entsprechenden Mikrofonaudiosignals (18, 20) als Reaktion auf Schall, der an dem mindestens einen Mikrofon (14, 16) empfangen wird, umfasst, und
    ein zweites Hörgerät (10B), das mindestens ein Mikrofon (14B, 16B) zum Bereitstellen mindestens eines entsprechenden Mikrofonaudiosignals (18B, 20B) als Reaktion auf Schall, der an dem mindestens einen Mikrofon (14B, 16B) empfangen wird, umfasst, und wobei
    ein Sende-Empfänger (36B) in dem zweiten Hörgerät (10B) zum Übertragen von Signalen, die das mindestens eine Mikrofonaudiosignal (18B, 20B) darstellen, an das erste Hörgerät (10A) verbunden ist, und wobei
    ein Sende-Empfänger (36) in dem ersten Hörgerät (10A) zum Empfang der Signale, die das mindestens eine Mikrofonaudiosignal (18B, 20B) des zweiten Hörgeräts (10B) darstellen, verbunden ist, und wobei
    die Signaltrennungseinheit (12) zum Bereitstellen der Schätzung von einem von dem Zielsignal (26) und dem Rauschsignal (30) basierend auf dem mindestens einen Mikrofonaudiosignal (18, 20, 18B, 20B) der ersten und zweiten Hörgeräte (10A, 10B) konfiguriert ist.
  5. Binaurales Hörgerätesystem (10) nach einem der vorstehenden Ansprüche, weiter umfassend
    eine Phasenverschiebungsschaltung, die zum Phasenverschieben der Schätzung von einem von dem Zielsignal (26) und dem Rauschsignal (30) konfiguriert ist, und
    einen Phasenverschiebungsaddierer (50), der zum Bereitstellen eines phasenverschobenen Signals, das Schall darstellt, der an der Vielzahl von Mikrofonen (14, 16, 14B, 16B) empfangen wird, verbunden ist, wobei die Phasenverschiebung der Schätzung von einem von den Zielsignal (26) und dem Rauschsignal (30) im Wesentlichen das entsprechende Original von dem Zielsignal (26) und dem Rauschsignal (30) ersetzt hat, und
    einen ersten Empfänger (48) zum Umwandeln eines Empfängereingangs-signals in ein akustisches Signal zum Übertragen auf eines der Trommelfelle eines Benutzers des binauralen Hörgerätesystems (10), und
    einen zweiten Empfänger (48B) zum Umwandeln eines Empfängereingangs-signals in ein akustisches Signal zum Übertragen auf das andere der Trommelfelle des Benutzers, und wobei der Empfängereingang eines der ersten und zweiten Empfänger (48, 48B) mit einem Signal verbunden ist, das das phasenverschobene Signal darstellt, und
    wobei der Empfängereingang des anderen der ersten und zweiten Empfänger (48B, 48) mit einem Signal verbunden ist, das die Summe der Schätzung des Zielsignals (26) und der Schätzung des Rauschsignals (30) darstellt.
  6. Binaurales Hörgerätesystem (10) nach Anspruch 5, wobei die Phasenverschiebungsschaltung die Schätzung des Zielsignals (26) phasenverschiebt.
  7. Binaurales Hörgerätesystem (10) nach Anspruch 5 oder 6, wobei die Phasenverschiebung im Bereich von 150° bis 210° liegt.
EP16164585.8A 2011-12-30 2011-12-30 Hörgerät mit signalerweiterung Revoked EP3059979B1 (de)

Priority Applications (2)

Application Number Priority Date Filing Date Title
DK16164585.8T DK3059979T3 (da) 2011-12-30 2011-12-30 Et høreapparat med signalforbedring
EP16164585.8A EP3059979B1 (de) 2011-12-30 2011-12-30 Hörgerät mit signalerweiterung

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP11196247.8A EP2611215B1 (de) 2011-12-30 2011-12-30 Hörgerät mit Signalverbesserung
EP16164585.8A EP3059979B1 (de) 2011-12-30 2011-12-30 Hörgerät mit signalerweiterung

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
EP11196247.8A Division EP2611215B1 (de) 2011-12-30 2011-12-30 Hörgerät mit Signalverbesserung

Publications (2)

Publication Number Publication Date
EP3059979A1 EP3059979A1 (de) 2016-08-24
EP3059979B1 true EP3059979B1 (de) 2020-03-04

Family

ID=45470394

Family Applications (2)

Application Number Title Priority Date Filing Date
EP16164585.8A Revoked EP3059979B1 (de) 2011-12-30 2011-12-30 Hörgerät mit signalerweiterung
EP11196247.8A Active EP2611215B1 (de) 2011-12-30 2011-12-30 Hörgerät mit Signalverbesserung

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP11196247.8A Active EP2611215B1 (de) 2011-12-30 2011-12-30 Hörgerät mit Signalverbesserung

Country Status (2)

Country Link
EP (2) EP3059979B1 (de)
DK (2) DK3059979T3 (de)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210375274A1 (en) * 2020-05-29 2021-12-02 Beijing Baidu Netcom Science And Technology Co., Ltd. Speech recognition method and apparatus, and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DK3111672T3 (en) 2014-02-24 2018-01-02 Widex As HEARING WITH SUPPORTED NOISE PRESSURE

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002003749A2 (en) 2000-06-13 2002-01-10 Gn Resound Corporation Adaptive microphone array system with preserving binaural cues
US6449586B1 (en) 1997-08-01 2002-09-10 Nec Corporation Control method of adaptive array and adaptive array apparatus
US20050141731A1 (en) 2003-12-24 2005-06-30 Nokia Corporation Method for efficient beamforming using a complementary noise separation filter
US7254199B1 (en) 1998-09-14 2007-08-07 Massachusetts Institute Of Technology Location-estimating, null steering (LENS) algorithm for adaptive array processing
WO2007125132A2 (en) 2007-05-22 2007-11-08 Phonak Ag Method for feedback cancelling in a hearing device and a hearing device
EP1879426A2 (de) 2006-07-10 2008-01-16 Starkey Laboratories, Inc. Verfahren und Vorrichtung für ein binaurales Hörgerätesystem unter Verwendung monauraler Audiosignale
US20100135500A1 (en) 2007-01-30 2010-06-03 Phonak Ag Method and system for providing binaural hearing assistance
WO2011006496A1 (en) 2009-07-15 2011-01-20 Widex A/S Method and processing unit for adaptive wind noise suppression in a hearing aid system and a hearing aid system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1316240B1 (de) 2000-07-14 2005-11-09 GN ReSound as Synchronisiertes binaurales hörsystem

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6449586B1 (en) 1997-08-01 2002-09-10 Nec Corporation Control method of adaptive array and adaptive array apparatus
US7254199B1 (en) 1998-09-14 2007-08-07 Massachusetts Institute Of Technology Location-estimating, null steering (LENS) algorithm for adaptive array processing
WO2002003749A2 (en) 2000-06-13 2002-01-10 Gn Resound Corporation Adaptive microphone array system with preserving binaural cues
US20050141731A1 (en) 2003-12-24 2005-06-30 Nokia Corporation Method for efficient beamforming using a complementary noise separation filter
EP1879426A2 (de) 2006-07-10 2008-01-16 Starkey Laboratories, Inc. Verfahren und Vorrichtung für ein binaurales Hörgerätesystem unter Verwendung monauraler Audiosignale
US20100135500A1 (en) 2007-01-30 2010-06-03 Phonak Ag Method and system for providing binaural hearing assistance
WO2007125132A2 (en) 2007-05-22 2007-11-08 Phonak Ag Method for feedback cancelling in a hearing device and a hearing device
WO2011006496A1 (en) 2009-07-15 2011-01-20 Widex A/S Method and processing unit for adaptive wind noise suppression in a hearing aid system and a hearing aid system

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
ELKO ET AL.: "A simple adaptive first-order differential microphone", PROCEEDINGS OF 1995 WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS, 15 October 1995 (1995-10-15), XP000651966, ISBN: 0-7803-3064-1
HERBORDT ET AL.: "Analysis Of Blocking Matrices For Generalized Sidelobe Cancellers For Non- Stationary Broadband Signals", 2002 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1 May 2002 (2002-05-01), pages 4187 - 4187, XP055763027
JOHANSSON ET AL.: "Binaural masking level difference for speech signals in noise", INTERNATIONAL JOURNAL OF AUDIOLOGY, vol. 41, August 2002 (2002-08-01), pages 279 - 284, XP055763026
LU ET AL.: "Binaural masking level differences in actual and simulated bilateral cochlear implant listeners", THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, vol. 127, no. 3, March 2010 (2010-03-01), pages 1479 - 1490, XP012135290

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210375274A1 (en) * 2020-05-29 2021-12-02 Beijing Baidu Netcom Science And Technology Co., Ltd. Speech recognition method and apparatus, and storage medium

Also Published As

Publication number Publication date
EP3059979A1 (de) 2016-08-24
DK3059979T3 (da) 2020-06-08
EP2611215A1 (de) 2013-07-03
DK2611215T3 (en) 2016-07-04
EP2611215B1 (de) 2016-04-20

Similar Documents

Publication Publication Date Title
US8891777B2 (en) Hearing aid with signal enhancement
US9185499B2 (en) Binaural hearing aid with frequency unmasking
US9282411B2 (en) Beamforming in hearing aids
US6888949B1 (en) Hearing aid with adaptive noise canceller
AU2016201028B2 (en) Signal enhancement using wireless streaming
US9432778B2 (en) Hearing aid with improved localization of a monaural signal source
US6704422B1 (en) Method for controlling the directionality of the sound receiving characteristic of a hearing aid a hearing aid for carrying out the method
EP2928213B1 (de) Hörgerät mit verbesserter Lokalisierung einer monauralen Signalquelle
AU5391600A (en) A method for controlling the directionality of the sound receiving characteristic of a hearing aid and a hearing aid for carrying out the method
CN103546849B (zh) 具有频率无掩蔽的双耳助听器
EP3059979B1 (de) Hörgerät mit signalerweiterung
EP2683179B1 (de) Hörgerät mit Frequenzdemaskierung
Ngo Digital signal processing algorithms for noise reduction, dynamic range compression, and feedback cancellation in hearing aids
WO2020245232A1 (en) Bilateral hearing aid system comprising temporal decorrelation beamformers
US11617037B2 (en) Hearing device with omnidirectional sensitivity
JP2013153427A (ja) 周波数アンマスキング機能を有する両耳用補聴器
CN115278493A (zh) 具有全向灵敏度的听力设备

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AC Divisional application: reference to earlier application

Ref document number: 2611215

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170220

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: GN HEARING A/S

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20190926

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AC Divisional application: reference to earlier application

Ref document number: 2611215

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1241821

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200315

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602011065451

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20200603

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200604

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200304

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200604

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200605

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200704

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200729

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1241821

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200304

REG Reference to a national code

Ref country code: DE

Ref legal event code: R026

Ref document number: 602011065451

Country of ref document: DE

PLBI Opposition filed

Free format text: ORIGINAL CODE: 0009260

PLAX Notice of opposition and request to file observation + time limit sent

Free format text: ORIGINAL CODE: EPIDOSNOBS2

26 Opposition filed

Opponent name: OTICON A/S

Effective date: 20201203

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

PLBB Reply of patent proprietor to notice(s) of opposition received

Free format text: ORIGINAL CODE: EPIDOSNOBS3

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20201231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201230

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201230

RDAF Communication despatched that patent is revoked

Free format text: ORIGINAL CODE: EPIDOSNREV1

REG Reference to a national code

Ref country code: DE

Ref legal event code: R103

Ref document number: 602011065451

Country of ref document: DE

Ref country code: DE

Ref legal event code: R064

Ref document number: 602011065451

Country of ref document: DE

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20211221

Year of fee payment: 11

Ref country code: FR

Payment date: 20211215

Year of fee payment: 11

Ref country code: DE

Payment date: 20211222

Year of fee payment: 11

Ref country code: DK

Payment date: 20211217

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20211217

Year of fee payment: 11

RDAG Patent revoked

Free format text: ORIGINAL CODE: 0009271

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: PATENT REVOKED

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: FI

Ref legal event code: MGE

27W Patent revoked

Effective date: 20211213

GBPR Gb: patent revoked under art. 102 of the ep convention designating the uk as contracting state

Effective date: 20211213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200304