EP3038381B1 - Diffuse noise listening - Google Patents
Diffuse noise listening Download PDFInfo
- Publication number
- EP3038381B1 EP3038381B1 EP14199590.2A EP14199590A EP3038381B1 EP 3038381 B1 EP3038381 B1 EP 3038381B1 EP 14199590 A EP14199590 A EP 14199590A EP 3038381 B1 EP3038381 B1 EP 3038381B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- hearing aid
- audio signal
- sound
- hearing
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005236 sound signal Effects 0.000 claims description 127
- 230000006870 function Effects 0.000 claims description 75
- 238000012546 transfer Methods 0.000 claims description 75
- 206010011878 Deafness Diseases 0.000 claims description 33
- 230000010370 hearing loss Effects 0.000 claims description 33
- 231100000888 hearing loss Toxicity 0.000 claims description 33
- 208000016354 hearing loss disease Diseases 0.000 claims description 33
- 238000001914 filtration Methods 0.000 claims description 27
- 238000000034 method Methods 0.000 claims description 16
- 230000004044 response Effects 0.000 claims description 14
- 238000001228 spectrum Methods 0.000 claims description 13
- 230000001364 causal effect Effects 0.000 claims description 10
- 238000006243 chemical reaction Methods 0.000 claims description 10
- 230000008569 process Effects 0.000 claims description 8
- 230000001902 propagating effect Effects 0.000 claims description 7
- 230000006872 improvement Effects 0.000 claims description 6
- 238000012545 processing Methods 0.000 description 12
- 210000003128 head Anatomy 0.000 description 8
- 238000007781 pre-processing Methods 0.000 description 6
- 230000003044 adaptive effect Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 4
- 208000032041 Hearing impaired Diseases 0.000 description 3
- 241000282412 Homo Species 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 230000004807 localization Effects 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 230000005534 acoustic noise Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 210000000613 ear canal Anatomy 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001629 suppression Effects 0.000 description 2
- 101100228469 Caenorhabditis elegans exp-1 gene Proteins 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 210000003484 anatomy Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 238000004870 electrical engineering Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000011045 prefiltration Methods 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 210000003454 tympanic membrane Anatomy 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/40—Arrangements for obtaining a desired directivity characteristic
- H04R25/407—Circuits for combining signals of a plurality of transducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/552—Binaural
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/554—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired using a wireless connection, e.g. between microphone and amplifier or using Tcoils
Definitions
- a new hearing aid is provided with improved reduction of diffuse noise with preserved spatial awareness.
- Hearing aid users have been reported to have poorer ability to localize sound sources when wearing their hearing aids than without their hearing aids. This represents a serious problem for the mild-to-moderate hearing impaired population.
- hearing aids typically reproduce sound in such a way that the user perceives sound sources to be localized inside the head. The sound is said to be internalized rather than being externalized.
- a common complaint for hearing aid users when referring to the "hearing speech in noise problem" is that it is very hard to follow anything that is being said even though the signal to noise ratio (SNR) should be sufficient to provide the required speech intelligibility.
- SNR signal to noise ratio
- a significant contributor to this fact is that the hearing aid reproduces an internalized sound field. This adds to the cognitive loading of the hearing aid user and may result in listening fatigue and ultimately that the user removes the hearing aid(s).
- new hearing aids have been disclosed with improved localization of sound sources, i.e. the new hearing aids preserve information of the directions of respective sound sources in the sound environment with relation to the orientation of the head of the wearer of the hearing aid, see EP 2 750 410 A1 , EP 2 750 411 A1 , and EP 2 750 412 A1 .
- Improved sound source localization enables hearing aid users to utilize the cocktail party effect, i.e. the user is able to focus the auditory attention on a selected sound source while suppressing all other sounds, e.g. to focus on a single conversation in a noisy room at a party.
- Directional systems operate to suppress signal energy from all other directions than a target direction. This requires that interfering sound has a directional nature; however, in complex listening situations, such as in a restaurant, the hearing aid user experiences interference from diffuse noise. Diffuse noise is, or approximately is, spatially white, i.e. the signal recorded in the noise field is uncorrelated with any other signal record at a different location. The number of microphones in a hearing aid system is typically not sufficient to efficiently suppress diffuse noise. Therefore, directional systems have limited effect for these types of listening situations.
- US 2004/0136541 A1 discloses a BTE hearing aid with a microphone disposed outside the ear canal and having a compensation filter for filtering the output signal of the microphone for restoring spatial cues in the signal for improved user capability of localization of a sound source.
- a new method of increasing a signal to noise ratio of a sound signal received in an environment with diffuse noise comprising converting sound into an audio signal using a microphone system, and filtering the audio signal with a matched filter having a matching transfer function that matches or substantially matches a transfer function of a sound propagation path of the acoustic sound from a sound source to the microphone system, when the microphone system is worn by a user.
- the transfer function preferably includes the transfer function of the microphone system.
- a matched filter is said to have a matching transfer function that matches or substantially matches another transfer function when the matching transfer function is equal to, or substantially equal to, a complex conjugate, multiplied by a complex scalar, of the other transfer function, wherein the value of the complex scalar is selected so that the matched filter is a causal filter.
- the matched filter may have an impulse response that is equal to, or substantially equal to, the time reversed and time shifted impulse response, possibly time shifted to ensure that the matched filter is a causal filter, of a sound propagation path from the sound source to the microphone system, when the microphone system is worn by a user.
- the matched filter may perform equalisation of the amplitude spectrum of the filtered audio signal to compensate for the changes of the amplitude spectrum caused by the transfer function.
- the new method may further comprise adding a plurality of filtered audio signals into a sum audio signal for further improvement of the signal to noise ratio.
- a new hearing aid comprising a first microphone system configured for conversion of sound emitted by a sound source into a first audio signal, a first matched filter configured for filtering the first audio signal into a first filtered audio signal, the first matched filter having a first matching transfer function that matches or substantially matches a first transfer function of a first sound propagation path of the sound propagating from the sound source to the first microphone system providing the first audio signal, when a user wears the hearing aid, and a hearing loss processor configured to provide a hearing loss compensated output signal that compensates for a hearing loss of the user based at least in part on the first filtered audio signal.
- the hearing aid may further comprise a second microphone system configured for conversion of sound into a second audio signal, and a second matched filter configured for filtering the second audio signal into a second filtered audio signal, the second matched filter having a second matching transfer that matches or substantially matches a second transfer function of a second sound propagation path of the sound propagating from the sound source to the second microphone system providing the second audio signal, when the user wears the hearing aid, a first adder configured for adding the first filtered audio signal and the second filtered audio signal to obtain a sum audio signal, wherein the hearing loss processor is configured to process the sum audio signal to provide the hearing loss compensated output signal.
- the first matched filter may be connected to an output of a microphone of the first microphone system for filtering the audio signal provided at the output of the microphone into a filtered audio signal.
- the first matched filter may be connected to a combined output of a plurality of microphones of the first microphone system for filtering the audio signal provided at the combined output of the plurality of microphones into a filtered audio signal.
- the first matched filter may have an impulse response that is equal to, or substantially equal to, a time reversed and possibly time shifted impulse response, possibly time shifted to ensure that the first matched filter is a causal filter, of a first sound propagation path from the sound source to the first microphone system, when the first microphone system is worn by a user.
- the first matched filter may perform equalisation of the amplitude spectrum of the first filtered audio signal to compensate for changes of the amplitude spectrum caused by the first transfer function.
- the second matched filter may be connected to an output of a microphone of the second microphone system for filtering the audio signal provided at the output of the microphone into a filtered audio signal.
- the second matched filter may be connected to a combined output of a plurality of microphones of the second microphone system for filtering the audio signal provided at the combined output of the plurality of microphones into a filtered audio signal.
- the second matched filter may have an impulse response that is equal to, or substantially equal to, a time reversed and possibly time shifted impulse response, possibly time shifted to ensure that the second matched filter is a causal filter, of a second sound propagation path from the sound source to the second microphone system, when the second microphone system is worn by a user.
- the second matched filter may perform equalisation of the amplitude spectrum of the second filtered audio signal to compensate for changes of the amplitude spectrum caused by the second transfer function.
- the first and second matching transfer functions may substantially equalize a phase of the first filtered audio signal and a phase of the second filtered audio signal, so that the first adder can add the first and second filtered audio signals in-phase.
- a transfer function of a sound propagation path from the sound source to a microphone system providing an audio signal, when the hearing aid is worn by a user is termed a microphone related transfer function.
- the microphone related transfer function preferably includes the transfer function of the microphone system.
- the hearing aid also comprises an output transducer for conversion of the hearing loss compensated output signal to an auditory output signal, such as an acoustic output signal, or an implanted transducer signal, that can be received by the human auditory system.
- an auditory output signal such as an acoustic output signal, or an implanted transducer signal
- the new hearing aid may be of any type of hearing aid, such as a BTE, a RIE, an ITE, an ITC, a CIC, etc., hearing aid or combination of these.
- the new hearing aid may form part of a new binaural hearing aid system using data exchange between the hearing aids to optimize performance.
- the matched filter operates to improve the SNR of a signal emitted from a sound source in an environment with significant diffuse acoustic noise, e.g. at a gathering with a lot of simultaneous conversation.
- the microphone related transfer function depends on the direction and distance to the sound source with relation to the user of the hearing aid and the anatomy of the user, due to diffraction around the head, reflections from shoulders, reflections by the pinna and in the ear canal, etc.
- one or more microphone related transfer functions of selected directions and distances are determined for the individual user and matched or substantially matched by one or more respective matched filters.
- the microphone related transfer functions like the HRTFs do not change with distance.
- the listener resides in the far field of a sound source, when the distance to the sound source is larger than 1.5 m.
- the determined microphone related transfer functions may be the far field microphone related transfer functions of selected directions.
- Approximate microphone related transfer functions may be used instead of the microphone related transfer functions individually determined for the user. Approximate microphone related transfer functions may be determined using an artificial head, such as a KEMAR head. In this way, approximations to the individual microphone related transfer functions are provided that can be of sufficient accuracy for the hearing aid user to obtain an improved SNR in an environment with diffuse noise.
- the approximate microphone related transfer functions may also be determined as an average of previously determined microphone related transfer functions for a group of people. This group may be selected to fit certain features of the human for which the individual microphone related transfer functions are to be determined in order to obtain approximate microphone related transfer functions that more closely match the respective corresponding individual microphone related transfer functions. For example, the group may be selected according to age, race, gender, family, ear size, etc., either alone or in any combination.
- the approximate microphone related transfer functions may also include averages over a number of directions.
- the approximate microphone related transfer functions may also be microphone related transfer functions previously determined for the patient in question, e.g. during a previous fitting session at an earlier age.
- the selected directions of the microphone related transfer functions matched or substantially matched by matched filters in the hearing aid preferably include the forward looking direction of the user, but may comprise any direction or a multitude of directions.
- the hearing aid comprises a plurality of matched filters
- the hearing aid also comprises an adder configured for adding the filtered audio signals provided at the outputs of the matched filters, into a sum audio signal that is input to the hearing loss processor for processing into the hearing loss compensated output signal.
- the sound source is located in the assumed direction so that the sound source emits sound that propagates along those propagation paths to the respective microphones, whose transfer functions are matched or substantially matched by the respective matched filters, the matched filters equalize the phase component originating from the propagation of the acoustic wave from the source to the microphone from the recorded signals so that subsequently, the adder adds the filtered signals in-phase to further improve the SNR of the output signal sum. This is due to the fact that the diffuse noise is uncorrelated over both time and space so that the filtering leads to SNR improvement and so does averaging over microphones.
- Further microphones connected to respective matched filters may be added to the circuitry with further filtered audio signals input to the adder for further improvement of the SNR of the sum audio signal.
- the adder may form a weighted sum of the signals input to the adder.
- the first microphone system may comprise a first microphone configured for conversion of sound into the first audio signal
- the second microphone system may comprise a second microphone configured for conversion of sound into the second audio signal
- the new hearing aid may form part of a new binaural hearing aid system, comprising a left ear hearing aid and a right ear hearing aid, and wherein one of the left ear hearing aid and the right ear hearing aid is the new hearing aid.
- one of the left ear hearing aid and the right ear hearing aid may have at least one matched filter configured to filter an audio signal originating from a microphone of the other one of the left ear hearing aid and the right ear hearing aid.
- the new binaural hearing aid system may comprise a first hearing aid and a second hearing aid, wherein each of the first and second hearing aids comprises a first microphone system configured for conversion of sound emitted by a sound source into a first audio signal, a first matched filter configured for filtering the first audio signal into a first filtered audio signal, the first matched filter having a first matching transfer function that matches or substantially matches a first transfer function of a first sound propagation path of the sound propagating from the sound source to the first microphone system providing the first audio signal, when a user wears the hearing aid, and a hearing loss processor configured to provide a hearing loss compensated output signal that compensates for a hearing loss of the user based at least in part on the first filtered audio signal.
- each of the first and second hearing aids comprises a first microphone system configured for conversion of sound emitted by a sound source into a first audio signal, a first matched filter configured for filtering the first audio signal into a first filtered audio signal, the first matched filter having a first matching
- Each of the first and second hearing aids may further comprise a second microphone system configured for conversion of sound into a second audio signal, and a second matched filter configured for filtering the second audio signal into a second filtered audio signal, the second matched filter having a second matching transfer that matches or substantially matches a second transfer function of a second sound propagation path of the sound propagating from the sound source to the second microphone system providing the second audio signal, when the user wears the hearing aid, a first adder configured for adding the first filtered audio signal and the second filtered audio signal to obtain a sum audio signal, wherein the hearing loss processor is configured to process the sum audio signal to provide the hearing loss compensated output signal.
- the hearing loss processor of one of the first and second hearing aids may have an input that is connected to an output of the first adder of the other one of the first and second hearing aids, and wherein the processor is configured for adding the outputs of the first adders of the left ear hearing aid and the right ear hearing aid.
- the first hearing aid may have a second adder with a first input that is connected to an output of the first adder of the first hearing aid and a second input that is connected to an output of the first adder of the second hearing aid, and an output for provision of a binaural sum of the sum audio signal of the first hearing aid and the sum audio signal of the second hearing aid, and wherein the hearing loss processor is configured to process the binaural sum audio signal to provide the hearing loss compensated output signal.
- Signals may be communicated wired or wirelessly between the left ear hearing aid and the right ear hearing aid as is well-known in the art of hearing aids.
- n th microphone receives a noisy version of a sound signal, e.g. speech; the user desires to listen to.
- V n ( ⁇ ) is the corresponding masker signal spectrum.
- E is the expectancy operator and * denotes complex conjugate.
- the masker has a Gaussian distribution.
- conditional probability of measuring s ( ⁇ ) given X( ⁇ ) is proportional to P s ⁇
- ⁇ is the convolution operator, i.e. f 1 ⁇ f 2 means the convolution of functions f 1 and f 2
- h n (t) is the inverse Fourier transform of H n ( ⁇ )
- s n (t) is the n th measured microphone signal
- the new hearing aid may be a multi-channel hearing aid, in which audio signals to be processed are divided into a plurality of signal components for being processed individually in a plurality of frequency channels, respectively.
- One of, some of; or, all of the matched filters may also be divided into the plurality of frequency channels; or, may still operate in the entire frequency range of the hearing aid; or, may be divided into other frequency channels, typically fewer frequency channels, than other parts of the hearing aid circuitry are divided into.
- one of, some of; or, all of the matched filters may operate in respective selected frequency bands.
- Each of the selected frequency bands may comprise one or more of the frequency channels, or all of the frequency channels.
- the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
- the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
- the audio signals may be processed for hearing loss compensation in a conventional way.
- the terms “substantially” and “approximately” account for fluctuations and inaccuracies experienced within the field of electrical engineering and are intended to mean that deviations from absolute are included within the scope of the term or expression so modified. For example, they can refer to deviations that are less than or equal to ⁇ 10%, such as less than or equal to ⁇ 5%, such as less than or equal to ⁇ 2%, such as less than or equal to ⁇ 1 %, such as less than or equal to ⁇ 0.5%, such as less than or equal to ⁇ 0.2%, such as less than or equal to ⁇ 0.1%.
- Signal processing, including filtering, in the new hearing aid may be performed by dedicated hardware or may be performed in a signal processor, or performed in a combination of dedicated hardware and one or more signal processors.
- processor As used herein, the terms “processor”, “signal processor”, “controller”, “system”, etc., are intended to refer to CPU-related entities, either hardware, a combination of hardware and software, software, or software in execution.
- the term processor may also refer to any integrated circuit that includes some hardware, which may or may not be a CPU-related entity.
- a processor may include a filter.
- a "processor”, “signal processor”, “controller”, “system”, etc. may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
- processor designate both an application running on a processor and a hardware processor.
- processors may reside within a process and/or thread of execution, and one or more "processors”, “signal processors”, “controllers”, “systems”, etc., or any combination hereof, may be localized on one hardware processor, possibly in combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
- a processor may be any component or any combination of components that is capable of performing signal processing.
- the signal processor may be an ASIC processor, a FPGA processor, a general purpose processor, a microprocessor, a circuit component, or an integrated circuit.
- Fig. 1 schematically illustrates a user 100 wearing a BTE hearing aid (only the microphones of the hearing aid are shown) on the user's right ear.
- the BTE hearing aid 10 has two microphones 12, 24 accommodated in the BTE hearing aid housing in such a way that a line through centres of the microphones extends in parallel with a forward looking direction of the user.
- the user 100 desires to listen to speaker 110; however, the user and listener 100 and the speaker 110 are surrounded by a number of other people (not shown) also engaged in various conversations.
- the user 100 is exposed to a diffuse noise field and as a result the hearing impaired user cannot focus the auditory attention on the selected sound source, i.e. the conversation partner 110, while suppressing speech from other talkers and other sounds.
- Fig. 2 shows a blocked schematic of the BTE hearing aid 10 worn by the user 100 in Fig. 1 .
- the illustrated BTE hearing aid 10 has a front microphone 12 that converts acoustic sound into a front audio signal 14.
- the front audio signal 14 is pre-processed in a first pre-processing filter 16 into a pre-processed front audio signal 18.
- the pre-processing may include, without excluding any form of processing, adaptive and/or static feedback suppression and/or adaptive and/or fixed beamforming and/or pre-filtering.
- a first matched filter 20 is connected to the output of the first pre-processing filter 16 and operates to filter the pre-processed front audio signal 18 into a front filtered audio signal 22.
- a sound source 110 see Fig. 1 , resides in the forward looking direction of the user 100 and emits sound to the microphone 12 when worn by the user 100 of the hearing aid 10.
- the front microphone 12 has the far field microphone related transfer function H 1 ( ⁇ ) of the front looking direction, and the first matched filter 20 has a matching transfer function that is a equal to the complex conjugate of the far field microphone related transfer function H 1 *( ⁇ ) multiplied by the complex scalar e -j ⁇ t to ensure that the impulse response h 1 (T-t) of the first matched filter 20 is causal.
- the illustrated BTE hearing aid 10 also has a rear microphone 24 that converts acoustic sound into a rear audio signal 26.
- the rear audio signal 26 is pre-processed in a second pre-processing filter 28 into a pre-processed rear audio signal 30.
- the pre-processing may include, without excluding any form of processing, adaptive and/or static feedback suppression and/or adaptive and/or fixed beamforming and/or pre-filtering.
- a second matched filter 32 is connected to the output of the second pre-processing filter 28 and operates to filter the pre-processed rear audio signal 30 into a rear filtered audio signal 34.
- the rear microphone 24 has the far field microphone related transfer function H 2 ( ⁇ ) of the front looking direction, and the second matched filter 32 has a matching transfer function that is equal or substantially equal to the complex conjugate of the far field microphone related transfer function H 2 *( ⁇ ) multiplied by the complex scalar e -j ⁇ T to ensure that the impulse response h 2 (T-t) of the second matched filter 32 is causal.
- Other embodiments of the hearing aid 10 may have a number of microphones that is larger than two.
- the matched filters 20, 32 operate to improve the SNR of the audio signals 14, 26 that originate from a sound source 110 in an environment with significant diffuse acoustic noise, e.g. at a gathering with a lot of simultaneous conversation.
- the front and rear audio signals 22, 34 are input to an adder 36 that adds the front and rear audio signals 22, 34 into the sum audio signal 38.
- the matched filters 20, 32 remove the phase from their respective input signals 18, 30 so that subsequently, the adder 36 adds the filtered signals 22, 34 in-phase to further improve the SNR of the sum audio signal 38.
- the adder 36 may form a weighted sum of the signals 22, 34 input to the adder 36.
- the sum audio signal 38 is input to a hearing loss processor 40 configured to process the sum audio signal 38 into a hearing loss compensated output signal 42 that is compensated for the hearing loss of the user in a way well-known in the art of hearing aids, possibly in accordance with a number of selectable hearing programmes stored in a memory (not shown) of the hearing aid 10.
- the hearing loss compensated output signal 42 is input to an output transducer 44 in the form of a receiver 44 for conversion of the hearing loss compensated output signal 42 into an acoustic output signal that is transmitted towards an eardrum of the user 100 wearing the hearing aid 10.
- the microphone related transfer functions H 1 ( ⁇ ), H 2 ( ⁇ ) of the respective acoustic propagation paths 120, 130 from the sound source 110 in the forward looking direction of the user 100 to the respective microphones 12, 24 are determined for the individual user 100 and matched by the respective matched filters 20, 32.
- approximate microphone related transfer functions H 1 '( ⁇ ), H 2 '( ⁇ ) may be used instead.
- H 1 '( ⁇ ), H 2 '( ⁇ ) may be determined using an artificial head, such as a KEMAR head, whereby approximated microphone related transfer functions H 1 '( ⁇ ), H 2 '( ⁇ ) are provided of sufficient accuracy for the hearing aid user 100 to obtain an improved SNR of the sum audio signal 38 in an environment with diffuse noise.
- the approximate microphone related transfer functions H 1 '( ⁇ ), H 2 '( ⁇ ) may also be determined as an average of previously determined microphone related transfer functions for a group of humans.
- the group of humans may be selected to fit certain features of the human for which the individual microphone related transfer functions are to be determined in order to obtain approximate microphone related transfer functions that more closely match the respective corresponding individual microphone related transfer functions.
- the group of humans may be selected according to age, race, gender, family, ear size, etc., either alone or in any combination. Averaging may also be performed over a number of directions.
- the approximate microphone related transfer functions may also be microphone related transfer functions previously determined for the user in question, e.g. during a previous fitting session at an earlier age.
- ⁇ is the convolution operator, i.e. f1 ⁇ f2 means the convolution of functions f1 and f2
- n is a microphone index, i.e.
- h n (t) is the inverse Fourier transform of H n ( ⁇ )
- s n (t) is the n th pre-filtered microphone signal 18, 30
- g t F ⁇ 1 1 h H ⁇ h ⁇ is a filter describing the amplitude equalization across frequency to compensate for the filtering operation.
- the summation is performed in the adder 36 while multiplication by g(t) is performed by the processor 40.
- the hearing aid 10 shown in Fig. 2 may be a multi-channel hearing aid in which audio sound signals 14, 26 to be processed are divided into a plurality of frequency channels, and wherein audio signals are processed individually in each of the frequency channels, possibly apart from the matched filters 20, 32 that may still operate in the entire frequency range of the hearing aid 10, or, may be divided into other frequency channels, typically fewer frequency channels than the remaining illustrated circuitry.
- FIG. 2 may illustrate the circuitry and signal processing in a single frequency channel of the audio signals 14, 26.
- the illustrated circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
- the signal processing illustrated in Fig. 2 may be performed in a selected frequency band.
- the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
- the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
- the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
- the audio signals may be processed for hearing loss compensation without matched filtering 20, 32.
- Fig. 3 schematically illustrates a user 100 wearing a binaural hearing aid system with a left ear BTE hearing aid accommodating microphones 12B, 24B and a right ear BTE hearing aid accommodating microphones 12A, 24A.
- Signals may be communicated wired or wirelessly between the left ear hearing aid and the right ear hearing aid in a way well-known in the art of signal transmission.
- each of the left ear BTE hearing aid and the right ear BTE hearing aid of the binaural hearing aid system operates in the same way as the hearing aid 10 with the blocked schematic shown in Fig. 2 apart from the fact that the filtered audio signal of each hearing aid is transmitted to the other hearing aid and added to the filtered audio signal of the other hearing aid as shown in Fig. 4 .
- Fig. 4 shows a blocked schematic of a binaural hearing aid system 10 comprising a right ear hearing aid 10A and a left ear hearing aid 10B, each of which operates in the same way as the hearing aid 10 shown in Fig. 2 apart from the fact that the sum audio signal 38A, 38B, respectively, of each of the right ear hearing aid 10A and left ear hearing aid 10B, is transmitted to the other hearing aid 10B, 10A and added to the sum audio signal 38B, 38A of the other hearing aid 10B, 10A in the respective processor 40B, 40A.
- the required wired or wireless interface circuitry is not shown.
- one or more microphones with pre-filters connected to respective matched filters may be added to the circuitry of the hearing aids 10A, 10B as indicated by the vertical lines of dots, generating filtered output audio signals input to the adder 36A, 36B for further improvement of the SNR of the sum audio signal 38A, 38B.
- the number of microphones in the right ear hearing aid 10A and the left ear hearing aid 10B is preferably, but need not be, the same.
- the binaural hearing aid system 10 may comprise four microphones, namely a front microphone 12A, 12B and a rear microphone 24A, 24B, in each of the right ear hearing aid 10A and the left ear hearing aid 10B of the binaural hearing aid system 10.
- Each of the hearing aids 10A, 10B shown in Fig. 4 may be a multi-channel hearing aid in which audio sound signals 14A, 26A, 14B, 26B to be processed are divided into a plurality of frequency channels, and wherein audio signals are processed individually in each of the frequency channels, possibly apart from the matched filters 20A, 32A, 20B, 32B that may still operate in the entire frequency range of the respective hearing aid 10A, 10B; or, may be divided into other frequency channels, typically fewer frequency channels than the remaining illustrated circuitry.
- Fig. 4 may illustrate the circuitry and signal processing in a single frequency channel of the audio signals 14A, 26A, 1B, 26B.
- the illustrated circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
- the signal processing illustrated in Fig. 4 may be performed in a selected frequency band.
- the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
- the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
- the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
- the audio signals may be processed for hearing loss compensation without matched filtering 20A, 32A, 20B, 32B.
- circuitry of the right ear hearing aid 10A and left ear hearing aid 10B may be identical as shown in Fig. 4 .
- the circuit components may be distributed in arbitrary ways between the two hearing aid housings in accordance with design choices well-known in the art of hearing aids.
- one of the hearing aids 10A may comprise all of the required matched filters 20A, 32A, 20B, 32B, and the processor 40A, while the other one of the hearing aids 10B does not comprise matched filters and a processor.
- microphone output signals, possibly pre-processed, 18B, 30B are transmitted to the hearing aid comprising the respective matched filters 20B, 32B, and wherein the processor 40A is configured to output the hearing loss compensated output signals 42A, 42B for both ears of the user.
- the hearing loss compensated output signal 42B for the other ear is then transmitted to the hearing aid 10B without matched filters and input to the output transducer 44B of the hearing aid 10B.
- the required wired or wireless interface circuitry for signal transfer between the hearing aids 10A, 10B is not shown.
- Fig. 6 shows a directionality plot 50 of the sum audio signal 38 of the hearing aid 10 shown in Fig. 2 in comparison with a directionality plot 60 of conventional omni-directional processing in the form the directionality 60 of the front microphone audio signal 14. It is noteworthy that the directionalities are very similar and thus, loss of environmental awareness is avoided with the matched filters.
- the disclosed method can also be used to suppress microphone noise.
- the term “substantially matches”, or any of other similar terms, such as “substantially equal”, refers to two items that do not vary by more than 10%.
- a description regarding an impulse response being “substantially equal” to another impulse response refers to the two impulse responses having at least one characteristic that does not vary by more than 10%.
- a description regarding a matching transfer function of a matched filter that "substantially matches" a transfer function of a sound propagation path refers to the matching transfer function and the transfer function of the sound propagation path having at least one characteristic that does not vary by more than 10%.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
Description
- A new hearing aid is provided with improved reduction of diffuse noise with preserved spatial awareness.
- Hearing aid users have been reported to have poorer ability to localize sound sources when wearing their hearing aids than without their hearing aids. This represents a serious problem for the mild-to-moderate hearing impaired population.
- Furthermore, hearing aids typically reproduce sound in such a way that the user perceives sound sources to be localized inside the head. The sound is said to be internalized rather than being externalized. A common complaint for hearing aid users when referring to the "hearing speech in noise problem" is that it is very hard to follow anything that is being said even though the signal to noise ratio (SNR) should be sufficient to provide the required speech intelligibility. A significant contributor to this fact is that the hearing aid reproduces an internalized sound field. This adds to the cognitive loading of the hearing aid user and may result in listening fatigue and ultimately that the user removes the hearing aid(s).
- Recently, new hearing aids have been disclosed with improved localization of sound sources, i.e. the new hearing aids preserve information of the directions of respective sound sources in the sound environment with relation to the orientation of the head of the wearer of the hearing aid, see
EP 2 750 410 A1 ,EP 2 750 411 A1 , andEP 2 750 412 A1 . - Improved sound source localization enables hearing aid users to utilize the cocktail party effect, i.e. the user is able to focus the auditory attention on a selected sound source while suppressing all other sounds, e.g. to focus on a single conversation in a noisy room at a party.
- However, in complex listening situations with adverse signal to noise ratios (SNR) some hearing impaired people cannot use spatial cues to segregate between different sound sources and focus on a selected sound source and suppress everything else. Other solutions have to be developed for this situation and/or for this subpopulation.
- One known way of alleviating this problem is to apply SNR enhancing techniques, such as directionality. Directional systems operate to suppress signal energy from all other directions than a target direction. This requires that interfering sound has a directional nature; however, in complex listening situations, such as in a restaurant, the hearing aid user experiences interference from diffuse noise. Diffuse noise is, or approximately is, spatially white, i.e. the signal recorded in the noise field is uncorrelated with any other signal record at a different location. The number of microphones in a hearing aid system is typically not sufficient to efficiently suppress diffuse noise. Therefore, directional systems have limited effect for these types of listening situations.
- Another complaint when applying directionality is that the listener loose environmental awareness.
-
US 2004/0136541 A1 discloses a BTE hearing aid with a microphone disposed outside the ear canal and having a compensation filter for filtering the output signal of the microphone for restoring spatial cues in the signal for improved user capability of localization of a sound source. - Thus, there is a need for a diffuse noise reduction technique which preserves spatial awareness. The invention is defined by
independent claims 1 and 13. Preferred embodiments are defined in the dependent claims. - A new method of increasing a signal to noise ratio of a sound signal received in an environment with diffuse noise is provided, comprising converting sound into an audio signal using a microphone system, and filtering the audio signal with a matched filter having a matching transfer function that matches or substantially matches a transfer function of a sound propagation path of the acoustic sound from a sound source to the microphone system, when the microphone system is worn by a user.
- The transfer function preferably includes the transfer function of the microphone system.
- Throughout the present disclosure, a matched filter is said to have a matching transfer function that matches or substantially matches another transfer function when the matching transfer function is equal to, or substantially equal to, a complex conjugate, multiplied by a complex scalar, of the other transfer function, wherein the value of the complex scalar is selected so that the matched filter is a causal filter.
- The matched filter may have an impulse response that is equal to, or substantially equal to, the time reversed and time shifted impulse response, possibly time shifted to ensure that the matched filter is a causal filter, of a sound propagation path from the sound source to the microphone system, when the microphone system is worn by a user.
- The matched filter may perform equalisation of the amplitude spectrum of the filtered audio signal to compensate for the changes of the amplitude spectrum caused by the transfer function.
- The new method may further comprise adding a plurality of filtered audio signals into a sum audio signal for further improvement of the signal to noise ratio.
- Further, a new hearing aid is provided, comprising
a first microphone system configured for conversion of sound emitted by a sound source into a first audio signal,
a first matched filter configured for filtering the first audio signal into a first filtered audio signal, the first matched filter having a first matching transfer function that matches or substantially matches a first transfer function of a first sound propagation path of the sound propagating from the sound source to the first microphone system providing the first audio signal,
when a user wears the hearing aid, and
a hearing loss processor configured to provide a hearing loss compensated output signal that compensates for a hearing loss of the user based at least in part on the first filtered audio signal. - The hearing aid may further comprise
a second microphone system configured for conversion of sound into a second audio signal, and
a second matched filter configured for filtering the second audio signal into a second filtered audio signal, the second matched filter having a second matching transfer that matches or substantially matches a second transfer function of a second sound propagation path of the sound propagating from the sound source to the second microphone system providing the second audio signal, when the user wears the hearing aid,
a first adder configured for adding the first filtered audio signal and the second filtered audio signal to obtain a sum audio signal,
wherein the hearing loss processor is configured to process the sum audio signal to provide the hearing loss compensated output signal. - The first matched filter may be connected to an output of a microphone of the first microphone system for filtering the audio signal provided at the output of the microphone into a filtered audio signal.
- The first matched filter may be connected to a combined output of a plurality of microphones of the first microphone system for filtering the audio signal provided at the combined output of the plurality of microphones into a filtered audio signal.
- The first matched filter may have an impulse response that is equal to, or substantially equal to, a time reversed and possibly time shifted impulse response, possibly time shifted to ensure that the first matched filter is a causal filter, of a first sound propagation path from the sound source to the first microphone system, when the first microphone system is worn by a user.
- The first matched filter may perform equalisation of the amplitude spectrum of the first filtered audio signal to compensate for changes of the amplitude spectrum caused by the first transfer function.
- The second matched filter may be connected to an output of a microphone of the second microphone system for filtering the audio signal provided at the output of the microphone into a filtered audio signal.
- The second matched filter may be connected to a combined output of a plurality of microphones of the second microphone system for filtering the audio signal provided at the combined output of the plurality of microphones into a filtered audio signal.
- The second matched filter may have an impulse response that is equal to, or substantially equal to, a time reversed and possibly time shifted impulse response, possibly time shifted to ensure that the second matched filter is a causal filter, of a second sound propagation path from the sound source to the second microphone system, when the second microphone system is worn by a user.
- The second matched filter may perform equalisation of the amplitude spectrum of the second filtered audio signal to compensate for changes of the amplitude spectrum caused by the second transfer function.
- The first and second matching transfer functions may substantially equalize a phase of the first filtered audio signal and a phase of the second filtered audio signal, so that the first adder can add the first and second filtered audio signals in-phase.
- In the following, a transfer function of a sound propagation path from the sound source to a microphone system providing an audio signal, when the hearing aid is worn by a user, is termed a microphone related transfer function.
- The microphone related transfer function preferably includes the transfer function of the microphone system.
- Preferably, the hearing aid also comprises an output transducer for conversion of the hearing loss compensated output signal to an auditory output signal, such as an acoustic output signal, or an implanted transducer signal, that can be received by the human auditory system.
- The new hearing aid may be of any type of hearing aid, such as a BTE, a RIE, an ITE, an ITC, a CIC, etc., hearing aid or combination of these.
- The new hearing aid may form part of a new binaural hearing aid system using data exchange between the hearing aids to optimize performance.
- The matched filter operates to improve the SNR of a signal emitted from a sound source in an environment with significant diffuse acoustic noise, e.g. at a gathering with a lot of simultaneous conversation.
- Similar to a Head-related transfer function (HRTF), the microphone related transfer function depends on the direction and distance to the sound source with relation to the user of the hearing aid and the anatomy of the user, due to diffraction around the head, reflections from shoulders, reflections by the pinna and in the ear canal, etc.
- Thus, for optimum performance, one or more microphone related transfer functions of selected directions and distances are determined for the individual user and matched or substantially matched by one or more respective matched filters.
- When a listener resides in the far field of a sound source, the microphone related transfer functions like the HRTFs do not change with distance. Typically, the listener resides in the far field of a sound source, when the distance to the sound source is larger than 1.5 m.
- Thus, at least some of the determined microphone related transfer functions may be the far field microphone related transfer functions of selected directions.
- Approximate microphone related transfer functions may be used instead of the microphone related transfer functions individually determined for the user. Approximate microphone related transfer functions may be determined using an artificial head, such as a KEMAR head. In this way, approximations to the individual microphone related transfer functions are provided that can be of sufficient accuracy for the hearing aid user to obtain an improved SNR in an environment with diffuse noise.
- The approximate microphone related transfer functions may also be determined as an average of previously determined microphone related transfer functions for a group of people. This group may be selected to fit certain features of the human for which the individual microphone related transfer functions are to be determined in order to obtain approximate microphone related transfer functions that more closely match the respective corresponding individual microphone related transfer functions. For example, the group may be selected according to age, race, gender, family, ear size, etc., either alone or in any combination. The approximate microphone related transfer functions may also include averages over a number of directions.
- The approximate microphone related transfer functions may also be microphone related transfer functions previously determined for the patient in question, e.g. during a previous fitting session at an earlier age.
- The selected directions of the microphone related transfer functions matched or substantially matched by matched filters in the hearing aid preferably include the forward looking direction of the user, but may comprise any direction or a multitude of directions.
- In the event that the hearing aid comprises a plurality of matched filters, the hearing aid also comprises an adder configured for adding the filtered audio signals provided at the outputs of the matched filters, into a sum audio signal that is input to the hearing loss processor for processing into the hearing loss compensated output signal.
- Provided that the sound source is located in the assumed direction so that the sound source emits sound that propagates along those propagation paths to the respective microphones, whose transfer functions are matched or substantially matched by the respective matched filters, the matched filters equalize the phase component originating from the propagation of the acoustic wave from the source to the microphone from the recorded signals so that subsequently, the adder adds the filtered signals in-phase to further improve the SNR of the output signal sum. This is due to the fact that the diffuse noise is uncorrelated over both time and space so that the filtering leads to SNR improvement and so does averaging over microphones.
- Further microphones connected to respective matched filters may be added to the circuitry with further filtered audio signals input to the adder for further improvement of the SNR of the sum audio signal.
- The adder may form a weighted sum of the signals input to the adder.
- The first microphone system may comprise a first microphone configured for conversion of sound into the first audio signal, and the second microphone system may comprise a second microphone configured for conversion of sound into the second audio signal.
- The new hearing aid may form part of a new binaural hearing aid system, comprising a left ear hearing aid and a right ear hearing aid, and wherein one of the left ear hearing aid and the right ear hearing aid is the new hearing aid.
- In the new binaural hearing aid system, one of the left ear hearing aid and the right ear hearing aid may have at least one matched filter configured to filter an audio signal originating from a microphone of the other one of the left ear hearing aid and the right ear hearing aid.
- The new binaural hearing aid system may comprise a first hearing aid and a second hearing aid, wherein each of the first and second hearing aids comprises
a first microphone system configured for conversion of sound emitted by a sound source into a first audio signal,
a first matched filter configured for filtering the first audio signal into a first filtered audio signal, the first matched filter having a first matching transfer function that matches or substantially matches a first transfer function of a first sound propagation path of the sound propagating from the sound source to the first microphone system providing the first audio signal,
when a user wears the hearing aid, and
a hearing loss processor configured to provide a hearing loss compensated output signal that compensates for a hearing loss of the user based at least in part on the first filtered audio signal. - Each of the first and second hearing aids may further comprise
a second microphone system configured for conversion of sound into a second audio signal, and
a second matched filter configured for filtering the second audio signal into a second filtered audio signal, the second matched filter having a second matching transfer that matches or substantially matches a second transfer function of a second sound propagation path of the sound propagating from the sound source to the second microphone system providing the second audio signal, when the user wears the hearing aid,
a first adder configured for adding the first filtered audio signal and the second filtered audio signal to obtain a sum audio signal,
wherein the hearing loss processor is configured to process the sum audio signal to provide the hearing loss compensated output signal. - Further, the hearing loss processor of one of the first and second hearing aids may have an input that is connected to an output of the first adder of the other one of the first and second hearing aids, and wherein the processor is configured for adding the outputs of the first adders of the left ear hearing aid and the right ear hearing aid.
- The first hearing aid may have a second adder with a first input that is connected to an output of the first adder of the first hearing aid and a second input that is connected to an output of the first adder of the second hearing aid, and an output for provision of a binaural sum of the sum audio signal of the first hearing aid and the sum audio signal of the second hearing aid, and wherein the hearing loss processor is configured to process the binaural sum audio signal to provide the hearing loss compensated output signal.
- Signals may be communicated wired or wirelessly between the left ear hearing aid and the right ear hearing aid as is well-known in the art of hearing aids.
- In the following, one transfer function of the matched filter is derived.
- In a hearing aid, e.g. a binaural hearing aid system, having n microphones, it is assumed that the nth microphone receives a noisy version of a sound signal, e.g. speech; the user desires to listen to. The nth microphone outputs an audio signal sn(t) with spectrum Sn(ω), ω is the angular frequency, in accordance with:
- Where X(ω) is the speech signal spectrum, Hn(ω) the nth microphone related transfer function describing the sound propagation from the sound source to the nth microphone, Vn(ω) is the corresponding masker signal spectrum. We further assume that
where E is the expectancy operator and * denotes complex conjugate. Further, we also assume that the masker has a Gaussian distribution. Writing the received signal spectrum on vector form results in -
- Differentiating and setting to zero gives
using the fact that the masker is spatially white, this reduces to
where the exponential function with argument T is included only so that the corresponding time domain implementation is causal. In the time domain:
where ⊗ is the convolution operator, i.e. f1⊗f2 means the convolution of functions f1 and f2, and hn(t) is the inverse Fourier transform of Hn(ω), sn(t) is the nth measured microphone signal, and - The new hearing aid may be a multi-channel hearing aid, in which audio signals to be processed are divided into a plurality of signal components for being processed individually in a plurality of frequency channels, respectively.
- One of, some of; or, all of the matched filters may also be divided into the plurality of frequency channels; or, may still operate in the entire frequency range of the hearing aid; or, may be divided into other frequency channels, typically fewer frequency channels, than other parts of the hearing aid circuitry are divided into.
- In the new hearing aid, one of, some of; or, all of the matched filters may operate in respective selected frequency bands.
- Each of the selected frequency bands may comprise one or more of the frequency channels, or all of the frequency channels. The selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
- The plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
- Outside the selected frequency band, the audio signals may be processed for hearing loss compensation in a conventional way.
- In this way, matched filtering may be avoided in frequency channels in which no diffuse noise is present.
- As used herein, the terms "substantially" and "approximately" account for fluctuations and inaccuracies experienced within the field of electrical engineering and are intended to mean that deviations from absolute are included within the scope of the term or expression so modified. For example, they can refer to deviations that are less than or equal to ± 10%, such as less than or equal to ± 5%, such as less than or equal to ± 2%, such as less than or equal to ± 1 %, such as less than or equal to ± 0.5%, such as less than or equal to ± 0.2%, such as less than or equal to ± 0.1%.
- Signal processing, including filtering, in the new hearing aid may be performed by dedicated hardware or may be performed in a signal processor, or performed in a combination of dedicated hardware and one or more signal processors.
- As used herein, the terms "processor", "signal processor", "controller", "system", etc., are intended to refer to CPU-related entities, either hardware, a combination of hardware and software, software, or software in execution. The term processor may also refer to any integrated circuit that includes some hardware, which may or may not be a CPU-related entity. For example, in some embodiments, a processor may include a filter.
- For example, a "processor", "signal processor", "controller", "system", etc., may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
- By way of illustration, the terms "processor", "signal processor", "controller", "system", etc., designate both an application running on a processor and a hardware processor. One or more "processors", "signal processors", "controllers", "systems" and the like, or any combination hereof, may reside within a process and/or thread of execution, and one or more "processors", "signal processors", "controllers", "systems", etc., or any combination hereof, may be localized on one hardware processor, possibly in combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
- Also, a processor (or similar terms) may be any component or any combination of components that is capable of performing signal processing. For examples, the signal processor may be an ASIC processor, a FPGA processor, a general purpose processor, a microprocessor, a circuit component, or an integrated circuit.
- Other features and advantages will be described below in the detailed description.
- Below, the new method and hearing aid are explained in more detail with reference to the drawings in which various examples are shown. In the drawings:
- Fig. 1
- schematically illustrates a user wearing a hearing aid with two microphones in a listening situation,
- Fig. 2
- schematically illustrates the new hearing aid with two microphones and two matched filters,
- Fig. 3
- schematically illustrates a user wearing a new binaural hearing aid system with a plurality of microphones accommodated in each of the hearing aids,
- Fig. 4
- schematically illustrates one exemplary circuitry of a new binaural hearing aid system,
- Fig. 5
- schematically illustrates another exemplary circuitry of a new binaural hearing aid system, and
- Fig. 6
- shows a plot of the directional characteristic of a conventional omni-directional microphone system and of the new optimized omni-directional microphone system.
- The drawings illustrate the design and utility of embodiments, in which similar elements are referred to by common reference numerals. Like elements may, thus, not be described in detail with respect to the description of each figure. In order to better appreciate how the above-recited and other advantages and objects are obtained, a more particular description of the embodiments will be rendered, which are illustrated in the accompanying drawings. It should be noted that the figures are only intended to facilitate the description of the features. They are not intended as an exhaustive description of the claimed invention or as a limitation on the scope of the claimed invention. In addition, an illustrated feature needs not have all the aspects or advantages shown. An aspect or an advantage described in conjunction with a particular feature is not necessarily limited to that feature and can be practiced in any other features even if not so illustrated or explicitly described.
- The new hearing aid according to the appended claims may be embodied in different forms not shown in the accompanying drawings and should not be construed as limited to the examples set forth herein.
-
Fig. 1 schematically illustrates auser 100 wearing a BTE hearing aid (only the microphones of the hearing aid are shown) on the user's right ear. TheBTE hearing aid 10 has twomicrophones Fig. 1 , theuser 100 desires to listen tospeaker 110; however, the user andlistener 100 and thespeaker 110 are surrounded by a number of other people (not shown) also engaged in various conversations. As a result, theuser 100 is exposed to a diffuse noise field and as a result the hearing impaired user cannot focus the auditory attention on the selected sound source, i.e. theconversation partner 110, while suppressing speech from other talkers and other sounds. -
Fig. 2 shows a blocked schematic of theBTE hearing aid 10 worn by theuser 100 inFig. 1 . - The illustrated
BTE hearing aid 10 has afront microphone 12 that converts acoustic sound into afront audio signal 14. Thefront audio signal 14 is pre-processed in afirst pre-processing filter 16 into a pre-processedfront audio signal 18. The pre-processing may include, without excluding any form of processing, adaptive and/or static feedback suppression and/or adaptive and/or fixed beamforming and/or pre-filtering. A first matchedfilter 20 is connected to the output of thefirst pre-processing filter 16 and operates to filter the pre-processedfront audio signal 18 into a front filteredaudio signal 22. Asound source 110, seeFig. 1 , resides in the forward looking direction of theuser 100 and emits sound to themicrophone 12 when worn by theuser 100 of thehearing aid 10. - The
front microphone 12 has the far field microphone related transfer function H1(ω) of the front looking direction, and the first matchedfilter 20 has a matching transfer function that is a equal to the complex conjugate of the far field microphone related transfer function H1*(ω) multiplied by the complex scalar e-jωt to ensure that the impulse response h1(T-t) of the first matchedfilter 20 is causal. - Similarly, the illustrated
BTE hearing aid 10 also has arear microphone 24 that converts acoustic sound into arear audio signal 26. Therear audio signal 26 is pre-processed in asecond pre-processing filter 28 into a pre-processedrear audio signal 30. The pre-processing may include, without excluding any form of processing, adaptive and/or static feedback suppression and/or adaptive and/or fixed beamforming and/or pre-filtering. A second matchedfilter 32 is connected to the output of thesecond pre-processing filter 28 and operates to filter the pre-processedrear audio signal 30 into a rear filteredaudio signal 34. Therear microphone 24 has the far field microphone related transfer function H2(ω) of the front looking direction, and the second matchedfilter 32 has a matching transfer function that is equal or substantially equal to the complex conjugate of the far field microphone related transfer function H2*(ω) multiplied by the complex scalar e-jωT to ensure that the impulse response h2(T-t) of the second matchedfilter 32 is causal. - Other embodiments of the
hearing aid 10 may have a number of microphones that is larger than two. - The matched filters 20, 32 operate to improve the SNR of the audio signals 14, 26 that originate from a
sound source 110 in an environment with significant diffuse acoustic noise, e.g. at a gathering with a lot of simultaneous conversation. - The front and rear audio signals 22, 34 are input to an
adder 36 that adds the front and rear audio signals 22, 34 into thesum audio signal 38. - The matched filters 20, 32 remove the phase from their respective input signals 18, 30 so that subsequently, the
adder 36 adds the filtered signals 22, 34 in-phase to further improve the SNR of thesum audio signal 38. - The
adder 36 may form a weighted sum of thesignals adder 36. - The
sum audio signal 38 is input to ahearing loss processor 40 configured to process thesum audio signal 38 into a hearing loss compensatedoutput signal 42 that is compensated for the hearing loss of the user in a way well-known in the art of hearing aids, possibly in accordance with a number of selectable hearing programmes stored in a memory (not shown) of thehearing aid 10. - Finally, the hearing loss compensated
output signal 42 is input to anoutput transducer 44 in the form of areceiver 44 for conversion of the hearing loss compensatedoutput signal 42 into an acoustic output signal that is transmitted towards an eardrum of theuser 100 wearing thehearing aid 10. - For optimum performance, the microphone related transfer functions H1(ω), H2(ω) of the respective
acoustic propagation paths sound source 110 in the forward looking direction of theuser 100 to therespective microphones individual user 100 and matched by the respective matchedfilters - However, approximate microphone related transfer functions H1'(ω), H2'(ω) may be used instead. H1'(ω), H2'(ω) may be determined using an artificial head, such as a KEMAR head, whereby approximated microphone related transfer functions H1'(ω), H2'(ω) are provided of sufficient accuracy for the
hearing aid user 100 to obtain an improved SNR of thesum audio signal 38 in an environment with diffuse noise. - The approximate microphone related transfer functions H1'(ω), H2'(ω) may also be determined as an average of previously determined microphone related transfer functions for a group of humans. The group of humans may be selected to fit certain features of the human for which the individual microphone related transfer functions are to be determined in order to obtain approximate microphone related transfer functions that more closely match the respective corresponding individual microphone related transfer functions. For example, the group of humans may be selected according to age, race, gender, family, ear size, etc., either alone or in any combination. Averaging may also be performed over a number of directions.
- The approximate microphone related transfer functions may also be microphone related transfer functions previously determined for the user in question, e.g. during a previous fitting session at an earlier age.
- The
sum audio signal 38 is provided in accordance with the equation:
where ⊗ is the convolution operator, i.e. f1⊗f2 means the convolution of functions f1 and f2, and where n is a microphone index, i.e. n = 1 for thefront microphone 12 and n = 2 for therear microphone 24, hn(t) is the inverse Fourier transform of Hn(ω), sn(t) is the nthpre-filtered microphone signal - Alternatively, the summation is performed in the
adder 36 while multiplication by g(t) is performed by theprocessor 40. - The
hearing aid 10 shown inFig. 2 may be a multi-channel hearing aid in which audio sound signals 14, 26 to be processed are divided into a plurality of frequency channels, and wherein audio signals are processed individually in each of the frequency channels, possibly apart from the matched filters 20, 32 that may still operate in the entire frequency range of thehearing aid 10, or, may be divided into other frequency channels, typically fewer frequency channels than the remaining illustrated circuitry. - For a
multi-channel hearing aid 10,Fig. 2 may illustrate the circuitry and signal processing in a single frequency channel of the audio signals 14, 26. - The illustrated circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
- For example, the signal processing illustrated in
Fig. 2 may be performed in a selected frequency band. - The selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels. The selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
- The plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
- Outside the selected frequency band, the audio signals may be processed for hearing loss compensation without matched filtering 20, 32.
- In this way, matched filtering may be avoided in frequency channels in which no diffuse noise is present.
-
Fig. 3 schematically illustrates auser 100 wearing a binaural hearing aid system with a left ear BTE hearingaid accommodating microphones aid accommodating microphones - Signals may be communicated wired or wirelessly between the left ear hearing aid and the right ear hearing aid in a way well-known in the art of signal transmission.
- With respect to the filtering of the received acoustic signals, each of the left ear BTE hearing aid and the right ear BTE hearing aid of the binaural hearing aid system, operates in the same way as the
hearing aid 10 with the blocked schematic shown inFig. 2 apart from the fact that the filtered audio signal of each hearing aid is transmitted to the other hearing aid and added to the filtered audio signal of the other hearing aid as shown inFig. 4 . -
Fig. 4 shows a blocked schematic of a binauralhearing aid system 10 comprising a rightear hearing aid 10A and a leftear hearing aid 10B, each of which operates in the same way as thehearing aid 10 shown inFig. 2 apart from the fact that thesum audio signal ear hearing aid 10A and leftear hearing aid 10B, is transmitted to theother hearing aid sum audio signal other hearing aid respective processor - Further, one or more microphones with pre-filters connected to respective matched filters may be added to the circuitry of the hearing aids 10A, 10B as indicated by the vertical lines of dots, generating filtered output audio signals input to the
adder sum audio signal - The number of microphones in the right
ear hearing aid 10A and the leftear hearing aid 10B is preferably, but need not be, the same. - For example, the binaural
hearing aid system 10 may comprise four microphones, namely afront microphone rear microphone ear hearing aid 10A and the leftear hearing aid 10B of the binauralhearing aid system 10. - Each of the hearing aids 10A, 10B shown in
Fig. 4 may be a multi-channel hearing aid in which audio sound signals 14A, 26A, 14B, 26B to be processed are divided into a plurality of frequency channels, and wherein audio signals are processed individually in each of the frequency channels, possibly apart from the matched filters 20A, 32A, 20B, 32B that may still operate in the entire frequency range of therespective hearing aid - For multi-channel hearing aids 10A, 10B,
Fig. 4 may illustrate the circuitry and signal processing in a single frequency channel of theaudio signals - The illustrated circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
- For example, the signal processing illustrated in
Fig. 4 may be performed in a selected frequency band. - The selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels. The selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
- The plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
- Outside the selected frequency band, the audio signals may be processed for hearing loss compensation without matched filtering 20A, 32A, 20B, 32B.
- In this way, matched filtering may be avoided in frequency channels in which no diffuse noise is present.
- The circuitry of the right
ear hearing aid 10A and leftear hearing aid 10B may be identical as shown inFig. 4 . However, in other embodiments the circuit components may be distributed in arbitrary ways between the two hearing aid housings in accordance with design choices well-known in the art of hearing aids. - For example, as shown in
Fig. 5 , one of the hearing aids 10A may comprise all of the required matchedfilters processor 40A, while the other one of the hearing aids 10B does not comprise matched filters and a processor. Instead, microphone output signals, possibly pre-processed, 18B, 30B are transmitted to the hearing aid comprising the respective matchedfilters processor 40A is configured to output the hearing loss compensatedoutput signals output signal 42B for the other ear is then transmitted to thehearing aid 10B without matched filters and input to theoutput transducer 44B of thehearing aid 10B. The required wired or wireless interface circuitry for signal transfer between the hearing aids 10A, 10B is not shown. -
Fig. 6 shows adirectionality plot 50 of thesum audio signal 38 of thehearing aid 10 shown inFig. 2 in comparison with adirectionality plot 60 of conventional omni-directional processing in the form thedirectionality 60 of the frontmicrophone audio signal 14. It is noteworthy that the directionalities are very similar and thus, loss of environmental awareness is avoided with the matched filters. - Mutually uncorrelated white noise sequences have been applied to the
microphones sum audio signal 38 is equal to 5.92 dB. Thus, the SNR improvement for this example amounts to approximately 7 dB and without sacrificing the environmental awareness. - The disclosed method can also be used to suppress microphone noise.
- As used in this specification, the term "substantially matches", or any of other similar terms, such as "substantially equal", refers to two items that do not vary by more than 10%. For example, a description regarding an impulse response being "substantially equal" to another impulse response refers to the two impulse responses having at least one characteristic that does not vary by more than 10%. Similarly, a description regarding a matching transfer function of a matched filter that "substantially matches" a transfer function of a sound propagation path refers to the matching transfer function and the transfer function of the sound propagation path having at least one characteristic that does not vary by more than 10%.
Claims (14)
- A hearing aid (10) comprising:a first microphone system (12) configured for conversion of sound emitted by a sound source (110) into a first audio signal (14),a first filter (20) configured for filtering the first audio signal (14) into a first filtered audio signal (22),a hearing loss processor (40) configured to provide a hearing loss compensated output signal (42) that compensates for a hearing loss of the user based at least in part on the first filtered audio signal (22),characterized in thatthe first filter (20) is a first matched filter (20) having a first matching transfer function H1*(ω) that is substantially equal to a first complex scalar multiplied with a complex conjugate of a first transfer function H1(ω) of a first sound propagation path (120) of sound propagating from the sound source (110) to the first microphone system (12) providing the first audio signal(14), when a user (100) wears the hearing aid (10), wherein the first complex scalar is selected so that the first matched filter (20) is a causal filter.
- A hearing aid (10) according to claim 1, further comprising:a second microphone system (24) configured for conversion of sound into a second audio signal (26), anda second matched filter (32) configured for filtering the second audio signal (26) into a second filtered audio signal (34), the second matched filter (32) having a second matching transfer function H2*(ω) that is substantially equal to a second complex scalar multiplied with a complex conjugate of a second transfer function of a second sound propagation path (130) of the sound propagating from the sound source (110) to the second microphone system (24) providing the second audio signal (26), when the user (100) wears the hearing aid (10), wherein the second complex scalar is selected so that the second matched filter is a causal filter,a first adder (36) configured for adding the first filtered audio signal (22) and the second filtered audio signal (34) to obtain a sum audio signal (38),wherein the hearing loss processor (40) is configured to process the sum audio signal (38) to provide the hearing loss compensated output signal (42).
- A hearing aid (10) according to claim 1 or 2, wherein the sound source (110) resides in a forward looking direction of the user.
- A hearing aid (10) according to any of the preceding claims, wherein the first matched filter (20) has an impulse response h1(T-t) that is substantially equal to a time reversed and time shifted impulse response h1(t) of the first sound propagation path (120) of the sound propagating from the sound source (110) to the first microphone system (12), when the user (100) wears the hearing aid (10).
- A hearing aid (10) according to any of the preceding claims, wherein the first and second matching transfer functions substantially equalize a phase of the first filtered audio signal (22) and a phase of the second filtered audio signal (34), so that the first adder (36) can add the first and second filtered audio signals (22, 34) in-phase.
- A hearing aid (10) according to any of the preceding claims, wherein the first and second matching transfer functions substantially equalize an amplitude spectrum of the first filtered audio signal (22) and an amplitude spectrum of the second filtered audio signal (34), respectively, to the amplitude spectrum of the sound emitted by the sound source (110).
- A hearing aid (10) according to any of the preceding claims, wherein the hearing aid (10) is a multi-channel hearing aid (10) in which the first audio signal (14) is divided into a plurality of signal components for being processed individually in a plurality of frequency channels, respectively.
- A hearing aid (10) according to claim 7, wherein the first matched filter (20) is configured to perform filtering in a selected frequency band.
- A hearing aid (10) according to claim 7 or 8, wherein the plurality of frequency channels includes warped frequency channels.
- A binaural hearing aid system (10) comprising a first hearing aid (10A) and a second hearing aid (10B), wherein the first hearing aid (10A) is a hearing aid according to any of the preceding claims.
- A binaural hearing aid system (10) according to claim 10, wherein each of the first and second hearing aids (10A, 10B) is a hearing aid according to any of claims 1 - 9.
- A binaural hearing aid system (10) according to claim 11, wherein
the first hearing aid (10A) has a second adder with a first input that is connected to an output of the first adder of the first hearing aid (10A) and a second input that is connected to an output of the first adder of the second hearing aid (10B) and an output for provision of a binaural sum audio signal (38A) of the sum audio signal of the first hearing aid (10A) and the sum audio signal of the second hearing aid (10B),
wherein the hearing loss processor (40A) is configured to process the binaural sum audio signal (38A) to provide the hearing loss compensated output signal (42A, 42B). - A method of increasing a signal to noise ratio of a sound signal received in a hearing aid (10) in an environment with diffuse noise, comprising:converting acoustic sound into an audio signal (14) using a microphone system (12) of the hearing aid (10),characterized infiltering the audio signal (14) with a matched filter (20) of the hearing aid (10) having a matching transfer function H*(ω) that is substantially equal to a first complex scalar multiplied with a complex conjugate of a transfer function H(ω) of a sound propagation path (120) of the acoustic sound from a sound source (110) to the microphone system (12), when the microphone system (12) is worn by a user (100), wherein the first complex scalar is selected so that the first matched filter is a causal filter.
- The method according to claim 13, further comprising adding a plurality of the filtered audio signals (22, 34) to obtain a sum audio signal (38) for improvement of the signal to noise ratio, wherein one of the filtered audio signals (22) is resulted from the act of filtering the audio signal.
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP14199590.2A EP3038381B1 (en) | 2014-12-22 | 2014-12-22 | Diffuse noise listening |
DK14199590.2T DK3038381T3 (en) | 2014-12-22 | 2014-12-22 | Listening in diffuse noise |
US14/584,872 US9774960B2 (en) | 2014-12-22 | 2014-12-29 | Diffuse noise listening |
CN201580070136.2A CN107113516B (en) | 2014-12-22 | 2015-12-17 | Diffusion noise is listened to |
JP2017533412A JP6267834B2 (en) | 2014-12-22 | 2015-12-17 | Listening to diffuse noise |
PCT/EP2015/080218 WO2016102300A1 (en) | 2014-12-22 | 2015-12-17 | Diffuse noise listening |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP14199590.2A EP3038381B1 (en) | 2014-12-22 | 2014-12-22 | Diffuse noise listening |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3038381A1 EP3038381A1 (en) | 2016-06-29 |
EP3038381B1 true EP3038381B1 (en) | 2017-08-09 |
Family
ID=52282481
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14199590.2A Active EP3038381B1 (en) | 2014-12-22 | 2014-12-22 | Diffuse noise listening |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP3038381B1 (en) |
DK (1) | DK3038381T3 (en) |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE10249416B4 (en) * | 2002-10-23 | 2009-07-30 | Siemens Audiologische Technik Gmbh | Method for adjusting and operating a hearing aid device and hearing aid device |
US8670583B2 (en) * | 2009-01-22 | 2014-03-11 | Panasonic Corporation | Hearing aid system |
EP2611218B1 (en) * | 2011-12-29 | 2015-03-11 | GN Resound A/S | A hearing aid with improved localization |
EP2750410B1 (en) | 2012-12-28 | 2018-10-03 | GN Hearing A/S | A hearing aid with improved localization |
EP2750411B1 (en) | 2012-12-28 | 2015-09-30 | GN Resound A/S | A hearing aid with improved localization |
EP2750412B1 (en) | 2012-12-28 | 2016-06-29 | GN Resound A/S | Improved localization with feedback |
US10425747B2 (en) * | 2013-05-23 | 2019-09-24 | Gn Hearing A/S | Hearing aid with spatial signal enhancement |
-
2014
- 2014-12-22 EP EP14199590.2A patent/EP3038381B1/en active Active
- 2014-12-22 DK DK14199590.2T patent/DK3038381T3/en active
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
DK3038381T3 (en) | 2017-11-20 |
EP3038381A1 (en) | 2016-06-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10181328B2 (en) | Hearing system | |
Marquardt et al. | Theoretical analysis of linearly constrained multi-channel Wiener filtering algorithms for combined noise reduction and binaural cue preservation in binaural hearing aids | |
US9100762B2 (en) | Hearing aid with improved localization | |
EP3468228B1 (en) | Binaural hearing system with localization of sound sources | |
EP3794844B1 (en) | Adaptive binaural beamforming with preservation of spatial cues in hearing assistance devices | |
US9432778B2 (en) | Hearing aid with improved localization of a monaural signal source | |
EP2611218B1 (en) | A hearing aid with improved localization | |
Cornelis et al. | Speech intelligibility improvements with hearing aids using bilateral and binaural adaptive multichannel Wiener filtering based noise reduction | |
JP2019531659A (en) | Binaural hearing aid system and method of operating a binaural hearing aid system | |
US20140185846A1 (en) | Hearing aid with improved localization | |
US9774960B2 (en) | Diffuse noise listening | |
JP6518286B2 (en) | Method of operation of a binaural hearing system | |
EP2928213B1 (en) | A hearing aid with improved localization of a monaural signal source | |
Derleth et al. | Binaural signal processing in hearing aids | |
EP2806660B1 (en) | A hearing aid with improved localization | |
EP3038381B1 (en) | Diffuse noise listening | |
Jespersen et al. | Increasing the effectiveness of hearing aid directional microphones | |
EP2750412B1 (en) | Improved localization with feedback | |
EP2750410B1 (en) | A hearing aid with improved localization | |
EP3148217B1 (en) | Method for operating a binaural hearing system | |
JP6479211B2 (en) | Hearing device | |
Le Goff et al. | Modeling horizontal localization of complex sounds in the impaired and aided impaired auditory system | |
Wu et al. | Hearing aid system with 3D sound localization | |
Valentin et al. | Development of a real-time EOG-based acoustical beamformer algorithm for binaural hearing devices | |
US11617037B2 (en) | Hearing device with omnidirectional sensitivity |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
17P | Request for examination filed |
Effective date: 20161214 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20170404 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: GRAN, KARL-FREDRIK JOHAN |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 918027 Country of ref document: AT Kind code of ref document: T Effective date: 20170815 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602014012809 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20171113 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20170809 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 4 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 918027 Country of ref document: AT Kind code of ref document: T Effective date: 20170809 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171109 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: GN HEARING A/S |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171109 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171209 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171110 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602014012809 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20180511 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171222 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171222 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20171231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171222 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20141222 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20211221 Year of fee payment: 8 Ref country code: DK Payment date: 20211217 Year of fee payment: 8 Ref country code: FR Payment date: 20211215 Year of fee payment: 8 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20211217 Year of fee payment: 8 |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: EBP Effective date: 20221231 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20221222 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221222 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20231218 Year of fee payment: 10 |