EP3038381B1 - Diffuse noise listening - Google Patents

Diffuse noise listening Download PDF

Info

Publication number
EP3038381B1
EP3038381B1 EP14199590.2A EP14199590A EP3038381B1 EP 3038381 B1 EP3038381 B1 EP 3038381B1 EP 14199590 A EP14199590 A EP 14199590A EP 3038381 B1 EP3038381 B1 EP 3038381B1
Authority
EP
European Patent Office
Prior art keywords
hearing aid
audio signal
sound
hearing
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP14199590.2A
Other languages
German (de)
French (fr)
Other versions
EP3038381A1 (en
Inventor
Karl-Fredrik Johan Gran
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GN Hearing AS
Original Assignee
GN Resound AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GN Resound AS filed Critical GN Resound AS
Priority to EP14199590.2A priority Critical patent/EP3038381B1/en
Priority to DK14199590.2T priority patent/DK3038381T3/en
Priority to US14/584,872 priority patent/US9774960B2/en
Priority to CN201580070136.2A priority patent/CN107113516B/en
Priority to JP2017533412A priority patent/JP6267834B2/en
Priority to PCT/EP2015/080218 priority patent/WO2016102300A1/en
Publication of EP3038381A1 publication Critical patent/EP3038381A1/en
Application granted granted Critical
Publication of EP3038381B1 publication Critical patent/EP3038381B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40Arrangements for obtaining a desired directivity characteristic
    • H04R25/407Circuits for combining signals of a plurality of transducers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/43Signal processing in hearing aids to enhance the speech intelligibility
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/552Binaural
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/554Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired using a wireless connection, e.g. between microphone and amplifier or using Tcoils

Definitions

  • a new hearing aid is provided with improved reduction of diffuse noise with preserved spatial awareness.
  • Hearing aid users have been reported to have poorer ability to localize sound sources when wearing their hearing aids than without their hearing aids. This represents a serious problem for the mild-to-moderate hearing impaired population.
  • hearing aids typically reproduce sound in such a way that the user perceives sound sources to be localized inside the head. The sound is said to be internalized rather than being externalized.
  • a common complaint for hearing aid users when referring to the "hearing speech in noise problem" is that it is very hard to follow anything that is being said even though the signal to noise ratio (SNR) should be sufficient to provide the required speech intelligibility.
  • SNR signal to noise ratio
  • a significant contributor to this fact is that the hearing aid reproduces an internalized sound field. This adds to the cognitive loading of the hearing aid user and may result in listening fatigue and ultimately that the user removes the hearing aid(s).
  • new hearing aids have been disclosed with improved localization of sound sources, i.e. the new hearing aids preserve information of the directions of respective sound sources in the sound environment with relation to the orientation of the head of the wearer of the hearing aid, see EP 2 750 410 A1 , EP 2 750 411 A1 , and EP 2 750 412 A1 .
  • Improved sound source localization enables hearing aid users to utilize the cocktail party effect, i.e. the user is able to focus the auditory attention on a selected sound source while suppressing all other sounds, e.g. to focus on a single conversation in a noisy room at a party.
  • Directional systems operate to suppress signal energy from all other directions than a target direction. This requires that interfering sound has a directional nature; however, in complex listening situations, such as in a restaurant, the hearing aid user experiences interference from diffuse noise. Diffuse noise is, or approximately is, spatially white, i.e. the signal recorded in the noise field is uncorrelated with any other signal record at a different location. The number of microphones in a hearing aid system is typically not sufficient to efficiently suppress diffuse noise. Therefore, directional systems have limited effect for these types of listening situations.
  • US 2004/0136541 A1 discloses a BTE hearing aid with a microphone disposed outside the ear canal and having a compensation filter for filtering the output signal of the microphone for restoring spatial cues in the signal for improved user capability of localization of a sound source.
  • a new method of increasing a signal to noise ratio of a sound signal received in an environment with diffuse noise comprising converting sound into an audio signal using a microphone system, and filtering the audio signal with a matched filter having a matching transfer function that matches or substantially matches a transfer function of a sound propagation path of the acoustic sound from a sound source to the microphone system, when the microphone system is worn by a user.
  • the transfer function preferably includes the transfer function of the microphone system.
  • a matched filter is said to have a matching transfer function that matches or substantially matches another transfer function when the matching transfer function is equal to, or substantially equal to, a complex conjugate, multiplied by a complex scalar, of the other transfer function, wherein the value of the complex scalar is selected so that the matched filter is a causal filter.
  • the matched filter may have an impulse response that is equal to, or substantially equal to, the time reversed and time shifted impulse response, possibly time shifted to ensure that the matched filter is a causal filter, of a sound propagation path from the sound source to the microphone system, when the microphone system is worn by a user.
  • the matched filter may perform equalisation of the amplitude spectrum of the filtered audio signal to compensate for the changes of the amplitude spectrum caused by the transfer function.
  • the new method may further comprise adding a plurality of filtered audio signals into a sum audio signal for further improvement of the signal to noise ratio.
  • a new hearing aid comprising a first microphone system configured for conversion of sound emitted by a sound source into a first audio signal, a first matched filter configured for filtering the first audio signal into a first filtered audio signal, the first matched filter having a first matching transfer function that matches or substantially matches a first transfer function of a first sound propagation path of the sound propagating from the sound source to the first microphone system providing the first audio signal, when a user wears the hearing aid, and a hearing loss processor configured to provide a hearing loss compensated output signal that compensates for a hearing loss of the user based at least in part on the first filtered audio signal.
  • the hearing aid may further comprise a second microphone system configured for conversion of sound into a second audio signal, and a second matched filter configured for filtering the second audio signal into a second filtered audio signal, the second matched filter having a second matching transfer that matches or substantially matches a second transfer function of a second sound propagation path of the sound propagating from the sound source to the second microphone system providing the second audio signal, when the user wears the hearing aid, a first adder configured for adding the first filtered audio signal and the second filtered audio signal to obtain a sum audio signal, wherein the hearing loss processor is configured to process the sum audio signal to provide the hearing loss compensated output signal.
  • the first matched filter may be connected to an output of a microphone of the first microphone system for filtering the audio signal provided at the output of the microphone into a filtered audio signal.
  • the first matched filter may be connected to a combined output of a plurality of microphones of the first microphone system for filtering the audio signal provided at the combined output of the plurality of microphones into a filtered audio signal.
  • the first matched filter may have an impulse response that is equal to, or substantially equal to, a time reversed and possibly time shifted impulse response, possibly time shifted to ensure that the first matched filter is a causal filter, of a first sound propagation path from the sound source to the first microphone system, when the first microphone system is worn by a user.
  • the first matched filter may perform equalisation of the amplitude spectrum of the first filtered audio signal to compensate for changes of the amplitude spectrum caused by the first transfer function.
  • the second matched filter may be connected to an output of a microphone of the second microphone system for filtering the audio signal provided at the output of the microphone into a filtered audio signal.
  • the second matched filter may be connected to a combined output of a plurality of microphones of the second microphone system for filtering the audio signal provided at the combined output of the plurality of microphones into a filtered audio signal.
  • the second matched filter may have an impulse response that is equal to, or substantially equal to, a time reversed and possibly time shifted impulse response, possibly time shifted to ensure that the second matched filter is a causal filter, of a second sound propagation path from the sound source to the second microphone system, when the second microphone system is worn by a user.
  • the second matched filter may perform equalisation of the amplitude spectrum of the second filtered audio signal to compensate for changes of the amplitude spectrum caused by the second transfer function.
  • the first and second matching transfer functions may substantially equalize a phase of the first filtered audio signal and a phase of the second filtered audio signal, so that the first adder can add the first and second filtered audio signals in-phase.
  • a transfer function of a sound propagation path from the sound source to a microphone system providing an audio signal, when the hearing aid is worn by a user is termed a microphone related transfer function.
  • the microphone related transfer function preferably includes the transfer function of the microphone system.
  • the hearing aid also comprises an output transducer for conversion of the hearing loss compensated output signal to an auditory output signal, such as an acoustic output signal, or an implanted transducer signal, that can be received by the human auditory system.
  • an auditory output signal such as an acoustic output signal, or an implanted transducer signal
  • the new hearing aid may be of any type of hearing aid, such as a BTE, a RIE, an ITE, an ITC, a CIC, etc., hearing aid or combination of these.
  • the new hearing aid may form part of a new binaural hearing aid system using data exchange between the hearing aids to optimize performance.
  • the matched filter operates to improve the SNR of a signal emitted from a sound source in an environment with significant diffuse acoustic noise, e.g. at a gathering with a lot of simultaneous conversation.
  • the microphone related transfer function depends on the direction and distance to the sound source with relation to the user of the hearing aid and the anatomy of the user, due to diffraction around the head, reflections from shoulders, reflections by the pinna and in the ear canal, etc.
  • one or more microphone related transfer functions of selected directions and distances are determined for the individual user and matched or substantially matched by one or more respective matched filters.
  • the microphone related transfer functions like the HRTFs do not change with distance.
  • the listener resides in the far field of a sound source, when the distance to the sound source is larger than 1.5 m.
  • the determined microphone related transfer functions may be the far field microphone related transfer functions of selected directions.
  • Approximate microphone related transfer functions may be used instead of the microphone related transfer functions individually determined for the user. Approximate microphone related transfer functions may be determined using an artificial head, such as a KEMAR head. In this way, approximations to the individual microphone related transfer functions are provided that can be of sufficient accuracy for the hearing aid user to obtain an improved SNR in an environment with diffuse noise.
  • the approximate microphone related transfer functions may also be determined as an average of previously determined microphone related transfer functions for a group of people. This group may be selected to fit certain features of the human for which the individual microphone related transfer functions are to be determined in order to obtain approximate microphone related transfer functions that more closely match the respective corresponding individual microphone related transfer functions. For example, the group may be selected according to age, race, gender, family, ear size, etc., either alone or in any combination.
  • the approximate microphone related transfer functions may also include averages over a number of directions.
  • the approximate microphone related transfer functions may also be microphone related transfer functions previously determined for the patient in question, e.g. during a previous fitting session at an earlier age.
  • the selected directions of the microphone related transfer functions matched or substantially matched by matched filters in the hearing aid preferably include the forward looking direction of the user, but may comprise any direction or a multitude of directions.
  • the hearing aid comprises a plurality of matched filters
  • the hearing aid also comprises an adder configured for adding the filtered audio signals provided at the outputs of the matched filters, into a sum audio signal that is input to the hearing loss processor for processing into the hearing loss compensated output signal.
  • the sound source is located in the assumed direction so that the sound source emits sound that propagates along those propagation paths to the respective microphones, whose transfer functions are matched or substantially matched by the respective matched filters, the matched filters equalize the phase component originating from the propagation of the acoustic wave from the source to the microphone from the recorded signals so that subsequently, the adder adds the filtered signals in-phase to further improve the SNR of the output signal sum. This is due to the fact that the diffuse noise is uncorrelated over both time and space so that the filtering leads to SNR improvement and so does averaging over microphones.
  • Further microphones connected to respective matched filters may be added to the circuitry with further filtered audio signals input to the adder for further improvement of the SNR of the sum audio signal.
  • the adder may form a weighted sum of the signals input to the adder.
  • the first microphone system may comprise a first microphone configured for conversion of sound into the first audio signal
  • the second microphone system may comprise a second microphone configured for conversion of sound into the second audio signal
  • the new hearing aid may form part of a new binaural hearing aid system, comprising a left ear hearing aid and a right ear hearing aid, and wherein one of the left ear hearing aid and the right ear hearing aid is the new hearing aid.
  • one of the left ear hearing aid and the right ear hearing aid may have at least one matched filter configured to filter an audio signal originating from a microphone of the other one of the left ear hearing aid and the right ear hearing aid.
  • the new binaural hearing aid system may comprise a first hearing aid and a second hearing aid, wherein each of the first and second hearing aids comprises a first microphone system configured for conversion of sound emitted by a sound source into a first audio signal, a first matched filter configured for filtering the first audio signal into a first filtered audio signal, the first matched filter having a first matching transfer function that matches or substantially matches a first transfer function of a first sound propagation path of the sound propagating from the sound source to the first microphone system providing the first audio signal, when a user wears the hearing aid, and a hearing loss processor configured to provide a hearing loss compensated output signal that compensates for a hearing loss of the user based at least in part on the first filtered audio signal.
  • each of the first and second hearing aids comprises a first microphone system configured for conversion of sound emitted by a sound source into a first audio signal, a first matched filter configured for filtering the first audio signal into a first filtered audio signal, the first matched filter having a first matching
  • Each of the first and second hearing aids may further comprise a second microphone system configured for conversion of sound into a second audio signal, and a second matched filter configured for filtering the second audio signal into a second filtered audio signal, the second matched filter having a second matching transfer that matches or substantially matches a second transfer function of a second sound propagation path of the sound propagating from the sound source to the second microphone system providing the second audio signal, when the user wears the hearing aid, a first adder configured for adding the first filtered audio signal and the second filtered audio signal to obtain a sum audio signal, wherein the hearing loss processor is configured to process the sum audio signal to provide the hearing loss compensated output signal.
  • the hearing loss processor of one of the first and second hearing aids may have an input that is connected to an output of the first adder of the other one of the first and second hearing aids, and wherein the processor is configured for adding the outputs of the first adders of the left ear hearing aid and the right ear hearing aid.
  • the first hearing aid may have a second adder with a first input that is connected to an output of the first adder of the first hearing aid and a second input that is connected to an output of the first adder of the second hearing aid, and an output for provision of a binaural sum of the sum audio signal of the first hearing aid and the sum audio signal of the second hearing aid, and wherein the hearing loss processor is configured to process the binaural sum audio signal to provide the hearing loss compensated output signal.
  • Signals may be communicated wired or wirelessly between the left ear hearing aid and the right ear hearing aid as is well-known in the art of hearing aids.
  • n th microphone receives a noisy version of a sound signal, e.g. speech; the user desires to listen to.
  • V n ( ⁇ ) is the corresponding masker signal spectrum.
  • E is the expectancy operator and * denotes complex conjugate.
  • the masker has a Gaussian distribution.
  • conditional probability of measuring s ( ⁇ ) given X( ⁇ ) is proportional to P s ⁇
  • is the convolution operator, i.e. f 1 ⁇ f 2 means the convolution of functions f 1 and f 2
  • h n (t) is the inverse Fourier transform of H n ( ⁇ )
  • s n (t) is the n th measured microphone signal
  • the new hearing aid may be a multi-channel hearing aid, in which audio signals to be processed are divided into a plurality of signal components for being processed individually in a plurality of frequency channels, respectively.
  • One of, some of; or, all of the matched filters may also be divided into the plurality of frequency channels; or, may still operate in the entire frequency range of the hearing aid; or, may be divided into other frequency channels, typically fewer frequency channels, than other parts of the hearing aid circuitry are divided into.
  • one of, some of; or, all of the matched filters may operate in respective selected frequency bands.
  • Each of the selected frequency bands may comprise one or more of the frequency channels, or all of the frequency channels.
  • the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • the audio signals may be processed for hearing loss compensation in a conventional way.
  • the terms “substantially” and “approximately” account for fluctuations and inaccuracies experienced within the field of electrical engineering and are intended to mean that deviations from absolute are included within the scope of the term or expression so modified. For example, they can refer to deviations that are less than or equal to ⁇ 10%, such as less than or equal to ⁇ 5%, such as less than or equal to ⁇ 2%, such as less than or equal to ⁇ 1 %, such as less than or equal to ⁇ 0.5%, such as less than or equal to ⁇ 0.2%, such as less than or equal to ⁇ 0.1%.
  • Signal processing, including filtering, in the new hearing aid may be performed by dedicated hardware or may be performed in a signal processor, or performed in a combination of dedicated hardware and one or more signal processors.
  • processor As used herein, the terms “processor”, “signal processor”, “controller”, “system”, etc., are intended to refer to CPU-related entities, either hardware, a combination of hardware and software, software, or software in execution.
  • the term processor may also refer to any integrated circuit that includes some hardware, which may or may not be a CPU-related entity.
  • a processor may include a filter.
  • a "processor”, “signal processor”, “controller”, “system”, etc. may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
  • processor designate both an application running on a processor and a hardware processor.
  • processors may reside within a process and/or thread of execution, and one or more "processors”, “signal processors”, “controllers”, “systems”, etc., or any combination hereof, may be localized on one hardware processor, possibly in combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
  • a processor may be any component or any combination of components that is capable of performing signal processing.
  • the signal processor may be an ASIC processor, a FPGA processor, a general purpose processor, a microprocessor, a circuit component, or an integrated circuit.
  • Fig. 1 schematically illustrates a user 100 wearing a BTE hearing aid (only the microphones of the hearing aid are shown) on the user's right ear.
  • the BTE hearing aid 10 has two microphones 12, 24 accommodated in the BTE hearing aid housing in such a way that a line through centres of the microphones extends in parallel with a forward looking direction of the user.
  • the user 100 desires to listen to speaker 110; however, the user and listener 100 and the speaker 110 are surrounded by a number of other people (not shown) also engaged in various conversations.
  • the user 100 is exposed to a diffuse noise field and as a result the hearing impaired user cannot focus the auditory attention on the selected sound source, i.e. the conversation partner 110, while suppressing speech from other talkers and other sounds.
  • Fig. 2 shows a blocked schematic of the BTE hearing aid 10 worn by the user 100 in Fig. 1 .
  • the illustrated BTE hearing aid 10 has a front microphone 12 that converts acoustic sound into a front audio signal 14.
  • the front audio signal 14 is pre-processed in a first pre-processing filter 16 into a pre-processed front audio signal 18.
  • the pre-processing may include, without excluding any form of processing, adaptive and/or static feedback suppression and/or adaptive and/or fixed beamforming and/or pre-filtering.
  • a first matched filter 20 is connected to the output of the first pre-processing filter 16 and operates to filter the pre-processed front audio signal 18 into a front filtered audio signal 22.
  • a sound source 110 see Fig. 1 , resides in the forward looking direction of the user 100 and emits sound to the microphone 12 when worn by the user 100 of the hearing aid 10.
  • the front microphone 12 has the far field microphone related transfer function H 1 ( ⁇ ) of the front looking direction, and the first matched filter 20 has a matching transfer function that is a equal to the complex conjugate of the far field microphone related transfer function H 1 *( ⁇ ) multiplied by the complex scalar e -j ⁇ t to ensure that the impulse response h 1 (T-t) of the first matched filter 20 is causal.
  • the illustrated BTE hearing aid 10 also has a rear microphone 24 that converts acoustic sound into a rear audio signal 26.
  • the rear audio signal 26 is pre-processed in a second pre-processing filter 28 into a pre-processed rear audio signal 30.
  • the pre-processing may include, without excluding any form of processing, adaptive and/or static feedback suppression and/or adaptive and/or fixed beamforming and/or pre-filtering.
  • a second matched filter 32 is connected to the output of the second pre-processing filter 28 and operates to filter the pre-processed rear audio signal 30 into a rear filtered audio signal 34.
  • the rear microphone 24 has the far field microphone related transfer function H 2 ( ⁇ ) of the front looking direction, and the second matched filter 32 has a matching transfer function that is equal or substantially equal to the complex conjugate of the far field microphone related transfer function H 2 *( ⁇ ) multiplied by the complex scalar e -j ⁇ T to ensure that the impulse response h 2 (T-t) of the second matched filter 32 is causal.
  • Other embodiments of the hearing aid 10 may have a number of microphones that is larger than two.
  • the matched filters 20, 32 operate to improve the SNR of the audio signals 14, 26 that originate from a sound source 110 in an environment with significant diffuse acoustic noise, e.g. at a gathering with a lot of simultaneous conversation.
  • the front and rear audio signals 22, 34 are input to an adder 36 that adds the front and rear audio signals 22, 34 into the sum audio signal 38.
  • the matched filters 20, 32 remove the phase from their respective input signals 18, 30 so that subsequently, the adder 36 adds the filtered signals 22, 34 in-phase to further improve the SNR of the sum audio signal 38.
  • the adder 36 may form a weighted sum of the signals 22, 34 input to the adder 36.
  • the sum audio signal 38 is input to a hearing loss processor 40 configured to process the sum audio signal 38 into a hearing loss compensated output signal 42 that is compensated for the hearing loss of the user in a way well-known in the art of hearing aids, possibly in accordance with a number of selectable hearing programmes stored in a memory (not shown) of the hearing aid 10.
  • the hearing loss compensated output signal 42 is input to an output transducer 44 in the form of a receiver 44 for conversion of the hearing loss compensated output signal 42 into an acoustic output signal that is transmitted towards an eardrum of the user 100 wearing the hearing aid 10.
  • the microphone related transfer functions H 1 ( ⁇ ), H 2 ( ⁇ ) of the respective acoustic propagation paths 120, 130 from the sound source 110 in the forward looking direction of the user 100 to the respective microphones 12, 24 are determined for the individual user 100 and matched by the respective matched filters 20, 32.
  • approximate microphone related transfer functions H 1 '( ⁇ ), H 2 '( ⁇ ) may be used instead.
  • H 1 '( ⁇ ), H 2 '( ⁇ ) may be determined using an artificial head, such as a KEMAR head, whereby approximated microphone related transfer functions H 1 '( ⁇ ), H 2 '( ⁇ ) are provided of sufficient accuracy for the hearing aid user 100 to obtain an improved SNR of the sum audio signal 38 in an environment with diffuse noise.
  • the approximate microphone related transfer functions H 1 '( ⁇ ), H 2 '( ⁇ ) may also be determined as an average of previously determined microphone related transfer functions for a group of humans.
  • the group of humans may be selected to fit certain features of the human for which the individual microphone related transfer functions are to be determined in order to obtain approximate microphone related transfer functions that more closely match the respective corresponding individual microphone related transfer functions.
  • the group of humans may be selected according to age, race, gender, family, ear size, etc., either alone or in any combination. Averaging may also be performed over a number of directions.
  • the approximate microphone related transfer functions may also be microphone related transfer functions previously determined for the user in question, e.g. during a previous fitting session at an earlier age.
  • is the convolution operator, i.e. f1 ⁇ f2 means the convolution of functions f1 and f2
  • n is a microphone index, i.e.
  • h n (t) is the inverse Fourier transform of H n ( ⁇ )
  • s n (t) is the n th pre-filtered microphone signal 18, 30
  • g t F ⁇ 1 1 h H ⁇ h ⁇ is a filter describing the amplitude equalization across frequency to compensate for the filtering operation.
  • the summation is performed in the adder 36 while multiplication by g(t) is performed by the processor 40.
  • the hearing aid 10 shown in Fig. 2 may be a multi-channel hearing aid in which audio sound signals 14, 26 to be processed are divided into a plurality of frequency channels, and wherein audio signals are processed individually in each of the frequency channels, possibly apart from the matched filters 20, 32 that may still operate in the entire frequency range of the hearing aid 10, or, may be divided into other frequency channels, typically fewer frequency channels than the remaining illustrated circuitry.
  • FIG. 2 may illustrate the circuitry and signal processing in a single frequency channel of the audio signals 14, 26.
  • the illustrated circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
  • the signal processing illustrated in Fig. 2 may be performed in a selected frequency band.
  • the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
  • the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • the audio signals may be processed for hearing loss compensation without matched filtering 20, 32.
  • Fig. 3 schematically illustrates a user 100 wearing a binaural hearing aid system with a left ear BTE hearing aid accommodating microphones 12B, 24B and a right ear BTE hearing aid accommodating microphones 12A, 24A.
  • Signals may be communicated wired or wirelessly between the left ear hearing aid and the right ear hearing aid in a way well-known in the art of signal transmission.
  • each of the left ear BTE hearing aid and the right ear BTE hearing aid of the binaural hearing aid system operates in the same way as the hearing aid 10 with the blocked schematic shown in Fig. 2 apart from the fact that the filtered audio signal of each hearing aid is transmitted to the other hearing aid and added to the filtered audio signal of the other hearing aid as shown in Fig. 4 .
  • Fig. 4 shows a blocked schematic of a binaural hearing aid system 10 comprising a right ear hearing aid 10A and a left ear hearing aid 10B, each of which operates in the same way as the hearing aid 10 shown in Fig. 2 apart from the fact that the sum audio signal 38A, 38B, respectively, of each of the right ear hearing aid 10A and left ear hearing aid 10B, is transmitted to the other hearing aid 10B, 10A and added to the sum audio signal 38B, 38A of the other hearing aid 10B, 10A in the respective processor 40B, 40A.
  • the required wired or wireless interface circuitry is not shown.
  • one or more microphones with pre-filters connected to respective matched filters may be added to the circuitry of the hearing aids 10A, 10B as indicated by the vertical lines of dots, generating filtered output audio signals input to the adder 36A, 36B for further improvement of the SNR of the sum audio signal 38A, 38B.
  • the number of microphones in the right ear hearing aid 10A and the left ear hearing aid 10B is preferably, but need not be, the same.
  • the binaural hearing aid system 10 may comprise four microphones, namely a front microphone 12A, 12B and a rear microphone 24A, 24B, in each of the right ear hearing aid 10A and the left ear hearing aid 10B of the binaural hearing aid system 10.
  • Each of the hearing aids 10A, 10B shown in Fig. 4 may be a multi-channel hearing aid in which audio sound signals 14A, 26A, 14B, 26B to be processed are divided into a plurality of frequency channels, and wherein audio signals are processed individually in each of the frequency channels, possibly apart from the matched filters 20A, 32A, 20B, 32B that may still operate in the entire frequency range of the respective hearing aid 10A, 10B; or, may be divided into other frequency channels, typically fewer frequency channels than the remaining illustrated circuitry.
  • Fig. 4 may illustrate the circuitry and signal processing in a single frequency channel of the audio signals 14A, 26A, 1B, 26B.
  • the illustrated circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
  • the signal processing illustrated in Fig. 4 may be performed in a selected frequency band.
  • the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
  • the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • the audio signals may be processed for hearing loss compensation without matched filtering 20A, 32A, 20B, 32B.
  • circuitry of the right ear hearing aid 10A and left ear hearing aid 10B may be identical as shown in Fig. 4 .
  • the circuit components may be distributed in arbitrary ways between the two hearing aid housings in accordance with design choices well-known in the art of hearing aids.
  • one of the hearing aids 10A may comprise all of the required matched filters 20A, 32A, 20B, 32B, and the processor 40A, while the other one of the hearing aids 10B does not comprise matched filters and a processor.
  • microphone output signals, possibly pre-processed, 18B, 30B are transmitted to the hearing aid comprising the respective matched filters 20B, 32B, and wherein the processor 40A is configured to output the hearing loss compensated output signals 42A, 42B for both ears of the user.
  • the hearing loss compensated output signal 42B for the other ear is then transmitted to the hearing aid 10B without matched filters and input to the output transducer 44B of the hearing aid 10B.
  • the required wired or wireless interface circuitry for signal transfer between the hearing aids 10A, 10B is not shown.
  • Fig. 6 shows a directionality plot 50 of the sum audio signal 38 of the hearing aid 10 shown in Fig. 2 in comparison with a directionality plot 60 of conventional omni-directional processing in the form the directionality 60 of the front microphone audio signal 14. It is noteworthy that the directionalities are very similar and thus, loss of environmental awareness is avoided with the matched filters.
  • the disclosed method can also be used to suppress microphone noise.
  • the term “substantially matches”, or any of other similar terms, such as “substantially equal”, refers to two items that do not vary by more than 10%.
  • a description regarding an impulse response being “substantially equal” to another impulse response refers to the two impulse responses having at least one characteristic that does not vary by more than 10%.
  • a description regarding a matching transfer function of a matched filter that "substantially matches" a transfer function of a sound propagation path refers to the matching transfer function and the transfer function of the sound propagation path having at least one characteristic that does not vary by more than 10%.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)

Description

    Technical Field
  • A new hearing aid is provided with improved reduction of diffuse noise with preserved spatial awareness.
  • Background Art
  • Hearing aid users have been reported to have poorer ability to localize sound sources when wearing their hearing aids than without their hearing aids. This represents a serious problem for the mild-to-moderate hearing impaired population.
  • Furthermore, hearing aids typically reproduce sound in such a way that the user perceives sound sources to be localized inside the head. The sound is said to be internalized rather than being externalized. A common complaint for hearing aid users when referring to the "hearing speech in noise problem" is that it is very hard to follow anything that is being said even though the signal to noise ratio (SNR) should be sufficient to provide the required speech intelligibility. A significant contributor to this fact is that the hearing aid reproduces an internalized sound field. This adds to the cognitive loading of the hearing aid user and may result in listening fatigue and ultimately that the user removes the hearing aid(s).
  • Recently, new hearing aids have been disclosed with improved localization of sound sources, i.e. the new hearing aids preserve information of the directions of respective sound sources in the sound environment with relation to the orientation of the head of the wearer of the hearing aid, see EP 2 750 410 A1 , EP 2 750 411 A1 , and EP 2 750 412 A1 .
  • Improved sound source localization enables hearing aid users to utilize the cocktail party effect, i.e. the user is able to focus the auditory attention on a selected sound source while suppressing all other sounds, e.g. to focus on a single conversation in a noisy room at a party.
  • However, in complex listening situations with adverse signal to noise ratios (SNR) some hearing impaired people cannot use spatial cues to segregate between different sound sources and focus on a selected sound source and suppress everything else. Other solutions have to be developed for this situation and/or for this subpopulation.
  • One known way of alleviating this problem is to apply SNR enhancing techniques, such as directionality. Directional systems operate to suppress signal energy from all other directions than a target direction. This requires that interfering sound has a directional nature; however, in complex listening situations, such as in a restaurant, the hearing aid user experiences interference from diffuse noise. Diffuse noise is, or approximately is, spatially white, i.e. the signal recorded in the noise field is uncorrelated with any other signal record at a different location. The number of microphones in a hearing aid system is typically not sufficient to efficiently suppress diffuse noise. Therefore, directional systems have limited effect for these types of listening situations.
  • Another complaint when applying directionality is that the listener loose environmental awareness.
  • US 2004/0136541 A1 discloses a BTE hearing aid with a microphone disposed outside the ear canal and having a compensation filter for filtering the output signal of the microphone for restoring spatial cues in the signal for improved user capability of localization of a sound source.
  • Summary
  • Thus, there is a need for a diffuse noise reduction technique which preserves spatial awareness. The invention is defined by independent claims 1 and 13. Preferred embodiments are defined in the dependent claims.
  • A new method of increasing a signal to noise ratio of a sound signal received in an environment with diffuse noise is provided, comprising converting sound into an audio signal using a microphone system, and filtering the audio signal with a matched filter having a matching transfer function that matches or substantially matches a transfer function of a sound propagation path of the acoustic sound from a sound source to the microphone system, when the microphone system is worn by a user.
  • The transfer function preferably includes the transfer function of the microphone system.
  • Throughout the present disclosure, a matched filter is said to have a matching transfer function that matches or substantially matches another transfer function when the matching transfer function is equal to, or substantially equal to, a complex conjugate, multiplied by a complex scalar, of the other transfer function, wherein the value of the complex scalar is selected so that the matched filter is a causal filter.
  • The matched filter may have an impulse response that is equal to, or substantially equal to, the time reversed and time shifted impulse response, possibly time shifted to ensure that the matched filter is a causal filter, of a sound propagation path from the sound source to the microphone system, when the microphone system is worn by a user.
  • The matched filter may perform equalisation of the amplitude spectrum of the filtered audio signal to compensate for the changes of the amplitude spectrum caused by the transfer function.
  • The new method may further comprise adding a plurality of filtered audio signals into a sum audio signal for further improvement of the signal to noise ratio.
  • Further, a new hearing aid is provided, comprising
    a first microphone system configured for conversion of sound emitted by a sound source into a first audio signal,
    a first matched filter configured for filtering the first audio signal into a first filtered audio signal, the first matched filter having a first matching transfer function that matches or substantially matches a first transfer function of a first sound propagation path of the sound propagating from the sound source to the first microphone system providing the first audio signal,
    when a user wears the hearing aid, and
    a hearing loss processor configured to provide a hearing loss compensated output signal that compensates for a hearing loss of the user based at least in part on the first filtered audio signal.
  • The hearing aid may further comprise
    a second microphone system configured for conversion of sound into a second audio signal, and
    a second matched filter configured for filtering the second audio signal into a second filtered audio signal, the second matched filter having a second matching transfer that matches or substantially matches a second transfer function of a second sound propagation path of the sound propagating from the sound source to the second microphone system providing the second audio signal, when the user wears the hearing aid,
    a first adder configured for adding the first filtered audio signal and the second filtered audio signal to obtain a sum audio signal,
    wherein the hearing loss processor is configured to process the sum audio signal to provide the hearing loss compensated output signal.
  • The first matched filter may be connected to an output of a microphone of the first microphone system for filtering the audio signal provided at the output of the microphone into a filtered audio signal.
  • The first matched filter may be connected to a combined output of a plurality of microphones of the first microphone system for filtering the audio signal provided at the combined output of the plurality of microphones into a filtered audio signal.
  • The first matched filter may have an impulse response that is equal to, or substantially equal to, a time reversed and possibly time shifted impulse response, possibly time shifted to ensure that the first matched filter is a causal filter, of a first sound propagation path from the sound source to the first microphone system, when the first microphone system is worn by a user.
  • The first matched filter may perform equalisation of the amplitude spectrum of the first filtered audio signal to compensate for changes of the amplitude spectrum caused by the first transfer function.
  • The second matched filter may be connected to an output of a microphone of the second microphone system for filtering the audio signal provided at the output of the microphone into a filtered audio signal.
  • The second matched filter may be connected to a combined output of a plurality of microphones of the second microphone system for filtering the audio signal provided at the combined output of the plurality of microphones into a filtered audio signal.
  • The second matched filter may have an impulse response that is equal to, or substantially equal to, a time reversed and possibly time shifted impulse response, possibly time shifted to ensure that the second matched filter is a causal filter, of a second sound propagation path from the sound source to the second microphone system, when the second microphone system is worn by a user.
  • The second matched filter may perform equalisation of the amplitude spectrum of the second filtered audio signal to compensate for changes of the amplitude spectrum caused by the second transfer function.
  • The first and second matching transfer functions may substantially equalize a phase of the first filtered audio signal and a phase of the second filtered audio signal, so that the first adder can add the first and second filtered audio signals in-phase.
  • In the following, a transfer function of a sound propagation path from the sound source to a microphone system providing an audio signal, when the hearing aid is worn by a user, is termed a microphone related transfer function.
  • The microphone related transfer function preferably includes the transfer function of the microphone system.
  • Preferably, the hearing aid also comprises an output transducer for conversion of the hearing loss compensated output signal to an auditory output signal, such as an acoustic output signal, or an implanted transducer signal, that can be received by the human auditory system.
  • The new hearing aid may be of any type of hearing aid, such as a BTE, a RIE, an ITE, an ITC, a CIC, etc., hearing aid or combination of these.
  • The new hearing aid may form part of a new binaural hearing aid system using data exchange between the hearing aids to optimize performance.
  • The matched filter operates to improve the SNR of a signal emitted from a sound source in an environment with significant diffuse acoustic noise, e.g. at a gathering with a lot of simultaneous conversation.
  • Similar to a Head-related transfer function (HRTF), the microphone related transfer function depends on the direction and distance to the sound source with relation to the user of the hearing aid and the anatomy of the user, due to diffraction around the head, reflections from shoulders, reflections by the pinna and in the ear canal, etc.
  • Thus, for optimum performance, one or more microphone related transfer functions of selected directions and distances are determined for the individual user and matched or substantially matched by one or more respective matched filters.
  • When a listener resides in the far field of a sound source, the microphone related transfer functions like the HRTFs do not change with distance. Typically, the listener resides in the far field of a sound source, when the distance to the sound source is larger than 1.5 m.
  • Thus, at least some of the determined microphone related transfer functions may be the far field microphone related transfer functions of selected directions.
  • Approximate microphone related transfer functions may be used instead of the microphone related transfer functions individually determined for the user. Approximate microphone related transfer functions may be determined using an artificial head, such as a KEMAR head. In this way, approximations to the individual microphone related transfer functions are provided that can be of sufficient accuracy for the hearing aid user to obtain an improved SNR in an environment with diffuse noise.
  • The approximate microphone related transfer functions may also be determined as an average of previously determined microphone related transfer functions for a group of people. This group may be selected to fit certain features of the human for which the individual microphone related transfer functions are to be determined in order to obtain approximate microphone related transfer functions that more closely match the respective corresponding individual microphone related transfer functions. For example, the group may be selected according to age, race, gender, family, ear size, etc., either alone or in any combination. The approximate microphone related transfer functions may also include averages over a number of directions.
  • The approximate microphone related transfer functions may also be microphone related transfer functions previously determined for the patient in question, e.g. during a previous fitting session at an earlier age.
  • The selected directions of the microphone related transfer functions matched or substantially matched by matched filters in the hearing aid preferably include the forward looking direction of the user, but may comprise any direction or a multitude of directions.
  • In the event that the hearing aid comprises a plurality of matched filters, the hearing aid also comprises an adder configured for adding the filtered audio signals provided at the outputs of the matched filters, into a sum audio signal that is input to the hearing loss processor for processing into the hearing loss compensated output signal.
  • Provided that the sound source is located in the assumed direction so that the sound source emits sound that propagates along those propagation paths to the respective microphones, whose transfer functions are matched or substantially matched by the respective matched filters, the matched filters equalize the phase component originating from the propagation of the acoustic wave from the source to the microphone from the recorded signals so that subsequently, the adder adds the filtered signals in-phase to further improve the SNR of the output signal sum. This is due to the fact that the diffuse noise is uncorrelated over both time and space so that the filtering leads to SNR improvement and so does averaging over microphones.
  • Further microphones connected to respective matched filters may be added to the circuitry with further filtered audio signals input to the adder for further improvement of the SNR of the sum audio signal.
  • The adder may form a weighted sum of the signals input to the adder.
  • The first microphone system may comprise a first microphone configured for conversion of sound into the first audio signal, and the second microphone system may comprise a second microphone configured for conversion of sound into the second audio signal.
  • The new hearing aid may form part of a new binaural hearing aid system, comprising a left ear hearing aid and a right ear hearing aid, and wherein one of the left ear hearing aid and the right ear hearing aid is the new hearing aid.
  • In the new binaural hearing aid system, one of the left ear hearing aid and the right ear hearing aid may have at least one matched filter configured to filter an audio signal originating from a microphone of the other one of the left ear hearing aid and the right ear hearing aid.
  • The new binaural hearing aid system may comprise a first hearing aid and a second hearing aid, wherein each of the first and second hearing aids comprises
    a first microphone system configured for conversion of sound emitted by a sound source into a first audio signal,
    a first matched filter configured for filtering the first audio signal into a first filtered audio signal, the first matched filter having a first matching transfer function that matches or substantially matches a first transfer function of a first sound propagation path of the sound propagating from the sound source to the first microphone system providing the first audio signal,
    when a user wears the hearing aid, and
    a hearing loss processor configured to provide a hearing loss compensated output signal that compensates for a hearing loss of the user based at least in part on the first filtered audio signal.
  • Each of the first and second hearing aids may further comprise
    a second microphone system configured for conversion of sound into a second audio signal, and
    a second matched filter configured for filtering the second audio signal into a second filtered audio signal, the second matched filter having a second matching transfer that matches or substantially matches a second transfer function of a second sound propagation path of the sound propagating from the sound source to the second microphone system providing the second audio signal, when the user wears the hearing aid,
    a first adder configured for adding the first filtered audio signal and the second filtered audio signal to obtain a sum audio signal,
    wherein the hearing loss processor is configured to process the sum audio signal to provide the hearing loss compensated output signal.
  • Further, the hearing loss processor of one of the first and second hearing aids may have an input that is connected to an output of the first adder of the other one of the first and second hearing aids, and wherein the processor is configured for adding the outputs of the first adders of the left ear hearing aid and the right ear hearing aid.
  • The first hearing aid may have a second adder with a first input that is connected to an output of the first adder of the first hearing aid and a second input that is connected to an output of the first adder of the second hearing aid, and an output for provision of a binaural sum of the sum audio signal of the first hearing aid and the sum audio signal of the second hearing aid, and wherein the hearing loss processor is configured to process the binaural sum audio signal to provide the hearing loss compensated output signal.
  • Signals may be communicated wired or wirelessly between the left ear hearing aid and the right ear hearing aid as is well-known in the art of hearing aids.
  • In the following, one transfer function of the matched filter is derived.
  • In a hearing aid, e.g. a binaural hearing aid system, having n microphones, it is assumed that the nth microphone receives a noisy version of a sound signal, e.g. speech; the user desires to listen to. The nth microphone outputs an audio signal sn(t) with spectrum Sn(ω), ω is the angular frequency, in accordance with: S n ω = H n ω X ω + V n ω
    Figure imgb0001
  • Where X(ω) is the speech signal spectrum, Hn(ω) the nth microphone related transfer function describing the sound propagation from the sound source to the nth microphone, Vn(ω) is the corresponding masker signal spectrum. We further assume that E V n ω V m * ω = 0 , n m
    Figure imgb0002
    E V n ω = 0 , n m
    Figure imgb0003
    E V n ω X * ω = 0 , n
    Figure imgb0004

    where E is the expectancy operator and * denotes complex conjugate. Further, we also assume that the masker has a Gaussian distribution. Writing the received signal spectrum on vector form results in S 1 ω S N ω s ω = H 1 ω H N ω h ω X ω + V 1 ω V N ω v ω
    Figure imgb0005
  • The conditional probability of measuring s(ω) given X(ω) is proportional to P s ω | X ω exp 1 2 s ω h ω X ω H R vv 1 s ω h ω X ω
    Figure imgb0006
    where Rvv -1 is the inverse of the auto covariance matrix of the masker. Taking the natural logarithm of this expression and removing constant terms results in ln P s ω | X ω s ω h ω X ω H R vv 1 s ω h ω X ω
    Figure imgb0007
  • Differentiating and setting to zero gives X * ω ln P s ω | X ω = 0
    Figure imgb0008
    h H ω R vv 1 s ω h ω X ω = 0
    Figure imgb0009
    X ^ ML ω = h H ω R vv 1 s ω h H ω R vv 1 h ω
    Figure imgb0010

    using the fact that the masker is spatially white, this reduces to X ^ ML ω = h H ω e jωT h H ω h ω s ω
    Figure imgb0011

    where the exponential function with argument T is included only so that the corresponding time domain implementation is causal. In the time domain: x ^ ML t = g t n = 1 N h n T t s n t
    Figure imgb0012

    where ⊗ is the convolution operator, i.e. f1⊗f2 means the convolution of functions f1 and f2, and hn(t) is the inverse Fourier transform of Hn(ω), sn(t) is the nth measured microphone signal, and g t = F 1 1 h H ω h ω
    Figure imgb0013
    is a filter describing the amplitude equalization across frequency to compensate for the filtering operation, wherein F-1(·) is the inverse Fourier transform of (·).
  • The new hearing aid may be a multi-channel hearing aid, in which audio signals to be processed are divided into a plurality of signal components for being processed individually in a plurality of frequency channels, respectively.
  • One of, some of; or, all of the matched filters may also be divided into the plurality of frequency channels; or, may still operate in the entire frequency range of the hearing aid; or, may be divided into other frequency channels, typically fewer frequency channels, than other parts of the hearing aid circuitry are divided into.
  • In the new hearing aid, one of, some of; or, all of the matched filters may operate in respective selected frequency bands.
  • Each of the selected frequency bands may comprise one or more of the frequency channels, or all of the frequency channels. The selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • The plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • Outside the selected frequency band, the audio signals may be processed for hearing loss compensation in a conventional way.
  • In this way, matched filtering may be avoided in frequency channels in which no diffuse noise is present.
  • As used herein, the terms "substantially" and "approximately" account for fluctuations and inaccuracies experienced within the field of electrical engineering and are intended to mean that deviations from absolute are included within the scope of the term or expression so modified. For example, they can refer to deviations that are less than or equal to ± 10%, such as less than or equal to ± 5%, such as less than or equal to ± 2%, such as less than or equal to ± 1 %, such as less than or equal to ± 0.5%, such as less than or equal to ± 0.2%, such as less than or equal to ± 0.1%.
  • Signal processing, including filtering, in the new hearing aid may be performed by dedicated hardware or may be performed in a signal processor, or performed in a combination of dedicated hardware and one or more signal processors.
  • As used herein, the terms "processor", "signal processor", "controller", "system", etc., are intended to refer to CPU-related entities, either hardware, a combination of hardware and software, software, or software in execution. The term processor may also refer to any integrated circuit that includes some hardware, which may or may not be a CPU-related entity. For example, in some embodiments, a processor may include a filter.
  • For example, a "processor", "signal processor", "controller", "system", etc., may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
  • By way of illustration, the terms "processor", "signal processor", "controller", "system", etc., designate both an application running on a processor and a hardware processor. One or more "processors", "signal processors", "controllers", "systems" and the like, or any combination hereof, may reside within a process and/or thread of execution, and one or more "processors", "signal processors", "controllers", "systems", etc., or any combination hereof, may be localized on one hardware processor, possibly in combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
  • Also, a processor (or similar terms) may be any component or any combination of components that is capable of performing signal processing. For examples, the signal processor may be an ASIC processor, a FPGA processor, a general purpose processor, a microprocessor, a circuit component, or an integrated circuit.
  • Other features and advantages will be described below in the detailed description.
  • Brief description of drawings
  • Below, the new method and hearing aid are explained in more detail with reference to the drawings in which various examples are shown. In the drawings:
  • Fig. 1
    schematically illustrates a user wearing a hearing aid with two microphones in a listening situation,
    Fig. 2
    schematically illustrates the new hearing aid with two microphones and two matched filters,
    Fig. 3
    schematically illustrates a user wearing a new binaural hearing aid system with a plurality of microphones accommodated in each of the hearing aids,
    Fig. 4
    schematically illustrates one exemplary circuitry of a new binaural hearing aid system,
    Fig. 5
    schematically illustrates another exemplary circuitry of a new binaural hearing aid system, and
    Fig. 6
    shows a plot of the directional characteristic of a conventional omni-directional microphone system and of the new optimized omni-directional microphone system.
    Description
  • The drawings illustrate the design and utility of embodiments, in which similar elements are referred to by common reference numerals. Like elements may, thus, not be described in detail with respect to the description of each figure. In order to better appreciate how the above-recited and other advantages and objects are obtained, a more particular description of the embodiments will be rendered, which are illustrated in the accompanying drawings. It should be noted that the figures are only intended to facilitate the description of the features. They are not intended as an exhaustive description of the claimed invention or as a limitation on the scope of the claimed invention. In addition, an illustrated feature needs not have all the aspects or advantages shown. An aspect or an advantage described in conjunction with a particular feature is not necessarily limited to that feature and can be practiced in any other features even if not so illustrated or explicitly described.
  • The new hearing aid according to the appended claims may be embodied in different forms not shown in the accompanying drawings and should not be construed as limited to the examples set forth herein.
  • Fig. 1 schematically illustrates a user 100 wearing a BTE hearing aid (only the microphones of the hearing aid are shown) on the user's right ear. The BTE hearing aid 10 has two microphones 12, 24 accommodated in the BTE hearing aid housing in such a way that a line through centres of the microphones extends in parallel with a forward looking direction of the user. In Fig. 1, the user 100 desires to listen to speaker 110; however, the user and listener 100 and the speaker 110 are surrounded by a number of other people (not shown) also engaged in various conversations. As a result, the user 100 is exposed to a diffuse noise field and as a result the hearing impaired user cannot focus the auditory attention on the selected sound source, i.e. the conversation partner 110, while suppressing speech from other talkers and other sounds.
  • Fig. 2 shows a blocked schematic of the BTE hearing aid 10 worn by the user 100 in Fig. 1.
  • The illustrated BTE hearing aid 10 has a front microphone 12 that converts acoustic sound into a front audio signal 14. The front audio signal 14 is pre-processed in a first pre-processing filter 16 into a pre-processed front audio signal 18. The pre-processing may include, without excluding any form of processing, adaptive and/or static feedback suppression and/or adaptive and/or fixed beamforming and/or pre-filtering. A first matched filter 20 is connected to the output of the first pre-processing filter 16 and operates to filter the pre-processed front audio signal 18 into a front filtered audio signal 22. A sound source 110, see Fig. 1, resides in the forward looking direction of the user 100 and emits sound to the microphone 12 when worn by the user 100 of the hearing aid 10.
  • The front microphone 12 has the far field microphone related transfer function H1(ω) of the front looking direction, and the first matched filter 20 has a matching transfer function that is a equal to the complex conjugate of the far field microphone related transfer function H1*(ω) multiplied by the complex scalar e-jωt to ensure that the impulse response h1(T-t) of the first matched filter 20 is causal.
  • Similarly, the illustrated BTE hearing aid 10 also has a rear microphone 24 that converts acoustic sound into a rear audio signal 26. The rear audio signal 26 is pre-processed in a second pre-processing filter 28 into a pre-processed rear audio signal 30. The pre-processing may include, without excluding any form of processing, adaptive and/or static feedback suppression and/or adaptive and/or fixed beamforming and/or pre-filtering. A second matched filter 32 is connected to the output of the second pre-processing filter 28 and operates to filter the pre-processed rear audio signal 30 into a rear filtered audio signal 34. The rear microphone 24 has the far field microphone related transfer function H2(ω) of the front looking direction, and the second matched filter 32 has a matching transfer function that is equal or substantially equal to the complex conjugate of the far field microphone related transfer function H2*(ω) multiplied by the complex scalar e-jωT to ensure that the impulse response h2(T-t) of the second matched filter 32 is causal.
  • Other embodiments of the hearing aid 10 may have a number of microphones that is larger than two.
  • The matched filters 20, 32 operate to improve the SNR of the audio signals 14, 26 that originate from a sound source 110 in an environment with significant diffuse acoustic noise, e.g. at a gathering with a lot of simultaneous conversation.
  • The front and rear audio signals 22, 34 are input to an adder 36 that adds the front and rear audio signals 22, 34 into the sum audio signal 38.
  • The matched filters 20, 32 remove the phase from their respective input signals 18, 30 so that subsequently, the adder 36 adds the filtered signals 22, 34 in-phase to further improve the SNR of the sum audio signal 38.
  • The adder 36 may form a weighted sum of the signals 22, 34 input to the adder 36.
  • The sum audio signal 38 is input to a hearing loss processor 40 configured to process the sum audio signal 38 into a hearing loss compensated output signal 42 that is compensated for the hearing loss of the user in a way well-known in the art of hearing aids, possibly in accordance with a number of selectable hearing programmes stored in a memory (not shown) of the hearing aid 10.
  • Finally, the hearing loss compensated output signal 42 is input to an output transducer 44 in the form of a receiver 44 for conversion of the hearing loss compensated output signal 42 into an acoustic output signal that is transmitted towards an eardrum of the user 100 wearing the hearing aid 10.
  • For optimum performance, the microphone related transfer functions H1(ω), H2(ω) of the respective acoustic propagation paths 120, 130 from the sound source 110 in the forward looking direction of the user 100 to the respective microphones 12, 24 are determined for the individual user 100 and matched by the respective matched filters 20, 32.
  • However, approximate microphone related transfer functions H1'(ω), H2'(ω) may be used instead. H1'(ω), H2'(ω) may be determined using an artificial head, such as a KEMAR head, whereby approximated microphone related transfer functions H1'(ω), H2'(ω) are provided of sufficient accuracy for the hearing aid user 100 to obtain an improved SNR of the sum audio signal 38 in an environment with diffuse noise.
  • The approximate microphone related transfer functions H1'(ω), H2'(ω) may also be determined as an average of previously determined microphone related transfer functions for a group of humans. The group of humans may be selected to fit certain features of the human for which the individual microphone related transfer functions are to be determined in order to obtain approximate microphone related transfer functions that more closely match the respective corresponding individual microphone related transfer functions. For example, the group of humans may be selected according to age, race, gender, family, ear size, etc., either alone or in any combination. Averaging may also be performed over a number of directions.
  • The approximate microphone related transfer functions may also be microphone related transfer functions previously determined for the user in question, e.g. during a previous fitting session at an earlier age.
  • The sum audio signal 38 is provided in accordance with the equation: x ^ ML t = g t n = 1 N h n T t s n t
    Figure imgb0014

    where ⊗ is the convolution operator, i.e. f1⊗f2 means the convolution of functions f1 and f2, and where n is a microphone index, i.e. n = 1 for the front microphone 12 and n = 2 for the rear microphone 24, hn(t) is the inverse Fourier transform of Hn(ω), sn(t) is the nth pre-filtered microphone signal 18, 30, and g t = F 1 1 h H ω h ω
    Figure imgb0015
    is a filter describing the amplitude equalization across frequency to compensate for the filtering operation.
  • Alternatively, the summation is performed in the adder 36 while multiplication by g(t) is performed by the processor 40.
  • The hearing aid 10 shown in Fig. 2 may be a multi-channel hearing aid in which audio sound signals 14, 26 to be processed are divided into a plurality of frequency channels, and wherein audio signals are processed individually in each of the frequency channels, possibly apart from the matched filters 20, 32 that may still operate in the entire frequency range of the hearing aid 10, or, may be divided into other frequency channels, typically fewer frequency channels than the remaining illustrated circuitry.
  • For a multi-channel hearing aid 10, Fig. 2 may illustrate the circuitry and signal processing in a single frequency channel of the audio signals 14, 26.
  • The illustrated circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
  • For example, the signal processing illustrated in Fig. 2 may be performed in a selected frequency band.
  • The selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels. The selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • The plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • Outside the selected frequency band, the audio signals may be processed for hearing loss compensation without matched filtering 20, 32.
  • In this way, matched filtering may be avoided in frequency channels in which no diffuse noise is present.
  • Fig. 3 schematically illustrates a user 100 wearing a binaural hearing aid system with a left ear BTE hearing aid accommodating microphones 12B, 24B and a right ear BTE hearing aid accommodating microphones 12A, 24A.
  • Signals may be communicated wired or wirelessly between the left ear hearing aid and the right ear hearing aid in a way well-known in the art of signal transmission.
  • With respect to the filtering of the received acoustic signals, each of the left ear BTE hearing aid and the right ear BTE hearing aid of the binaural hearing aid system, operates in the same way as the hearing aid 10 with the blocked schematic shown in Fig. 2 apart from the fact that the filtered audio signal of each hearing aid is transmitted to the other hearing aid and added to the filtered audio signal of the other hearing aid as shown in Fig. 4.
  • Fig. 4 shows a blocked schematic of a binaural hearing aid system 10 comprising a right ear hearing aid 10A and a left ear hearing aid 10B, each of which operates in the same way as the hearing aid 10 shown in Fig. 2 apart from the fact that the sum audio signal 38A, 38B, respectively, of each of the right ear hearing aid 10A and left ear hearing aid 10B, is transmitted to the other hearing aid 10B, 10A and added to the sum audio signal 38B, 38A of the other hearing aid 10B, 10A in the respective processor 40B, 40A. The required wired or wireless interface circuitry is not shown.
  • Further, one or more microphones with pre-filters connected to respective matched filters may be added to the circuitry of the hearing aids 10A, 10B as indicated by the vertical lines of dots, generating filtered output audio signals input to the adder 36A, 36B for further improvement of the SNR of the sum audio signal 38A, 38B.
  • The number of microphones in the right ear hearing aid 10A and the left ear hearing aid 10B is preferably, but need not be, the same.
  • For example, the binaural hearing aid system 10 may comprise four microphones, namely a front microphone 12A, 12B and a rear microphone 24A, 24B, in each of the right ear hearing aid 10A and the left ear hearing aid 10B of the binaural hearing aid system 10.
  • Each of the hearing aids 10A, 10B shown in Fig. 4 may be a multi-channel hearing aid in which audio sound signals 14A, 26A, 14B, 26B to be processed are divided into a plurality of frequency channels, and wherein audio signals are processed individually in each of the frequency channels, possibly apart from the matched filters 20A, 32A, 20B, 32B that may still operate in the entire frequency range of the respective hearing aid 10A, 10B; or, may be divided into other frequency channels, typically fewer frequency channels than the remaining illustrated circuitry.
  • For multi-channel hearing aids 10A, 10B, Fig. 4 may illustrate the circuitry and signal processing in a single frequency channel of the audio signals 14A, 26A, 1B, 26B.
  • The illustrated circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
  • For example, the signal processing illustrated in Fig. 4 may be performed in a selected frequency band.
  • The selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels. The selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • The plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • Outside the selected frequency band, the audio signals may be processed for hearing loss compensation without matched filtering 20A, 32A, 20B, 32B.
  • In this way, matched filtering may be avoided in frequency channels in which no diffuse noise is present.
  • The circuitry of the right ear hearing aid 10A and left ear hearing aid 10B may be identical as shown in Fig. 4. However, in other embodiments the circuit components may be distributed in arbitrary ways between the two hearing aid housings in accordance with design choices well-known in the art of hearing aids.
  • For example, as shown in Fig. 5, one of the hearing aids 10A may comprise all of the required matched filters 20A, 32A, 20B, 32B, and the processor 40A, while the other one of the hearing aids 10B does not comprise matched filters and a processor. Instead, microphone output signals, possibly pre-processed, 18B, 30B are transmitted to the hearing aid comprising the respective matched filters 20B, 32B, and wherein the processor 40A is configured to output the hearing loss compensated output signals 42A, 42B for both ears of the user. The hearing loss compensated output signal 42B for the other ear is then transmitted to the hearing aid 10B without matched filters and input to the output transducer 44B of the hearing aid 10B. The required wired or wireless interface circuitry for signal transfer between the hearing aids 10A, 10B is not shown.
  • Fig. 6 shows a directionality plot 50 of the sum audio signal 38 of the hearing aid 10 shown in Fig. 2 in comparison with a directionality plot 60 of conventional omni-directional processing in the form the directionality 60 of the front microphone audio signal 14. It is noteworthy that the directionalities are very similar and thus, loss of environmental awareness is avoided with the matched filters.
  • Mutually uncorrelated white noise sequences have been applied to the microphones 12, 20, and a resulting SNR of - 1.28 dB has been calculated for the front microphone audio signal 14 (conventional omni response). The corresponding SNR value for the sum audio signal 38 is equal to 5.92 dB. Thus, the SNR improvement for this example amounts to approximately 7 dB and without sacrificing the environmental awareness.
  • The disclosed method can also be used to suppress microphone noise.
  • As used in this specification, the term "substantially matches", or any of other similar terms, such as "substantially equal", refers to two items that do not vary by more than 10%. For example, a description regarding an impulse response being "substantially equal" to another impulse response refers to the two impulse responses having at least one characteristic that does not vary by more than 10%. Similarly, a description regarding a matching transfer function of a matched filter that "substantially matches" a transfer function of a sound propagation path refers to the matching transfer function and the transfer function of the sound propagation path having at least one characteristic that does not vary by more than 10%.

Claims (14)

  1. A hearing aid (10) comprising:
    a first microphone system (12) configured for conversion of sound emitted by a sound source (110) into a first audio signal (14),
    a first filter (20) configured for filtering the first audio signal (14) into a first filtered audio signal (22),
    a hearing loss processor (40) configured to provide a hearing loss compensated output signal (42) that compensates for a hearing loss of the user based at least in part on the first filtered audio signal (22),
    characterized in that
    the first filter (20) is a first matched filter (20) having a first matching transfer function H1*(ω) that is substantially equal to a first complex scalar multiplied with a complex conjugate of a first transfer function H1(ω) of a first sound propagation path (120) of sound propagating from the sound source (110) to the first microphone system (12) providing the first audio signal(14), when a user (100) wears the hearing aid (10), wherein the first complex scalar is selected so that the first matched filter (20) is a causal filter.
  2. A hearing aid (10) according to claim 1, further comprising:
    a second microphone system (24) configured for conversion of sound into a second audio signal (26), and
    a second matched filter (32) configured for filtering the second audio signal (26) into a second filtered audio signal (34), the second matched filter (32) having a second matching transfer function H2*(ω) that is substantially equal to a second complex scalar multiplied with a complex conjugate of a second transfer function of a second sound propagation path (130) of the sound propagating from the sound source (110) to the second microphone system (24) providing the second audio signal (26), when the user (100) wears the hearing aid (10), wherein the second complex scalar is selected so that the second matched filter is a causal filter,
    a first adder (36) configured for adding the first filtered audio signal (22) and the second filtered audio signal (34) to obtain a sum audio signal (38),
    wherein the hearing loss processor (40) is configured to process the sum audio signal (38) to provide the hearing loss compensated output signal (42).
  3. A hearing aid (10) according to claim 1 or 2, wherein the sound source (110) resides in a forward looking direction of the user.
  4. A hearing aid (10) according to any of the preceding claims, wherein the first matched filter (20) has an impulse response h1(T-t) that is substantially equal to a time reversed and time shifted impulse response h1(t) of the first sound propagation path (120) of the sound propagating from the sound source (110) to the first microphone system (12), when the user (100) wears the hearing aid (10).
  5. A hearing aid (10) according to any of the preceding claims, wherein the first and second matching transfer functions substantially equalize a phase of the first filtered audio signal (22) and a phase of the second filtered audio signal (34), so that the first adder (36) can add the first and second filtered audio signals (22, 34) in-phase.
  6. A hearing aid (10) according to any of the preceding claims, wherein the first and second matching transfer functions substantially equalize an amplitude spectrum of the first filtered audio signal (22) and an amplitude spectrum of the second filtered audio signal (34), respectively, to the amplitude spectrum of the sound emitted by the sound source (110).
  7. A hearing aid (10) according to any of the preceding claims, wherein the hearing aid (10) is a multi-channel hearing aid (10) in which the first audio signal (14) is divided into a plurality of signal components for being processed individually in a plurality of frequency channels, respectively.
  8. A hearing aid (10) according to claim 7, wherein the first matched filter (20) is configured to perform filtering in a selected frequency band.
  9. A hearing aid (10) according to claim 7 or 8, wherein the plurality of frequency channels includes warped frequency channels.
  10. A binaural hearing aid system (10) comprising a first hearing aid (10A) and a second hearing aid (10B), wherein the first hearing aid (10A) is a hearing aid according to any of the preceding claims.
  11. A binaural hearing aid system (10) according to claim 10, wherein each of the first and second hearing aids (10A, 10B) is a hearing aid according to any of claims 1 - 9.
  12. A binaural hearing aid system (10) according to claim 11, wherein
    the first hearing aid (10A) has a second adder with a first input that is connected to an output of the first adder of the first hearing aid (10A) and a second input that is connected to an output of the first adder of the second hearing aid (10B) and an output for provision of a binaural sum audio signal (38A) of the sum audio signal of the first hearing aid (10A) and the sum audio signal of the second hearing aid (10B),
    wherein the hearing loss processor (40A) is configured to process the binaural sum audio signal (38A) to provide the hearing loss compensated output signal (42A, 42B).
  13. A method of increasing a signal to noise ratio of a sound signal received in a hearing aid (10) in an environment with diffuse noise, comprising:
    converting acoustic sound into an audio signal (14) using a microphone system (12) of the hearing aid (10),
    characterized in
    filtering the audio signal (14) with a matched filter (20) of the hearing aid (10) having a matching transfer function H*(ω) that is substantially equal to a first complex scalar multiplied with a complex conjugate of a transfer function H(ω) of a sound propagation path (120) of the acoustic sound from a sound source (110) to the microphone system (12), when the microphone system (12) is worn by a user (100), wherein the first complex scalar is selected so that the first matched filter is a causal filter.
  14. The method according to claim 13, further comprising adding a plurality of the filtered audio signals (22, 34) to obtain a sum audio signal (38) for improvement of the signal to noise ratio, wherein one of the filtered audio signals (22) is resulted from the act of filtering the audio signal.
EP14199590.2A 2014-12-22 2014-12-22 Diffuse noise listening Active EP3038381B1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
EP14199590.2A EP3038381B1 (en) 2014-12-22 2014-12-22 Diffuse noise listening
DK14199590.2T DK3038381T3 (en) 2014-12-22 2014-12-22 Listening in diffuse noise
US14/584,872 US9774960B2 (en) 2014-12-22 2014-12-29 Diffuse noise listening
CN201580070136.2A CN107113516B (en) 2014-12-22 2015-12-17 Diffusion noise is listened to
JP2017533412A JP6267834B2 (en) 2014-12-22 2015-12-17 Listening to diffuse noise
PCT/EP2015/080218 WO2016102300A1 (en) 2014-12-22 2015-12-17 Diffuse noise listening

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP14199590.2A EP3038381B1 (en) 2014-12-22 2014-12-22 Diffuse noise listening

Publications (2)

Publication Number Publication Date
EP3038381A1 EP3038381A1 (en) 2016-06-29
EP3038381B1 true EP3038381B1 (en) 2017-08-09

Family

ID=52282481

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14199590.2A Active EP3038381B1 (en) 2014-12-22 2014-12-22 Diffuse noise listening

Country Status (2)

Country Link
EP (1) EP3038381B1 (en)
DK (1) DK3038381T3 (en)

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10249416B4 (en) * 2002-10-23 2009-07-30 Siemens Audiologische Technik Gmbh Method for adjusting and operating a hearing aid device and hearing aid device
US8670583B2 (en) * 2009-01-22 2014-03-11 Panasonic Corporation Hearing aid system
EP2611218B1 (en) * 2011-12-29 2015-03-11 GN Resound A/S A hearing aid with improved localization
EP2750410B1 (en) 2012-12-28 2018-10-03 GN Hearing A/S A hearing aid with improved localization
EP2750411B1 (en) 2012-12-28 2015-09-30 GN Resound A/S A hearing aid with improved localization
EP2750412B1 (en) 2012-12-28 2016-06-29 GN Resound A/S Improved localization with feedback
US10425747B2 (en) * 2013-05-23 2019-09-24 Gn Hearing A/S Hearing aid with spatial signal enhancement

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
DK3038381T3 (en) 2017-11-20
EP3038381A1 (en) 2016-06-29

Similar Documents

Publication Publication Date Title
US10181328B2 (en) Hearing system
Marquardt et al. Theoretical analysis of linearly constrained multi-channel Wiener filtering algorithms for combined noise reduction and binaural cue preservation in binaural hearing aids
US9100762B2 (en) Hearing aid with improved localization
EP3468228B1 (en) Binaural hearing system with localization of sound sources
EP3794844B1 (en) Adaptive binaural beamforming with preservation of spatial cues in hearing assistance devices
US9432778B2 (en) Hearing aid with improved localization of a monaural signal source
EP2611218B1 (en) A hearing aid with improved localization
Cornelis et al. Speech intelligibility improvements with hearing aids using bilateral and binaural adaptive multichannel Wiener filtering based noise reduction
JP2019531659A (en) Binaural hearing aid system and method of operating a binaural hearing aid system
US20140185846A1 (en) Hearing aid with improved localization
US9774960B2 (en) Diffuse noise listening
JP6518286B2 (en) Method of operation of a binaural hearing system
EP2928213B1 (en) A hearing aid with improved localization of a monaural signal source
Derleth et al. Binaural signal processing in hearing aids
EP2806660B1 (en) A hearing aid with improved localization
EP3038381B1 (en) Diffuse noise listening
Jespersen et al. Increasing the effectiveness of hearing aid directional microphones
EP2750412B1 (en) Improved localization with feedback
EP2750410B1 (en) A hearing aid with improved localization
EP3148217B1 (en) Method for operating a binaural hearing system
JP6479211B2 (en) Hearing device
Le Goff et al. Modeling horizontal localization of complex sounds in the impaired and aided impaired auditory system
Wu et al. Hearing aid system with 3D sound localization
Valentin et al. Development of a real-time EOG-based acoustical beamformer algorithm for binaural hearing devices
US11617037B2 (en) Hearing device with omnidirectional sensitivity

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20161214

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20170404

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

RIN1 Information on inventor provided before grant (corrected)

Inventor name: GRAN, KARL-FREDRIK JOHAN

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 918027

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170815

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602014012809

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20171113

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20170809

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 4

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 918027

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170809

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171109

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

RAP2 Party data changed (patent owner data changed or rights of a patent transferred)

Owner name: GN HEARING A/S

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171109

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171209

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171110

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602014012809

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20180511

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171222

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171222

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20171231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171222

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20141222

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170809

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20211221

Year of fee payment: 8

Ref country code: DK

Payment date: 20211217

Year of fee payment: 8

Ref country code: FR

Payment date: 20211215

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20211217

Year of fee payment: 8

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20221231

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20221222

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221231

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221222

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221231

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231218

Year of fee payment: 10