EP2750410B1 - A hearing aid with improved localization - Google Patents

A hearing aid with improved localization Download PDF

Info

Publication number
EP2750410B1
EP2750410B1 EP12199720.9A EP12199720A EP2750410B1 EP 2750410 B1 EP2750410 B1 EP 2750410B1 EP 12199720 A EP12199720 A EP 12199720A EP 2750410 B1 EP2750410 B1 EP 2750410B1
Authority
EP
European Patent Office
Prior art keywords
btec
iec
hearing aid
microphone
bte
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP12199720.9A
Other languages
German (de)
French (fr)
Other versions
EP2750410A1 (en
Inventor
Karl-Fredrik Johan Gran
Guilin Ma
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GN Hearing AS
Original Assignee
GN Hearing AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GN Hearing AS filed Critical GN Hearing AS
Priority to DK12199720.9T priority Critical patent/DK2750410T3/en
Priority to EP12199720.9A priority patent/EP2750410B1/en
Priority to US13/872,720 priority patent/US9338561B2/en
Priority to JP2013266879A priority patent/JP5723962B2/en
Priority to CN201310744341.5A priority patent/CN103916806A/en
Priority to CN201810895006.8A priority patent/CN109089200B/en
Publication of EP2750410A1 publication Critical patent/EP2750410A1/en
Application granted granted Critical
Publication of EP2750410B1 publication Critical patent/EP2750410B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/70Adaptation of deaf aid to hearing loss, e.g. initial electronic fitting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/021Behind the ear [BTE] hearing aids
    • H04R2225/0216BTE hearing aids having a receiver in the ear mould
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40Arrangements for obtaining a desired directivity characteristic
    • H04R25/407Circuits for combining signals of a plurality of transducers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/45Prevention of acoustic reaction, i.e. acoustic oscillatory feedback
    • H04R25/453Prevention of acoustic reaction, i.e. acoustic oscillatory feedback electronically
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2420/00Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Definitions

  • a new hearing aid is provided with improved localization of sound sources with relation to the wearer of the hearing aid.
  • Hearing aid users have been reported to have poorer ability to localize sound sources when wearing their hearing aids than without their hearing aids. This represents a serious problem for the mild-to-moderate hearing impaired population.
  • hearing aids typically reproduce sound in such a way that the user perceives sound sources to be localized inside the head. The sound is said to be internalized rather than being externalized.
  • a common complaint for hearing aid users when referring to the "hearing speech in noise problem" is that it is very hard to follow anything that is being said even though the signal to noise ratio (SNR) should be sufficient to provide the required speech intelligibility.
  • SNR signal to noise ratio
  • a significant contributor to this fact is that the hearing aid reproduces an internalized sound field. This adds to the cognitive loading of the hearing aid user and may result in listening fatigue and ultimately that the user removes the hearing aid(s).
  • the new hearing aid preserves information of the directions and distances of respective sound sources in the sound environment with relation to the orientation of the head of the wearer of the hearing aid.
  • Human beings detect and localize sound sources in three-dimensional space by means of the human binaural sound localization capability.
  • the input to the hearing consists of two signals, namely the sound pressures at each of the eardrums, in the following termed the binaural sound signals.
  • the human auditory system extracts information about distance and direction to a sound source, but it is known that the human auditory system uses a number of cues in this determination. Among the cues are spectral cues, reverberation cues, interaural time differences (ITD), interaural phase differences (IPD) and interaural level differences (ILD).
  • HRTF Head-Related Transfer Function
  • the HRTF contains all information relating to the sound transmission to the ears of the listener, including diffraction around the head, reflections from shoulders, reflections in the ear canal, etc., and therefore, the HRTF varies from individual to individual.
  • the hearing aid related transfer function is defined similar to a HRTF, namely as the ratio between a sound pressure p generated by the hearing aid at a specific point in the appertaining ear canal in response to a plane wave and a reference.
  • the reference traditionally chosen is the sound pressure p l that would have been generated by a plane wave at a position right in the middle of the head with the listener absent.
  • the HRTF changes with direction and distance of the sound source in relation to the ears of the listener. It is possible to measure the HRTF for any direction and distance and simulate the HRTF, e.g. electronically, e.g. by filters. If such filters are inserted in the signal path between a playback unit, such as a tape recorder, and headphones used by a listener, the listener will achieve the perception that the sounds generated by the headphones originate from a sound source positioned at the distance and in the direction as defined by the transfer functions of the filters simulating the HRTF in question, because of the true reproduction of the sound pressures in the ears.
  • a playback unit such as a tape recorder
  • Binaural processing by the brain when interpreting the spatially encoded information, results in several positive effects, namely better signal-to-noise ratio (SNR); direction of arrival (DOA) estimation; depth/distance perception and synergy between the visual and auditory systems.
  • SNR signal-to-noise ratio
  • DOA direction of arrival
  • the complex shape of the ear is a major contributor to the individual spatial-spectral cues (ITD, ILD and spectral cues) of a listener. Devices which pick up sound behind the ear will, hence, be at a disadvantage in reproducing the HRTF since much of the spectral detail will be lost or heavily distorted.
  • FIGs. 1 and 2 This is exemplified in Figs. 1 and 2 where the angular frequency spectrum of an open ear, i.e. non-occluded, measurement is shown in Fig. 1 for comparison with Fig. 2 showing the corresponding measurement on the front microphone on a behind the ear device (BTE) using the same ear.
  • BTE behind the ear device
  • US 2004/136541 discloses a hearing aid device, and operating and adjustment methods therefor, with microphone disposed outside of the auditory canal.
  • the localization capability with regard to a signal source is lost.
  • the transfer function of the head or of the external ear is taken into account between the position at which the microphone is located and a position in the auditory canal of the hearing device user.
  • EP 2 088 802 discloses a method of estimating weighting function of audio signals in a hearing aid.
  • a method of generating an audible signal in a hearing aid by estimating a weighting function of received audio signals is disclosed, the hearing aid is adapted to be worn by a user; the method comprises the steps of: estimating a directional signal by estimating a weighted sum of two or more microphone signals from two or more microphones, where a first microphone of the two or more microphones is a front microphone, and where a second microphone of the two or more microphones is a rear microphone; estimating a direction-dependent time-frequency gain, and synthesizing an output signal.
  • a microphone of the hearing aid at a position with relation to a user wearing the hearing aid, in which spatial cues of sounds arriving at the user is preserved. It is for example advantageous to position a microphone in the outer ear of the user in front of the pinna, for example at the entrance to the ear canal; or, inside the ear canal, in order to preserve spatial cues of sounds arriving at the ear to a much larger extent than what is possible with a microphone positioned behind the ear.
  • a microphone positioned in front of the pinna below the triangular fossa has also proven advantageous with relation to preservation of spatial cues.
  • Positioning of a microphone at the entrance to the ear canal or inside the ear canal leads to the problem that the microphone is moved close to the sound emitting device of the hearing aid, whereby the risk of feedback generation is increased, which in turn limits the maximum stable gain which can be prescribed with the hearing aid.
  • a BTE hearing aid with front and rear microphones positioned behind the ear and an In-The-Ear (ITE) hearing aid with an open fitted microphone positioned in the ear canal is shown in Fig. 3 . It can be seen that the ITE hearing aid has much lower maximum stable gain (MSG) than the front and rear BTE microphones for nearly all frequencies.
  • MSG maximum stable gain
  • output signals of an arbitrary configuration of microphones undergo signal processing in such a way that spatial cues are preserved and conveyed to the user of the hearing aid.
  • the output signals are filtered with filters that are configured to preserve spatial cues.
  • the new hearing aid may provide improved localization to the user by providing, in addition to conventionally positioned microphones as in a BTE hearing aid, at least one ITE microphone intended to be positioned in the outer ear of the user in front of the pinna, e.g. at the entrance to the ear canal or immediately below the triangular fossa; or, inside the ear canal, when in use, in order to record sound arriving at the ear of the user and containing the desired spatial information relating to localization of sound sources in the sound environment.
  • the processor of the new hearing aid combines an audio signal of the at least one ITE microphone residing in the outer ear of the user with the microphone signal(s) of the conventionally positioned microphone(s) of the hearing aid in such a way that spatial cues are preserved.
  • An audio signal of the at least one ITE microphone may be formed as a weighted sum of the output signals of each microphone of the at least one ITE microphone.
  • Other forms of signal processing may be included in the formation of the audio signal of the at least one ITE microphone.
  • a new hearing aid comprising a BTE hearing aid housing configured to be worn behind the pinna of a user, at least one BTE sound input transducer, such as an omni-directional microphone, a directional microphone, a transducer for an implantable hearing aid, a telecoil, a receiver of a digital audio datastream, etc., accommodated in the BTE hearing aid housing, each of which is configured for conversion of acoustic sound into a respective audio signal, an ITE microphone housing configured to be positioned in the outer ear of the user for fastening and retaining in its intended position at least one ITE microphone accommodated in the ITE microphone housing, each of which is configured for conversion of acoustic sound into a respective audio signal, at least one cue filter, each of which having an input that is provided with an output signal from a respective one of the at least one BTE sound input transducer and at least one ITE microphone, a processor configured to generate a hearing loss compensated output signal based on a combination of the BTE sound input
  • the hearing aid may further have a sound signal transmission member for transmission of a signal representing sound from a sound output in the BTE hearing aid housing at a first end of the sound signal transmission member to the ear canal of the user at a second end of the sound signal transmission member, an earpiece configured to be inserted in the ear canal of the user for fastening and retaining the sound signal transmission member in its intended position in the ear canal of the user.
  • the new hearing aid may be a multi-channel hearing aid in which signals to be processed are divided into a plurality of frequency channels, and wherein signals are processed individually in each of the frequency channels.
  • Possible adaptive feedback cancellation circuitry may also be divided into the plurality of frequency channels; or, the adaptive feedback cancellation circuitry may still operate in the entire frequency range; or, may be divided into other frequency channels, typically fewer frequency channels, than the other circuitry is divided into.
  • the processor may be configured for processing the output signals of the at least one ITE microphone and the at least one BTE sound input transducer in such a way that the hearing loss compensated output signal substantially preserves spatial cues in a selected frequency band.
  • the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
  • the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • the at least one ITE microphone may be connected conventionally as an input source to the processor of the hearing aid and may cooperate with the processor of the hearing aid in a well-known way.
  • the at least one ITE microphone supplies the input to the hearing aid at frequencies where the hearing aid is capable of supplying the desired gain with this configuration.
  • the microphones of BTE hearing aid housing are included in the signal processing as disclosed above. In this way, the gain can be increased while simultaneously maintain the spatial information about the sound environment provided by the at least one ITE microphone.
  • the hearing aid may for example comprise a first filter connected between the processor input and the at least one ITE microphone, and a second complementary filter connected between the processor input and a combined output of the at least one BTE sound input transducer, the filters passing and blocking frequencies in complementary frequency bands so that one of the at least one ITE microphone and the combined output of at least one BTE sound input transducer constitutes the main part of the input signal supplied to the processor input in one frequency band, and the other one of the at least one ITE microphone and the combined output of at least one BTE sound input transducer constitutes the main part of the input signal supplied to the processor input in the complementary frequency band.
  • the at least one ITE microphone may be used as the sole input source to the processor in a frequency band wherein the required gain for hearing loss compensation can be applied to the output signal of the at least one ITE microphone. Outside this frequency band, the combined output signal of the at least one BTE sound input transducer is applied to the processor for provision of the required gain.
  • the "output signals of the at least one ITE microphone” may be used to identify any analogue or digital signal forming part of the signal path from the output of the at least one ITE microphone to an input of the processor, including pre-processed output signals of the at least one ITE microphone.
  • the "output signals of the at least one BTE sound input transducer" may be used to identify any analogue or digital signal forming part of the signal path from the at least one BTE sound input transducer to an input of the processor, including pre-processed output signals of the at least one BTE sound input transducer.
  • the at least one ITE microphone is positioned so that the output signal of the at least one ITE microphone generated in response to the incoming sound has a transfer function that constitutes a good approximation to the HRTFs of the user.
  • the at least one ITE microphone may be constituted by a single microphone positioned at the entrance to the ear canal.
  • the processor conveys the directional information contained in the output signal of the at least one ITE microphone to the resulting hearing loss compensated output signal of the processor so that the hearing loss compensated output signal of the processor also attains a transfer function that constitutes a good approximation to the HRTFs of the user whereby improved localization is provided to the user.
  • a BTE hearing aid has a BTE housing that is shaped to be worn behind the pinna of the user.
  • the BTE housing accommodates components for hearing loss compensation.
  • a sound signal transmission member i.e. a sound tube or an electrical conductor, transmits a signal representing the hearing loss compensated sound from the BTE housing into the ear canal of the user.
  • an earpiece, shell, or earmould may be provided for insertion into the ear canal of the user constituting an open solution.
  • the earpiece, shell, or earmould does not obstruct the ear canal when it is positioned in its intended operational position in the ear canal.
  • the earpiece, shell, or earmould is individually custom manufactured or manufactured in a number of standard sizes to fit the user's ear to sufficiently secure the sound signal transmission member in its intended position in the ear canal and prevent the earpiece from falling out of the ear, e.g., when the user moves the jaw.
  • the output transducer may be a receiver positioned in the BTE hearing aid housing.
  • the sound signal transmission member comprises a sound tube for propagation of acoustic sound signals from the receiver positioned in the BTE hearing aid housing and through the sound tube to an earpiece positioned and retained in the ear canal of the user and having an output port for transmission of the acoustic sound signal to the eardrum in the ear canal.
  • the output transducer may be a receiver positioned in the earpiece.
  • the sound signal transmission member comprises electrical conductors for propagation of audio signals from the output of a processor in the BTE hearing aid housing through the conductors to a receiver positioned in the earpiece for emission of sound through an output port of the earpiece.
  • the ITE microphone housing accommodating at least one ITE microphone may be combined with, or be constituted by, the earpiece so that the at least one microphone is positioned proximate the entrance to the ear canal when the earpiece is fastened in its intended position in the ear canal.
  • the ITE microphone housing may be connected to the earpiece with an arm, possibly a flexible arm that is intended to be positioned inside the pinna, e.g. around the circumference of the conchae abutting the antihelix and at least partly covered by the antihelix for retaining its position inside the outer ear of the user.
  • the arm may be pre-formed during manufacture, preferably into an arched shape with a curvature slightly larger than the curvature of the antihelix, for easy fitting of the arm into its intended position in the pinna.
  • the arm has a length and a shape that facilitate positioning of the at least one ITE microphone in an operating position immediately below the triangular fossa.
  • the processor may be accommodated in the BTE hearing aid housing, or in the ear piece, or part of the processor may be accommodated in the BTE hearing aid housing and part of the processor may be accommodated in the ear piece.
  • the link may be wired or wireless.
  • the link may be wired or wireless.
  • the processor operates to perform hearing loss compensation while maintaining spatial information of the sound environment for optimum spatial performance of the hearing aid and while at the same time providing as large maximum stable gain as possible.
  • output signals of an arbitrary configuration of microphones undergo signal processing in such a way that spatial cues are preserved and conveyed to the user of the hearing aid.
  • the output signals are filtered with filters that are configured to preserve spatial cues.
  • a method may be performed in the new hearing aid, comprising the steps of:
  • Feedback may be taken into account by performing the solution of the minimization problem above subject to the condition that the gain of the feedback loops must be less than one, i.e. subject to the condition that: 1
  • frequency weights W(f) may optimize the solution in certain one or more frequency ranges
  • angular weights W(l) may optimize the solution for certain directions of arrival of sound.
  • L (I) is the angular direction towards a sound source with respect to the looking direction of a user wearing the hearing aid.
  • ⁇ MSG f or min G i IEC f , G j BTEC f ( ⁇ l 0 L ⁇ 1 W l ⁇ W f HRT F l f ⁇ ⁇ i G i IEC f H l , i IEC f ⁇ ⁇ j G j BTEC f H l , j BTEC f
  • only magnitude of the transfer functions may be taken into account during minimization while phase is disregarded, i.e. in the one or more selected frequency range, the transfer function is substituted by its absolute value.
  • the target transfer function need not be defined by the HRTF for the various directions I. Any transfer function that includes spatial cues may be used as the target transfer function.
  • the output signal of each of the at least one ITE microphone may be pre-processed.
  • the output signal of each of the at least one BTE sound input transducer may be pre-processed.
  • Pre-processing may include, without excluding any form of processing; adaptive and/or static feedback suppression, adaptive or fixed beamforming and pre-filtering.
  • the at least one ITE microphone may operate as monitor microphone(s) for generation of an electronic sound signal with the desired spatial information of the current sound environment.
  • Each output signal of the at least one BTE sound input transducer and of the at least one ITE microphone is filtered with a respective cue filter, the transfer function of which are configured to provide a combined output signal of the cue filters with a transfer function that approximates the HRTFs of the user as closely as possible.
  • the combined output signal of the cue filters is passed on for further hearing loss compensation processing, e.g. with a compressor.
  • signals from the at least one BTE sound input transducer and the at least one ITE microphone are appropriately processed before hearing loss compensation whereby risk of feedback from the output transducer to the at least one ITE microphone and the at least one BTE sound input transducer is minimized and a large maximum stable gain can be provided.
  • the at least one cue filter G i IEC f of the respective at least one ITE microphone and the at least one cue filter G j BTEC f of the respective at least one BTE sound transducer may be determined by the following steps: With the hearing aid worn by the individual user:
  • measurements above need not be performed with the individual user; rather measurements may be performed that constitute good approximations to individual measurements for a number of humans with certain characteristics in common, e.g. humans within a certain age group, population, etc.: For a number of user's with certain characteristics in common:
  • the audio signals may be divided into a plurality of frequency channels, and be individually processed in individual frequency channels, and the transfer functions of
  • the at least one BTE microphone may be disconnected from the processor in one or more selected frequency channels so that hearing loss compensation is performed solely on the output of the at least one ITE microphone in the one or more selected frequency channels.
  • processor As used herein, the terms "processor”, “signal processor”, “controller”, “system”, etc., are intended to refer to CPU-related entities, either hardware, a combination of hardware and software, software, or software in execution.
  • a "processor”, “signal processor”, “controller”, “system”, etc. may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
  • processor designate both an application running on a processor and a hardware processor.
  • processors may reside within a process and/or thread of execution, and one or more "processors”, “signal processors”, “controllers”, “systems”, etc., or any combination hereof, may be localized on one hardware processor, possibly in combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
  • Fig. 4 schematically illustrates an example of the new hearing aid 10 comprising a BTE hearing aid housing 12 (not shown - outer walls have been removed to make internal parts visible) to be worn behind the pinna 100 of a user.
  • the BTE housing 12 accommodates at least one BTE sound input transducer 14, 16 with a front microphone 14 and a rear microphone 16 for conversion of a sound signal into a microphone audio signal, optional pre-filters (not shown) for filtering the respective microphone audio signals, A/D converters (not shown) for conversion of the respective microphone audio signals into respective digital microphone audio signals that are input to a processor 18 configured to generate a hearing loss compensated output signal based on the input digital audio signals .
  • the hearing loss compensated output signal is transmitted through electrical wires contained in a sound signal transmission member 20 to a receiver 22 for conversion of the hearing loss compensated output signal to an acoustic output signal for transmission towards the eardrum of a user and contained in an earpiece 24 that is shaped (not shown) to be comfortably positioned in the ear canal of a user for fastening and retaining the sound signal transmission member in its intended position in the ear canal of the user as is well-known in the art of BTE hearing aids.
  • the earpiece 24 also holds one ITE microphone 26 that is positioned at the entrance to the ear canal when the earpiece is positioned in its intended position in the ear canal of the user.
  • the ITE microphone 26 is connected to an A/D converter (not shown) and optional to a pre-filter (not shown) in the BTE housing 12, with electrical wires (not visible) contained in the sound transmission member 20.
  • the BTE hearing aid 10 is powered by battery 28.
  • processor 18 Various possible functions of the processor 18 are disclosed above and some of these in more detail below.
  • Fig. 5 schematically illustrates another BTE hearing aid 10 similar to the hearing aid shown in Fig. 1 , except for the difference that in Fig. 5 , the receiver 22 is positioned in the hearing aid housing 12 and not in the earpiece 24, so that acoustic sound output by the receiver 22 is transmitted through the sound tube 20 and towards the eardrum of the user when the earpiece 24 is positioned in its intended position in the ear canal of the user.
  • the positioning of the ITE microphone 26 proximate the entrance to the ear canal of the user when the BTE hearing aids 10 of Figs. 4 and 5 are used is believed to lead to a good reproduction of the HRTFs of the user.
  • Fig. 6 shows a BTE hearing aid 10 in its operating position with the BTE housing 12 behind the ear, i.e. behind the pinna 100, of the user.
  • the illustrated BTE hearing aid 10 is similar to the hearing aids shown in Figs. 4 and 5 except for the fact that the ITE microphone 26 is positioned in the outer ear of the user outside the ear canal at the free end of an arm 30.
  • the arm 30 is flexible and the arm 30 is intended to be positioned inside the pinna 100 , e.g. around the circumference of the conchae 102 behind the tragus 104 and antitragus 106 and abutting the antihelix 108 and at least partly covered by the antihelix for retaining its position inside the outer ear of the user.
  • the arm may be pre-formed during manufacture, preferably into an arched shape with a curvature slightly larger than the curvature of the antihelix 108, for easy fitting of the arm 30 into its intended position in the pinna.
  • the arm 30 contains electrical wires (not visible) for interconnection of the ITE microphone 26 with other parts of the BTE hearing aid circuitry.
  • the arm 30 has a length and a shape that facilitate positioning of the ITE microphone 26 in an operating position below the triangular fossa.
  • Fig. 7 is a block diagram illustrating one example of signal processing in the new hearing aid 10.
  • the BTE hearing aid 10 has an array of microphones 14-1, 14-2, ... , 14-M, 26-1, 26-2, ... , 26-N, for example constituted by a front microphone 14 and a rear microphone 16 and an ITE microphone 26 that resides in an earpiece 24 to be positioned in the outer ear of the user as illustrated in Figs. 4 - 6 .
  • the microphone output audio signals are digitized (A/D-converters not shown) and pre-processed, such as pre-filtered, in respective pre-processors 32-1, 32-2, ... , 32-N, 34-1, 34-2, ... , 34-M.
  • the digitized and possibly pre-processed microphone output audio signals 38-1, 38-2, ... , 38-N, 40-1, 40-2, ... , 40-M are filtered in cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M and the filtered signals 46-1, 46-2, ... , 46-N, 48-1, 48-2, ...
  • the hearing loss compensated signal 54 is output to a receiver 22 that converts the signal to an acoustic signal for transmission towards the ear drum of the user.
  • the new hearing aid circuitry shown in Fig. 7 may operate in the entire frequency range of the BTE hearing aid 10.
  • the hearing aid 10 shown in Fig. 7 may be a multi-channel hearing aid in which microphone output audio signals are divided into a plurality of frequency channels, and wherein divided signals are processed individually in each of the frequency channels.
  • Fig. 7 may illustrate the circuitry and signal processing in a single frequency channel.
  • the circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
  • the signal processing illustrated in Fig. 7 may be performed in a selected frequency band, e.g. selected during fitting of the hearing aid 10 to a specific user at a dispenser's office.
  • the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
  • the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • one or more of the at least one ITE microphone may be connected conventionally as an input source to the processor of the hearing aid and may cooperate with the processor of the hearing aid in a well-known way.
  • one or more or all of the at least one ITE microphone provide the input to the processor 18 at frequencies where the hearing aid is capable of supplying the desired gain based on the input from the one or more of the at least one ITE microphone.
  • the microphones of BTE hearing aid housing are included in the signal processing as disclosed above. In this way, the gain can be increased while simultaneously maintain the spatial information about the sound environment as provided by the array of microphones.
  • the minimization problem may be solved subject to the condition that: 1
  • weights W(f) may optimize the solution in certain one or more frequency ranges
  • angular weights W(l) may optimize the solution for certain directions of arrival of sound.
  • ⁇ MSG f or min G i IEC f , G j BTEC f ( ⁇ l 0 L ⁇ 1 W l ⁇ W f HRT F l f ⁇ ⁇ i G i IEC f H l , i IEC f ⁇ ⁇ j G j BTEC f H l , j BTEC
  • only magnitude of the transfer functions may be taken into account during minimization while phase is disregarded, i.e. in the one or more selected frequency range, the transfer function is substituted by its absolute value.
  • the target transfer function need not be defined by the HRTF for the various directions I. Any transfer function that includes spatial cues may be used as the target transfer function.
  • Fig. 8 is a block diagram illustrating a new hearing aid 10 similar to the hearing aid 10 shown in Fig. 7 except for the fact that an adaptive feedback canceller 70 has been added with an input 72 connected to the output of the processor 18 and outputs 74-1, 74-2, ... , 74-N, 76-1, 76-2, ... , 76-M connected to respective subtractors 78-1, 78-2, ... , 78-N. 80-1, 80-2, ... , 80-M for subtraction of the outputs from each respective microphone output audio signal to provide feedback compensated signals fed to the corresponding pre-processors 32-1, 32-2, ... , 32-N, 34-1, 34-2, ...
  • the feedback canceller 70 provide signals 74-1, 74-2, ... , 74-N, 76-1, 76-2, ... , 76-M that constitute approximations of corresponding feedback signals travelling from the output transducer 22 to the respective microphones 14-1, 14-2, ... , 14-M, 26-1, 26-2, ... , 26-N.
  • the hearing aid 10 shown in Fig. 8 may be a multi-channel hearing aid in which microphone output audio signals are divided into a plurality of frequency channels, and wherein divided signals are processed individually in each of the frequency channels.
  • Fig. 8 may illustrate the circuitry and signal processing in a single frequency channel.
  • the circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
  • the adaptive feedback cancelling circuitry may also be divided into the plurality of frequency channels; or, the adaptive circuitry may still operate in the entire frequency range; or, may be divided into other frequency channels, typically fewer frequency channels, than the other circuitry is divided into.
  • the signal processing illustrated in Fig. 8 may be performed in a selected frequency band, e.g. selected during fitting of the hearing aid 10 to a specific user at a dispenser's office.
  • the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
  • the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • one or more of the at least one ITE microphone may be connected conventionally as an input source to the processor of the hearing aid and may cooperate with the processor of the hearing aid in a well-known way.
  • the one or more of the at least one ITE microphone provide the input to the processor 18 at frequencies where the hearing aid is capable of supplying the desired gain based on the input from the one or more of the at least one ITE microphone.
  • the microphones of BTE hearing aid housing are included in the signal processing as disclosed above. In this way, the gain can be increased while simultaneously maintain the spatial information about the sound environment as provided by the array of microphones.
  • Fig. 9 is a schematic block diagram illustrating one method of determining the cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M of the hearing aids shown in Figs. 7 and 8 , e.g. during fitting of the hearing aid.
  • the cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M are adaptive filters that are allowed to adapt during fitting of the hearing aid. After determination of the cue filters, , the filter coefficients are kept constant at the respective determined values.
  • the microphone ITE REF 25 may be a single microphone located in a position with relation to an artificial head or a user with good preservation of spatial cues of incoming sound; or, the microphone ITE REF 25 may represent an array of microphones connected to pre-processor 31 and located in a position with relation to an artificial head or a user in which a combined signal output from the array of microphones, e.g. in cooperation with pre-processor 31, has good preservation of spatial cues of incoming sound.
  • the output signal of microphone (array) ITE REF 25 has a transfer function that constitutes a good approximation to the HRTFs of the user for one or more directions towards a sound source.
  • various sound sources emit sound from respective various directions with relation to the artificial head or user of the hearing aid
  • the cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M are allowed to adapt to the output signal 51 of the delay 41 and at the end of adaptation, e.g. when the filter coefficients of the cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M have stabilized, i.e. the changes of the filter coefficients have become less than a certain threshold, the filter coefficients are no longer allowed to change.
  • the signal 51 is disconnected from subtractor 54 so that signal 56 constitutes a combined output signal of the cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M that has substantially the same spatial cues as the output signal 51.
  • the delay 41 delays the output signal of the pre-processor 31 with a delay that is substantially equal to the delay of the cue filters 42-1, 42-2, ,..., 42-N, 44-1, ... , 44-M.
  • adaptation of the filter coefficients of the cue filters 42-1, 42-2, ,..., 42-N, 44-1, ... , 44-M are controlled by adaptive cue controller 48 that controls the adaptation of the filter coefficients to minimize the output signal 52 of the subtractor 54 equal to the difference between sum of output signals 50-1, 50-2, ... , 50-N, 46-1, 46-2, ... , 46-M and the ITE REF microphone audio signal 51.
  • W(f) may be equal to one for all frequencies and/or W(l) may be equal to one for all directions.
  • Possible feedback may be taken into account by solving the minimization problem above subject to the condition that 1
  • ⁇ MSG f or min G i IEC f , G j BTEC f ( ⁇ l 0 L ⁇ 1 W l ⁇ W f HRT F l f ⁇ ⁇ i G i IEC f H l , i IEC f ⁇ j G j BTEC f H l , j BTEC f ⁇ p + ⁇ ⁇ ⁇ i G i IEC f H FB , i IEC f + ⁇ j G j BTEC f H FB , j BTEC f ⁇ p )
  • the feedback compensation circuitry 72, 70, 74-1, 74-2, ... , 74-N, 76-1, 76-2, ... , 76-M, 78-1, 78-2, ... , 78-N, 80-1, 80-2, ... , 80-M, 82-1, 82-2, ... , 82-N, 84-1, 84-2, ... , 84-M, shown in Fig. 8 may be added to the circuit of Fig. 9 and in addition connecting the outputs 74-1, 74-2, ... , 74-N, 76-1, 76-2, ...
  • 76-M of the adaptive feedback filter 70 to respective inputs of the adaptive cue control 48 each of the outputs 74-1, 74-2, ... , 74-N, 76-1, 76-2, ... , 76-M providing an estimate of the hearing aid related transfer function of the respective at least one ITE microphone H l , i ITEC f , and the hearing aid related transfer functions of the respective at least one BTE microphone H l , j BTEC f so that the adaptive cue control 48 can check the condition: 1
  • ⁇ MSG f or solve the minimization problem: min G i IEC f , G j BTEC f ( ⁇ l 0 L ⁇ 1 W l ⁇ W f HRT F l f ⁇ ⁇ i G i IEC f H l

Description

    FIELD OF THE INVENTION
  • A new hearing aid is provided with improved localization of sound sources with relation to the wearer of the hearing aid.
  • BACKGROUND
  • Hearing aid users have been reported to have poorer ability to localize sound sources when wearing their hearing aids than without their hearing aids. This represents a serious problem for the mild-to-moderate hearing impaired population.
  • Furthermore, hearing aids typically reproduce sound in such a way that the user perceives sound sources to be localized inside the head. The sound is said to be internalized rather than being externalized. A common complaint for hearing aid users when referring to the "hearing speech in noise problem" is that it is very hard to follow anything that is being said even though the signal to noise ratio (SNR) should be sufficient to provide the required speech intelligibility. A significant contributor to this fact is that the hearing aid reproduces an internalized sound field. This adds to the cognitive loading of the hearing aid user and may result in listening fatigue and ultimately that the user removes the hearing aid(s).
  • Thus, there is a need for a new hearing aid with improved localization of sound sources, i.e. the new hearing aid preserves information of the directions and distances of respective sound sources in the sound environment with relation to the orientation of the head of the wearer of the hearing aid.
  • Human beings detect and localize sound sources in three-dimensional space by means of the human binaural sound localization capability.
  • The input to the hearing consists of two signals, namely the sound pressures at each of the eardrums, in the following termed the binaural sound signals. Thus, if sound pressures at the eardrums that would have been generated by a given spatial sound field are accurately reproduced at the eardrums, the human auditory system will not be able to distinguish the reproduced sound from the actual sound generated by the spatial sound field itself.
  • It is not fully known how the human auditory system extracts information about distance and direction to a sound source, but it is known that the human auditory system uses a number of cues in this determination. Among the cues are spectral cues, reverberation cues, interaural time differences (ITD), interaural phase differences (IPD) and interaural level differences (ILD).
  • The transmission of a sound wave from a sound source positioned at a given direction and distance in relation to the left and right ears of the listener is described in terms of two transfer functions, one for the left ear and one for the right ear, that include any linear distortion, such as coloration, interaural time differences and interaural spectral differences. Such a set of two transfer functions, one for the left ear and one for the right ear, is called a Head-Related Transfer Function (HRTF). Each transfer function of the HRTF is defined as the ratio between a sound pressure p generated by a plane wave at a specific point in or close to the appertaining ear canal (pL in the left ear canal and pR in the right ear canal) in relation to a reference. The reference traditionally chosen is the sound pressure pl that would have been generated by a plane wave at a position right in the middle of the head with the listener absent.
  • The HRTF contains all information relating to the sound transmission to the ears of the listener, including diffraction around the head, reflections from shoulders, reflections in the ear canal, etc., and therefore, the HRTF varies from individual to individual.
  • In the following, one of the transfer functions of the HRTF will also be termed the HRTF for convenience.
  • The hearing aid related transfer function is defined similar to a HRTF, namely as the ratio between a sound pressure p generated by the hearing aid at a specific point in the appertaining ear canal in response to a plane wave and a reference. The reference traditionally chosen is the sound pressure pl that would have been generated by a plane wave at a position right in the middle of the head with the listener absent.
  • The HRTF changes with direction and distance of the sound source in relation to the ears of the listener. It is possible to measure the HRTF for any direction and distance and simulate the HRTF, e.g. electronically, e.g. by filters. If such filters are inserted in the signal path between a playback unit, such as a tape recorder, and headphones used by a listener, the listener will achieve the perception that the sounds generated by the headphones originate from a sound source positioned at the distance and in the direction as defined by the transfer functions of the filters simulating the HRTF in question, because of the true reproduction of the sound pressures in the ears.
  • Binaural processing by the brain, when interpreting the spatially encoded information, results in several positive effects, namely better signal-to-noise ratio (SNR); direction of arrival (DOA) estimation; depth/distance perception and synergy between the visual and auditory systems.
  • The complex shape of the ear is a major contributor to the individual spatial-spectral cues (ITD, ILD and spectral cues) of a listener. Devices which pick up sound behind the ear will, hence, be at a disadvantage in reproducing the HRTF since much of the spectral detail will be lost or heavily distorted.
  • This is exemplified in Figs. 1 and 2 where the angular frequency spectrum of an open ear, i.e. non-occluded, measurement is shown in Fig. 1 for comparison with Fig. 2 showing the corresponding measurement on the front microphone on a behind the ear device (BTE) using the same ear. The open ear spectrum shown in Fig. 1 is rich in detail whereas the BTE result shown in Fig. 2 is much more blurred and much of the spectral detail is lost.
  • US 2004/136541 discloses a hearing aid device, and operating and adjustment methods therefor, with microphone disposed outside of the auditory canal. For a hearing-impaired person provided with a hearing aid device with which sound acquisition ensues outside of the auditory canals of the person, the localization capability with regard to a signal source is lost. To compensate the information loss that occurs due to the acquisition of an acoustic signal outside of the auditory canals, in the signal processing in the hearing aid device of an acoustic input signal acquired by at least one microphone of the hearing aid device, the transfer function of the head or of the external ear is taken into account between the position at which the microphone is located and a position in the auditory canal of the hearing device user.
  • EP 2 088 802 discloses a method of estimating weighting function of audio signals in a hearing aid. A method of generating an audible signal in a hearing aid by estimating a weighting function of received audio signals is disclosed, the hearing aid is adapted to be worn by a user; the method comprises the steps of: estimating a directional signal by estimating a weighted sum of two or more microphone signals from two or more microphones, where a first microphone of the two or more microphones is a front microphone, and where a second microphone of the two or more microphones is a rear microphone; estimating a direction-dependent time-frequency gain, and synthesizing an output signal.
  • SUMMARY
  • It is therefore desirable to position a microphone of the hearing aid at a position with relation to a user wearing the hearing aid, in which spatial cues of sounds arriving at the user is preserved. It is for example advantageous to position a microphone in the outer ear of the user in front of the pinna, for example at the entrance to the ear canal; or, inside the ear canal, in order to preserve spatial cues of sounds arriving at the ear to a much larger extent than what is possible with a microphone positioned behind the ear. A microphone positioned in front of the pinna below the triangular fossa has also proven advantageous with relation to preservation of spatial cues.
  • Positioning of a microphone at the entrance to the ear canal or inside the ear canal leads to the problem that the microphone is moved close to the sound emitting device of the hearing aid, whereby the risk of feedback generation is increased, which in turn limits the maximum stable gain which can be prescribed with the hearing aid.
  • The standard way of solving this problem is to completely seal off the ear canal using a custom mould. This, however, introduces the occlusion effect as well as comfort issues with respect to moisture and heat.
  • For comparison, the maximum stable gain of a BTE hearing aid with front and rear microphones positioned behind the ear, and an In-The-Ear (ITE) hearing aid with an open fitted microphone positioned in the ear canal is shown in Fig. 3. It can be seen that the ITE hearing aid has much lower maximum stable gain (MSG) than the front and rear BTE microphones for nearly all frequencies.
  • Disclosed is a method of determining parameters of a hearing aid for preserving spatial cues of sounds arriving at the user of the hearing aid according to claim 1. Also disclosed is a hearing aid according to claim 13.
  • In the new hearing aid, output signals of an arbitrary configuration of microphones undergo signal processing in such a way that spatial cues are preserved and conveyed to the user of the hearing aid. The output signals are filtered with filters that are configured to preserve spatial cues.
  • The new hearing aid may provide improved localization to the user by providing, in addition to conventionally positioned microphones as in a BTE hearing aid, at least one ITE microphone intended to be positioned in the outer ear of the user in front of the pinna, e.g. at the entrance to the ear canal or immediately below the triangular fossa; or, inside the ear canal, when in use, in order to record sound arriving at the ear of the user and containing the desired spatial information relating to localization of sound sources in the sound environment.
  • The processor of the new hearing aid combines an audio signal of the at least one ITE microphone residing in the outer ear of the user with the microphone signal(s) of the conventionally positioned microphone(s) of the hearing aid in such a way that spatial cues are preserved. An audio signal of the at least one ITE microphone may be formed as a weighted sum of the output signals of each microphone of the at least one ITE microphone. Other forms of signal processing may be included in the formation of the audio signal of the at least one ITE microphone.
  • Thus, a new hearing aid is provided, comprising
    a BTE hearing aid housing configured to be worn behind the pinna of a user,
    at least one BTE sound input transducer, such as an omni-directional microphone, a directional microphone, a transducer for an implantable hearing aid, a telecoil, a receiver of a digital audio datastream, etc., accommodated in the BTE hearing aid housing, each of which is configured for conversion of acoustic sound into a respective audio signal,
    an ITE microphone housing configured to be positioned in the outer ear of the user for fastening and retaining in its intended position
    at least one ITE microphone accommodated in the ITE microphone housing, each of which is configured for conversion of acoustic sound into a respective audio signal,
    at least one cue filter, each of which having an input that is provided with an output signal from a respective one of the at least one BTE sound input transducer and at least one ITE microphone,
    a processor configured to generate a hearing loss compensated output signal based on a combination of the filtered audio signals output by the at least one cue filter,
    an output transducer for conversion of the hearing loss compensated output signal to an auditory output signal that can be received by the human auditory system, and wherein
    the processor is further configured for processing the output signals of the at least one ITE microphone and the at least one BTE sound input transducer in such a way that the hearing loss compensated output signal substantially preserves spatial cues, such as the spatial cues recorded by the at least one ITE microphone, or recorded by a combination of the at least one ITE microphone and the at least one BTE sound input transducer.
  • The hearing aid may further have
    a sound signal transmission member for transmission of a signal representing sound from a sound output in the BTE hearing aid housing at a first end of the sound signal transmission member to the ear canal of the user at a second end of the sound signal transmission member,
    an earpiece configured to be inserted in the ear canal of the user for fastening and retaining the sound signal transmission member in its intended position in the ear canal of the user.
  • The new hearing aid may be a multi-channel hearing aid in which signals to be processed are divided into a plurality of frequency channels, and wherein signals are processed individually in each of the frequency channels. Possible adaptive feedback cancellation circuitry may also be divided into the plurality of frequency channels; or, the adaptive feedback cancellation circuitry may still operate in the entire frequency range; or, may be divided into other frequency channels, typically fewer frequency channels, than the other circuitry is divided into.
  • The processor may be configured for processing the output signals of the at least one ITE microphone and the at least one BTE sound input transducer in such a way that the hearing loss compensated output signal substantially preserves spatial cues in a selected frequency band.
  • The selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels. The selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • The plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • Outside the selected frequency band, the at least one ITE microphone may be connected conventionally as an input source to the processor of the hearing aid and may cooperate with the processor of the hearing aid in a well-known way.
  • In this way, the at least one ITE microphone supplies the input to the hearing aid at frequencies where the hearing aid is capable of supplying the desired gain with this configuration. In the selected frequency band, wherein the hearing aid cannot supply the desired gain with this configuration, the microphones of BTE hearing aid housing are included in the signal processing as disclosed above. In this way, the gain can be increased while simultaneously maintain the spatial information about the sound environment provided by the at least one ITE microphone.
  • The hearing aid may for example comprise a first filter connected between the processor input and the at least one ITE microphone, and a second complementary filter connected between the processor input and a combined output of the at least one BTE sound input transducer, the filters passing and blocking frequencies in complementary frequency bands so that one of the at least one ITE microphone and the combined output of at least one BTE sound input transducer constitutes the main part of the input signal supplied to the processor input in one frequency band, and the other one of the at least one ITE microphone and the combined output of at least one BTE sound input transducer constitutes the main part of the input signal supplied to the processor input in the complementary frequency band.
  • In this way, the at least one ITE microphone may be used as the sole input source to the processor in a frequency band wherein the required gain for hearing loss compensation can be applied to the output signal of the at least one ITE microphone. Outside this frequency band, the combined output signal of the at least one BTE sound input transducer is applied to the processor for provision of the required gain.
  • Throughout the present disclosure, the "output signals of the at least one ITE microphone" may be used to identify any analogue or digital signal forming part of the signal path from the output of the at least one ITE microphone to an input of the processor, including pre-processed output signals of the at least one ITE microphone.
  • Likewise, the "output signals of the at least one BTE sound input transducer" may be used to identify any analogue or digital signal forming part of the signal path from the at least one BTE sound input transducer to an input of the processor, including pre-processed output signals of the at least one BTE sound input transducer.
  • Preferably, the at least one ITE microphone is positioned so that the output signal of the at least one ITE microphone generated in response to the incoming sound has a transfer function that constitutes a good approximation to the HRTFs of the user. For example, the at least one ITE microphone may be constituted by a single microphone positioned at the entrance to the ear canal. The processor conveys the directional information contained in the output signal of the at least one ITE microphone to the resulting hearing loss compensated output signal of the processor so that the hearing loss compensated output signal of the processor also attains a transfer function that constitutes a good approximation to the HRTFs of the user whereby improved localization is provided to the user.
  • BTE (behind-the-ear) hearings aids are well-known in the art. A BTE hearing aid has a BTE housing that is shaped to be worn behind the pinna of the user. The BTE housing accommodates components for hearing loss compensation. A sound signal transmission member, i.e. a sound tube or an electrical conductor, transmits a signal representing the hearing loss compensated sound from the BTE housing into the ear canal of the user.
  • In order to position the sound signal transmission member securely and comfortably at the entrance to the ear canal of the user, an earpiece, shell, or earmould may be provided for insertion into the ear canal of the user constituting an open solution. In an open solution, the earpiece, shell, or earmould does not obstruct the ear canal when it is positioned in its intended operational position in the ear canal. Rather, there will be a passageway through the earpiece, shell, or earmould or, between a part of the ear canal wall and a part of the earpiece, shell, or earmould, so that sound waves may escape from behind the earpiece, shell, or earmould between the ear drum and the earpiece, shell, or earmould through the passageway to the surroundings of the user. In this way, the occlusion effect is substantially eliminated.
  • Typically, the earpiece, shell, or earmould is individually custom manufactured or manufactured in a number of standard sizes to fit the user's ear to sufficiently secure the sound signal transmission member in its intended position in the ear canal and prevent the earpiece from falling out of the ear, e.g., when the user moves the jaw.
  • The output transducer may be a receiver positioned in the BTE hearing aid housing. In this event, the sound signal transmission member comprises a sound tube for propagation of acoustic sound signals from the receiver positioned in the BTE hearing aid housing and through the sound tube to an earpiece positioned and retained in the ear canal of the user and having an output port for transmission of the acoustic sound signal to the eardrum in the ear canal.
  • The output transducer may be a receiver positioned in the earpiece. In this event, the sound signal transmission member comprises electrical conductors for propagation of audio signals from the output of a processor in the BTE hearing aid housing through the conductors to a receiver positioned in the earpiece for emission of sound through an output port of the earpiece.
  • The ITE microphone housing accommodating at least one ITE microphone may be combined with, or be constituted by, the earpiece so that the at least one microphone is positioned proximate the entrance to the ear canal when the earpiece is fastened in its intended position in the ear canal.
  • The ITE microphone housing may be connected to the earpiece with an arm, possibly a flexible arm that is intended to be positioned inside the pinna, e.g. around the circumference of the conchae abutting the antihelix and at least partly covered by the antihelix for retaining its position inside the outer ear of the user. The arm may be pre-formed during manufacture, preferably into an arched shape with a curvature slightly larger than the curvature of the antihelix, for easy fitting of the arm into its intended position in the pinna. In one example, the arm has a length and a shape that facilitate positioning of the at least one ITE microphone in an operating position immediately below the triangular fossa.
  • The processor may be accommodated in the BTE hearing aid housing, or in the ear piece, or part of the processor may be accommodated in the BTE hearing aid housing and part of the processor may be accommodated in the ear piece. There is a one-way or two-way communication link between circuitry of the BTE hearing aid housing and circuitry of the earpiece. The link may be wired or wireless.
  • Likewise, there is a one-way or two-way communication link between circuitry of the BTE hearing aid housing and the at least one ITE microphone. The link may be wired or wireless.
  • The processor operates to perform hearing loss compensation while maintaining spatial information of the sound environment for optimum spatial performance of the hearing aid and while at the same time providing as large maximum stable gain as possible.
  • In the new hearing aid, output signals of an arbitrary configuration of microphones undergo signal processing in such a way that spatial cues are preserved and conveyed to the user of the hearing aid. The output signals are filtered with filters that are configured to preserve spatial cues.
  • For example a method may be performed in the new hearing aid, comprising the steps of:
    • for a set of directions I with relation to the BTE hearing aid, determine
      • the Head-Related Transfer functions HRTFl (f),
      • the hearing aid related transfer function H l , i ITEC f
        Figure imgb0001
        of the ith microphone of the at least one ITE microphone for direction I,
      • the hearing aid related transfer functions H l , j BTEC f
        Figure imgb0002
        of the jth microphone of the at least one BTE microphone,
    • determine the transfer function H FB , i IEC f
      Figure imgb0003
      of the feedback path associated with the ith microphone of the at least one ITE microphone,
    • determine the transfer function H FB , j BTEC f
      Figure imgb0004
      of the feedback path associated with the jth microphone of the at least one BTE sound input transducer, and determine transfer functions G i IEC f
      Figure imgb0005
      of the ith cue filter of the at least one cue filter filtering audio signals of the at least one ITE microphone,
    • determine transfer functions G j BTEC f
      Figure imgb0006
      of the jth cue filter of at least one cue filter filtering audio signals of the at least one BTE microphone by solving the following minimization problem: min G i IEC f , G i BTEC f l = 0 L 1 HRT F l f i G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p
      Figure imgb0007
      wherein p is an integer, e.g. p = 2.
  • Feedback may be taken into account by performing the solution of the minimization problem above subject to the condition that the gain of the feedback loops must be less than one, i.e. subject to the condition that: 1 | i G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f | MSG f .
    Figure imgb0008
  • Feedback stability may also be ensured by incorporation of the condition into the minimization problem: min G i IEC f , G j BTEC f ( l = 0 L 1 HRT F l f i G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p + α i G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f p )
    Figure imgb0009
    wherein α is a weighting factor balancing spatial cue accuracy and feedback performance.
  • Various weights may be incorporated into the minimization problems above so that the solution is optimized as specified by the values of the weights. For example, frequency weights W(f) may optimize the solution in certain one or more frequency ranges, and angular weights W(l) may optimize the solution for certain directions of arrival of sound. L (I) is the angular direction towards a sound source with respect to the looking direction of a user wearing the hearing aid.
  • Thus, the minimization problem may be modified into: min G i IEC f , G i BTEC f l = 0 L 1 W l W l HRT F l f i G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p
    Figure imgb0010
    subject to 1 | i G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f | MSG f
    Figure imgb0011
    or min G i IEC f , G j BTEC f ( l = 0 L 1 W l W f HRT F l f i G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p + α i G i IEC f H FB , i IEC f + j G j BTEC f H FB , i BTEC f p )
    Figure imgb0012
  • Further, in one or more selected frequency ranges, only magnitude of the transfer functions may be taken into account during minimization while phase is disregarded, i.e. in the one or more selected frequency range, the transfer function is substituted by its absolute value.
  • The target transfer function need not be defined by the HRTF for the various directions I. Any transfer function that includes spatial cues may be used as the target transfer function.
  • For example, one of the ITE microphones of the at least one ITE microphone may be positioned at a position with relation to the user wherein the transfer function of the ITE microphone approximates the HRTFs of the user so that HRTFl(f) in the minimization problems specified above may be substituted by the transfer function H l , ref ITEC f
    Figure imgb0013
    of the ITE microphone in question: min G i IEC f , G i BTEC f l = 0 L 1 W l W f H l , ref ITEC f i ref G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p
    Figure imgb0014
    subject to 1 | i ref G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f | MSG f
    Figure imgb0015
    or min G i IEC f , G j BTEC f ( l = 0 L 1 W l W f H l , ref ITEC f i ref G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p + α i ref G i IEC f H FB , i IEC f + j G j BTEC f H FB , i BTEC f p )
    Figure imgb0016
  • The output signal of each of the at least one ITE microphone may be pre-processed.
  • The output signal of each of the at least one BTE sound input transducer may be pre-processed.
  • Pre-processing may include, without excluding any form of processing; adaptive and/or static feedback suppression, adaptive or fixed beamforming and pre-filtering.
  • The at least one ITE microphone may operate as monitor microphone(s) for generation of an electronic sound signal with the desired spatial information of the current sound environment.
  • Each output signal of the at least one BTE sound input transducer and of the at least one ITE microphone is filtered with a respective cue filter, the transfer function of which are configured to provide a combined output signal of the cue filters with a transfer function that approximates the HRTFs of the user as closely as possible.
  • Subsequent to the cue filtering, the combined output signal of the cue filters is passed on for further hearing loss compensation processing, e.g. with a compressor. In this way, signals from the at least one BTE sound input transducer and the at least one ITE microphone are appropriately processed before hearing loss compensation whereby risk of feedback from the output transducer to the at least one ITE microphone and the at least one BTE sound input transducer is minimized and a large maximum stable gain can be provided.
  • The determinations, for a set of directions I with relation to the new hearing aid, of
    • ▪ the Head-Related Transfer functions HRTFl (f),
    • ▪ the hearing aid related transfer function of the respective at least one ITE microphone H l , i ITEC f ,
      Figure imgb0017
      and
    • ▪ the hearing aid related transfer functions of the respective at least one BTE microphone H l , j BTEC f
      Figure imgb0018
      may be performed with the hearing aid mounted on an artificial head. lindividual determinations, for a set of directions I with relation to the new hearing aid, of
    • ▪ the Head-Related Transfer functions HRTFl (f),
    • ▪ the hearing aid related transfer function of the respective at least one ITE microphone H l , i ITEC f ,
      Figure imgb0019
      and
    • ▪ the hearing aid related transfer functions of the respective at least one BTE microphone H l , i BTEC f
      Figure imgb0020
      may be performed for a number of users representing a selected group of users, and the transfer functions of the at least one cue filter G j BTEC f
      Figure imgb0021
      of the respective at least one BTE sound transducer may be determined based on averaged values of
    • ▪ the Head-Related Transfer functions HRTFl (f),
    • ▪ the hearing aid related transfer function of the respective at least one ITE microphone H l , i ITEC f ,
      Figure imgb0022
      and
    • ▪ the hearing aid related transfer functions of the respective at least one BTE microphone H l , i BTEC f
      Figure imgb0023
    of the number of users representing the selected group of users.
  • Thus, the at least one cue filter G i IEC f
    Figure imgb0024
    of the respective at least one ITE microphone and the at least one cue filter G j BTEC f
    Figure imgb0025
    of the respective at least one BTE sound transducer may be determined by the following steps:
    With the hearing aid worn by the individual user:
    • 1) Measure the Head-Related Transfer functions HRTFl (f), the hearing aid related transfer functions H l , i ITEC f ,
      Figure imgb0026
      and the hearing aid related transfer functions H l , i BTEC f ,
      Figure imgb0027
    • 2) Measure the transfer functions H FB , i IEC f
      Figure imgb0028
      of the feedback path associated with the ith microphone of the at least one ITE microphone and the transfer functions H FB , j BTEC f
      Figure imgb0029
      of the feedback paths associated with the jth microphone of the at least one BTE sound input transducer.
    • 3) Determine the at least one cue filter G i IEC f
      Figure imgb0030
      of the respective at least one ITE microphone and the at least one cue filter G j BTEC f
      Figure imgb0031
      of the respective at least one BTE sound transducer solving a selected one of the minimization problems mentioned above.
  • Some of the measurements above need not be performed with the individual user; rather measurements may be performed that constitute good approximations to individual measurements for a number of humans with certain characteristics in common, e.g. humans within a certain age group, population, etc.:
    For a number of user's with certain characteristics in common:
    • 1) Measure the Head-Related Transfer functions HRTFl (f), the hearing aid related transfer functions H l , i ITEC f ,
      Figure imgb0032
      and the hearing aid related transfer functions H l , i BTEC f
      Figure imgb0033
      with the hearing aid mounted on an artificial head, e.g. for a number of differently sized ears; or, with the hearing aid worn by a number of humans,
    • 2) Determine average Head-Related Transfer functions HRTFl (f), hearing aid related transfer functions H l , i ITEC f ,
      Figure imgb0034
      and hearing aid related transfer functions H l , i BTEC f
      Figure imgb0035
      for the population in question, e.g. one for big ears, one for small ears, etc, and
  • For the individual user:
    • 3) With the hearing aid worn by the individual user: Measure the transfer functions
      H FB , i IEC f
      Figure imgb0036
      of the feedback path associated with the ith microphone of the at least one ITE microphone and the transfer functions H FB , j BTEC f
      Figure imgb0037
      of the feedback paths associated with the jth microphone of the at least one BTE sound input transducer.
    • 4) Determine the at least one cue filter G i IEC f
      Figure imgb0038
      of the respective at least one ITE microphone and the at least one cue filter G j BTEC f
      Figure imgb0039
      of the respective at least one BTE sound transducer solving a selected one of the minimization problems mentioned above.
  • The audio signals may be divided into a plurality of frequency channels, and be individually processed in individual frequency channels, and the transfer functions of
    • ▪ the at least one cue filter G i IEC f
      Figure imgb0040
      of the respective at least one ITE microphone,
    • ▪ the at least one cue filter G j BTEC f
      Figure imgb0041
      of the respective at least one BTE sound transducer
    may be individually determined in selected frequency channels.
  • The at least one BTE microphone may be disconnected from the processor in one or more selected frequency channels so that hearing loss compensation is performed solely on the output of the at least one ITE microphone in the one or more selected frequency channels.
  • As used herein, the terms "processor", "signal processor", "controller", "system", etc., are intended to refer to CPU-related entities, either hardware, a combination of hardware and software, software, or software in execution.
  • For example, a "processor", "signal processor", "controller", "system", etc., may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
  • By way of illustration, the terms "processor", "signal processor", "controller", "system", etc., designate both an application running on a processor and a hardware processor. One or more "processors", "signal processors", "controllers", "systems" and the like, or any combination hereof, may reside within a process and/or thread of execution, and one or more "processors", "signal processors", "controllers", "systems", etc., or any combination hereof, may be localized on one hardware processor, possibly in combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • In the following, preferred embodiments of the invention is explained in more detail with reference to the drawing, wherein
  • Fig. 1
    shows a plot of the angular frequency spectrum of an open ear,
    Fig. 2
    shows a plot of the angular frequency spectrum of a BTE front microphone worn at the same ear,
    Fig. 3
    shows plots of maximum stable gain of a BTE front and rear microphones and an open fitted ITE microphone positioned in the ear canal,
    Fig. 4
    schematically illustrates an exemplary new hearing aid,
    Fig. 5
    schematically illustrates another exemplary new hearing aid,
    Fig. 6
    shows in perspective a new hearing aid with an ITE-microphone in the outer ear of a user,
    Fig. 7
    shows a schematic block diagram of an exemplary new hearing aid with cue filters,
    Fig. 8
    shows a schematic block diagram of the new hearing aid of Fig. 7 with added feedback cancellation, and
    Fig. 9
    shows a schematic block diagram illustrating one method of determining the cue filters.
    DETAILED DESCRIPTION OF THE DRAWINGS
  • The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the invention are shown. The invention may, however, be embodied in different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Like reference numerals refer to like elements throughout. Like elements will, thus, not be described in detail with respect to the description of each figure.
  • Fig. 4 schematically illustrates an example of the new hearing aid 10 comprising a BTE hearing aid housing 12 (not shown - outer walls have been removed to make internal parts visible) to be worn behind the pinna 100 of a user. The BTE housing 12 accommodates at least one BTE sound input transducer 14, 16 with a front microphone 14 and a rear microphone 16 for conversion of a sound signal into a microphone audio signal, optional pre-filters (not shown) for filtering the respective microphone audio signals, A/D converters (not shown) for conversion of the respective microphone audio signals into respective digital microphone audio signals that are input to a processor 18 configured to generate a hearing loss compensated output signal based on the input digital audio signals .
  • The hearing loss compensated output signal is transmitted through electrical wires contained in a sound signal transmission member 20 to a receiver 22 for conversion of the hearing loss compensated output signal to an acoustic output signal for transmission towards the eardrum of a user and contained in an earpiece 24 that is shaped (not shown) to be comfortably positioned in the ear canal of a user for fastening and retaining the sound signal transmission member in its intended position in the ear canal of the user as is well-known in the art of BTE hearing aids.
  • The earpiece 24 also holds one ITE microphone 26 that is positioned at the entrance to the ear canal when the earpiece is positioned in its intended position in the ear canal of the user. The ITE microphone 26 is connected to an A/D converter (not shown) and optional to a pre-filter (not shown) in the BTE housing 12, with electrical wires (not visible) contained in the sound transmission member 20.
  • The BTE hearing aid 10 is powered by battery 28.
  • Various possible functions of the processor 18 are disclosed above and some of these in more detail below.
  • Fig. 5 schematically illustrates another BTE hearing aid 10 similar to the hearing aid shown in Fig. 1, except for the difference that in Fig. 5, the receiver 22 is positioned in the hearing aid housing 12 and not in the earpiece 24, so that acoustic sound output by the receiver 22 is transmitted through the sound tube 20 and towards the eardrum of the user when the earpiece 24 is positioned in its intended position in the ear canal of the user.
  • The positioning of the ITE microphone 26 proximate the entrance to the ear canal of the user when the BTE hearing aids 10 of Figs. 4 and 5 are used is believed to lead to a good reproduction of the HRTFs of the user.
  • Fig. 6 shows a BTE hearing aid 10 in its operating position with the BTE housing 12 behind the ear, i.e. behind the pinna 100, of the user. The illustrated BTE hearing aid 10 is similar to the hearing aids shown in Figs. 4 and 5 except for the fact that the ITE microphone 26 is positioned in the outer ear of the user outside the ear canal at the free end of an arm 30. The arm 30 is flexible and the arm 30 is intended to be positioned inside the pinna 100 , e.g. around the circumference of the conchae 102 behind the tragus 104 and antitragus 106 and abutting the antihelix 108 and at least partly covered by the antihelix for retaining its position inside the outer ear of the user. The arm may be pre-formed during manufacture, preferably into an arched shape with a curvature slightly larger than the curvature of the antihelix 108, for easy fitting of the arm 30 into its intended position in the pinna. The arm 30 contains electrical wires (not visible) for interconnection of the ITE microphone 26 with other parts of the BTE hearing aid circuitry.
  • In one example, the arm 30 has a length and a shape that facilitate positioning of the ITE microphone 26 in an operating position below the triangular fossa.
  • Fig. 7 is a block diagram illustrating one example of signal processing in the new hearing aid 10. The BTE hearing aid 10 has an array of microphones 14-1, 14-2, ... , 14-M, 26-1, 26-2, ... , 26-N, for example constituted by a front microphone 14 and a rear microphone 16 and an ITE microphone 26 that resides in an earpiece 24 to be positioned in the outer ear of the user as illustrated in Figs. 4 - 6. N and M can be any integer, e.g. N=1, and M=2.
  • The microphone output audio signals are digitized (A/D-converters not shown) and pre-processed, such as pre-filtered, in respective pre-processors 32-1, 32-2, ... , 32-N, 34-1, 34-2, ... , 34-M. The digitized and possibly pre-processed microphone output audio signals 38-1, 38-2, ... , 38-N, 40-1, 40-2, ... , 40-M are filtered in cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M and the filtered signals 46-1, 46-2, ... , 46-N, 48-1, 48-2, ... , 48-M are added to each other in adder 50 and the combined signal 52 is input to a processor 18 for hearing loss compensation. The hearing loss compensated signal 54 is output to a receiver 22 that converts the signal to an acoustic signal for transmission towards the ear drum of the user.
  • The new hearing aid circuitry shown in Fig. 7 may operate in the entire frequency range of the BTE hearing aid 10.
  • The hearing aid 10 shown in Fig. 7 may be a multi-channel hearing aid in which microphone output audio signals are divided into a plurality of frequency channels, and wherein divided signals are processed individually in each of the frequency channels.
  • For a multi-channel hearing aid 10, Fig. 7 may illustrate the circuitry and signal processing in a single frequency channel. The circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
  • For example, the signal processing illustrated in Fig. 7 may be performed in a selected frequency band, e.g. selected during fitting of the hearing aid 10 to a specific user at a dispenser's office.
  • The selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels. The selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • The plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • Outside the selected frequency band, one or more of the at least one ITE microphone may be connected conventionally as an input source to the processor of the hearing aid and may cooperate with the processor of the hearing aid in a well-known way.
  • In this way, one or more or all of the at least one ITE microphone provide the input to the processor 18 at frequencies where the hearing aid is capable of supplying the desired gain based on the input from the one or more of the at least one ITE microphone. In the selected frequency band, wherein the hearing aid cannot supply the desired gain with this configuration, the microphones of BTE hearing aid housing are included in the signal processing as disclosed above. In this way, the gain can be increased while simultaneously maintain the spatial information about the sound environment as provided by the array of microphones.
  • The transfer functions of the Cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M has been determined before use, e.g. at the dispenser's office, by the following steps:
    1. 1) Measure the Head-Related Transfer functions HRTFl (f), the hearing aid related transfer functions H l , i ITEC f ,
      Figure imgb0042
      and the hearing aid related transfer functions H l , i BTEC f
      Figure imgb0043
      with the hearing aid mounted on an artificial head, e.g. for a number of differently sized ears; or, with the hearing aid worn by a number of humans,
    2. 2) Determine average Head-Related Transfer functions HRTFl (f), hearing aid related transfer functions H l , i ITEC f ,
      Figure imgb0044
      and hearing aid related transfer functions H l , i BTEC f
      Figure imgb0045
      for the population in question, e.g. one for big ears, one for small ears, etc,
    3. 3) With the hearing aid worn by the individual user: Measure the transfer functions H FB , i IEC f
      Figure imgb0046
      of the feedback path associated with the ith microphone of the at least one ITE microphone and the transfer functions H FB , j BTEC f
      Figure imgb0047
      of the feedback paths associated with the jth microphone of the at least one BTE sound input transducer.
    4. 4) Determine the transfer function of the at least one cue filter G i IEC f
      Figure imgb0048
      and the at least one cue filter G j BTEC f
      Figure imgb0049
      solving a selected one of the following minimization problems: min G i IEC f , G i BTEC f l = 0 L 1 HRT F l f i G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p
      Figure imgb0050
      wherein p is an integer, e.g. p = 2.
  • In order to ensure feedback stability, the minimization problem may be solved subject to the condition that: 1 | i G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f | MSG f .
    Figure imgb0051
  • Feedback stability may also be ensured by incorporation of the condition into the minimization problem: min G i IEC f , G j BTEC f ( l = 0 L 1 HRT F l f i G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p + α i G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f p )
    Figure imgb0052
    wherein α is a weighting factor balancing spatial cue accuracy and feedback performance.
  • Various weights may be incorporated into the minimization problems above so that the solution is optimized as specified by the values of the weights. For example, frequency weights W(f) may optimize the solution in certain one or more frequency ranges, and angular weights W(l) may optimize the solution for certain directions of arrival of sound. Thus, the minimization problem may be modified into: min G i IEC f , G i BTEC f l = 0 L 1 W l W f ( HRT F l f i G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f ) p
    Figure imgb0053
    subject to 1 | i G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f | MSG f
    Figure imgb0054
    or min G i IEC f , G j BTEC f ( l = 0 L 1 W l W f HRT F l f i G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p + α i G i IEC f H FB , i IEC f + j G j BTEC f H FB , i BTEC f p )
    Figure imgb0055
  • Further, in one or more selected frequency ranges, only magnitude of the transfer functions may be taken into account during minimization while phase is disregarded, i.e. in the one or more selected frequency range, the transfer function is substituted by its absolute value.
  • The target transfer function need not be defined by the HRTF for the various directions I. Any transfer function that includes spatial cues may be used as the target transfer function.
  • For example, one of the ITE microphones of the at least one ITE microphone may be positioned at a position with relation to the user wherein the transfer function of the ITE microphone approximates the HRTFs of the user so that HRTFl(f) in the minimization problems specified above may be substituted by the transfer function H l , ref ITEC f
    Figure imgb0056
    of the ITE microphone in question: min G i IEC f , G i BTEC f l = 0 L 1 W l W f ( H l , ref ITEC f i ref G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f ) p
    Figure imgb0057
    subject to 1 | i ref G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f | MSG f
    Figure imgb0058
    or min G i IEC f , G j BTEC f ( l = 0 L 1 W l W l H l , ref ITEC f i ref G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p + α i ref G i IEC f H FB , i IEC f + j G j BTEC f H FB , i BTEC f p )
    Figure imgb0059
  • Fig. 8 is a block diagram illustrating a new hearing aid 10 similar to the hearing aid 10 shown in Fig. 7 except for the fact that an adaptive feedback canceller 70 has been added with an input 72 connected to the output of the processor 18 and outputs 74-1, 74-2, ... , 74-N, 76-1, 76-2, ... , 76-M connected to respective subtractors 78-1, 78-2, ... , 78-N. 80-1, 80-2, ... , 80-M for subtraction of the outputs from each respective microphone output audio signal to provide feedback compensated signals fed to the corresponding pre-processors 32-1, 32-2, ... , 32-N, 34-1, 34-2, ... , 34-M and to the feedback canceller 70 for control of the adaption of the feedback canceller 70 comprising adaptive filters as is well-known in the art. The feedback canceller 70 provide signals 74-1, 74-2, ... , 74-N, 76-1, 76-2, ... , 76-M that constitute approximations of corresponding feedback signals travelling from the output transducer 22 to the respective microphones 14-1, 14-2, ... , 14-M, 26-1, 26-2, ... , 26-N.
  • The hearing aid 10 shown in Fig. 8 may be a multi-channel hearing aid in which microphone output audio signals are divided into a plurality of frequency channels, and wherein divided signals are processed individually in each of the frequency channels.
  • For a multi-channel hearing aid 10, Fig. 8 may illustrate the circuitry and signal processing in a single frequency channel. The circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
  • The adaptive feedback cancelling circuitry may also be divided into the plurality of frequency channels; or, the adaptive circuitry may still operate in the entire frequency range; or, may be divided into other frequency channels, typically fewer frequency channels, than the other circuitry is divided into.
  • For example, the signal processing illustrated in Fig. 8 may be performed in a selected frequency band, e.g. selected during fitting of the hearing aid 10 to a specific user at a dispenser's office.
  • The selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels. The selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • The plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • Outside the selected frequency band, one or more of the at least one ITE microphone may be connected conventionally as an input source to the processor of the hearing aid and may cooperate with the processor of the hearing aid in a well-known way.
  • In this way, the one or more of the at least one ITE microphone provide the input to the processor 18 at frequencies where the hearing aid is capable of supplying the desired gain based on the input from the one or more of the at least one ITE microphone. In the selected frequency band, wherein the hearing aid cannot supply the desired gain with this configuration, the microphones of BTE hearing aid housing are included in the signal processing as disclosed above. In this way, the gain can be increased while simultaneously maintain the spatial information about the sound environment as provided by the array of microphones.
  • The transfer functions of the Cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M has been determined before use, e.g. at the dispenser's office, by the same steps as disclosed above in connection with Fig. 7.
  • Fig. 9 is a schematic block diagram illustrating one method of determining the cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M of the hearing aids shown in Figs. 7 and 8, e.g. during fitting of the hearing aid.
  • The cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M are adaptive filters that are allowed to adapt during fitting of the hearing aid. After determination of the cue filters, , the filter coefficients are kept constant at the respective determined values.
  • The microphone ITE REF 25 may be a single microphone located in a position with relation to an artificial head or a user with good preservation of spatial cues of incoming sound; or, the microphone ITE REF 25 may represent an array of microphones connected to pre-processor 31 and located in a position with relation to an artificial head or a user in which a combined signal output from the array of microphones, e.g. in cooperation with pre-processor 31, has good preservation of spatial cues of incoming sound.
  • Due to the positioning of microphone (array) ITE REF 25, the output signal of microphone (array) ITE REF 25 has a transfer function that constitutes a good approximation to the HRTFs of the user for one or more directions towards a sound source.
  • During fitting, various sound sources emit sound from respective various directions with relation to the artificial head or user of the hearing aid, and the cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M are allowed to adapt to the output signal 51 of the delay 41 and at the end of adaptation, e.g. when the filter coefficients of the cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M have stabilized, i.e. the changes of the filter coefficients have become less than a certain threshold, the filter coefficients are no longer allowed to change. Further, the signal 51 is disconnected from subtractor 54 so that signal 56 constitutes a combined output signal of the cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M that has substantially the same spatial cues as the output signal 51.
  • The delay 41 delays the output signal of the pre-processor 31 with a delay that is substantially equal to the delay of the cue filters 42-1, 42-2, ,..., 42-N, 44-1, ... , 44-M.
  • During determination of the filter coefficients of the cue filters 42-1, 42-2, ,..., 42-N, 44-1, ... , 44-M, e.g. during fitting, adaptation of the filter coefficients of the cue filters 42-1, 42-2, ,..., 42-N, 44-1, ... , 44-M are controlled by adaptive cue controller 48 that controls the adaptation of the filter coefficients to minimize the output signal 52 of the subtractor 54 equal to the difference between sum of output signals 50-1, 50-2, ... , 50-N, 46-1, 46-2, ... , 46-M and the ITEREF microphone audio signal 51.
  • Thus, while adapting, the adaptive cue control 48 operates to adjust the filter coefficients of the cue filters 42-1, 42-2, ... , 42-N, 44-1, 44-2, ... , 44-M solving the following minimization problem: min G i IEC f , G i BTEC f l = 0 L 1 W l W f H l , ref ITEC f i ref G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p
    Figure imgb0060
    wherein
    W(f) are frequency weights that may optimize the solution in certain one or more frequency ranges, and
    W(l) are angular weights that may optimize the solution for certain directions of arrival of sound.
  • W(f) may be equal to one for all frequencies and/or W(l) may be equal to one for all directions.
  • Possible feedback may be taken into account by solving the minimization problem above subject to the condition that 1 | i G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f | MSG f
    Figure imgb0061
    or min G i IEC f , G j BTEC f ( l = 0 L 1 W l W f HRT F l f i G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p + α i G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f p )
    Figure imgb0062
  • For example, the feedback compensation circuitry 72, 70, 74-1, 74-2, ... , 74-N, 76-1, 76-2, ... , 76-M, 78-1, 78-2, ... , 78-N, 80-1, 80-2, ... , 80-M, 82-1, 82-2, ... , 82-N, 84-1, 84-2, ... , 84-M, shown in Fig. 8 may be added to the circuit of Fig. 9 and in addition connecting the outputs 74-1, 74-2, ... , 74-N, 76-1, 76-2, ... , 76-M of the adaptive feedback filter 70 to respective inputs of the adaptive cue control 48, each of the outputs 74-1, 74-2, ... , 74-N, 76-1, 76-2, ... , 76-M providing an estimate of the hearing aid related transfer function of the respective at least one ITE microphone H l , i ITEC f ,
    Figure imgb0063
    and the hearing aid related transfer functions of the respective at least one BTE microphone H l , j BTEC f
    Figure imgb0064
    so that the adaptive cue control 48 can check the condition: 1 | i G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f | MSG f
    Figure imgb0065
    or solve the minimization problem: min G i IEC f , G j BTEC f ( l = 0 L 1 W l W f HRT F l f i G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p + α i G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f p )
    Figure imgb0066

Claims (14)

  1. A method of determining parameters of a hearing aid (10) for preserving spatial cues of sounds arriving at a user of the hearing aid, the hearing aid (10) comprising a BTE hearing aid housing (12) configured to be worn behind the pinna of the user, at least one BTE sound input transducer accommodated in the BTE hearing aid housing and comprising at least one BTE microphone (14-1, ..., 14-M), each of which is configured for conversion of acoustic sound into a respective audio signal,
    an ITE microphone housing configured to be positioned in the outer ear of the user for fastening and retaining in its intended position
    at least one ITE microphone (26-1, ..., 26-N) accommodated in the ITE microphone housing, each of which is configured for conversion of acoustic sound into a respective audio signal,
    at least one cue filter (44-1, ..., 44-M) having an input that is provided with an output signal from a respective one of the at least one BTE sound input transducer (14-1, ..., 14-M), and at least one cue filter (42-1, ..., 42-N) having an input that is provided with an output signal from a respective one of the at least one ITE microphone (26-1, ..., 26-N),
    a processor (18) configured to generate a hearing loss compensated output signal (54) based on a combination (52) of the filtered audio signals output by the cue filters,
    an output transducer (22) for conversion of the hearing loss compensated output signal to an auditory output signal that can be received by the human auditory system, the method comprising the steps of:
    for a set of directions (l) with relation to the BTE hearing aid, determine
    the Head-Related Transfer functions HRTFl (f),
    the hearing aid related transfer functions H l , i ITEC f
    Figure imgb0067
    of the ith microphone of the at least one ITE microphone (26-1, ..., 26-N)for direction (I),
    the hearing aid related transfer functions H l , j BTEC f
    Figure imgb0068
    of the jth microphone of the at least one BTE microphone (14-1, ..., 14-M),
    determine the transfer function H FB , i IEC f
    Figure imgb0069
    of a feedback path associated with the ith
    microphone of the at least one ITE microphone,
    determine the transfer function H FB , j BTEC f
    Figure imgb0070
    of a feedback path associated with the jth
    microphone of the at least one BTE sound input transducer, and
    determine transfer functions G i IEC f
    Figure imgb0071
    of the ith cue filter of the at least one cue filter filtering audio signals of the at least one ITE microphone (26-1, ..., 26-N),
    determine transfer functions G j BTEC f
    Figure imgb0072
    of the jth cue filter of the at least one cue filter
    filtering audio signals of the at least one BTE microphone (14-1, ..., 14-M) by solving: min G i IEC f , G i BTEC f l = 0 L 1 W l W l HRT F l f i G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p
    Figure imgb0073
    wherein
    W(l) is an angular weighting factor,
    W(f) is a frequency dependent weighting factor, and
    p is a positive integer.
  2. A method according to claim 1, further comprising the steps of determine the transfer function H FB , i IEC f
    Figure imgb0074
    of the feedback path associated with the respective at least one ITE microphone,
    determine the transfer function H FB , i BTEC f
    Figure imgb0075
    of the feedback path associated with the respective at least one BTE sound input transducer, and
    determine filter coefficients of
    the at least one cue filter G i IEC f
    Figure imgb0076
    of the respective at least one ITE microphone,
    the at least one cue filter G j BTEC f
    Figure imgb0077
    of the respective at least one BTE sound transducer, by solving min G i IEC f , G i BTEC f l = 0 L 1 W l W f HRT F l f i G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p
    Figure imgb0078
    subject to 1 | i G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f | MSG f
    Figure imgb0079
    wherein MSG(f) is the maximum stable gain as a function of frequency f.
  3. A method according to claim 1, further comprising the steps of determine the transfer function H FB , i IEC f
    Figure imgb0080
    of the feedback path associated with the respective at least one ITE microphone,
    determine the transfer function H FB , i BTEC f
    Figure imgb0081
    of the feedback path associated with the respective at least one BTE sound input transducer, and
    determine filter coefficients of
    the at least one cue filter G i IEC f
    Figure imgb0082
    of the respective at least one ITE microphone,
    the at least one cue filter G j BTEC f
    Figure imgb0083
    of the respective at least one BTE sound transducer, by solving min G i IEC f , G j BTEC f ( l = 0 L 1 W l W f HRT F l f i G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p + α i G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f p )
    Figure imgb0084
    wherein α is a weighting factor balancing spatial cue accuracy and feedback performance.
  4. A method according to claim 1, wherein the Head-Related Transfer functions HRTFl (f) is approximated with the hearing aid related transfer function of a combination of the at least one ITE microphone: H l , ref ITEC f ,
    Figure imgb0085
    and comprising the steps of determine the transfer function H FB , i IEC f
    Figure imgb0086
    of the feedback path associated with the respective at least one ITE microphone,
    determine the transfer function H FB , i BTEC f
    Figure imgb0087
    of the feedback path associated with the respective at least one BTE sound input transducer, and
    determine filter coefficients of
    the at least one cue filter G i IEC f
    Figure imgb0088
    of the respective at least one ITE microphone not included in the combination of the at least one ITE microphone,
    the at least one cue filter G j BTEC f
    Figure imgb0089
    of the respective at least one BTE sound transducer, by solving min G i IEC f , G i BTEC f l = 0 L 1 W l W f H l , ref ITEC f i ref G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p
    Figure imgb0090
    subject to 1 | i ref G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f | MSG f
    Figure imgb0091
    wherein MSG(f) is the maximum stable gain as a function of frequency f.
  5. A method according to claim 1, wherein the Head-Related Transfer functions HRTFl (f) is approximated with the hearing aid related transfer function of a combination of the at least one ITE microphone: H l , ref ITEC f ,
    Figure imgb0092
    and comprising the steps of determine the transfer function H FB , i IEC f
    Figure imgb0093
    of the feedback path associated with the respective at least one ITE microphone,
    determine the transfer function H FB , i BTEC f
    Figure imgb0094
    of the feedback path associated with the respective at least one BTE sound input transducer, and
    determine filter coefficients of
    the at least one cue filter G i IEC f
    Figure imgb0095
    of the respective at least one ITE microphone not included in the combination of the at least one ITE microphone,
    the at least one cue filter G j BTEC f
    Figure imgb0096
    of the respective at least one BTE sound transducer, by solving min G i IEC f , G j BTEC f ( l = 0 L 1 W l W f H l , ref ITEC f i ref G i IEC f H l , i IEC f j G j BTEC f H l , j BTEC f p + α i ref G i IEC f H FB , i IEC f + j G j BTEC f H FB , j BTEC f p )
    Figure imgb0097
    wherein α is a weighting factor balancing spatial cue accuracy and feedback performance.
  6. A method according to any of the previous claims, wherein the determinations, for a set of directions I with relation to the BTE hearing aid, of
    the Head-Related Transfer functions HRTFl (f),
    the hearing aid related transfer function of the respective at least one ITE microphone H l , i ITEC f ,
    Figure imgb0098
    and
    the hearing aid related transfer functions of the respective at least one BTE microphone H l , i BTEC f
    Figure imgb0099
    are performed with the hearing aid mounted on an artificial head.
  7. A method according to any of previous claims 1-5, wherein individual determinations, for a set of directions (I) with relation to the BTE hearing aid, of
    the Head-Related Transfer functions HRTFl (f),
    the hearing aid related transfer function of the respective at least one ITE microphone H l , i ITEC f ,
    Figure imgb0100
    and
    the hearing aid related transfer functions of the respective at least one BTE microphone H l , i BTEC f
    Figure imgb0101
    are performed for a number of users representing a selected group of users, and wherein the filter coefficients of the at least one cue filter G j BTEC f
    Figure imgb0102
    of the respective at least one BTE sound transducer are determined based on averaged values of
    the Head-Related Transfer functions HRTFl (f),
    the hearing aid related transfer function of the respective at least one ITE microphone H l , i ITEC f ,
    Figure imgb0103
    and
    the hearing aid related transfer functions of the respective at least one BTE microphone
    of the number of users representing the selected group of users.
  8. A method according to any of the previous claims, comprising the step of dividing the audio signals representing sound into a plurality of frequency channels, and individually processing the audio signals in individual frequency channels, whereby the filter coefficients of
    the at least one cue filter G i IEC f
    Figure imgb0104
    of the respective at least one ITE microphone,
    the at least one cue filter G j BTEC f
    Figure imgb0105
    of the respective at least one BTE sound transducer
    are individually determined in selected frequency channels.
  9. A method according to claim 8, comprising the step of disconnecting the at least one BTE microphone from the processor in a selected frequency channel so that hearing loss compensation is performed solely on the output of the at least one ITE microphone.
  10. A method according to any of the previous claims, wherein W(l) = 1.
  11. A method according to any of the previous claims, wherein W(f) = 1.
  12. A method according to any of the previous claims, wherein p = 2.
  13. A hearing aid with a processor configured to perform a method according to any of the previous claims.
  14. A hearing aid according to claim 13, comprising
    a sound signal transmission member for transmission of a signal representing sound from a sound output in the BTE hearing aid housing at a first end of the sound signal transmission member to the ear canal of the user at a second end of the sound signal transmission member,
    an earpiece configured to be inserted in the ear canal of the user for fastening and retaining the sound signal transmission member in its intended position in the ear canal of the user.
EP12199720.9A 2012-12-28 2012-12-28 A hearing aid with improved localization Active EP2750410B1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
DK12199720.9T DK2750410T3 (en) 2012-12-28 2012-12-28 Hearing aid with improved location
EP12199720.9A EP2750410B1 (en) 2012-12-28 2012-12-28 A hearing aid with improved localization
US13/872,720 US9338561B2 (en) 2012-12-28 2013-04-29 Hearing aid with improved localization
JP2013266879A JP5723962B2 (en) 2012-12-28 2013-12-25 Hearing aid with improved localization
CN201310744341.5A CN103916806A (en) 2012-12-28 2013-12-30 Hearing aid with improved localization
CN201810895006.8A CN109089200B (en) 2012-12-28 2013-12-30 Method for determining parameters of a hearing aid and a hearing aid

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP12199720.9A EP2750410B1 (en) 2012-12-28 2012-12-28 A hearing aid with improved localization

Publications (2)

Publication Number Publication Date
EP2750410A1 EP2750410A1 (en) 2014-07-02
EP2750410B1 true EP2750410B1 (en) 2018-10-03

Family

ID=47458782

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12199720.9A Active EP2750410B1 (en) 2012-12-28 2012-12-28 A hearing aid with improved localization

Country Status (2)

Country Link
EP (1) EP2750410B1 (en)
DK (1) DK2750410T3 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DK3038381T3 (en) 2014-12-22 2017-11-20 Gn Resound As Listening in diffuse noise
US9774960B2 (en) 2014-12-22 2017-09-26 Gn Hearing A/S Diffuse noise listening
EP3185589B1 (en) 2015-12-22 2024-02-07 Oticon A/s A hearing device comprising a microphone control system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10249416B4 (en) * 2002-10-23 2009-07-30 Siemens Audiologische Technik Gmbh Method for adjusting and operating a hearing aid device and hearing aid device
EP1594344A3 (en) * 2005-08-03 2006-03-15 Phonak Ag Method of obtaining acoustical characteristics, hearing instrument and manufacturing method thereof
EP2208367B1 (en) * 2007-10-12 2017-09-27 Earlens Corporation Multifunction system and method for integrated hearing and communiction with noise cancellation and feedback management
DK2088802T3 (en) * 2008-02-07 2013-10-14 Oticon As Method for estimating the weighting function of audio signals in a hearing aid

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
DK2750410T3 (en) 2018-12-10
EP2750410A1 (en) 2014-07-02

Similar Documents

Publication Publication Date Title
US9338561B2 (en) Hearing aid with improved localization
DK2611218T3 (en) A hearing aid with improved location determination
US9100762B2 (en) Hearing aid with improved localization
US9148735B2 (en) Hearing aid with improved localization
EP2611218B1 (en) A hearing aid with improved localization
US10431239B2 (en) Hearing system
US9432778B2 (en) Hearing aid with improved localization of a monaural signal source
US9148733B2 (en) Hearing aid with improved localization
EP2928213B1 (en) A hearing aid with improved localization of a monaural signal source
JP2014140159A5 (en)
EP2806660B1 (en) A hearing aid with improved localization
EP2750410B1 (en) A hearing aid with improved localization
EP2750411B1 (en) A hearing aid with improved localization
EP2750412B1 (en) Improved localization with feedback

Legal Events

Date Code Title Description
17P Request for examination filed

Effective date: 20121228

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

R17P Request for examination filed (corrected)

Effective date: 20141222

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RIC1 Information provided on ipc code assigned before grant

Ipc: H04R 25/00 20060101AFI20180413BHEP

Ipc: H04S 7/00 20060101ALN20180413BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04S 7/00 20060101ALN20180426BHEP

Ipc: H04R 25/00 20060101AFI20180426BHEP

INTG Intention to grant announced

Effective date: 20180530

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: GN HEARING A/S

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 1049974

Country of ref document: AT

Kind code of ref document: T

Effective date: 20181015

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Ref country code: DE

Ref legal event code: R096

Ref document number: 602012051713

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20181203

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20181003

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1049974

Country of ref document: AT

Kind code of ref document: T

Effective date: 20181003

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190103

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190203

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190103

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190203

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190104

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602012051713

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181228

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

26N No opposition filed

Effective date: 20190704

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20181231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181003

Ref country code: MK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181003

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20121228

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20211217

Year of fee payment: 10

Ref country code: FR

Payment date: 20211215

Year of fee payment: 10

Ref country code: GB

Payment date: 20211221

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20211217

Year of fee payment: 10

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230525

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20221231

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20221228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221231

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221228

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221231

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231218

Year of fee payment: 12