WO2010115227A1 - Localisation in a bilateral hearing device system - Google Patents

Localisation in a bilateral hearing device system Download PDF

Info

Publication number
WO2010115227A1
WO2010115227A1 PCT/AU2009/000437 AU2009000437W WO2010115227A1 WO 2010115227 A1 WO2010115227 A1 WO 2010115227A1 AU 2009000437 W AU2009000437 W AU 2009000437W WO 2010115227 A1 WO2010115227 A1 WO 2010115227A1
Authority
WO
WIPO (PCT)
Prior art keywords
localisation
recipient
sound signal
hearing device
cues
Prior art date
Application number
PCT/AU2009/000437
Other languages
French (fr)
Inventor
Tom Francart
Jan Wouters
Bas Van Dijk
Original Assignee
Cochlear Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cochlear Limited filed Critical Cochlear Limited
Priority to US13/263,407 priority Critical patent/US8503704B2/en
Priority to PCT/AU2009/000437 priority patent/WO2010115227A1/en
Publication of WO2010115227A1 publication Critical patent/WO2010115227A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/552—Binaural
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N1/00—Electrotherapy; Circuits therefor
    • A61N1/18—Applying electric currents by contact electrodes
    • A61N1/32—Applying electric currents by contact electrodes alternating or intermittent currents
    • A61N1/36—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
    • A61N1/36036—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation of the outer, middle or inner ear
    • A61N1/36038—Cochlear stimulation
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S3/00—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received
    • G01S3/80—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received using ultrasonic, sonic or infrasonic waves
    • G01S3/802—Systems for determining direction or deviation from predetermined direction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40—Arrangements for obtaining a desired directivity characteristic
    • H04R25/407—Circuits for combining signals of a plurality of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/35—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using translation techniques
    • H04R25/353—Frequency, e.g. frequency shift or compression
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Definitions

  • the present invention relates to localisation of sound sources in hearing device systems and in one application, to bilateral hearing device systems.
  • BACKGROUND Sufferers of hearing loss are, in many cases, able to ameliorate the effects of their hearing loss by the use of hearing devices that amplify surrounding sound signals, couple sound to the inner ear in non-acoustic ways, and/or directly stimulate auditory nerves in the recipient's cochlea, for example, using electrical stimulation.
  • hearing aids which amplify surrounding signals and provide this to the recipient in the form of amplified acoustic signals (hearing aids may also be implantable), Direct Acoustic Cochlear Stimulation (DACS) systems which convert surrounding sound signals into mechanical actuation signals which stimulate the recipient's cochlea directly, Bone Anchored Hearing Aids (BAHA) which transmit sound from the skull to the cochlea via bone conduction, and cochlear implant systems which convert surrounding sound signals into electrical stimulation signals which are applied directly to auditory nerves inside the recipient's cochlea or inner ear.
  • DAS Direct Acoustic Cochlear Stimulation
  • BAHA Bone Anchored Hearing Aids
  • cochlear implant systems which convert surrounding sound signals into electrical stimulation signals which are applied directly to auditory nerves inside the recipient's cochlea or inner ear.
  • cochlear implant systems which convert surrounding sound signals into electrical stimulation signals which are applied directly to auditory nerves inside the recipient's cochlea or inner ear.
  • a recipient will have a hearing device in each ear.
  • This is known as a bilateral system.
  • a bilateral system may consist of a cochlear implant in one ear and a conventional hearing aid in the other ear, a cochlear implant in both ears, a hearing aid in both ears, a hybrid system in both ears, a hybrid system in one ear and a cochlear implant in the other ear, or a hybrid system in one ear and a hearing aid in the other ear.
  • Combinations in which a different system is used in the two ears is known as a bimodal bilateral system.
  • a method of facilitating localisation of a source of a sound signal for a recipient of a bilateral hearing device system comprising a first hearing device and a second hearing device, the method comprising: receiving the sound signal at the first and second hearing devices; determining one or more localisation cues in the received sound signal; and processing the determined one or more localisation cues to provide a useable one or more localisation cues; and generating a stimulation signal representative of the sound signal with the useable one or more localisation cues, for application to the recipient.
  • the step of processing the detected one or more localisation cues comprises shifting the detected localisation cue to a lower frequency.
  • the step of processing the detected one or more localisation cues comprises amplifying the localisation cue.
  • the detected one or more localisation cues is an interaural level difference (ILD).
  • ILD interaural level difference
  • the detected one or more localisation cue is an interaural time difference (ITD).
  • a method of facilitating localisation of a source of a sound signal for a recipient of a bilateral hearing device system comprising a first hearing device and a second hearing device, the method comprising: receiving the sound signal at the first and second hearing devices; detecting an interaural level difference (ELD) in the received sound signal; and generating a stimulation signal representative of the sound signal with the detected ILD inserted at a lower frequency, for application to the recipient.
  • ELD interaural level difference
  • a method of facilitating localisation of a source of a sound signal for a recipient of a bilateral hearing device system comprising a first hearing device and a second hearing device, the method comprising: receiving the sound signal at the first and second hearing devices; detecting one or more localisation cues in the received sound signal; and generating a stimulation signal representative of the sound signal with the detected one or more localisation cues amplified, for application to the recipient.
  • the localisation cue is an interaural level difference (ILD).
  • ILD interaural level difference
  • the localisation cue is an interaural time difference (ITD).
  • a method of facilitating localisation of a source of a sound signal for a recipient of a bilateral hearing device system comprising a first hearing device and a second hearing device, the method comprising: receiving the sound signal at the first and second hearing devices; determining a likely location of the source of the sound signal; determining one or more localisation cues for the recipient to perceive the source of the sound signal at the determined likely location; and generating a stimulation signal including the determined one or more localisation cues for application to the recipient.
  • a bilateral hearing device system for facilitating localisation of a source of a sound signal for a recipient of the bilateral hearing device system comprising a first hearing device and a second hearing device, the bilateral system comprising:
  • One or more receivers for receiving the sound signal at the first and second hearing devices; means for determining one or more localisation cues in the received sound signal; a processor for processing the determined one or more localisation cues to provide a useable one or more localisation cues; and a stimulation signal generator for generating a stimulation signal representative of the sound signal with the useable one or more localisation cues, for application to the recipient.
  • the processor for processing the determined one or more localisation cues comprises means for shifting the determined one or more localisation cues to a lower frequency.
  • the processor for processing the determined one or more localisation cues comprises means for amplifying the determined one or more localisation cues.
  • the detected one or more localisation cues is an interaural level difference (ILD).
  • the detected one or more localisation cues is an interaural time difference (ITD).
  • ITD interaural time difference
  • a bilateral hearing device system for facilitating localisation of a source of a sound signal for a recipient of the bilateral hearing device system comprising a first hearing device and a second hearing device, the bilateral system comprising: one or more receivers for receiving the sound signal at the first and second hearing devices; a detector for detecting an interaural level difference (ILD) in the received sound signal; and a stimulation signal generator for generating a stimulation signal representative of the sound signal with the detected ILD inserted at a lower frequency, for application to the recipient.
  • ILD interaural level difference
  • a bilateral hearing device system for facilitating localisation of a source of a sound signal for a recipient of the bilateral hearing device system comprising a first hearing device and a second hearing device, the bilateral system comprising: one or more receivers for receiving the sound signal at the first and second hearing devices; a detector for detecting one or more localisation cues in the received sound signal; and a stimulation signal generator for generating a stimulation signal representative of the sound signal with the detected one or more localisation cues amplified, for application to the recipient.
  • a bilateral hearing device system for facilitating localisation of a source of a sound signal for a recipient of the bilateral hearing device system comprising a first hearing device and a second hearing device, the bilateral system comprising: one or more receivers for receiving the sound signal at the first and second hearing devices; means for determining a likely location of the source of the sound signal; means for determining one or more localisation cues for the recipient to perceive the source of the sound signal at the determined likely location; and a stimulation signal generator for generating a stimulation signal including the determined one or more localisation cues for application to the recipient.
  • Figure 1 - shows a representation of a person surrounded by a plurality of potential sound sources
  • FIG. 2 - illustrates the localisation cues of Interaural Level Difference (ILD) and Interaural Time
  • Figure 3 - shows a plot of ILDs for varying source locations
  • Figure 4 - shows an example of a bilateral system comprising two hearing devices on which the various aspects of the present invention may be employed;
  • Figure 5 A - shows another example of a bilateral system comprising two hearing devices on which the various aspects of the present invention may be employed;
  • Figure 5B - shows a further example of a bilateral system comprising two hearing devices on which the various aspects of the present invention may be employed;
  • Figure 6 - shows a flowchart of a general method of allowing the recipient to locate the source location
  • Figure 7 - shows a flowchart for one method of allowing the recipient to locate the source location using frequency-transposed cues
  • Figure 8 - shows a flowchart for another method of allowing the recipient to locate the source location using amplified cues
  • Figure 9 - shows a flowchart of a general method of allowing a recipient to locate the source location using cues determined from a calculation of the likely location
  • Figure 10 - shows a flowchart of a more detailed method of Figure 9
  • Figure 11 - shows a chart of HRTF for two devices
  • Figure 12 - shows a chart of energy spectrum for the signals at the two devices at a point in time
  • Figure 13 - shows the difference between the left and right signals of Figure 12;
  • Figure 14- shows ILDs vs Estimated location in degrees in the recipient's lower 3 bands
  • Figure 15 - shows the processed signal corrected using the BLDs
  • Figure 16 - shows a graph of ILDs vs Estimated location in degrees for another recipient in the lower 3 bands.
  • Hearing Device refers to any artificial device that assists the recipient in hearing.
  • This can include a hearing aid that receives surrounding sound signals, amplifies them and provides them to the recipient in the form of amplified acoustic signals (a hearing aid may be partially implanted); Direct Acoustic Cochlear Stimulation (DACS) systems which convert surrounding sound signals into mechanical actuation signals which stimulate the recipient's cochlea or middle ear directly; and cochlear implant systems which convert surrounding sound signals into electrical stimulation signals which are applied directly to auditory nerves inside the recipient's cochlea.
  • DAS Direct Acoustic Cochlear Stimulation
  • cochlear implant systems which convert surrounding sound signals into electrical stimulation signals which are applied directly to auditory nerves inside the recipient's cochlea.
  • There are also hybrid systems which provide both mechanical (or acoustic) and electrical stimulation. Other combinations of the devices mentioned above may also be possible in the future.
  • “Location” - in this context will be understood to mean a directional location about the recipient and need not include any distance perception from the recipient.
  • “Useable location cue” refers to a location cue that is able to be used by the recipient to assist in determining the location of the source of a sound.
  • the useable location cue may be an amplified version of an existing location cue at the same or similar frequency band, or may be a location cue that is detected or estimated from one frequency band and inserted into a different frequency band, or it may be one type of localisation cue extracted from the signal represented as another type of localisation cue (e.g. ITD represented as ILD).
  • the useable location cue may also include a location cue that is calculated from a separate calculation of the location of the source and inserted into the processed audio signal for application to the recipient.
  • Figure 1 shows a representation of a recipient 50 surrounded by a plurality of possible sound sources A,B,C,...M.
  • the location of the source of the sound is accorded a value in terms of degrees.
  • source location A is at -90 deg
  • source location G is at 0 degrees
  • source location M is at 90 degrees.
  • Other source locations (not shown) behind recipient 50 are also possible and will be accorded appropriate angle values.
  • a source location directly behind recipient 50 is at 180 degrees.
  • the sources of possible sound signals A to M could be target signals such as speech or music, or interfering noise sources such as other speakers, a radio playing or a fan humming.
  • ITD cues may either be apparent as phase differences in the fine timing structure of a signal (the carrier wave) or as delays in the slow varying envelope of a signal.
  • ILD cues may be as strong as 10-15 dB (depending on frequency) and the smallest ILD that one can detect is in the order of 1 dB.
  • ITD cues may range from 0 to 660 mircoseconds. The smallest detectable value is in the 10 microsecond range.
  • Figure 2 shows a representation of ILD and ITD in the context of an incoming sound from a source located at location A or at -90 degrees in Figure 1.
  • the ILD is due to head shadow effect, that is, the effect of the head attenuating the sound arriving at the ear behind the head with respect to the source (in Figure 2, the right ear).
  • head shadow effect that is, the effect of the head attenuating the sound arriving at the ear behind the head with respect to the source (in Figure 2, the right ear).
  • ILDs are considered useful for localisation, at frequencies greater than about 1500Hz.
  • Figure 3 shows a plot of ILDs per frequency for different angles of incidence. It can be seen that the magnitude of the ILDs is greatest in the higher frequencies.
  • ELD cues for bimodal recipients these are not generally available to bilateral recipients because in most bimodal recipients, the residual acoustical hearing is only available at lower frequencies and as previously discussed with reference to Figure 3, ILDs are most prominent in the higher frequencies.
  • a bilateral hearing system in which useable location cues are provided in the lower frequency range of the recipient. It has been discovered by the inventors of the present application (see for example, the paper "Amplification of interaural level differences improves sound localization for cochlear implant users with contralateral bimodal hearing", Francart et al, previously incorporated by reference), that the transposition of ILD cues from the higher frequencies to the lower frequencies can be used by bimodal recipients for localisation.
  • the useable location cue may be the amplification of the already-existing ILD or ITD information in that lower frequency range.
  • FIG 4 shows one example of a bilateral hearing system 500 comprising a first hearing device 100 and a second hearing device 200.
  • Hearing device 100 may be a hearing aid (HA), a cochlear implant (CI), a DACS system or a hybrid device.
  • Hearing device 200 may equally be any one of a hearing aid (HA), a cochlear implant (CI), a DACS system or a hybrid device.
  • HA hearing aid
  • CI cochlear implant
  • DACS system a hybrid device.
  • An example of a CI/CI bilateral system is described in US Patent Application No. 2004/0172101 entitled "Peak-Derived Timing Stimulation Strategy For a Multi-Channel Cochlear Implant", previously incorporated by reference.
  • each device 100, 200 there is microphone 110, 210, which captures surrounding sound signals, and provides these to analog-to-digital converter ADC 120, 220 for converting the analog sound signal into a digital signal for further processing.
  • ADC 120,220 provides the digital signal to pre-processing block 130, 230 for processing.
  • This processing may include sensitivity control or Automatic Gain Control (AGC).
  • AGC Automatic Gain Control
  • the input block described above adapts the signal for use by the rest of the system.
  • An example of a cochlear implant with pre-processing is described in US Patent Application No. 2005/0209657 entitled "Enhancing Cochlear Implants With Hearing Aid Signal Processing Technologies", previously incorporated by reference.
  • non-synchronised input pre-processing between the two devices 100, 200 may result in the loss of location cues.
  • the AGC in the louder device may compress the signal more than in the other device, resulting in loss of ILD information.
  • unsynchronised processes could result in loss, attenuation, or misrepresentation of ITD information.
  • Figure 4 shows that in this example, the pre-processing stages 130,230 communicate with each other to synchronise their respective operations.
  • An example of a bilateral system providing synchronisation between hearing devices is described in US Patent No. 5,991,419 entitled “Bilateral Signal Processing Prosthesis" previously incorporated by reference. It will be appreciated however, that the two devices need not communicate with each other, and may be synchronised by other means, including pre-setting the various parameters so as to coordinate with each other.
  • Filterbank 140,240 analyses the frequency content of the sound signal.
  • the post-processor 150,250 may provide any desired post-processing such as an ACETM strategy for cochlear implants.
  • the processed signal is applied to an output stimulation device 160,260 for application of the stimulation signal to the recipient. It will be apparent for somebody skilled in the art that the exact architecture of the device as shown in Figure 4 may differ between devices, for instance a hearing aid need not to have a post processing block 150/250. These differences are not relevant to the various aspects of the present invention.
  • the output stimulation device may be a receiver (a receiver is a common term for a loudspeaker in a hearing aid) for providing amplified and processed acoustic stimulation to the eardrum of the recipient.
  • the output stimulation device may be an electrode array for applying electrical stimulation signals directly to the auditory nerves in the cochlea of the recipient.
  • the output stimulation device may be a mechanical actuator for applying mechanical stimulation to a window of the recipient's cochlea or to one of the auditory bones in the recipient's middle ear.
  • Figure 5 A shows an alternative arrangement in which part of the pre-processing is shown as including localisation pre-processing as a separate functional block 135.
  • this functionality may be physically provided on the same processor as pre-processing block 130, or indeed as any other processing block.
  • a corresponding localisation pre-processing block 235 in device 200 is also provided. As shown, in this example, these blocks also communicate with each other. This communication channel may be one or more wireless links.
  • Blocks 135 and 235 may exchange full bandwidth or compressed, uni- or bi-directional audio, but may also or instead, exchange other data such as one or more parameters associated with one or more location algorithms as will be described in more detail below.
  • Figure 5B shows yet a further example of an arrangement of a bilateral hearing system 500, comprising two hearing devices 100 and 200, with like parts accordingly labelled.
  • a bilateral hearing system 500 comprising two hearing devices 100 and 200, with like parts accordingly labelled.
  • full audio may be streamed to one device.
  • one or both devices 100,200 may contain multiple microphones and more than one audio stream may exist to optimize the location algorithms.
  • the first algorithm in the pre-processing blocks 130,230 Figure 4 (or localisation pre-processing blocks 135,235 Figure 5A, or localisation pre-processing block Figure 5B), is used to extract or otherwise determine, location data from the input sound signal detected by microphones (110, 210).
  • any suitable algorithm may be used. If one or both devices contain more than one microphone, more data streams may be exchanged, but alternatively a device may do some pre-calculations based on its own multiple microphone signals, then exchange a single data stream with the other device that also pre- calculated parameters.
  • Sum-and-delay type algorithms may be used to estimate the Direction Of Arrival (DOA).
  • autocorrelation type algorithms may be used to estimate the ITD. These algorithms may run on the broadband signals or on sub-band (filtered) versions of the signal.
  • Algorithms that look at the ratio of energy in a subband over a certain period of time, may also be used, thus estimating ILD cues. When this is done, there is no need to transfer full audio over the link. Instead, sub-band average energies (envelope) signals may be transferred instead to reduce bandwidth. In ILDs the average energy will have a very typical distribution over frequencies due to the head-related transfer function (HRTF). The algorithm may specifically look for spectrally-distributed ILDs that follow the HRTF.
  • HRTF head-related transfer function
  • the inventors have developed an algorithm that makes use of the full-band signals from the microphones of both hearing devices 100,200 (for example HA and CI) (see pages 125,126). IfAa is the root mean square (RMS) amplitude of the signal at the microphone of the CI speech processor, and A HA is the RMS amplitude of the signal at the microphone of the HA, then the ILD in dB is defined as :
  • ILD 201og (Ac) - 201og (AH A ) ( 1 )
  • localisation cue information may be estimated rather than detected or extracted.
  • suitable algorithms for estimating localisation cues are - "Time difference of arrival estimation of speech source in a noisy and reverberant environment"; Dvorkind et al; Signal Processing 85 (2005) 177-204; and "Time Delay Estimation in Room Acoustic Environments: An Overview"; Chen et al; EURASIP Journal on Applied Signal Processing; Volume 2006, Article ID 26503, ppl-19, both previously incorporated by reference.
  • the information is used to modify the processed input audio signal in a post-processing stage by blocks 150, 155,250,255 as previously described.
  • the type of post-processing may vary.
  • the algorithms in the PostLoc block may perform 1 of 2 functions or a combination of both. In general they will, based on the control data input from the PreLoc blocks introduce and/or enhance ILD and/or ITD cues.
  • the ILDs found or estimated in higher frequencies in the PreLoc block may simply drive subband gain blocks in the lower frequencies. In this way, ILDs in higher frequencies (which are more prominent) are transferred to DLDs in lower frequencies (more audible for hybrid patients or others with only low-frequency acoustical residual hearing).
  • block 135 will transfer control instructions or data to the post-processing blocks 155,255 to implement the modification of the processed signal to generate the stimulation signal for application to the recipient through output stimulation device 160,260.
  • all the pre-processing is done in one device (100), and the results transmitted to the other device (200) to generate the appropriate stimulation signal.
  • the first device (100) will simply take the required instructions for generation of its stimulation signal from its own pre-processing block 135.
  • the high frequency BLDs may be amplified, re-tuned, or even made binary. If people have trouble 'hearing' the exact DOA, it could be estimated from the PreLoc block and cues applied that place the signal in front when the direction was -45 - 45 degrees, to the right if the DOA was 45 — 135 degrees, to the left when it was -135 — 45 degrees, etc. This will lead to less resolution for the recipient but may make it easier to point the recipient's attention to 'about' the right direction. Delay blocks in the processing chain may also be introduced or subband delays may be amplified to transmit ITD cues.
  • the amount of ILD or ITD introduced in PostLoc may be recipient-dependent.
  • a method may be implemented of measuring the recipient's sensitivity to ILDs or ITDs and depending on these measurements more or fewer cues could be introduced. This may also be time-variable and re-adjustable.
  • Figure 6 is a flowchart describing a general method of allowing a recipient to locate the source of a sound signal.
  • the sound signal is received at the receivers of the devices 100,200.
  • a localisation cue is then determined in step 610. This determination may be done by detecting or measuring a localisation cue in the received signal using one or more of the algorithms or techniques described above. In another example or embodiment, the determination is done by independently calculating the localisation cue from a calculation or estimation of the location of the source of the sound signal and determining the localisation cue from that.
  • the determined location cue is then processed in one or more of a number of ways.
  • the determined location cue for example ILD
  • the determined localisation cue for example ILD or ITD
  • the processing step involves inserting the determined localisation cue into a stimulation signal to provide the recipient with the required localisation cues so as to be able to perceive the location of the source of the sound signal at the location previously calculated or estimated. This method is described in more detail with reference to Figures 9-16.
  • FIG. 7 is a flowchart of a general method of assisting a recipient in locating the source of a sound using frequency transposition of an ILD.
  • the sound signal is received at the microphones of the devices 100,200.
  • the received signal is then processed by one or both devices as previously described and a cue is detected or otherwise identified.
  • This cue may be an ILD for example, and may be identified using any one or more of the various algorithms or techniques previously described.
  • This ILD is likely to be in the higher frequencies of the signal, and not useful to the recipient because of the recipient's hearing condition.
  • the detected cue e.g. ILD
  • the method shown in Figure 7 comprises receiving a sound signal at the receiver; determining a localisation cue in the received sound signal, and generating a stimulation signal representative of the received sound signal with the useable localisation cue inserted in the stimulation signal.
  • FIG. 8 is a flowchart of a general method of assisting a recipient in locating the source of a sound using frequency amplification of an ILD or ITD.
  • the sound signal is received at the receivers of the devices, and in step 810, one or more the localisation cues (for example, ILD and/or ITD) are detected using one or more of the techniques or algorithms described above.
  • the stimulation signal is generated with the detected localisation cue amplified, thereby inserting a useable localisation cue in the generated stimulation signal.
  • the localisation cue is not transposed from a higher frequency to a lower frequency, but rather the localisation cue that is present in the lower, useable frequencies, is amplified to be more useable by the recipient.
  • the useable localisation cues are determined from an independent determination of the location of the sound source and in some cases, may be modified so that the recipient will perceive the location of the sound source to be where is was independently determined.
  • the sound signal is received at the receivers of the devices, and in step 910, a determination of the location of the source of the sound signal is made using one or more of the algorithms or techniques described above.
  • one or more localisation cues are determined that will allow the recipient to locate the source of the sound signal.
  • the stimulation signal is generated with the determined localisation cues, or useable location cues.
  • FIG. 10 provides a more detailed flowchart of one method as shown in and described with reference to, Figure 9 above.
  • step 1000 the sound signal is received at the left and right devices 100,200.
  • step 1 100 the difference between the signals at the left and right devices is determined.
  • step 1200 this determined difference is compared with a pre-generated or otherwise known FIRTF for the recipient, and a closest match is selected (e.g. by way of a look-up table) and in step 1300, the closest matching HRTF is used to determine the most likely location of the sound signal.
  • steps 1400 and 1500 the location cues for that recipient that would allow the recipient to perceive the location of the sound signal as the most likely location are determined.
  • Figure 11 shows an HRTF of 2 devices on the recipient's head.
  • the horizontal axis shows frequency bands used in the device (low to high frequency).
  • the difference in intensity between the left and right microphone is displayed for signal coming from different directions (0 degrees; front, 90 degrees: right side).
  • This HRTF is known or at least known to some approximation.
  • Figure 12 shows, at a certain point in time, the energy spectrum of the left and right input signal.
  • the PostLoc block could introduce a 19 dB ILD in the signal leading to the correct estimation of the DOA by the recipient.
  • the algorithm does this by simply adding 19 dB gain to the right device's lowest 3 frequency bands (or 19 dB attenuation to the left devices, or any combination of the two).
  • the resulting signal will be as seen in Figure 15.
  • Monaural cues are available, but can be distorted or attenuated due to 1) microphone placement (behind the ear, instead of in the ear), 2) compression in the CI signal processing, 3) unavailability of frequencies higher than the upper cut off frequency of the CI processor (typically around 8khz) and 4) inability of the recipient to perceive differences between HRTFs corresponding to different sound source locations.
  • a psychophysical test may be done with the subject and it could be determined that the subject can perceive differences in dip frequency of about 500Hz.
  • the system could then use a tailored set of HRTFs with the following dip frequencies: angle (degrees) 0 15 30 45 60 75 90 freq (hertz) 8000 7750 7500 7250 7000 6500 6000

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Otolaryngology (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Neurosurgery (AREA)
  • Acoustics & Sound (AREA)
  • Radar, Positioning & Navigation (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Remote Sensing (AREA)
  • Biomedical Technology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

Disclosed is a method and system for allowing a recipient of a hearing aid device, and in one aspect, a bilateral hearing aid system, to locate the source of a sound signal about the recipient. The method uses localisation cues in the sound signal and modifies these to provide useable localisation cues to generate a stimulating signal for application to the recipient. In one example, a detected localisation cue such as an interaural level difference (ILD) is transposed to a lower frequency.

Description

LOCALISATION IN A BILATERAL HEARING DEVICE SYSTEM
FIELD The present invention relates to localisation of sound sources in hearing device systems and in one application, to bilateral hearing device systems.
INCORPORATION BY REFERENCE
The following documents are referred to in the present application:
"Perception of binaural localization cues with combined electric and acoustic hearing", PhD Thesis by Tom Francart; Katholieke Univeriteit Leuven, November 2008; "Amplification of interaural level differences improves sound localization for cochlear implant users with contralateral acoustic hearing", Francart et al, J Acoust Soc Am, 2008d; - US Patent Application No. 2004/0172101 entitled "Peak-Derived Timing Stimulation
Strategy For a Multi-Channel Cochlear Implant";
- US Patent Application No. 2005/0209657 entitled "Enhancing Cochlear Implants With Hearing Aid Signal Processing Technologies" ;
US Patent No. 5,870,481 entitled "Method and Apparatus for Localisation Enhancement in Hearing Aids";
- US Patent No. 5,991 ,419 entitled "Bilateral Signal Processing Prosthesis"
- International Patent Application PCT/EP2008/004959 (WO2008/155123) entitled "Binaural Stimulation in Neural Auditory Prostheses or Hearing Aids";
A localization algorithm based on head-related transfer functions. Macdonald JA. J Acoust Soc Am. 2008 Jun; 123(6):4290-6;
"Narrow-band sound localization related to external ear acoustics" Middlebrooks J. Acoust. Soc. Am. Volume 92, Issue 5, pp. 2607-2624 (November 1992);
- "A New Method For Binaural 3-D Localization Based on HRTFs", Keyrouz et al; ICASSP
2006 pp341-344.
"Adaptive eigenvalue decomposition algorithm for passive acoustic source localization"; Benesty; J. Accoust. Soc. Am 107 (1), January 2000; pp. 384-391;
- Computational auditory scene analysis (2006), ISBN: 978-04-7174109-1 Wang and Brown, chapter 5; "Time difference of arrival estimation of speech source in a noisy and reverberant environment"; Dvorkind et al; Signal Processing 85 (2005) 177-204; "Time Delay Estimation in Room Acoustic Environments: An Overview"; Chen et al; EURASIP Journal on Applied Signal Processing; Volume 2006, Article ID 26503, ppl-19
The entire content of each of these documents is hereby incorporated by reference.
BACKGROUND Sufferers of hearing loss are, in many cases, able to ameliorate the effects of their hearing loss by the use of hearing devices that amplify surrounding sound signals, couple sound to the inner ear in non-acoustic ways, and/or directly stimulate auditory nerves in the recipient's cochlea, for example, using electrical stimulation.
Examples of such devices include hearing aids, which amplify surrounding signals and provide this to the recipient in the form of amplified acoustic signals (hearing aids may also be implantable), Direct Acoustic Cochlear Stimulation (DACS) systems which convert surrounding sound signals into mechanical actuation signals which stimulate the recipient's cochlea directly, Bone Anchored Hearing Aids (BAHA) which transmit sound from the skull to the cochlea via bone conduction, and cochlear implant systems which convert surrounding sound signals into electrical stimulation signals which are applied directly to auditory nerves inside the recipient's cochlea or inner ear. There are also hybrid systems which provide both mechanical (or acoustic) and electrical stimulation.
In some cases, a recipient will have a hearing device in each ear. This is known as a bilateral system. A bilateral system may consist of a cochlear implant in one ear and a conventional hearing aid in the other ear, a cochlear implant in both ears, a hearing aid in both ears, a hybrid system in both ears, a hybrid system in one ear and a cochlear implant in the other ear, or a hybrid system in one ear and a hearing aid in the other ear. Combinations in which a different system is used in the two ears is known as a bimodal bilateral system.
Even though bilateral hearing device users or recipients will have more chance of detecting the direction of sound than a unilateral user or recipient, bilateral users still suffer from very poor localisation skills compared to normal hearing people. In normal hearing people, location of a sound source is accomplished using a number of different strategies, including using cues such as interaural level difference (ILD), in which the level or magnitude of sound is different in each ear depending upon the location of the source of the sound; and interaural time difference (ITD), in which the sound arrives at each ear at different times, depending upon the location of the source of the sound. Because of the way hearing devices process sound artificially, the usefulness of these cues may be lost or diminished in device users or recipients, making it difficult for the recipient to identify or locate the source of a sound. Furthermore, knowledge of the location of the source of a sound can often assist the recipient in understanding speech in noise.
SUMMARY
According to one aspect of the present invention, there is provided a method of facilitating localisation of a source of a sound signal for a recipient of a bilateral hearing device system comprising a first hearing device and a second hearing device, the method comprising: receiving the sound signal at the first and second hearing devices; determining one or more localisation cues in the received sound signal; and processing the determined one or more localisation cues to provide a useable one or more localisation cues; and generating a stimulation signal representative of the sound signal with the useable one or more localisation cues, for application to the recipient.
In one form, the step of processing the detected one or more localisation cues comprises shifting the detected localisation cue to a lower frequency.
In another form, the step of processing the detected one or more localisation cues comprises amplifying the localisation cue.
In one form, the detected one or more localisation cues is an interaural level difference (ILD).
In another form, the detected one or more localisation cue is an interaural time difference (ITD).
According to a second aspect of the present invention, there is provided a method of facilitating localisation of a source of a sound signal for a recipient of a bilateral hearing device system comprising a first hearing device and a second hearing device, the method comprising: receiving the sound signal at the first and second hearing devices; detecting an interaural level difference (ELD) in the received sound signal; and generating a stimulation signal representative of the sound signal with the detected ILD inserted at a lower frequency, for application to the recipient.
According to a third aspect of the present invention, there is provided a method of facilitating localisation of a source of a sound signal for a recipient of a bilateral hearing device system comprising a first hearing device and a second hearing device, the method comprising: receiving the sound signal at the first and second hearing devices; detecting one or more localisation cues in the received sound signal; and generating a stimulation signal representative of the sound signal with the detected one or more localisation cues amplified, for application to the recipient.
In one form, the localisation cue is an interaural level difference (ILD).
In another form, the localisation cue is an interaural time difference (ITD).
According to a fourth aspect of the present invention, there is provided a method of facilitating localisation of a source of a sound signal for a recipient of a bilateral hearing device system comprising a first hearing device and a second hearing device, the method comprising: receiving the sound signal at the first and second hearing devices; determining a likely location of the source of the sound signal; determining one or more localisation cues for the recipient to perceive the source of the sound signal at the determined likely location; and generating a stimulation signal including the determined one or more localisation cues for application to the recipient.
According to a fifth aspect of the present invention, there is provided a bilateral hearing device system for facilitating localisation of a source of a sound signal for a recipient of the bilateral hearing device system comprising a first hearing device and a second hearing device, the bilateral system comprising:
One or more receivers for receiving the sound signal at the first and second hearing devices; means for determining one or more localisation cues in the received sound signal; a processor for processing the determined one or more localisation cues to provide a useable one or more localisation cues; and a stimulation signal generator for generating a stimulation signal representative of the sound signal with the useable one or more localisation cues, for application to the recipient.
In one form, the processor for processing the determined one or more localisation cues comprises means for shifting the determined one or more localisation cues to a lower frequency.
In one form, the processor for processing the determined one or more localisation cues comprises means for amplifying the determined one or more localisation cues. In one form, the detected one or more localisation cues is an interaural level difference (ILD).
In one form, the detected one or more localisation cues is an interaural time difference (ITD).
According to a sixth aspect of the present invention, there is provided a bilateral hearing device system for facilitating localisation of a source of a sound signal for a recipient of the bilateral hearing device system comprising a first hearing device and a second hearing device, the bilateral system comprising: one or more receivers for receiving the sound signal at the first and second hearing devices; a detector for detecting an interaural level difference (ILD) in the received sound signal; and a stimulation signal generator for generating a stimulation signal representative of the sound signal with the detected ILD inserted at a lower frequency, for application to the recipient.
According to a seventh aspect of the present invention, there is provided a bilateral hearing device system for facilitating localisation of a source of a sound signal for a recipient of the bilateral hearing device system comprising a first hearing device and a second hearing device, the bilateral system comprising: one or more receivers for receiving the sound signal at the first and second hearing devices; a detector for detecting one or more localisation cues in the received sound signal; and a stimulation signal generator for generating a stimulation signal representative of the sound signal with the detected one or more localisation cues amplified, for application to the recipient.
According to an eighth aspect of the present invention, there is provided a bilateral hearing device system for facilitating localisation of a source of a sound signal for a recipient of the bilateral hearing device system comprising a first hearing device and a second hearing device, the bilateral system comprising: one or more receivers for receiving the sound signal at the first and second hearing devices; means for determining a likely location of the source of the sound signal; means for determining one or more localisation cues for the recipient to perceive the source of the sound signal at the determined likely location; and a stimulation signal generator for generating a stimulation signal including the determined one or more localisation cues for application to the recipient. DRAWINGS
The various aspects of the present invention will now be described in more detail with reference to the following drawings in which:
Figure 1 - shows a representation of a person surrounded by a plurality of potential sound sources;
Figure 2 - illustrates the localisation cues of Interaural Level Difference (ILD) and Interaural Time
Difference (ITD);
Figure 3 - shows a plot of ILDs for varying source locations; Figure 4 - shows an example of a bilateral system comprising two hearing devices on which the various aspects of the present invention may be employed;
Figure 5 A - shows another example of a bilateral system comprising two hearing devices on which the various aspects of the present invention may be employed;
Figure 5B - shows a further example of a bilateral system comprising two hearing devices on which the various aspects of the present invention may be employed;
Figure 6 - shows a flowchart of a general method of allowing the recipient to locate the source location;
Figure 7 - shows a flowchart for one method of allowing the recipient to locate the source location using frequency-transposed cues;
Figure 8 - shows a flowchart for another method of allowing the recipient to locate the source location using amplified cues;
Figure 9 - shows a flowchart of a general method of allowing a recipient to locate the source location using cues determined from a calculation of the likely location;
Figure 10 - shows a flowchart of a more detailed method of Figure 9;
Figure 11 - shows a chart of HRTF for two devices; Figure 12 - shows a chart of energy spectrum for the signals at the two devices at a point in time;
Figure 13 - shows the difference between the left and right signals of Figure 12;
Figure 14- shows ILDs vs Estimated location in degrees in the recipient's lower 3 bands;
Figure 15 - shows the processed signal corrected using the BLDs; and
Figure 16 - shows a graph of ILDs vs Estimated location in degrees for another recipient in the lower 3 bands.
DETAILED DESCRIPTION
Throughout the following description, the following terms will be used:
"Hearing Device" - this refers to any artificial device that assists the recipient in hearing. This can include a hearing aid that receives surrounding sound signals, amplifies them and provides them to the recipient in the form of amplified acoustic signals ( a hearing aid may be partially implanted); Direct Acoustic Cochlear Stimulation (DACS) systems which convert surrounding sound signals into mechanical actuation signals which stimulate the recipient's cochlea or middle ear directly; and cochlear implant systems which convert surrounding sound signals into electrical stimulation signals which are applied directly to auditory nerves inside the recipient's cochlea. There are also hybrid systems which provide both mechanical (or acoustic) and electrical stimulation. Other combinations of the devices mentioned above may also be possible in the future.
"Location" - in this context will be understood to mean a directional location about the recipient and need not include any distance perception from the recipient.
"Useable location cue" - this refers to a location cue that is able to be used by the recipient to assist in determining the location of the source of a sound. The useable location cue may be an amplified version of an existing location cue at the same or similar frequency band, or may be a location cue that is detected or estimated from one frequency band and inserted into a different frequency band, or it may be one type of localisation cue extracted from the signal represented as another type of localisation cue (e.g. ITD represented as ILD). The useable location cue may also include a location cue that is calculated from a separate calculation of the location of the source and inserted into the processed audio signal for application to the recipient.
Figure 1 shows a representation of a recipient 50 surrounded by a plurality of possible sound sources A,B,C,...M. As seen in Figure 1, the location of the source of the sound is accorded a value in terms of degrees. For example, source location A is at -90 deg, source location G is at 0 degrees, and source location M is at 90 degrees. Other source locations (not shown) behind recipient 50 are also possible and will be accorded appropriate angle values. For example, a source location directly behind recipient 50 is at 180 degrees.
The sources of possible sound signals A to M could be target signals such as speech or music, or interfering noise sources such as other speakers, a radio playing or a fan humming.
In normal hearing people, location of a sound source is accomplished using one or more of a number of different strategies, including using cues such as interaural level difference (ILD), in which the level or magnitude of sound is different in each ear depending upon the location of the source of the sound; and interaural time difference (ITD), in which the sound arrives at each ear at different times, depending upon the location of the source of the sound. ITD cues may either be apparent as phase differences in the fine timing structure of a signal (the carrier wave) or as delays in the slow varying envelope of a signal. In normal circumstances, ILD cues may be as strong as 10-15 dB (depending on frequency) and the smallest ILD that one can detect is in the order of 1 dB. ITD cues may range from 0 to 660 mircoseconds. The smallest detectable value is in the 10 microsecond range.
Figure 2 shows a representation of ILD and ITD in the context of an incoming sound from a source located at location A or at -90 degrees in Figure 1.
The ILD is due to head shadow effect, that is, the effect of the head attenuating the sound arriving at the ear behind the head with respect to the source (in Figure 2, the right ear). For sound sources located more than about 1 meter from the ear, ILDs are considered useful for localisation, at frequencies greater than about 1500Hz. Figure 3 shows a plot of ILDs per frequency for different angles of incidence. It can be seen that the magnitude of the ILDs is greatest in the higher frequencies.
Because of the way hearing devices process sound artificially, the usefulness of these cues may be lost or diminished in bilateral recipients, making it difficult for the bilateral recipient to identify or locate the source of a sound. For example, in the case of ITDs, where ITD information is present in the fine structure of the signal, this information is often lost when the device is a cochlear implant because the processor of the cochlear implant removes this fine structure from the incident sound signal and only transmits the per-band slow temporal energy envelopes. Furthermore, in the case of bilateral devices, the two devices are, in general, not synchronised and so time difference information from the ITDs have little meaning. In the case of ELD cues for bimodal recipients, these are not generally available to bilateral recipients because in most bimodal recipients, the residual acoustical hearing is only available at lower frequencies and as previously discussed with reference to Figure 3, ILDs are most prominent in the higher frequencies.
According to one aspect of the present invention, there is provided a bilateral hearing system in which useable location cues are provided in the lower frequency range of the recipient. It has been discovered by the inventors of the present application (see for example, the paper "Amplification of interaural level differences improves sound localization for cochlear implant users with contralateral bimodal hearing", Francart et al, previously incorporated by reference), that the transposition of ILD cues from the higher frequencies to the lower frequencies can be used by bimodal recipients for localisation. In another example, the useable location cue may be the amplification of the already-existing ILD or ITD information in that lower frequency range.
Figure 4 shows one example of a bilateral hearing system 500 comprising a first hearing device 100 and a second hearing device 200. Hearing device 100 may be a hearing aid (HA), a cochlear implant (CI), a DACS system or a hybrid device. Hearing device 200 may equally be any one of a hearing aid (HA), a cochlear implant (CI), a DACS system or a hybrid device. An example of a CI/CI bilateral system is described in US Patent Application No. 2004/0172101 entitled "Peak-Derived Timing Stimulation Strategy For a Multi-Channel Cochlear Implant", previously incorporated by reference.
In each device 100, 200, there is microphone 110, 210, which captures surrounding sound signals, and provides these to analog-to-digital converter ADC 120, 220 for converting the analog sound signal into a digital signal for further processing. ADC 120,220 provides the digital signal to pre-processing block 130, 230 for processing. This processing may include sensitivity control or Automatic Gain Control (AGC). As will be understood by the person skilled in the art, the input block described above adapts the signal for use by the rest of the system. An example of a cochlear implant with pre-processing is described in US Patent Application No. 2005/0209657 entitled "Enhancing Cochlear Implants With Hearing Aid Signal Processing Technologies", previously incorporated by reference.
It will be appreciated that non-synchronised input pre-processing between the two devices 100, 200 may result in the loss of location cues. For example, if the sound signal incident on one device is louder than the sound in the other device, the AGC in the louder device may compress the signal more than in the other device, resulting in loss of ILD information. Furthermore, in the case of ITDs, where timing is of paramount importance, unsynchronised processes could result in loss, attenuation, or misrepresentation of ITD information.
Figure 4 shows that in this example, the pre-processing stages 130,230 communicate with each other to synchronise their respective operations. An example of a bilateral system providing synchronisation between hearing devices is described in US Patent No. 5,991,419 entitled "Bilateral Signal Processing Prosthesis" previously incorporated by reference. It will be appreciated however, that the two devices need not communicate with each other, and may be synchronised by other means, including pre-setting the various parameters so as to coordinate with each other.
Filterbank 140,240 analyses the frequency content of the sound signal. The post-processor 150,250 may provide any desired post-processing such as an ACE™ strategy for cochlear implants. Finally, the processed signal is applied to an output stimulation device 160,260 for application of the stimulation signal to the recipient. It will be apparent for somebody skilled in the art that the exact architecture of the device as shown in Figure 4 may differ between devices, for instance a hearing aid need not to have a post processing block 150/250. These differences are not relevant to the various aspects of the present invention. In the case of a hearing aid (HA), the output stimulation device may be a receiver (a receiver is a common term for a loudspeaker in a hearing aid) for providing amplified and processed acoustic stimulation to the eardrum of the recipient. In the case of a cochlear implant (CI), the output stimulation device may be an electrode array for applying electrical stimulation signals directly to the auditory nerves in the cochlea of the recipient. In the case of a DACS device, the output stimulation device may be a mechanical actuator for applying mechanical stimulation to a window of the recipient's cochlea or to one of the auditory bones in the recipient's middle ear.
It will be appreciated that in the case of a hearing implant such as a cochlear implant, a (partially) implanted hearing aid, or a DACS, part of the device will be external to the recipient and part will be internal with communications between the internal and external parts occurring transcutaneously as will be understood by the person skilled in the art. Figures 4, 5 and 6 (below) do not show any separation of the two parts as this is not relevant to the various aspects of the present invention.
It will also be appreciated that in the case of a hybrid device, there may be two or more parallel paths, but again these are not shown for the sake of clarity.
Figure 5 A shows an alternative arrangement in which part of the pre-processing is shown as including localisation pre-processing as a separate functional block 135. Of course, it will be appreciated that this functionality may be physically provided on the same processor as pre-processing block 130, or indeed as any other processing block. A corresponding localisation pre-processing block 235 in device 200 is also provided. As shown, in this example, these blocks also communicate with each other. This communication channel may be one or more wireless links.
Blocks 135 and 235 may exchange full bandwidth or compressed, uni- or bi-directional audio, but may also or instead, exchange other data such as one or more parameters associated with one or more location algorithms as will be described in more detail below.
Figure 5B shows yet a further example of an arrangement of a bilateral hearing system 500, comprising two hearing devices 100 and 200, with like parts accordingly labelled. In this arrangement, there is only one localisation pre-processing block 135. In this case, full audio may be streamed to one device. In this arrangement, there is a backwards link between block 220 and block 135 that sends control data back to the 'slave' device to control the output.
In some implementations, one or both devices 100,200 may contain multiple microphones and more than one audio stream may exist to optimize the location algorithms.
In each of the arrangements shown in Figures 4, 5 and 6, use is made of two algorithms to effect the various aspects of the present invention. The first algorithm, in the pre-processing blocks 130,230 Figure 4 (or localisation pre-processing blocks 135,235 Figure 5A, or localisation pre-processing block Figure 5B), is used to extract or otherwise determine, location data from the input sound signal detected by microphones (110, 210).
Any suitable algorithm may be used. If one or both devices contain more than one microphone, more data streams may be exchanged, but alternatively a device may do some pre-calculations based on its own multiple microphone signals, then exchange a single data stream with the other device that also pre- calculated parameters.
Sum-and-delay type algorithms may be used to estimate the Direction Of Arrival (DOA). Alternatively, autocorrelation type algorithms may be used to estimate the ITD. These algorithms may run on the broadband signals or on sub-band (filtered) versions of the signal.
Algorithms that look at the ratio of energy in a subband over a certain period of time, may also be used, thus estimating ILD cues. When this is done, there is no need to transfer full audio over the link. Instead, sub-band average energies (envelope) signals may be transferred instead to reduce bandwidth. In ILDs the average energy will have a very typical distribution over frequencies due to the head-related transfer function (HRTF). The algorithm may specifically look for spectrally-distributed ILDs that follow the HRTF.
For example, as described in the PhD thesis "Perception of binaural localization cues with combined electric and acoustic hearing", previously incorporated by reference, the inventors have developed an algorithm that makes use of the full-band signals from the microphones of both hearing devices 100,200 (for example HA and CI) (see pages 125,126). IfAa is the root mean square (RMS) amplitude of the signal at the microphone of the CI speech processor, and AHA is the RMS amplitude of the signal at the microphone of the HA, then the ILD in dB is defined as :
ILD = 201og (Ac) - 201og (AHA) ( 1 )
Other examples of suitable localisation algorithms are described in the following documents, all previously incorporated by reference - A localization algorithm based on head-related transfer functions, Macdonald JA. J Acoust Soc Am. 2008 Jun; 123 (6): 4290-6; "Narrow-band sound localization related to external ear acoustics" Middlebrooks J. Acoust. Soc. Am. Volume 92, Issue 5, pp. 2607-2624 (November 1992); "A New Method For Binaural 3-D Localization Based on HRTFs", Keyrouz et al; ICASSP 2006 pp341-344; "Adaptive eigenvalue decomposition algorithm for passive acoustic source localization"; Benesty; J. Accoust. Soc. Am 107 (1), January 2000; pp. 384-391; and Computational auditory scene analysis (2006), ISBN: 978-04-7174109-1 Wang and Brown, chapter 5; US Patent No. 5,870,481 entitled "Method and Apparatus for Localisation Enhancement in Hearing Aids" (describing a method of determining ILDs and use in bilateral hearing aids; and
International Patent Application PCT/EP2008/004959 (WO2008/155123) entitled "Binaural Stimulation in Neural Auditory Prostheses or Hearing Aids" (describing a method of determining ITDs and controlling the hearing devices accordingly.
In other examples, localisation cue information may be estimated rather than detected or extracted. Examples of suitable algorithms for estimating localisation cues are - "Time difference of arrival estimation of speech source in a noisy and reverberant environment"; Dvorkind et al; Signal Processing 85 (2005) 177-204; and "Time Delay Estimation in Room Acoustic Environments: An Overview"; Chen et al; EURASIP Journal on Applied Signal Processing; Volume 2006, Article ID 26503, ppl-19, both previously incorporated by reference.
Once the localisation cues have been detected or estimated in the pre-processing blocks 135,235, the information is used to modify the processed input audio signal in a post-processing stage by blocks 150, 155,250,255 as previously described.
The type of post-processing may vary. The algorithms in the PostLoc block may perform 1 of 2 functions or a combination of both. In general they will, based on the control data input from the PreLoc blocks introduce and/or enhance ILD and/or ITD cues.
In a simple implementation the ILDs found or estimated in higher frequencies in the PreLoc block may simply drive subband gain blocks in the lower frequencies. In this way, ILDs in higher frequencies (which are more prominent) are transferred to DLDs in lower frequencies (more audible for hybrid patients or others with only low-frequency acoustical residual hearing). For example in Figure 5B, block 135 will transfer control instructions or data to the post-processing blocks 155,255 to implement the modification of the processed signal to generate the stimulation signal for application to the recipient through output stimulation device 160,260. In this example, all the pre-processing is done in one device (100), and the results transmitted to the other device (200) to generate the appropriate stimulation signal. The first device (100) will simply take the required instructions for generation of its stimulation signal from its own pre-processing block 135.
In alternative implementations, the high frequency BLDs may be amplified, re-tuned, or even made binary. If people have trouble 'hearing' the exact DOA, it could be estimated from the PreLoc block and cues applied that place the signal in front when the direction was -45 - 45 degrees, to the right if the DOA was 45 — 135 degrees, to the left when it was -135 — 45 degrees, etc. This will lead to less resolution for the recipient but may make it easier to point the recipient's attention to 'about' the right direction. Delay blocks in the processing chain may also be introduced or subband delays may be amplified to transmit ITD cues.
In a further step the amount of ILD or ITD introduced in PostLoc may be recipient-dependent. A method may be implemented of measuring the recipient's sensitivity to ILDs or ITDs and depending on these measurements more or fewer cues could be introduced. This may also be time-variable and re-adjustable.
The following describes a number of methods that may be used in applying the various aspects of the present invention.
Figure 6 is a flowchart describing a general method of allowing a recipient to locate the source of a sound signal. In step 600, the sound signal is received at the receivers of the devices 100,200. A localisation cue is then determined in step 610. This determination may be done by detecting or measuring a localisation cue in the received signal using one or more of the algorithms or techniques described above. In another example or embodiment, the determination is done by independently calculating the localisation cue from a calculation or estimation of the location of the source of the sound signal and determining the localisation cue from that.
In step 620, the determined location cue is then processed in one or more of a number of ways. In one example, the determined location cue (for example ILD), is shifted or transposed into a lower frequency band. This is described in more detail below with reference to Figure 7. In another example, the determined localisation cue (for example ILD or ITD) is amplified at its existing frequency band. This method is described in more detail below with reference to Figure 8. In yet another example, if the localisation cue is determined from an independent calculation or estimation of the location of the source of the sound signal, the processing step involves inserting the determined localisation cue into a stimulation signal to provide the recipient with the required localisation cues so as to be able to perceive the location of the source of the sound signal at the location previously calculated or estimated. This method is described in more detail with reference to Figures 9-16.
Figure 7 is a flowchart of a general method of assisting a recipient in locating the source of a sound using frequency transposition of an ILD. In step 700, the sound signal is received at the microphones of the devices 100,200. The received signal is then processed by one or both devices as previously described and a cue is detected or otherwise identified. This cue may be an ILD for example, and may be identified using any one or more of the various algorithms or techniques previously described. This ILD is likely to be in the higher frequencies of the signal, and not useful to the recipient because of the recipient's hearing condition. Upon further processing, the detected cue (e.g. ILD) is transposed into the lower frequencies, where it is more useable by the recipient. In essence then, the method shown in Figure 7 comprises receiving a sound signal at the receiver; determining a localisation cue in the received sound signal, and generating a stimulation signal representative of the received sound signal with the useable localisation cue inserted in the stimulation signal.
Figure 8 is a flowchart of a general method of assisting a recipient in locating the source of a sound using frequency amplification of an ILD or ITD. In step 800, the sound signal is received at the receivers of the devices, and in step 810, one or more the localisation cues (for example, ILD and/or ITD) are detected using one or more of the techniques or algorithms described above. In this example, the stimulation signal is generated with the detected localisation cue amplified, thereby inserting a useable localisation cue in the generated stimulation signal. In this case, the localisation cue is not transposed from a higher frequency to a lower frequency, but rather the localisation cue that is present in the lower, useable frequencies, is amplified to be more useable by the recipient.
In another example, as shown in Figure 9, the useable localisation cues are determined from an independent determination of the location of the sound source and in some cases, may be modified so that the recipient will perceive the location of the sound source to be where is was independently determined. This effectively provides a "mapping function" between the location of the sound source and the ILDs required by the recipient to locate the sound source. This again, provides for the generation of a stimulation signal with a useable localisation cue to allow the recipient to locate the source of the original sound signal. In step 900, the sound signal is received at the receivers of the devices, and in step 910, a determination of the location of the source of the sound signal is made using one or more of the algorithms or techniques described above. In step 920, one or more localisation cues are determined that will allow the recipient to locate the source of the sound signal. In step 930, the stimulation signal is generated with the determined localisation cues, or useable location cues.
Figure 10 provides a more detailed flowchart of one method as shown in and described with reference to, Figure 9 above. In step 1000, the sound signal is received at the left and right devices 100,200. In step 1 100, the difference between the signals at the left and right devices is determined. In step 1200, this determined difference is compared with a pre-generated or otherwise known FIRTF for the recipient, and a closest match is selected (e.g. by way of a look-up table) and in step 1300, the closest matching HRTF is used to determine the most likely location of the sound signal. In steps 1400 and 1500, the location cues for that recipient that would allow the recipient to perceive the location of the sound signal as the most likely location are determined. This may be done by any suitable means, including referring to a look up table populated with previously-measured data for the recipient. These determined location cues (such as ILDs) are then inserted into the stimulation signal for application to the recipient in step 1600. The following, with reference to Figures 11-16, provides an example of the method shown in Figures 9 and 10 above. Figure 11 shows an HRTF of 2 devices on the recipient's head. The horizontal axis shows frequency bands used in the device (low to high frequency). On the vertical axis the difference in intensity between the left and right microphone is displayed for signal coming from different directions (0 degrees; front, 90 degrees: right side). This HRTF is known or at least known to some approximation.
Figure 12 shows, at a certain point in time, the energy spectrum of the left and right input signal.
The difference between the right and left signal per band is shown in Figure 13. Comparing this difference curve to the HRTFs of the first graph (Figure 11) the algorithm extracts that the most likely DOA of the most prominent signal is in the order of 45 degrees (for example by comparing ILD magnitudes.
In this example, it is assumed that for the recipient with a bimodal system there is only residual hearing in the first 3 frequency bands and an experiment relating ILDs in those lower frequency bands to an estimated DOA led to the results as shown in Figure 14.
From Figure 14, it can be seen that in order to estimate an angle of 45 degrees, the recipient needs an ILD in the lower 3 frequencies of about 19 dB. In Figure 13, it can be seen that the current signal has an ILD of zero dB in that region, meaning the recipient would place the signal (incorrectly) in the front.
The PostLoc block could introduce a 19 dB ILD in the signal leading to the correct estimation of the DOA by the recipient. The algorithm does this by simply adding 19 dB gain to the right device's lowest 3 frequency bands (or 19 dB attenuation to the left devices, or any combination of the two). The resulting signal will be as seen in Figure 15.
In another example, suppose that in another bilateral CI user the measuring results of Figure 10 are as shown in Figure 16. With the same input signal as in the previous example, this recipient will have difficulty in consistently localizing the input sound signal as the ILD was about 19 degrees which is just in the s-point of his/her curve (Figure 16). The algorithm may introduce an ILD that is amplified to say 30 dB to enable consistent localization to the right side for this recipient.
While much of the above description has described the various aspects of the invention in the context of bilateral hearing systems, some aspects are also applicable to a unilateral recipient, i.e. a recipient having only a single hearing device. When a single CI is used (as opposed to bilateral CI's or CI+HA), the recipient does not have access to binaural cues (ITD and ILD). Monaural cues are available, but can be distorted or attenuated due to 1) microphone placement (behind the ear, instead of in the ear), 2) compression in the CI signal processing, 3) unavailability of frequencies higher than the upper cut off frequency of the CI processor (typically around 8khz) and 4) inability of the recipient to perceive differences between HRTFs corresponding to different sound source locations.
This can be addressed by artificially modifying HRTFs to fit them into the frequency range that is transmitted by the CI and make them perceptually distinguishable.
While at first the artificial HRTFs might not be perceived as corresponding to a certain direction, the recipient can be trained to perceive them as such (differences in HRTF are highly trainable in NH subjects).
Example 1 :
Consider a set of HRTFs which contain a prominent dip that shifts in frequency with changing angle of incidence (similar to the shifting dip in Figure 3). Let the angles and dip frequencies be: angle (degrees) 0 15 30 45 60 75 90 freq (hertz) 12000 11000 11500 10000 9000 8500 8000
In this case, based on this dip, different angles can not be distinguished by the recipient because 1) frequencies above 8kHz are not transmitted by the CI and the given differences in dip frequency might not be perceivable.
A psychophysical test may be done with the subject and it could be determined that the subject can perceive differences in dip frequency of about 500Hz. The system could then use a tailored set of HRTFs with the following dip frequencies: angle (degrees) 0 15 30 45 60 75 90 freq (hertz) 8000 7750 7500 7250 7000 6500 6000
Note that larger angles have a better perceptual resolution. This is useful because for smaller angles there are clear visual cues to sound source location.
The system would then determine the angle of incidence of a sound source and select and apply an HRTF from the latter set based on that angle. Example 2:
To distinguish between sounds incident from the front or back, normal hearing listeners use pinna cues. These cues are typically only available at higher frequencies (>1 OkHz) (which are not transmitted by the CI). A system similar to example 2 could be devised that 1) determines whether the sound came from the front or back; and 2) applies a tailored HRTF that is perceived as - or can be trained to be perceived as - corresponding to front or back.
Throughout the specification and the claims that follow, unless the context requires otherwise, the words "comprise" and "include" and variations such as "comprising" and "including" will be understood to imply the inclusion of a stated integer or group of integers, but not the exclusion of any other integer or group of integers.
The reference to any prior art in this specification is not, and should not be taken as, an acknowledgement of any form of suggestion that such prior art forms part of the common general knowledge.

Claims

1. A method of facilitating localisation of a source of a sound signal for a recipient of a bilateral hearing device system comprising a first hearing device and a second hearing device, the method comprising: receiving the sound signal at the first and second hearing devices; determining one or more localisation cues in the received sound signal; and processing the determined one or more localisation cues to provide a useable one or more localisation cues; and generating a stimulation signal representative of the sound signal with the useable one or more localisation cues, for application to the recipient.
2. A method as claimed in claim 1 wherein the step of processing the detected one or more localisation cues comprises shifting the detected localisation cue to a lower frequency.
3. A method as claimed in claim 1 wherein the step of processing the detected one or more localisation cues comprises amplifying the localisation cue.
4. A method as claimed in claim 2 or 3 wherein the detected one or more localisation cues is an interaural level difference (ILD).
5. A method as claimed in claim 3 wherein the detected one or more localisation cue is an interaural time difference (ITD).
6. A method of facilitating localisation of a source of a sound signal for a recipient of a bilateral hearing device system comprising a first hearing device and a second hearing device, the method comprising: receiving the sound signal at the first and second hearing devices; detecting an interaural level difference (ILD) in the received sound signal; and generating a stimulation signal representative of the sound signal with the detected ILD inserted at a lower frequency, for application to the recipient.
7. A method of facilitating localisation of a source of a sound signal for a recipient of a bilateral hearing device system comprising a first hearing device and a second hearing device, the method comprising: receiving the sound signal at the first and second hearing devices; detecting one or more localisation cues in the received sound signal; and generating a stimulation signal representative of the sound signal with the detected one or more localisation cues amplified, for application to the recipient.
8. A method as claimed in claim 7 wherein the localisation cue is an interaural level difference
(ILD).
9. A method as claimed in claim 8 wherein the localisation cue is an interaural time difference (ITD).
10. A method of facilitating localisation of a source of a sound signal for a recipient of a bilateral hearing device system comprising a first hearing device and a second hearing device, the method comprising: receiving the sound signal at the first and second hearing devices; determining a likely location of the source of the sound signal; determining one or more localisation cues for the recipient to perceive the source of the sound signal at the determined likely location; and generating a stimulation signal including the determined one or more localisation cues for application to the recipient.
11. A bilateral hearing device system for facilitating localisation of a source of a sound signal for a recipient of the bilateral hearing device system comprising a first hearing device and a second hearing device, the bilateral system comprising: one or more receivers for receiving the sound signal at the first and second hearing devices; means for determining one or more localisation cues in the received sound signal; a processor for processing the determined one or more localisation cues to provide a useable one or more localisation cues; and a stimulation signal generator for generating a stimulation signal representative of the sound signal with the useable one or more localisation cues, for application to the recipient.
12. A system as claimed in claim 11 wherein the processor for processing the determined one or more localisation cues comprises means for shifting the determined one or more localisation cues to a lower frequency.
13. A system as claimed in claim 11 wherein the processor for processing the determined one or more localisation cues comprises means for amplifying the determined one or more localisation cues.
14. A system as claimed in claim 12 or 13 wherein the detected one or more localisation cues is an interaural level difference (ILD).
15. A system as claimed in claim 13 wherein the detected one or more localisation cues is an interaural time difference (ITD).
16. A bilateral hearing device system for facilitating localisation of a source of a sound signal for a recipient of the bilateral hearing device system comprising a first hearing device and a second hearing device, the bilateral system comprising: one or more receivers for receiving the sound signal at the first and second hearing devices; a detector for detecting an interaural level difference (ILD) in the received sound signal; and a stimulation signal generator for generating a stimulation signal representative of the sound signal with the detected ILD inserted at a lower frequency, for application to the recipient.
17. A bilateral hearing device system for facilitating localisation of a source of a sound signal for a recipient of the bilateral hearing device system comprising a first hearing device and a second hearing device, the bilateral system comprising: one or more receivers for receiving the sound signal at the first and second hearing devices; a detector for detecting one or more localisation cues in the received sound signal; and a stimulation signal generator for generating a stimulation signal representative of the sound signal with the detected one or more localisation cues amplified, for application to the recipient.
18. A bilateral hearing device system for facilitating localisation of a source of a sound signal for a recipient of the bilateral hearing device system comprising a first hearing device and a second hearing device, the bilateral system comprising: one or more receivers for receiving the sound signal at the first and second hearing devices; means for determining a likely location of the source of the sound signal; means for determining one or more localisation cues for the recipient to perceive the source of the sound signal at the determined likely location; and a stimulation signal generator for generating a stimulation signal including the determined one or more localisation cues for application to the recipient.
PCT/AU2009/000437 2009-04-07 2009-04-07 Localisation in a bilateral hearing device system WO2010115227A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/263,407 US8503704B2 (en) 2009-04-07 2009-04-07 Localisation in a bilateral hearing device system
PCT/AU2009/000437 WO2010115227A1 (en) 2009-04-07 2009-04-07 Localisation in a bilateral hearing device system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/AU2009/000437 WO2010115227A1 (en) 2009-04-07 2009-04-07 Localisation in a bilateral hearing device system

Publications (1)

Publication Number Publication Date
WO2010115227A1 true WO2010115227A1 (en) 2010-10-14

Family

ID=42935573

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU2009/000437 WO2010115227A1 (en) 2009-04-07 2009-04-07 Localisation in a bilateral hearing device system

Country Status (2)

Country Link
US (1) US8503704B2 (en)
WO (1) WO2010115227A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102438189A (en) * 2011-08-30 2012-05-02 东南大学 Sound source positioning method based on dual-channel acoustic signals
CN102984638A (en) * 2011-08-23 2013-03-20 奥迪康有限公司 A method and a binaural listening system for maximizing a better ear effect
WO2013078218A1 (en) * 2011-11-21 2013-05-30 Advanced Bionics Ag Methods and systems for optimizing speech and music perception by a bilateral cochlear implant patient
WO2014065831A1 (en) * 2012-10-24 2014-05-01 Advanced Bionics Ag Systems and methods for facilitating sound localization by a bilateral cochlear implant patient
EP2869599A1 (en) 2013-11-05 2015-05-06 Oticon A/s A binaural hearing assistance system comprising a database of head related transfer functions
US9283376B2 (en) 2011-05-27 2016-03-15 Cochlear Limited Interaural time difference enhancement strategy
WO2016116160A1 (en) * 2015-01-22 2016-07-28 Sonova Ag Hearing assistance system
WO2017011196A1 (en) * 2015-07-10 2017-01-19 Advanced Bionics Ag Systems and methods for facilitating interaural time difference perception by a binaural cochlear implant patient
DK201600608A1 (en) * 2016-10-10 2018-05-07 Widex As Binaural hearing aid system and a method of operating a binaural hearing aid system
US10524067B2 (en) 2015-05-11 2019-12-31 Advanced Bionics Ag Hearing assistance system

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11217237B2 (en) 2008-04-14 2022-01-04 Staton Techiya, Llc Method and device for voice operated control
US8611560B2 (en) 2007-04-13 2013-12-17 Navisense Method and device for voice operated control
US8625819B2 (en) 2007-04-13 2014-01-07 Personics Holdings, Inc Method and device for voice operated control
US11317202B2 (en) 2007-04-13 2022-04-26 Staton Techiya, Llc Method and device for voice operated control
US9129291B2 (en) 2008-09-22 2015-09-08 Personics Holdings, Llc Personalized sound management and method
KR101694822B1 (en) * 2010-09-20 2017-01-10 삼성전자주식회사 Apparatus for outputting sound source and method for controlling the same
DK2563044T3 (en) * 2011-08-23 2014-11-03 Oticon As A method, a listening device and a listening system to maximize a better ear effect
ES2428466B1 (en) * 2012-05-04 2014-11-07 Universidad De Salamanca BINAURAL SOUND PROCESSING SYSTEM FOR COCLEAR IMPLANTS
US9407999B2 (en) * 2013-02-04 2016-08-02 University of Pittsburgh—of the Commonwealth System of Higher Education System and method for enhancing the binaural representation for hearing-impaired subjects
US9270244B2 (en) 2013-03-13 2016-02-23 Personics Holdings, Llc System and method to detect close voice sources and automatically enhance situation awareness
US9854081B2 (en) * 2013-03-15 2017-12-26 Apple Inc. Volume control for mobile device using a wireless device
WO2014143959A2 (en) * 2013-03-15 2014-09-18 Bodhi Technology Ventures Llc Volume control for mobile device using a wireless device
US9802044B2 (en) 2013-06-06 2017-10-31 Advanced Bionics Ag System and method for neural hearing stimulation
US9271077B2 (en) 2013-12-17 2016-02-23 Personics Holdings, Llc Method and system for directional enhancement of sound using small microphone arrays
KR102110460B1 (en) 2013-12-20 2020-05-13 삼성전자주식회사 Method and apparatus for processing sound signal
EP2942976B1 (en) 2014-05-08 2019-10-23 Universidad de Salamanca Sound enhancement for cochlear implants
US10575103B2 (en) 2015-04-10 2020-02-25 Starkey Laboratories, Inc. Neural network-driven frequency translation
US9401158B1 (en) 2015-09-14 2016-07-26 Knowles Electronics, Llc Microphone signal fusion
US9843875B2 (en) * 2015-09-25 2017-12-12 Starkey Laboratories, Inc. Binaurally coordinated frequency translation in hearing assistance devices
US10397710B2 (en) 2015-12-18 2019-08-27 Cochlear Limited Neutralizing the effect of a medical device location
US9830930B2 (en) 2015-12-30 2017-11-28 Knowles Electronics, Llc Voice-enhanced awareness mode
US9779716B2 (en) 2015-12-30 2017-10-03 Knowles Electronics, Llc Occlusion reduction and active noise reduction based on seal quality
US9812149B2 (en) 2016-01-28 2017-11-07 Knowles Electronics, Llc Methods and systems for providing consistency in noise reduction during speech and non-speech periods
EP3426339B1 (en) 2016-03-11 2023-05-10 Mayo Foundation for Medical Education and Research Cochlear stimulation system with surround sound and noise cancellation
US10469962B2 (en) 2016-08-24 2019-11-05 Advanced Bionics Ag Systems and methods for facilitating interaural level difference perception by enhancing the interaural level difference
US11426581B2 (en) 2016-11-04 2022-08-30 Med-El Elektromedizinische Geraete Gmbh Bilateral synchronized channel selection for cochlear implants
EP3326685B1 (en) 2016-11-11 2019-08-14 Oticon Medical A/S Cochlear implant system for processing multiple sound source information
US10405082B2 (en) 2017-10-23 2019-09-03 Staton Techiya, Llc Automatic keyword pass-through system
WO2020190317A1 (en) * 2019-03-15 2020-09-24 Advanced Bionics Ag Systems and methods for frequency-specific localization and speech comprehension enhancement
US12090327B2 (en) 2019-10-30 2024-09-17 Cochlear Limited Synchronized pitch and timing cues in a hearing prosthesis system
WO2022112879A1 (en) * 2020-11-30 2022-06-02 Cochlear Limited Magnified binaural cues in a binaural hearing system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5870481A (en) * 1996-09-25 1999-02-09 Qsound Labs, Inc. Method and apparatus for localization enhancement in hearing aids
US20070140506A1 (en) * 2005-12-19 2007-06-21 Phonak Ag Synchronization of sound generated in binaural hearing system
US20080013762A1 (en) * 2006-07-12 2008-01-17 Phonak Ag Methods for manufacturing audible signals

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5870481A (en) * 1996-09-25 1999-02-09 Qsound Labs, Inc. Method and apparatus for localization enhancement in hearing aids
US20070140506A1 (en) * 2005-12-19 2007-06-21 Phonak Ag Synchronization of sound generated in binaural hearing system
US20080013762A1 (en) * 2006-07-12 2008-01-17 Phonak Ag Methods for manufacturing audible signals

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
FRANCART T. ET AL.: "Perception of binaural localization cues with combined electric and acoustic hearing", (PHD THESIS) LIBRARY HOLDING OF KATHOLIEKE UNIVERSITEIT LUVEN, 18 November 2008 (2008-11-18), Retrieved from the Internet <URL:http;//repository.libis.kuleuven.be/dspace/handle/1979/1961?mode=simple&dc=description&dcAttr=abstract&dcLang=en> *
SEEBER ET AL.: "Localization ability with bimodal hearing aids and bilateral cochlear implants", J. ACOUST. SOC. AM., vol. 116, no. 3, 2004, pages 1698 - 1709, XP012072520, doi:10.1121/1.1776192 *
VAN DER BOGAERT ET AL.: "Horizontal localization with bilateral hearing aids: Without is better than with", J. ACOUST. SOC. AM., vol. 119, no. 1, January 2006 (2006-01-01), XP012085106, doi:10.1121/1.2139653 *
VAN HOESEL ET AL.: "Speech perception, localization, and lateralization with bilateral cochlear implants", J. ACOUST. SOC. AM., vol. 113, no. 3, 2003, pages 1617 - 1630, XP012003372, doi:10.1121/1.1539520 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9283376B2 (en) 2011-05-27 2016-03-15 Cochlear Limited Interaural time difference enhancement strategy
CN102984638A (en) * 2011-08-23 2013-03-20 奥迪康有限公司 A method and a binaural listening system for maximizing a better ear effect
CN102984638B (en) * 2011-08-23 2017-08-25 奥迪康有限公司 The maximized method of ear effect and ears listening system are made
CN102438189A (en) * 2011-08-30 2012-05-02 东南大学 Sound source positioning method based on dual-channel acoustic signals
WO2013078218A1 (en) * 2011-11-21 2013-05-30 Advanced Bionics Ag Methods and systems for optimizing speech and music perception by a bilateral cochlear implant patient
US20140277276A1 (en) * 2011-11-21 2014-09-18 Advanced Bionics Ag Methods and systems for optimizing speech and music perception by a bilateral cochlear implant patient
US9199079B2 (en) 2011-11-21 2015-12-01 Advanced Bionics Ag Methods and systems for optimizing speech and music perception by a bilateral cochlear implant patient
US9592381B2 (en) 2012-10-24 2017-03-14 Advanced Bionics Ag Systems and methods for facilitating sound localization by a bilateral cochlear implant patient
WO2014065831A1 (en) * 2012-10-24 2014-05-01 Advanced Bionics Ag Systems and methods for facilitating sound localization by a bilateral cochlear implant patient
US9414171B2 (en) 2013-11-05 2016-08-09 Oticon A/S Binaural hearing assistance system comprising a database of head related transfer functions
EP2869599A1 (en) 2013-11-05 2015-05-06 Oticon A/s A binaural hearing assistance system comprising a database of head related transfer functions
US9565502B2 (en) 2013-11-05 2017-02-07 Oticon A/S Binaural hearing assistance system comprising a database of head related transfer functions
WO2016116160A1 (en) * 2015-01-22 2016-07-28 Sonova Ag Hearing assistance system
US10149074B2 (en) 2015-01-22 2018-12-04 Sonova Ag Hearing assistance system
CN107211225A (en) * 2015-01-22 2017-09-26 索诺瓦公司 Hearing assistant system
US10524067B2 (en) 2015-05-11 2019-12-31 Advanced Bionics Ag Hearing assistance system
WO2017011196A1 (en) * 2015-07-10 2017-01-19 Advanced Bionics Ag Systems and methods for facilitating interaural time difference perception by a binaural cochlear implant patient
US10342976B2 (en) 2015-07-10 2019-07-09 Advanced Bionics Ag Systems and methods for facilitating interaural time difference perception by a binaural cochlear implant patient
US10244334B2 (en) 2016-10-10 2019-03-26 Widex A/S Binaural hearing aid system and a method of operating a binaural hearing aid system
DK201600608A1 (en) * 2016-10-10 2018-05-07 Widex As Binaural hearing aid system and a method of operating a binaural hearing aid system

Also Published As

Publication number Publication date
US8503704B2 (en) 2013-08-06
US20120093329A1 (en) 2012-04-19

Similar Documents

Publication Publication Date Title
US8503704B2 (en) Localisation in a bilateral hearing device system
US10431239B2 (en) Hearing system
US11020593B2 (en) System and method for enhancing the binaural representation for hearing-impaired subjects
US9338565B2 (en) Listening system adapted for real-time communication providing spatial information in an audio stream
US10349191B2 (en) Binaural gearing system and method
EP3248393B1 (en) Hearing assistance system
US20100002886A1 (en) Hearing system and method implementing binaural noise reduction preserving interaural transfer functions
US9432778B2 (en) Hearing aid with improved localization of a monaural signal source
US20040190734A1 (en) Binaural compression system
US9699574B2 (en) Method of superimposing spatial auditory cues on externally picked-up microphone signals
US20170043162A1 (en) Sound enhancement for cochlear implants
CN106658319B (en) Method for generating stimulation pulses and corresponding bilateral cochlear implant
Moore et al. Evaluation of a method for enhancing interaural level differences at low frequencies
Monaghan et al. A method to enhance the use of interaural time differences for cochlear implants in reverberant environments
Dieudonné et al. Head shadow enhancement with low-frequency beamforming improves sound localization and speech perception for simulated bimodal listeners
EP2928213B1 (en) A hearing aid with improved localization of a monaural signal source
CN108175936B (en) Cochlear implant system for processing multi-source information
Lavandier et al. A binaural model predicting speech intelligibility in the presence of stationary noise and noise-vocoded speech interferers for normal-hearing and hearing-impaired listeners
US20110150232A1 (en) Method and apparatus for testing binaural hearing aid function
King et al. The effect of tone-vocoding on spatial release from masking for old, hearing-impaired listeners
EP3041270B1 (en) A method of superimposing spatial auditory cues on externally picked-up microphone signals
San-Victoriano et al. Binaural pre-processing for contralateral sound field attenuation can improve speech-in-noise intelligibility for bilateral hearing-aid users

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09842847

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 13263407

Country of ref document: US

122 Ep: pct application non-entry in european phase

Ref document number: 09842847

Country of ref document: EP

Kind code of ref document: A1