WO2003098970A1 - Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions - Google Patents

Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions Download PDF

Info

Publication number
WO2003098970A1
WO2003098970A1 PCT/AU2003/000613 AU0300613W WO03098970A1 WO 2003098970 A1 WO2003098970 A1 WO 2003098970A1 AU 0300613 W AU0300613 W AU 0300613W WO 03098970 A1 WO03098970 A1 WO 03098970A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
auditory prosthesis
prosthesis according
data
sound
Prior art date
Application number
PCT/AU2003/000613
Other languages
French (fr)
Inventor
Harvey Dillon
Justin Andrew Zakis
Hugh Joseph Mcdermott
Gitte Keidser
Original Assignee
Hearworks Pty Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hearworks Pty Ltd filed Critical Hearworks Pty Ltd
Priority to CA2486893A priority Critical patent/CA2486893C/en
Priority to JP2004506316A priority patent/JP4658593B2/en
Priority to AU2003225339A priority patent/AU2003225339A1/en
Priority to EP03720029A priority patent/EP1532841A4/en
Publication of WO2003098970A1 publication Critical patent/WO2003098970A1/en
Priority to US10/993,359 priority patent/US7889879B2/en
Priority to US13/024,649 priority patent/US8532317B2/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/60Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles
    • H04R25/604Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles of acoustic or vibrational transducers
    • H04R25/606Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles of acoustic or vibrational transducers acting directly on the eardrum, the ossicles or the skull, e.g. mastoid, tooth, maxillary or mandibular bone, or mechanically stimulating the cochlea, e.g. at the oval window
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N1/00Electrotherapy; Circuits therefor
    • A61N1/18Applying electric currents by contact electrodes
    • A61N1/32Applying electric currents by contact electrodes alternating or intermittent currents
    • A61N1/36Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
    • A61N1/36036Applying electric currents by contact electrodes alternating or intermittent currents for stimulation of the outer, middle or inner ear
    • A61N1/36038Cochlear stimulation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N1/00Electrotherapy; Circuits therefor
    • A61N1/18Applying electric currents by contact electrodes
    • A61N1/32Applying electric currents by contact electrodes alternating or intermittent currents
    • A61N1/36Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
    • A61N1/36036Applying electric currents by contact electrodes alternating or intermittent currents for stimulation of the outer, middle or inner ear
    • A61N1/36038Cochlear stimulation
    • A61N1/36039Cochlear stimulation fitting procedures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/43Electronic input selection or mixing based on input signal analysis, e.g. mixing or selection between microphone and telecoil or between microphones with different directivity characteristics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/50Customised settings for obtaining desired overall acoustical characteristics
    • H04R25/505Customised settings for obtaining desired overall acoustical characteristics using digital signal processing
    • H04R25/507Customised settings for obtaining desired overall acoustical characteristics using digital signal processing implemented by neural network or fuzzy logic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/41Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/67Implantable hearing aids or parts thereof not covered by H04R25/606

Definitions

  • the present invention relates to a programmable auditory prosthesis, such as a hearing aid or cochlear implant.
  • the invention is an auditory prosthesis that adjusts its sound processing characteristics in a particular acoustic environment in a manner that is similar or identical to that previously determined by the user of the prosthesis as optimal for that environment.
  • Hearing loss which may be due to many different causes, is generally of two types, conductive and sensorineural. Of these types, conductive hearing loss occurs where the normal mechanical pathways for sound to reach the hair cells in the cochlea are impeded, for example, by damage to the ossicles. Conductive hearing loss may often be helped by use of conventional hearing aid systems, which comprise a microphone, an amplifier and a receiver (miniature speaker) for amplifying detected sounds so that acoustic information does reach the cochlea and the hair cells. Since the elevation ofthe minimum detectable sound pressure level may vary with the frequency of an acoustic test stimulus, the amplifier may be preceded by, or comprise of, a bank of filters to enable different frequency components of the signal to be amplified by different amounts.
  • conventional hearing aid systems which comprise a microphone, an amplifier and a receiver (miniature speaker) for amplifying detected sounds so that acoustic information does reach the cochlea and the hair cells. Since the elevation ofthe minimum detectable sound pressure level may vary with
  • Sensorineural hearing loss occurs where the hair cells in the cochlea and the attached auditory nerve fibres are damaged or destroyed. Sensorineural hearing loss results in an increase in the minimum detectable sound pressure level, which often varies with the frequency of the test stimulus. However, in contrast to conductive hearing loss, the sound pressure level that is uncomfortably loud at a given test frequency is often approximately the same as for people with normal hearing. The result is a reduction in the dynamic range of sound pressure levels that are audible yet not uncomfortably loud with the impaired ear, and this dynamic range of the impaired ear may vary considerably with the frequency of the acoustic test stimulus.
  • sensorineural hearing loss is often treated with hearing aid systems that employ non-linear amplification to compress the dynamic range of common sounds towards the dynamic range ofthe impaired ear.
  • Such systems may use a filter bank that is followed by a bank of compressive amplifiers, so that the dynamic range of the signal is reduced by an amount that is considered appropriate for the dynamic range ofthe impaired ear in each band.
  • Cochlear implant systems have typically consisted of two essential components, an external component commonly referred to as a processor unit and an internal implanted component commonly referred to as a stimulator/receiver unit.
  • both of these components have cooperated together to provide the sound sensation to a user.
  • the external component has traditionally consisted of a microphone for detecting sounds, such as speech and environmental sounds, a speech processor that converts the detected sounds, particularly speech, into a coded signal, a power source such as a battery, and an external transmitter coil.
  • the coded signal output by the speech processor is transmitted transcutaneously to the implanted stimulator/receiver unit situated within a recess of the temporal bone of the user.
  • This transcutaneous transmission occurs via the external transmitter coil which is. positioned to communicate with an implanted receiver coil provided with the stimulator/receiver unit.
  • This communication serves two essential purposes, firstly to transcutaneously transmit the coded sound signal and secondly to provide power to the implanted stimulator/receiver unit.
  • this link has been in the form of an RF link, but other such links have been proposed and implemented with varying degrees of success.
  • the implanted stimulator/receiver unit traditionally includes a receiver coil that receives the coded signal and power from the external processor component, and a stimulator that processes the coded signal and outputs a stimulation signal to an intracochlea electrode assembly which applies the electrical stimulation directly to the auditory nerve producing a hearing sensation corresponding to the original detected sound.
  • This document describes a hearing aid that has a memory that can store so-called “unsharp inputs”, or impressions of the hearing aid wearer about prevailing ambient conditions and/or the volume of the output of the hearing aid, prescribable algorithms, hearing loss data and hearing aid characteristic data.
  • a fuzzy logic module uses this data and control signals from an input signal analysis unit to calculate the output setting parameters for the hearing aid.
  • the behaviour rules of the fuzzy logic module and/or the prescribable algorithms are calculated from the data stored in the aid's memory by a neural network, with the neural network being typically implemented on a personal computer that is connected to the aid..
  • a problem with such an aid is the complexity ofthe processing scheme and an undesirably large drain on the aid's power source, typically an on-board battery. Further to this, such an aid would require a large amount of clinical time to correctly "train”, as the user does not have direct control over what is optimal, and "unsharp inputs” are used in the training of the aid rather than precise and direct inputs.
  • a neural network may not be able to reliably recognise such listening situations from an analysis of the microphone signal that, due to practical considerations such as memory limitations and the desirability of fast recognition of a change in listening situation, must be limited to a period of seconds or a few minutes. Therefore, after training it is possible that the neural network may misclassify a listening situation, especially in situations that are not acoustically well-defined, which can result in the application of amplification parameters that are unsuitable for the current listening situation. In such a device focus is placed on attempting to categorise specific acoustic environments, rather than measure the parameters of the environment and use these parameters directly in the processing scheme, as is the case with the present invention.
  • Another disadvantage of this device is that a major lifestyle change, such as a new workplace that is acoustically different to the previous workplace, may require different amplification parameters and hence a return visit to the clinic.
  • a major lifestyle change such as a new workplace that is acoustically different to the previous workplace
  • US Patent 6044163 Another example of a hearing aid that can receive the preferences of a hearing aid user and take these into consideration is described in US Patent 6044163.
  • This document describes a hearing aid that is similar to the hearing aid described in US patent 6035050.
  • the neural network is not restricted to selection of sets of amplification parameters that are stored in a memory, but may directly set the value of individual amplification parameters.
  • the disadvantages of the hearing aid described in this patent are similar to those of the hearing aid described in US patent 6035050.
  • the present invention is adapted to providing users with an auditory prosthesis that is adaptable and can adjust its output to the user when that user is exposed to varying ambient acoustic environments.
  • the present invention is adapted to providing users with an auditory prosthesis that can be 'trained' by the individual user to adapt its output to the user's preference in listening conditions encountered away from a traditional clinical situation, thereby reducing the clinical time required to fit an optimise a prosthesis to the individual user.
  • the present invention provides an auditory prosthesis comprising: a microphone which receives sound and produces a microphone signal corresponding to the received sound; an output device that provides audio signals in a form receivable by a user ofthe prosthesis; a sound processing means operable to receive the microphone signal and carry out a processing operation on the microphone signal to produce an output signal in a form suitable to operate the output device, wherein the processing means is operable in a first mode in which the processing operation comprises at least one variable processing factor which is adjustable by a user to a setting which causes the output signal ofthe processing means to be adjusted according to the preference ofthe user for the characteristics ofthe current acoustic environment; a data memory means for storing said setting; and wherein the sound processing means is simultaneously operable in a second mode in which said at least one variable processing factor is automatically adjusted on the basis ofthe previously adjusted variable processing factor selected by the user.
  • the present invention ensures that the prosthesis operates in a manner that suits the requirements of the user for the acoustic environments that the user encounters rather than in some manner predetermined from clinical tests which may not replicate the type of acoustic environments to which the user is routinely or occasionally exposed, and which may not necessarily replicate the subjective reactions of users when in those environments.
  • the data memory means stores data sets representative of the characteristics of at least one acoustic environment.
  • the at least one variable processing factor is automatically adjusted on the basis ofthe acoustic environments in which at least one variable processing factor was selected.
  • the processing means may be adapted when operable in the first mode to offer two or more possible optimal settings of the variable processing factor for selection by the user.
  • the user is preferably able to compare the operation of the prosthesis when operating in a particular acoustic environment when operating with each setting and then select from these the setting that is best for that particular environment.
  • the setting ofthe variable processing factor that is selected by the user may then be stored in the data memory means, optionally with data indicative of the characteristics of the particular acoustic environment.
  • This process may be repeatable so as to allow the processing means to monitor whether the user's preference for a particular setting of the variable processing factor changes with time or usage. In this way, the user effectively selects or votes for the best setting each time. By repeating the process, the number of selections or votes made by the user for each setting may be monitored to allow the prosthesis to select the optimal setting of the variable processing factor or optionally, the optimal setting of the variable processing factor for a particular environment.
  • the user may alternate between listening with the offered settings by operating a control means, and can select or vote for a setting ofthe variable processing factor(s) by operating an indicator means.
  • the control means may comprise a switch or set of buttons that is actuable by the user
  • the indicator means may comprise a switch or button that is actuable by the user.
  • the processing operation of the processing means may be adjustable by the user when the processing means is in the first mode of operation.
  • the user is able to adjust a control means throughout a substantially continuous range that allows the user to alter the variable processing factor(s) throughout a range of values, and thus alter the processing operation of the processing means.
  • the user may operate an indicator means, such as a switch or button, leading to storage of that setting and optionally, data indicative ofthe particular acoustic environment in the data memory means. Actuation of this indicator means may be taken by the processing means as indicating that the particular setting of the control means at that time is considered optimal by the user for the particular acoustic environment in which the user finds themself.
  • control means may comprise a rotary wheel control.
  • the rotary wheel control may be mounted on the housing of the prosthesis or alternatively, may be mounted on a remote unit.
  • the control means could also be in the form of a toggle switch or press buttons.
  • the indicator means may be mounted on a housing of the prosthesis. In another embodiment, the indicator means may be mounted on a remote unit.
  • the settings selected by the user as being optimal to that user for a plurality of acoustic environments may be stored in the data memory means and optionally, with data indicative of the characteristics of those particular acoustic environments.
  • the processing means operates in the second mode, and may simultaneously be operable in the first mode for a defined period of time or can be considered as operating in the first mode every time the user adjusts the control means and selects what is considered a new optimal setting for that particular environment.
  • the prosthesis may have a defined training period in which the prosthesis may be operable in the first mode of operation. This period may be as long as the user wishes or optionally, the prosthesis may signal to the user when the training period is complete. In this case, the prosthesis may be adapted to indicate the training period is complete once there has been a particular pre-defined number of instances in which the user has not selected a setting which is substantially different to the setting already estimated by the prosthesis to be optimal.
  • the prosthesis may further comprise a sound analysis means.
  • the sound analysis means preferably receives input signals from the microphone and monitors the acoustic environment of the prosthesis user.
  • the sound analysis means preferably provides an output representative of the acoustic environment being monitored at that time.
  • the data memory means may comprise one or more data memory locations.
  • the data memory means may comprise five data memory locations.
  • the first data memory location may contain the audiometric data of the prosthesis user and/or individual data for one or more loudness models used by the prosthesis.
  • the second data memory location may contain characteristic data about the hearing prosthesis.
  • the third data memory location may comprise one or more equations used to predict the optimal processing operation of the processing means for an individual user in different acoustic environments.
  • the fourth data memory location may store the optimal sound processing data as selected by the user of the prosthesis. This data may be ordered in different ways, such as sequentially or indexed according to the corresponding acoustic environment data supplied by the sound analysis means.
  • the acoustic environment data that corresponds to the optimal sound processing data is optionally stored in the fifth data memory location.
  • Other data memory means having differing numbers of memory locations may be envisaged.
  • the fourth data memory location may store a predefined maximum number of sets of optimal sound processing data.
  • the memory location may store a maximum of 400 data sets. Other maximum numbers can, however, be envisaged.
  • the data processing means does not utilise all stored data sets but only a predefined number of most recently logged data sets. For example, the data processing means may only utilise the last 256 data sets when determining the optimal value of a variable processing factor.
  • the newest data set to be stored in the memory location can be stored instead of the oldest data set in the memory location.
  • This first in first out storage system ensures only the most recently logged data is ever stored in the prosthesis at any one time.
  • older data cannot be overwritten such that once the memory location is full no further data sets can be logged by the prosthesis.
  • old data is preferably selectively overwritten by the newest sound processing data according to the acoustic environment in which the sound processing data was selected.
  • the prosthesis preferably further comprises a data processing means.
  • the data processing means preferably receives the output of the sound analysis means. Based on the output of the sound analysis means, the data processing means can be adapted to calculate the loudness of sounds present at the microphone. In one embodiment, the data processing means can calculate the loudness ofthe sounds as they would appear to a person with normal hearing and/or to a person with a degree of hearing impairment. The data processing means can be adapted to calculate other acoustic and psychoacoustic measures of the sounds present at the microphone.
  • the data processing means can use the acoustic and/or psychoacoustic measures as inputs to the one or more equations stored in the third data memory location which estimate the optimal sound processing operation ofthe sound processing means for the user in the acoustic environments represented by the sound analysis means.
  • the data processing means further preferably uses the hearing prosthesis characteristic data stored in the second data memory location and the optimal sound processor data generated by the equations to automatically and continuously determine the appropriate setting ofthe processing means to provide the optimal output signal for the user in the current acoustic environment being experienced by the user.
  • the processing means can include an amplifier means and a gain control means.
  • the operation of the amplifier means is preferably adjustable when in the first mode to allow the user to optimise the gain at each or every frequency of the amplifier in a particular acoustic environment.
  • the prosthesis operates in a second mode in which the amplification characteristics of the amplifier means automatically adjusts to the optimal level. That is, in such embodiments the variable processing factor is preferably the amplifier gain at each or every frequency.
  • the gain at each or every frequency ofthe amplifier means is calculated through use of an equation having a predefined form.
  • the equation can be:
  • i the frequency band number
  • equations with other acoustic or psychoacoustic parameters can calculate the gain or processing factors other than gain, such as the speed at which the prosthesis reacts to change in the acoustic environment, the choice of the equations used will depend upon the particular application desired, with such applications falling within the scope ofthe present invention.
  • trainable coefficients include a, b, c and d, which as a result leads to the amplifier gain G being a variable processing factor.
  • more than one variable processing factor of the processing means can be adjustable by the user using the control means or multiple control means.
  • more than one variable processing factor of the processing means can be automatically adjusted as appropriate to any acoustic environment.
  • the control means or multiple control means can allow the user to adjust one or more of the following example operations of the processor means:
  • the user can select a setting which is optimal for each variable processing factor for the particular acoustic environment that they are in by actuating the indicator means.
  • the user may select a setting which is optimal for one or more variable processing factors for the acoustic environment that the user experiences by actuating the indicator means.
  • more than one operation of the sound processor means, as well as more than one variable processing factor, can be adjusted in combination for each vote or selection.
  • the gain in each frequency band is preferably recorded along with a data set indicative of the acoustic environment detected by the microphone. This data can be used with previous sets of data by the data processing means to calculate the gain equation coefficients that best match the logged training data in each band. The recorded gain in each frequency band may be used to calculate the gain equation coefficients.
  • the data processing means when operating in the first mode the data processing means preferably does -not calculate optimal gain equation coefficients until a predetermined number of selections have been made by the user.
  • the prosthesis can be adapted to not calculate optimal gain equation coefficients until at least fifty selections have been made by the user.
  • the processing means may when operating in the second mode preferably automatically calculate the output appropriate to the current environment, based on predetermined coefficients and/or variable processing factors. Once the predetermined number of selections have been made, the processing means may calculate the optimal gain equation coefficients on the basis of previous user preferences when in the first mode of operation, and automatically and continuously calculate the variable processing factors with these equations when in the second mode of operation.
  • the data processing means preferably does not wait for a predetermined number of selections to be made by the user before calculating the optimal gain equation coefficients, but preferably does not use the calculated coefficients when in the second mode of operation until the variable processing factors that are preferred by the user can be predicted with the equations and calculated coefficients with a certain degree of accuracy.
  • equations may not be used to determine the optimal variable processing factors for different environments.
  • the optimally adjusted variable processing factors may be stored in the fourth data memory at locations determined by the corresponding acoustic environment data supplied by the sound analysis means. Prior to the commencement of operation in the first mode, the memory locations are preferably loaded with processing factors that are derived from empirical observations or prescriptive procedures for the corresponding acoustic environment parameter values. When operating in the first mode the optimally adjusted processing factor(s) may be stored in the fourth data memory at locations determined by the acoustic environment data. The optimally adjusted processing data may simply overwrite the prescribed data, or may be combined with old data written to the same location using a mathematical and/or statistical procedure.
  • the data supplied by the sound analysis means may be used to index the fourth data memory location, and the value(s) stored at the indexed memory location are preferably used to set the target value(s) of the corresponding processing factor(s) for the sound processing means.
  • the processing factor(s) applied in the sound processing means may slowly converge towards the target value(s) to avoid the possibility of undesirable acoustic effects associated with excessively rapid or instantaneous changes of the applied value(s).
  • This alternative embodiment eliminates the need for the fifth data memory location and the equations stored in the third data memory location, and hence the variation of a processing factor with the acoustic environment is not restricted by the relationships that are predefined in the equations.
  • the optimally adjusted variable processing factor(s) may be stored in the fourth data memory location and a mathematical and/or statistical procedure is used to calculate the optimal value of the processing factor(s).
  • This alternative embodiment eliminates the need for the equations stored in the third data memory location, and the storage of acoustic environment data either directly in the fifth data memory location or to index setting data in the fourth data memory location.
  • This alternative embodiment is an appropriate simplification for processing factors that do not vary with the acoustic environment, such as the maximum permissible level ofthe output of a hearing aid or cochlear implant before the output is uncomfortably loud.
  • the user can train the prosthesis to provide optimal variable processing factors for different listening criteria, such as to maximise speech intelligibility, listening comfort, or pleasantness.
  • an equation similar in form to equation 1 can comprise acoustic environment or psychoacoustic parameters that are highly correlated to a particular listening criterion, such as maximising speech intelligibility or listening comfort.
  • the variable processing factors may automatically adapt for the predicted weighted combination of listening criteria as determined by the values of the coefficients and the acoustic environment and/or psychoacoustic parameters used by the equations.
  • the user may indicate the listening criterion or combination of criteria used to determine the preferred adjustment of the variable processing factor(s) with an indicator means, or optionally the aid automatically predicts the listening criterion or combination of criteria from the values of acoustic environment and/or psychoacoustic parameters that are known to correlate with different listening criteria, and/or from the presence of signals of interest such as speech and music as detected by the prosthesis.
  • the fourth data memory location (otherwise referred to as a first data memory location in claim 76) may be divided into sections for different listening criteria, and the optimally adjusted variable processing factor(s) may be stored in a memory location(s) as determined by the listening criterion or combination of listening criteria under which they were adjusted by the user.
  • the fifth data memory location (otherwise referred to as a further data memory location in claim 77) is optionally also divided into sections for each different listening criterion for the storage of the acoustic or psychoacoustic parameter values that correspond to the values stored in the fourth data memory location.
  • the data in each section of the fourth and fifth data memory locations is preferably used to calculate the optimal coefficients of variable processing factor equations similar in form to equation 1 for each listening criterion.
  • the user can indicate the current listening criterion or combination or criteria via an indicator means or alternatively, the listening criterion or weighted combination of criteria can be predicted from the values of acoustic environment and/or psychoacoustic parameters that are known to correlate with different listening criteria and/or the presence of signals of interest such as speech and/or music, or by one or more trainable listening criteria equations that have acoustic environment or psychoacoustic parameters as their input, where the optimal coefficients of each listening criterion equation are calculated from the data stored in the corresponding sections of the fourth and fifth data memory locations.
  • the optimal variable processing factors may be calculated with equations similar in form to equation 1 for each criterion, and are combined according to the indicated or predicted weighting ofthe listening criteria.
  • the listening criterion or combination of criteria indicated by the user via an indicator means or predicted by the prosthesis may be used in addition to the corresponding acoustic environment and/or psychoacoustic parameters to index the location in the fourth data memory where the optimally adjusted variable processing factor(s) are stored.
  • the current values of acoustic environment and/or psychoacoustic parameters and the indicated and/or predicted listening criterion or combination or criteria may be used to index the fourth data memory location to retrieve the optimal variable processing factor(s) for the prevailing conditions.
  • the listening criterion or combination of criteria may not be used to index the fourth data memory location, and the processing factor value(s) stored at each location in the fourth data memory when operable in the first mode may be modified according to the weighted combination of listening criteria for the particular acoustic environment.
  • the listening criterion or combination of criteria is indicated by the user by an indicator means, such as a switch, toggle switch, or set of pushbuttons on the housing ofthe prosthesis, or alternatively on a remote unit.
  • an auditory prosthesis comprising: a microphone which receives sound and produces an output signal corresponding to the received sound; an output device that provides audio signals in a form receivable by a user ofthe prosthesis; a sound processing means operable to receive the microphone signal and carry out a processing operation on the microphone signal to produce an output signal in a form suitable to operate the output device, wherein the processing means is operable in a first mode in which the processing operation comprises at least one variable processing factor which is adjustable by a user to a setting which causes the output signal ofthe processing means to be adjusted according to the preference ofthe user for the characteristics ofthe current acoustic environment; a sound analysis means that also receives the microphone signal and outputs a data set representative ofthe acoustic environment
  • the features of the prosthesis can have the features as described above with reference to the first aspect where such features are compatible with the operation ofthe prosthesis as described therein.
  • the hearing prosthesis preferably uses the data memory means to store a record of optimal settings as determined by the user of the prosthesis for different acoustic environments. This record is then used by the data processing means to calculate coefficients of one or more equations that are used to predict the optimal setting of the processing operation of the speech processor for that user when exposed to a different acoustic environment.
  • the hearing prosthesis can be adapted to output audio signals to a single ear of the user.
  • the hearing prosthesis can be adapted to output audio signals to both ears of the user.
  • signals from the inputs of two prosthesis can be connected to the sound analysis means by wire or wirelessly.
  • the control means for the above embodiments can be located on the housing of each prosthesis, a remote unit for each prosthesis, or the control means for both prostheses can be located on a common remote unit.
  • the hearing prosthesis can be a hearing aid.
  • the output device of the hearing aid can be an earphone that receives the output signal ofthe processing means and generates amplified sounds that are delivered into the ear ofthe user.
  • the hearing prosthesis can be an implanted hearing aid device whereby the output device of the prosthesis can be a vibrating mechanism, mechanically coupled to the middle or inner ear.
  • the hearing prosthesis can be a cochlear implant.
  • the output device can comprise a receiver/stimulator unit that receives encoded stimulation data from the processing means and outputs stimulation signals that are delivered to the cochlea through an electrode array.
  • the sound processing means can comprise a speech processor that uses a coding strategy to extract speech from the sounds detected by the microphone before or after processing ofthe microphone signal according to the variable processing factors.
  • the speech processor of the cochlear implant can perform an audio spectral analysis of the acoustic signals and output channel amplitude levels. The transformation from the spectrum of the acoustic signal to electrical channel amplitude levels may be determined by a variable processing factor based on previously selected variable processing factors.
  • the threshold and discomfort channel amplitude levels can also be processing factors that are based on previous adjustments and selections made by the prosthesis user.
  • the sound processor can also sort the outputs in order of magnitude, or flag the spectral maxima as used in the SPEAK strategy developed by Cochlear Ltd.
  • the receiver/stimulator unit is preferably positioned within a housing that is implantable within the user.
  • the housing for the receiver/stimulator unit is preferably implantable within a recess in the bone behind the ear posterior to the mastoid.
  • the speech processing means is, in use, preferably mounted external to the body ofthe user such that the signals are transmitted transcutaneously through the skin ofthe user. Signals can preferably travel from the processing means to the receiver means and vice versa.
  • the receiver/stimulator unit can include a receiver coil adapted to receive radio frequency (RF) signals from a corresponding transmitter coil worn externally ofthe body.
  • the radio frequency signals can comprise frequency modulated (FM) signals. While described as a receiver coil, the receiver coil can preferably transmit signals to the transmitter coil which receives the signals.
  • the transmitter coil is preferably held in position adjacent the implanted location of the receiver coil by way of respective attractive magnets mounted centrally in, or at some other position relative to, the coils.
  • the microphone is preferably worn on the pinna of the user, however, other suitable locations can be envisaged, such as a lapel of the implantee's clothing.
  • the speech processor preferably encodes the sound detected by the microphone into a sequence of electrical stimuli following given algorithms.
  • the encoded sequence is transferred to the implanted receiver/stimulator unit using the transmitter and receiver coils.
  • the implanted receiver/stimulator unit may demodulate the FM signals and allocates the electrical pulses to the appropriate attached electrode by an algorithm which is consistent with the chosen speech coding strategy.
  • the external component housing the processing means further preferably houses a power supply.
  • the power supply can comprise one or more rechargeable batteries.
  • the transmitter and receiver coils may be used to provide power via transcutaneous induction to the implanted receiver/stimulator unit and the electrode array.
  • a method of adjusting an auditory prosthesis by a user in an acoustic environment comprising the steps of: producing a microphone signal from a microphone that corresponds to sound received by the microphone; providing audio signals, through an output device, in a form receivable by the user; carrying out a processing operation, through a sound processing means, on the microphone signal so as to produce an output signal in a form suitable to operate the output device wherein the processing means is operable in a first mode in which the processing operation comprises at least one variable processing factor which is adjustable by a user to a setting which causes the output signal ofthe sound processing means to be adjusted according to the preference of the user for the characteristics of the current acoustic environment; storing the setting in a data memory means; wherein
  • a method of adjusting an auditory prosthesis by a user in an acoustic environment comprising the steps of: producing a microphone signal from a microphone that corresponds to sound received by the microphone; providing audio signals, through an output device, in a form receivable by the user; carrying out a processing operation, through a sound processing means, on the microphone signal so as to produce an output signal in a form suitable to operate the output device wherein the processing means is operable in a first mode in which the processing operation comprises at least one variable processing factor which is adjustable by a user to a setting which causes the output signal ofthe sound processing means to be adjusted according to the preference of the user for the characteristics of the current acoustic environment; receiving the microphone signal at a sound analysis means that subsequently outputs a data set representative ofthe acoustic environment ofthe prosthesis; storing a plurality of user adjusted settings in a data memory means; analysing the stored user adjusted settings and transmitting control signals to the sound processing means; wherein, upon receiving
  • the present invention enables the user of an auditory prosthesis to adjust the operation of the processing means in a simple way while they are using the prosthesis in a normal way.
  • the invention further eventually allows the user to 'train' the prosthesis to adjust its operation automatically. This has a number of advantages including:
  • Figure 1 is a pictorial representation of a prior art cochlear implant system
  • FIG. 2 is a block diagram of one embodiment of an auditory prosthesis according to the present invention
  • Figure 3 is a flowchart setting one particular mode of operation ofthe prosthesis of Figure 2;
  • Figure 4 is a graph depicting results of experiments performed on a prototype prosthesis according to one embodiment ofthe present invention.
  • Figure 5 is a diagram representing the storage of processing factor values in a two-dimensional memory space.
  • Known cochlear implants typically consist of two main components, an external component including a speech processor 29, and an internal component including an implanted receiver and stimulator unit 22.
  • the external component includes a microphone 27.
  • the speech processor 29 is, in this illustration, constructed and arranged so that it can fit behind the outer ear 11. Alternative versions may be worn on the body. Attached to the speech processor 29 is a transmitter coil 24 that transmits electrical signals to the implanted unit 22 via a radio frequency (RF) link.
  • RF radio frequency
  • the implanted component includes a receiver coil 23 for receiving power and data from the transmitter coil 24.
  • a cable 21 extends from the implanted receiver and stimulator unit 22 to the cochlea 12 and terminates in an electrode array 20. The signals thus received are applied by the array 20 to the basilar membrane 8 and the nerve cells within the cochlea 12 thereby stimulating the auditory nerve 9.
  • the operation of such a device is described, for example, in US Patent No. 4,532,930.
  • FIG. 1 A block diagram depicting one embodiment of an auditory prosthesis according to the present invention is depicted generally as 30 in Figure 2.
  • the block diagram depicts features of both a cochlear implant and a hearing aid. Despite this, it will be appreciated that the diagram is representative only and that a prosthesis according to the present invention may not necessarily act as both a cochlear implant and hearing aid.
  • the auditory prosthesis 30 comprises a microphone 27 which receives sound and produces a microphone signal corresponding to the received sound and an output device that provides audio signals in a form receivable by a user of the prosthesis 30.
  • the output device can comprise an earphone 31 in the case where the prosthesis 30 is a hearing aid.
  • the output device comprises an encoder/transmitter unit 32 that outputs encoded data signals to the external transmitter coil 24.
  • the prosthesis 30 further has a sound processing unit 33 that is operable to receive the microphone signal provided by the microphone 27 and produce an output signal in a form suitable to operate either the earphone 31 or the encoder/transmitter unit 32.
  • the sound processor 33 will depend on whether the prosthesis 30 is a cochlear implant or a hearing aid.
  • the sound processor 33 includes at least an amplifier whereas in the case of cochlear implant the sound processor 33 will include an amplifier and a speech processor that uses a coding strategy to extract speech from the sounds detected by the microphone 27.
  • the speech processor of the cochlear implant can perform an audio spectral analysis ofthe acoustic signals and output channel amplitude levels.
  • the sound processor can also sort the outputs in order of magnitude, or flag the spectral maxima as used in the SPEAK strategy developed by Cochlear Ltd. Other coding strategies could be employed.
  • the sound processor 33 comprises at least one variable processing factor, such as amplification, which in a first mode of operation is adjustable to a setting in which the output signal of the sound processor 33 is optimised for the preference of the user in at least one acoustic environment.
  • amplification characteristics ofthe amplifier can be adjusted by a user of the prosthesis 30 to suit the surrounding background noise in a particular environment.
  • the prosthesis 30 further comprises a data memory means 34 for storing at least data indicative ofthe setting selected by the user and optionally data sets representative ofthe characteristics ofthe acoustic environment at the time the setting adjustment and selection is made.
  • the sound processor 33 when operable in a first mode recalculates the trainable coefficients after each adjustment by the user.
  • the sound processor 33 can be adapted to offer two or more possible optimal settings for selection by the user.
  • One of these settings may be the one automatically calculated by the processor and the other may be a systematic departure therefrom.
  • the user is preferably able to compare the operation of the prosthesis when operating in a particular acoustic environment when operating with each setting and then select from these the setting that is best for that particular environment.
  • the setting that is selected by the user can then be stored in the data memory means 34 optionally with data indicative ofthe particular acoustic environment. This process can be repeatable so as to allow the data processing unit 38 to gather the preferences and to monitor whether the user's preference for a particular setting changes with time or usage. In this way, the user effectively selects or votes for the best setting each time.
  • the user can alternate between settings by operating a control means 36 which can be a toggle switch or a set of pushbuttons, and select a setting by operating an indicator means which is represented by switch 35 in Figure 2.
  • the switch 35 and control means 36 can be mounted on the housing of the prosthesis 30, or while not depicted, the switch and control means could be mounted on a remote unit.
  • the processing operation of the sound processor 33 can be operable in another manner in which its operation is adjustable by the user. Rather than offering a selection of possible optimal settings for selection by the user, in this arrangement, the user is able to adjust a control means 36 that allows the user to alter the processing operation of the sound processor unit 33.
  • the user Once the user has adjusted the control means 36 to what is considered by the user an optimal setting for a particular acoustic environment, the user can operate the switch 35, leading to storage of that setting and optionally data indicative of the particular acoustic environment in the data memory means 34. Actuation ofthe switch 35 is taken by the sound processor unit 33 as indicating that the particular setting ofthe control means 36 at that time is considered optimal by the user for the particular acoustic environment in which the user finds themself.
  • the control means 36 can comprise a rotary wheel control that may be mounted on the housing ofthe prosthesis 30.
  • the switch 35 can also be mounted on the housing of the prosthesis 30. While not depicted, the switch and controller could be mounted on a remote unit.
  • the settings selected by the user as being optimal to that user for a plurality of acoustic environments are stored in the data memory means 34 optionally with data indicative of those particular acoustic environments.
  • the sound processor 33 continuously operates in the second mode, and can simultaneously be operable in the first mode for a defined period of time or can be considered as operating in that mode every time the user adjusts the control means 36 and selects what is considered a new optimal setting for that particular environment.
  • the training period can be as long as the user wishes or optionally, the prosthesis 30 can signal to the user when the training period is complete. In this case, the prosthesis 30 can be adapted to indicate the training period is complete once there has been a particular pre-defined number of instances in which the user has been unable to select a setting that is substantially different from the setting already estimated by the prosthesis to be optimal.
  • the prosthesis 30 further comprises a sound analysis module 37.
  • the sound analysis module 37 receives input signals from the microphone 27 and monitors the acoustic environment of the prosthesis user.
  • the sound analysis module provides output(s) representative ofthe type ofthe acoustic environment being monitored at that time.
  • the data memory means 34 comprises five data memory locations.
  • the first data memory means 34a contains the audiometric data ofthe prosthesis user and/or individual data for one or more loudness models used by the prosthesis 30.
  • the second data memory location 34b contains characteristic data about the hearing prosthesis 30.
  • the third data memory location 34c comprises one or more equations used to predict the optimal processing operation of the sound processor unit 33 for an individual user in different acoustic environments.
  • the fourth data memory location 34d stores the optimal sound processing data as selected by the user.
  • the acoustic environment data that corresponds to the optimal sound processing data stored in the fourth data memory location is optionally stored in the fifth data memory location 34e.
  • the fourth data memory location 34d stores a predefined maximum number of 400 sets of optimal sound processing data. Other maximum numbers can, however, be envisaged.
  • the depicted embodiment uses a data processing unit 38, that is described in more detail below.
  • the unit 38 does not utilise all stored data sets but only a predefined number of most recently logged data sets. In this case, the data processing unit 38 only utilises the last 256 data sets when calculating the optimal equation coefficients.
  • older data cannot be overwritten such that once the memory location is full no further data sets can be logged by the prosthesis.
  • rules are used to determine the old data that is overwritten by the newest data set, based on the worth of each old data set according to predetermined criteria.
  • the prosthesis further comprises a data processing unit 38.
  • the data processing unit 38 receives the output of the sound analysis module 37. Based on the output of the sound analysis module 37, the data processing unit 38 may be adapted to calculate the loudness of sounds present at the microphone 27. In the depicted embodiment, the data processing unit 38 may calculate the loudness of the sounds as they would appear to a person with normal hearing and/or to a person with a degree of hearing impairment. The data processing unit 38 can be adapted to calculate other acoustic and psychoacoustic measures of the sounds present at the microphone 27.
  • the data processing unit 38 can use the measures of the acoustic conditions as inputs to the one or more equations stored in the third data memory location 34c which estimate the optimal sound processing operation ofthe sound processor 33 for the user in the acoustic environments determined by the sound analysis module 37.
  • the data processing unit 38 further uses the hearing prosthesis characteristic data stored in the second data memory location 34b and the optimal sound processor data generated by the equations to automatically and continuously determine the appropriate setting of the sound processor 33 to provide the optimal output signal for the user in the current acoustic environment being experienced by the user.
  • the sound processor 33 includes an amplifier means and a control means 36. At all times the data processing unit 38 operates in the second mode, where it automatically calculates the operation ofthe sound processor 33 that is most likely to provide the optimal amplification characteristics in any environment, as represented by the output of sound analysis unit 37.
  • the prosthesis can also simultaneously operate in the first mode, where operation of the amplifier means is also adjustable by the user varying control 36 to allow the user to optimise the amplification characteristics in the current acoustic environment.
  • the desired gain ofthe amplifier is calculated through use of an equation having a pre-defined form.
  • the equation is:
  • G-, a; +b; * max(Li,c + d ; * (SNRi-SM ) (1)
  • the following training data is stored for each band i: the sound pressure level or SPL, Lj, in dB SPL; the signal-to-noise ratio in band i minus the average for all bands, that is SNRi- SNRav, in dB; and the preferred gain Gi also in dB.
  • Each of the above values are calculated based on the signal at the microphone 27 for a period of time that precedes the actual vote. The values may be calculated based on the signal at the microphone 27 for a time preceding the vote and for a time after the vote has been cast.
  • the stored L is the average or RMS value ofthe SPL over the predetermined period of time and the stored Gi is the average value ofthe gain over a predetermined period of time prior to the actuation ofthe voting button plus the user's preferred gain adjustment at the time of actuation of the voting button.
  • the SNR in band i is currently calculated at the SPL at the microphone exceeded 10% ofthe time in band i minus the SPL at the microphone exceeded 90% of the time in band i over the predetermined period of time prior to the vote. This difference may be more accurately described as an estimate of the modulation depth of the signal. It is envisaged that a more accurate SNR or even speech-to-noise ratio estimation techniques may be employed.
  • the stored training data from many votes is used to form a set of simultaneous equations (1).
  • the set of simultaneous equations is sold as a set of linear equations, however since coefficient bi and coefficient Ci are potentially multiplied by each other, that is not linear, the simultaneous equations are initially linearised.
  • the value of Ci is set to a predefined value, and the MAX [L;, Ci] operation performed with this value of Ci and the stored L; values in order to set the bracketed term, in other words the greater of Lj and Ci the result of which is L';.
  • the optimal values of a;, b; and d are calculated with a direct numerical method wherein the optimal coefficient values are the ones that give the least squared error between the stored G; values and G, values that are calculated with the corresponding L'i and stored SNR; - SNR a v values.
  • This is repeated for at least four alternative values of c; 3 for example 35, 45, 55 and 65 dB SPL, and the set of coefficients that gives the least squared error is selected as the optimal set and applied to the processing of the signal, unless the value of b; is outside the range of -1.0 to +1.0, or if less than fifty votes have occurred.
  • Other versions may apply the trained coefficients after more or less than fifty votes.
  • b is a vector that contains the stored Gj values.
  • the LU decomposition method operates on these matrices and solves vector x. Other variants of Gaussian elimination or other direct numerical methods can be used in other applications.
  • the training data from four votes may result in the set of simultaneous equations as follows:
  • equations with other acoustic or psychoacoustic parameters can calculate the gain or processing factors other than gain, such as the speed at which the prosthesis reacts to change in the acoustic environment, the choice of the equations used will depend upon the particular application desired, with such applications falling within the scope ofthe present invention.
  • trainable coefficients include a, b, c and d, which as a result leads to the amplifier gain G being a variable processing factor.
  • More than one processing factor ofthe sound processor 33 can be automatically calculated using equations similar to equation 1, and then further adjusted by the user using the control means 36 or multiple control means.
  • the control means 36 can allow the user to adjust one or more of the following operations of the sound processor 33: (i) the volume ofthe output signal;
  • the gain of the output signal at particular frequencies relative to other frequencies for example the mid frequency gain can be boosted or attenuated with respect to the low or high band frequencies ofthe output signal; and (iii) a slope control where the low and high frequency band gains are adjusted in opposing directions while the mid band gain is unchanged.
  • the user can select which setting of the control means 36 is the optimal one for the particular acoustic environment that they are in by actuating the switch 35.
  • the gain in each frequency band is logged along with a data set indicative of the acoustic environment detected by the microphone 27.
  • This data can be used with previous sets of data by the data processing unit 38 to calculate the gain equation coefficients that enable the equations to best predict the preferences of the user from the logged training data in each band. Because the data processing unit 38 has access to the preferred amplification characteristics and the acoustic environments in which they were preferred, the data processing unit 38 can calculate general relationships between the amplification characteristics and the measured aspects of the acoustic environment.
  • the automatically calculated amplification characteristics can thus vary in a complex but defined manner as the acoustic environment changes. For example, in the current embodiment, gain at each frequency varies with the overall input level and the signal-to-noise ratio at said frequency relative to the signal-to-noise ratio at other frequencies.
  • the depicted data processing unit 38 does not calculate optimal gain equation coefficients until a predetermined number of selections have been made by the user.
  • the prosthesis 30 is adapted to not calculate optimal gain equation coefficients until at least fifty selections have been made by the user.
  • the sound processor 33 will preferably output a signal calculated on the basis of the initial, pre- defined values of trainable coefficients. These initial, pre-defined values are calculated for each user by conventional methods of prescribing prosthesis operation, or by an empirical, trial and error adjustment process.
  • the data processing unit 38 re-calculates the trainable coefficients immediately after every occasion on which the user operates the switch 35 to indicate that the control 36 is in the optimal position. In another embodiment, the data processing unit 38 does not wait until a predetermined number of selections have been made by the user to re-calculate the trainable coefficients, but does not apply these coefficients until the equations can accurately predict the preferences of the aid user with the trained coefficients, and/or the user has made selections in a preferred minimum range of acoustic environments.
  • the data processing unit 38 does not use the equations stored in the third data memory location 34c to determine the optimal variable processing factors for different environments.
  • the optimally adjusted variable processing factors are stored in the fourth data memory location 34d at locations determined by the corresponding acoustic environment data supplied by the sound analysis means 37.
  • the fourth data memory locations 34d Prior to the commencement of operation in the first mode, the fourth data memory locations 34d are loaded with processing factors that are derived from empirical observations or prescriptive procedures for the corresponding acoustic environment parameter values.
  • the optimally adjusted processing factor(s) are stored in the fourth data memory 34d at locations determined by the acoustic environment data supplied by the sound analysis means 37.
  • the fourth data memory location 34d can store a multi-dimensional (or N- dimensional) look-up table or matrix, where each dimension is a different acoustic environment or psychoacoustic parameter, and the parameter values determine the location in the table, matrix, or memory location 34d where the preferred processing factor(s) is stored.
  • the matrix is indexed by rounded values of the N acoustic environment parameters (or optionally the estimated psychoacoustic parameters such as loudness).
  • the optimally adjusted processing data may simply overwrite the prescribed data in the fourth data memory 34d, or may be combined with old data written to the same location using a mathematical and/or statistical procedure.
  • the acoustic environment and psychoacoustic parameter values supplied by the sound analysis means 37 are used to index the table or matrix or fourth data memory location 34d, and the value(s) stored at the indexed location are used to set the target value(s) of the corresponding processing factor(s) for the sound processing means 33.
  • the processing factor(s) applied in the sound processing means 33 may slowly converge towards the target value(s) to avoid the possibility of undesirable acoustic effects associated with excessively rapid or instantaneous changes of the applied value(s).
  • the target value can be adjusted to represent the trend of user-adjusted values for environments located near the current environment in the memory location 34d.
  • the hearing prosthesis can be adapted to output audio signals to a single ear of the user. In another embodiment, the hearing prosthesis can be adapted to output audio signals to both ears ofthe user.
  • the trainable hearing prosthesis can be adapted to accept microphone signals from microphones mounted on each side of the head, and then to output signal to either or both ears.
  • FIG. 3 is a flowchart of the logic behind the operation of the data processing unit 38.
  • the Start of the flowchart is when the prosthesis 30 is turned on and power is supplied to the parts thereof including the sound processor 33 and data processing unit 38.
  • the end point ofthe flowchart is when the user turns the prosthesis 30 off or if the battery for the power source goes flat. While not depicted, it is possible that another end point could be defined as when a certain number of votes are reached, or if the user stops training the prosthesis 30 for a predetermined period of time, or if the prosthesis 30 determines from the user adjustments of the control means 36 that it is sufficiently well-trained. Still further, an audiologist or other third party could disable further training of the prosthesis when the user is satisfied with the performance of the prosthesis 30 in a range of different acoustic environments.
  • the user can train the prosthesis at any time, so that training does not need to be re- enabled if the user encounters a new environment or if the hearing loss profile of the user changes over time or with slow acclimatisation to the prosthesis.
  • Figure 4 is a graph of the results of preliminary experiments performed on a prototype prosthesis according to the present invention. In the experiments, the goal was to train the prosthesis to produce a greater gain than provided by the prosthesis prior to the training in all frequency bands for any input sound. Figure 4 indicates how the necessity to adjust the control 36 (RMS control adjustment in dB) following groups of 15 votes to get the desired output decreased due to the "training" ability of the prosthesis.
  • Figure 5 is an illustration of the matrix previously referred to using acoustic parameters of equation 1.
  • Figure 5 is a diagram representing the storage of processing factor values in a two-dimensional memory space that is indexed by the values of two acoustic parameters, the sound pressure level for band i and the signal-to-noise ratio for band i relative to the average for all bands, although this does not exclude the use of a greater number of dimensions from the scope of this invention, and the values shown are illustrative only.
  • the numbers in the memory locations represent gain values, where gain is a variable processing factor.
  • the stored values are prescribed values, except the bold italic values which represent data that differs from the initial prescribed data due to the storage of user-preferred setting data as a result of training by the user.

Abstract

An auditory prosthesis (30) comprising a microphone (27) for receiving the sound and producing a microphone signal corresponding to the received sound, an output device for providing audio signals in a form receivable by a user of the prosthesis (30), a sound processing unit (33) operable to receive the microphone signal and carry out a processing operation on the microphone signal to produce an output signal in a form suitable to operate the output device, wherein the sound processing unit (33) is operable in a first mode in which the processing operation comprises at least one variable processing factor which is adjustable by a user to a setting which causes the output signal of the sound processing unit (33) to be adjusted according to the preference of the user for the characteristics of the current acoustic environment.

Description

Programmable Auditory Prosthesis with Trainable Automatic Adaptation to Acoustic Conditions
Technical Field
The present invention relates to a programmable auditory prosthesis, such as a hearing aid or cochlear implant. In particular, the invention is an auditory prosthesis that adjusts its sound processing characteristics in a particular acoustic environment in a manner that is similar or identical to that previously determined by the user of the prosthesis as optimal for that environment.
Background Art
Hearing loss, which may be due to many different causes, is generally of two types, conductive and sensorineural. Of these types, conductive hearing loss occurs where the normal mechanical pathways for sound to reach the hair cells in the cochlea are impeded, for example, by damage to the ossicles. Conductive hearing loss may often be helped by use of conventional hearing aid systems, which comprise a microphone, an amplifier and a receiver (miniature speaker) for amplifying detected sounds so that acoustic information does reach the cochlea and the hair cells. Since the elevation ofthe minimum detectable sound pressure level may vary with the frequency of an acoustic test stimulus, the amplifier may be preceded by, or comprise of, a bank of filters to enable different frequency components of the signal to be amplified by different amounts.
Sensorineural hearing loss occurs where the hair cells in the cochlea and the attached auditory nerve fibres are damaged or destroyed. Sensorineural hearing loss results in an increase in the minimum detectable sound pressure level, which often varies with the frequency of the test stimulus. However, in contrast to conductive hearing loss, the sound pressure level that is uncomfortably loud at a given test frequency is often approximately the same as for people with normal hearing. The result is a reduction in the dynamic range of sound pressure levels that are audible yet not uncomfortably loud with the impaired ear, and this dynamic range of the impaired ear may vary considerably with the frequency of the acoustic test stimulus. For this reason, sensorineural hearing loss is often treated with hearing aid systems that employ non-linear amplification to compress the dynamic range of common sounds towards the dynamic range ofthe impaired ear. Such systems may use a filter bank that is followed by a bank of compressive amplifiers, so that the dynamic range of the signal is reduced by an amount that is considered appropriate for the dynamic range ofthe impaired ear in each band.
In many people who are profoundly deaf, the reason for deafness is absence of, or destruction of, the hair cells in the cochlea which transduce acoustic signals into nerve impulses. These people are thus unable to derive suitable benefit from hearing aid systems, no matter how much the acoustic stimulus is amplified, because there is damage to or absence ofthe mechanism for nerve impulses to be generated from sound in the normal manner. It is for this purpose that cochlear implant systems have been developed. Such systems bypass the hair cells in the cochlea and directly deliver electrical stimulation to the auditory nerve fibres, thereby allowing the brain to perceive a hearing sensation resembling the natural hearing sensation normally delivered to the auditory nerve. US Patent 4,532,930, the contents of which are incorporated herein by reference, provides a description of one type of traditional cochlear implant system.
Cochlear implant systems have typically consisted of two essential components, an external component commonly referred to as a processor unit and an internal implanted component commonly referred to as a stimulator/receiver unit.
Traditionally, both of these components have cooperated together to provide the sound sensation to a user.
The external component has traditionally consisted of a microphone for detecting sounds, such as speech and environmental sounds, a speech processor that converts the detected sounds, particularly speech, into a coded signal, a power source such as a battery, and an external transmitter coil.
The coded signal output by the speech processor is transmitted transcutaneously to the implanted stimulator/receiver unit situated within a recess of the temporal bone of the user. This transcutaneous transmission occurs via the external transmitter coil which is. positioned to communicate with an implanted receiver coil provided with the stimulator/receiver unit. This communication serves two essential purposes, firstly to transcutaneously transmit the coded sound signal and secondly to provide power to the implanted stimulator/receiver unit. Conventionally, this link has been in the form of an RF link, but other such links have been proposed and implemented with varying degrees of success.
The implanted stimulator/receiver unit traditionally includes a receiver coil that receives the coded signal and power from the external processor component, and a stimulator that processes the coded signal and outputs a stimulation signal to an intracochlea electrode assembly which applies the electrical stimulation directly to the auditory nerve producing a hearing sensation corresponding to the original detected sound.
Different users of auditory prostheses require differing outputs from their prosthesis to suit their individual requirements. This is the case even when individual users may clinically be regarded as having identical hearing loss profiles, are utilising identical prostheses, and when exposed to essentially identical acoustic environments. Because of this, sound processing schemes for hearing aids and cochlear implants typically contain a number of parameters for which the values can be adjusted to suit the requirements of individual users. Examples of such parameters include the sensitivity to incoming sounds and the variation of the frequency response. Typically, the parameter values are selected either by the prosthesis user in everyday situations (eg. the sensitivity (volume), frequency response), or by the clinician at the time the prosthesis is fitted (eg. the baseline frequency response and the rate at which the frequency response and sensitivity vary as the input level varies).
In more recent times, there has been a trend to provide auditory prostheses with an increasing number of adjustable parameters that can or must be adjusted to optimise performance. This increase has, however, highlighted the problem that there does not always exist a reliable prescriptive method for selecting the optimum values for the individual user, particularly as some optimum values may vary among individuals who have hearing loss profiles that may clinically be regarded as identical. It is accordingly often necessary for the clinician to make adjustments to the prosthesis based on the user's reported experiences away from the clinic, and the need to return to the clinic for these adjustments can be time consuming and inefficient.
One example of a hearing aid that can receive the impressions of a hearing aid user and take these into consideration during operation is described in US Patent
5604812. This document describes a hearing aid that has a memory that can store so- called "unsharp inputs", or impressions of the hearing aid wearer about prevailing ambient conditions and/or the volume of the output of the hearing aid, prescribable algorithms, hearing loss data and hearing aid characteristic data. A fuzzy logic module uses this data and control signals from an input signal analysis unit to calculate the output setting parameters for the hearing aid. The behaviour rules of the fuzzy logic module and/or the prescribable algorithms are calculated from the data stored in the aid's memory by a neural network, with the neural network being typically implemented on a personal computer that is connected to the aid.. A problem with such an aid is the complexity ofthe processing scheme and an undesirably large drain on the aid's power source, typically an on-board battery. Further to this, such an aid would require a large amount of clinical time to correctly "train", as the user does not have direct control over what is optimal, and "unsharp inputs" are used in the training of the aid rather than precise and direct inputs.
Another example of a hearing aid that can receive the preferences of a hearing aid user and take these into consideration is described in US Patent 6035050. Such an aid requires the user to identify their current listening environment by selecting one of a limited number of listening situations on a remote unit. Should the user find that their current listening situation does not readily fall within those provided for selection, the benefit of such a aid becomes greatly reduced. Further to this, some listening situations on the remote unit, such as "at work", may consist of a range of different acoustic environments and hence may not be acoustically well-defined. Thus, a neural network may not be able to reliably recognise such listening situations from an analysis of the microphone signal that, due to practical considerations such as memory limitations and the desirability of fast recognition of a change in listening situation, must be limited to a period of seconds or a few minutes. Therefore, after training it is possible that the neural network may misclassify a listening situation, especially in situations that are not acoustically well-defined, which can result in the application of amplification parameters that are unsuitable for the current listening situation. In such a device focus is placed on attempting to categorise specific acoustic environments, rather than measure the parameters of the environment and use these parameters directly in the processing scheme, as is the case with the present invention. Another disadvantage of this device is that a major lifestyle change, such as a new workplace that is acoustically different to the previous workplace, may require different amplification parameters and hence a return visit to the clinic. Another example of a hearing aid that can receive the preferences of a hearing aid user and take these into consideration is described in US Patent 6044163. This document describes a hearing aid that is similar to the hearing aid described in US patent 6035050. A major difference is that the neural network is not restricted to selection of sets of amplification parameters that are stored in a memory, but may directly set the value of individual amplification parameters. The disadvantages of the hearing aid described in this patent are similar to those of the hearing aid described in US patent 6035050.
The present invention is adapted to providing users with an auditory prosthesis that is adaptable and can adjust its output to the user when that user is exposed to varying ambient acoustic environments.
Further, the present invention is adapted to providing users with an auditory prosthesis that can be 'trained' by the individual user to adapt its output to the user's preference in listening conditions encountered away from a traditional clinical situation, thereby reducing the clinical time required to fit an optimise a prosthesis to the individual user.
Any discussion of documents, acts, materials, devices, articles or the like which has been included in the present specification is solely for the purpose of providing a context for the present invention. It is not to be taken as an admission that any or all of these matters form part ofthe prior art base or were common general knowledge in the field relevant to the present invention as it existed before the priority date of each claim of this application.
Summary of the Invention
According to a first aspect, the present invention provides an auditory prosthesis comprising: a microphone which receives sound and produces a microphone signal corresponding to the received sound; an output device that provides audio signals in a form receivable by a user ofthe prosthesis; a sound processing means operable to receive the microphone signal and carry out a processing operation on the microphone signal to produce an output signal in a form suitable to operate the output device, wherein the processing means is operable in a first mode in which the processing operation comprises at least one variable processing factor which is adjustable by a user to a setting which causes the output signal ofthe processing means to be adjusted according to the preference ofthe user for the characteristics ofthe current acoustic environment; a data memory means for storing said setting; and wherein the sound processing means is simultaneously operable in a second mode in which said at least one variable processing factor is automatically adjusted on the basis ofthe previously adjusted variable processing factor selected by the user.
In this invention, it will be appreciated that what is considered an optimal output signal by one user may not be considered an optimal signal by another user. The present invention ensures that the prosthesis operates in a manner that suits the requirements of the user for the acoustic environments that the user encounters rather than in some manner predetermined from clinical tests which may not replicate the type of acoustic environments to which the user is routinely or occasionally exposed, and which may not necessarily replicate the subjective reactions of users when in those environments.
Preferably, the data memory means stores data sets representative of the characteristics of at least one acoustic environment. Preferably the at least one variable processing factor is automatically adjusted on the basis ofthe acoustic environments in which at least one variable processing factor was selected.
In a first embodiment, the processing means may be adapted when operable in the first mode to offer two or more possible optimal settings of the variable processing factor for selection by the user. In this case, the user is preferably able to compare the operation of the prosthesis when operating in a particular acoustic environment when operating with each setting and then select from these the setting that is best for that particular environment. The setting ofthe variable processing factor that is selected by the user may then be stored in the data memory means, optionally with data indicative of the characteristics of the particular acoustic environment. This process may be repeatable so as to allow the processing means to monitor whether the user's preference for a particular setting of the variable processing factor changes with time or usage. In this way, the user effectively selects or votes for the best setting each time. By repeating the process, the number of selections or votes made by the user for each setting may be monitored to allow the prosthesis to select the optimal setting of the variable processing factor or optionally, the optimal setting of the variable processing factor for a particular environment.
In this embodiment, the user may alternate between listening with the offered settings by operating a control means, and can select or vote for a setting ofthe variable processing factor(s) by operating an indicator means. In one embodiment, the control means may comprise a switch or set of buttons that is actuable by the user, and the indicator means may comprise a switch or button that is actuable by the user.
In another embodiment, the processing operation of the processing means may be adjustable by the user when the processing means is in the first mode of operation. Rather than offering a discrete selection of possible optimal settings for selection by the user, in this embodiment, the user is able to adjust a control means throughout a substantially continuous range that allows the user to alter the variable processing factor(s) throughout a range of values, and thus alter the processing operation of the processing means. Once the user has adjusted the control means to a setting in the substantially continuous range that is considered by the user an optimal setting for a particular acoustic environment, the user may operate an indicator means, such as a switch or button, leading to storage of that setting and optionally, data indicative ofthe particular acoustic environment in the data memory means. Actuation of this indicator means may be taken by the processing means as indicating that the particular setting of the control means at that time is considered optimal by the user for the particular acoustic environment in which the user finds themself.
In this embodiment, the control means may comprise a rotary wheel control. The rotary wheel control may be mounted on the housing of the prosthesis or alternatively, may be mounted on a remote unit. The control means could also be in the form of a toggle switch or press buttons.
In the above embodiments, the indicator means may be mounted on a housing of the prosthesis. In another embodiment, the indicator means may be mounted on a remote unit.
In a preferred embodiment, the settings selected by the user as being optimal to that user for a plurality of acoustic environments may be stored in the data memory means and optionally, with data indicative of the characteristics of those particular acoustic environments. The processing means operates in the second mode, and may simultaneously be operable in the first mode for a defined period of time or can be considered as operating in the first mode every time the user adjusts the control means and selects what is considered a new optimal setting for that particular environment. In another embodiment, the prosthesis may have a defined training period in which the prosthesis may be operable in the first mode of operation. This period may be as long as the user wishes or optionally, the prosthesis may signal to the user when the training period is complete. In this case, the prosthesis may be adapted to indicate the training period is complete once there has been a particular pre-defined number of instances in which the user has not selected a setting which is substantially different to the setting already estimated by the prosthesis to be optimal.
In a preferred embodiment, the prosthesis may further comprise a sound analysis means. The sound analysis means preferably receives input signals from the microphone and monitors the acoustic environment of the prosthesis user. The sound analysis means preferably provides an output representative of the acoustic environment being monitored at that time.
In a further embodiment, the data memory means may comprise one or more data memory locations. In one embodiment, the data memory means may comprise five data memory locations. In this embodiment, the first data memory location may contain the audiometric data of the prosthesis user and/or individual data for one or more loudness models used by the prosthesis. The second data memory location may contain characteristic data about the hearing prosthesis. The third data memory location may comprise one or more equations used to predict the optimal processing operation of the processing means for an individual user in different acoustic environments. The fourth data memory location may store the optimal sound processing data as selected by the user of the prosthesis. This data may be ordered in different ways, such as sequentially or indexed according to the corresponding acoustic environment data supplied by the sound analysis means. The acoustic environment data that corresponds to the optimal sound processing data is optionally stored in the fifth data memory location. Other data memory means having differing numbers of memory locations may be envisaged. In one embodiment, the fourth data memory location may store a predefined maximum number of sets of optimal sound processing data. In one embodiment, the memory location may store a maximum of 400 data sets. Other maximum numbers can, however, be envisaged. In one embodiment, the data processing means does not utilise all stored data sets but only a predefined number of most recently logged data sets. For example, the data processing means may only utilise the last 256 data sets when determining the optimal value of a variable processing factor. In one embodiment, the newest data set to be stored in the memory location can be stored instead of the oldest data set in the memory location. This first in first out storage system ensures only the most recently logged data is ever stored in the prosthesis at any one time. In another embodiment, older data cannot be overwritten such that once the memory location is full no further data sets can be logged by the prosthesis. In another embodiment, old data is preferably selectively overwritten by the newest sound processing data according to the acoustic environment in which the sound processing data was selected.
In a further embodiment, the prosthesis preferably further comprises a data processing means. The data processing means preferably receives the output of the sound analysis means. Based on the output of the sound analysis means, the data processing means can be adapted to calculate the loudness of sounds present at the microphone. In one embodiment, the data processing means can calculate the loudness ofthe sounds as they would appear to a person with normal hearing and/or to a person with a degree of hearing impairment. The data processing means can be adapted to calculate other acoustic and psychoacoustic measures of the sounds present at the microphone. The data processing means can use the acoustic and/or psychoacoustic measures as inputs to the one or more equations stored in the third data memory location which estimate the optimal sound processing operation ofthe sound processing means for the user in the acoustic environments represented by the sound analysis means.
The data processing means further preferably uses the hearing prosthesis characteristic data stored in the second data memory location and the optimal sound processor data generated by the equations to automatically and continuously determine the appropriate setting ofthe processing means to provide the optimal output signal for the user in the current acoustic environment being experienced by the user. In a preferred embodiment, the processing means can include an amplifier means and a gain control means. In this case, the operation of the amplifier means is preferably adjustable when in the first mode to allow the user to optimise the gain at each or every frequency of the amplifier in a particular acoustic environment. Once optimised, the prosthesis operates in a second mode in which the amplification characteristics of the amplifier means automatically adjusts to the optimal level. That is, in such embodiments the variable processing factor is preferably the amplifier gain at each or every frequency.
In a preferred embodiment of the above aspects, the gain at each or every frequency ofthe amplifier means is calculated through use of an equation having a predefined form. In one form the equation can be:
Gi = a; +bi * max(Li,c + d; * (SNRi-SNRav) (1)
where i = the frequency band number;
G; = gain for band i; a, = trainable coefficient for band i; bi = trainable coefficient for band i; c; = trainable coefficient for band i; di = trainable coefficient for band i; L; = sound pressure level at the microphone in band i; SNRj = signal to noise ratio in band i; and SNRav = average SNR in all bands.
Other forms of the equation with other acoustic or psychoacoustic parameters, such as higher-order moments of the spectrum of the signal and variations of these moments with time, or other statistical parameters or estimates ofthe acoustic signal or combinations of these parameters, and optionally with other additional coefficients, can calculate the gain or processing factors other than gain, such as the speed at which the prosthesis reacts to change in the acoustic environment, the choice of the equations used will depend upon the particular application desired, with such applications falling within the scope ofthe present invention.
In the above embodiment, trainable coefficients include a, b, c and d, which as a result leads to the amplifier gain G being a variable processing factor. Thus, in embodiments ofthe invention, more than one variable processing factor of the processing means can be adjustable by the user using the control means or multiple control means. Similarly, more than one variable processing factor of the processing means can be automatically adjusted as appropriate to any acoustic environment. In this embodiment, the control means or multiple control means can allow the user to adjust one or more of the following example operations of the processor means:
(i) the volume ofthe output signal; (ii) the gain of the output signal at particular frequencies relative to other frequencies, for example the mid frequency gain can be boosted or attenuated with respect to the low or high band frequencies ofthe output signal; and
(iii) a slope control where the low and high frequency band gains are adjusted in opposing directions while the mid band gain is unchanged.
In this embodiment, for each of the operations of the processor means the user can select a setting which is optimal for each variable processing factor for the particular acoustic environment that they are in by actuating the indicator means. On multiple operations ofthe sound processor means the user may select a setting which is optimal for one or more variable processing factors for the acoustic environment that the user experiences by actuating the indicator means. Thus, more than one operation of the sound processor means, as well as more than one variable processing factor, can be adjusted in combination for each vote or selection. Each time the indicator means is actuated, the gain in each frequency band is preferably recorded along with a data set indicative of the acoustic environment detected by the microphone. This data can be used with previous sets of data by the data processing means to calculate the gain equation coefficients that best match the logged training data in each band. The recorded gain in each frequency band may be used to calculate the gain equation coefficients.
In a further embodiment, when operating in the first mode the data processing means preferably does -not calculate optimal gain equation coefficients until a predetermined number of selections have been made by the user. In one embodiment, the prosthesis can be adapted to not calculate optimal gain equation coefficients until at least fifty selections have been made by the user. In this case, where the predetermined number of selections have not been made, the processing means may when operating in the second mode preferably automatically calculate the output appropriate to the current environment, based on predetermined coefficients and/or variable processing factors. Once the predetermined number of selections have been made, the processing means may calculate the optimal gain equation coefficients on the basis of previous user preferences when in the first mode of operation, and automatically and continuously calculate the variable processing factors with these equations when in the second mode of operation. In another embodiment, the data processing means preferably does not wait for a predetermined number of selections to be made by the user before calculating the optimal gain equation coefficients, but preferably does not use the calculated coefficients when in the second mode of operation until the variable processing factors that are preferred by the user can be predicted with the equations and calculated coefficients with a certain degree of accuracy.
In an alternative embodiment, equations may not be used to determine the optimal variable processing factors for different environments. The optimally adjusted variable processing factors may be stored in the fourth data memory at locations determined by the corresponding acoustic environment data supplied by the sound analysis means. Prior to the commencement of operation in the first mode, the memory locations are preferably loaded with processing factors that are derived from empirical observations or prescriptive procedures for the corresponding acoustic environment parameter values. When operating in the first mode the optimally adjusted processing factor(s) may be stored in the fourth data memory at locations determined by the acoustic environment data. The optimally adjusted processing data may simply overwrite the prescribed data, or may be combined with old data written to the same location using a mathematical and/or statistical procedure. When operating in the second mode, the data supplied by the sound analysis means may be used to index the fourth data memory location, and the value(s) stored at the indexed memory location are preferably used to set the target value(s) of the corresponding processing factor(s) for the sound processing means. The processing factor(s) applied in the sound processing means may slowly converge towards the target value(s) to avoid the possibility of undesirable acoustic effects associated with excessively rapid or instantaneous changes of the applied value(s). This alternative embodiment eliminates the need for the fifth data memory location and the equations stored in the third data memory location, and hence the variation of a processing factor with the acoustic environment is not restricted by the relationships that are predefined in the equations. In another alternative embodiment, the optimally adjusted variable processing factor(s) may be stored in the fourth data memory location and a mathematical and/or statistical procedure is used to calculate the optimal value of the processing factor(s). This alternative embodiment eliminates the need for the equations stored in the third data memory location, and the storage of acoustic environment data either directly in the fifth data memory location or to index setting data in the fourth data memory location. This alternative embodiment is an appropriate simplification for processing factors that do not vary with the acoustic environment, such as the maximum permissible level ofthe output of a hearing aid or cochlear implant before the output is uncomfortably loud.
In a further embodiment, the user can train the prosthesis to provide optimal variable processing factors for different listening criteria, such as to maximise speech intelligibility, listening comfort, or pleasantness. In one embodiment, an equation similar in form to equation 1 can comprise acoustic environment or psychoacoustic parameters that are highly correlated to a particular listening criterion, such as maximising speech intelligibility or listening comfort. When operable in the second mode the variable processing factors may automatically adapt for the predicted weighted combination of listening criteria as determined by the values of the coefficients and the acoustic environment and/or psychoacoustic parameters used by the equations.
In another embodiment, while operable in the first mode the user may indicate the listening criterion or combination of criteria used to determine the preferred adjustment of the variable processing factor(s) with an indicator means, or optionally the aid automatically predicts the listening criterion or combination of criteria from the values of acoustic environment and/or psychoacoustic parameters that are known to correlate with different listening criteria, and/or from the presence of signals of interest such as speech and music as detected by the prosthesis. The fourth data memory location (otherwise referred to as a first data memory location in claim 76) may be divided into sections for different listening criteria, and the optimally adjusted variable processing factor(s) may be stored in a memory location(s) as determined by the listening criterion or combination of listening criteria under which they were adjusted by the user. The fifth data memory location (otherwise referred to as a further data memory location in claim 77) is optionally also divided into sections for each different listening criterion for the storage of the acoustic or psychoacoustic parameter values that correspond to the values stored in the fourth data memory location. With this structure, the data in each section of the fourth and fifth data memory locations is preferably used to calculate the optimal coefficients of variable processing factor equations similar in form to equation 1 for each listening criterion. When operable in the second mode, the user can indicate the current listening criterion or combination or criteria via an indicator means or alternatively, the listening criterion or weighted combination of criteria can be predicted from the values of acoustic environment and/or psychoacoustic parameters that are known to correlate with different listening criteria and/or the presence of signals of interest such as speech and/or music, or by one or more trainable listening criteria equations that have acoustic environment or psychoacoustic parameters as their input, where the optimal coefficients of each listening criterion equation are calculated from the data stored in the corresponding sections of the fourth and fifth data memory locations. Once the listening criterion or weighted combination of listening criteria are either indicated by the user or automatically predicted by the prosthesis, the optimal variable processing factors may be calculated with equations similar in form to equation 1 for each criterion, and are combined according to the indicated or predicted weighting ofthe listening criteria.
In an alternative embodiment, when operable in the first mode the listening criterion or combination of criteria indicated by the user via an indicator means or predicted by the prosthesis may be used in addition to the corresponding acoustic environment and/or psychoacoustic parameters to index the location in the fourth data memory where the optimally adjusted variable processing factor(s) are stored. When operable in the second mode, the current values of acoustic environment and/or psychoacoustic parameters and the indicated and/or predicted listening criterion or combination or criteria may be used to index the fourth data memory location to retrieve the optimal variable processing factor(s) for the prevailing conditions. In another embodiment, the listening criterion or combination of criteria may not be used to index the fourth data memory location, and the processing factor value(s) stored at each location in the fourth data memory when operable in the first mode may be modified according to the weighted combination of listening criteria for the particular acoustic environment.
In the above embodiments, the listening criterion or combination of criteria is indicated by the user by an indicator means, such as a switch, toggle switch, or set of pushbuttons on the housing ofthe prosthesis, or alternatively on a remote unit. According to a second aspect, the present invention provides an auditory prosthesis comprising: a microphone which receives sound and produces an output signal corresponding to the received sound; an output device that provides audio signals in a form receivable by a user ofthe prosthesis; a sound processing means operable to receive the microphone signal and carry out a processing operation on the microphone signal to produce an output signal in a form suitable to operate the output device, wherein the processing means is operable in a first mode in which the processing operation comprises at least one variable processing factor which is adjustable by a user to a setting which causes the output signal ofthe processing means to be adjusted according to the preference ofthe user for the characteristics ofthe current acoustic environment; a sound analysis means that also receives the microphone signal and outputs a data set representative ofthe acoustic environment ofthe prosthesis; a data memory means for storing a plurality of said user adjusted settings; and a data processing means that analyses said stored settings and is operable to output control signals to the sound processing means; wherein, upon receiving control signals from the data processing means, the sound processing means is simultaneously operable in a second mode in which said at least one variable processing factor is automatically adjusted on the basis of the previously adjusted variable processing factor selected by the user.
In this aspect, the features of the prosthesis can have the features as described above with reference to the first aspect where such features are compatible with the operation ofthe prosthesis as described therein.
In this aspect, the hearing prosthesis preferably uses the data memory means to store a record of optimal settings as determined by the user of the prosthesis for different acoustic environments. This record is then used by the data processing means to calculate coefficients of one or more equations that are used to predict the optimal setting of the processing operation of the speech processor for that user when exposed to a different acoustic environment. In one embodiment, the hearing prosthesis can be adapted to output audio signals to a single ear of the user. In another embodiment, the hearing prosthesis can be adapted to output audio signals to both ears of the user. In yet a further embodiment, signals from the inputs of two prosthesis can be connected to the sound analysis means by wire or wirelessly. The control means for the above embodiments can be located on the housing of each prosthesis, a remote unit for each prosthesis, or the control means for both prostheses can be located on a common remote unit.
In one embodiment ofthe above aspects, the hearing prosthesis can be a hearing aid. In this embodiment, the output device of the hearing aid can be an earphone that receives the output signal ofthe processing means and generates amplified sounds that are delivered into the ear ofthe user.
In another embodiment, the hearing prosthesis can be an implanted hearing aid device whereby the output device of the prosthesis can be a vibrating mechanism, mechanically coupled to the middle or inner ear.
In another embodiment of the above aspects, the hearing prosthesis can be a cochlear implant. In this embodiment, the output device can comprise a receiver/stimulator unit that receives encoded stimulation data from the processing means and outputs stimulation signals that are delivered to the cochlea through an electrode array. In this embodiment, the sound processing means can comprise a speech processor that uses a coding strategy to extract speech from the sounds detected by the microphone before or after processing ofthe microphone signal according to the variable processing factors. In one embodiment, the speech processor of the cochlear implant can perform an audio spectral analysis of the acoustic signals and output channel amplitude levels. The transformation from the spectrum of the acoustic signal to electrical channel amplitude levels may be determined by a variable processing factor based on previously selected variable processing factors. The threshold and discomfort channel amplitude levels can also be processing factors that are based on previous adjustments and selections made by the prosthesis user. The sound processor can also sort the outputs in order of magnitude, or flag the spectral maxima as used in the SPEAK strategy developed by Cochlear Ltd. The receiver/stimulator unit is preferably positioned within a housing that is implantable within the user. The housing for the receiver/stimulator unit is preferably implantable within a recess in the bone behind the ear posterior to the mastoid.
The speech processing means is, in use, preferably mounted external to the body ofthe user such that the signals are transmitted transcutaneously through the skin ofthe user. Signals can preferably travel from the processing means to the receiver means and vice versa. The receiver/stimulator unit can include a receiver coil adapted to receive radio frequency (RF) signals from a corresponding transmitter coil worn externally ofthe body. The radio frequency signals can comprise frequency modulated (FM) signals. While described as a receiver coil, the receiver coil can preferably transmit signals to the transmitter coil which receives the signals.
The transmitter coil is preferably held in position adjacent the implanted location of the receiver coil by way of respective attractive magnets mounted centrally in, or at some other position relative to, the coils.
During use, the microphone is preferably worn on the pinna of the user, however, other suitable locations can be envisaged, such as a lapel of the implantee's clothing. The speech processor preferably encodes the sound detected by the microphone into a sequence of electrical stimuli following given algorithms. The encoded sequence is transferred to the implanted receiver/stimulator unit using the transmitter and receiver coils. The implanted receiver/stimulator unit may demodulate the FM signals and allocates the electrical pulses to the appropriate attached electrode by an algorithm which is consistent with the chosen speech coding strategy.
The external component housing the processing means further preferably houses a power supply. The power supply can comprise one or more rechargeable batteries. The transmitter and receiver coils may be used to provide power via transcutaneous induction to the implanted receiver/stimulator unit and the electrode array.
While the implant system can rely on external componentry, in another embodiment, the microphone, speech processor and power supply can also be implantable. In this embodiment, the implanted components can be contained within a hermetically sealed housing or the housing used for the stimulator unit. According to a third aspect there is provided a method of adjusting an auditory prosthesis by a user in an acoustic environment comprising the steps of: producing a microphone signal from a microphone that corresponds to sound received by the microphone; providing audio signals, through an output device, in a form receivable by the user; carrying out a processing operation, through a sound processing means, on the microphone signal so as to produce an output signal in a form suitable to operate the output device wherein the processing means is operable in a first mode in which the processing operation comprises at least one variable processing factor which is adjustable by a user to a setting which causes the output signal ofthe sound processing means to be adjusted according to the preference of the user for the characteristics of the current acoustic environment; storing the setting in a data memory means; wherein the sound processing means is simultaneously operable in a second mode in which said at least one variable processing factor is automatically adjusted on the basis ofthe previously adjusted variable processing factor selected by the user.
According to a fourth aspect there is provided a method of adjusting an auditory prosthesis by a user in an acoustic environment comprising the steps of: producing a microphone signal from a microphone that corresponds to sound received by the microphone; providing audio signals, through an output device, in a form receivable by the user; carrying out a processing operation, through a sound processing means, on the microphone signal so as to produce an output signal in a form suitable to operate the output device wherein the processing means is operable in a first mode in which the processing operation comprises at least one variable processing factor which is adjustable by a user to a setting which causes the output signal ofthe sound processing means to be adjusted according to the preference of the user for the characteristics of the current acoustic environment; receiving the microphone signal at a sound analysis means that subsequently outputs a data set representative ofthe acoustic environment ofthe prosthesis; storing a plurality of user adjusted settings in a data memory means; analysing the stored user adjusted settings and transmitting control signals to the sound processing means; wherein, upon receiving the control signals, the sound processing means is simultaneously operable in a second mode in which said at least one variable processing factor is automatically adjusted on the basis of the previously adjusted variable processing factor selected by the user.
The present invention enables the user of an auditory prosthesis to adjust the operation of the processing means in a simple way while they are using the prosthesis in a normal way. The invention further eventually allows the user to 'train' the prosthesis to adjust its operation automatically. This has a number of advantages including:
(1) greater levels of user satisfaction for both hearing aids and cochlear implants, because ofthe better control users have over their hearing;
(2) improved listening comfort, and/or speech intelligibility and/or subjective sound quality, because processing parameters are optimised by each user to the personal preference and needs of each user ;
(3) the ability to generalise the 'training' algorithm to work effectively with future devices that have different, or additional, parameters that require adjustment;
(4) because the training is carried out by the user in daily life, expensive clinical time is not required to achieve adjustment ofthe hearing aid and as adjustment is carried out in real life conditions, the adjustment better relates to actual performance ofthe device, rather than ideal clinical conditions; and
(5) The ability to generalise the training algorithm to work effectively in environments for which no training has been provided by the user, by automatically applying the general relationships between preferred variable processing factors and acoustic characteristics that have been established by the training.
Brief Description of the Drawings
By way of example only, a preferred embodiment of the invention is now described with reference to the accompanying drawings, in which:
Figure 1 is a pictorial representation of a prior art cochlear implant system;
Figure 2 is a block diagram of one embodiment of an auditory prosthesis according to the present invention; Figure 3 is a flowchart setting one particular mode of operation ofthe prosthesis of Figure 2;
Figure 4 is a graph depicting results of experiments performed on a prototype prosthesis according to one embodiment ofthe present invention; and
Figure 5 is a diagram representing the storage of processing factor values in a two-dimensional memory space.
Detailed Description of Preferred Embodiments of the Invention
While the present invention is not directed solely to a cochlear implant, it is appropriate to briefly describe the construction of one type of known cochlear implant system with reference to Figure 1.
Known cochlear implants typically consist of two main components, an external component including a speech processor 29, and an internal component including an implanted receiver and stimulator unit 22. The external component includes a microphone 27. The speech processor 29 is, in this illustration, constructed and arranged so that it can fit behind the outer ear 11. Alternative versions may be worn on the body. Attached to the speech processor 29 is a transmitter coil 24 that transmits electrical signals to the implanted unit 22 via a radio frequency (RF) link.
The implanted component includes a receiver coil 23 for receiving power and data from the transmitter coil 24. A cable 21 extends from the implanted receiver and stimulator unit 22 to the cochlea 12 and terminates in an electrode array 20. The signals thus received are applied by the array 20 to the basilar membrane 8 and the nerve cells within the cochlea 12 thereby stimulating the auditory nerve 9. The operation of such a device is described, for example, in US Patent No. 4,532,930.
As depicted diagrammatically in Figure 1, the cochlear implant electrode array 20 has traditionally been inserted into the initial portion of the scala tympani of the cochlea 12 up to about a full turn within the cochlea. A block diagram depicting one embodiment of an auditory prosthesis according to the present invention is depicted generally as 30 in Figure 2. The block diagram depicts features of both a cochlear implant and a hearing aid. Despite this, it will be appreciated that the diagram is representative only and that a prosthesis according to the present invention may not necessarily act as both a cochlear implant and hearing aid.
The auditory prosthesis 30 comprises a microphone 27 which receives sound and produces a microphone signal corresponding to the received sound and an output device that provides audio signals in a form receivable by a user of the prosthesis 30. As can be seen, the output device can comprise an earphone 31 in the case where the prosthesis 30 is a hearing aid. Where the prosthesis 30 is a cochlear implant, the output device comprises an encoder/transmitter unit 32 that outputs encoded data signals to the external transmitter coil 24.
The prosthesis 30 further has a sound processing unit 33 that is operable to receive the microphone signal provided by the microphone 27 and produce an output signal in a form suitable to operate either the earphone 31 or the encoder/transmitter unit 32.
The nature and function of the sound processor 33 will depend on whether the prosthesis 30 is a cochlear implant or a hearing aid. In the case of a hearing aid, the sound processor 33 includes at least an amplifier whereas in the case of cochlear implant the sound processor 33 will include an amplifier and a speech processor that uses a coding strategy to extract speech from the sounds detected by the microphone 27. In the depicted embodiment, the speech processor of the cochlear implant can perform an audio spectral analysis ofthe acoustic signals and output channel amplitude levels. The sound processor can also sort the outputs in order of magnitude, or flag the spectral maxima as used in the SPEAK strategy developed by Cochlear Ltd. Other coding strategies could be employed.
In this invention, the sound processor 33 comprises at least one variable processing factor, such as amplification, which in a first mode of operation is adjustable to a setting in which the output signal of the sound processor 33 is optimised for the preference of the user in at least one acoustic environment. For example, the amplification characteristics ofthe amplifier can be adjusted by a user of the prosthesis 30 to suit the surrounding background noise in a particular environment.
The prosthesis 30 further comprises a data memory means 34 for storing at least data indicative ofthe setting selected by the user and optionally data sets representative ofthe characteristics ofthe acoustic environment at the time the setting adjustment and selection is made.
The sound processor 33 when operable in a first mode recalculates the trainable coefficients after each adjustment by the user.
The sound processor 33 can be adapted to offer two or more possible optimal settings for selection by the user. One of these settings may be the one automatically calculated by the processor and the other may be a systematic departure therefrom. In this case, the user is preferably able to compare the operation of the prosthesis when operating in a particular acoustic environment when operating with each setting and then select from these the setting that is best for that particular environment. The setting that is selected by the user can then be stored in the data memory means 34 optionally with data indicative ofthe particular acoustic environment. This process can be repeatable so as to allow the data processing unit 38 to gather the preferences and to monitor whether the user's preference for a particular setting changes with time or usage. In this way, the user effectively selects or votes for the best setting each time.
In this embodiment, the user can alternate between settings by operating a control means 36 which can be a toggle switch or a set of pushbuttons, and select a setting by operating an indicator means which is represented by switch 35 in Figure 2. The switch 35 and control means 36 can be mounted on the housing of the prosthesis 30, or while not depicted, the switch and control means could be mounted on a remote unit.
The processing operation of the sound processor 33 can be operable in another manner in which its operation is adjustable by the user. Rather than offering a selection of possible optimal settings for selection by the user, in this arrangement, the user is able to adjust a control means 36 that allows the user to alter the processing operation of the sound processor unit 33. Once the user has adjusted the control means 36 to what is considered by the user an optimal setting for a particular acoustic environment, the user can operate the switch 35, leading to storage of that setting and optionally data indicative of the particular acoustic environment in the data memory means 34. Actuation ofthe switch 35 is taken by the sound processor unit 33 as indicating that the particular setting ofthe control means 36 at that time is considered optimal by the user for the particular acoustic environment in which the user finds themself.
The control means 36 can comprise a rotary wheel control that may be mounted on the housing ofthe prosthesis 30. The switch 35 can also be mounted on the housing of the prosthesis 30. While not depicted, the switch and controller could be mounted on a remote unit.
The settings selected by the user as being optimal to that user for a plurality of acoustic environments are stored in the data memory means 34 optionally with data indicative of those particular acoustic environments. The sound processor 33 continuously operates in the second mode, and can simultaneously be operable in the first mode for a defined period of time or can be considered as operating in that mode every time the user adjusts the control means 36 and selects what is considered a new optimal setting for that particular environment. The training period can be as long as the user wishes or optionally, the prosthesis 30 can signal to the user when the training period is complete. In this case, the prosthesis 30 can be adapted to indicate the training period is complete once there has been a particular pre-defined number of instances in which the user has been unable to select a setting that is substantially different from the setting already estimated by the prosthesis to be optimal.
The prosthesis 30 further comprises a sound analysis module 37. The sound analysis module 37 receives input signals from the microphone 27 and monitors the acoustic environment of the prosthesis user. The sound analysis module provides output(s) representative ofthe type ofthe acoustic environment being monitored at that time.
In the depicted embodiment, the data memory means 34 comprises five data memory locations. In this embodiment, the first data memory means 34a contains the audiometric data ofthe prosthesis user and/or individual data for one or more loudness models used by the prosthesis 30. The second data memory location 34b contains characteristic data about the hearing prosthesis 30. The third data memory location 34c comprises one or more equations used to predict the optimal processing operation of the sound processor unit 33 for an individual user in different acoustic environments. The fourth data memory location 34d stores the optimal sound processing data as selected by the user. The acoustic environment data that corresponds to the optimal sound processing data stored in the fourth data memory location is optionally stored in the fifth data memory location 34e.
In the depicted embodiment, the fourth data memory location 34d stores a predefined maximum number of 400 sets of optimal sound processing data. Other maximum numbers can, however, be envisaged. The depicted embodiment uses a data processing unit 38, that is described in more detail below. The unit 38 does not utilise all stored data sets but only a predefined number of most recently logged data sets. In this case, the data processing unit 38 only utilises the last 256 data sets when calculating the optimal equation coefficients. Once the memory location is full, new data sets are stored in the memory location by overwriting the oldest data set in the memory location. This first in first out storage system ensures only the most recently logged data is ever stored in the prosthesis 30 at any one time. In another embodiment, older data cannot be overwritten such that once the memory location is full no further data sets can be logged by the prosthesis. In another embodiment, rules are used to determine the old data that is overwritten by the newest data set, based on the worth of each old data set according to predetermined criteria.
As indicated above, the prosthesis further comprises a data processing unit 38. The data processing unit 38 receives the output of the sound analysis module 37. Based on the output of the sound analysis module 37, the data processing unit 38 may be adapted to calculate the loudness of sounds present at the microphone 27. In the depicted embodiment, the data processing unit 38 may calculate the loudness of the sounds as they would appear to a person with normal hearing and/or to a person with a degree of hearing impairment. The data processing unit 38 can be adapted to calculate other acoustic and psychoacoustic measures of the sounds present at the microphone 27. The data processing unit 38 can use the measures of the acoustic conditions as inputs to the one or more equations stored in the third data memory location 34c which estimate the optimal sound processing operation ofthe sound processor 33 for the user in the acoustic environments determined by the sound analysis module 37.
The data processing unit 38 further uses the hearing prosthesis characteristic data stored in the second data memory location 34b and the optimal sound processor data generated by the equations to automatically and continuously determine the appropriate setting of the sound processor 33 to provide the optimal output signal for the user in the current acoustic environment being experienced by the user.
As described, the sound processor 33 includes an amplifier means and a control means 36. At all times the data processing unit 38 operates in the second mode, where it automatically calculates the operation ofthe sound processor 33 that is most likely to provide the optimal amplification characteristics in any environment, as represented by the output of sound analysis unit 37. The prosthesis can also simultaneously operate in the first mode, where operation of the amplifier means is also adjustable by the user varying control 36 to allow the user to optimise the amplification characteristics in the current acoustic environment.
Where the prosthesis 30 is used in any environment, including an environment never previously experienced by the user, the desired gain ofthe amplifier is calculated through use of an equation having a pre-defined form. In this embodiment, the equation is:
G-, = a; +b; * max(Li,c + d; * (SNRi-SM ) (1)
where i = the band number;
G = gain for band i; ai = trainable coefficient for band i; b; = trainable coefficient for band i; c; = trainable coefficient for band i; d; = trainable coefficient for band i; L; = sound pressure level at the microphone in band i; SNR; = signal to noise ratio in band i; and SNRav = average SNR in all bands.
For each vote, the following training data is stored for each band i: the sound pressure level or SPL, Lj, in dB SPL; the signal-to-noise ratio in band i minus the average for all bands, that is SNRi- SNRav, in dB; and the preferred gain Gi also in dB. Each of the above values are calculated based on the signal at the microphone 27 for a period of time that precedes the actual vote. The values may be calculated based on the signal at the microphone 27 for a time preceding the vote and for a time after the vote has been cast. The stored L; is the average or RMS value ofthe SPL over the predetermined period of time and the stored Gi is the average value ofthe gain over a predetermined period of time prior to the actuation ofthe voting button plus the user's preferred gain adjustment at the time of actuation of the voting button. The SNR in band i is currently calculated at the SPL at the microphone exceeded 10% ofthe time in band i minus the SPL at the microphone exceeded 90% of the time in band i over the predetermined period of time prior to the vote. This difference may be more accurately described as an estimate of the modulation depth of the signal. It is envisaged that a more accurate SNR or even speech-to-noise ratio estimation techniques may be employed.
The stored training data from many votes, for example up to 256, is used to form a set of simultaneous equations (1). The set of simultaneous equations is sold as a set of linear equations, however since coefficient bi and coefficient Ci are potentially multiplied by each other, that is not linear, the simultaneous equations are initially linearised. In other words the value of Ci is set to a predefined value, and the MAX [L;, Ci] operation performed with this value of Ci and the stored L; values in order to set the bracketed term, in other words the greater of Lj and Ci the result of which is L';. Subsequently the optimal values of a;, b; and d; are calculated with a direct numerical method wherein the optimal coefficient values are the ones that give the least squared error between the stored G; values and G, values that are calculated with the corresponding L'i and stored SNR; - SNRav values. This is repeated for at least four alternative values of c;3 for example 35, 45, 55 and 65 dB SPL, and the set of coefficients that gives the least squared error is selected as the optimal set and applied to the processing of the signal, unless the value of b; is outside the range of -1.0 to +1.0, or if less than fifty votes have occurred. Other versions may apply the trained coefficients after more or less than fifty votes.
The direct numerical method used is lower-upper (LU) decomposition and back substitution which is a variant of Gaussian elimination the set of simultaneous equations are stored as matrices in memory, Ax = b, where matrix A contains the stored acoustic environment data, x is a vector that contains the coefficients to be calculated
(that is ai, bi and di), and b is a vector that contains the stored Gj values. The LU decomposition method operates on these matrices and solves vector x. Other variants of Gaussian elimination or other direct numerical methods can be used in other applications.
As an example, the training data from four votes may result in the set of simultaneous equations as follows:
25 = ai + (bi !i!35) + (di *0)
20 = ai + (bi *45) + (di !(!0)
Figure imgf000028_0001
In this case, the trained coefficients would be a; = 42.5, b; = -0.5, c; = 35 and di = 0.0.
This set of coefficients would give OdB error. In practical situations, there may be more variability in people's amplification preferences, or scatter in the training data.
Thus the preferred, user adjusted, G, values on the left of the equal signs in the above equations would not go up so uniformly in even steps, and the trained coefficient values would be different.
Other forms of the equation with other acoustic or psychoacoustic parameters, such as higher-order moments of the spectrum of the signal and variations of these moments with time, or other statistical parameters or estimates ofthe acoustic signal or combinations of these parameters, and optionally with other additional coefficients, can calculate the gain or processing factors other than gain, such as the speed at which the prosthesis reacts to change in the acoustic environment, the choice of the equations used will depend upon the particular application desired, with such applications falling within the scope ofthe present invention.
In the above embodiment, trainable coefficients include a, b, c and d, which as a result leads to the amplifier gain G being a variable processing factor.
More than one processing factor ofthe sound processor 33 can be automatically calculated using equations similar to equation 1, and then further adjusted by the user using the control means 36 or multiple control means. In this embodiment, the control means 36 can allow the user to adjust one or more of the following operations of the sound processor 33: (i) the volume ofthe output signal;
(ii) the gain of the output signal at particular frequencies relative to other frequencies, for example the mid frequency gain can be boosted or attenuated with respect to the low or high band frequencies ofthe output signal; and (iii) a slope control where the low and high frequency band gains are adjusted in opposing directions while the mid band gain is unchanged.
The user can select which setting of the control means 36 is the optimal one for the particular acoustic environment that they are in by actuating the switch 35. Each time the switch 35 is actuated, the gain in each frequency band is logged along with a data set indicative of the acoustic environment detected by the microphone 27. This data can be used with previous sets of data by the data processing unit 38 to calculate the gain equation coefficients that enable the equations to best predict the preferences of the user from the logged training data in each band. Because the data processing unit 38 has access to the preferred amplification characteristics and the acoustic environments in which they were preferred, the data processing unit 38 can calculate general relationships between the amplification characteristics and the measured aspects of the acoustic environment. The automatically calculated amplification characteristics can thus vary in a complex but defined manner as the acoustic environment changes. For example, in the current embodiment, gain at each frequency varies with the overall input level and the signal-to-noise ratio at said frequency relative to the signal-to-noise ratio at other frequencies.
The depicted data processing unit 38 does not calculate optimal gain equation coefficients until a predetermined number of selections have been made by the user. In the depicted embodiment, the prosthesis 30 is adapted to not calculate optimal gain equation coefficients until at least fifty selections have been made by the user. In this case, where the predetermined number of selections have not been made, the sound processor 33 will preferably output a signal calculated on the basis of the initial, pre- defined values of trainable coefficients. These initial, pre-defined values are calculated for each user by conventional methods of prescribing prosthesis operation, or by an empirical, trial and error adjustment process. Once the predetermined number of selections have been made, the data processing unit 38 re-calculates the trainable coefficients immediately after every occasion on which the user operates the switch 35 to indicate that the control 36 is in the optimal position. In another embodiment, the data processing unit 38 does not wait until a predetermined number of selections have been made by the user to re-calculate the trainable coefficients, but does not apply these coefficients until the equations can accurately predict the preferences of the aid user with the trained coefficients, and/or the user has made selections in a preferred minimum range of acoustic environments.
In an alternative embodiment, the data processing unit 38 does not use the equations stored in the third data memory location 34c to determine the optimal variable processing factors for different environments. The optimally adjusted variable processing factors are stored in the fourth data memory location 34d at locations determined by the corresponding acoustic environment data supplied by the sound analysis means 37. Prior to the commencement of operation in the first mode, the fourth data memory locations 34d are loaded with processing factors that are derived from empirical observations or prescriptive procedures for the corresponding acoustic environment parameter values. When operating in the first mode the optimally adjusted processing factor(s) are stored in the fourth data memory 34d at locations determined by the acoustic environment data supplied by the sound analysis means 37. For example, the fourth data memory location 34d can store a multi-dimensional (or N- dimensional) look-up table or matrix, where each dimension is a different acoustic environment or psychoacoustic parameter, and the parameter values determine the location in the table, matrix, or memory location 34d where the preferred processing factor(s) is stored. Thus the matrix is indexed by rounded values of the N acoustic environment parameters (or optionally the estimated psychoacoustic parameters such as loudness). The optimally adjusted processing data may simply overwrite the prescribed data in the fourth data memory 34d, or may be combined with old data written to the same location using a mathematical and/or statistical procedure. When operating in the second mode, the acoustic environment and psychoacoustic parameter values supplied by the sound analysis means 37 are used to index the table or matrix or fourth data memory location 34d, and the value(s) stored at the indexed location are used to set the target value(s) of the corresponding processing factor(s) for the sound processing means 33. The processing factor(s) applied in the sound processing means 33 may slowly converge towards the target value(s) to avoid the possibility of undesirable acoustic effects associated with excessively rapid or instantaneous changes of the applied value(s). For memory locations that contain a prescribed value of a processing factor, the target value can be adjusted to represent the trend of user-adjusted values for environments located near the current environment in the memory location 34d. For this alternative embodiment there is no need for the fifth data memory location 34e and the equations stored in the third data memory 34c, and the variation of a processing factor with acoustic parameters supplied by the sound analysis means 37, or psychoacoustic parameters calculated by the data processing unit 38, is not restricted by the relationships that are predefined in the equations stored in the third data memory location 34c.
In one embodiment, the hearing prosthesis can be adapted to output audio signals to a single ear of the user. In another embodiment, the hearing prosthesis can be adapted to output audio signals to both ears ofthe user.
In a further embodiment, the trainable hearing prosthesis can be adapted to accept microphone signals from microphones mounted on each side of the head, and then to output signal to either or both ears.
Figure 3 is a flowchart of the logic behind the operation of the data processing unit 38.
The Start of the flowchart is when the prosthesis 30 is turned on and power is supplied to the parts thereof including the sound processor 33 and data processing unit 38. The end point ofthe flowchart is when the user turns the prosthesis 30 off or if the battery for the power source goes flat. While not depicted, it is possible that another end point could be defined as when a certain number of votes are reached, or if the user stops training the prosthesis 30 for a predetermined period of time, or if the prosthesis 30 determines from the user adjustments of the control means 36 that it is sufficiently well-trained. Still further, an audiologist or other third party could disable further training of the prosthesis when the user is satisfied with the performance of the prosthesis 30 in a range of different acoustic environments. However, it is desirable that the user can train the prosthesis at any time, so that training does not need to be re- enabled if the user encounters a new environment or if the hearing loss profile of the user changes over time or with slow acclimatisation to the prosthesis.
Figure 4 is a graph of the results of preliminary experiments performed on a prototype prosthesis according to the present invention. In the experiments, the goal was to train the prosthesis to produce a greater gain than provided by the prosthesis prior to the training in all frequency bands for any input sound. Figure 4 indicates how the necessity to adjust the control 36 (RMS control adjustment in dB) following groups of 15 votes to get the desired output decreased due to the "training" ability of the prosthesis.
Figure 5 is an illustration of the matrix previously referred to using acoustic parameters of equation 1.
Figure 5 is a diagram representing the storage of processing factor values in a two-dimensional memory space that is indexed by the values of two acoustic parameters, the sound pressure level for band i and the signal-to-noise ratio for band i relative to the average for all bands, although this does not exclude the use of a greater number of dimensions from the scope of this invention, and the values shown are illustrative only. The numbers in the memory locations represent gain values, where gain is a variable processing factor. The stored values are prescribed values, except the bold italic values which represent data that differs from the initial prescribed data due to the storage of user-preferred setting data as a result of training by the user.
It will be appreciated by persons skilled in the art that numerous variations and/or modifications may be made to the invention as shown in the specific embodiments without departing from the spirit or scope of the invention as broadly described. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive.

Claims

CLAIMS:
1. An auditory prosthesis comprising: a microphone which receives sound and produces a microphone signal corresponding to the received sound; an output device that provides audio signals in a form receivable by a user of the prosthesis; a sound processing means operable to receive the microphone signal and carry out a processing operation on the microphone signal to produce an output signal in a form suitable to operate the output device, wherein the processing means is operable in a first mode in which the processing operation comprises at least one variable processing factor which is adjustable by a user to a setting which causes the output signal ofthe sound processing means to be adjusted according to the preference of the user for the characteristics ofthe current acoustic environment; and a data memory means for storing said setting; wherein the sound processing means is simultaneously operable in a second mode in which said at least one variable processing factor is automatically adjusted on the basis ofthe previously adjusted variable processing factor selected by the user.
2. An auditory prosthesis according to claim 1 wherein when the sound processing means is operable in the first mode, the sound processing means offers two or more possible optimal settings of the at least one variable processing factor for selection by the user.
3. An auditory prosthesis according to claim 2 wherein the selection process by the user is repeated to enable the sound processing means to monitor whether the preference of the user for a particular setting of the at least one variable processing factor changes with time or usage.
4. An auditory prosthesis according to claim 3 wherein the number of selections made by the user for each setting is monitored by the sound processing means to enable the prosthesis to select the optimal setting ofthe at least one variable processing factor.
5. An auditory prosthesis according to claim 4 wherein the user operates a control means to alter the at least one variable processing factor and thereby alter the processing operation ofthe sound processing means.
6. An auditory prosthesis according to claim 5 whereupon the user adjusting the control means to a setting considered optimal by the user for the current acoustic environment, the user actuates an indicator means in order to store the setting in the data memory means.
7. An auditory prosthesis according to claim 6 wherein actuation of the indicator means indicates to the sound processing means that the setting of the control means selected by the user at that time is considered optimal by the user for the current acoustic environment.
8. An auditory prosthesis according to claim 7 wherein the selected setting is stored in the data storage means on activation ofthe indicator means.
9. An audio prosthesis according to any one of claims 1 to 8 wherein the data memory means stores data sets representative of the characteristics of at least one acoustic environment.
10. An audio prosthesis according to claim 9 wherein the data sets representative of the characteristics of said at least one acoustic environment are stored in the data memory means on activation ofthe indicator means by the user.
11. An audio prosthesis according to claim 10 wherein said at least one variable processing factor is automatically adjusted on the basis ofthe acoustic environments in which the at least one variable processing factor was selected.
12. An auditory prosthesis according to any one of claims 7 to 11 wherein when the sound processing means operates in the second mode, the sound processing means operates in the first mode for a defined period of time.
13. An auditory prosthesis according to any one of claims 7 to 11 wherein when the sound processing means operates in the second mode, the sound processing means operates in the first mode each time the user adjusts the control means and selects what the user considers to be a new optimal setting for the current acoustic environment.
14. An auditory prosthesis according to any one of the previous claims wherein the prosthesis has a defined training period in which the prosthesis is operable in the first mode.
15. An auditory prosthesis according to claim 14 wherein the prosthesis signals to the user when the training period is complete.
16. An auditory prosthesis according to claim 15 wherein the training period is complete when a predefined number of instances in which the user has not selected a setting which is substantially different to the setting already estimated by the prosthesis to be optimal.
17. An auditory prosthesis according to any one of the previous claims further comprising sound analysis means for receiving input signals from the microphone and monitoring the current acoustic environment.
18. An auditory prosthesis according to claim 17 wherein the sound analysis means provides an output representative of the acoustic environment being monitored at that time.
19. An auditory prosthesis according to claim 18 wherein the data memory means comprises one or more data memory locations.
20. An auditory prosthesis according to claim 19 wherein the data memory means comprises five data memory locations, the first data memory location storing audiometric data of the user and/or individual data for one or more loudness models used by the prosthesis.
21. An auditory prosthesis according to claim 20 wherein a second data memory location stores characteristic data ofthe prosthesis.
22. An auditory prosthesis according to claim 20 or claim 21 wherein a third data memory location stores one or more equations used to predict the optimal processing operation of the sound processing means for the user in different acoustic environments.
23. An auditory prosthesis according to any one of claims 20 to 22 wherein a fourth data memory location stores the optimal sound processing data selected by the user.
24. An auditory prosthesis according to claim 23 wherein the data stored in the fourth data memory location is indexed according to the corresponding acoustic environment data supplied by the sound analysis means.
25. An auditory prosthesis according to any one claims 20 to 24 wherein a fifth data memory location stores acoustic environment data corresponding to the optimal sound processing data stored in the fourth data memory location,
26. An auditory prosthesis according to claim 23 wherein the fourth data memory location stores a predefined maximum number of sets of optimal sound processing data selected by the user.
27. An auditory prosthesis according to claim 26 further comprising a data processing means for receiving the output ofthe sound analysis means.
28. An auditory prosthesis according to claim 27 such that based on the output from the sound analysis means, the data processing means is adapted to calculate the loudness of sounds present at the microphone.
29. An auditory prosthesis according to claim 27 or claim 28 wherein the data processing means, based on the output from the sound analysis means, calculates acoustic and/or psychoacoustic measures, such as loudness, ofthe sounds present at the microphone.
30. An auditory prosthesis according to claim 29 wherein the data processing means calculates the loudness of the sounds as the sounds appear to a person with normal • hearing and/or to a person with a degree of hearing impairment.
31. An auditory prosthesis according to claim 30 wherein the data processing means uses the acoustic and/or psychoacoustic measures as inputs to the one or more equations stored in the third data memory location in order to estimate the optimal sound processing operation of the sound processing means for the user in the acoustic environments represented by the sound analysis means.
32. An auditory prosthesis according to claim 31 the data processing means uses a predefined number of the most recently logged data sets stored in the fourth data memory location when determining the optimal value of the at least one variable processing factor.
33. An auditory prosthesis according to claim 32 wherein the most recent data set to be stored in the fourth data memory location replaces the oldest data set stored in the fourth data memory location.
34. An auditory prosthesis according to claim 33 wherein when the fourth data memory location is full, no further data sets can be logged by the prosthesis.
35. An auditory prosthesis according to claim 33 wherein an old data set is selectively overwritten by the newest data set according to the acoustic environment in which the sound processing data was selected.
36. An auditory prosthesis according to any one of claims 27 to 35 wherein the data processing means uses the prosthesis characteristic data stored in the second data memory location and the optimal sound processor data generated by one or more equations stored in the third data memory location to automatically and continuously determine an appropriate setting of the sound processing means to provide the optimal output signal for the user in the current acoustic environment experienced by the user.
37. An auditory prosthesis according to any one of the previous claims wherein the sound processing means includes an amplifier means and a gain control means.
38. An auditory prosthesis according to claim 37 wherein the amplifier means is adjustable when in the first mode in order to allow the user to optimise the gain at each frequency ofthe amplifier in a particular environment.
39. An auditory prosthesis according to claim 38 such that when the gain has been optimised, the prosthesis operates in the second mode in which the amplification characteristics ofthe amplifier means automatically adjusts to the optimal level.
40. An auditory prosthesis according to claim 39 wherein the data processing unit operates in the second mode to automatically calculate the operation of the sound processor means that is most likely to provide the optimal amplification characteristics in any environment as represented by the output ofthe sound analysis means.
41. An auditory prosthesis according to claim 40 that simultaneously operates in the first mode whereby operation of the amplifier means is also adjustable by the user varying the control means to allow the user to optimise the amplification characteristics in the current acoustic environment.
42. An auditory prosthesis according to any one of claims 37 to 41 wherein the at least one variable processing factor includes the amplifier gain.
43. An auditory prosthesis according to any one of claims 37 to 42 used in any environment wherein the gain of the amplifier means at each frequency is calculated using the following equation:
G; = a; +b; * max(Li,Ci) + d; * (SNRj-SNRav) where i = the frequency band number; G = gain for band i; a = trainable coefficient for band b = trainable coefficient for band c = trainable coefficient for band d = trainable coefficient for band L; = sound pressure level at the microphone in band i; SNR; = signal to noise ratio in band i; and
SNRav = average SNR in all bands.
44. An auditory prosthesis according to claim 43 wherein the sound processing means, when operable in the first mode, calculates the trainable coefficients a, b, c and d after each adjustment by the user.
45. An auditory prosthesis according to claim 44 wherein the user operates multiple control means in order to adjust multiple variable processing factors.
46. An auditory prosthesis according to claim 45 wherein the control means or multiple control means is used by the user to adjust one or more of the following operations ofthe sound processor means: (i) the volume ofthe output signal; (ii) the gain of the output signal at particular frequencies relative to other frequencies; and
(iii) a slope control where low and high frequency band gains are adjusted in opposing directions while a mid-band gain is unchanged.
47. An auditory prosthesis according to claim 46 wherein for each ofthe operations of the sound processor means, the user selects a setting which is optimal for each variable processing factor for the acoustic environment that the user experiences by actuating the indicator means.
48. An auditory prosthesis according to claim 46 wherein for multiple operations of the sound processor means, the user selects a setting which is optimal for one or more variable processing factors for the acoustic environment that the user experiences by actuating the indicator means.
49. An auditory prosthesis according to claim 47 or claim 48 whereupon actuation ofthe indicator means the gain in each frequency band is recorded.
50. An auditory prosthesis according to claim 49 wherein the recorded gain in each frequency band is used to calculate the gain equation coefficients of claim 43.
51. An auditory prosthesis according to claim 50 wherein data sets representative of the acoustic environments detected by the microphone are recorded.
52. An auditory prosthesis according to claim 51 wherein the data sets representative ofthe acoustic environments are used with previous data sets by the data processing means to calculate the gain equation coefficients that best match logged training data in each frequency band, wherein the logged training data includes the stored preferred variable processing factors and the corresponding environment data.
53. An auditory prosthesis according to any one of claims 44 to 52 such that when operating in the first mode the data processing means does not calculate optimal gain equation coefficients until a predetermined number of selections have been made by the user.
54. An auditory prosthesis according to claim 53 wherein the predetermined number of selections is fifty.
55. An auditory prosthesis according to claim 53 or claim 54 where the predetermined number of selections has not been made, the data processing means, when operating in the second mode, automatically calculates the output appropriate to the current acoustic environment based on predetermined coefficients and/or variable processing factors.
56. An auditory prosthesis according to claim 55 where the predetermined number of selections has not been made, the sound processing means outputs a signal calculated on the basis ofthe initial, predefined values of trainable coefficients.
57. An auditory prosthesis according to claim 56 wherein the initial predefined values are calculated for each user by conventional methods of prescribing prosthesis operation or by an empirical, trial and error adjustment process.
58. An auditory prosthesis according to any one of claims 53 to 55 wherein upon the predetermined number of selections being made, the data processing means calculates the optimal gain equation coefficients on the basis of previous user preferences when in the first mode of operation and continually calculates the variable processing factors with the equation of claim 43 when in the second mode.
59. An auditory prosthesis according to claim 58 wherein the data processing means does not wait for a predetermined number of selections to be made by the user before calculating the optimal gain equation coefficients , and does not use the calculated coefficients when in the second mode until the variable processing factors that are preferred by the user are predictable by the equation of claim 36 and the calculated coefficients.
60. An auditory prosthesis according to claim 19 wherein when operating in the first mode, optimally adjusted variable processing factors are stored at the one or more locations as determined by corresponding acoustic environment data supplied by the sound analysis means.
61. An auditory prosthesis according to claim 60 wherein the adjusted variable processing factors at the one or more locations are stored in a multi-dimensional lookup table where each dimension is a different acoustic environment or psychoacoustic parameter.
62. An auditory prosthesis according to claim 61 wherein the multi-dimensional look-up table is indexed by at least two parameters chosen from acoustic environment parameters or psychoacoustic parameters.
63. An auditory prosthesis according to claim 62 wherein the parameter values determine the location in the look-up table where the preferred processing factors are stored.
64. An auditory prosthesis according to claim 63 wherein prior to the commencement of the sound processing means operating in the first mode, each of the memory locations are loaded with processing factors that are derived from empirical observations or prescriptive procedures for the corresponding acoustic environment parameter values.
65. An auditory prosthesis according to claim 64 wherein the optimally adjusted variable processing factors overwrites prescribed data or is combined with old data written to the same memory location using a mathematical and/or statistical procedure.
66. An auditory prosthesis according to claim 65 such that when operating in the second mode, the acoustic environment and psychoacoustic parameter values supplied by the sound analysis means are used to index the memory locations or look-up table, the values stored at the indexed locations being used to set the target values of the corresponding processing factors for the sound processing means.
67. An auditory prosthesis according to claim 66 wherein the processing factors applied in the sound processing means converge towards the target values in order to avoid undesirable acoustic effects associated with excessively rapid or instantaneous changes ofthe applied values.
68. An auditory prosthesis according to claim 67 wherein for memory locations that contain a prescribed value of a processing factor, the target value is adjustable to represent the trend ofthe user-adjusted values for environments located near the current environment in the one or more locations.
69. An auditory prosthesis according to claim 19 wherein optimally adjusted variable processing factors are stored at the one or more locations as calculated by a mathematical and/or statistical procedure, such as weighted averaging.
70. An auditory prosthesis according to any one of claims 1 to 19 wherein the prosthesis is trained to provide optimal variable processing factors for different listening criteria, such as to maximise speech intelligibility, listening comfort or pleasantness.
71. An auditory prosthesis according to claim 70 wherein an equation including acoustic environment and/or psychoacoustic parameters highly correlated to a particular listening criterion is used in the training process.
72. An auditory prosthesis according to claim 71 wherein when operable in the second mode, the variable processing factors automatically adapt for the predicted weighted combination of listening criteria as determined by the value of coefficients and acoustic environment and/or psychoacoustic parameters used in the equation.
73. An auditory prosthesis according to any one of claims 1 to 19 wherein when the sound processing means is operable in the first mode, the user indicates the listening criterion or criteria to determine the preferred adjustment of the variable processing factors with the indicator means.
74. An auditory prosthesis according to any one of claims 1 to 19 wherein when the sound processing means is operable in the first mode, the prosthesis automatically predicts the listening criterion or criteria from values of acoustic environment and/or psychoacoustic parameters that are known to correlate with different listening criteria so as to determine the preferred adjustment ofthe variable processing factors.
75. An auditory prosthesis according to claim 74 wherein the prosthesis automatically predicts the listening criterion or criteria from the presence of signals of interest such as speech and music as detected by the prosthesis.
76. An auditory prosthesis according to claim 75 wherein a first data memory location is divided into sections for different listening criteria and the optimally adjusted variable processing factors are stored in memory locations determined by the listening criterion or criteria under which they were adjusted by the user.
77. An auditory prosthesis according to claim 76 wherein a further data memory location is divided into sections for each different listening criterion for storage of acoustic or psychoacoustic parameter values that correspond to the values stored in the first data memory location.
78. An auditory prosthesis according to claim 76 or claim 77 wherein the data in each section of the first and further data memory locations is used to calculate the optimal coefficients of variable processing factors for each listening criterion.
79. An auditory prosthesis according to any one claims 76 to 78 wherein the user indicates the current listening criteria or criterion via the indicator means when operable in the second mode.
80. An auditory prosthesis according to any one of claims 76 to 78 wherein, when operable in the second mode, the listening criterion or weighted combination of criteria is predicted from the values of acoustic environment and/or psychoacoustic parameters that are known to correlate with different listening criteria.
81. An auditory prosthesis according to any one of claims 76 to 78 wherein, when operable in the second mode, the listening criterion or weighted combination of criteria is predicted from the presence of signals of interest such as speech or music.
82. An auditory prosthesis according to any one of claims 76 to 78 wherein, when operable in the second mode, the listening criterion or weighted combination of criteria is predicted from one or more trainable listening criteria equations that have acoustic environment and/or psychoacoustic parameters, where optimal coefficients of each listening criterion equation are calculated from the data stored in the corresponding sections ofthe first and further data memory locations.
83. An auditory prosthesis according to claim 76 wherein, when operable in the first mode, the listening criterion or criteria indicated by the user via the indicator means or as predicted by the prosthesis are used in addition to the corresponding acoustic environment and/or pyschoacoustic parameters to index the first data memory location where the optimally adjusted variable processing factors are stored.
84. An auditory prosthesis according to claim 76 wherein, when operable in the second mode, the current values of acoustic environment and/or psychoacoustic parameters and the indicated or predicted listening criterion criteria are used to index the first data memory location to retrieve the optimal variable processing factors for the current conditions.
85. An auditory prosthesis according to claim 76 wherein the processing factor values stored at the first data memory location when operable in the first mode are modified according to the weighted combination of listening criteria for the particular acoustic environment.
86. An auditory prosthesis comprising: a microphone which receives sound and produces an output signal corresponding to the received sound; an output device that provides audio signals in a form receivable by a user ofthe prosthesis; a sound processing means operable to receive the microphone signal and carry out a processing operation on the microphone signal to produce an output signal in a form suitable to operate the output device, wherein the processing means is operable in a first mode in which the processing operation comprises at least one variable processing factor which is adjustable by a user to a setting which causes the output signal of the sound processing means to be adjusted according to the preference of the user for the characteristics ofthe current acoustic environment; a sound analysis means that also receives the microphone signal and outputs a data set representative ofthe acoustic environment ofthe prosthesis; a data memory means for storing a plurality of said user adjusted settings; and a data processing means that analyses said stored settings and is operable to output control signals to the sound processing means; wherein, upon receiving control signals from the data processing means, the sound processing means is simultaneously operable in a second mode in which said at least one variable processing factor is automatically adjusted on the basis of the previously adjusted variable processing factor selected by the user.
87. An auditory prosthesis according to claim 86 wherein the data memory means stores said data set output by the sound analysis means.
88. An auditory prosthesis according to claim 86 or claim 87 wherein said at least one variable processing factor is automatically adjusted on the basis of the acoustic environments in which said variable processing factors were selected.
89. An auditory prosthesis according to any one of claims 86 to 88 wherein the data memory means stores a record of optimal settings as determined by the user for different acoustic environments.
90. An auditory prosthesis according to claim 89 wherein the data processing means uses the record of optimal settings to calculate coefficients of one or more equations that are used to predict the optimal setting of the processing operation of the sound processing means for the user when exposed to a different acoustic environment.
91. An auditory prosthesis according to any one of claims 86 to 90 adapted to output audio signals to a single ear ofthe user.
92. An auditory prosthesis according to any one of claims 86 to 90 adapted to output audio signals to both ears ofthe user.
93. An auditory prosthesis according to any one of claims 86 to 92 wherein when the sound processing means is operable in the first mode, the processing means offers two or more possible optimal settings of the at least one variable processing factor for selection by the user.
94. An auditory prosthesis according to claim 93 wherein the selection process by the user is repeated to enable the sound processing means to monitor whether the preference of the user for a particular setting of the at least one variable processing factor changes with time or usage.
95. An auditory prosthesis according to claim 94 wherein the number of selections made by the user for each setting is monitored by the sound processing means to enable the prosthesis to select the optimal setting ofthe at least one variable processing factor.
96. An auditory prosthesis according to claim 95 wherein the user operates a control means to alter the at least one variable processing factor and thereby alter the processing operation ofthe sound processing means.
97. An auditory prosthesis according to claim 95 whereupon the user adjusting the control means to a setting considered optimal by the user for the current acoustic environment, the user actuates an indicator means in order to store the setting in the data memory means.
98. An auditory prosthesis according to claim 97 wherein actuation of the indicator means indicates to the sound processing means that the setting of the control means selected by the user at that time is considered optimal by the user for the current acoustic environment.
99. An auditory prosthesis according to any one of claims 86 to 98 wherein the auditory prosthesis is a hearing aid.
100. An auditory prosthesis according to claim 99 wherein the output device of the hearing aid is an earphone that receives the output signal of the sound processing means and generates amplified sounds that are delivered into the ear ofthe user.
101. An auditory prosthesis according to any one of claims 86 to 98 wherein the auditory prosthesis is an implanted hearing aid.
102. An auditory prosthesis according to claim 101 wherein the output device of the implanted hearing aid is a vibrating mechanism mechanically coupled to the middle or inner ear.
103. An auditory prosthesis according to any one of claims 86 to 98 wherein the auditory prosthesis is a cochlea implant.
104. An auditory prosthesis according to claim 103 wherein the output device of the cochlea implant comprises a receiver/stimulator unit that receives encoded stimulation data from the sound processing means and outputs stimulation signals that are delivered to the cochlea through an electrode array.
105. An auditory prosthesis according to claim 104 wherein the sound processing means comprises a speech processor that uses a coding strategy to extract speech from the sounds detected by the microphone before or after processing of the microphone signal according to the variable processing factors.
106. An auditory prosthesis according to claim 105 wherein the speech processor performs an audio spectral analysis of the acoustic signals and output channel amplitude levels.
107. An auditory prosthesis according to claim 106 wherein the transformation from the spectrum ofthe acoustic signals to output channel amplitude levels is determined by a variable processing factor based on previously selected variable processing factors.
108. An auditory prosthesis according to claim 107 wherein the channel amplitude levels include a threshold level and discomfort level that are processing factors based on previous adjustments and selections made by the user.
109. An auditory prosthesis according to any one claims 104 to 108 wherein the receiver/stimulator unit is positioned within a housing that is implantable within the user.
110. An auditory prosthesis according to claim 109 wherein the housing for the receiver/stimulator unit is implantable within a recess in the bone behind the ear posterior to the mastoid.
111. An auditory prosthesis according to any one of claims 105 to 110 wherein the speech processor encodes the sound detected by the microphone into a sequence of electrical stimuli following given algorithms.
112. An auditory prosthesis according to claim 111 wherein the encoded sequence is transferred to the implanted receiver/stimulator unit using a transmitter a coil and a receiver coil ofthe receiver/stimulator unit.
113. A method of adjusting an auditory prosthesis by a user in an acoustic environment comprising the steps of: producing a microphone signal from a microphone that corresponds to sound received by the microphone; providing audio signals, through an output device, in a form receivable by the user; carrying out a processing operation, through a sound processing means, on the microphone signal so as to produce an output signal in a form suitable to operate the output device wherein the processing means is operable in a first mode in which the processing operation comprises at least one variable processing factor which is adjustable by a user to a setting which causes the output signal ofthe sound processing means to be adjusted according to the preference of the user for the characteristics of the current acoustic environment; storing the setting in a data memory means; wherein the sound processing means is simultaneously operable in a second mode in which said at least one variable processing factor is automatically adjusted on the basis ofthe previously adjusted variable processing factor selected by the user.
114. A method of adjusting an auditory prosthesis by a user in an acoustic environment comprising the steps of: producing a microphone signal from a microphone that corresponds to sound received by the microphone; providing audio signals, through an output device, in a form receivable by the user; carrying out a processing operation, through a sound processing means, on the microphone signal so as to produce an output signal in a form suitable to operate the output device wherein the processing means is operable in a first mode in which the processing operation comprises at least one variable processing factor which is adjustable by a user to a setting which causes the output signal ofthe sound processing means to be adjusted according to the preference of the user for the characteristics of the current acoustic environment; receiving the microphone signal at a sound analysis means that subsequently outputs a data set representative ofthe acoustic environment ofthe prosthesis; storing a plurality of user adjusted settings in a data memory means; analysing the stored user adjusted settings and transmitting control signals to the sound processing means; wherein, upon receiving the control signals, the sound processing means is simultaneously operable in a second mode in which said at least one variable processing factor is automatically adjusted on the basis of the previously adjusted variable processing factor selected by the user.
PCT/AU2003/000613 2002-05-21 2003-05-21 Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions WO2003098970A1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
CA2486893A CA2486893C (en) 2002-05-21 2003-05-21 Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions
JP2004506316A JP4658593B2 (en) 2002-05-21 2003-05-21 Programmable hearing prosthesis that can automatically adapt to the acoustic environment
AU2003225339A AU2003225339A1 (en) 2002-05-21 2003-05-21 Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions
EP03720029A EP1532841A4 (en) 2002-05-21 2003-05-21 Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions
US10/993,359 US7889879B2 (en) 2002-05-21 2004-11-22 Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions
US13/024,649 US8532317B2 (en) 2002-05-21 2011-02-10 Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
AUPS2470A AUPS247002A0 (en) 2002-05-21 2002-05-21 Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions
AUPS2470 2002-05-21

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US10/993,359 Continuation-In-Part US7889879B2 (en) 2002-05-21 2004-11-22 Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions

Publications (1)

Publication Number Publication Date
WO2003098970A1 true WO2003098970A1 (en) 2003-11-27

Family

ID=3836035

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU2003/000613 WO2003098970A1 (en) 2002-05-21 2003-05-21 Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions

Country Status (5)

Country Link
EP (1) EP1532841A4 (en)
JP (1) JP4658593B2 (en)
AU (1) AUPS247002A0 (en)
CA (1) CA2486893C (en)
WO (1) WO2003098970A1 (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1696701A2 (en) * 2005-02-23 2006-08-30 Siemens Audiologische Technik GmbH Hearing device and process to monitor the hearing capacity of a hearing impaired person
WO2008049453A1 (en) * 2006-09-27 2008-05-02 Oticon A/S Hearing aid with memory space for functional settings and learned settings, and programming method thereof
EP2182740A1 (en) 2008-10-28 2010-05-05 Siemens Medical Instruments Pte. Ltd. Method for adjusting a hearing device and corresponding hearing device
WO2012066149A1 (en) * 2010-11-19 2012-05-24 Jacoti Bvba Personal communication device with hearing support and method for providing the same
US8208667B2 (en) 2007-08-13 2012-06-26 Siemens Medical Instruments Pte. Ltd. Individually adjustable hearing aid and method for its operation
US8477972B2 (en) 2008-03-27 2013-07-02 Phonak Ag Method for operating a hearing device
US8638949B2 (en) 2006-03-14 2014-01-28 Starkey Laboratories, Inc. System for evaluating hearing assistance device settings using detected sound environment
EP2667640A3 (en) * 2007-04-25 2014-02-19 Daniel R. Schumaier User programable hearing assistance device
US8917891B2 (en) 2010-04-13 2014-12-23 Starkey Laboratories, Inc. Methods and apparatus for allocating feedback cancellation resources for hearing assistance devices
US8942398B2 (en) 2010-04-13 2015-01-27 Starkey Laboratories, Inc. Methods and apparatus for early audio feedback cancellation for hearing assistance devices
US9654885B2 (en) 2010-04-13 2017-05-16 Starkey Laboratories, Inc. Methods and apparatus for allocating feedback cancellation resources for hearing assistance devices
US9729976B2 (en) 2009-12-22 2017-08-08 Starkey Laboratories, Inc. Acoustic feedback event monitoring system for hearing assistance devices
EP2140725B1 (en) * 2007-04-25 2019-10-23 Daniel R. Schumaier User programmable hearing assistance device
WO2024003688A1 (en) * 2022-07-01 2024-01-04 Cochlear Limited Implantable sensor training

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009001559A1 (en) * 2007-06-28 2008-12-31 Panasonic Corporation Environment adaptive type hearing aid
US8831256B2 (en) 2011-12-09 2014-09-09 Cochlear Limited Controlling a link for different load conditions
US11253193B2 (en) 2016-11-08 2022-02-22 Cochlear Limited Utilization of vocal acoustic biomarkers for assistive listening device utilization
EP3874769A4 (en) 2018-10-31 2022-08-03 Cochlear Limited Combinatory directional processing of sound signals
WO2020089757A1 (en) * 2018-11-02 2020-05-07 Cochlear Limited Multiple sound source encoding in hearing protheses

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0883325A2 (en) * 1997-06-02 1998-12-09 The University Of Melbourne Multi-strategy array processor
US6035050A (en) 1996-06-21 2000-03-07 Siemens Audiologische Technik Gmbh Programmable hearing aid system and method for determining optimum parameter sets in a hearing aid
US6044163A (en) 1996-06-21 2000-03-28 Siemens Audiologische Technik Gmbh Hearing aid having a digitally constructed calculating unit employing a neural structure
WO2001076321A1 (en) 2000-04-04 2001-10-11 Gn Resound A/S A hearing prosthesis with automatic classification of the listening environment
US20020021814A1 (en) * 2001-01-23 2002-02-21 Hans-Ueli Roeck Process for communication and hearing aid system

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE428167B (en) * 1981-04-16 1983-06-06 Mangold Stephan PROGRAMMABLE SIGNAL TREATMENT DEVICE, MAINLY INTENDED FOR PERSONS WITH DISABILITY
DE3900588A1 (en) * 1989-01-11 1990-07-19 Toepholm & Westermann REMOTE CONTROLLED, PROGRAMMABLE HOUR DEVICE SYSTEM
EP0674464A1 (en) * 1994-03-23 1995-09-27 Siemens Audiologische Technik GmbH Programmable hearing aid with fuzzy logic controller
DE59410235D1 (en) * 1994-05-06 2003-03-06 Siemens Audiologische Technik Programmable hearing aid
EP0712263B1 (en) * 1994-11-10 2003-01-29 Siemens Audiologische Technik GmbH Programmable hearing aid
EP0712261A1 (en) * 1994-11-10 1996-05-15 Siemens Audiologische Technik GmbH Programmable hearing aid
DE19625639C2 (en) * 1996-06-26 2002-07-18 Siemens Audiologische Technik hearing Aid
US6201875B1 (en) * 1998-03-17 2001-03-13 Sonic Innovations, Inc. Hearing aid fitting system
WO2001020965A2 (en) * 2001-01-05 2001-03-29 Phonak Ag Method for determining a current acoustic environment, use of said method and a hearing-aid
US20030091197A1 (en) * 2001-11-09 2003-05-15 Hans-Ueli Roeck Method for operating a hearing device as well as a hearing device
AU2002224722B2 (en) * 2002-01-28 2008-04-03 Phonak Ag Method for determining an acoustic environment situation, application of the method and hearing aid

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6035050A (en) 1996-06-21 2000-03-07 Siemens Audiologische Technik Gmbh Programmable hearing aid system and method for determining optimum parameter sets in a hearing aid
US6044163A (en) 1996-06-21 2000-03-28 Siemens Audiologische Technik Gmbh Hearing aid having a digitally constructed calculating unit employing a neural structure
EP0883325A2 (en) * 1997-06-02 1998-12-09 The University Of Melbourne Multi-strategy array processor
WO2001076321A1 (en) 2000-04-04 2001-10-11 Gn Resound A/S A hearing prosthesis with automatic classification of the listening environment
US20020021814A1 (en) * 2001-01-23 2002-02-21 Hans-Ueli Roeck Process for communication and hearing aid system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1532841A4

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1696701A2 (en) * 2005-02-23 2006-08-30 Siemens Audiologische Technik GmbH Hearing device and process to monitor the hearing capacity of a hearing impaired person
EP1696701A3 (en) * 2005-02-23 2007-04-25 Siemens Audiologische Technik GmbH Hearing device and process to monitor the hearing capacity of a hearing impaired person
US8085961B2 (en) 2005-02-23 2011-12-27 Siemens Audiologische Technik Gmbh Hearing device and method for monitoring the hearing ability of a person with impaired hearing
US8638949B2 (en) 2006-03-14 2014-01-28 Starkey Laboratories, Inc. System for evaluating hearing assistance device settings using detected sound environment
WO2008049453A1 (en) * 2006-09-27 2008-05-02 Oticon A/S Hearing aid with memory space for functional settings and learned settings, and programming method thereof
AU2006349527B2 (en) * 2006-09-27 2011-03-10 Oticon A/S Hearing aid with memory space for functional settings and learned settings, and programming method thereof
EP2140725B1 (en) * 2007-04-25 2019-10-23 Daniel R. Schumaier User programmable hearing assistance device
EP2667640A3 (en) * 2007-04-25 2014-02-19 Daniel R. Schumaier User programable hearing assistance device
US8208667B2 (en) 2007-08-13 2012-06-26 Siemens Medical Instruments Pte. Ltd. Individually adjustable hearing aid and method for its operation
US8477972B2 (en) 2008-03-27 2013-07-02 Phonak Ag Method for operating a hearing device
US8644535B2 (en) 2008-10-28 2014-02-04 Siemens Medical Instruments Pte. Ltd. Method for adjusting a hearing device and corresponding hearing device
EP2182740A1 (en) 2008-10-28 2010-05-05 Siemens Medical Instruments Pte. Ltd. Method for adjusting a hearing device and corresponding hearing device
US9729976B2 (en) 2009-12-22 2017-08-08 Starkey Laboratories, Inc. Acoustic feedback event monitoring system for hearing assistance devices
US10924870B2 (en) 2009-12-22 2021-02-16 Starkey Laboratories, Inc. Acoustic feedback event monitoring system for hearing assistance devices
US11818544B2 (en) 2009-12-22 2023-11-14 Starkey Laboratories, Inc. Acoustic feedback event monitoring system for hearing assistance devices
US8917891B2 (en) 2010-04-13 2014-12-23 Starkey Laboratories, Inc. Methods and apparatus for allocating feedback cancellation resources for hearing assistance devices
US8942398B2 (en) 2010-04-13 2015-01-27 Starkey Laboratories, Inc. Methods and apparatus for early audio feedback cancellation for hearing assistance devices
US9654885B2 (en) 2010-04-13 2017-05-16 Starkey Laboratories, Inc. Methods and apparatus for allocating feedback cancellation resources for hearing assistance devices
WO2012066149A1 (en) * 2010-11-19 2012-05-24 Jacoti Bvba Personal communication device with hearing support and method for providing the same
US9055377B2 (en) 2010-11-19 2015-06-09 Jacoti Bvba Personal communication device with hearing support and method for providing the same
WO2024003688A1 (en) * 2022-07-01 2024-01-04 Cochlear Limited Implantable sensor training

Also Published As

Publication number Publication date
CA2486893C (en) 2013-12-24
EP1532841A4 (en) 2008-12-24
CA2486893A1 (en) 2003-11-27
AUPS247002A0 (en) 2002-06-13
EP1532841A1 (en) 2005-05-25
JP2005531175A (en) 2005-10-13
JP4658593B2 (en) 2011-03-23

Similar Documents

Publication Publication Date Title
US7889879B2 (en) Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions
CA2486893C (en) Programmable auditory prosthesis with trainable automatic adaptation to acoustic conditions
US8265765B2 (en) Multimodal auditory fitting
US10406359B2 (en) Input selection for an auditory prosthesis
US20090076569A1 (en) Fitting a prosthetic hearing implant for a recipient
US7522960B2 (en) Variable sensitivity control for a cochlear implant
US11596793B2 (en) Shifting of output in a sense prosthesis
WO2018197992A1 (en) Body noise reduction in auditory prostheses
US10003895B2 (en) Selective environmental classification synchronization
CN105142717B (en) The unilateral electroacoustic of fitting for binaural is stimulated
WO2013057718A1 (en) Acoustic prescription rule based on an in situ measured dynamic range
US11589170B2 (en) Generalized method for providing one or more stimulation coding parameters in a hearing aid system for obtaining a perceivable hearing loudness
AU2004240216B2 (en) Programmable Auditory Prosthesis with Trainable Automatic Adaptation to Acoustic Conditions
US20160337768A1 (en) Normalization fitting method
US20220053272A1 (en) Normalization fitting method
AU2002245950B2 (en) Variable sensitivity control for a cochlear implant
AU2002245950A1 (en) Variable sensitivity control for a cochlear implant

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2004506316

Country of ref document: JP

Ref document number: 10993359

Country of ref document: US

Ref document number: 2486893

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 2003720029

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2003720029

Country of ref document: EP