EP3107314A1 - Performance based in situ optimization of hearing aids - Google Patents

Performance based in situ optimization of hearing aids Download PDF

Info

Publication number
EP3107314A1
EP3107314A1 EP15172898.7A EP15172898A EP3107314A1 EP 3107314 A1 EP3107314 A1 EP 3107314A1 EP 15172898 A EP15172898 A EP 15172898A EP 3107314 A1 EP3107314 A1 EP 3107314A1
Authority
EP
European Patent Office
Prior art keywords
hearing aid
signal processing
user
server
performance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP15172898.7A
Other languages
German (de)
English (en)
French (fr)
Inventor
Karl-Fredrik Johan Gran
Aalbert De Vries
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GN Hearing AS
Original Assignee
GN Resound AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GN Resound AS filed Critical GN Resound AS
Priority to EP15172898.7A priority Critical patent/EP3107314A1/en
Priority to US14/788,615 priority patent/US9723415B2/en
Priority to JP2016117350A priority patent/JP2017011699A/ja
Priority to CN201610443990.5A priority patent/CN106257936B/zh
Priority to US15/346,249 priority patent/US9838805B2/en
Publication of EP3107314A1 publication Critical patent/EP3107314A1/en
Priority to US15/630,366 priority patent/US10154357B2/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/50—Customised settings for obtaining desired overall acoustical characteristics
    • H04R25/505—Customised settings for obtaining desired overall acoustical characteristics using digital signal processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/45—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback
    • H04R25/453—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback electronically
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/50—Customised settings for obtaining desired overall acoustical characteristics
    • H04R25/505—Customised settings for obtaining desired overall acoustical characteristics using digital signal processing
    • H04R25/507—Customised settings for obtaining desired overall acoustical characteristics using digital signal processing implemented by neural network or fuzzy logic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/70—Adaptation of deaf aid to hearing loss, e.g. initial electronic fitting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/39—Aspects relating to automatic logging of sound environment parameters and the performance of the hearing aid during use, e.g. histogram logging, or of user selected programs or settings in the hearing aid, e.g. usage logging
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/41—Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/55—Communication between hearing aids and external devices via a network for data exchange

Definitions

  • a new hearing aid system that facilitates determination of listening performance of a user of the hearing aid system and adjustment of a hearing aid for improved listening performance.
  • the adjustment may be based on determined listening performance of users of other hearing aid systems.
  • Today's hearing aids are usually provided with a signal processor and a number of different signal processing algorithms, wherein each algorithm is tailored to particular user preferences and particular categories of sound environment.
  • Signal processing parameters of the various signal processing algorithms are typically determined during an initial fitting session in a dispenser's office and programmed into the hearing aid by activating desired algorithms and setting algorithm parameters in a non-volatile memory area of the hearing aid and/or transmitting desired algorithms and algorithm parameter settings to the non-volatile memory area.
  • an audiologist spends a very limited amount of time on fitting a hearing aid to each patient compared to all the nuances that are associated with hearing loss. Diagnostic procedures exist which would optimize the prescribed hearing aid parameters to maximize the benefit that the patient would get out of their hearing instruments. Unfortunately, the time needed to carry out these procedures is prohibitive for the audiologist and instead they often resort to an automatic fitting procedure with minimal personalization. This results in several return visits to the audiologist for the patient, alternatively that the patient gives up and deems the hearing instrument as being more of a burden than a benefit and the instrument ends up not being used.
  • the fitting procedure is based on a parametric model defined by the hearing aid manufacturer.
  • This model can be based on e.g. loudness perception, cochlear compression modelling and/or audibility threshold shifts. This implies that the solution space and the possible hearing aid configurations are limited to what the designing scientists think they know about hearing loss, or essentially how good the hearing loss model is in predicting listening performance of the individual patient.
  • the hearing loss model that is typically used is fundamentally wrong. For instance, if the hearing aid is fitted to compensate exactly for the modelled loss of compression in the cochlea, the sound will be uncomfortably loud, which indicates that the model is flawed.
  • Another example of where the model breaks down is when trying to fit hearing impaired subjects with similar or close to identical audiograms but different levels of cognition; here, the higher performing subjects benefit from syllabic compression whereas the lower performing patients benefit more from longer time constants in the compression.
  • the challenge is that the optimization of the hearing aid is based on adjusting a model that is believed to be correlated with listener performance, when it really isn't.
  • a parametric model does not have the ability to change fundamental behaviour even if new knowledge is unveiled that change the nature of the data.
  • hearing aid systems are provided facilitating determination of listening performance of its users and forming part of an in situ fitting system with at least one server configured for adjusting signal processing parameters of hearing aids of the hearing aid systems for improved listening performance of its users.
  • an in situ fitting system configured for adjusting hearing aid signal processing parameters of a plurality of hearing aid systems during normal use of the hearing aid systems
  • at least one server interconnected with the plurality of hearing aid systems, each of which comprises a hearing aid with a microphone for provision of an audio signal in response to sound signals received at the microphone from a sound environment, a processor that is configured to process the audio signal in accordance with a signal processing algorithm F n ( ⁇ n ), where ⁇ n is a set of signal processing parameters of signal processing algorithm F n , to generate a hearing loss compensated audio signal, an output transducer for providing an output signal to a user of the hearing aid system based on the hearing loss compensated audio signal, and a server interface configured for data communication with the at least one server, for each of the hearing aid systems, a performance detector associated with the respective one of the hearing aid systems and configured for determining listening performance of a user of the associated hearing aid system, and wherein the at least one server is configured for determining a value of one of the signal
  • Information on the signal processing parameter value may be transmitted in the form of a control signal suitable for transmission to the hearing aid in question, the control signal being decoded in the hearing aid and subsequently control the hearing aid to set the signal processing parameter to the determined value upon receipt by the hearing aid.
  • the information may be the determined value itself that is encoded into a form suitable for transmission to the hearing aid.
  • the in situ fitting system performs adjustment of hearing aid signal processing parameters n, ⁇ n during normal use of the respective hearing aid, i.e. while the hearing aid is worn in its intended position at the ear of a user and performing hearing loss compensation in accordance with the individual hearing loss of the respective user wearing the hearing aid.
  • the adjustment is performed in response to listening performance of one or more users as determined by the respective one or more performance detectors configured for determining listening performance relating to how well users are able to hear and respond to sound received by hearing aids worn by the users.
  • the in situ fitting system may be configured for automatic adjustment of at least one signal processing parameter ⁇ i ⁇ ⁇ n in the hearing aid system with the library of signal processing algorithms F n ( ⁇ n ), where ⁇ n is the set of parameters of signal processing algorithm F n , including values of the index parameter n controlling selection of one or more algorithms for execution, e.g. a noise suppression algorithm may be selected for execution in a noisy environment and may not be selected for execution in a quiet environment.
  • n is also a signal processing parameter and may be automatically adjusted by the in situ fitting system.
  • the in situ fitting system comprises at least one server for provision of computing power and memory resources required for its functioning.
  • the at least one server may comprise the performance detectors of, or associated with, the plurality of hearing aid systems and may be configured for receiving data from the plurality of hearing aid systems relating to the listening performance of its users and may be configured for determining user listening performance based on the received data and determining signal processing parameters for the hearing aids of the plurality of hearing aid systems in response to the determined user listening performance in order to improve the listening performance.
  • the at least one server may reside in a cloud computing network and/or in a grid computing network and/or another form of computing network for provision of the required computing resources for proper functioning of the in situ fitting system.
  • the hearing aid system may comprise a binaural hearing aid system with two hearing aids, one for the right ear and one for the left ear of the user of the hearing aid system.
  • the hearing aid system may comprise a second hearing aid with a second microphone for provision of a second audio input signal in response to sound signals received at the second microphone, a second processor that is configured to process the second audio input signal in accordance with a second signal processing algorithms F n ( ⁇ n ) to generate a second hearing loss compensated audio signal, and a second output transducer for providing a second acoustic output signal based on the second hearing loss compensated audio signal.
  • a second hearing aid with a second microphone for provision of a second audio input signal in response to sound signals received at the second microphone
  • a second processor that is configured to process the second audio input signal in accordance with a second signal processing algorithms F n ( ⁇ n ) to generate a second hearing loss compensated audio signal
  • a second output transducer for providing a second acoustic output signal based on the second hearing loss compensated audio signal.
  • the circuitry of the second hearing aid is preferably identical to the circuitry of the first hearing aid apart from the fact that the second hearing aid, typically, is adjusted to compensate a hearing loss that is different from the hearing loss compensated by the first hearing aid, since; typically, binaural hearing loss differs for the two ears.
  • the in situ fitting system may be configured for automatic adjustment of at least one signal processing parameter ⁇ i ⁇ ⁇ n of the second processor with the library of signal processing algorithms F n ( ⁇ n ), where ⁇ n is the set of parameters of signal processing algorithm F n , including values of the index parameter n controlling selection of one or more algorithms for execution, e.g. a noise suppression algorithm may be selected for execution in a noisy environment and may not be selected for execution in a quiet environment.
  • the signal processing algorithms of the first and second signal processors are selected in a coordinated way. Since sound environment characteristics may differ significantly at the two ears of a user, it will often occur that independent determination of category of the sound environment at the two ears of a user differs, and this may lead to undesired different signal processing of sounds in the hearing aids. Thus, preferably the signal processing algorithms of the first and second processors are selected based on the same signals, such as sound signals received at a hand-held device of the hearing aid system, or both sound signals received at the left ear and sound signals received at the right ear, or a combination of sound signals received at the hand-held device and sound signals received at the left ear and sound signals received at the right ear, etc.
  • the user listening performance relates to the user's ability to understand speech.
  • the performance detector associated with the hearing aid system used by the user may for example reside in a server and sound received by a hearing aid of the hearing aid system may be transmitted to the performance detector residing in the server together with speech spoken by the user, and the performance detector may be configured for speech recognition and for evaluating the speech of the user in the context of speech received from another person by the hearing aid of the user and providing a performance value that reflects how well the user's speech fits the context.
  • the performance detector may rely on a statistical model of probable responses to a given external speech token. For example, the performance detector may compute the probability of each response to a given input. The performance detector or another part of the in situ fitting system may then measure the response of the user. If the user's response is highly probable, then he/she probably understood the input. The obtained information may also be used to adapt the signal processing so that the probability is maximized.
  • the performance detector may comprise voice recognition for recognizing words spoken by the user of the hearing aid system for separation of the user's speech from speech by others as received by the hearing aid.
  • the hearing aid of the hearing aid system of the user may have a directional array of microphones targeted at the user's mouth when the hearing aid is worn in its operational position by the user for spatial separation of the user's speech from speech by others.
  • the hearing aid may have a microphone residing in the ear canal of the user for reception of bone conducted speech from the user when the hearing aid is worn in its operational position by the user for separation of the user's speech from speech by others.
  • the hearing aid of the hearing aid system may have a microphone system configured for recording of the user's own voice and wherein the performance detector is configured for determining listening performance of the user of the hearing aid system based on the recorded user's own voice and recorded sound from the sound environment.
  • the listening performance may relate to time to user response from reception of speech and optionally, the at least one server may be configured to determine at least one gain value for improved speech audibility.
  • the listening performance may relate to speech understanding of the user and optionally, the at least one server may be configured to determine a signal processing parameter for improved speech understanding.
  • the performance detector may relate a current user response to speech to a statistical model based on previous performance of the user and other users for determination of the user's performance.
  • One or more hearing aid systems of the plurality of hearing aid systems may comprise a direction of arrival detector configured for determination of the direction of arrival of sound at a hearing aid of the hearing aid system comprising the direction of arrival detector and optionally, an orientation sensor configured for determination of a looking direction of the user of the hearing aid system comprising the direction of arrival detector during arrival of the sound.
  • the performance detector may be configured for comparison of the determined direction of arrival of the sound and the time from arrival of speech until the user changes his or her looking direction towards the determined direction of arrival of the speech for example determined with an orientation sensor in one or both hearing aids of the hearing aid system.
  • the performance detector may be configured for comparison of the determined direction of arrival of the sound and the resulting forward looking direction of the user.
  • the at least one server may be configured for determination of a signal processing parameter value of the hearing aid comprising the direction of arrival detector based on the comparison, and transmission of the signal processing parameter value to the hearing aid system with the hearing aid comprising the direction of arrival detector, and wherein the processor of the hearing aid comprising the direction of arrival detector is configured for adjusting the signal processing parameter to the received value, e.g. increasing a gain value at a frequency of the received speech, whereby the time used for responding to speech from another direction than the looking direction is decreased.
  • the hearing aid systems and the at least one server may transmit data to each other and receive data from each other through a wired or wireless network with their respective communication interfaces.
  • Examples of the network may include the Internet, a local area network (LAN), a wireless LAN, a wide area network (WAN), and a personal area network (PAN), either alone or in any combination.
  • the network may include, or be constituted by, another type of network.
  • At least one hearing aid system of the plurality of hearing aid systems may comprise a hand-held device communicatively coupled with the hearing aid(s) of the hearing aid system, and configured for interconnecting the hearing aid(s) with the at least one server.
  • the hearing aid system and the at least one server may transmit data to each other and receive data from each other through the hand-held device, and the hearing aid system is provided with the further communication resources and computing capabilities of the hand-held device.
  • the hand-held device may be, or include, a notebook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet computer (PC), a GPS receiver, a mobile phone, a smart phone, e.g. an Iphone, an Android phone, windows phone, etc., e.g. with a GPS receiver, and a calendar system, etc., or any other portable device capable of communicating with the at least one server and the hearing aid.
  • PDA personal digital assistant
  • PMP portable multimedia player
  • PC tablet computer
  • GPS receiver GPS receiver
  • At least one hearing aid system of the plurality of hearing aid systems may have a hearing aid with an interface for connection with a Wide-Area-Network, such as the Internet.
  • At least one hearing aid system of the plurality of hearing aid systems may have a hearing aid that accesses the Wide-Area-Network through a mobile telephone network, such as GSM, IS-95, UMTS, CDMA-2000, etc.
  • a mobile telephone network such as GSM, IS-95, UMTS, CDMA-2000, etc.
  • At least one hearing aid system of the plurality of hearing aid systems may have a hearing aid comprising a data interface for transmission of data and/or control signals between the hearing aid and the hand-held device and optionally other parts of the hearing aid system, e.g. including another hearing aid of the hearing aid system.
  • the data interface may be a wired interface, e.g. a USB interface, or a wireless interface, such as a Bluetooth interface, e.g. a Bluetooth Low Energy interface.
  • a wired interface e.g. a USB interface
  • a wireless interface such as a Bluetooth interface, e.g. a Bluetooth Low Energy interface.
  • the hearing aid may comprise an audio interface for reception of an audio signal from the hand-held device and possibly other audio signal sources.
  • the audio interface may be a wired interface or a wireless interface.
  • the data interface and the audio interface may be combined into a single interface, e.g. a USB interface, a Bluetooth interface, etc.
  • the hearing aid may for example have a Bluetooth Low Energy data interface for exchange of sensor and control signals between the hearing aid and the hand-held device, and a wired audio interface for exchange of audio signals between the hearing aid and the hand-held device.
  • the hand-held device has an interface for connection with the wired or wireless network through which the hand-held device and the at least one server may transmit data to each other and receive data from each other.
  • the network may include the Internet, a local area network (LAN), a wireless LAN, a wide area network (WAN), and a personal area network (PAN), either alone or in any combination.
  • the network may include, or be constituted by, another type of network.
  • the hand-held device may access the network through a mobile telephone network, such as GSM, IS-95, UMTS, CDMA-2000, etc.
  • a mobile telephone network such as GSM, IS-95, UMTS, CDMA-2000, etc.
  • the hand-held device may have access to electronic time management and communication tools used by the user for communication and for storage of time management and communication information relating to the user.
  • the tools and the stored information typically reside on a remote at least one server accessed through the network.
  • the at least one server may have access to a performance model based on determined listening performance of a plurality of users of the plurality of hearing aid systems, and wherein the at least one server is configured for determination of a signal processing parameter value of a hearing aid based on the determined listening performance of the user of the hearing aid system and the performance model.
  • the performance model may include at least one user parameter selected from the group consisting of the user audiogram, age, sex, race, and native language so that signal processing parameters determined based on the model may vary for different user parameter values.
  • the performance model may include a hearing loss model, e.g. one of the hearing loss models mentioned in EP 2 871 858 A1 .
  • the performance model may include various sound environment categories so that signal processing parameters determined based on the model may vary for different sound environment categories.
  • the at least one server may be configured for forming the performance model based on listening performance determinations and optionally other user related data, such as the user audiogram and/or age and/or sex and/or race and/or native language, etc., and optionally sound environment categories.
  • the performance model may include a Bayesian statistical model, a neural network, data clustering, support vector machines, etc.
  • the hearing aid When a hearing aid is fitted to a user for the first time, the hearing aid may be adjusted for maximum listening performance of the user based on the performance model of the in situ fitting system.
  • signal processing parameters may be adjusted by the at least one server of the in situ fitting system in response to performance determinations during use since the latest signal processing parameter adjustment and in response to possible updating of the performance model, e.g. in response to performance determinations received from a plurality of hearing aid systems.
  • Performance determinations are performed during normal use of the hearing aid systems.
  • the at least one server may be configured for updating the performance model based on received performance determinations.
  • the performance determinations may be performed frequently during use, e.g. once every hour, e.g. once every 10 minutes, e.g. once every 5 minutes, e.g. once every 2 minutes, e.g. once every minute.
  • a hearing aid may comprise the performance detector of the hearing aid system, or a part of the performance detector of the hearing aid system, and may transmit data of determined performance to the at least one server during normal use of the hearing aid, e.g. once every hour, once every 10 minutes, once every 5 minutes, once every 2 minutes, or, once every minute.
  • At least one hearing aid system of the plurality of hearing aid systems may have a hand-held device that is interconnected with a hearing aid of the at least one hearing aid system and that comprises the performance detector of the hearing aid system that is configured for determination of listening performance of the user of the hearing aid system.
  • the performance detector may reside remote from the hearing aid system, interconnected with the at least one server; or, forming part of the at least one server, thereby benefitting from the large amount of computing resources available in the at least one server and interconnecting networks.
  • the at least one server may comprise all performance detectors of the plurality of hearing aid systems.
  • a hearing aid may comprise a location detector configured for determining a geographical position of the hearing aid and the at least one server may be configured for recording of the geographical position of the hearing aid and the hearing aid system comprising the hearing aid, and incorporation of the geographical position in the performance model.
  • At least one hearing aid system of the plurality of hearing aid systems may have a hand-held device that is interconnected with a hearing aid of the at least one hearing aid system and that comprises a location detector configured for determining a geographical position of the hearing aid system and the at least one server may be configured for recording of the geographical position of the hearing aid system, and incorporation of the geographical position in the performance model.
  • the location detector residing in the hand-held device benefits from the larger computing resources and power supply typically available in the hand-held device as compared with the limited computing resources and power available in the hearing aid.
  • the location detector may include at least one of a GPS receiver, a calendar system, a WIFI network interface, a mobile phone network interface, for determining the geographical position of the hearing aid system and optionally the velocity of the hearing aid system.
  • GPS signal strength of signals received by the GPS receiver decreases significantly when the hearing aid system is inside a building and thus, information on GPS signal strength may be used by the location detector to determine whether the hearing aid system is inside a building.
  • Information on moving speed as for example determined by the GPS receiver may be used by the location detector to determine that the hearing aid system is inside a transportation vehicle, such as in a car.
  • the location detector may determine the geographical position of the hearing aid system based on the postal address of a WIFI network the hearing aid system may be connected to, or by triangulation based on signals possibly received from various GSM-transmitters as is well-known in the art of mobile phones. Further, the location detector may be configured for accessing a calendar system of the user to obtain information on the expected whereabouts of the user, e.g. meeting room, office, canteen, restaurant, home, etc. and to include this information in the determination of the geographical position. Thus, Information from the calendar system of the user may substitute or supplement information on the geographical position determined by otherwise, e.g. by a GPS receiver.
  • GPS signals may be absent or so weak that the geographical position cannot be determined by a GPS receiver.
  • Information from the calendar system on the whereabouts of the user may then be used to provide information on the geographical position, or information from the calendar system may supplement information on the geographical position, e.g. indication of a specific meeting room may provide information on which floor in a high rise building, the hearing aid system is located. Information on height is typically not available from a GPS receiver.
  • the location detector may automatically use information from the calendar system, when the geographical position cannot be determined otherwise, e.g. when the GPS-receiver is unable to provide the geographical position.
  • At least one hearing aid system of the plurality of hearing aid systems may have a sound environment detector associated with it and configured for determination of the sound environment surrounding the respective hearing aid system based on sound signals received by the respective hearing aid system, e.g. from one hearing aid of the hearing aid system; or, from two hearing aids of the hearing aid system.
  • the sound environment detector may determine a category of the sound environment surrounding the respective hearing aid, such as speech, babble speech, restaurant clatter, music, traffic noise, etc.
  • a hearing aid of the hearing aid system may comprise the sound environment detector; or a part of the sound environment detector.
  • At least one hearing aid system of the plurality of hearing aid systems may have a hand-held device that is interconnected with a hearing aid of the at least one hearing aid system and that comprises the sound environment detector of, or associated with, the hearing aid system.
  • the sound environment detector residing in the hand-held device benefits from the larger computing resources and power supply typically available in the hand-held device as compared with the limited computing resources and power available in the hearing aid.
  • the sound environment detector of a hearing aid system may be configured to transmit information on the determined sound environment, e.g. information on the determined category of the sound environment, to the at least one server.
  • the sound environment detector may reside remote from the hearing aid system, interconnected with the at least one server; or, forming part of the at least one server, thereby benefitting from the large amount of computing resources available in the at least one server and interconnecting networks.
  • the at least one server may comprise all sound environment detectors of the plurality of hearing aid systems.
  • the at least one server may be configured for determination of a signal processing parameter values of a hearing aid of a hearing aid system based on the category of the sound environment of the hearing aid system determined by the sound environment detector, and for transmission of the signal processing parameter value to the hearing aid, and wherein the processor of the hearing aid may be configured for adjusting the signal processing parameter to the received value for improved listening performance in the determined sound environment.
  • the sound environment detector may be configured for determining the category of the sound environment surrounding a specific hearing aid system of the plurality of hearing aid systems based on the sound received by the hearing aid system, and optionally on the determined geographical position of the hearing aid system as determined by the location detector, and optionally on at least one parameter selected from the group consisting of: A date, a time of day, a velocity of the hearing aid system, and a signal strength of a signal received by the GPS receiver.
  • the sound environment detector may categorize the sound environment in a conventional way based on the received sound signal; or, the hearing aid may be set to operate in a mode selected by the user, e.g. previously during a fitting session, or when the situation occurs.
  • the sound environment at a specific geographical position may change in a repetitive way during the year in a similar way from one year to another and/or during a day in a similar way from one day to another, e.g. due to repeated variations in traffic, number of people, etc., and such variations may be taken into account by allowing the sound environment detector to include the date and/or the time of day in the determining the category of sound environment.
  • Obtained classification results may be utilised in the hearing aid to automatically select signal processing characteristics of the hearing aid, e.g. to automatically switch to the most suitable signal processing algorithm and parameters for the environment category in question.
  • Such a hearing aid will be able to automatically maintain optimum sound quality and/or speech intelligibility for the individual hearing aid user in various categories of sound environments.
  • the sound environment detector may be configured for determining the category of the sound environment surrounding the user of the hearing aid system based on the sound signals received at both hearing aids and optionally the geographical position of the hearing aid system.
  • the hearing aid system may be configured for transmitting signal processing parameters together with GPS-data to the at least one server for inclusion in the performance model, e.g., for sharing of hearing aid signal processing parameter values at various geographical locations with other hearing aid system users.
  • the hearing aid system may be configured for retrieving a hearing aid signal processing parameter value from the at least one server at the current geographical location, e.g. based on hearing profile similarities and/or age and/or race and/or ear size, etc., and the performance model.
  • At least one of the hearing aid systems may have a hearing aid comprising a user interface allowing a user of the hearing aid system comprising the hearing aid, to make adjustment of at least one signal processing parameter ⁇ ⁇ ⁇ .
  • At least one hearing aid system of the plurality of hearing aid systems may have a hand-held device that is interconnected with a hearing aid of the at least one hearing aid system and that comprises a user interface allowing a user of the hearing aid system comprising the hearing aid, to make adjustment of at least one signal processing parameter ⁇ ⁇ ⁇ .
  • the user interface residing in the hand-held device benefits from the larger computing resources and power supply typically available in the hand-held device as compared with the limited computing resources and power available in the hearing aid.
  • the user may not be satisfied with the automatic selection of parameter values performed by the at least one server and may perform an adjustment of signal processing parameters using the user interface, e.g. the user may change the current selection of signal processing algorithm to another signal processing algorithm, e.g. the user may switch from a directional signal processing algorithm to an omni-directional signal processing algorithm; or, the user may adjust a parameter value, e.g. the volume.
  • the in situ fitting system may be configured for incorporation of user adjustments in the determination of signal processing parameter values, e.g. the at least one server may be configured for recording the adjustment of the at least one signal processing parameter ⁇ ⁇ ⁇ made by the user of the hearing aid system, and incorporating the adjustment in the performance model.
  • the at least one server of the in situ fitting system may be configured for recording an adjustment made by the user of the hearing aid system, and modifying the automatic adjustment of the at least one signal processing parameter ⁇ ⁇ ⁇ n in response to the recorded adjustment based on a learning algorithm, e.g. Bayesian incremental preference elicitation, so that the next time the same listening condition, e.g. the same sound environment, is detected, the modified automatic adjustment is performed.
  • a learning algorithm e.g. Bayesian incremental preference elicitation
  • the in situ fitting system makes it possible to effectively learn a complex relationship between desired adjustments of signal processing parameters relating to various listening conditions and corrective user adjustments that are a personal, time-varying, nonlinear, and stochastic.
  • the formation and/or adjustment of the performance model may include Bayesian machine learning and/or neural networks and/or data clustering, etc.
  • the hearing aid may be of any type configured to be head worn at, and shifting position and orientation together with, the head, such as a BTE, a RIE, an ITE, an ITC, a CIC, etc., hearing aid.
  • GPS receiver is used to designate a receiver of satellite signals of any satellite navigation system that provides location and time information anywhere on or near the Earth, such as the satellite navigation system maintained by the United States government and freely accessible to anyone with a GPS receiver and typically designated "the GPS-system", the Russian GLObal NAvigation Satellite System (GLONASS), the European Union Galileo navigation system, the Chinese Compass navigation system, the Indian Regional Navigational 20 Satellite System, etc., and also including augmented GPS, such as StarFire, Omnistar, the Indian GPS Aided Geo Augmented Navigation (GAGAN), the European Geostationary Navigation Overlay Service (EGNOS), the Japanese Multifunctional Satellite Augmentation System (MSAS), etc.
  • GAGAN Indian GPS Aided Geo Augmented Navigation
  • EGNOS European Geostationary Navigation Overlay Service
  • MSAS Japanese Multifunctional Satellite Augmentation System
  • augmented GPS a network of ground-based reference stations measure small variations in the GPS satellites' signals, correction messages are sent to the GPS system satellites that broadcast the correction messages back to Earth, where augmented GPS-enabled receivers use the corrections while computing their positions to improve accuracy.
  • the International Civil Aviation Organization (ICAO) calls this type of system a satellite-based augmentation system (SBAS).
  • the hearing aid may further comprise one or more orientation sensors, such as gyroscopes, e.g. MEMS gyros, tilt sensors, roll ball switches, etc., configured for outputting signals for determination of orientation of the head of a user wearing the hearing aid, e.g. one or more of head yaw, head pitch, head roll, or combinations hereof, e.g. inclination or tilt.
  • orientation sensors such as gyroscopes, e.g. MEMS gyros, tilt sensors, roll ball switches, etc.
  • a calendar system is a system that provides users with an electronic version of a calendar with data that can be accessed through a network, such as the Internet.
  • Well-known calendar systems include, e.g., Mozilla Sunbird, Windows Live Calendar, Google Calendar, Microsoft Outlook with Exchange Server, etc.
  • tilt denotes the angular deviation from the heads normal vertical position, when the user is standing up or sitting down.
  • the tilt in a resting position of the head of a person standing up or sitting down, the tilt is 0°, and in a resting position of the head of a person lying down on the person's back, the tilt is 90°.
  • the signal processing algorithms may comprise a plurality of sub-algorithms or sub-routines that each performs a particular subtask in the signal processing algorithm.
  • the signal processing algorithm may comprise different signal processing sub-routines such as frequency selective filtering, single or multi-channel compression, adaptive feedback cancellation, speech detection and noise reduction, etc.
  • the signal processing algorithms will have one or several related algorithm parameters. These algorithm parameters can usually be divided into a number of smaller parameters sets, where each such algorithm parameter set is related to a particular part of the signal processing algorithms or to particular sub-routines. These parameter sets control certain characteristics of their respective algorithms or subroutines such as corner-frequencies and slopes of filters, compression thresholds and ratios of compressor algorithms, filter coefficients, including adaptive filter coefficients, adaptation rates and probe signal characteristics of adaptive feedback cancellation algorithms, etc.
  • Values of the algorithm parameters are preferably intermediately stored in a volatile data memory area of the processing means such as a data RAM area during execution of the respective signal processing algorithms or sub-routines.
  • Initial values of the algorithm parameters are stored in a non-volatile memory area such as an EEPROM/Flash memory area or battery backed-up RAM memory area to allow these algorithm parameters to be retained during power supply interruptions, usually caused by the user's removal or replacement of the hearing aid's battery or manipulation of an ON/OFF switch.
  • Signal processing in the new hearing aid system may be performed by dedicated hardware or may be performed in a signal processor, or performed in a combination of dedicated hardware and one or more signal processors.
  • processor As used herein, the terms "processor”, “signal processor”, “controller”, “system”, etc., are intended to refer to CPU-related entities, either hardware, a combination of hardware and software, software, or software in execution.
  • a "processor”, “signal processor”, “controller”, “system”, etc. may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
  • processor designate both an application running on a processor and a hardware processor.
  • processors may reside within a process and/or thread of execution, and one or more "processors”, “signal processors”, “controllers”, “systems”, etc., or any combination hereof, may be localized on one hardware processor, possibly in combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
  • a processor may be any component or any combination of components that is capable of performing signal processing.
  • the signal processor may be an ASIC processor, a FPGA processor, a general purpose processor, a microprocessor, a circuit component, or an integrated circuit.
  • FIG. 1 A first figure.
  • Fig. 1 schematically illustrates a in situ fitting system 100 configured for adjusting signal processing parameters of a plurality of hearing aid systems during normal use of the hearing aid systems, i.e. while the hearing aid systems are worn by their respective users providing hearing loss compensated sound signals to the users.
  • the in situ fitting system 100 comprises a plurality of hearing aid systems 10, each of which is worn by a respective one of a plurality of users, User A, User B, ... , User N, and each of which comprises a binaural hearing aid system 10 with a first hearing aid 12A performing hearing loss compensation of one ear of the user and a second hearing aid 12B performing hearing loss compensation of the other ear of the user.
  • Some of the hearing aid systems 10 forming part of the in situ fitting system 100 may have a single monaural hearing aid 12 (not shown).
  • Each of the hearing aid systems 10 also comprises a hand-held device 30 that provides the hearing aid system 10 with a network interface for interconnection of the hearing aids 12A, 12B of the hearing aid system 10 with one or more servers 110 through one or more networks 120.
  • the servers 110 are interconnected through the one or more networks 120 as is well-known in the art of computer networks, such as in the art of cloud computing, grid computing, etc.
  • the servers 110 are interconnected and configured for determination of signal processing parameter values of hearing aids 12A, 12B interconnected with the servers 110 through the one or more networks 120 for improved listening performance of the users of the hearing aid systems 10 comprising the hearing aids.
  • a determination of a signal processing parameter value of a hearing aid 12A, 12B of a hearing aid system 10 of a user is based on determined listening performance of the user.
  • a performance detector (not shown) of the hearing aid system 10 is configured for determining the listening performance of the user.
  • the performance detector may reside in one of the hearing aids 12A, 12B of the hearing aid system 10, or in the hand-held device 30, or in one of the servers 110, or parts of the performance detector may reside in one or more of the hearing aids 12A, 12B of the hearing aid system 10 and the hand-held device 30 and the one or more severs 110.
  • the performance detector transmits information on the determined listening performance of the user to the one or more servers 110 and the one or more servers determine one or more processing parameter values of one or two hearing aids 12A, 12B of one or more hearing aid systems 10 based on the transmitted information.
  • the one or more servers 110 transmit the determined one or more signal processing parameter values to the respective hearing aids through the one or more networks 110 in order to obtain improved listening performance of the users of the hearing aids receiving the determined signal processing parameter values and adjusting the signal processing parameter to the received value.
  • At least one of the servers 110 has access to a statistical performance model (not shown) based on determined listening performance of a plurality of users of the plurality of hearing aid systems, and the at least one server 110 is configured for determination of a signal processing parameter value of a hearing aid 12A, 12B based on the determined listening performance of the user of the hearing aid system 10 and the performance model.
  • the performance model may include at least one user parameter selected from the group consisting of the user audiogram, age, sex, race, height, and native language.
  • the performance model may include a hearing loss model, e.g. one of the hearing loss models mentioned in EP 2 871 858 A1 .
  • the performance model may include various sound environment categories so that signal processing parameters determined based on the model may vary for different sound environment categories.
  • the illustrated in situ fitting system 100 has a sound environment detector configured for determination of the sound environment surrounding the individual hearing aid systems 10 based on sound signals received by the respective individual hearing aid systems 10, e.g. from one hearing aid 12A, 12B of the respective hearing aid system 10; or, from two hearing aids 12A, 12B of the respective hearing aid system 10.
  • the sound environment detector may determine a category of the sound environment surrounding the respective hearing aid, such as speech, babble speech, restaurant clatter, music, traffic noise, etc.
  • a hearing aid 12A, 12B of the hearing aid system 10 may comprise the part of the sound environment detector that is configured for determination of the sound environment surrounding the hearing aid 12A, 12B in question.
  • At least one hearing aid system 10 of the plurality of hearing aid systems may have a hand-held device 30 that is interconnected with a hearing aid 12A, 12B of the at least one hearing aid system 10 and that comprises the part of the sound environment detector that is configured for determination of the sound environment surrounding the hearing aid 12A, 12B in question.
  • the part of the sound environment detector residing in the hand-held device 30 benefits from the larger computing resources and power supply typically available in the hand-held device 30 as compared with the limited computing resources and power available in the hearing aid 12A, 12B.
  • a part of the sound environment detector residing in a hearing aid system 10 may be configured to transmit information on the determined sound environment, e.g. information on the determined category of the sound environment, to the at least one server 110.
  • the sound environment detector may reside remote from the hearing aid systems 10, interconnected with the at least one server 110; or, forming part of the at least one server 110, thereby benefitting from the large amount of computing resources available in the at least one server 110 and interconnecting networks 120.
  • the at least one server 110 may comprise all parts of the sound environment detector of the in situ fitting system 100.
  • the at least one server 110 may be configured for determination of a signal processing parameter value of a hearing aid 12A, 12B of a hearing aid system 10 based on the category of the sound environment of the hearing aid system 10 determined by the sound environment detector, and for transmission of the signal processing parameter value to the hearing aid 12A, 12B, and the processor of the hearing aid 12A, 12B may be configured for adjusting the signal processing parameter to the received value for improved listening performance of the user of the hearing aid system 10 in the determined sound environment.
  • the at least one server may be configured for forming the performance model based on listening performance determinations and optionally other user related data, such as the user audiogram and/or age and/or sex and/or race and/or height and/or native language, etc., and optionally sound environment categories.
  • Fig. 2 schematically illustrates a BTE hearing aid 12 comprising a BTE hearing aid housing (not shown - outer walls have been removed to make internal parts visible) to be worn behind the pinna 200 of a user.
  • the BTE housing (not shown) accommodates a front microphone 14 and a rear microphone 16 for conversion of a sound signal into a microphone audio sound signal, optional pre-filters (not shown) for filtering the respective microphone audio sound signals, A/D converters (not shown) for conversion of the respective microphone audio sound signals into respective digital microphone audio sound signals that are input to a signal processor 18 configured to generate a hearing loss compensated output signal based on the input digital audio sound signals.
  • the hearing loss compensated output signal is transmitted through electrical wires contained in a sound signal transmission member 20 to a receiver 22 for conversion of the hearing loss compensated output signal to an acoustic output signal for transmission towards the eardrum of a user and contained in an earpiece 24 that is shaped (not shown) to be comfortably positioned in the ear canal of a user for fastening and retaining the sound signal transmission member in its intended position in the ear canal of the user as is well-known in the art of BTE hearing aids.
  • the earpiece 24 also holds one microphone 26 that is positioned for abutment of a wall of the ear canal when the earpiece is positioned in its intended position in the ear canal of the user for reception of the user's own voice utilizing bone conduction of the voice to the microphone 26.
  • the microphone 26 is connected to an A/D converter (not shown) and optional to a pre-filter (not shown) in the BTE housing 12, with interconnecting electrical wires (not visible) contained in the sound transmission member 20.
  • the BTE hearing aid 12 is powered by battery 28.
  • the signal processor 18 is configured for execution of a number of different signal processing algorithms of a library of signal processing algorithms F n ( ⁇ n ) stored in a non-volatile memory (not shown) connected to the signal processor 18.
  • Each signal processing algorithm F n ( ⁇ n ), or a combination of them, is tailored to particular user preferences and particular categories of sound environment.
  • ⁇ n is the set of parameters of signal processing algorithm F n .
  • Initial settings of signal processing parameters of the various signal processing algorithms are typically determined during an initial fitting session in a dispenser's office and programmed into the hearing aid by activating desired algorithms and setting algorithm parameters in a non-volatile memory area of the hearing aid and/or transmitting desired algorithms and algorithm parameter settings to the non-volatile memory area.
  • the in situ fitting system shown in Fig. 1 is configured for automatic adjustment of at least one signal processing parameter ⁇ i ⁇ ⁇ n in the hearing aid 12 with the library of signal processing algorithms F n ( ⁇ n ).
  • Fig. 3 shows the hearing aid 12 in its operating position with the BTE housing 60 behind the ear, i.e. behind the pinna 200, of the user.
  • the hearing aid 12 may have an arm 64 that is flexible and intended to be positioned inside the pinna 200, e.g. around the circumference of the conchae behind the tragus and antitragus and abutting the antihelix and at least partly covered by the antihelix for retaining the earpiece 24 in its intended position inside the outer ear of the user.
  • the arm may be pre-formed during manufacture, preferably into an arched shape with a curvature slightly larger than the curvature of the antihelix, for easy fitting of the arm into its intended position in the pinna 200.
  • the earpiece 25 may also accommodate a microphone positioned at the entrance to the ear canal for reception of incoming sound and for provision of a corresponding output signal that may be combined with output signals from one or more microphones accommodated in the BTE housing 60.
  • Fig. 3 also schematically illustrates a fitting instrument 70 and its wireless interconnections with a network 120, such as the Internet and forming part of the in situ fitting system 100.
  • a network 120 such as the Internet
  • Data relating to a hardware and/or software configuration of the hearing aid 12 may be transmitted wirelessly 80 to the fitting instrument 70, e.g. to be displayed on a display of the fitting instrument 70 for verification by the operator of the fitting instrument 70, and possible corrective action in the event that the configuration of the hearing aid differs from the intentions.
  • the fitting instrument 70 is configured for performing initial fitting of the hearing aid 12 in accordance with information received from the one or more servers of the in situ fitting system 100, e.g. with new values of fitting parameters based on recent updates of the performance model. whereby the fitting instrument 70 selects parameters that maximize the predicted listening performance of the user given the received information, such as audiogram, age, performance of similar users, etc.
  • Fig. 4 schematically illustrates components and circuitry of a hearing aid system 10 forming part of the in situ fitting system 100 shown in Fig. 1 and having a first hearing aid 12A, e.g. for the left ear, with an orientation sensor 44, a second hearing aid 12B, e.g. for the right ear, and a hand-held device 30 with a GPS receiver 42, a sound environment detector 34 and a user interface 38.
  • a first hearing aid 12A e.g. for the left ear
  • an orientation sensor 44 e.g. for the right ear
  • a hand-held device 30 with a GPS receiver 42, a sound environment detector 34 and a user interface 38.
  • the hearing aids 12A, 12B may be any type of hearing aid, such as a BTE, a RIE, an ITE, an ITC, a CIC, etc., hearing aid.
  • Each of the illustrated hearing aids 12A, 12B comprises a front microphone 14 and a rear microphone 16 connected to respective A/D converters (not shown) for provision of respective digital input signals in response to sound signals received at the microphones 14, 16 in a sound environment surrounding the user of the hearing aid system 10.
  • the digital input signals are input to a hearing loss processor 18 that is configured to process the digital input signals in accordance with a signal processing algorithm selected from a library of signal processing algorithms F n ( ⁇ n ) to generate a hearing loss compensated output signal.
  • the hearing loss compensated output signal is routed to a D/A converter (not shown) and a receiver 22 for conversion of the hearing loss compensated output signal to an acoustic output signal emitted towards an eardrum of the user.
  • the hearing aid system 10 further comprises a hand-held device 30, e.g. a smart phone, facilitating data transmission between the hearing aids 12A, 12B and the at least one server 110 of the in situ fitting system 100.
  • the illustrated hearing aids 12A, 12B and the hand-held device 30 are interconnected with, e.g., a Bluetooth Low Energy interface for exchange of sensor data and control signals between the hearing aid 12 and the hand-held device 30.
  • the illustrated hand-held device 30 is a smart phone also having a mobile telephone interface 50, such as a GSM-interface, for interconnection with a mobile telephone network and a WIFI interface 48 as is well-known in the art of smart phones.
  • the hand-held device 30 interconnects with the network 120 and the at least one server 110 through the Internet with the WiFi interface 48 and/or the mobile telephone interface 50 as is well-known in the art of WANs.
  • the hearing aid 12A comprises a performance detector 40 for determination of listening performance of the user.
  • the performance detector 40 is connected to a microphone 26 that is positioned for reception of the user's own speech, e.g. as shown in Fig. 2 in abutment with an ear canal wall for reception of bone conducted speech of the user.
  • the performance detector 40 is also connected to one or more orientation sensors 44, such as gyroscopes, e.g. MEMS gyros, tilt sensors, roll ball switches, etc., configured for outputting signals for determination of orientation of the head of a user wearing the hearing aid, e.g. one or more of head yaw, head pitch, head roll, or combinations hereof, e.g. tilt, i.e.
  • the angular deviation from the heads normal vertical position, when the user is standing up or sitting down is 0°
  • the tilt of the head of a person standing up or sitting down is 0°
  • the tilt of the head of a person lying down is 90°.
  • the performance detector 40 is configured for detection of speech and for recognition of words spoken by the user and indicating user difficulties in understanding speech from others, such as "sorry”, “pardon”, “what”, or the like, or corresponding words in other languages than English. Frequent detection of such words spoken by the user of the hearing aid system in the context of speech from another person that would have been easy to understand by a person with normal hearing, leads to a low listening performance value.
  • the performance detector 40 is configured for transmission of data relating to detection of such words and data on user timing in response to reception of speech to the at least one server, and the at least one server determines one or more signal processing parameters for improved listening performance of the user based on the received data and the performance model, whereby obtained listening performance of other users of hearing aid systems possibly with hearing losses similar to the hearing loss of the user in question is included in the determination of signal processing parameters of the hearing aid of the user in question.
  • the performance detector comprises a direction of arrival detector configured for determination of the direction of arrival of sound at the hearing aid 12.
  • the performance detector is configured for comparison of the determined direction of arrival of the sound and the time from arrival of speech until the user changes his or her looking direction towards the determined direction of arrival of the speech as indicated by the orientation sensors 44.
  • the performance detector 40 is configured for transmission of data relating to determined user reaction times or absence of user reaction in response to reception of speech to the at least one server, and the at least one server determines one or more signal processing parameters for improved listening performance of the user based on the received data and the performance model, whereby obtained listening performance of other users of hearing aid systems possibly with hearing losses similar to the hearing loss of the user in question is included in the determination of signal processing parameters of the hearing aid of the user in question.
  • the at least one server may for example increase a gain value at a frequency of the received speech so that the time used for responding to speech from another direction than the looking direction is decreased.
  • the at least one server may also adjust complex gain values, e.g. in order to perform filtering.
  • the hand-held device 30 comprises a sound environment detector 34 for determining the category of the sound environment surrounding the user of the hearing aid system 10. The determining of the sound environment category is based on a sound signal picked up by a microphone 32 in the hand-held device. Based on the determination of the category, the sound environment detector 34 provides an output 36 to the at least one server for determination of a signal processing parameter value and/or a signal processing algorithm appropriate for the sound environment category in question.
  • the in situ fitting system automatically switches the hearing aid signal processor 18 to the most suitable one or more algorithm(s) for the sound environment in question whereby optimum sound quality and/or speech intelligibility is maintained in various sound environments.
  • the signal processing algorithms of the processor 18 may perform various forms of noise reduction and dynamic range compression as well as a range of other signal processing tasks.
  • the sound environment detector 34 benefits from the computing resources and power supply typically available in the hand-held device 30 that are larger than the resources and power supply available in the hearing aid 12.
  • the hand-held device 30 and/or all of, or at least some of, the hearing aid systems 10 may also benefit from the resources made available by the network(s) 120 and the at least one server 110.
  • the sound environment detector 34 categorizes the current sound environment into one of a set of environmental categories, such as speech, babble speech, restaurant clatter, music, traffic noise, etc.
  • the at least one server transmits a server parameter control signal 52A, 52B to each of the hearing aids 12A, 12B with information on the determined one or more signal processing parameters and/or signal processing algorithm(s) to be selected by the respective signal processor 18A, 18B from the available library of signal processing algorithms and parameters F n ( ⁇ n ) in response to the server parameter control signal 52A, 52B.
  • signal processing parameters include: Amount of noise reduction, amount of gain and amount of HF gain, algorithm control parameters controlling whether corresponding signal algorithms are selected for execution or not, corner-frequencies and slopes of filters, compression thresholds and ratios of compressor algorithms, filter coefficients, including adaptive filter coefficients, adaptation rates and probe signal characteristics of adaptive feedback cancellation algorithms, etc.
  • the hand-held device 30 includes a location detector 42 with a GPS receiver configured for determining the geographical position of the hearing aid system 10. In absence of useful GPS signals, the position of the illustrated hearing aid system 10 may be determined as the address of the WIFI network access point or by triangulation based on signals received from various GSM-transmitters as is well-known in the art of smart phones.
  • the hand-held device 30 is configured for transmission of determined sound environment categories and geographical positions to the at least one server through the WiFi interface 48 and/or the mobile telephone interface 50.
  • the at least one server is configured for recording the determined geographical positions together with the determined categories of the sound environment at the respective geographical positions. Recording may be performed at regular time intervals, and/or with a certain geographical distance between recordings, and/or triggered by certain events, e.g. a shift in category of the sound environment, a change in signal processing, such as a change in signal processing programme, a change in signal processing parameters, a user command entered with the user interface, etc., etc.
  • the recorded data are included in the performance model.
  • the at least one server is configured for increasing the probability that the current sound environment is of the respective previously recorded category of the sound environment.
  • the hand-held device 30 is also configured for accessing a calendar system of the user, e.g. through the WiFi interface 48 and/or the mobile telephone interface 50, to obtain information on the whereabouts of the user, e.g. meeting room, office, canteen, restaurant, home, etc., and to include this information in the determining of the category of the sound environment.
  • Information from the calendar system of the user may substitute or supplement information on the geographical position determined by the GPS receiver and transmitted to the at least one server.
  • GPS signals may be absent or so weak that the geographical position cannot be determined by the GPS receiver.
  • Information from the calendar system on the whereabouts of the user may then be used to provide information on the geographical position, or information from the calendar system may supplement information on the geographical position, e.g. indication of a specific meeting room may provide information on the floor in a high rise building.
  • Information on height is typically not available from a GPS receiver.
  • Information on the orientation of the head of the user is also transmitted to the at least one server to be included in the performance model and form basis for determination of signal processing parameters and/or algorithms of the hearing aid 12.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Artificial Intelligence (AREA)
  • Automation & Control Theory (AREA)
  • Evolutionary Computation (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
EP15172898.7A 2015-06-19 2015-06-19 Performance based in situ optimization of hearing aids Ceased EP3107314A1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
EP15172898.7A EP3107314A1 (en) 2015-06-19 2015-06-19 Performance based in situ optimization of hearing aids
US14/788,615 US9723415B2 (en) 2015-06-19 2015-06-30 Performance based in situ optimization of hearing aids
JP2016117350A JP2017011699A (ja) 2015-06-19 2016-06-13 能力に基づく補聴器のｉｎ ｓｉｔｕ最適化
CN201610443990.5A CN106257936B (zh) 2015-06-19 2016-06-20 用于助听器的原位适配系统以及助听器系统
US15/346,249 US9838805B2 (en) 2015-06-19 2016-11-08 Performance based in situ optimization of hearing aids
US15/630,366 US10154357B2 (en) 2015-06-19 2017-06-22 Performance based in situ optimization of hearing aids

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP15172898.7A EP3107314A1 (en) 2015-06-19 2015-06-19 Performance based in situ optimization of hearing aids

Publications (1)

Publication Number Publication Date
EP3107314A1 true EP3107314A1 (en) 2016-12-21

Family

ID=53442655

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15172898.7A Ceased EP3107314A1 (en) 2015-06-19 2015-06-19 Performance based in situ optimization of hearing aids

Country Status (3)

Country Link
EP (1) EP3107314A1 (zh)
JP (1) JP2017011699A (zh)
CN (1) CN106257936B (zh)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019040895A1 (en) * 2017-08-25 2019-02-28 Starkey Laboratories, Inc. COGNITIVE BENEFIT MEASUREMENT ASSOCIATED WITH THE USE OF A HEARING AID DEVICE
WO2021148538A1 (en) * 2020-01-22 2021-07-29 Widex A/S Method of operating an in-situ fitting system and an in-situ fitting system
EP3873110A1 (en) * 2020-02-28 2021-09-01 Oticon A/s Hearing aid determining turn-taking
EP3614379B1 (en) 2018-08-20 2022-04-20 Mimi Hearing Technologies GmbH Systems and methods for adaption of a telephonic audio signal
CN115250415A (zh) * 2021-04-26 2022-10-28 梁文雄 基于机器学习的助听系统

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3468227B1 (en) * 2017-10-03 2023-05-03 GN Hearing A/S A system with a computing program and a server for hearing device service requests
CN109640212A (zh) * 2019-02-20 2019-04-16 广州明医医疗科技有限公司 音质改善方法及骨传导耳机

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5600728A (en) * 1994-12-12 1997-02-04 Satre; Scot R. Miniaturized hearing aid circuit
EP2426953A1 (en) * 2010-04-19 2012-03-07 Panasonic Corporation Hearing aid fitting device
WO2012066149A1 (en) * 2010-11-19 2012-05-24 Jacoti Bvba Personal communication device with hearing support and method for providing the same
EP2528357A1 (en) * 2011-03-31 2012-11-28 Panasonic Corporation Hearing aid adjustment device, hearing aid adjustment method, and hearing aid adjustment program
EP2736273A1 (en) * 2012-11-23 2014-05-28 Oticon A/s Listening device comprising an interface to signal communication quality and/or wearer load to surroundings
EP2813175A2 (en) * 2013-06-14 2014-12-17 Oticon A/s A hearing assistance device with brain-computer interface
EP2871858A1 (en) 2013-11-07 2015-05-13 GN Resound A/S A hearing aid with probabilistic hearing loss compensation
EP2884766A1 (en) * 2013-12-13 2015-06-17 GN Resound A/S A location learning hearing aid

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7804973B2 (en) * 2002-04-25 2010-09-28 Gn Resound A/S Fitting methodology and hearing prosthesis based on signal-to-noise ratio loss data
JP4939542B2 (ja) * 2005-10-18 2012-05-30 ヴェーデクス・アクティーセルスカプ データ・ロガーを備えた補聴器，および上記補聴器の操作方法
CN101090584B (zh) * 2007-07-10 2011-12-14 王永华 数字助听器的选配装置
US20110317858A1 (en) * 2008-05-28 2011-12-29 Yat Yiu Cheung Hearing aid apparatus
DK2335427T3 (da) * 2008-09-10 2012-06-18 Widex As Fremgangsmåde til lydbehandling i et høreapparat og et høreapparat
DK2439960T3 (en) * 2010-10-08 2015-08-24 Oticon As Wireless binaural hearing aid
US8817996B2 (en) * 2011-11-01 2014-08-26 Merry Electronics Co., Ltd. Audio signal processing system and its hearing curve adjusting unit for assisting listening devices
US9148735B2 (en) * 2012-12-28 2015-09-29 Gn Resound A/S Hearing aid with improved localization
JP6190351B2 (ja) * 2013-12-13 2017-08-30 ジーエヌ ヒアリング エー／エスＧＮ Ｈｅａｒｉｎｇ Ａ／Ｓ 学習型補聴器

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5600728A (en) * 1994-12-12 1997-02-04 Satre; Scot R. Miniaturized hearing aid circuit
EP2426953A1 (en) * 2010-04-19 2012-03-07 Panasonic Corporation Hearing aid fitting device
WO2012066149A1 (en) * 2010-11-19 2012-05-24 Jacoti Bvba Personal communication device with hearing support and method for providing the same
EP2528357A1 (en) * 2011-03-31 2012-11-28 Panasonic Corporation Hearing aid adjustment device, hearing aid adjustment method, and hearing aid adjustment program
EP2736273A1 (en) * 2012-11-23 2014-05-28 Oticon A/s Listening device comprising an interface to signal communication quality and/or wearer load to surroundings
EP2813175A2 (en) * 2013-06-14 2014-12-17 Oticon A/s A hearing assistance device with brain-computer interface
EP2871858A1 (en) 2013-11-07 2015-05-13 GN Resound A/S A hearing aid with probabilistic hearing loss compensation
EP2884766A1 (en) * 2013-12-13 2015-06-17 GN Resound A/S A location learning hearing aid

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
DAVID J. C. MACKAY: "Information Theory, Inference, and Learning Algorithms", 2003, CAMBRIDGE UNIVERSITY PRESS

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019040895A1 (en) * 2017-08-25 2019-02-28 Starkey Laboratories, Inc. COGNITIVE BENEFIT MEASUREMENT ASSOCIATED WITH THE USE OF A HEARING AID DEVICE
US10674285B2 (en) 2017-08-25 2020-06-02 Starkey Laboratories, Inc. Cognitive benefit measure related to hearing-assistance device use
US11012793B2 (en) 2017-08-25 2021-05-18 Starkey Laboratories, Inc. Cognitive benefit measure related to hearing-assistance device use
US11612320B2 (en) 2017-08-25 2023-03-28 Starkey Laboratories, Inc. Cognitive benefit measure related to hearing-assistance device use
EP3614379B1 (en) 2018-08-20 2022-04-20 Mimi Hearing Technologies GmbH Systems and methods for adaption of a telephonic audio signal
WO2021148538A1 (en) * 2020-01-22 2021-07-29 Widex A/S Method of operating an in-situ fitting system and an in-situ fitting system
EP3873110A1 (en) * 2020-02-28 2021-09-01 Oticon A/s Hearing aid determining turn-taking
US11375322B2 (en) 2020-02-28 2022-06-28 Oticon A/S Hearing aid determining turn-taking
US11863938B2 (en) 2020-02-28 2024-01-02 Oticon A/S Hearing aid determining turn-taking
CN115250415A (zh) * 2021-04-26 2022-10-28 梁文雄 基于机器学习的助听系统
CN115250415B (zh) * 2021-04-26 2024-05-28 梁文雄 基于机器学习的助听系统

Also Published As

Publication number Publication date
CN106257936A (zh) 2016-12-28
JP2017011699A (ja) 2017-01-12
CN106257936B (zh) 2021-06-29

Similar Documents

Publication Publication Date Title
US10154357B2 (en) Performance based in situ optimization of hearing aids
US11277696B2 (en) Automated scanning for hearing aid parameters
EP3107314A1 (en) Performance based in situ optimization of hearing aids
EP2884766B1 (en) A location learning hearing aid
US9094769B2 (en) Hearing aid operating in dependence of position
US9648430B2 (en) Learning hearing aid
JP6190351B2 (ja) 学習型補聴器
US9894446B2 (en) Customization of adaptive directionality for hearing aids using a portable device
US11477583B2 (en) Stress and hearing device performance
EP2819436B1 (en) A hearing aid operating in dependence of position
US20170325033A1 (en) Method for operating a hearing device, hearing device and computer program product
EP2876902A1 (en) Adjustable hearing aid device
US20220192541A1 (en) Hearing assessment using a hearing instrument
US10873816B2 (en) Providing feedback of an own voice loudness of a user of a hearing device
US11601766B2 (en) Binaural hearing system having two hearing instruments to be worn in or on the ear of the user, and method of operating such a hearing system
EP4290886A1 (en) Capture of context statistics in hearing instruments
US20240122543A1 (en) Optimizing positioning and configuration of a hearing device
CN115002635A (zh) 声音自适应调整方法和系统
DK201370356A1 (en) A hearing aid operating in dependence of position

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170620

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20170914

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: GN HEARING A/S

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

APBK Appeal reference recorded

Free format text: ORIGINAL CODE: EPIDOSNREFNE

APBN Date of receipt of notice of appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNNOA2E

APBR Date of receipt of statement of grounds of appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNNOA3E

APAF Appeal reference modified

Free format text: ORIGINAL CODE: EPIDOSCREFNE

APBT Appeal procedure closed

Free format text: ORIGINAL CODE: EPIDOSNNOA9E

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20210824