WO2020077348A1 - Procédé d'ajustement de dispositif d'aide auditive, système, algorithme, logiciel, test de performances et apprentissage - Google Patents

Procédé d'ajustement de dispositif d'aide auditive, système, algorithme, logiciel, test de performances et apprentissage Download PDF

Info

Publication number
WO2020077348A1
WO2020077348A1 PCT/US2019/056152 US2019056152W WO2020077348A1 WO 2020077348 A1 WO2020077348 A1 WO 2020077348A1 US 2019056152 W US2019056152 W US 2019056152W WO 2020077348 A1 WO2020077348 A1 WO 2020077348A1
Authority
WO
WIPO (PCT)
Prior art keywords
hearing
patient
user interface
digital signal
signal processor
Prior art date
Application number
PCT/US2019/056152
Other languages
English (en)
Inventor
Andreas Perscheid
Original Assignee
Intricon Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intricon Corporation filed Critical Intricon Corporation
Priority to EP19871422.2A priority Critical patent/EP3864862A4/fr
Priority claimed from US16/601,368 external-priority patent/US10952649B2/en
Publication of WO2020077348A1 publication Critical patent/WO2020077348A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/70—Adaptation of deaf aid to hearing loss, e.g. initial electronic fitting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/41—Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest

Definitions

  • Human hearing is generally considered to be in the range of 20 Hz to 20 kHz, with greatest sensitivity to sounds including speech in the range of 1 kHz to 4 kHz.
  • PSAPs personal sound amplifier products
  • hearing assist devices are used by many people to increase/adjust the amplitudes (and perhaps frequency) of certain tones and sounds so they will be better heard in accordance with their hearing loss profile.
  • Cochlear implants which output an electrical pulse signal directly to the cochlea rather than a sound wave signal sensed by the eardrum, are another type of hearing assist device which may involve customizing the signal for an individual's hearing loss or signal recognition profile.
  • primary parameters which are adjusted in fitting a particular DSP amplifier include overall pre-amplifier gain, compression ratios, thresholds and output compression limiter (MPO) settings for each of eight channels, time constants, noise reduction, matrix gain, equalization filter band gain settings for each of twelve different frequency bands, and adaptive feedback canceller on/off.
  • the typical fitting process usually involves identifying the softest sound which can be heard by the patient at a number of different frequencies, optionally together with the loudest sound which can be comfortably heard by the patient at each of those frequencies.
  • hearing aid manufacturers have added the capability of hearing aids to use wireless accessories such as external microphones and connections to smartphones to increase the usability of their hearing aids in different listening situations. These new capabilities still retain the focus on providing an objective "best” quality sound and signal to noise ratio, assuming that the entire hard-of-hearing problem is in the degradation of the ear to convert sound into a single "best” signal fed to the user's brain.
  • the present invention is directed at an algorithm, method and software program (including a graphical user interface) for upgraded fitting and refitting of a DSP-based hearing assistance device.
  • the method is performed by a user interacting with a display, such as of a computer or smart phone, which can simultaneous play sounds (such as over a computer speaker or smart phone speaker or headphones) audibly heard by the user while responding during the testing method.
  • the algorithm, method and software program is directed in an order which makes for efficient selection of fitting parameter values, but also involves changing the transfer function of the hearing assist device in a way that mates with the changing cognitive-hearing abilities as the user relearns to distinguish between various sounds using the hearing assistance device.
  • the algorithm, method and software program also includes various unique testing protocols, likewise to better match the improved hearing and changing cognitive-hearing abilities as the user relearns to distinguish between various sounds using the hearing assistance device.
  • Various parameters are controllable such as with slidebars on audiologist fitting software, each of which controls a plurality of different DSP parameter settings in the hearing aid.
  • a soundmap is then included, which allows simultaneous control over a plurality of the slidebars. At least the patient fitting user interface, and optionally also the audiologist’s fitting user interface, is limited in accordance with the cognitive-hearing abilities of the patient.
  • FIG. 1 is a flow chart of the preferred method of some aspects of the present invention.
  • FIGS. 2 - 7 are screen shots of a preferred software program used to perform the hearing tests of the preferred method of FIG. 1.
  • FIG. 8 is a screen shot of a first embodiment of an adjustment screen which can be used in the method of FIG. 1.
  • FIG. 9 is a screen shot of a balance screen which can be used in the method of FIG. 1.
  • FIG. 10 is a screen shot of a control screen for the preferred cognitive training/testing protocols in the method of FIG. 1.
  • FIG. 11 is a screen shot used in a first preferred type of cognitive training/testing.
  • FIG. 12 is a screen shot used in a second preferred type of cognitive training/testing.
  • FIG. 13 is a screen shot used in a third preferred type of cognitive training/testing.
  • FIG. 14 shows an example of a graphical analysis of the results of the cognitive testing of FIG. 13.
  • FIGS. 15-18 are screen shots used in a fourth preferred type of cognitive training/testing.
  • FIG. 19 is a screen shot used in sound therapy in the present invention.
  • FIG. 20 is a screen shot of a second embodiment of an adjustment screen of a fitting software application running on a computing device of an audiologist or other specialist of hearing professional.
  • FIG. 21 is a screen shot comparison between the audiologist fitting software application and a fitting user interface running on a computing device of a hearing device user, such as on a smartphone.
  • FIG. 22 is a presentation of concept mappings for eight variables preferably controlled by the soundmap of the audiologist fitting software application.
  • the present invention involves approaching the problem in the opposite direction from the established norm, focusing first on how sounds are subjectively interpreted in that particular user's brain. Only after measuring and considering that particularly user's subjective in-the-brain interpretation capability is the hearing assist device programmed, not to produce sound-quality that is objectively best, but rather to produce sound-quality which is best fit for that particular user's current sound-cognition abilities. In other words, the present invention first considers the brain and thereafter considers the ear, not like the consensus approach of considering the ear and ignoring deficiencies in the brain.
  • the patient's brain compares the incoming signal with learned and remembered hearing patterns. For instance, consider an everyday situation in which there are multiple sound sources, such as having a conversation on a street comer, with both vehicles and other people passing by. All the sounds - from the vehicles, from the person in the conversation, from the other people passing by - are physically combined into a single sum sound signal heard by the ears. The brain attempts to separate the single sum signal into different identified and understood components. In making this separation, the heard audio signal is considered in the brain together with other data and situation patterns, like visual information, feelings, smells, etc.
  • the brain recognizes the incoming sound from an acoustic point of view.
  • the brain also has a tremendous ability to focus on selected portions of the incoming sound signal (what is being said by the other person in the conversation) while ignoring other portions of the incoming sound signal (the passing vehicles and noise from other people passing by).
  • a key feature of the way the brain identifies sound is that, when matching incoming/heard signals with remembered patterns, the brain also adjusts/reorganizes the remembered, existing patterns inside the brain to have a quicker and easier understanding next time, when confronted with a similar acoustic situation.
  • the cognitive ability and learned/remembered sound patterns are established quite early, within the first few years of life. During most of a person's life (i.e., during the decades before identifying a hearing loss), the person is simply retreading through cognitive links that were established and known for as long as the person can remember.
  • the incoming/heard signal changes. Information, that was present in the incoming signal at an earlier age, is no longer being received.
  • the patient's cognitive linking by necessity also changes, i.e., what the user's brain remembers as an incoming audio pattern corresponding to speech is now different than the audio pattern heard/remembered years ago. Essentially, the patient forgets the "when I was younger, a recognized pattern sounded like this" cognitive link, replacing it with the more recent cognitive link of what a recognized pattern sounds like.
  • the present invention takes a very different approach.
  • the hearing aid patient is hearing more sound like a baby, forming new cognitive links within the brain.
  • the present invention focuses on trying to match the incoming sound signal with the patient's CURRENT cognitive links, not matching the incoming sound signal with cognitive links that were long ago forgotten.
  • the present invention also focuses on trying to improve the brain's ability to recognize and match incoming sounds to existing/remembered patterns, i.e., a little by little improvement of the cognitive links in the user's brain toward maximum intelligibility, even if different from the cognitive links in place in the user's brain when the user had perfect hearing.
  • hearing assist devices including hearing aids, personal sound amplifiers, cochlear implants, etc.
  • hearing aid in this disclosure and figures is often merely for convenience in describing the preferred method, system, algorithm, software, performance testing and/or training, and should not be taken as limiting the invention to use only on hearing aids.
  • a first step 10 for the present invention is to input certain information about the patient which is separate from hearing and cognitive abilities.
  • FIG. 2 shows an introductory question screen 12 of the preferred software. While FIG. 2 shows an example of a computer screen, the present invention is equally applicable for use on a more mobile device like a smartphone, a tablet or any other kind of mobile computing device having an audio output and a screen.
  • the software can be provided either as a separate program which is downloadable or otherwise loaded on the computing device, or can reside on a server which is electronically accessible such as over the internet.
  • the software application and the depicted screen shots can be used anywhere, without being in a special measurement room inside a doctor's practice or in an audiologist's shop.
  • the user fills in the user’s age in a dialog box 14 (which could, if desired, include a drop down menu to select the user's age), has two buttons 16, 18 to click to identify gender, and has two buttons 20, 22 to click to identify preferred telephony ear.
  • a dialog box 14 which could, if desired, include a drop down menu to select the user's age
  • has two buttons 16, 18 to click to identify gender and has two buttons 20, 22 to click to identify preferred telephony ear.
  • the age, gender and telephony ear information are used as inputs into algorithms that determine the various parameters which can be set in the hearing aid DSP. Additionally, in the preferred embodiment, the sounds and questioning profile used in the remainder of the testing is dependent upon the age and gender responses the user inputs on this introductory question screen 12.
  • Patient age is an initial input in the system because the causes of hearing loss in younger patients tend to be different than in older patients, and thus the type of hearing loss in younger patients tends to be different than the type of hearing loss in older patients.
  • cerebrovascular and peripheral arterial disease have been associated with audiogram patterns and have been particularly associated with low frequency hearing loss. Accordingly, the patient's age can be used to provide DSP fitting settings that tend to be more appropriate for that particular patient.
  • Patient gender is an initial input in the system because male and female brains process sound differently.
  • Males tend to process male voice sounds in Wernicke’s area, but process female voice sounds in the auditory portion of the right hemisphere also used for processing melody lines.
  • Females tend to listen with both brain hemispheres and pick up more nuances of tonality in voice sounds and in other sounds (e.g , crying, moaning).
  • Males tend to listen primarily with one brain hemisphere (either the left or the right, depending upon the sounds being heard and the processing being done in the brain) and do not hear the same nuances of tonality (e.g., may miss the warning tone in a female voice).
  • Females also tend to be distracted by lower noise levels than males find distracting. These differences in sound processing also result in different exhaustion profiles of the brain. After long listening /processing sessions (such as typically in the evening), female brains tend to be exhausted overall on both hemispheres, while male brains are only exhausted on one side.
  • the present invention considers and adapts for these differences of typical brain processing of sounds by the different genders.
  • women are provided with less overall gain, less loudness and more noise reduction to better understand speech, whereas men are provided with more gain between 1-4 kHz, thereby causing males to use the opposing side of the brain more like the exhausted side.
  • These gender-based differences of DSP parameters settings are particularly appropriate for stressed situations of healing and subsequent sound therapy, discussed further with reference to the training aspects of the present invention.
  • the ear that is favored for use on talking on the phone is another initial input in the system, explained as follows. When speaking on the phone, the audio signal is only received in one ear. Because talking on the phone commonly involves using logic and analysis, most people migrate toward a preferred ear on the telephone which feeds the brain hemisphere better suited and/or trained for logic and analysis.
  • the present invention seeks to use these brain differences - one brain hemisphere better suited and/or trained for logic and analysis and the other brain hemisphere better suited and/or trained for creativity - to its benefit.
  • the motivation to use a hearing assist device is to better understand speech.
  • To separate speech from noise inside the brain we would like the speech content best amplified with the least noise in the leading ear, with the percentage of noise being greater in the non-leading ear side.
  • the non-leading ear is taking all the noise to separate it from speech inside the brain, i.e., to assist the patient's brain in identifying and ignoring the noise which is heard.
  • the present invention thus inputs directional mirophone settings and higher noise reduction parameters into the hearing assist device worn in the leading ear, while inputting no microphone directionality and lesser noise reduction parameters parameters into the non-leading ear hearing assist device.
  • the user can click on a "Next" button 24 and the system proceeds 26 to testing of the hearing ability of each ear.
  • the preferred embodiment performs a relatively simple form of testing based on understandability of speech based on different playback parameters.
  • the computing device used in performing the inventive method needs to have sound playback capabilities, preferably a electrical audio jack output which can be transformed into sound on carefully calibrated headphones.
  • FIGS. 3-7 represent the simplified hearing profile system testing aspect of the present invention.
  • the user For each ear, the user merely plays through example recordings (shown here as a female voice 28 and a male voice 30), and controls the slider 32 to whichever of twenty-four locations permit the best hearing comprehension.
  • the slide control can preferably be operated by a mouse 34, either by clicking on the arrows 36 or by click-drag-dropping the slider 32, or by arrows on the computer keyboard (if present, not shown).
  • the preferred software includes a different playback curve for each slider position.
  • the female/male voice playback differs for each of eight colors in amounts of general level of amplification and in each of three shapes in the shape of the gain-frequency curve (for instance, circle settings amplify the voice playback more in the low frequency registers, while triangle settings amplify the voice playback more in higher frequency registers, with square settings between the two).
  • the female/male voice playback also differs for each of the eight colors and in each of the three shapes in compression and expansion characteristics. The specific control used to switch between voice playback characteristics is a matter of design choice.
  • the objective is NOT to identify the minimum loudness of tones which can be heard or maximum volume which is comfortable for the patient’s ears, but rather to identify which of the twenty-four different playback curves represents the characteristics of most easily understood speech for the hearing loss of that particular patient.
  • the voice playback is preferably output on the calibrated headphones (not shown) into the ear of interest with essentially no noise.
  • the test usually begins with the female voice 28, having a higher frequency profile than the male voice 30 and thus for most patients being harder to distinguish, and using the preferred telephony ear, which tends to be the dominant ear in cognitively understanding speech. So, for example and assuming the user has input that the right ear 38 is the preferred telephony ear, FIG.
  • FIG 3 shows a first slider position (the“red circle” selection 40) for the right ear 38.
  • FIGS. 4, 5 and 6 show second (“red square” 42 , arrived at by a click-drag-drop of the slider 32), third (“red triangle” 44, arrived at by clicking on one of the arrows 36) and seventh (“dark blue circle” 46) slider selection positions for the playback into the right ear 38.
  • Each slider position changes the playback characteristics of the female voice 28.
  • the color/shape 40/42/44/46 changes on the screen 26. If the user clicks on the male playback button 30 shown by the mouse 34 position in FIG.
  • the voice being played over the headphones changes to a male voice, again presented in twenty-four playback curves depending on slider position.
  • the male voice 30, for which comprehension is generally as good as or better than the female voice 28, is preferably used to confirm the playback selection made with the female voice 28.
  • the user can click back and forth between the male playback button 30 and the female playback button 28, in between adjusting the slider position, with the objective of selecting which of the twenty-four playback curves leads to the best intelligibility for both male and female speech.
  • the twenty-four possible slider positions for each ear 38 are separated into eight colors (red, orange, dark blue, green, light blue, purple, yellow, violet) by three shapes (circle, square, triangle). While the number of selectable slider positions could have been chosen to be about as low as six per ear to as high as hundreds of potential positions, other embodiments preferably include from ten to thirty slider positions per ear, with the preferred number of slider positions being twenty-four for each ear (only one left ear and four right ear slider positions depicted).
  • FIG. 7 shows a first slider position (the“red circle” selection 40) for the left ear 38, recognizing that all twenty-four slider positions are again available, for both the male and female voice playback.
  • a "Back" button 48 is provided if the user wishes to change settings or data which has been entered on previous screens.
  • additional audio control and adjustment screens can be provided, more traditionally akin to those familiar to audiologist professionals, to set additional parameters in the DSP which are not modified in the basic algorithm, and/or to tweak the settings obtained through the simple hearing intelligibility test of FIGS. 2-7.
  • One preferred adjustment screen 52 is shown in FIG. 8, showing more traditional hearing aid settings in the text in FIG. 8.
  • many lay users will have little or no interest in such more detailed control of the DSP, particularly prior to performing the cognitive training further described below.
  • the fitting software initially sets the DSP program settings with a frequency band gain curve, an Output Compression Limiter MPO in each channel curve, and a Compression Ratio in each channel curve to modify the amplification of voices heard by the user in a way which best draws upon the user’s hearing ability for voice comprehension.
  • the fitting software includes values for each of the amplifier parameters.
  • any of the parameter settings which in the preferred embodiment do not change based on the user input/selection of color/shape i.e., DSP parameters other than frequency-gain curve, compression ratio in each channel, and compression limiting/MPO in each channel
  • DSP parameters other than frequency-gain curve, compression ratio in each channel, and compression limiting/MPO in each channel
  • the DSP setting software application shown in FIGS. 2-8 is connected to a central, cloud-based database. Every change of settings made by the computing devices of users in the field, is stored inside the cloud database.
  • the computing device includes its own microphone, and the cloud database also stores a signal of the sound environment in which the setting change was made.
  • the central database is used, in one instance, for individual improvements and adjustments to the algorithms converting between the selections shown in FIGS. 3-7 and in FIG. 8 and the parameter values plugged into the DSP.
  • balance testing 54 After performing the voice comprehension testing of each of the two ears, the user proceeds to balance testing 54 as shown in FIG. 1.
  • the preferred balance testing is again performed with a computer screen 54, as depicted in FIG. 9.
  • the user plays sound samples 56 and balances the sound heard in each ear by adjusting the slider position 58.
  • the balance testing 54 is particularly important for users who will be wearing two hearing assistance devices, one for each ear, so the DSP settings of the two devices are determined collectively rather than determining settings for each device individually.
  • the results of the balance testing are also used to adjust the hearing device parameters as determined by the simplified hearing profile system testing.
  • the preferred balance testing is performed based on playback 56 of a child speaking, heard in both ears, also providing a confirmatory display and allowing the user to verify the separate setting 60, 62 previously selected for each ear using the earlier screens as shown in FIGS. 2-7.
  • a single hearing assist device may only be worn in one ear, in which case the testing of the other ear and the balance testing 54 steps are omitted.
  • the hearing testing of the present invention could be performed by directly using the hearing assist device(s).
  • the user would wear the hearing assist device(s), preferably having a wired or wireless structure in place to communicate with the hearing assist devices.
  • the computer could communicate an audio signal to the hearing assist device (essentially, transmitting a digital version of the signal played on the calibrated headphones) such as using a telecoil or Bluetooth type transceiver or a wired in-situ connection, with the receiver (speaker) in the hearing assist device itself generating the audio wave in the user's ear.
  • a single version of a female voice and a single version of a male voice could be generated by the computing device and picked up by a microphone in the hearing assist device, with the computer then using a wired or wireless transmission of DSP parameter changes, so the amplification characteristics of the receiver (speaker) -generated sound of the hearing assist device changed in real time as the user clicks and drags the slider 32 between red circle 40 and other color/shape positions.
  • the user would still be self-conducting a hearing test is based upon intelligibility of speech using a plurality of sound processing parameter curves and selecting the sound processing parameter curve which provides the best intelligibility of speech.
  • the present invention can be practiced merely by storing the parameter values as determined above for operation of the DSP in use.
  • the method of transmitting the calculated DSP parameter values to the hearing assist device and storing the parameter values in the DSP can be either through a wired or wireless transmission as known in the art, and is not the subject of the present application.
  • the simplified hearing profile system testing described above is really just a first aspect of the present invention that simplifies the steps previously performed by audiologists so the user can self-fit the hearing assistance devices.
  • the user preferably proceeds with a performance test 64 to assess aural cognitive abilities of the patient, with preferred embodiments further explained with reference to FIGS. 10-18.
  • the performance test 64 to assess aural cognitive abilities of the patient could be performed using the sound output by an in-situ hearing assist device (not shown), but more preferably is performed using calibrated headphones (not shown) directly connected by wire to an audio jack (not shown) of the computing device.
  • FIG. 10 shows a control screen 66 for the preferred performance testing 64 to assess aural cognitive abilities of the patient.
  • the control screen 66 uses the word “training” rather than “testing” because the user's act of taking the test helps to increase the user's aural cognitive abilities, but it is the score the user achieves on the various tests which determines the subsequent training and hearing assist device usage protocols recommended for that particular user. While various screens use the word “training", “training” is synonymous with “testing” when the user's cognitive abilities are being quantified using the computer training screens.
  • the control screen 66 allows the user to individually select which type of performance testing to run, with four buttons 70, 72, 74, 76 which can be clicked on for each of the four preferred tests, further explained with reference to FIGS. 11-13 and 15-18.
  • the control screen 66 includes a clickable button 78 which alternatively allows the user to serially run all four preferred performance tests in the preferred order.
  • the preferred control screen 66 shows the setting 60, 62 for each hearing aid, and allows the user to go back 48 to the simplified hearing profile system testing of FIGS. 2-7 and 9.
  • each of the clickable buttons 70, 72, 74, 76, 78 for running the tests may have indicators, such as the arrows 80 or the radio dots 82, which light or change color to show the user's progress through the testing/training on this computer session.
  • the computer can store the user's progress through the various testing protocols, so a session for any given user can be paused and then restarted hours or days later.
  • the control screen 66 also includes a clickable button 84 which allows the user to play sounds for hearing therapy (to rest and relax the brain), further explained with reference to FIG. 18.
  • the user wears hearing assist devices for one or both ears (as applicable), and the sound is merely output on the computer, tablet or smartphone speakers. This is in contrast to the preferred hearing testing using calibrated headphones. Switching from the headphones to use of the hearing aids is another reason that users inherently understand the "training" label as directed to the cognitive portion of the method and as being very different from the hearing testing.
  • the sound signal can be directed to the hearing assist device via a wired or wireless transmission and bypassing the microphone of the hearing assist device, or the sound signal could be played using the headphones, but in either case the transfer function of the hearing assist device (i.e., particularly the frequency-gain curve, compression ratio in each channel, and compression limiting/MPO in each channel determined by the hearing testing procedure/algorithm for each ear) should be applied to the sound before it is perceived in each ear by the user.
  • the transfer function of the hearing assist device i.e., particularly the frequency-gain curve, compression ratio in each channel, and compression limiting/MPO in each channel determined by the hearing testing procedure/algorithm for each ear
  • While variance in head direction is minimized because the user is looking at the computer screen, use of the headphones, or use of the hearing assist device(s) while bypassing its (their) microphone(s), is advantageous because the balance of sound between the two ears does not depend in any way on the direction the user's head is facing at that particular time.
  • FIG. 11 represents a first performance testing 70 for the present invention which involves the ability to identify or detect what are normally considered background noises.
  • a background noise non-speech
  • This test is primarily intended to assess the user's cognitive memory. During the duration that the user has been hard-of-hearing, the cognitive links in the user's brain may have degraded or been lost, i.e., the user may have essentially forgotten what these sounds sound like. As depicted in FIG.
  • preferred sounds for this cognitive memory testing 70 include paper crumpling 86, a cow mooing 88, water trickling 90, human whistling 92, and a bird chirping 94, with in this example the user's mouse 34 clicking on the water trickling 90.
  • a patient's cognitive memory degrades worse for sounds that are substantially within the frequencies that hearing has degraded most, and for most patients this will be in the high frequency registers.
  • the sounds selected for use in testing 70 will be characterized as having different frequencies but focused on high frequency sounds. For instance, water trickling, chirping and whistling are concentrated in higher frequencies than a cow mooing.
  • the sounds played for the cognitive memory test 70 should also vary in how smooth or harsh (how many clicks, points per second, and how quickly different frequencies change intensity) the various sounds are. For instance, whistling is smoother than paper crumpling.
  • the sounds played for the cognitive memory test 70 can also vary in volume, and/or in rate of volume change. Workers skilled in the art will be able to select numerous additional sounds, identifiable by most people with perfect hearing, which can be used in performing this cognitive memory test.
  • the user Upon hearing and identifying the sound, the user then selects the image 86, 88, 90, 92, 94 which corresponds with the background noise being played, such as by clicking on the image button.
  • the user's response can be assessed both in whether the user correctly identifies the sound and in how long it takes for the user to click the correct button 86, 88, 90, 92, 94 after the sound begins playing.
  • the cognitive memory test 70 can accordingly be specialized for different classes of people.
  • the cognitive memory test 70 for amateur or professional ornithologists could be entirely based on chirping of different species of birds.
  • the loss of the ability to distinguish between bird species based on the sound heard can be emotionally traumatic, and be a primary motivator for the individual to want to use the hearing assist device(s).
  • Such specialized cognitive memory tests, if sufficiently developed, can then be used as training tools for individuals to enhance their cognitive memory without regard to hearing loss.
  • ornithology students can perform the training to learn to identify different species of birds based on the sound of chirp each species makes.
  • Another example would be automobile mechanics, using the sounds of an engine or automobile in diagnosing a problem to be fixed or an automobile part to be replaced.
  • the preferred noise detection exercise screen 70 of FIG. 11 shows the hearing testing setting 60, 62 for each hearing aid.
  • the preferred screen also provides immediate feedback to the user performing the training, including showing a cumulative score 96 and a rate 98 (which can be either the rate correct as a percentage of tries, the rate at which answers are being given as a function of time, or a combination of both), and also an indication of which round 100 of testing/training 70 is begin performed.
  • FIG. 12 represents a second performance testing 72 for the present invention which involves the ability to determine sound source movement, a type of spatial hearing.
  • This test 72 assesses what can be referred to as "lateralization" ⁇ A sound is played (such as of a bird flying, or a mosquito buzzing), with the balance and fade continually changing as a function of time during playback so the sound seems to approach and then pass the user.
  • the computing device used for this test 72 includes stereo or surround sound speakers. Particularly when generated by a speaker (set) from in front of the user, a doppler effect may be coupled with changes in volume to further give the sense that the sound source has passed by the users. When passing the user, the sound source passes either to the user’s right or to the user’s left.
  • the testing 72 requires the user to determine on which side (right or left) the sound source passed.
  • the testing 72 may also assess how accurately the user can judge the instant when the sound source is at the user, with the user attempting to click when the sound source is closest.
  • the sound being played is the sound of a bird 102, which can either being chirping or the sound of its wings, moving and coming at the user, with the dashed lines indicating the image of the bird 102 at earlier points in time to visually correspond with the sound being heard.
  • the screen 72 may include clickable buttons 104, 106 to indicate which side the sound passed on, or the keyboard can be used for the user to enter results.
  • the mouse 34 can be used as an input for the user to control the position of the bird image on the screen, attempting to match with the positional location of the sound being heard as played through the stereo speakers.
  • the various sounds being played on different attempts by the user change in the amount and rate of balance/fade change, i.e., some testing rounds have sounds which cognitively seem to pass far to the right or left of the user and passing quickly, whereas the next testing round might have a sound which cognitively seems to pass very close to the user and passing slowly.
  • the sounds played for the source movement test can also vary in peak volume, in primary frequencies, and in smoothness.
  • FIG. 13 represents a third performance testing 74 for the present invention which involves the ability to determine sound source direction without movement.
  • a sound is played, and the user identifies the direction (right or left) from which the sound came.
  • the sounds played for testing sound source direction without movement 74 primarily differ in volume, and can be provided with or without other background noise.
  • the user can attempt to identify the direction of the silverware clinking, which can with or without other noises such as music or indistinct conversation.
  • the other background noises can also be provided directionally, such as silverware clinking on the right while music plays on the left.
  • the preferred screen 74 includes an image 108 of the sound to be distinguished, with a clickable button 110 if the sound comes from the left, a clickable button 112 if centered, and a clickable button 114 if the sound comes from the right.
  • the sounds played for testing sound source direction without movement can also vary in duration, in primary frequencies, and in smoothness.
  • the computing device used for this test 74 preferably includes stereo or surround sound speakers, and the various sounds being played on different rounds can also change in perceived distance to the right or left.
  • speech can be used, with the user asked to identify the direction of speech over other background sounds.
  • the user can be played three simultaneous conversations, two female and one male, and asked from which direction the male conversation comes.
  • FIG. 14 shows one example of a graphical analysis 116 of the results of the performance testing of FIG. 13.
  • the user's responses to numerous rounds of testing are compiled, and graphically displayed to show the percentage of correct answers identified by the user as a function of the direction (balance and fade) of the sound played.
  • the various graphs are preferably available by clicking on the“graphs” button 118 in the adjustment screen 52 of FIG. 8, and may be available through clicking on the“show evaluation” button 120 in the control screen 66 of FIG. 10.
  • This particular example shows a user who does a very good job of recognizing the directionality of sounds played in front of her, but not a good job of recognizing the directionality of sounds played from her right, even when hearing was equally corrected in both ears.
  • Such variances can involve both a preferred telephony ear and a loss of aural cognition from the duration of being hard of hearing.
  • Screens such as FIG. 14 can be used not only to better understand the cognitive loss and then improvement of this particular patient, but also as encouragement so the patient can understand how training using the properly set hearing aids has lead to better performance, resulting in a much better adoption rate and satisfaction over use of the hearing aids.
  • Other graphs can chart, for instance, a listing of frequencies versus the percentage correctly identified by the user, and/or a comparison between frequencies being identified versus decibel level for accurate identification.
  • Frequency graphs can preferably be provided either linearly or logarithmically.
  • Other graphs can display the frequencies played by any of the sound samples as a function of time as the sound sample plays.
  • the preferred software for the present invention thus includes screens to graphically display the performance, and particularly the improvement, which occurs as a result of the cognition training 64 of the present invention.
  • FIGS. 15-18 show a fourth performance testing 76 for the present invention which involves the ability at different relative volume levels to distinguish speech in the presence of noise.
  • FIG. 15 is an explanation screen 122 explaining to the user what the testing/training consists of and how to perform the testing/training.
  • Each of the hearing testing 26 and the first three cognition performance tests 70, 72, 74 described above can include similar explanation screens (not shown).
  • FIG. 16 shows a first round of the speech differentiation testing/training.
  • the topic options were anatomical, e.g., "colon” 124, “spine” 126, “tongue” 128, “eye” 130 or “foot” 132.
  • each clickable answer button 124, 126, 128, 130, 132 includes an image of the topic option, reinforcing that the objective is understanding speech content, not merely identifying or matching words.
  • the preferred embodiment includes smaller words for each of the topic option buttons 124, 126, 128, 130, 132, avoiding any ambiguity over what the image represents, but the words in the topic option buttons 124, 126, 128, 130, 132 can be omitted.
  • a timer 134 can be shown on screen.
  • the user quickly responded believing that the topic of the relatively indistinct speech being heard was a foot, but the response was incorrect.
  • the preferred software provides a mechanism, such as changing the back button 48 into a red-colored "WRONG! display 136 or a buzzer, for immediate feedback to the user about the accuracy of the results.
  • the user can be given similar immediate feedback.
  • the options are once again anatomical, this time “ear” 138, "hair” 140, “muscle” 142, “spine” 126 and “colon” 124.
  • the background noise is changed to the sounds heard from a train.
  • the background noise topic 144 is also graphically present to the user while performing the test. Almost without the user realizing, this further helps improve the cognitive relearning of the patient to identify and cognitively remember the background noise, while at the same time reteaching the cognitive separation ability of the user to distinguish speech over such background noise.
  • This type of performance testing represented in FIGS. 10-13 and 15-18, and particularly the speech over noise recognition performance testing represented in FIGS. 15-18, is important to continue to monitor and adjust as the user continues use of the hearing assistance device(s).
  • part of the degradation is due to a loss of cognitive ability to distinguish sounds that they can no longer hear, i.e., part of the hearing aid fitting problem is due to unlearning which occurs in the user’s brain rather than merely a lack of ability of the user’s ears.
  • the same sort of loss of cognitive ability could occur, for instance, if a person went for years in a silent environment without hearing speech but without any loss of hearing ability.
  • cognitive performance testing results are also transmitted and stored in a central cloud database as additional users perform the testing/training.
  • the central cloud database is analyzed and used to improve the algorithms for all users of the present invention in determining DSP parameter values, by analysis and comparisons between the cognitive scores and the settings used by multiple users.
  • a further and important aspect of the present invention is the non-testing training regimen which makes use of the cognitive hearing assessment, further explained with reference to FIG. 1.
  • the amount of cognitive loss can be measured through the testing 70, 72, 74, 76 represented in FIGS. 10-13 and 15-18. Once measured, the measurement can be summarized or categorized on a scale of 0 through 7, counting back through the age in years when most people learn to distinguish between speech sounds.
  • the cognitive loss categorization index can be thought of like an "A" through "F” letter grade in U.S. schools, which sums up the total number of points earned on all the assignments during the term; in FIG.
  • the score“401” is out of a greater number of possible points, and how much cognitive loss is represented by the 401 score necessarily depends upon how many rounds of training are performed. For example, a score of 401 out of 425 might correlate to a cognitive loss category of 0, whereas a score of 401 out of 825 might correlate to a cognitive loss category of 4.
  • the stage of cognitive loss is then used to modify the parameter settings of the hearing assist device(s), or more importantly, to ascertain how the usage (and DSP parameter settings during such usage) of the hearing assist device should be adjusted over time so the user can most easily relearn how to distinguish between sounds using the hearing assist device(s). Devising the hearing device usage regimen to best improve-over-time in cognitive ability to distinguish between sounds is a significant aspect of the present invention.
  • the cognitive testing gives an indication of how far the user’s cognitive ability to understand speech has degraded. If the patient has a severe loss of cognitive speech recognition ability (particularly those users who test out to a cognitive loss category of 5 to 7), use of the hearing aid in any sort of noisy environment is likely to still leave the user frustrated with a poor ability to understand speech. Instead of programming the hearing aid for everyday/noisy situation use, the user is told NOT to regularly wear the hearing aid. Instead, a program of parameter settings 146 (“Journey”) is installed in the hearing aid for the user to conduct cognitive training, on their own time, using their own interests and without assessment during training.
  • Journey a program of parameter settings 146
  • the preferred embodiment includes four levels or different sets of training settings 146 which can be programmed into the DSP and regimens which should be followed: one for severe cognitive loss 148, in the cognitive loss category of 5 to 7 years unlearned; a second for medium cognitive loss 150 , in the cognitive loss category of 3 to 4 years unlearned; a third for mild cognitive loss 152, in the cognitive loss category of 1 to 2 years unlearned; and a fourth for essentially no cognitive loss 154.
  • the preferred non-assessment cognitive training involves listening to voices in a low noise environment. For best results, such cognitive training should be performed for a duration in the range of 5 minutes to 180 minutes during a day. While speech in low noise environments can be provided in a number of settings, typically the easiest and most entertaining (and hence best followed and tolerated) training is performed by watching TV with the hearing aid in the cognitive training program of DSP parameter settings 146, such as for about 90 minutes a day.
  • the Journey program of DSP parameter settings use a very low compression ratio, which is tolerated in the low noise environment.
  • the Journey program of DSP parameter settings modifies and changes the baseline DSP parameter settings (the green triangle 60 and dark blue square 62, for instance), which were identified in the hearing testing mode of FIGS. 2-9.
  • FIG. 19 shows a screen shot 156 of a portion of the computer system which can be used for the proper relaxation or hearing therapy, which can be reached from the control screen 66 of FIG. 10 by clicking on the hearing therapy button 84.
  • the relaxation sounds which can be played include bird and breeze sounds 158, campfire sounds 160, and ocean shore sounds 162.
  • tapes and/or CDs of relaxation sounds are commonly commercially available, often used for sleep aids.
  • the patient listens to relaxation non-speech sounds for a duration of at least 5 minutes, so the patient can rest the cognitive speech/noise distinguishing portion of the brain.
  • the user spends about 30 minutes listening to relaxing, natural sounds, using the hearing assist device with its DSP parameter settings in the cognitive training program.
  • this daily cognitive training regimen for a period of time, typically 3 to 28 days and preferably in about a week, the user repeats the cognitive testing 70, 72, 74, 76. Usually after a few weeks the user’s cognitive ability score improves to the next cognitive loss category level.
  • a medium or moderate cognitive loss 150 the user is told to use the hearing aid with its baseline DSP settings during day to day activities.
  • the hearing aid with its baseline settings provides enough benefit in voice recognition performance that the daily wear will not prove exceedingly frustrating.
  • Day to day activities typically occur in what are considered regular or high noise environments.
  • the usage of the baseline DSP settings in the day to day activities should be for a duration of at least 15 minutes during a day.
  • a new set of cognitive training parameters 146 are installed in the hearing aid in a modified cognitive training program (“Journey 2”).
  • the user can switch between the baseline DSP parameter settings and the Journey 2 DSP parameter settings using a simple switch or button on the hearing aid, or perhaps by using a hearing aid remote control.
  • the Journey 2 cognitive training DSP parameter settings are similar to the Journey cognitive training DSP parameter settings, but increases the compression ratio.
  • the user is told to perform cognitive training (listening to voices in a low noise environment, such as by watching TV) for a duration in the range of 5 minutes to 180 minutes and most preferably about 90 minutes a day, followed by a period such as about 30 minutes of relaxing listening.
  • the user uses the baseline settings for most of the day, but performs cognitive training with a different set of hearing aid settings and while listening to voices in a low noise environment for a limited time each day.
  • this daily Journey 2 cognitive training regimen for a period of time (typically 3 to 28 days and preferably in about a week) including wearing the hearing aid during day-to-day activities, the user repeats the cognitive testing. Usually after a few weeks the user’s cognitive ability score continues to improve to the next level.
  • the cognitive training parameter settings are again adjusted.
  • the Journey 1 cognitive training parameter settings are similar to the Journey 2 cognitive training parameter settings, but with a further increase in compression ratio.
  • the user may want to reperform the selection of which of the twenty four voice playbacks is best heard (determining whether to switch from a blue triangle set of DSP parameters to a different set of DSP parameters) for speech comprehension. While occasionally this improves satisfaction with the hearing assist device, many users can perform cognitive training to significantly reduce cognitive loss (i.e., going from Journey 3 to Journey 2 to Journey 1 to possibly eliminating cognitive training entirely) all the while maintaining the same hearing loss profile and therefore maintaining the same baseline DSP parameter settings on the hearing aid.
  • the frequency bands in the DSP are not selected at arbitrary breaks convenient to the hearing aid electronics, but rather are selected on a scale and spacing corresponding to the Bark scale of 24 critical bands. See https://en.wikipedia.org/wiki/Critical_band and https://en.wikipedia.org/wiki/Bark_scale, as rounded in the following Table I .
  • the algorithms for calculating DSP parameters then focuses on having the signal in as many of the thus-selected frequency bands be amplified/adjusted to include information based on the cognitive abilities of the patient.
  • the dynamic measurements and adjustments make sure that all available critical bands are reached.
  • the intent is not to have an objectively accurate sound given the hearing deficiencies of the user, but instead to compensate and adjust for the cognitive abilities and current cognitive retraining of the patient.
  • the output amplifies and provides such frequencies rather than to eliminate or minimize such frequencies in the DSP.
  • the methodology of the present invention provides as many brain relevant signals as possible to regain the brain's ability to separate speech from noise in a natural way, not by using technical features of the DSP to minimize the brain's need to separate speech from noise.
  • the improvement in daily situations for the patient is enormous, as the sound is natural and more akin to the learning achieved during the first years of life to separate speech from noise.
  • the brain is also trained to not lose more patterns because of further disuse of cognitive links, such disuse having begun from being hearing impaired.
  • the result of the present invention is, through retraining of the cognitive aspects of the brain, significantly better understanding of speech in all environments, as well as reduction of stress and reducing tiring of the brain caused in the prior art consensus methods due to interpolating through missing information.
  • FIG. 8 shows an adjustment screen 52 of a first preferred embodiment of a fitting software application.
  • FIG. 20 shows an adjustment screen 164 of a second preferred embodiment of a fitting software application.
  • a fitting software application 52, 164 will run on a computing device of an audiologist or other specialist or hearing professional, such as an iPad or other tablet (with screen shots 52, 164 from an iPad shown in FIGS. 8, 20 and 21), but alternatively on the audiologist's laptop computer, desktop computer, or smartphone.
  • the audiologist application is intended to be used, for instance, in a clinic, in setting up and ongoing monitoring of a patient’s progress. However, if a patient wants detailed fine tuning control over their own hearing aid(s), the patient could alternatively be given access to the fitting software application 52, 164 of either FIG. 8 or FIG. 20.
  • the preferred software application 52, 164 includes one or several initial login screens (not shown), prompting the user to enter his or her individual username and password.
  • correct entry of user name and password combination will allow the user to connect to a cloud service on the internet, either for downloading or storing appropriate control settings for the hearing aid 166 (shown in FIG. 21), for logging changes, usage or complaints, etc.
  • the cloud service may record the patient's current or prior cognitive loss score (points) and their current or prior hearing comprehension setting (shape and color) as described previously, alone or in conjunction with the patient's age, gender, preferred telephony ear as well as the type and serial number of the hearing aid(s) being used.
  • the software After logging in, the software searches for compatible hearing assist devices which can be wirelessly connected, such as compatible hearing assist devices and accessories which are on and connectable in near field or Bluetooth range.
  • compatible hearing assist devices which can be wirelessly connected
  • the preferred software application shows the devices found and identified on a list (not shown), so the user can initiate wireless connection with the desired device 166.
  • the list can include hearing assist devices or accessories that are already separately linked (such as via a WiFi or wired internet connection) to the cloud database.
  • the software application may include icons 168 such as radio button(s) or green check box(es), shown on the screen 164 to indicate such a connection.
  • the green check box(es) 168 will change to red if the connection becomes interrupted.
  • the finetuning provided by the software application of the present invention is different and unique, including displaying functions and settings which are new, each based on combining several hearing aid parameters for simultaneous adjustment.
  • the primary adjustments are split into four categories of "Loudness Mapping", “Cognitive Tonotopy”, “MIC” (for "MICrophone") and “MPO” (for "Maximum Power Output”).
  • an alternative embodiment 164 includes a 2-D selection area at left which is a "sound map" 170, and then (primarily to save screenspace) omits the two MIC slidebars.
  • Loudness Mapping controls dynamics of the audio signals
  • Cognitive Tonotopy controls frequency and gain
  • MIC controls the microphone input
  • MPO controls the maximum output levels.
  • the sound map 170 is a two dimensional display in which the user can drag and drop the circular cursor 172. Any location on the sound map 170 corresponds to values of several or all of the ten (in FIG. 20) parameters shown on the right. For instance, in one embodiment, as the user moves the cursor 172 on the sound map 170 at left, eight of the ten values shown on the slidebars at right all move and change, in a controlled mapping scheme. Alternatively, the user can individually adjust any of the ten parameters shown at right by dragging and dropping the active top of its individual slidebar. The preferred slidebars are scaled from 0 to 100 for whatever set of parameters they control.
  • a first adjustment that can be made is under the label "Audiophile Harmony” 174 to adjust noise management, which is a combined adjustment of both the noise reduction features and the low frequency compression features of the preferred DSP amplifiers in the hearing aid.
  • Layered Noise Reduction technology includes an algorithm which acts to remove noise between speech syllables, as well as lowering general background noise from the environment.
  • the LNR function in the DSP amplifier 176 (shown in FIG. 21) can be set to the following settings: Off, Low (7 dB), Medium (10 dB), High (13 dB), and Max (17 dB).
  • compression thresholds settings for each frequency channel in the DSP amplifier 176 can be set from 20 dB SPL to 82 dB SPL, in 2 dB steps.
  • the Audiophile Harmony slide bar 174 allows selection of these settings, and preferably also controls related noise reduction parameters in the DSP amplifier 176, such as on and off status and biQuad coefficients for first and second noise filters in the DSP amplifier 176.
  • Audiophile Harmony slide bar 174 may allow control over an input low cut filter which provides a 12 dB/octave smooth linear roll off below the comer frequency, with programmable corner frequency values of 250 Hz, 500 Hz, 750 Hz, 1 kHz, 1.25 kHz, 1.5 kHz, 2 kHz, 2.5 kHz, 3 kHz.
  • a second adjustment that can be made is under the label "3D Reach Dynamic” 178, which primarily selects compression mode and adjusts attack and release compression time constants of the preferred DSP amplifier 176 in the hearing aid 166.
  • the compression modes Basic, Fast or Reach Down
  • time constant settings are available as follows:
  • the 3D Reach Dynamic slidebar 178 allows simultaneous adjustment of the compression mode and the attack and release time constants for all the frequency channels.
  • the 3D Reach Dynamic value is one of the two that are solely controllable using its slidebar 178, i.e., moving the cursor 172 on the sound map 170 does not adjust 3D Reach Dynamic.
  • a third slide bar 180 presented in the Loudness Mapping category is labeled "Active Dynamic Processing" and provides compression management, primarily adjusting compression ratios within each frequency band.
  • compression ratio settings in each frequency channel are adjustable from 1:1 to 8:1, in 35 steps.
  • the Active Dynamic Processing slidebar 180 allows similtaneous adjustment of compression ratios for all the frequency channels.
  • a fourth slide bar 182 presented in the Loudness Mapping category is labeled "Acoustic
  • compression thresholds settings for each channel can be set from 20 dB SPL to 82 dB SPL, in 2 dB steps.
  • the Acoustic Map slidebar 182 allows similtaneous adjustment of compression threshold knees for all the frequency bands.
  • a first adjustment that can be made is under the label "Barkbase Soundscape” 184, which primarily adjusts the frequency band specific gains, also referred to as band equalizer or BEQ values.
  • the band gain adjusters are used to handle frequency shaping, with the most preferred DSP amplifier 176 providing each band with an adjustable gain in 2 dB steps from 0 dB to -40 dB.
  • the Barkbase soundscape slidebar 184 is a speech filter for reducing mid frequencies by pulling down on the slidebar 184 and raising mid-frequencies by lifting the slidebar 184 up, both in a stepped fashion.
  • One setting on the Barkbase Soundscape slidebar 184 leaves BEQ values equally unadjusted.
  • a first step or second upward raises some or all of the BEQ values overall, such as raising all BEQ values below 4kHz by +2 dB or +4 dB.
  • a first step downward provides a curved adjustment to the BEQ values, from no adjustment in the highest frequency band(s), to a -8 dB adjustment in a middle frequency band around 1 kHz, to a -2 dB adjustment in the lowest frequency band.
  • a second adjustment in the Cognitive Tonotopy category is under the label "Brilliance”.
  • This slidebar 186 simultaneously adjusts the BEQ values covering the 1-3 kHz midrange frequencies, in steps of 2 dB, such as raising the midrange frequencies by +2 dB, +4 dB, or +6 dB.
  • the 1-3 kHz midrange frequencies contain much of the sound information the brain needs to process and understand speech, so the Brilliance slidebar 186 can be thought of as a speech gain control.
  • a third adjustment in the Cognitive Tonotopy category is under the label "Perception”.
  • the Perception slidebar 188 simultaneously adjusts both the comer frequency of the input low cut filter, as well as the BEQ values covering the 3-8 kHz highrange frequencies.
  • a fourth adjustment in the Cognitive Tonotopy category is under the label "5k High Res Audio".
  • this control 190 it is useful to think of frequency band pairs, particularly for higher frequency (over 4kHz) bands. Raising the 5k High Res Audio slidebar 190 brings the two BEQ values within the frequency band pairs closer together. For instance, consider a frequency band pair (say, 5kHz and 5.5kHz) where the lower frequency band (5kHz) has an initial BEQ value of -6dB and the upper frequency band (5.5kHz) has an initial BEQ value of - lOdB. Raising the 5k High Res Audio slidebar 190 one step would change the BEQ in the lower frequency band to -7dB and simultaneously change the BEQ in the higher frequency band to - 9dB.
  • MPO maximum power output
  • the preferred amplifier 176 allows its maximum power output (MPO) to be limited using a compression limiter, which (unlike peak clipping) does not create harmonic distortion.
  • MPO maximum power output
  • the MPO can be programmed to the settings of: Off or anywhere from 0 dB to -28 dB (relative to maximum output) in 2 dB steps.
  • the output limiter threshold is not affected by the volume control setting, since the limiter is placed right before the output stage and after the volume control block.
  • the MPO slidebar 192 allows simultaneous adjustment of all the MPO values in all compression channels. In the most preferred embodiment of the sound map 170, the MPO value is one of the two that are solely controllable using its slidebar 192, i.e., moving the cursor 172 on the sound map 170 does not adjust MPO.
  • a second adjustment within the MPO category is labeled "Speech Headroom".
  • the Speech Headroom slidebar 194 sets the attack time of the MPO to allow more MPO for a limited time.
  • FIG. 8 shows two additional MICrophone slidebars, which are omitted from the embodiment of FIG. 20.
  • One of these slidebars allows control over the Cocktail Party Effect setting on the microphone input.
  • the other MICrophone slidebar allows control over the Pinna Effect setting on the microphone input.
  • the preferred sound map 170 shown at the left in FIG. 20 allows simultaneous control over eight of the ten slidebar variables, all based on the cognitive abilities of the patient.
  • the sound map 170 is separated into four quadrants, with icons 196, 198, 200, 202 displayed on the screen to indicate the appropriate situation for each quadrant.
  • Moving the circular cursor 172 toward the top right generally causes the values of the “Audiophile harmonie”,“perception” and“5kRES Audio” to increase
  • moving the circular cursor 172 toward the upper left generally causes the values of the“Acoustic map” to decrease, but causes the values of “Brilliance” and“Speech headroom to generally increase.
  • the settings toward the upper left quadrant tend to be appropriate for restaurant situations, and a restaurant icon 196 is positioned toward the upper left of the soundmap 170.
  • the settings toward the upper right quadrant tend to be appropriate for party situations, and a party icon 198 is positioned toward the upper right of the soundmap 170.
  • the settings toward the lower left quadrant tend to be appropriate for face to face conversational situations, and a conversation icon 200 is positioned toward the lower left of the soundmap 170.
  • the settings toward the lower right quadrant tend to be appropriate for public address situations, and a public address icon 202 is positioned toward the lower right of the soundmap 170.
  • These“ability meter” symbols 204 summarize the expected ability of the patient in each of the four situations (restaurant, party, conversation and public address), based upon the cognitive loss score (points) and hearing comprehension setting (shape and color) as described previously with reference to FIGS. 1-7 and 9-19 (and assuming that the cognitive loss score (points) and hearing comprehension setting (shape and color) have been input into the fitting software application).
  • An important benefit of the preferred software application involves limiting the ranges of various variables which can be controlled based on the hearing or cognitive abilities of the patient.
  • the user most commonly the patient, but it could also be an audiologist or other staff person
  • the user is not permitted to make changes of hearing device parameters that are outside the range of benefit to that particular patient at that particular time, according to the current hearing and deprivation conditions of that particular patient. This is further explained with reference to FIG. 21 and additional examples outlined below.
  • FIG. 21 includes a patient's computing device 206 running a fitting software application in accordance with the present invention, and in wired or wireless communication with a hearing aid 166 or other hearing assist device.
  • the hearing assist device 166 in this case depicted as a behind-the-ear hearing aid, has a housing 208 and includes a microphone 210, a digital signal processor (“DSP”) 176 and a speaker (receiver) 212 with a sound outlet 214 directed into the patient's ear canal (not shown), powered by a replaceable or rechargeable battery 216, such as the hearing aids further disclosed in U.S. Pat. Nos.
  • the hearing aid 166 also includes an antenna /chipset 218 for receiving a wireless signal, which can preferably include control data and/or audio data (such as from an audio streaming device, not shown), and/or may alternatively receive control data over a wired connection or directly programmed or burned into the DSP 176. While FIG. 21 depicts usage on an iPhone 206, the patient's fitting software application could alternatively be on the patient’s iPad or other tablet, laptop computer or desktop computer.
  • Both the audiologist's software application and the patient's software application are available for any type of computing device platform (Tablet, smartphone, PC, Mac). Further, the terms “audiologist's” and “patient's” are used herein merely for ease of understanding relative to the most common use case; these terms are not intended to indicate ownership of the device or the software license, nor even necessarily the identity of the person running the software application, but rather to demonstrate that at least one of the software applications (the "patient's” software application) can be limited in its range of control of DSP parameters relative to either the other software application or the full range of control of the respective DSP parameter in the hearing device 166.
  • the patient's computing device 206 is in communication with the audiologist’s computer, such as using wired or wireless transmissions or the communication scheme of U.S. Pat. App. No. 16/600,703, incorporated by reference.
  • the software it is important for the software to have an understanding of the cognitive abilities of the patient.
  • this involves obtaining the patient's current cognitive loss score (points) and their current hearing comprehension setting (shape and color) as described previously with reference to FIGS. 1-7 and 9-19.
  • the data can be acquired simply because all the computer screens shown in FIGS. 2-7 and 9-19 are from the same computer in the same session as the computer providing the screens 52, 164 shown in FIGS. 8 and 20.
  • the patient's cognitive loss score (points) and comprehension setting (shape and color) are directly input into the fitting software application.
  • the patient's cognitive loss score (points) and comprehension setting (shape and color) are downloaded into one or both fitting software applications from the cloud server.
  • An important benefit of the preferred software application involves limiting the ranges of various variables which can be controlled based on the hearing or cognitive abilities of the patient.
  • the user is not permitted to make changes of hearing device parameters that are outside the range of benefit to that particular patient at that particular time, according to the current hearing and deprivation conditions of that particular patient.
  • the preferred fitting software running on the patient’s smartphone 206 cannot make changes that could adversely affect and make the patient’s hearing cognition worse.
  • the ranges of permitted values allowed in the smartphone sound map 230 are limited relative to the ranges of values allowed in the audiologists soundmap 170.
  • the goal in the software algorithm which selects the permissive ranges in the smartphone sound map 230 is to avoid any setting that would lead to discomfort and/or to too much brain work, to avoid too much effort by the patient as he/she retrains the cognitive abilities of his/her brain.
  • the fitting software algorithm determines six different slidebar values for“Active Dynamic Processing” which can be selected by the audiologist. When scaled on a 0 to 100 scale, these are 0, 21, 42, 64, 85 and 100. Each of these values correspond to different regions on the 2-D soundmap 170. If the user (audiologist) moves the circular cursor 172 to the far left side, at any elevation, the Active Dynamic Processing value is 100.
  • the Active Dynamic Processing value is 100.
  • the Active Dynamic Processing value will decrease through the available values to the lowest scaled value of 0.
  • the Active Dynamic Processing value will decrease but only to a scaled value of 85.
  • the 2-D sound map 170 on the audiologist’s fitting software can be viewed as mapping into six different regions shown in the concept drawing 220 in the upper middle of FIG. 2.
  • This concept drawing 220 is never presented by the software, but merely conceptually translates what the user (audiologist) could determine by manipulating the circular cursor 172 to different areas of the soundmap 170 and watching the values output on the Active Dynamic Processing slidebar 180.
  • the user (audiologist) has moved the circular cursor 172 into the area with the Active Dynamic Processing scaled value of 42, so this 42 value appears in the positioning and for Active Dynamic Processing slide bar 180.
  • FIG. 21 also shows conceptual mappings 222, 224, 226 for compression ratios in three such frequency bands.
  • each scaled value on the Active Dynamic Processing map 220 correlates to a compression ratio value in each frequency channel.
  • the Active Dynamic Processing scaled value of 100 might correlate to a compression ratio of 1.25 in the first lowest frequency band li, to a compression ratio of 1.21 in the second lowest frequency band l 2 , etc. to a compression ratio of 1.43 in the highest frequency band l .
  • the resultant setting of compression ratio in the first lowest frequency band li i.e., the corresponding location of the circular cursor within map 222
  • the resultant setting of compression ratio in the second lowest frequency band l 2 i.e., the corresponding location of the circular cursor within map 224
  • the resultant setting of compression ratio in the highest frequency band l h i.e., the corresponding location of the circular cursor within map 226) would change to 1.6.
  • the preferred audiologist’s soundmap 170 presents a useful area 228, viewed by the audiologist in the fitting software application. This lets the audiologist know that moving the circular cursor 172 to a location outside the useful area 228 (or moving the slidebar 180 to select a scaled value for Active Dynamic Processing which does not occur within the useful area 228 of the concept map 220), is not appropriate for this patient at this time.
  • the only Active Dynamic Processing values within the useful area 228 are 100, 85, 64 and 42.
  • the audiologist would be able to determine that moving the slidebar 180 to a scaled value of 0 or 21 would not be useful for the current cognitive skills of this particular patient.
  • the intent is to have the software limit the available ranges of finetuning of the DSP 176 in accordance with the patient’s cognitive skills.
  • the patient’s soundmap 230 is limited to the useful area 228. This can be readily achieved just by scaling the useful area 228 in the x- and/or y- directions.
  • FIG. 21 also shows a concept mapping 232 of the patient’s soundmap 230, showing the Active Dynamic Processing scaled values within the soundmap 230 of 100, 85, 64 and 42. Accordingly, with the soundmap 230 presented to the patient being so scaled, it is always 100% safe for the patient to select any location on the patient’s soundmap 230 for setting the parameters of the hearing aid 166.
  • the 2-D sound map 230 on the patient’s fitting software can be viewed as a subset of the 2-D sound map 170 on the audiologist’s fitting software corresponding to the useful area 228, i.e., mapping into only four different regions of scaled values of 100, 85, 64 and 42.
  • This concept drawing 232 is again never presented by the software, but merely conceptually translates what the patient user could determine by manipulating the circular cursor 172 to different areas of the smartphone soundmap 230, transferring those values back into the audiologist’s fitting software (such as using the transfer scheme of U.S. Pat. App. No. 16/600,703, incorporated by reference), and checking which values were output on the Active Dynamic Processing slidebar 180.
  • Conceptual map 232 is thus just the active area portion of conceptual map 220.
  • Conceptual mappings 234, 236, 238 shown in FIG. 21 show the compression ratios in the same three frequency bands.
  • Each conceptual mapping 234, 236, 238, showing the compression ratio settings achieveable in this example of the patient’s soundmap 230, is the active area portion of its corresponding conceptual mapping 222, 224, 226.
  • FIG. 22 presents examples of such concept drawings for this particular patient (having a given cognitive loss score (points) of 6350 (cognitive deprivation is minimal) and comprehension setting (shape and color) of green triangle (left ear) and green triangle (right ear).
  • the soundmap 170 of the audiologist fitting software application allows more control over the eight variables, but also having a useful area 228 which is a subregion of the audiologist soundmap 170, with that useful area subregion scaled to the size of the patient’s smartphone soundmap 230.
  • the audiologist soundmap 170, the active area 228/patient’s soundmap 230, and the variable ranges of the slidebars 174, 178, 180, 182, 184, 186, 188, 192, 194 are all selected by the preferred algorithms based on the current cognitive ability (deprivation points) and hearing profile (shape, color) of the patient.
  • DSP amplifier 176 of an IntriCon AUDION 16 amplifier two examples are as follows:
  • the slidebar control, sound map 170 and useful area 228/sound map 230 translate into DSP control generally as follows:
  • LNR is initially set to low (-7 dB), with the ability to raise to - max (-17 dB) or lower to off (0 dB)(i.e., the slidebar 174, sound map 170 and useful area 228/sound map 230 all permit the full range of layered noise reduction control allowed by the amplifier 176);
  • B. 3D Reach - is not controlled by either soundmap 170 or sound map 230, but is set in the fitting software to a scaled value of 100, resulting in an compression attack time constant of 3 msec and a compression release time constant of 120 msec.
  • the slidebar 178 can be used to provide more comfort for the user by lowering the scaled value down from 100, which results in raising the compression attack and release time constants in accordance with the table presented previously;
  • Adaptive dynamic processing For a midrange frequency band, the compression ratio is set to 1.21. The remaining fifteen frequency bands have their compression ratios selected for an appropriate curve of compression ratios relative to the 1.21 midrange compression ratio.
  • the slidebar 180 and the full sound map 170 allow the midrange compression ratio to be adjusted up to five steps down to 1:43, with equal step changes applied to the other fifteen compression ratios.
  • the size of the useful area 228/control allowed in the soundmap 230 relative to the slidebar 180 and sound map control depends on slidebar settings of other variables.
  • the compression threshold is set to 44 dB SPL.
  • the remaining fifteen frequency bands have their compression thresholds selected for an appropriate curve of compression thresholds relative to the 44 dB SPL midrange compression threshold.
  • the slidebar 182 allow the midrange compression ratio to be increased from one to three steps up to 50 dB SPL or decreased from one to three steps down to 38 dB SPL, with equal step changes applied to the other fifteen compression ratios.
  • the audiologists’ sound map 170 only allows decreases to the compression ratios.
  • the size of the useful area 228/control provided in the patient’s soundmap 230 depends on slidebar settings of other variables.
  • E. Barkbase soundscape Initially sets the band EQ gains for all sixteen bands to -20 dB.
  • the slidebar 184 and the soundmap 170 have a first step down, where the following adjustments are made: BEQ1 and BEQ7, -2dB; BEQ2 and BEQ6, -4dB; BEQ3 and BEQ5, -6dB, BEQ4, -8DB; BEQ8 through BEQ16, no change.
  • the slidebar 184 allows up to three steps up, increasing BEQ1 through BEQ8 by +2, +4 or +6 dB, respectively, but making no change to BEQ 9 through BEQ16.
  • the soundmap 170 only allows up to two steps up.
  • the useful area 228 is sized such that the patient’s soundmap 230 only allows a single step up or a single step down.
  • the slidebar 186 and the soundmap 170 allows BEQ3 through BEQ6 to be moved one or two steps down, decreasing BEQ3 through BEQ6 by 2 or 4 dB respectively, or to be moved one, two or three steps up, increasing BEQ3 through BEQ6 by 2, 4 or 6 dB respectively.
  • the size of the useful area 228 and control provided in the patient’s soundmap 230 depends on other slidebar settings.
  • the slidebar 188 and both soundmaps 170, 230 allow the corner frequency of the input low cut filter to be unadjusted or increased one step.
  • the slidebar 188 and soundmap 170 allows BEQ7 through BEQ16 to be increased up to one step upward, i.e., by 2 dB, or to be decreased up to two steps downward, i.e., by 2 or 4 dB.
  • H. 5k High Res The control provided by the slidebar 190 and both soundmaps 170, 230 depends on whether the audiologist has separately made adjustments to BEQ9 through BEQ 16, in accordance with the“pair averaging” algorithm as described above.
  • MPO Each of the sixteen MPOs is initially set to 0. Neither sound map 170, 230 has any effect.
  • the slidebar 192 allows control of from one to fourteen steps, consistently changing each of the sixteen MPO values from -2 to -28dB in 2 dB steps.
  • J. Speech Headroom MPO attack time is initially unadjusted (DSP standard setting).
  • the slidebar 194 and the audiologist soundmap 170 allows up to five step changes in accordance with the DSP permitted values.
  • the patient soundmap 230 allows no change to MPO attack time.
  • LNR is initially set to high (-13 dB), with the ability to raise to -max (-17 dB) or lower to low (-70 dB)(i.e., the slidebar 174, sound map 170 and useful area 228/soundmap 230 are all limited to avoid high un-comfort sounds);
  • Adaptive dynamic processing For a midrange frequency band, the compression ratio is initially set to 1.6. The slidebar 180 and sound map 170 only allow up to three steps down.
  • each exact algorithm which translates the 0 to 100 value of each of the slidebar settings into each collection of DSP settings is continually being reviewed and analyzed to see if it can be improved, thereby providing better results for more patients.
  • Which slidebars are presented in the audiologist user interface, and which collections of DSP settings are being controlled by each slidebar are similarly under continuous review for potential improvement.
  • Each of the algorithms translating between the soundmap 170 and the 0 to 100 slidebar scaled values is similarly under continuous review, analysis and improvement.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

L'invention concerne un test d'audition par sélection d'une lecture parmi vingt-quatre lectures de parole, pour chaque oreille. Des exercices d'apprentissage/test cognitif effectuent un test et entraînent l'utilisateur à réapprendre à faire la distinction entre divers sons et en particulier la parole à l'aide du dispositif d'aide auditive. Les régimes d'utilisation de l'aide auditive dépendent de la perte cognitive mesurée, avec différents ensembles de paramètres DSP pour un apprentissage cognitif auto-orienté et non évalué. Une interface utilisateur d'audiologue et une interface utilisateur de patient comprennent des cartes sonores et des barres coulissantes pour commander des collections de paramètres auditifs à l'intérieur du DSP du dispositif. Sur la base du test cognitif et de l'apprentissage du patient, la plage de réglages autorisée à l'intérieur d'au moins l'interface utilisateur du patient est limitée. Le logiciel maintient donc toujours 100 % de sécurité pour le patient et/ou l'utilisateur pour affiner les paramètres d'aide auditive sans s'inquiéter de la sélection de valeurs de paramètre qui conduiraient à ralentir l'apprentissage cognitif du patient.
PCT/US2019/056152 2018-10-12 2019-10-14 Procédé d'ajustement de dispositif d'aide auditive, système, algorithme, logiciel, test de performances et apprentissage WO2020077348A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP19871422.2A EP3864862A4 (fr) 2018-10-12 2019-10-14 Procédé d'ajustement de dispositif d'aide auditive, système, algorithme, logiciel, test de performances et apprentissage

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201862745085P 2018-10-12 2018-10-12
US62/745,085 2018-10-12
US16/601,368 US10952649B2 (en) 2016-12-19 2019-10-14 Hearing assist device fitting method and software
US16/601,368 2019-10-14

Publications (1)

Publication Number Publication Date
WO2020077348A1 true WO2020077348A1 (fr) 2020-04-16

Family

ID=70165287

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2019/056152 WO2020077348A1 (fr) 2018-10-12 2019-10-14 Procédé d'ajustement de dispositif d'aide auditive, système, algorithme, logiciel, test de performances et apprentissage

Country Status (1)

Country Link
WO (1) WO2020077348A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114513733A (zh) * 2020-11-16 2022-05-17 合世生医科技股份有限公司 具智能音量调整的辅听装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040131195A1 (en) * 2002-09-30 2004-07-08 Patrick Mergell Device and method to adapt a hearing device
US20040264719A1 (en) * 2001-09-28 2004-12-30 Graham Naylor Method for fitting a hearing aid to the needs of a hearing aid user and assistive tool for use when fitting a hearing aid to a hearing aid user
US8094848B1 (en) * 2006-04-24 2012-01-10 At&T Mobility Ii Llc Automatically configuring hearing assistive device
US20150003650A1 (en) * 2013-06-28 2015-01-01 Otoharmonics Corporation Systems and methods for a tinnitus therapy
US20150256942A1 (en) * 2012-09-27 2015-09-10 Jacoti Bvba Method for Adjusting Parameters of a Hearing Aid Functionality Provided in a Consumer Electronics Device
US20170332180A1 (en) * 2016-05-16 2017-11-16 Intricon Corporation Feedback Reduction For High Frequencies

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040264719A1 (en) * 2001-09-28 2004-12-30 Graham Naylor Method for fitting a hearing aid to the needs of a hearing aid user and assistive tool for use when fitting a hearing aid to a hearing aid user
US20040131195A1 (en) * 2002-09-30 2004-07-08 Patrick Mergell Device and method to adapt a hearing device
US8094848B1 (en) * 2006-04-24 2012-01-10 At&T Mobility Ii Llc Automatically configuring hearing assistive device
US20150256942A1 (en) * 2012-09-27 2015-09-10 Jacoti Bvba Method for Adjusting Parameters of a Hearing Aid Functionality Provided in a Consumer Electronics Device
US20150003650A1 (en) * 2013-06-28 2015-01-01 Otoharmonics Corporation Systems and methods for a tinnitus therapy
US20170332180A1 (en) * 2016-05-16 2017-11-16 Intricon Corporation Feedback Reduction For High Frequencies

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114513733A (zh) * 2020-11-16 2022-05-17 合世生医科技股份有限公司 具智能音量调整的辅听装置

Similar Documents

Publication Publication Date Title
US10952649B2 (en) Hearing assist device fitting method and software
US11095995B2 (en) Hearing assist device fitting method, system, algorithm, software, performance testing and training
US9782131B2 (en) Method and system for self-managed sound enhancement
US10356535B2 (en) Method and system for self-managed sound enhancement
JP6279757B2 (ja) 補聴器システムをフィッティングする方法および補聴器フィッティング・システム
US20140193008A1 (en) System and method for fitting of a hearing device
CN103081513B (zh) 听力装置的基于视觉的选配
US20150256942A1 (en) Method for Adjusting Parameters of a Hearing Aid Functionality Provided in a Consumer Electronics Device
US20070286350A1 (en) Speech-based optimization of digital hearing devices
CA2876251C (fr) Systeme et procede d'evaluation et de selection de prothese auditive
US10334376B2 (en) Hearing system with user-specific programming
US11882413B2 (en) System and method for personalized fitting of hearing aids
EP3864862A1 (fr) Procédé d'ajustement de dispositif d'aide auditive, système, algorithme, logiciel, test de performances et apprentissage
WO2020077348A1 (fr) Procédé d'ajustement de dispositif d'aide auditive, système, algorithme, logiciel, test de performances et apprentissage
US20220369054A1 (en) System and method for personalized sound modification
EP3232906B1 (fr) Système de test auditif
Scollie 20Q: The Ins and outs of frequency lowering amplification
Bramsløw et al. Hearing aids
KR102093369B1 (ko) 확장역치레벨에 대한 최적증폭을 위한 보청기 시스템의 제어 방법, 장치 및 프로그램
KR102093368B1 (ko) 한국어에 특화된 최적증폭을 위한 보청기 시스템의 제어 방법, 장치 및 프로그램
KR102093370B1 (ko) 압축역치레벨에 대한 최적증폭을 위한 보청기 시스템의 제어 방법, 장치 및 프로그램
KR102069893B1 (ko) 최적증폭을 위한 보청기 시스템의 제어 방법, 장치 및 프로그램
Jespersen Independent study identifies a method for evaluating hearing instrument sound quality
Palmer et al. Unleashing to Power of Test Box and Real-Ear Probe Microphone Measurement: Chapter 3: Setting the Hearing Aid Response and Verifying Signal Processing and Features in the Test Box
Palmer et al. Setting the Hearing Aid Response and Verifying Signal Processing and Features in the Test Box

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19871422

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019871422

Country of ref document: EP

Effective date: 20210512