WO2019235913A1 - Method for processing an audio signal for a hearing aid - Google Patents

Method for processing an audio signal for a hearing aid Download PDF

Info

Publication number
WO2019235913A1
WO2019235913A1 PCT/NL2019/050320 NL2019050320W WO2019235913A1 WO 2019235913 A1 WO2019235913 A1 WO 2019235913A1 NL 2019050320 W NL2019050320 W NL 2019050320W WO 2019235913 A1 WO2019235913 A1 WO 2019235913A1
Authority
WO
WIPO (PCT)
Prior art keywords
frequency range
signal
audio signal
low
high frequency
Prior art date
Application number
PCT/NL2019/050320
Other languages
French (fr)
Inventor
Cor DRIEBERGEN
Original Assignee
Interhear B.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Interhear B.V. filed Critical Interhear B.V.
Publication of WO2019235913A1 publication Critical patent/WO2019235913A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/70Adaptation of deaf aid to hearing loss, e.g. initial electronic fitting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/43Signal processing in hearing aids to enhance the speech intelligibility
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/50Customised settings for obtaining desired overall acoustical characteristics
    • H04R25/505Customised settings for obtaining desired overall acoustical characteristics using digital signal processing

Definitions

  • the invention relates to the field of a method of processing an audio signal.
  • the invention further relates to a hearing aid or mobile device using this method.
  • Humans with impaired hearing may be assisted by a hearing aid to be able to hear others speaking to them. This allows these humans to continue to participate in society. And as humans are becoming older and older, the ears of these humans will be more and more impaired overtime, thus more and more people will depend on a hearing aid.
  • a disadvantage of the current hearing aids is that the intelligibility of users of the hearing aid is still impaired.
  • An object of the invention is to improve the intelligibility of an audio signal.
  • a method for processing an audio signal for a hearing-impaired listener comprising a speech signal comprising the steps of:
  • the low frequency range is spaced apart from the high frequency range.
  • vowels in speech signals are associated with low frequencies and consonants are associated with high frequencies. Although more detailed models show that some vowels may be associated with high frequencies and some consonants may be associated with low frequencies, still vowels are
  • the association of vowels and consonants with a particular frequency range may be done based on tests. These tests measure the amount of energy and/or amplitude of a speech signal at a particular frequency.
  • the speech signal comprises a particular vowel or consonant.
  • the particular frequency range for a vowel or consonant is the range of frequencies combined comprising more than a predefined level amount of energy or signal amplitude compared to the total amount of energy or amplitude in the signal.
  • the predefined level may be 50%, 60% or 70%, preferably 80%, more preferably 85%, most preferably 90%.
  • the lower frequency range typically has a lower edge of 100Hz, preferably 125Hz, more preferably 150Hz.
  • the lower frequency range typically has a higher edge of 700Hz, preferably 750Hz, more preferably 800Hz.
  • the higher frequency typically has a lower edge of 1200Hz, preferably 1250Hz, more preferably 1300Hz.
  • the higher frequency typically has a higher edge at a frequency that is on the edge of audibility, such as around 20kHz.
  • the method comprises the steps of associating the low frequency range and associating the high frequency range are based on the language of the speech signal and/or the differences between man and woman. As vowels and consonants are pronounced differently, the association of low and high frequency ranges may be depended on the language or even the dialect of the language. Further, as pronunciation may vary from one person to another and especially pronunciation varies between man and woman, the association of low and high frequency ranges may vary. In a further embodiment of the invention, the steps of associating the low frequency range and associating the high frequency range are dynamic. This allows for the method to adapt to changes in the speech signal.
  • the amplification factor is higher compared to the multiplication factor, preferably wherein the amplification factor is at least 20dB, preferably 25dB, more preferably 30dB, more preferably 35dB, more preferably 40dB, most preferably 45dB, higher compared to the multiplication factor.
  • the multiplication factor is in the range of -40dB to 10dB, preferably -35dB to 5dB, more preferably -30dB to OdB, most preferably -25 to -5dB and/or the amplification factor is in the range of -10dB to 25dB, preferably -5dB to 20dB, more preferably OdB to 15dB, most preferably 5 to 10dB.
  • the hearing impairment gradually develops, whereby the higher frequencies are impaired first or are impaired the most compared to the lower frequencies.
  • the amplification factor is set higher for higher frequencies.
  • the method comprises the step of receiving the audio signal comprises the step of receiving the audio signal from a microphone and/or the step of transmitting the processed audio signal comprises the step of transmitting the processed audio signal to a speaker.
  • the method comprises the step of attenuating a medium frequency range arranged between the low and the high frequency range. It is an insight of the inventor that attenuating the medium frequency has the effect of enhancing the intelligibility of the speech signal. Typically, this medium frequency range is associated with background noise by the inventor. Thus, the inventor extends the current models of speech with the insight that the frequency ranges associated with vowels and consonants are spaced apart and the frequency range in between is to be attenuated to enhance the intelligibility of the speech signal.
  • Attenuating the medium frequency typically does not cost energy, on the contrary it saves energy as not the complete frequency spectrum is amplified. Therefore, a further technical effect may be that as the medium frequency range is attenuated, a more energy efficient method is provided for obtaining a more intelligible mixed audio signal from the audio signal.
  • the medium frequency range is centred around the 1 kHz.
  • the lower edge of the medium frequency range is around the 750Hz and the higher edge is around the 1250Hz.
  • the attenuation of the medium frequency range is at least -20dB, preferably -25dB, more preferably -30dB, most preferably -35dB. This attenuation step may be implemented as a band-stop filter or in software executed on a processor.
  • the method comprises the step of attenuating all frequencies outside the low and high frequency ranges.
  • the technical effect is that the intelligibility is further enhanced.
  • another technical effect may be that the method becomes even more energy efficient as no energy is wasted due to amplifying frequencies that are not of interest for obtaining a more intelligible mixed audio signal from the audio signal.
  • a computer program product comprising a computer readable medium having computer readable code embodied therein, the computer readable code being configured such that, on execution by a suitable computer or processor, the computer or processor is caused to perform any of the methods according to the claims or specified in the description.
  • a hearing aid for a hearing- impaired listener comprising:
  • a microphone for receiving an audio signal comprising a speech signal
  • a low frequency pass-filter for filtering out a low filtered signal from the audio signal by letting frequencies pass in the low frequency range
  • a high frequency pass-filter for filtering out a high filtered signal from the audio signal by letting frequencies pass in the high frequency range
  • an amplifier for amplifying the high filtered signal with an amplification factor to an amplified signal
  • a hearing aid comprising a register for storing a plurality of settings, wherein each setting specifies the amplification or the attenuation for a specific frequency range; wherein a first subset of the plurality of settings forms the low frequency range; and wherein a second subset of the plurality of settings forms the high frequency range.
  • a mobile device comprising an app for a hearing-impaired listener, comprising:
  • a low frequency pass-filter for filtering out a low filtered signal from the audio signal by letting frequencies pass in the low frequency range
  • a high frequency pass-filter for filtering out a high filtered signal from the audio signal by letting frequencies pass in the high frequency range
  • an amplifier for amplifying the high filtered signal with an amplification factor to an amplified signal
  • a computer program product comprising a computer readable medium having computer readable code embodied therein, the computer readable code comprising a plurality of settings:
  • each setting specifies the amplification or the attenuation for a specific frequency range; wherein a first subset of the plurality of settings forms the low frequency range;
  • the computer readable code is configured for use by a hearing aid and/or mobile device according to any of the claims or mentioned in the
  • Figure 1 schematically shows a hearing aid according to an embodiment of the current invention
  • Figure 2 schematically shows a method for processing an audio signal for a hearing-impaired listener
  • Figure 3A schematically shows an embodiment of the invention in a first graph
  • Figure 3B schematically shows an embodiment of the invention in a second graph
  • Figure 4 schematically shows test results of an open ear resonance measurement
  • Figure 5 schematically shows settings for an Oticon hearing aid according to the invention
  • Figure 6 schematically shows settings for a Phonak hearing aid according to the invention
  • Figure 7 schematically shows settings for a Sivantos hearing aid according to the invention
  • Figure 8 schematically shows settings for a Starkey hearing aid according to the invention
  • Figure 9A schematically shows test results of an intelligibility test for a first listener
  • Figure 9B schematically shows test results of an intelligibility test for a second listener
  • Figure 9C schematically shows test results of an intelligibility test for a third listener
  • Figure 10 schematically shows an embodiment of a computer program product, computer readable medium and/or non-transitory computer readable storage medium according to the invention.
  • FIG. 1 schematically shows a hearing aid 100 according to an embodiment of the current invention.
  • the hearing aid comprises a microphone 115, a low association unit 120, a low frequency pass filter 130, a multiplier 140, a high association unit 160, a high frequency pass-filter 170, an amplifier 180, a mixer 190 and a speaker 195.
  • the microphone is arranged for receiving an audio signal 110 for example from the mouth 10 of a speaker.
  • the microphone transforms the audio signal to a received audio signal 117, such as an electrical received audio signal.
  • the received audio signal is distributed to at least the low and high frequency pass-filters.
  • the low and high frequency pass-filters are also provided with low and high frequency range settings 125, 165, respectively.
  • the frequency range settings may comprise a multiplier factor, such as an amplification or an attenuation, per frequency band or range.
  • a range may comprise multiple frequency bands.
  • the low and high frequency range settings are provided by the low and high association units, respectively.
  • the low frequency range settings are associated with vowels and the high frequency range settings are associated with consonants.
  • the association units may comprise a fixed register with settings.
  • the association unit may comprise an adaptive unit for changing the settings, for example depending on the received audio signal.
  • the adaptation may depend on the language of the received speech signal.
  • the adaptation may depend on the loudness of the received speech signal.
  • the adaptation may depend on the SNR of the audio signal.
  • the adaptation may depend on the presence of background noise in the audio signal. Or the adaptation may depend on a combination of the previous mentioned factors.
  • the low frequency pass-filter provides a low filtered signal 135 to the multiplier.
  • the hearing aid may further comprise a frequency register 150, which may provide multiplier settings per frequency band 152. Alternatively, the frequency register may provide one multiplier setting 152 for the complete frequency range. In an alternative embodiment the frequency settings are depended on the audio signal in a similar way as for the association units.
  • the multiplier multiplies the low filtered signal with the multiplier setting and provides a multiplied signal 145 to the mixer.
  • the high frequency pass-filter provides a high filtered signal 175 to the amplifier.
  • the frequency register may provide amplifier settings per frequency band 155. Alternatively, the frequency register may provide one amplifier setting 155 for the complete frequency range. In an alternative embodiment the frequency settings are depended on the audio signal in a similar way as for the association units.
  • the amplifier amplifies the high filtered signal with the amplifier setting and provides an amplified signal 185 to the mixer.
  • the mixer mixes the multiplied signal and the amplified signal to a mixed audio signal 192.
  • the mixing is typically adding the multiplied signal and the amplified signal, such as adding in the time domain. Alternatively, the adding may be done in the frequency domain.
  • the mixer provides the mixed audio signal to the speaker.
  • the speaker transforms the mixed audio signal in a transmitted mixed audio signal 197, that can be received by an ear 20 of a hearing-impaired listener.
  • a technical effect of that the low frequency range and the high frequency range is spaced apart is that the intelligibility of the transmitted audio signal is improved.
  • a further technical effect is provided if the frequency range between the low and high frequency range is attenuated. Specific frequency ranges to be amplified and attenuated are detailed throughout this description.
  • the hearing aid may combine several elements in one element.
  • the low frequency pass-filter may be combined with the multiplier
  • the high frequency pass-filter may be combined with the amplifier
  • the low association unit and the high association unit may be combined
  • the low and high frequency pass-filter may be combined making the mixer implicit and/or the low and high association units may be combined with the frequency register.
  • part of the signals in the hearing aid may be digitized, such as that the filters, association units, multiplier, amplifier and/or mixer are implemented as software run on a microprocessor.
  • the microphone may comprise an AD-converter and/or the speaker may comprise a DA-converter.
  • Figure 1 can also schematically represent a mobile device by replacing the microphone and speaker with an input and an output, respectively.
  • Figure 2 schematically shows a method 200 for processing an audio signal for a hearing-impaired listener.
  • the method starts with the step receiving 210 the audio signal.
  • the method continues with the step of associating 215 a low frequency range with vowels.
  • the method continues with the step of filtering 220 out a first low filtered signal from the audio signal by letting frequencies pass in the first low frequency range.
  • the method continues with the step of multiplying 225 the low filtered signal with a multiplication factor to a multiplied signal.
  • the method continues with the step of associating 230 a high frequency range with consonants.
  • the method continuous with the step of filtering 235 out a high filtered signal from the audio signal by letting frequencies pass in the high frequency range.
  • the method continuous with the step of amplifying 240 the high filtered signal with an amplification factor to an amplified signal the method continuous with the step of mixing 245 the multiplied signal and the amplified signal to a mixed audio signal.
  • the method further specifies that the low frequency range is spaced apart from the high frequency range. The method provides the technical effects as specified throughout this description.
  • the different steps in the method described in figure 2 may be executed in a different order, if these steps are independent of each other, depending on the specific embodiment of the method. Also, different steps of the method in figure 2 may be executed in parallel and/or merged depending on the specific embodiment of the method.
  • Figure 3A and 3B schematically show an embodiment of the invention in a first 310 and second 320 graph, respectively.
  • the graphs have a horizontal axis having a frequency scale in Hertz and a vertical axis having a gain scale in dB.
  • the horizontal axis has a marking 0Hz at its origin.
  • the horizontal axis has a marking Med. freq. 318, 328, which is an abbreviation of medium frequency.
  • the medium frequency may be extended to either side forming a medium frequency range.
  • the medium frequency or medium frequency range separates a low frequency range 311 , 321 from a high frequency range 315,
  • the vertical axis has a marking OdB indicating no gain.
  • the marking OdB identifies the top of the gain for the low and high frequency range.
  • the top 312, 316, 322, 326 of the gain for the low and high frequency range may be at another level then OdB.
  • the top of the gain for the low and high frequency range are different.
  • the top of the gain for the low and high frequency range are depending on the frequency, such as sloped or curved.
  • figure 3B shows a gain peak or spike 327 in the high frequency range, thus further amplifying the signal for a specific frequency.
  • This last embodiment is specifically advantageous according to the inventor. Settings according to this last embodiment and according to the embodiment in figure 3A are further detailed in figures 5 to 8. Combinations of the alternative embodiments are within the scope of the invention.
  • FIG. 4 schematically shows test results of an open ear resonance measurement 400. This and following test results are print screens of different programs used to provide the reader with insight in the invention.
  • the top graph 410 shows the open ear resonance for the left ear.
  • the bottom graph 450 shows the open ear resonance for the right ear. Both graphs have on the horizontal axis the
  • the maximum amplification in the graph is 60dB and the maximum attenuation in the graph is -30dB.
  • the minimum frequency is 125Hz and the maximum frequency is 8kHz.
  • the line 420 in the top graph shows the ear resonance for the left ear and the line 460 in the bottom graph shows the ear resonance for the right ear.
  • This open ear resonance for the left and right ear are almost always different. This difference allows for directional hearing.
  • Figure 5 schematically shows settings 500 for an Oticon hearing aid according to the invention.
  • the top table 510 shows the original settings of the Oticon hearing aid.
  • the top graph 520 shows the original settings of the Oticon hearing aid corresponding to the top table.
  • the bottom table 550 shows the settings for the hearing aid according to the invention.
  • the bottom graph 560 shows the settings for the hearing aid according to the invention corresponding to the bottom table.
  • the tables have different rows representing a frequency band. For each row the centre frequency for the frequency band is shown.
  • the table has different columns with the designation of the column shown at the bottom.
  • the left most column is labelled“Alle” showing the centre frequency.
  • the column to the right is labelled“MPO” which is the abbreviation for Maximum Power Output.
  • the MPO is the maximum power output or amplification factor of the hearing aid.
  • the following columns are labelled“Luid”,“Matig” and“Zacht”, which translate to“Loud”,“Medium” and“Soft”, respectively.
  • Hearing aids typically have amplification settings depending on the loudness of the received audio signal.
  • the hearing aid selects the settings for“Luid”, if the received audio signal is soft, the hearing aid selects the settings for“Zacht”, and if the received audio signal is in between or medium, the hearing aid selects the settings for“Matig”.
  • the graphs 520, 560 show the settings for“Luid”,“Matig” and“Zacht” in the settings tables 510, 550, respectively with three different lines 522, 524, 526, 562, 564, 566 per graph, respectively.
  • the settings in the bottom table as well as the bottom graph show a dip 570 around the 1 kHz spacing apart and/or separating the lower frequency range below around 750Hz and the higher frequency range above around 1250Hz. This dip suppresses background noise and improves intelligibility according to the invention. This dip may be seen as the medium frequency range.
  • Figure 6 schematically shows settings 600 for a Phonak hearing aid according to the invention.
  • the top table 610 shows the original settings of the Phonak hearing aid.
  • the top graph 620 shows the original settings of the Phonak hearing aid corresponding to the top table.
  • the bottom table 650 shows the settings for the hearing aid according to the invention.
  • the bottom graph 660 shows the settings for the hearing aid according to the invention corresponding to the bottom table.
  • the tables have different rows representing a frequency band. For each row the centre frequency for the frequency band is shown.
  • the table has different columns with the designation of the column shown at the bottom.
  • the left most column is labelled“MPO” which is the abbreviation for Maximum Power Output.
  • the MPO is the maximum power output or amplification factor of the hearing aid.
  • the column to the right is labelled“Alle” showing the centre frequency.
  • the following columns are labelled“G80”,“G65” and“G50”.
  • Hearing aids typically have amplification settings depending on the loudness of the received audio signal.
  • the hearing aid selects the settings for“G80”, if the received audio signal is below 50dB, the hearing aid selects the settings for“G50”, and if the received audio signal is in between or around 65dB, the hearing aid selects the settings for“G65”.
  • the graphs 620, 660 show the settings for“G80",“G65” and“G50” in the settings tables 610, 650, respectively with three different lines 622, 624, 626, 662, 664, 666 per graph, respectively.
  • the settings in the bottom table as well as the bottom graph show a dip 670 around the 1 kHz spacing apart and/or separating the lower frequency range below around 860Hz and the higher frequency range above around 1200Hz. This dip suppresses background noise and improves intelligibility according to the invention. This dip may be seen as the medium frequency range.
  • Figure 7 schematically shows settings 700 for a Sivantos hearing aid according to the invention.
  • the top table 710 shows the original settings of the
  • the top graph 720 shows the original settings of the Sivantos hearing aid corresponding to the top table.
  • the bottom table 750 shows the settings for the hearing aid according to the invention.
  • the bottom graph 760 shows the settings for the hearing aid according to the invention corresponding to the bottom table.
  • the tables comprise not just values but are represented by settings or sliders of an equalizer. Each slider represents the amplification or attenuation for a specific centre frequency. The values of the sliders are automatically translated in three different settings for“Loud”,“Medium” and“Soft”, respectively of the received audio signal.
  • Hearing aids typically have amplification settings depending on the loudness of the received audio signal. If the received audio signal is loud, the hearing aid selects the settings for“Loud”, if the received audio signal is soft, the hearing aid selects the settings for“Soft”, and if the received audio signal is in between or medium, the hearing aid selects the settings for“Medium”.
  • the graphs 720, 760 show the settings for“Loud”,“Medium” and“Soft” in the settings tables 710, 750, respectively with three different lines 722, 724, 726, 762, 764, 766 per graph, respectively.
  • the settings in the bottom table as well as the bottom graph show a dip 770 around the 1 kHz spacing apart and/or separating the lower frequency range below around 750Hz and the higher frequency range above around 1250Hz. This dip suppresses background noise and improves intelligibility according to the invention. This dip may be seen as the medium frequency range.
  • Figure 8 schematically shows settings 800 for a Starkey hearing aid according to the invention.
  • the top table 810 shows the original settings of the Starkey hearing aid.
  • the top graph 820 shows the original settings of the Starkey hearing aid corresponding to the top table.
  • the bottom table 850 shows the settings for the hearing aid according to the invention.
  • the bottom graph 860 shows the settings for the hearing aid according to the invention corresponding to the bottom table.
  • the tables have different rows representing a frequency band. For each row the centre frequency for the frequency band is shown.
  • the table has different columns with the designation of the column shown in the middle of the column.
  • the left most column is labelled“Alles” showing the centre frequency.
  • the rightmost column is labelled“MPO” which is the abbreviation for Maximum Power Output.
  • the MPO is the maximum power output or amplification factor of the hearing aid.
  • the columns in between are labelled“Luid”,“Gemiddeld” and“Zacht”, which translate to“Loud”, “Average” and“Soft”, respectively.
  • Hearing aids typically have amplification settings depending on the loudness of the received audio signal.
  • the hearing aid selects the settings for“Luid”, if the received audio signal is soft, the hearing aid selects the settings for“Zacht”, and if the received audio signal is in between or average, the hearing aid selects the settings for“Gemiddeld”.
  • the graphs 820, 860 show the settings for“Luid”,“Gemiddeld” and“Zacht” in the settings tables 810, 850, respectively with three different lines 822, 824, 826,
  • the settings in the bottom table as well as the bottom graph show a dip 870 around the 950Hz spacing apart and/or separating the lower frequency range below around 700Hz and the higher frequency range above around 1200Hz. This dip suppresses background noise and improves intelligibility according to the invention. This dip may be seen as the medium frequency range.
  • Figure 9A, figure 9B and figure 9C schematically shows test results of an intelligibility test for a first, second and third listener, respectively. Reference numbers are only shown for figure 9A but are equally applicable for the figures 9B and 9C.
  • Intelligibility tests come in different forms, e.g. the speech transmission index, Tikofsky’s 50-word intelligibility test and Harvard PB test.
  • the figures show tests results from the Hearing-Aid Speech Perception Index or HASPI from three different persons.
  • HASPI Hearing-Aid Speech Perception Index
  • the first horizontal axis 910 at the bottom of the figure shows the loudness of the test signal in decibels. Although the horizontal axis ranges from -10dB to 120dB, it is clear that measurements are always positive.
  • the vertical axis 911 on the left of the figure shows the percentage of intelligible words.
  • the second horizontal axis 912 halfway of the figure offset to the right relative to the first horizontal axis shows the speech reception index, speech reception test score, speech reception threshold or SRT.
  • the SRT is a score line, which indicates how well the listener understands words or words are intelligible for the listener.
  • the curved line 920 without marking is the normal line or reference line.
  • the reference is a normal person without hearing problems, thus this line indicates the ideal.
  • the curved line 921 with triangular or circular markings, depending on the figure, are measurements taken with the right ear of the listener without hearing aid. Each marking is a measurement.
  • the curved line 922 with squares and crosses as markings, depending on the figure, are measurements taken with the left ear of the listener without hearing aid. All figures show a considerable gap between the reference line and the curved lines 921 , 922 indicating a considerable loss of the capacity of understanding words or intelligibility.
  • the curved line 923 with V as markings are measurements taken with a free-field stereo measurement.
  • the three figures each show an improvement of the capacity of understanding words or intelligibility for this curved line, but still not close to the reference line.
  • the curved line 924 with T as markings are measurements taken wherein the listener is equipped with a hearing aid configured according to the invention. This curved line is much closer to the reference line and shows a considerable improvement.
  • Figure 10 schematically shows an embodiment of a computer program product 1000, computer readable medium and/or non-transitory computer readable storage medium according to the invention.
  • the invention also applies to computer programs, particularly computer programs on or in a carrier, adapted to put the invention into practice.
  • the program may be in the form of a source code, an object code, a code intermediate source and an object code such as in a partially compiled form, or in any other form suitable for use in the implementation of the method according to the invention.
  • a program may have many different architectural designs.
  • a program code implementing the functionality of the method or system according to the invention may be sub-divided into one or more sub-routines. Many different ways of distributing the functionality among these sub- routines will be apparent to the skilled person.
  • the sub-routines may be stored together in one executable file to form a self-contained program.
  • Such an executable file may comprise computer-executable instructions, for example, processor
  • interpreter instructions e.g. Java interpreter instructions
  • one or more or all of the sub-routines may be stored in at least one external library file and linked with a main program either statically or dynamically, e.g. at run-time.
  • the main program contains at least one call to at least one of the sub- routines.
  • the sub-routines may also comprise function calls to each other.
  • An embodiment relating to a computer program product comprises computer-executable instructions corresponding to each processing stage of at least one of the methods set forth herein. These instructions may be sub-divided into sub-routines and/or stored in one or more files that may be linked statically or dynamically.
  • Another embodiment relating to a computer program product comprises computer-executable instructions corresponding to each means of at least one of the systems and/or products set forth herein. These instructions may be sub-divided into sub-routines and/or stored in one or more files that may be linked statically or dynamically.
  • the carrier of a computer program may be any entity or device capable of carrying the program.
  • the carrier may include a data storage, such as a ROM, for example, a CD ROM or a semiconductor ROM, or a magnetic recording medium, for example, a hard disk.
  • the carrier may be a transmissible carrier such as an electric or optical signal, which may be conveyed via electric or optical cable or by radio or other means.
  • the carrier may be constituted by such a cable or other device or means.
  • the carrier may be an integrated circuit in which the program is embedded, the integrated circuit being adapted to perform, or used in the performance of, the relevant method.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

During the lifetime of a human his hearing capabilities decline. Humans with impaired hearing may be assisted by a hearing aid to be able to hear others speaking to them. A disadvantage of the current hearing aids is that the intelligibility of users of the hearing aid is still impaired. The intelligibility is improved by a hearing aid according to the invention, comprising: a microphone for receiving an audio signal comprising a speech signal; a low association unit for associating a low frequency range with vowels; a low frequency pass-filter for filtering out a low filtered signal from the audio signal by letting frequencies pass in the low frequency range; a multiplier for multiplying the low filtered signal with an multiplication factor to a multiplied signal; a high association unit associating a high frequency range with consonants; a high frequency pass-filter for filtering out a high filtered signal from the audio signal by letting frequencies pass in the high frequency range; an amplifier for amplifying the high filtered signal with an amplification factor to an amplified signal; a mixer for mixing the multiplied signal and the amplified signal to a mixed audio signal; and a speaker for transmitting the mixed audio signal, wherein the low frequency range is spaced apart from the high frequency range.

Description

METHOD FOR PROCESSING AN AUDIO SIGNAL FOR A HEARING AID
FIELD OF THE INVENTION
The invention relates to the field of a method of processing an audio signal. The invention further relates to a hearing aid or mobile device using this method.
BACKGROUND OF THE INVENTION
During the lifetime of a human his hearing capabilities decline. Most of the time this decline goes gradually, but sometimes this decline may be abrupt, such as when a loud noise next to the ear cause ear damage.
Humans with impaired hearing may be assisted by a hearing aid to be able to hear others speaking to them. This allows these humans to continue to participate in society. And as humans are becoming older and older, the ears of these humans will be more and more impaired overtime, thus more and more people will depend on a hearing aid.
In past times the ear trumpet was used to improve the hearing. Nowadays, electronic hearing aids are available having a speaker placed in the ear that outputs an amplified audio signal received by a microphone. Miniaturization has gone such far that the speaker, amplifier, microphone and power source all can be placed in-ear.
A disadvantage of the current hearing aids is that the intelligibility of users of the hearing aid is still impaired.
SUMMARY OF THE INVENTION
An object of the invention is to improve the intelligibility of an audio signal.
According to a first aspect of the invention, a method for processing an audio signal for a hearing-impaired listener comprising a speech signal, wherein the method comprises the steps of:
- receiving the audio signal;
- associating a low frequency range with vowels;
- filtering out a low filtered signal from the audio signal by letting frequencies pass in the low frequency range;
- multiplying the low filtered signal with a multiplication factor to a multiplied signal;
- associating a high frequency range with consonants;
- filtering out a high filtered signal from the audio signal by letting frequencies pass in the high frequency range;
- amplifying the high filtered signal with an amplification factor to an amplified signal;
- mixing the multiplied signal and the amplified signal to a mixed audio signal; and
- transmitting the mixed audio signal;
wherein the low frequency range is spaced apart from the high frequency range.
In most audio models, vowels in speech signals are associated with low frequencies and consonants are associated with high frequencies. Although more detailed models show that some vowels may be associated with high frequencies and some consonants may be associated with low frequencies, still vowels are
predominantly associated with low frequencies and consonants are predominantly associated with high frequencies. Independent of the selected model, it is an insight of the inventor that these low and high frequencies ranges should be spaced apart. The technical effect of this insight is that the intelligibility of the mixed audio signal is improved.
The association of vowels and consonants with a particular frequency range may be done based on tests. These tests measure the amount of energy and/or amplitude of a speech signal at a particular frequency. The speech signal comprises a particular vowel or consonant. The particular frequency range for a vowel or consonant is the range of frequencies combined comprising more than a predefined level amount of energy or signal amplitude compared to the total amount of energy or amplitude in the signal. The predefined level may be 50%, 60% or 70%, preferably 80%, more preferably 85%, most preferably 90%. The lower frequency range typically has a lower edge of 100Hz, preferably 125Hz, more preferably 150Hz. The lower frequency range typically has a higher edge of 700Hz, preferably 750Hz, more preferably 800Hz. The higher frequency typically has a lower edge of 1200Hz, preferably 1250Hz, more preferably 1300Hz. The higher frequency typically has a higher edge at a frequency that is on the edge of audibility, such as around 20kHz.
In an embodiment of the invention, the method comprises the steps of associating the low frequency range and associating the high frequency range are based on the language of the speech signal and/or the differences between man and woman. As vowels and consonants are pronounced differently, the association of low and high frequency ranges may be depended on the language or even the dialect of the language. Further, as pronunciation may vary from one person to another and especially pronunciation varies between man and woman, the association of low and high frequency ranges may vary. In a further embodiment of the invention, the steps of associating the low frequency range and associating the high frequency range are dynamic. This allows for the method to adapt to changes in the speech signal.
In an embodiment of the method, the amplification factor is higher compared to the multiplication factor, preferably wherein the amplification factor is at least 20dB, preferably 25dB, more preferably 30dB, more preferably 35dB, more preferably 40dB, most preferably 45dB, higher compared to the multiplication factor. Alternatively, in an embodiment of the method, the multiplication factor is in the range of -40dB to 10dB, preferably -35dB to 5dB, more preferably -30dB to OdB, most preferably -25 to -5dB and/or the amplification factor is in the range of -10dB to 25dB, preferably -5dB to 20dB, more preferably OdB to 15dB, most preferably 5 to 10dB. Typically, the hearing impairment gradually develops, whereby the higher frequencies are impaired first or are impaired the most compared to the lower frequencies. Hence, the amplification factor is set higher for higher frequencies.
In an embodiment of the invention, the method comprises the step of receiving the audio signal comprises the step of receiving the audio signal from a microphone and/or the step of transmitting the processed audio signal comprises the step of transmitting the processed audio signal to a speaker.
In an embodiment of the invention, the method comprises the step of attenuating a medium frequency range arranged between the low and the high frequency range. It is an insight of the inventor that attenuating the medium frequency has the effect of enhancing the intelligibility of the speech signal. Typically, this medium frequency range is associated with background noise by the inventor. Thus, the inventor extends the current models of speech with the insight that the frequency ranges associated with vowels and consonants are spaced apart and the frequency range in between is to be attenuated to enhance the intelligibility of the speech signal.
Typically, attenuating the medium frequency typically does not cost energy, on the contrary it saves energy as not the complete frequency spectrum is amplified. Therefore, a further technical effect may be that as the medium frequency range is attenuated, a more energy efficient method is provided for obtaining a more intelligible mixed audio signal from the audio signal.
Preferably, the medium frequency range is centred around the 1 kHz.
Preferably, the lower edge of the medium frequency range is around the 750Hz and the higher edge is around the 1250Hz. Further preferably, the attenuation of the medium frequency range is at least -20dB, preferably -25dB, more preferably -30dB, most preferably -35dB. This attenuation step may be implemented as a band-stop filter or in software executed on a processor.
In a further embodiment of the invention, the method comprises the step of attenuating all frequencies outside the low and high frequency ranges. The technical effect is that the intelligibility is further enhanced. Furthermore, another technical effect may be that the method becomes even more energy efficient as no energy is wasted due to amplifying frequencies that are not of interest for obtaining a more intelligible mixed audio signal from the audio signal.
According to another aspect of the invention, a computer program product comprising a computer readable medium having computer readable code embodied therein, the computer readable code being configured such that, on execution by a suitable computer or processor, the computer or processor is caused to perform any of the methods according to the claims or specified in the description.
According to another aspect of the invention, a hearing aid for a hearing- impaired listener, comprising:
- a microphone for receiving an audio signal comprising a speech signal;
- a low association unit for associating a low frequency range with vowels;
- a low frequency pass-filter for filtering out a low filtered signal from the audio signal by letting frequencies pass in the low frequency range;
- a multiplier for multiplying the low filtered signal with an multiplication factor to a multiplied signal;
- a high association unit associating a high frequency range with consonants;
- a high frequency pass-filter for filtering out a high filtered signal from the audio signal by letting frequencies pass in the high frequency range;
- an amplifier for amplifying the high filtered signal with an amplification factor to an amplified signal;
- a mixer for mixing the low multiplied signal and the amplified signal to a mixed audio signal; and
- a speaker for transmitting the mixed audio signal,
wherein the low frequency range is spaced apart from the high frequency range. In an embodiment of the invention, a hearing aid, comprising a register for storing a plurality of settings, wherein each setting specifies the amplification or the attenuation for a specific frequency range; wherein a first subset of the plurality of settings forms the low frequency range; and wherein a second subset of the plurality of settings forms the high frequency range. This embodiment provides the advantage of easily setting and changing the amplification or attenuation for a specific frequency. This embodiment further provides the advantage of allowing these settings to be exchangeable between hearing aids having the same or similar frequency ranges for the settings.
According to another aspect of the invention, a mobile device comprising an app for a hearing-impaired listener, comprising:
- an input for receiving an audio signal comprising a speech signal from a microphone;
- a low association unit for associating a low frequency range with vowels;
- a low frequency pass-filter for filtering out a low filtered signal from the audio signal by letting frequencies pass in the low frequency range;
- a multiplier for multiplying the low filtered signal with a multiplication factor to an amplified signal;
- a high association unit associating a high frequency range with consonants;
- a high frequency pass-filter for filtering out a high filtered signal from the audio signal by letting frequencies pass in the high frequency range;
- an amplifier for amplifying the high filtered signal with an amplification factor to an amplified signal;
- a mixer for mixing the multiplied signal and the amplified signal to a mixed audio signal; and
- an output for transmitting the processed audio signal to a headphone, wherein the low frequency range is spaced apart from the high frequency range.
According to another aspect of the invention, a computer program product comprising a computer readable medium having computer readable code embodied therein, the computer readable code comprising a plurality of settings:
wherein each setting specifies the amplification or the attenuation for a specific frequency range; wherein a first subset of the plurality of settings forms the low frequency range;
wherein a second subset of the plurality of settings forms the high frequency range; and
wherein the computer readable code is configured for use by a hearing aid and/or mobile device according to any of the claims or mentioned in the
description.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention will be apparent from and elucidated further with reference to the embodiments described by way of example in the following description and with reference to the accompanying drawings, in which:
Figure 1 schematically shows a hearing aid according to an embodiment of the current invention;
Figure 2 schematically shows a method for processing an audio signal for a hearing-impaired listener;
Figure 3A schematically shows an embodiment of the invention in a first graph;
Figure 3B schematically shows an embodiment of the invention in a second graph;
Figure 4 schematically shows test results of an open ear resonance measurement;
Figure 5 schematically shows settings for an Oticon hearing aid according to the invention;
Figure 6 schematically shows settings for a Phonak hearing aid according to the invention;
Figure 7 schematically shows settings for a Sivantos hearing aid according to the invention;
Figure 8 schematically shows settings for a Starkey hearing aid according to the invention;
Figure 9A schematically shows test results of an intelligibility test for a first listener;
Figure 9B schematically shows test results of an intelligibility test for a second listener; Figure 9C schematically shows test results of an intelligibility test for a third listener; and
Figure 10 schematically shows an embodiment of a computer program product, computer readable medium and/or non-transitory computer readable storage medium according to the invention.
The figures are purely diagrammatic and not drawn to scale. In the figures, elements which correspond to elements already described may have the same reference numerals. LIST OF REFERENCE NUMERALS
Figure imgf000009_0001
Figure imgf000010_0001
Figure imgf000011_0001
Figure imgf000012_0001
DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS
The following figures may detail different embodiments. Embodiments can be combined to reach an enhanced or improved technical effect. These combined embodiments may be mentioned explicitly throughout the text, may be hint upon in the text or may be implicit.
Figure 1 schematically shows a hearing aid 100 according to an embodiment of the current invention. The hearing aid comprises a microphone 115, a low association unit 120, a low frequency pass filter 130, a multiplier 140, a high association unit 160, a high frequency pass-filter 170, an amplifier 180, a mixer 190 and a speaker 195. The microphone is arranged for receiving an audio signal 110 for example from the mouth 10 of a speaker. The microphone transforms the audio signal to a received audio signal 117, such as an electrical received audio signal. The received audio signal is distributed to at least the low and high frequency pass-filters. The low and high frequency pass-filters are also provided with low and high frequency range settings 125, 165, respectively. The frequency range settings may comprise a multiplier factor, such as an amplification or an attenuation, per frequency band or range. A range may comprise multiple frequency bands.
The low and high frequency range settings are provided by the low and high association units, respectively. The low frequency range settings are associated with vowels and the high frequency range settings are associated with consonants. The association units may comprise a fixed register with settings. Alternatively, the association unit may comprise an adaptive unit for changing the settings, for example depending on the received audio signal. The adaptation may depend on the language of the received speech signal. The adaptation may depend on the loudness of the received speech signal. The adaptation may depend on the SNR of the audio signal. The adaptation may depend on the presence of background noise in the audio signal. Or the adaptation may depend on a combination of the previous mentioned factors.
The low frequency pass-filter provides a low filtered signal 135 to the multiplier. The hearing aid may further comprise a frequency register 150, which may provide multiplier settings per frequency band 152. Alternatively, the frequency register may provide one multiplier setting 152 for the complete frequency range. In an alternative embodiment the frequency settings are depended on the audio signal in a similar way as for the association units. The multiplier multiplies the low filtered signal with the multiplier setting and provides a multiplied signal 145 to the mixer.
The high frequency pass-filter provides a high filtered signal 175 to the amplifier. The frequency register may provide amplifier settings per frequency band 155. Alternatively, the frequency register may provide one amplifier setting 155 for the complete frequency range. In an alternative embodiment the frequency settings are depended on the audio signal in a similar way as for the association units. The amplifier amplifies the high filtered signal with the amplifier setting and provides an amplified signal 185 to the mixer.
The mixer mixes the multiplied signal and the amplified signal to a mixed audio signal 192. The mixing is typically adding the multiplied signal and the amplified signal, such as adding in the time domain. Alternatively, the adding may be done in the frequency domain. The mixer provides the mixed audio signal to the speaker. The speaker transforms the mixed audio signal in a transmitted mixed audio signal 197, that can be received by an ear 20 of a hearing-impaired listener.
A technical effect of that the low frequency range and the high frequency range is spaced apart is that the intelligibility of the transmitted audio signal is improved. A further technical effect is provided if the frequency range between the low and high frequency range is attenuated. Specific frequency ranges to be amplified and attenuated are detailed throughout this description.
The hearing aid may combine several elements in one element. For example, the low frequency pass-filter may be combined with the multiplier, the high frequency pass-filter may be combined with the amplifier, the low association unit and the high association unit may be combined, the low and high frequency pass-filter may be combined making the mixer implicit and/or the low and high association units may be combined with the frequency register. Furthermore, part of the signals in the hearing aid may be digitized, such as that the filters, association units, multiplier, amplifier and/or mixer are implemented as software run on a microprocessor. In this case the microphone may comprise an AD-converter and/or the speaker may comprise a DA-converter.
Figure 1 can also schematically represent a mobile device by replacing the microphone and speaker with an input and an output, respectively.
Figure 2 schematically shows a method 200 for processing an audio signal for a hearing-impaired listener. The method starts with the step receiving 210 the audio signal. The method continues with the step of associating 215 a low frequency range with vowels. The method continues with the step of filtering 220 out a first low filtered signal from the audio signal by letting frequencies pass in the first low frequency range. The method continues with the step of multiplying 225 the low filtered signal with a multiplication factor to a multiplied signal. The method continues with the step of associating 230 a high frequency range with consonants. The method continuous with the step of filtering 235 out a high filtered signal from the audio signal by letting frequencies pass in the high frequency range. The method continuous with the step of amplifying 240 the high filtered signal with an amplification factor to an amplified signal the method continuous with the step of mixing 245 the multiplied signal and the amplified signal to a mixed audio signal. The method continuous with the step of transmitting 250 the mixed audio signal. The method further specifies that the low frequency range is spaced apart from the high frequency range. The method provides the technical effects as specified throughout this description.
The different steps in the method described in figure 2 may be executed in a different order, if these steps are independent of each other, depending on the specific embodiment of the method. Also, different steps of the method in figure 2 may be executed in parallel and/or merged depending on the specific embodiment of the method.
Figure 3A and 3B schematically show an embodiment of the invention in a first 310 and second 320 graph, respectively. The graphs have a horizontal axis having a frequency scale in Hertz and a vertical axis having a gain scale in dB. The horizontal axis has a marking 0Hz at its origin.
Further, the horizontal axis has a marking Med. freq. 318, 328, which is an abbreviation of medium frequency. The medium frequency may be extended to either side forming a medium frequency range. The medium frequency or medium frequency range separates a low frequency range 311 , 321 from a high frequency range 315,
325.
Further, the vertical axis has a marking OdB indicating no gain. The marking OdB identifies the top of the gain for the low and high frequency range. Alternatively, the top 312, 316, 322, 326 of the gain for the low and high frequency range may be at another level then OdB. Alternatively, the top of the gain for the low and high frequency range are different. Alternatively, the top of the gain for the low and high frequency range are depending on the frequency, such as sloped or curved. Alternatively, figure 3B shows a gain peak or spike 327 in the high frequency range, thus further amplifying the signal for a specific frequency. This last embodiment is specifically advantageous according to the inventor. Settings according to this last embodiment and according to the embodiment in figure 3A are further detailed in figures 5 to 8. Combinations of the alternative embodiments are within the scope of the invention.
Figure 4 schematically shows test results of an open ear resonance measurement 400. This and following test results are print screens of different programs used to provide the reader with insight in the invention. The top graph 410 shows the open ear resonance for the left ear. The bottom graph 450 shows the open ear resonance for the right ear. Both graphs have on the horizontal axis the
amplification or attenuation of the ear and on the vertical axis the frequency that is tested. The maximum amplification in the graph is 60dB and the maximum attenuation in the graph is -30dB. The minimum frequency is 125Hz and the maximum frequency is 8kHz.
The line 420 in the top graph shows the ear resonance for the left ear and the line 460 in the bottom graph shows the ear resonance for the right ear. This open ear resonance for the left and right ear are almost always different. This difference allows for directional hearing.
Figure 5 schematically shows settings 500 for an Oticon hearing aid according to the invention. The top table 510 shows the original settings of the Oticon hearing aid. The top graph 520 shows the original settings of the Oticon hearing aid corresponding to the top table. The bottom table 550 shows the settings for the hearing aid according to the invention. The bottom graph 560 shows the settings for the hearing aid according to the invention corresponding to the bottom table.
The tables have different rows representing a frequency band. For each row the centre frequency for the frequency band is shown. The table has different columns with the designation of the column shown at the bottom. The left most column is labelled“Alle” showing the centre frequency. The column to the right is labelled“MPO” which is the abbreviation for Maximum Power Output. The MPO is the maximum power output or amplification factor of the hearing aid. The following columns are labelled“Luid”,“Matig” and“Zacht”, which translate to“Loud”,“Medium” and“Soft”, respectively. Hearing aids typically have amplification settings depending on the loudness of the received audio signal. If the received audio signal is loud, the hearing aid selects the settings for“Luid”, if the received audio signal is soft, the hearing aid selects the settings for“Zacht”, and if the received audio signal is in between or medium, the hearing aid selects the settings for“Matig”.
The graphs 520, 560 show the settings for“Luid”,“Matig” and“Zacht” in the settings tables 510, 550, respectively with three different lines 522, 524, 526, 562, 564, 566 per graph, respectively.
The settings in the bottom table as well as the bottom graph show a dip 570 around the 1 kHz spacing apart and/or separating the lower frequency range below around 750Hz and the higher frequency range above around 1250Hz. This dip suppresses background noise and improves intelligibility according to the invention. This dip may be seen as the medium frequency range.
Figure 6 schematically shows settings 600 for a Phonak hearing aid according to the invention. The top table 610 shows the original settings of the Phonak hearing aid. The top graph 620 shows the original settings of the Phonak hearing aid corresponding to the top table. The bottom table 650 shows the settings for the hearing aid according to the invention. The bottom graph 660 shows the settings for the hearing aid according to the invention corresponding to the bottom table.
The tables have different rows representing a frequency band. For each row the centre frequency for the frequency band is shown. The table has different columns with the designation of the column shown at the bottom. The left most column is labelled“MPO” which is the abbreviation for Maximum Power Output. The MPO is the maximum power output or amplification factor of the hearing aid. The column to the right is labelled“Alle” showing the centre frequency. The following columns are labelled“G80”,“G65” and“G50”. Hearing aids typically have amplification settings depending on the loudness of the received audio signal. If the received audio signal is above 80dB, the hearing aid selects the settings for“G80”, if the received audio signal is below 50dB, the hearing aid selects the settings for“G50", and if the received audio signal is in between or around 65dB, the hearing aid selects the settings for“G65”.
The graphs 620, 660 show the settings for“G80",“G65” and“G50” in the settings tables 610, 650, respectively with three different lines 622, 624, 626, 662, 664, 666 per graph, respectively.
The settings in the bottom table as well as the bottom graph show a dip 670 around the 1 kHz spacing apart and/or separating the lower frequency range below around 860Hz and the higher frequency range above around 1200Hz. This dip suppresses background noise and improves intelligibility according to the invention. This dip may be seen as the medium frequency range.
Figure 7 schematically shows settings 700 for a Sivantos hearing aid according to the invention. The top table 710 shows the original settings of the
Sivantos hearing aid. The top graph 720 shows the original settings of the Sivantos hearing aid corresponding to the top table. The bottom table 750 shows the settings for the hearing aid according to the invention. The bottom graph 760 shows the settings for the hearing aid according to the invention corresponding to the bottom table.
The tables comprise not just values but are represented by settings or sliders of an equalizer. Each slider represents the amplification or attenuation for a specific centre frequency. The values of the sliders are automatically translated in three different settings for“Loud”,“Medium” and“Soft”, respectively of the received audio signal. Hearing aids typically have amplification settings depending on the loudness of the received audio signal. If the received audio signal is loud, the hearing aid selects the settings for“Loud”, if the received audio signal is soft, the hearing aid selects the settings for“Soft”, and if the received audio signal is in between or medium, the hearing aid selects the settings for“Medium”.
The graphs 720, 760 show the settings for“Loud”,“Medium” and“Soft” in the settings tables 710, 750, respectively with three different lines 722, 724, 726, 762, 764, 766 per graph, respectively.
The settings in the bottom table as well as the bottom graph show a dip 770 around the 1 kHz spacing apart and/or separating the lower frequency range below around 750Hz and the higher frequency range above around 1250Hz. This dip suppresses background noise and improves intelligibility according to the invention. This dip may be seen as the medium frequency range.
Figure 8 schematically shows settings 800 for a Starkey hearing aid according to the invention. The top table 810 shows the original settings of the Starkey hearing aid. The top graph 820 shows the original settings of the Starkey hearing aid corresponding to the top table. The bottom table 850 shows the settings for the hearing aid according to the invention. The bottom graph 860 shows the settings for the hearing aid according to the invention corresponding to the bottom table.
The tables have different rows representing a frequency band. For each row the centre frequency for the frequency band is shown. The table has different columns with the designation of the column shown in the middle of the column. The left most column is labelled“Alles” showing the centre frequency. The rightmost column is labelled“MPO” which is the abbreviation for Maximum Power Output. The MPO is the maximum power output or amplification factor of the hearing aid. The columns in between are labelled“Luid”,“Gemiddeld” and“Zacht”, which translate to“Loud”, “Average” and“Soft”, respectively. Hearing aids typically have amplification settings depending on the loudness of the received audio signal. If the received audio signal is loud, the hearing aid selects the settings for“Luid”, if the received audio signal is soft, the hearing aid selects the settings for“Zacht”, and if the received audio signal is in between or average, the hearing aid selects the settings for“Gemiddeld”.
The graphs 820, 860 show the settings for“Luid",“Gemiddeld” and“Zacht” in the settings tables 810, 850, respectively with three different lines 822, 824, 826,
862, 864, 866 per graph, respectively.
The settings in the bottom table as well as the bottom graph show a dip 870 around the 950Hz spacing apart and/or separating the lower frequency range below around 700Hz and the higher frequency range above around 1200Hz. This dip suppresses background noise and improves intelligibility according to the invention. This dip may be seen as the medium frequency range.
Figure 9A, figure 9B and figure 9C schematically shows test results of an intelligibility test for a first, second and third listener, respectively. Reference numbers are only shown for figure 9A but are equally applicable for the figures 9B and 9C.
Intelligibility tests come in different forms, e.g. the speech transmission index, Tikofsky’s 50-word intelligibility test and Harvard PB test. The figures show tests results from the Hearing-Aid Speech Perception Index or HASPI from three different persons. In the measurements set-up the listener was placed in an audio cabin to prevent disturbances from any external audio source. Furthermore, the listener got a headphone on as audio source for the tests.
The first horizontal axis 910 at the bottom of the figure shows the loudness of the test signal in decibels. Although the horizontal axis ranges from -10dB to 120dB, it is clear that measurements are always positive. The vertical axis 911 on the left of the figure shows the percentage of intelligible words. The second horizontal axis 912 halfway of the figure offset to the right relative to the first horizontal axis shows the speech reception index, speech reception test score, speech reception threshold or SRT. The SRT is a score line, which indicates how well the listener understands words or words are intelligible for the listener.
The curved line 920 without marking is the normal line or reference line. The reference is a normal person without hearing problems, thus this line indicates the ideal. The curved line 921 with triangular or circular markings, depending on the figure, are measurements taken with the right ear of the listener without hearing aid. Each marking is a measurement. The curved line 922 with squares and crosses as markings, depending on the figure, are measurements taken with the left ear of the listener without hearing aid. All figures show a considerable gap between the reference line and the curved lines 921 , 922 indicating a considerable loss of the capacity of understanding words or intelligibility.
The curved line 923 with V as markings are measurements taken with a free-field stereo measurement. The three figures each show an improvement of the capacity of understanding words or intelligibility for this curved line, but still not close to the reference line.
The curved line 924 with T as markings are measurements taken wherein the listener is equipped with a hearing aid configured according to the invention. This curved line is much closer to the reference line and shows a considerable improvement.
Figure 10 schematically shows an embodiment of a computer program product 1000, computer readable medium and/or non-transitory computer readable storage medium according to the invention.
It should be noted that the figures are purely diagrammatic and not drawn to scale. In the figures, elements which correspond to elements already described may have the same reference numerals.
It will be appreciated that the invention also applies to computer programs, particularly computer programs on or in a carrier, adapted to put the invention into practice. The program may be in the form of a source code, an object code, a code intermediate source and an object code such as in a partially compiled form, or in any other form suitable for use in the implementation of the method according to the invention. It will also be appreciated that such a program may have many different architectural designs. For example, a program code implementing the functionality of the method or system according to the invention may be sub-divided into one or more sub-routines. Many different ways of distributing the functionality among these sub- routines will be apparent to the skilled person. The sub-routines may be stored together in one executable file to form a self-contained program. Such an executable file may comprise computer-executable instructions, for example, processor
instructions and/or interpreter instructions (e.g. Java interpreter instructions).
Alternatively, one or more or all of the sub-routines may be stored in at least one external library file and linked with a main program either statically or dynamically, e.g. at run-time. The main program contains at least one call to at least one of the sub- routines. The sub-routines may also comprise function calls to each other. An embodiment relating to a computer program product comprises computer-executable instructions corresponding to each processing stage of at least one of the methods set forth herein. These instructions may be sub-divided into sub-routines and/or stored in one or more files that may be linked statically or dynamically. Another embodiment relating to a computer program product comprises computer-executable instructions corresponding to each means of at least one of the systems and/or products set forth herein. These instructions may be sub-divided into sub-routines and/or stored in one or more files that may be linked statically or dynamically.
The carrier of a computer program may be any entity or device capable of carrying the program. For example, the carrier may include a data storage, such as a ROM, for example, a CD ROM or a semiconductor ROM, or a magnetic recording medium, for example, a hard disk. Furthermore, the carrier may be a transmissible carrier such as an electric or optical signal, which may be conveyed via electric or optical cable or by radio or other means. When the program is embodied in such a signal, the carrier may be constituted by such a cable or other device or means.
Alternatively, the carrier may be an integrated circuit in which the program is embedded, the integrated circuit being adapted to perform, or used in the performance of, the relevant method.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. Use of the verb "comprise" and its conjugations does not exclude the presence of elements or stages other than those stated in a claim. The article "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
Examples, embodiments or optional features, whether indicated as non- limiting or not, are not to be understood as limiting the invention as claimed.

Claims

CLAIMS:
1. Method for processing (200) an audio signal (110) for a hearing-impaired listener comprising a speech signal, wherein the method comprises the steps of:
- receiving (210) the audio signal;
- associating (215) a low frequency range with vowels;
- filtering (220) out a low filtered signal from the audio signal by letting
frequencies pass in the low frequency range;
- multiplying (225) the low filtered signal with a multiplication factor to a multiplied signal;
- associating (230) a high frequency range with consonants;
- filtering (235) out a high filtered signal from the audio signal by letting frequencies pass in the high frequency range;
- amplifying (240) the high filtered signal with an amplification factor to an amplified signal;
- mixing (245) the multiplied signal and the amplified signal to a mixed audio signal; and
- transmitting (250) the mixed audio signal;
wherein the low frequency range is spaced apart from the high frequency range.
2. Method according to claim 1 , wherein the step of mixing comprises the step of adding the multiplied signal and the amplified signal to a mixed audio signal.
3. Method according to claim 1 , wherein associating low and high frequency ranges with vowels and consonants respectively is based on the predominant frequencies of vowels and consonants.
4. Method according to any of the preceding claims, wherein the steps of associating the low frequency range and associating the high frequency range are based on the language of the speech signal and/or the differences between man and woman.
5. Method according to any of the preceding claims, wherein the steps of associating the low frequency range and associating the high frequency range are predetermined or dynamic.
6. Method according to any of the preceding claims, wherein the amplification factor is higher compared to the multiplication factor, preferably wherein the
amplification factor is at least 20dB, preferably 25dB, more preferably 30dB, more preferably 35dB, more preferably 40dB, most preferably 45dB, higher compared to the multiplication factor.
7. Method according to any of the preceding claims, wherein the multiplication factor is in the range of -40dB to 10dB, preferably -35dB to 5dB, more preferably -30dB to OdB, most preferably -25 to -5dB and/or the amplification factor is in the range of - 10dB to 25dB, preferably -5dB to 20dB, more preferably OdB to 15dB, most preferably 5 to 10dB.
8. Method according to any of the preceding claims, wherein the method comprises the step of attenuating a medium frequency range arranged between the low and the high frequency range.
9. Method according to claim 8, wherein the medium frequency range is associated with background noise.
10. Method according to any of the claims 8-9, wherein the attenuation is at least - 20dB, preferably -25dB, more preferably -30dB, most preferably -35dB.
11. Method according to any of the preceding claims, wherein the method comprises the step of attenuating all frequencies outside the low and high frequency ranges.
12. Computer program product (1000) comprising a computer readable medium (1010) having computer readable code (1020) embodied therein, the computer readable code being configured such that, on execution by a suitable computer or processor, the computer or processor is caused to perform any of the methods 1 -11.
13. Hearing aid (100) for a hearing-impaired listener, comprising:
- a microphone (115) for receiving an audio signal (110) comprising a speech signal;
- a low association unit (120) for associating a low frequency range with vowels;
- a low frequency pass-filter (130) for filtering out a low filtered signal (135) from the audio signal by letting frequencies pass in the low frequency range;
- a multiplier (140) for multiplying the low filtered signal with a multiplication factor to a multiplied signal (145);
- a high association unit (160) associating a high frequency range with consonants;
- a high frequency pass-filter (170) for filtering out a high filtered signal (175) from the audio signal by letting frequencies pass in the high frequency range;
- an amplifier (180) for amplifying the high filtered signal with a amplification factor to an amplified signal (185);
- a mixer (190) for mixing the multiplied signal and the amplified signal to a mixed audio signal (192); and
- a speaker (195) for transmitting the mixed audio signal,
wherein the low frequency range is spaced apart from the high frequency range.
14. Hearing aid according to claim 13, comprising a register (150) for storing a plurality of settings,
wherein each setting (152, 155) specifies the amplification or the attenuation for a specific frequency range;
wherein a first subset (152) of the plurality of settings forms the low frequency range; and
wherein a second subset (155) of the plurality of settings forms the high frequency range.
15. Mobile device comprising an app for a hearing-impaired listener, comprising:
- an input for receiving an audio signal comprising a speech signal from a microphone;
- a low association unit for associating a low frequency range with vowels;
- a low frequency pass-filter for filtering out a low filtered signal from the audio signal by letting frequencies pass in the low frequency range;
- a multiplier for multiplying the low filtered signal with a multiplication factor to an amplified signal;
- a high association unit associating a high frequency range with consonants;
- a high frequency pass-filter for filtering out a high filtered signal from the audio signal by letting frequencies pass in the high frequency range;
- an amplifier for amplifying the high filtered signal with an amplification factor to an amplified signal;
- a mixer for mixing the multiplied signal and the amplified signal to a mixed audio signal; and
- an output for transmitting the mixed audio signal to a headphone,
wherein the low frequency range is spaced apart from the high frequency range.
16. Computer program product (1000) comprising a computer readable medium (1010) having computer readable code (1020) embodied therein, the computer readable code comprising a plurality of settings:
wherein each setting specifies the amplification or the attenuation for a specific frequency range;
wherein a first subset of the plurality of settings forms the low frequency range; wherein a second subset of the plurality of settings forms the high frequency range; and
wherein the computer readable code is configured for use by a hearing aid and/or mobile device according to any of the claims 13-15.
PCT/NL2019/050320 2018-06-07 2019-06-03 Method for processing an audio signal for a hearing aid WO2019235913A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
NL2021071A NL2021071B1 (en) 2018-06-07 2018-06-07 Method for processing an audio signal for a hearing aid
NLNL2021071 2018-06-07

Publications (1)

Publication Number Publication Date
WO2019235913A1 true WO2019235913A1 (en) 2019-12-12

Family

ID=62873547

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/NL2019/050320 WO2019235913A1 (en) 2018-06-07 2019-06-03 Method for processing an audio signal for a hearing aid

Country Status (2)

Country Link
NL (1) NL2021071B1 (en)
WO (1) WO2019235913A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4739511A (en) * 1985-01-25 1988-04-19 Rion Kabushiki Kaisha Hearing aid
WO1993020669A1 (en) * 1992-03-31 1993-10-14 Auditory System Technologies, Inc. Aid to hearing speech in a noisy environment
US20100272289A1 (en) * 2009-04-24 2010-10-28 Siemens Medical Instruments Pte. Ltd. Method for operating a hearing apparatus and hearing apparatus with a frequency separating filter
US20130322671A1 (en) * 2012-05-31 2013-12-05 Purdue Research Foundation Enhancing perception of frequency-lowered speech

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4739511A (en) * 1985-01-25 1988-04-19 Rion Kabushiki Kaisha Hearing aid
WO1993020669A1 (en) * 1992-03-31 1993-10-14 Auditory System Technologies, Inc. Aid to hearing speech in a noisy environment
US20100272289A1 (en) * 2009-04-24 2010-10-28 Siemens Medical Instruments Pte. Ltd. Method for operating a hearing apparatus and hearing apparatus with a frequency separating filter
US20130322671A1 (en) * 2012-05-31 2013-12-05 Purdue Research Foundation Enhancing perception of frequency-lowered speech

Also Published As

Publication number Publication date
NL2021071B1 (en) 2019-12-13

Similar Documents

Publication Publication Date Title
Levy et al. Extended high-frequency bandwidth improves speech reception in the presence of spatially separated masking speech
van Buuren et al. Compression and expansion of the temporal envelope: Evaluation of speech intelligibility and sound quality
Anzalone et al. Determination of the potential benefit of time-frequency gain manipulation
US7580536B2 (en) Sound enhancement for hearing-impaired listeners
Dillon Tutorial compression? Yes, but for low or high frequencies, for low or high intensities, and with what response times?
Lunner et al. Cognition and hearing aids
US8107656B2 (en) Level-dependent noise reduction
Stone et al. Comparison of different forms of compression using wearable digital hearing aids
Kates et al. Using objective metrics to measure hearing aid performance
US10805741B2 (en) Audio systems, devices, and methods
Moore et al. Use of a loudness model for hearing aid fitting: II. Hearing aids with multi-channel compression
US20060122826A1 (en) Device and method for reducing stuttering
EP3840222A1 (en) Method to process an audio signal with a dynamic compressive system
Lunner et al. A digital filterbank hearing aid: Three digital signal processing algorithms-User preference and performance
Stone et al. Multichannel fast-acting dynamic range compression hinders performance by young, normal-hearing listeners in a two-talker separation task
NL2021071B1 (en) Method for processing an audio signal for a hearing aid
CN110840462A (en) Hearing-aid method for human ears based on earphone, computer readable storage medium and Bluetooth earphone
Henning et al. Compression-dependent differences in hearing aid gain between speech and nonspeech input signals
US11490216B2 (en) Compensating hidden hearing losses by attenuating high sound pressure levels
EP2325843B1 (en) Frequency-specific determination of audio dose
Kasturi et al. Use of s-shaped input-output functions for noise suppression in cochlear implants
Gilbert et al. Discrimination of release time constants in hearing-aid compressors
US10149070B2 (en) Normalizing signal energy for speech in fluctuating noise
CN113132882B (en) Multi-dynamic-range companding method and system
EP1211671A2 (en) Automatic gain control with noise suppression

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19743027

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16.03.2022)

122 Ep: pct application non-entry in european phase

Ref document number: 19743027

Country of ref document: EP

Kind code of ref document: A1