WO2009153718A1 - Earphone arrangement and method of operation therefor - Google Patents

Earphone arrangement and method of operation therefor Download PDF

Info

Publication number
WO2009153718A1
WO2009153718A1 PCT/IB2009/052511 IB2009052511W WO2009153718A1 WO 2009153718 A1 WO2009153718 A1 WO 2009153718A1 IB 2009052511 W IB2009052511 W IB 2009052511W WO 2009153718 A1 WO2009153718 A1 WO 2009153718A1
Authority
WO
WIPO (PCT)
Prior art keywords
earphone
binaural
audio
arrangement
signal
Prior art date
Application number
PCT/IB2009/052511
Other languages
French (fr)
Inventor
Sriram Srinivasan
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Publication of WO2009153718A1 publication Critical patent/WO2009153718A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/552Binaural
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/41Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00Signal processing covered by H04R, not provided for in its groups
    • H04R2430/20Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/03Aspects of the reduction of energy consumption in hearing devices

Definitions

  • the invention relates to an earphone arrangement and a method of operation therefor and in particular, but not exclusively, to binaural processing for hearing aids.
  • Audio processing algorithms have been used to provide an improved signal to noise ratio between a desired sound source and an interfering sound source resulting in a clearer and more perceptible signal being provided to the user.
  • hearing aids have been developed which include more than one microphone with the audio signals of the microphones being dynamically combined to provide directivity for the microphone arrangement. Such directivity may be achieved by beam forming algorithms which in some cases may be adaptive such that they are dynamically directed towards a desired sound source.
  • noise cancelling algorithms may be applied to reduce the interference caused by undesired sound sources and background noise.
  • a monaural hearing aid solution consists of a single hearing aid which fits on one ear of the user and typically provides functions such as compression, amplification and feedback cancellation. Most modern hearing aids have two or more microphones mounted on them and provide directional processing through spatial filtering techniques. A system wherein two independent monaural hearing aids are used simultaneously is still considered a bilateral monaural hearing aid solution.
  • a binaural system is one where hearing aids on two ears collaborate with one another.
  • Such an approach promises at least three advantages compared to a monaural system: improved speech intelligibility in noise (especially when the speech and noise signals originate from different directions), improved localization resulting in a better perception of the auditory scene, and improved noise reduction due to a larger microphone spacing and a higher number of microphones.
  • binaural beam forming may be achieved by combining the microphone signals from both left and right hearing aids and this binaural beam forming may provide a substantially improved beam forming relative to e.g. beam forming based only on the microphones from one hearing aid.
  • Binaural beam forming in hearing aids requires exchange of microphone signals between the hearing aids worn on the left and right ears. This exchange occurs over a wireless link as it is not generally desired to have a wired link for aesthetic reasons.
  • wireless transmission introduces power and computational constraints and in particular introduces significant additional power consumption by the hearing aids resulting in a reduced battery life, which is an important concern for hearing aid users.
  • an improved ear phone/ hearing aid system would be advantageous and in particular a system allowing increased flexibility, facilitated implementation, reduced resource usage, practical implementation, reduced power consumption, increased battery life and/or improved performance would be advantageous.
  • the Invention seeks to preferably mitigate, alleviate or eliminate one or more of the above mentioned disadvantages singly or in any combination.
  • earphone arrangement comprising a first and second earphone arranged to operate in a binaural arrangement, the first earphone comprising: determining means for determining an audio environment characteristic in response to a signal from at least one microphone of the first earphone; and control means for controlling a data rate of an audio data exchange between the first and second earphone in response to the audio environment characteristic, the audio data exchange supporting a binaural processing of the earphone arrangement.
  • the invention may allow improved performance of an ear phone arrangement which specifically may be a hearing aid arrangement.
  • the invention may allow reduced resource consumption and in many embodiments a reduced power consumption and thus increased battery life can be achieved.
  • the invention may allow performance close to a fully binaural operation but with a substantially reduced resource usage.
  • the system may specifically allow a flexible and dynamic system wherein the resource expended by the binaural operation may be continuously adapted to reflect the performance improvement achievable by the binaural operation in the current conditions.
  • the first and/or second earphone may be a hearing aid.
  • the arrangement may comprise means for performing a binaural processing in response to the exchanged audio data.
  • a binaural combination of signals from the first and second earphone may be performed using the exchanged audio data.
  • the binaural operation may for example be a binaural beam forming.
  • the determining means may be comprised in the first earphone.
  • monaural refers to a system wherein each ear is considered independently and the word binaural refers to a system wherein audio fed to one ear is determined in response to signals obtained (directly or indirectly) from microphones associated with both ears.
  • monaural may be used to refer to a hearing aid for one ear which operates independently of any other hearing aid whereas the term binaural may refer to the use of interworking hearing aids for each ear.
  • Each earphone or hearing aid may specifically comprise one or more microphones.
  • the exchanged audio data may specifically correspond to one or more microphone signals.
  • the arrangement may further comprise second determining means for determining a second audio environment characteristic in response to signals from at least one microphone of the second earphone; and second control means for controlling a data rate of a second audio data exchange between the first and second earphone in response to the second audio environment characteristic, the second audio data exchange supporting a binaural processing of the earphone arrangement.
  • the audio data exchange may include the second audio data exchange i.e. a data rate of audio exchanged between the two headphones may depend on an audio environment characteristic determined from both at least one microphone of the first earphone and at least one microphone of the second earphone.
  • control means is arranged to reduce the data rate if the audio environment characteristic does not meet a criterion. This may allow improved performance, facilitated operation and/or reduced resource usage. In particularly, it may in many embodiments allow an efficient and low complexity trade-off between e.g. audio quality and battery life.
  • the reduction of the data rate may specifically be a switching off of the exchange of all or part of one or more microphone signals for which audio data is exchanged from the first earphone to the second earphone or from the second earphone to the first earphone.
  • exchanged audio data supporting binaural processing for the first earphone and/or the second earphone may be switched off if the criterion is not met.
  • binaural operation may only be supported if the criterion is met.
  • the audio environment characteristic comprises a Signal to Interference Ratio, SIR, indication, a Signal to Noise Ratio, SNR, indication and an angle of arrival estimate for an interferer; and the criterion comprises: a requirement that the SIR indication is below a first threshold; a requirement that the SNR indication is above a second threshold; and a requirement that the angle of arrival estimate is within an angle interval.
  • the angle interval may specifically comprise an angle corresponding to a frontal direction for the earphone arrangement when in use.
  • Particularly advantageous performance may typically be achieved for a first threshold between 0 and 20 dB (and in particular for a first threshold of substantially 10 dB) and/or a second (SNR) threshold between 0 and 2OdB (and in particular for a second threshold of substantially 10 dB) and an angle interval of between 100-140 degrees.
  • the audio data exchange is an exchange of audio data from the first earphone to the second earphone.
  • the audio environment characteristic determined from the at least one microphone of the first earphone may control the transmission of audio data to the second earphone thereby allowing the resource usage expended by binaural operation to be flexibly adjusted based on the conditions experienced at the first earphone.
  • the arrangement may additionally exchange audio data from the second to the first earphone.
  • This reverse exchange of audio data may be controlled in response to the audio environment characteristic independently of or correlated with the exchange of audio data from the first earphone to the second earphone.
  • the audio data exchange is an exchange of audio data from the second earphone to the first earphone.
  • the audio environment characteristic determined from the at least one microphone of the first earphone may control the transmission of audio data from the second earphone thereby allowing the resource usage expended by binaural operation to be flexibly adjusted based on the conditions experienced at the first earphone.
  • the arrangement may additionally exchange audio data from the first to the second earphone. This reverse exchange of audio data may be controlled in response to the audio environment characteristic independently of or correlated with the exchange of audio data from the second earphone to the first earphone.
  • the audio environment characteristic is indicative of a performance gain of the binaural processing of the earphone arrangement relative to a monaural operation of the earphone arrangement.
  • the audio environment characteristic comprises a Signal to Interference Ratio, SIR, indication.
  • the audio environment characteristic comprises a Signal to Noise Ratio, SNR, indication.
  • a SNR measure provides particularly useful information for dynamically adjusting the binaural processing of an earphone arrangement and of the data exchange resource used by this.
  • the audio environment characteristic comprises an angle of arrival estimate for an interferer.
  • an angle of arrival for an interferer provides particularly useful information for dynamically adjusting the binaural processing of an earphone arrangement and of the data exchange resource used by this.
  • the interferer may for example be a dominant interferer and/or may be an interferer which is received at a signal level that exceeds a given threshold (which may be dynamically determined in response to audio characteristics).
  • control means is arranged to reduce the data rate by reducing a frequency bandwidth represented by exchanged audio data if the angle of arrival estimate is within a first angle interval.
  • This may allow improved performance, facilitated operation and/or reduced resource usage. This may in particular allow reduced resource usage while allowing any quality degradation to be reduced by a partial binaural operation being enabled. Furthermore, for a given reduced data rate this may allow improved benefit of the performed binaural processing.
  • the angle interval may specifically comprise an angle corresponding to a frontal direction for the earphone arrangement when in use. Particularly advantageous performance may typically be achieved for a first angle interval of between 100-140 degrees.
  • control means is arranged to reduce a data rate for audio data transmitted from the second earphone to the first earphone if the angle of arrival is in an angle interval corresponding to a head shadow for the second earphone when in use.
  • the reduction may furthermore be performed only if a SNR indication is below a threshold.
  • the first angle interval may have a size of between 50 and 70 degrees and may specifically include an angle of 30 degrees relative to the frontal direction when in use and in the direction of the ear associated with the first earphone when in use.
  • the control means is arranged to set a frequency bandwidth for audio signals exchanged by the audio data in response to the audio environment characteristic. This may allow improved performance, facilitated operation and/or reduced resource usage. In particular it may allow reduced resource usage while allowing any quality degradation to be reduced by a partial binaural operation being enabled. Furthermore, for a given reduced data rate this may allow improved benefit of the performed binaural processing.
  • the audio data exchange comprises a first audio data exchange from the first earphone to the second earphone and a second audio data exchange from the second earphone to the first earphone; and the control means is arranged to control the data rate differently in response to the audio environment characteristic for the first audio data exchange and the second audio exchange.
  • At least one earphone of the first and second earphones comprises a binaural beam former for performing a binaural beam forming using at least a first signal from a first microphone of the at least one earphone and at least a second signal from a second microphone of an other earphone of the first and second earphones, the second signal being communicated from the other earphone to the at least one earphone by the audio data exchange.
  • improved beam forming and/or reduced power consumption may be achieved.
  • the other earphone is arranged to low pass filter the second signal prior to communication to the at least one earphone.
  • the at least one earphone is arranged to low pass filter the first signal prior to performing the binaural beam forming.
  • This may allow improved performance, facilitated operation and/or reduced resource usage.
  • it may allow an improved binaural beam forming from a closer correspondence between the characteristics of the audio signals from the two earphones.
  • the at least one earphone further comprises a monaural beam former arranged to perform a monaural beam forming based only on signals from microphones of the at least one earphone; and means for combining an output signal of the binaural beam former and an output signal of the monaural beam former to generate an output signal of the at least one earphone.
  • an earphone of an earphone arrangement comprising the earphone and a second earphone arranged to operate in a binaural arrangement, the earphone comprising: determining means for determining an audio environment characteristic in response to a signal from at least one microphone of the earphone; and control means for controlling a data rate of an audio data exchange between the earphone and the second earphone in response to the audio environment characteristic, the audio data exchange supporting a binaural processing of the earphone arrangement.
  • a method of operation for an earphone arrangement comprising a first and second earphone arranged to operate in a binaural arrangement, the method comprising the first earphone performing the steps of: determining an audio environment characteristic in response to a signal from at least one microphone of the first earphone; and controlling a data rate of an audio data exchange between the first and second earphone in response to the audio environment characteristic, the audio data exchange supporting a binaural processing of the earphone arrangement.
  • FIG. 1 is an example of an illustration of a hearing aid in accordance with some embodiments of the invention
  • Fig. 2 illustrates an example of a binaural hearing aid setup with three microphones on each ear
  • Fig. 3 illustrates an example of performance gains from binaural and monaural processing
  • Fig. 4 illustrates an example of performance gains from binaural and monaural processing
  • Fig. 5 illustrates an example of performance gains from binaural and monaural processing
  • Fig. 6 illustrates an example of performance gains from binaural and monaural processing
  • Fig. 7 illustrates an example of performance gains from binaural processing in the presence or not of head shadow
  • Fig. 8 is an example of an illustration of a hearing aid in accordance with some embodiments of the invention
  • Fig. 9 illustrates an example of performance gains from binaural and monaural processing
  • Fig. 10 illustrates an example of performance gains from binaural and monaural processing.
  • a hearing impaired user may utilize a hearing aid arrangement to assist in the hearing.
  • the hearing aid arrangement comprises a left and right hearing aid to be worn on respectively the left and right ear by the user when in use.
  • the two hearing aids have identical functionality although the exact physical dimensions may vary to compensate for differences between the left or right ear.
  • FIG. 1 shows an example of a hearing aid in accordance with some embodiments of the invention.
  • FIG. 1 specifically shows the left hearing aid and the following description will focus on this example.
  • the right hearing aid may be functionally identical to the left hearing aid and that the focus on the left ear is merely for clarity and brevity of the description.
  • the hearing aid comprises a microphone array which in the specific example comprises two microphones 101, 103 although it will be appreciated that in other embodiments the hearing aid may comprise more microphones and indeed in some embodiments may comprise only a single microphone.
  • the two microphones 101, 103 are coupled to an audio processor 105 which is further coupled to an audio transducer 107 which radiates the resulting audio signal into the left ear when in use.
  • the left hearing aid furthermore comprises a wireless receiver 109 which is arranged to receive a wireless data communication from the right hearing aid.
  • the received data is fed to a receive data processor 111 which extracts the appropriate audio data from the communication.
  • any suitable method of communicating data between the right and left hearing aid may be used including proprietary techniques or publicly standardized techniques such as e.g. BluetoothTM.
  • the exchanged audio data is binaural audio data for performing a binaural processing at the left hearing aid.
  • the audio data may comprise the microphone signals from the microphone(s) of the right hearing aid.
  • the audio signal(s) received from the right hearing aid may be signals generated by a processing of the microphone signals from the microphone(s) of the right hearing aid.
  • the microphone signals may be filtered, amplified, compressed etc prior to communication to the left hearing aid.
  • microphone signals may be combined into fewer audio signals prior to the transmission to the left hearing aid.
  • the receive data processor 111 is coupled to the audio processor 105 which is fed the received audio data.
  • the audio processor 105 may then process the received audio data together with the local microphone signals from microphones 101, 103 to generate a binaurally processed signal that is output to the audio transducer 107.
  • the audio processor 105 may perform a binaural operation/ process that combines the local microphone signals with the received audio signals in order to improve the generated audio signal.
  • the binaural operation may be a beam forming algorithm that is based on the combined microphone array comprising the microphones of the both the left and right hearing aid.
  • Such a beam forming may substantially improve the performance of any beam forming based only on the local microphones 101, 103 since it increases (and typically doubles) the number of microphones of the array as well as significantly increases the distance between the microphones.
  • the distance between the left and right hearing aids are typically much larger than the distance between the microphones of a hearing aid thereby allowing a much larger effective array and thus enabling effective beam forming at much lower frequencies.
  • the wireless communication of audio data is typically very resource demanding and in particular increases both power consumption and computational resource (which further increases power consumption). Indeed, the increased power consumption may often substantially reduce the battery life thereby reducing the user benefit.
  • the left hearing aid furthermore comprises a data generator 113 which is coupled to the microphones 101, 103 and which generates suitable audio data/signals that are transmitted to the right hearing aid by a transmitter 115.
  • the transmitter 115 may specifically be a BluetoothTM transmitter but it will be appreciated that the transmission to the second hearing aid may be in accordance with any suitable transmission protocol or standard. Typically, the same transmission approach will be used for transmissions from the right to the left hearing aid as from the left to the right hearing aid.
  • the hearing aid furthermore comprises a binaural controller 117 coupled to receive data processor 111 and the data generator 113.
  • the binaural controller 117 is arranged to control the audio data exchange between the two hearing aids.
  • the binaural controller 117 is arranged to control a data rate of the audio data exchange between the first and second hearing aid in response to an audio environment characteristic determined from the signal from at least one of the local microphones.
  • the controlled data rate may be of the transmission from the left to the right hearing aid, from the right to the left hearing aid or both.
  • the binaural controller 117 is coupled to an audio environment processor 119 which is further coupled to the microphones 101, 103 and which is arranged to determine an audio environment characteristic from the microphone signals from the two microphones 101, 103.
  • the audio environment processor 119 is arranged to determine an audio environment characteristic comprising e.g. a Signal to Interference Ratio (SIR) indication, a Signal to Noise Ratio (SNR) indication and/or an angle of arrival estimate for an interferer.
  • the audio environment characteristic is a characteristic which is indicative of a performance gain of a binaural processing of at least one of the left or right hearing aid relative to a monaural operation of the hearing aid.
  • the binaural controller 117 can specifically reduce the data rate of the exchanged audio data for the binaural operation if the audio environment characteristic has a value(s) that is indicative of the benefit of using binaural operation not being sufficiently high.
  • the audio exchange between the left and right hearing aids may be completely switched off when the audio environment characteristic has values that correspond to an estimated benefit of the binaural processing being below a given value.
  • the binaural controller 117 may evaluate if the audio environment characteristic meets a predetermined criterion (e.g. that the values of the parameters comprised in the audio environment characteristic has acceptable values). If so, the binaural controller 117 controls the receive data processor 111 and the data generator 113 to exchange audio data with the right hearing aid. Furthermore, as the audio processor 105 receives audio data from the right hearing aid it proceeds to include this and to perform a binaural processing.
  • the binaural controller 117 controls the receive data processor 111 and the data generator 113 to not exchange any audio data.
  • the computational resource (of both the left and right hearing aid) is reduced (as no receive operation, transmit operation or binaural processing is performed).
  • the power consumption (of both hearing aids) is substantially reduced, partly due to the computational resource reduction and partly due to the reduced transmit power resource usage.
  • the approach may allow improved performance and may in particular provide an improved trade-off between power consumption/ battery life and audio quality/ hearing assistance. Specifically, the battery life may be substantially increased while maintaining acceptable or even negligible quality degradation. It will be appreciated that in other embodiments, a more flexible control of the data rate of the audio data exchange may be implemented. For example, the data rate may be given as a given function of the audio environment characteristic.
  • any suitable method of controlling the data rate may be used.
  • the encoding process may be adjusted to provide the desired data rate (e.g. the encoded audio quality may depend on the audio environment characteristic).
  • the data rate may be controlled by characteristics or parameters of the transmitted audio signals being flexibly adjusted. For example, only low frequency signals may be transmitted with the cut-off frequency of the low pass filtering of the microphone signals being determined as a function of one or more values of the audio environment characteristic.
  • the binaural controller 117 may control both the transmission of audio data from the first hearing aid to the second hearing aid as well as the transmission of audio data from the second hearing aid to the first hearing aid. However, it will be appreciated that in other embodiments, the binaural controller 117 may control only data transmissions in one direction. It will also be appreciated that the binaural controller 117 may control the data transmissions in the two different directions differently or asymmetrically. For example, if a specific criterion is met, the binaural controller 117 may terminate audio data from the left to the right hearing aid while allowing audio data transmissions from the right to the left hearing aid.
  • the binaural controller 117 may for example control transmissions from the right hearing aid to the left hearing aid by communicating control data to the right hearing aid using the transmitter 115. For example, if the binaural controller 117 detects that the criterion for using binaural operation at the left hearing aid is not met, it may transmit a control signal to the right hearing aid in response to which the right hearing aid ceases transmissions of audio data.
  • the binaural controller 117 may identify situations where the additional benefit offered by a binaural system over a monaural system is high and situations where the improvements are only marginal. Transmission of audio data and thus binaural operation may then be allowed only when the expected benefits are high with monaural operation being used otherwise. Thus, as signals are only exchanged when the resulting benefits are sufficiently significant, an increased battery life is achieved without a significant quality reduction.
  • the data rate is controlled by detecting specific values of parameters of the audio environment characteristic for which a specific data reduction is applied, and specifically specific parameter values for which binaural operation and audio data exchange is completely switched off.
  • an analysis of the operation and performance gains of binaural processing/ operation is provided and specific examples of the data rate control by the binaural controller 117 are provided on the basis of the analysis.
  • PSD power spectral density
  • H k (( ⁇ ) and G k (( ⁇ ) are the transfer functions between the k th microphone on the left hearing aid and the desired and interfering sources respectively
  • £/*( ⁇ ) and V k (( ⁇ ) correspond to uncorrelated (e.g., sensor) noise and ambient diffuse noise, respectively, at the k th microphone on the left hearing aid
  • N is the number of microphones on the left hearing aid.
  • E ⁇ C/*( ⁇ )C/f ( ⁇ ) ⁇ ⁇ (£ - /) ⁇ H ( ⁇ )V£ .
  • E ⁇ C/*( ⁇ )C/f ( ⁇ ) ⁇ ⁇ (£ - /) ⁇ H ( ⁇ )V£ .
  • S((o) , /( ⁇ ) and t/( ⁇ ) are pair wise independent.
  • left ear quantities are defined as
  • n L ( ⁇ ) [Hl( ⁇ ),H L 2 ( ⁇ ),...,H?( ⁇ )] ⁇ ,
  • G x (CO) [G
  • the right ear quantities H ⁇ ( ⁇ ) , G ⁇ ( ⁇ ) , X R ( ⁇ ) , U ⁇ ( ⁇ ) , and V ⁇ ( ⁇ ) are defined similarly.
  • V( ⁇ ) [Vj( ⁇ )Vj( ⁇ )f .
  • X z ( ⁇ ) H z ((D)S(OO) + G z (oo)/(oo) + U z ( ⁇ ) + V z ( ⁇ )
  • X R ( ⁇ ) U R ( ⁇ )S( ⁇ ) + G R ( ⁇ )I( ⁇ ) + U R ( ⁇ ) + ⁇ R ( ⁇ ) (3)
  • X( ⁇ ) H(OO)S(OO) + G( ⁇ )/( ⁇ ) + U(co) + V(oo).
  • Fig. 2 illustrates an example of a binaural hearing aid setup with three microphones on each ear. The example will be used to describe the model.
  • the origin to be the center of the sphere (corresponding to the head).
  • a be the radius of the sphere
  • r be the distance between the origin and the sound source
  • p rla
  • denote the angle between a ray from the origin to the sound source and a ray from the origin to the point of observation on the surface of the sphere.
  • HRTF Head Related Transfer Function
  • ⁇ ⁇ denote the angle between the vertical y-axis and a ray from the origin to the desired source.
  • be defined similarly for the interfering source.
  • the first microphone on the left and right ears are assumed to be located at 5 ⁇ /9 and - 5 ⁇ /9 respectively. It is assumed that the microphones are located on the surface of the sphere, and let d denote the length of the arc between two adjacent microphones on a single hearing aid. This yields:
  • H L k ( ⁇ ) H(p, ⁇ , ⁇ s + 5 ⁇ /9 + (k - ⁇ ) ⁇ ⁇ )
  • G L k ( ⁇ ) H(p, ⁇ , ⁇ ! + 5 ⁇ /9 + (£ - l) ⁇ ⁇ )
  • MMSE Minimum Mean Squared Error
  • the binaural MWF is given by
  • I 2N is the identity matrix of dimension 2N , and the (i,j) ⁇ entry of F 5 (CO)E(V(CO)V 1 XcO)) is given by
  • the benefit at the left ear due to monaural and binaural processing as a function of the location of the interferer, the number of interferers, the signal-to-interference noise ratio (SIR), and the signal-to-noise ratio (SNR) can be assessed.
  • the impact of the head shadow effect on the performance of the binaural system can be considered.
  • the SIR and SNR are defined as lOtogJ — and 10tog 10 — ,
  • a desired source is considered to be located straight ahead of the user when the hearing aid arrangement is in use (corresponding to 0°).
  • Fig. 3 illustrates M and B for four different frequencies 2, 4, 6, and 8 kHz corresponding to an input SIR of 0 dB and input SNR of 30 dB.
  • Fig. 4 illustrates M and B averaged over all frequencies.
  • the binaural processing may be made dependent on an estimated angle of arrival of an interferer. For example, if the estimated angle of arrival falls within a given angle interval including the angle of the desired signal (which is typically, or may be assumed to be, straight ahead of the user when in user (0°). For example, binaural processing may be used if the estimate falls within the interval of [-60°, 60°]. Thus, in the example, the binaural audio data exchange may be increased if the estimate falls within the given interval and may be reduced if it is outside the interval. It will be appreciated that any suitable method or algorithm of estimating the angle of arrival of an interferer may be used and that several different approaches will be known by the person skilled in the art.
  • a four- microphone binaural system has a clear advantage over a two -microphone monaural system.
  • the binaural system offers fewer benefits in some scenarios. For example, when both interferers are co-located, the binaural operation tends not to provide a significant additional benefit. However, this corresponds to a scenario with only a single interferer where the monaural system performs relatively well and the benefit of the binaural processing is relatively limited except when the interferers are located within the interval [- 60°, 60°] as previously described for the single interferer. Another example is when both interferers are located very close to the desired source. In this case, the binaural array is typically unable to place two spatial nulls close to the desired source and therefore cannot sufficiently attenuate the interferers.
  • Another example is when the interferers are located around 180°.
  • the monaural system is able to suppress a single interferer relatively well.
  • the binaural system is unable to sufficiently suppress an interferer located around 180° when the desired source is active at 0°.
  • the binaural processing may be made dependent on a number of interferers and may in particular be dependent on estimated angles of arrival for a plurality of interferers. For example, if two interferers are detected with estimated angle of arrivals that differ substantially from each other (i.e. by more than a suitable threshold) binaural processing may be switched on.
  • the binaural audio data exchange may furthermore be controlled in response to the SIR and/or SNR values experienced in the audio environment. For example, at high SIR values and for an interferer located at around 30°, the additional benefit of binaural processing tends to reduce to the 3 dB gain resulting from the reduction of uncorrelated noise due to the doubling of microphones.
  • the monaural system is able to provide a significant improvement as the SNR increases. Since the monaural system already provides good performance, the additional benefit due to the binaural processing is not as high as when the interferer is located at 30°.
  • Fig. 5 illustrates M and B for four different frequencies 2, 4, 6, and 8 kHz corresponding to an input SIR of 0 dB and input SNR of 20 dB and Fig. 6 illustrates M and
  • the binaural processing may be made dependent on the SIR and/or the SNR.
  • the binaural audio data exchange may only be performed when the SIR is below a given threshold and the SNR is above a given threshold.
  • the binaural audio data exchange may in some embodiments/ scenarios be controlled in consideration of the head shadow effect.
  • results obtained using the head shadow model are compared to those obtained without applying the model.
  • the latter case corresponds to the four microphone array mounted in free space, and the microphone signals differ from each other just by delays.
  • FIG. 7 illustrates the SINR improvement of the binaural processing with the head shadow model (dotted line) and without the head shadow model (solid line) for four different frequencies 2, 4, 6, and 8 kHz corresponding to an input SIR of 0 dB and input SNR of 30 dB.
  • the improvement with the free mounted array is symmetric with respect to interferer location whereas the head mounted array results in better performance when the interferer is located in the left half plane.
  • the input SINR is low at the left ear and higher at the right ear due to the attenuation provided by the head.
  • the binaural system is able to benefit from the higher SINR signal observed at the right ear.
  • the free mounted array does not have this advantage as signals at both ears have the same input SINR. This effect is more pronounced at higher frequencies.
  • the attenuation provided by the head is higher at high frequencies, the difference between the head and free mounted arrays is also higher at the high frequencies.
  • the left ear already enjoys a high input SINR and there is not much added benefit due to the availability of the lower SINR right ear signal.
  • FIG. 7 shows the improvement in SINR due to the binaural processing, which is asymmetric with respect to interferer location in the case of the head mounted array (as only the impact on the left hearing aid is considered).
  • the total output SINR after processing is however symmetric.
  • a second effect especially at high frequencies is that the head mounted array suffers less from spatial aliasing compared to the free-mounted array. This is evident from the sharp nulls present in the front half plane in the free-mounted case. These nulls are less pronounced for the head mounted array.
  • the binaural controller 117 may reduce a data rate from the right earphone to the left earphone if the angle of arrival is in an angle interval corresponding to a head shadow for the left earphone when in use by a user (i.e. when the hearing aids are worn on the left and right ears).
  • the binaural controller 117 may reduce a data rate from the right earphone to the left earphone if the angle of arrival is in an angle interval corresponding to a head shadow for the left earphone when in use by a user (i.e. when the hearing aids are worn on the left and right ears).
  • an interferer is located in the interval from [0°, -60°] there is not much added benefit at the left ear due to a binaural processing, and transmission of data from the right to left ear may be avoided. It will be appreciated that the symmetric situation will typically apply to the right hearing aid.
  • the data rate of the audio data exchange is made dependent on the benefit due to binaural beam forming as assessed by the audio environment characteristic. Specifically, as illustrated the data rate may be varied depending on interferer location, frequency, angle of arrival, SNR and SINR.
  • the resulting transmission scheme may conserve power and bandwidth and may specifically increase battery life.
  • transmission is allowed only when the audio environment characteristic meets a criterion that indicates that the benefits of the binaural processing are high, thus resulting in power savings in other situations as no signal needs to be transmitted.
  • the second approach is a soft decision scheme where an appropriate data-rate is selected for the audio data exchange resulting in an efficient use of the available bandwidth.
  • the selection of the data rate takes into account the additional benefit provided by the binaural processing.
  • a hard decision may be made on whether or not to transmit, and in cases when transmission is performed, an appropriate bit-rate may then be calculated by the second method.
  • the additional benefit provided by the binaural processing depends on a number of parameters.
  • binaural audio data is exchanged between the two hearing aids only when the different parameters of the audio environment characteristic are within a predetermined range.
  • the exact parameter ranges may depend on the specific characteristics and preferences of the individual embodiment.
  • an advantageous criterion may comprise a requirement that the SIR indication SIR is below a first threshold; a requirement that the SNR indication is above a second threshold; and a requirement that the angle of arrival estimate is within an angle interval.
  • audio data may be exchanged between the left and right hearing aids.
  • the gain in performance resulting from a binaural system is only marginal at high SIRs and low SNRs and thus by restricting transmission to the identified range, power consumption can be minimized.
  • the binaural audio data exchange may only be performed for interferers in this range.
  • binaural operation is typically beneficial when at least one interferer is located within [60°, 300°]. If both interferers are located within a 60° neighborhood of 0° or 180°], the benefit is only marginal.
  • the criterion for audio data exchange may be set to reflect this.
  • the data rate may be determined by a rate distortion algorithm.
  • the binaural beam forming problem can be seen as a remote Wyner-Ziv due to the fact that the encoder does not have direct access to the source but only to a noisy version of the source.
  • the right hearing aid needs to encode ⁇ 05 J such that an MMSE estimate of £v ⁇ J ⁇ ⁇ J [ s obtained at the left hearing aid using the side information L ⁇ ⁇ ) .
  • the sources are band limited and can be described as zero-mean jointly Gaussian processes, the corresponding parametric rate-distortion formula is given by
  • bit-rate R is expressed in bits per second
  • ⁇ ( ⁇ ) ⁇ M ( ⁇ ) - ⁇ B ( ⁇ )
  • the difference ⁇ M ⁇ ⁇ ) ⁇ SB ⁇ ⁇ ) can t ⁇ e reduced by exchanging signals at a positive rate R .
  • the above equations may be used in a rate distortion algorithm to determine the rate allocation across different frequency bands.
  • a certain desired SINR improvement may be defined and the data rate of the audio data exchange may be adjusted accordingly.
  • the frequency dependency of the binaural processing gain may be taken into account when controlling the data rate.
  • the frequency bandwidth for the audio signals exchanged by the audio data may be modified in response to the audio environment characteristic.
  • the binaural processing gain is higher for lower frequencies than for higher frequencies. Accordingly, the signal bandwidth may be reduced for scenarios wherein the benefit at higher frequencies is negligible whereas the benefit at lower frequencies is still significant.
  • the frequency bandwidth represented by the exchanged audio data may be reduced if the angle of arrival estimate of a single interfere is within a given angle interval wherein the benefit at higher frequencies is less significant.
  • full bandwidth microphone signals may be exchanged between the hearing aids if the estimated angle of arrival is within [-60°, 60°] .
  • the low frequency content e.g., up to 2 kHz
  • binaural processing is only performed at lower frequencies whereas at higher frequencies, the monaural system already provides good performance.
  • the data rate required to represent the signal can be reduced for lower bandwidths (e.g. a reduced sample rate may be used)
  • a substantially reduced data rate for the wireless transmission may be achieved and thus reduced power consumption can be achieved.
  • Fig. 8 shows an example of an implementation wherein the binaural processing is a binaural beam forming that uses one or more low pass filtered audio signals communicated from the other hearing aid.
  • FIG. 8 specifically shows the left hearing aid and the following description will focus on this example.
  • the right hearing aid may be functionally identical to the left hearing aid and that the focus on the left ear is merely for clarity and brevity of the description.
  • the hearing aid of FIG. 8 specifically corresponds to the hearing aid of FIG. 1 with additional functionality which will be described in the following.
  • the audio processor 105 is a binaural beam former which performs a binaural beam forming using audio signals derived from the microphones of both the left hearing aid and the right hearing aid.
  • the binaural beam forming uses both the locally generated microphone signals and the microphone signals received by the audio data exchange, i.e. transmitted from the right hearing aid to the left hearing aid.
  • the audio signal received from the right hearing aid is not a full bandwidth signal but rather is a signal that has first been low pass filtered with a suitable cut-off frequency, such as e.g. 2 kHz.
  • a suitable cut-off frequency such as e.g. 2 kHz.
  • the first and second microphone signals are furthermore low pass filtered in a low pass filter 801 prior to being fed to the audio processor 105 for binaural beam forming.
  • the low pass filter characteristics of the low pass filter 801 is selected to match the characteristics of the low pass filtering performed at the right hearing aid. Specifically, the same filter and/or cut-off frequency may be used.
  • the binaural beam forming is based only on lower frequency components of the microphones signals. Although, this may not provide the same quality beam forming as a beam forming based on full bandwidth signals, the degradation is often acceptable in return for the reduced power consumption and the approach may accordingly provide increased user satisfaction in many scenarios.
  • the beam formed low frequency output signal generated by the audio processor 105 may be used directly as an audio output signal of the hearing aid.
  • the beam formed low frequency output signal is combined with high frequency content of the locally generated microphones signals.
  • the first and second microphone signals may be high pass filtered with a cut-off frequency corresponding to the low pass filter cut-off frequency.
  • the high pass filtered signal of one or more of the left ear microphone signals may e.g. be added directly to the beam formed low frequency output signal to generate the hearing aid output signal.
  • the local microphone signals are monaurally beam formed before being combined with the beam formed low frequency output signal from the binaural beam former.
  • the first and second microphone signals are fed to a high pass filter 803 which performs a high pass filtering that corresponds to (is complementary to) the low pass filtering performed by the low pass filter 801.
  • the high pass filter 803 is coupled to a monaural beam former 805 which receives the high pass filtered microphone signals.
  • the monaural beam former 805 then performs a monaural beam forming on these signals to generate a beam formed high frequency output signal.
  • the audio processor 105 and the monaural beam former 805 are coupled to a combiner 807 which is further coupled to the audio transducer 107.
  • the combiner 807 combines the binaurally beam formed low frequency output signal and the monaurally beam formed high frequency output signal to generate the hearing aid output signal fed to the sound transducer 107.
  • the combination may for example be a simple addition.
  • This approach may provide improved performance and may in particular provide improved beam forming.
  • the approach may allow high performance while substantially reducing the power consumption of the hearing aids.
  • the hearing aid of FIG. 8 also comprises a low pass filter 809 for filtering the locally generated microphone signals prior to their transmission to the right hearing aid.
  • the low pass filtering may be symmetric such that the transmitted signals may be the output signals from the low pass filter 801.
  • the low pass filtering may e.g. be dynamically varied asymmetrically between the first and second hearing aid (e.g. depending on the location of a dominant interferer).
  • the data rate of the audio data exchange may be adapted by adapting a characteristic of the low pass filtering.
  • the cut-off frequency of the low pass filtering may be adjusted in response to angle of arrival, SIR and/or SNR measures.
  • the low pass filtering may simply be switched on and off depending on whether the audio environment characteristic meets a suitable criterion.
  • FIG. 9 illustrates an example of performance gains from binaural and monaural processing.
  • FIG. 9 illustrates the improvement in SINR (Signal-To-Interference- Plus-Noise Ratio) at the left hearing aid for different locations of an interfering source for three scenarios.
  • the dashed line corresponds to the scenario when the entire frequency content is transmitted from the right hearing aid (cut-off frequency of 8 kHz).
  • the dotted line corresponds to full monaural processing, when no signal is transmitted from the right hearing aid (corresponding to a cut-off frequency of 0 kHz). In this scenario, only the microphone signals from the left hearing aid are processed.
  • the solid line corresponds to a particular scenario using the approach described in relation to FIG. 8.
  • the low frequency content of the right hearing aid microphone signals up to 2 kHz are transmitted from the right hearing aid, the desired source is assumed to be located at 0 deg., the input SIR (signal-to-interference ratio) is 0 dB and the input SNR is 30 dB.
  • the signals are sampled at 16 kHz.
  • Fig. 10 illustrates the relative performance for the same scenario but with a cut-off frequency of 4 kHz.
  • the cut-off frequency can be adjusted in response to e.g. the audio environment characteristic or e.g. in response to a current remaining battery charge.
  • an embodiment of the invention may be physically, functionally and logically implemented in any suitable way. Indeed the functionality may be implemented in a single unit, in a plurality of units or as part of other functional units. As such, the invention may be implemented in a single unit or may be physically and functionally distributed between different units and processors.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)

Abstract

An earphone arrangement comprises a first and second earphone arranged to operate in a binaural arrangement. An audio data exchange between the earphones supports a binaural processing of the earphone arrangement. The earphones may specifically be hearing aids each of which comprises one or more microphones. An audio environment processor (119) of the hearing aids determines an audio environment characteristic in response to signals from at least one microphone (101, 103) of the first earphone. A binaural controller (117) controls a data rate of an audio data exchange between the first and second earphone in response to the audio environment characteristic. Specifically, the data rate of the audio data exchange may be varied in dependence on a signal to interference ratio, a signal to noise ratio and/or an angle of arrival estimate for an interferer. The approach may typically reduce power consumption and increase battery life.

Description

Earphone arrangement and method of operation therefor
FIELD OF THE INVENTION
The invention relates to an earphone arrangement and a method of operation therefor and in particular, but not exclusively, to binaural processing for hearing aids.
BACKGROUND OF THE INVENTION
Advanced processing of audio signals has become increasingly important in many areas including e.g. telecommunication, content distribution etc. A particular important area for audio signal processing is in the field of earphones and in particular hearing aids. In recent years, hearing aids have increasingly applied complex audio processing algorithms to provide an improved user experience and assistance to the user. For example, audio processing algorithms have been used to provide an improved signal to noise ratio between a desired sound source and an interfering sound source resulting in a clearer and more perceptible signal being provided to the user. In particular, hearing aids have been developed which include more than one microphone with the audio signals of the microphones being dynamically combined to provide directivity for the microphone arrangement. Such directivity may be achieved by beam forming algorithms which in some cases may be adaptive such that they are dynamically directed towards a desired sound source. As another example, noise cancelling algorithms may be applied to reduce the interference caused by undesired sound sources and background noise.
A monaural hearing aid solution consists of a single hearing aid which fits on one ear of the user and typically provides functions such as compression, amplification and feedback cancellation. Most modern hearing aids have two or more microphones mounted on them and provide directional processing through spatial filtering techniques. A system wherein two independent monaural hearing aids are used simultaneously is still considered a bilateral monaural hearing aid solution.
A binaural system is one where hearing aids on two ears collaborate with one another. Such an approach promises at least three advantages compared to a monaural system: improved speech intelligibility in noise (especially when the speech and noise signals originate from different directions), improved localization resulting in a better perception of the auditory scene, and improved noise reduction due to a larger microphone spacing and a higher number of microphones.
In binaural operation the signals from both hearing aids are combined to generate the audio output signals from the hearing aids. Specifically, binaural beam forming may be achieved by combining the microphone signals from both left and right hearing aids and this binaural beam forming may provide a substantially improved beam forming relative to e.g. beam forming based only on the microphones from one hearing aid.
Binaural beam forming in hearing aids requires exchange of microphone signals between the hearing aids worn on the left and right ears. This exchange occurs over a wireless link as it is not generally desired to have a wired link for aesthetic reasons. However, wireless transmission introduces power and computational constraints and in particular introduces significant additional power consumption by the hearing aids resulting in a reduced battery life, which is an important concern for hearing aid users. Hence, an improved ear phone/ hearing aid system would be advantageous and in particular a system allowing increased flexibility, facilitated implementation, reduced resource usage, practical implementation, reduced power consumption, increased battery life and/or improved performance would be advantageous.
SUMMARY OF THE INVENTION
Accordingly, the Invention seeks to preferably mitigate, alleviate or eliminate one or more of the above mentioned disadvantages singly or in any combination. According to an aspect of the invention there is provided earphone arrangement comprising a first and second earphone arranged to operate in a binaural arrangement, the first earphone comprising: determining means for determining an audio environment characteristic in response to a signal from at least one microphone of the first earphone; and control means for controlling a data rate of an audio data exchange between the first and second earphone in response to the audio environment characteristic, the audio data exchange supporting a binaural processing of the earphone arrangement. The invention may allow improved performance of an ear phone arrangement which specifically may be a hearing aid arrangement. In particular, the invention may allow reduced resource consumption and in many embodiments a reduced power consumption and thus increased battery life can be achieved. Specifically, in many embodiments, the invention may allow performance close to a fully binaural operation but with a substantially reduced resource usage.
The system may specifically allow a flexible and dynamic system wherein the resource expended by the binaural operation may be continuously adapted to reflect the performance improvement achievable by the binaural operation in the current conditions.
The first and/or second earphone may be a hearing aid. The arrangement may comprise means for performing a binaural processing in response to the exchanged audio data. In particular, a binaural combination of signals from the first and second earphone may be performed using the exchanged audio data. The binaural operation may for example be a binaural beam forming.
The determining means may be comprised in the first earphone. The term monaural refers to a system wherein each ear is considered independently and the word binaural refers to a system wherein audio fed to one ear is determined in response to signals obtained (directly or indirectly) from microphones associated with both ears. Specifically, for hearing aids, the term monaural may be used to refer to a hearing aid for one ear which operates independently of any other hearing aid whereas the term binaural may refer to the use of interworking hearing aids for each ear. Each earphone or hearing aid may specifically comprise one or more microphones.
The exchanged audio data may specifically correspond to one or more microphone signals.
In some embodiments, the arrangement may further comprise second determining means for determining a second audio environment characteristic in response to signals from at least one microphone of the second earphone; and second control means for controlling a data rate of a second audio data exchange between the first and second earphone in response to the second audio environment characteristic, the second audio data exchange supporting a binaural processing of the earphone arrangement. The audio data exchange may include the second audio data exchange i.e. a data rate of audio exchanged between the two headphones may depend on an audio environment characteristic determined from both at least one microphone of the first earphone and at least one microphone of the second earphone.
In accordance with an optional feature of the invention, the control means is arranged to reduce the data rate if the audio environment characteristic does not meet a criterion. This may allow improved performance, facilitated operation and/or reduced resource usage. In particularly, it may in many embodiments allow an efficient and low complexity trade-off between e.g. audio quality and battery life.
The reduction of the data rate may specifically be a switching off of the exchange of all or part of one or more microphone signals for which audio data is exchanged from the first earphone to the second earphone or from the second earphone to the first earphone. Specifically, exchanged audio data supporting binaural processing for the first earphone and/or the second earphone may be switched off if the criterion is not met. Thus, binaural operation may only be supported if the criterion is met. In accordance with an optional feature of the invention, the audio environment characteristic comprises a Signal to Interference Ratio, SIR, indication, a Signal to Noise Ratio, SNR, indication and an angle of arrival estimate for an interferer; and the criterion comprises: a requirement that the SIR indication is below a first threshold; a requirement that the SNR indication is above a second threshold; and a requirement that the angle of arrival estimate is within an angle interval.
This may allow improved performance, facilitated operation and/or reduced resource usage. In particular, it has been found that the requirements may allow an efficient detection of audio environments wherein binaural operation is particularly desirable and likely to justify the additional resource usage. The angle interval may specifically comprise an angle corresponding to a frontal direction for the earphone arrangement when in use.
Particularly advantageous performance may typically be achieved for a first threshold between 0 and 20 dB (and in particular for a first threshold of substantially 10 dB) and/or a second (SNR) threshold between 0 and 2OdB (and in particular for a second threshold of substantially 10 dB) and an angle interval of between 100-140 degrees. In accordance with an optional feature of the invention, the audio data exchange is an exchange of audio data from the first earphone to the second earphone.
This may allow improved performance, facilitated operation and/or reduced resource usage. The audio environment characteristic determined from the at least one microphone of the first earphone may control the transmission of audio data to the second earphone thereby allowing the resource usage expended by binaural operation to be flexibly adjusted based on the conditions experienced at the first earphone.
The arrangement may additionally exchange audio data from the second to the first earphone. This reverse exchange of audio data may be controlled in response to the audio environment characteristic independently of or correlated with the exchange of audio data from the first earphone to the second earphone.
In accordance with an optional feature of the invention, the audio data exchange is an exchange of audio data from the second earphone to the first earphone. This may allow improved performance, facilitated operation and/or reduced resource usage. The audio environment characteristic determined from the at least one microphone of the first earphone may control the transmission of audio data from the second earphone thereby allowing the resource usage expended by binaural operation to be flexibly adjusted based on the conditions experienced at the first earphone. The arrangement may additionally exchange audio data from the first to the second earphone. This reverse exchange of audio data may be controlled in response to the audio environment characteristic independently of or correlated with the exchange of audio data from the second earphone to the first earphone.
In accordance with an optional feature of the invention, the audio environment characteristic is indicative of a performance gain of the binaural processing of the earphone arrangement relative to a monaural operation of the earphone arrangement.
This may allow improved performance, facilitated operation and/or reduced resource usage.
In accordance with an optional feature of the invention, the audio environment characteristic comprises a Signal to Interference Ratio, SIR, indication.
This may allow improved performance, facilitated operation and/or reduced resource usage. The inventor has realized that a SIR measure provides particularly useful information for dynamically adjusting the binaural processing of an earphone arrangement and of the data exchange resource used by this. In accordance with an optional feature of the invention, the audio environment characteristic comprises a Signal to Noise Ratio, SNR, indication.
This may allow improved performance, facilitated operation and/or reduced resource usage. The inventor has realized that a SNR measure provides particularly useful information for dynamically adjusting the binaural processing of an earphone arrangement and of the data exchange resource used by this.
In accordance with an optional feature of the invention, the audio environment characteristic comprises an angle of arrival estimate for an interferer.
This may allow improved performance, facilitated operation and/or reduced resource usage. The inventor has realized that an angle of arrival for an interferer provides particularly useful information for dynamically adjusting the binaural processing of an earphone arrangement and of the data exchange resource used by this. The interferer may for example be a dominant interferer and/or may be an interferer which is received at a signal level that exceeds a given threshold (which may be dynamically determined in response to audio characteristics).
In accordance with an optional feature of the invention, the control means is arranged to reduce the data rate by reducing a frequency bandwidth represented by exchanged audio data if the angle of arrival estimate is within a first angle interval.
This may allow improved performance, facilitated operation and/or reduced resource usage. This may in particular allow reduced resource usage while allowing any quality degradation to be reduced by a partial binaural operation being enabled. Furthermore, for a given reduced data rate this may allow improved benefit of the performed binaural processing.
The angle interval may specifically comprise an angle corresponding to a frontal direction for the earphone arrangement when in use. Particularly advantageous performance may typically be achieved for a first angle interval of between 100-140 degrees.
In accordance with an optional feature of the invention, the control means is arranged to reduce a data rate for audio data transmitted from the second earphone to the first earphone if the angle of arrival is in an angle interval corresponding to a head shadow for the second earphone when in use.
This may allow improved performance, facilitated operation and/or reduced resource usage.
The reduction may furthermore be performed only if a SNR indication is below a threshold. The first angle interval may have a size of between 50 and 70 degrees and may specifically include an angle of 30 degrees relative to the frontal direction when in use and in the direction of the ear associated with the first earphone when in use.
In accordance with an optional feature of the invention, the control means is arranged to set a frequency bandwidth for audio signals exchanged by the audio data in response to the audio environment characteristic. This may allow improved performance, facilitated operation and/or reduced resource usage. In particular it may allow reduced resource usage while allowing any quality degradation to be reduced by a partial binaural operation being enabled. Furthermore, for a given reduced data rate this may allow improved benefit of the performed binaural processing. In accordance with an optional feature of the invention, the audio data exchange comprises a first audio data exchange from the first earphone to the second earphone and a second audio data exchange from the second earphone to the first earphone; and the control means is arranged to control the data rate differently in response to the audio environment characteristic for the first audio data exchange and the second audio exchange.
This may allow improved performance, facilitated operation and/or reduced resource usage. In particular, an asymmetric data rate may allow an asymmetric binaural operation/ processing such that resource usage is dynamically adapted to the potential benefit of binaural processing at each individual earphone/ear. In accordance with an optional feature of the invention, at least one earphone of the first and second earphones comprises a binaural beam former for performing a binaural beam forming using at least a first signal from a first microphone of the at least one earphone and at least a second signal from a second microphone of an other earphone of the first and second earphones, the second signal being communicated from the other earphone to the at least one earphone by the audio data exchange.
This may allow improved performance, facilitated operation and/or reduced resource usage. In particular, improved beam forming and/or reduced power consumption may be achieved.
In accordance with an optional feature of the invention, the other earphone is arranged to low pass filter the second signal prior to communication to the at least one earphone.
This may allow improved performance, facilitated operation and/or reduced resource usage. In particular, this may allow an improved trade-off between audio quality and power consumption in many embodiments and scenarios. In accordance with an optional feature of the invention, the at least one earphone is arranged to low pass filter the first signal prior to performing the binaural beam forming.
This may allow improved performance, facilitated operation and/or reduced resource usage. In particular, it may allow an improved binaural beam forming from a closer correspondence between the characteristics of the audio signals from the two earphones.
In accordance with an optional feature of the invention, the at least one earphone further comprises a monaural beam former arranged to perform a monaural beam forming based only on signals from microphones of the at least one earphone; and means for combining an output signal of the binaural beam former and an output signal of the monaural beam former to generate an output signal of the at least one earphone.
This may allow improved audio quality and may in particular allow improved beam forming while maintaining low power consumption. According to an aspect of the invention, there is provided an earphone of an earphone arrangement comprising the earphone and a second earphone arranged to operate in a binaural arrangement, the earphone comprising: determining means for determining an audio environment characteristic in response to a signal from at least one microphone of the earphone; and control means for controlling a data rate of an audio data exchange between the earphone and the second earphone in response to the audio environment characteristic, the audio data exchange supporting a binaural processing of the earphone arrangement.
According to an aspect of the invention there is provided a method of operation for an earphone arrangement comprising a first and second earphone arranged to operate in a binaural arrangement, the method comprising the first earphone performing the steps of: determining an audio environment characteristic in response to a signal from at least one microphone of the first earphone; and controlling a data rate of an audio data exchange between the first and second earphone in response to the audio environment characteristic, the audio data exchange supporting a binaural processing of the earphone arrangement. These and other aspects, features and advantages of the invention will be apparent from and elucidated with reference to the embodiment(s) described hereinafter.
BRIEF DESCRIPTION OF THE DRAWINGS
Embodiments of the invention will be described, by way of example only, with reference to the drawings, in which Fig. 1 is an example of an illustration of a hearing aid in accordance with some embodiments of the invention;
Fig. 2 illustrates an example of a binaural hearing aid setup with three microphones on each ear;
Fig. 3 illustrates an example of performance gains from binaural and monaural processing;
Fig. 4 illustrates an example of performance gains from binaural and monaural processing;
Fig. 5 illustrates an example of performance gains from binaural and monaural processing; Fig. 6 illustrates an example of performance gains from binaural and monaural processing;
Fig. 7 illustrates an example of performance gains from binaural processing in the presence or not of head shadow; Fig. 8 is an example of an illustration of a hearing aid in accordance with some embodiments of the invention;
Fig. 9 illustrates an example of performance gains from binaural and monaural processing; and
Fig. 10 illustrates an example of performance gains from binaural and monaural processing.
DETAILED DESCRIPTION OF THE EMBODIMENTS
The following description focuses on embodiments of the invention applicable to hearing aids but it will be appreciated that the invention is not limited to this application but may be applied to other earphone arrangements.
In the specific example, a hearing impaired user may utilize a hearing aid arrangement to assist in the hearing. The hearing aid arrangement comprises a left and right hearing aid to be worn on respectively the left and right ear by the user when in use. In the example, the two hearing aids have identical functionality although the exact physical dimensions may vary to compensate for differences between the left or right ear.
Fig. 1 shows an example of a hearing aid in accordance with some embodiments of the invention. FIG. 1 specifically shows the left hearing aid and the following description will focus on this example. However, it will be appreciated that the right hearing aid may be functionally identical to the left hearing aid and that the focus on the left ear is merely for clarity and brevity of the description.
The hearing aid comprises a microphone array which in the specific example comprises two microphones 101, 103 although it will be appreciated that in other embodiments the hearing aid may comprise more microphones and indeed in some embodiments may comprise only a single microphone. The two microphones 101, 103 are coupled to an audio processor 105 which is further coupled to an audio transducer 107 which radiates the resulting audio signal into the left ear when in use.
The left hearing aid furthermore comprises a wireless receiver 109 which is arranged to receive a wireless data communication from the right hearing aid. The received data is fed to a receive data processor 111 which extracts the appropriate audio data from the communication. It will be appreciated that any suitable method of communicating data between the right and left hearing aid may be used including proprietary techniques or publicly standardized techniques such as e.g. Bluetooth™. The exchanged audio data is binaural audio data for performing a binaural processing at the left hearing aid. In particular, the audio data may comprise the microphone signals from the microphone(s) of the right hearing aid. In other embodiments, the audio signal(s) received from the right hearing aid may be signals generated by a processing of the microphone signals from the microphone(s) of the right hearing aid. For example, the microphone signals may be filtered, amplified, compressed etc prior to communication to the left hearing aid. Also, in some scenarios, microphone signals may be combined into fewer audio signals prior to the transmission to the left hearing aid.
The receive data processor 111 is coupled to the audio processor 105 which is fed the received audio data. The audio processor 105 may then process the received audio data together with the local microphone signals from microphones 101, 103 to generate a binaurally processed signal that is output to the audio transducer 107.
Specifically, the audio processor 105 may perform a binaural operation/ process that combines the local microphone signals with the received audio signals in order to improve the generated audio signal. As a specific example, the binaural operation may be a beam forming algorithm that is based on the combined microphone array comprising the microphones of the both the left and right hearing aid. Such a beam forming may substantially improve the performance of any beam forming based only on the local microphones 101, 103 since it increases (and typically doubles) the number of microphones of the array as well as significantly increases the distance between the microphones. Indeed, the distance between the left and right hearing aids are typically much larger than the distance between the microphones of a hearing aid thereby allowing a much larger effective array and thus enabling effective beam forming at much lower frequencies.
However, the wireless communication of audio data is typically very resource demanding and in particular increases both power consumption and computational resource (which further increases power consumption). Indeed, the increased power consumption may often substantially reduce the battery life thereby reducing the user benefit.
In order to support binaural operation at the right hearing aid, the left hearing aid furthermore comprises a data generator 113 which is coupled to the microphones 101, 103 and which generates suitable audio data/signals that are transmitted to the right hearing aid by a transmitter 115. The transmitter 115 may specifically be a Bluetooth™ transmitter but it will be appreciated that the transmission to the second hearing aid may be in accordance with any suitable transmission protocol or standard. Typically, the same transmission approach will be used for transmissions from the right to the left hearing aid as from the left to the right hearing aid.
The hearing aid furthermore comprises a binaural controller 117 coupled to receive data processor 111 and the data generator 113. The binaural controller 117 is arranged to control the audio data exchange between the two hearing aids. In particular, the binaural controller 117 is arranged to control a data rate of the audio data exchange between the first and second hearing aid in response to an audio environment characteristic determined from the signal from at least one of the local microphones. The controlled data rate may be of the transmission from the left to the right hearing aid, from the right to the left hearing aid or both. The binaural controller 117 is coupled to an audio environment processor 119 which is further coupled to the microphones 101, 103 and which is arranged to determine an audio environment characteristic from the microphone signals from the two microphones 101, 103. Specifically, the audio environment processor 119 is arranged to determine an audio environment characteristic comprising e.g. a Signal to Interference Ratio (SIR) indication, a Signal to Noise Ratio (SNR) indication and/or an angle of arrival estimate for an interferer. In the system, the audio environment characteristic is a characteristic which is indicative of a performance gain of a binaural processing of at least one of the left or right hearing aid relative to a monaural operation of the hearing aid.
Thus, the binaural controller 117 can specifically reduce the data rate of the exchanged audio data for the binaural operation if the audio environment characteristic has a value(s) that is indicative of the benefit of using binaural operation not being sufficiently high.
For example, in some embodiments, the audio exchange between the left and right hearing aids may be completely switched off when the audio environment characteristic has values that correspond to an estimated benefit of the binaural processing being below a given value. Thus, as a relatively low complexity example, the binaural controller 117 may evaluate if the audio environment characteristic meets a predetermined criterion (e.g. that the values of the parameters comprised in the audio environment characteristic has acceptable values). If so, the binaural controller 117 controls the receive data processor 111 and the data generator 113 to exchange audio data with the right hearing aid. Furthermore, as the audio processor 105 receives audio data from the right hearing aid it proceeds to include this and to perform a binaural processing.
However, if the audio environment characteristic does not meet the criterion, the binaural controller 117 controls the receive data processor 111 and the data generator 113 to not exchange any audio data. Thus, the computational resource (of both the left and right hearing aid) is reduced (as no receive operation, transmit operation or binaural processing is performed). Furthermore, the power consumption (of both hearing aids) is substantially reduced, partly due to the computational resource reduction and partly due to the reduced transmit power resource usage.
The approach may allow improved performance and may in particular provide an improved trade-off between power consumption/ battery life and audio quality/ hearing assistance. Specifically, the battery life may be substantially increased while maintaining acceptable or even negligible quality degradation. It will be appreciated that in other embodiments, a more flexible control of the data rate of the audio data exchange may be implemented. For example, the data rate may be given as a given function of the audio environment characteristic.
Furthermore, it will be appreciated that any suitable method of controlling the data rate may be used. For example, if the audio signals are audio encoded in accordance with an audio encoder standard (such as e.g. MPEG 2), the encoding process may be adjusted to provide the desired data rate (e.g. the encoded audio quality may depend on the audio environment characteristic). As another example, the data rate may be controlled by characteristics or parameters of the transmitted audio signals being flexibly adjusted. For example, only low frequency signals may be transmitted with the cut-off frequency of the low pass filtering of the microphone signals being determined as a function of one or more values of the audio environment characteristic.
In the specific embodiment, the binaural controller 117 may control both the transmission of audio data from the first hearing aid to the second hearing aid as well as the transmission of audio data from the second hearing aid to the first hearing aid. However, it will be appreciated that in other embodiments, the binaural controller 117 may control only data transmissions in one direction. It will also be appreciated that the binaural controller 117 may control the data transmissions in the two different directions differently or asymmetrically. For example, if a specific criterion is met, the binaural controller 117 may terminate audio data from the left to the right hearing aid while allowing audio data transmissions from the right to the left hearing aid.
The binaural controller 117 may for example control transmissions from the right hearing aid to the left hearing aid by communicating control data to the right hearing aid using the transmitter 115. For example, if the binaural controller 117 detects that the criterion for using binaural operation at the left hearing aid is not met, it may transmit a control signal to the right hearing aid in response to which the right hearing aid ceases transmissions of audio data.
In the system where a simple binary on/off switching of binaural operation is used, the transmission of signals from one hearing aid to the other is only performed when the additional benefit offered by a binaural speech enhancement system compared to a multi- microphone monaural system is sufficiently high.
Specifically, based on the audio environment characteristic, the binaural controller 117 may identify situations where the additional benefit offered by a binaural system over a monaural system is high and situations where the improvements are only marginal. Transmission of audio data and thus binaural operation may then be allowed only when the expected benefits are high with monaural operation being used otherwise. Thus, as signals are only exchanged when the resulting benefits are sufficiently significant, an increased battery life is achieved without a significant quality reduction. In the specific example, the data rate is controlled by detecting specific values of parameters of the audio environment characteristic for which a specific data reduction is applied, and specifically specific parameter values for which binaural operation and audio data exchange is completely switched off. In the following, an analysis of the operation and performance gains of binaural processing/ operation is provided and specific examples of the data rate control by the binaural controller 117 are provided on the basis of the analysis.
Signal Model
A frequency domain model is assumed. It is assumed that there exists a desired source S(ω) with power spectral density (PSD) E{5'(ω)5't(ω)} = Φ,(ω) , and an interfering source /(ω) with PSD E{/(ω)/t(ω)} = Φ;(ω) , where f indicates complex conjugate transpose.
The signal observed at the kth microphone on the left hearing aid can be written as Xk(ω) = HL k(ω)S(ω) + Gk(ω)I(ω) + UL k(ω) + Vk(ω), k = \...N, (1)
where Hk((ύ) and Gk((ύ) are the transfer functions between the kth microphone on the left hearing aid and the desired and interfering sources respectively, £/*(ω) and Vk((ύ) correspond to uncorrelated (e.g., sensor) noise and ambient diffuse noise, respectively, at the kth microphone on the left hearing aid, and N is the number of microphones on the left hearing aid.
It is assumed that E{C/*(ω)C/f (ω)} = δ(£ - /)ΦH(ω)V£ . For the ambient noise, which is assumed to be diffuse, one has
Figure imgf000015_0001
= Φv(ω)sinc(ω<i \ k - l \ Ic)Mk , where sinc(x) = sin(x)/x , d is the distance between two adjacent microphones and c is the speed of sound in air. Further, it is assumed that S((o) , /(ω) and t/(ω) are pair wise independent.
A similar right ear model can be written as XR k(ω) = HR k(ω)S(ω) + GR k(ω)I(ω) + UR(ω) + Vk(ω), k = \...N, (2)
where the relevant terms are defined analogously to the left ear. The left ear quantities are defined as
nL(ω) = [Hl(ω),HL 2(ω),...,H?(ω)]τ ,
Gx(CO) = [G|(ω),Gi 2(ω),..., Gf(ω)f ,
Figure imgf000015_0002
,
U^OO) = [Ul(ω),UL 2(ω),...,U?(ω)]τ , and
YL(ω) = [Vl(ω),V2(ω),...,VL N(ω)f .
The right ear quantities HΛ(ω) , GΛ(ω) , XR(ω) , UΛ(ω) , and VΛ(ω) are defined similarly.
Finally, the binaural quantities are defined as
Figure imgf000015_0003
, G(CO) = [G^ (CO) G^ (co)f ,
Figure imgf000016_0001
U(ω) = [Ui(OO) U£(ω)f and
V(ω) = [Vj(ω)Vj(ω)f .
Then, the left ear, right ear, and binaural signal model in vector notation can be written as
Xz (ω) = Hz ((D)S(OO) + Gz (oo)/(oo) + Uz (ω) + Vz (ω) XR(ω) = UR(ω)S(ω) + GR(ω)I(ω) + UR(ω) + \R(ω) (3) X(ω) = H(OO)S(OO) + G(ω)/(ω) + U(co) + V(oo).
Head Shadow Model
Based on the spherical head shadow model described in O. Duda and W. L. Martens, "Range dependence of the response of a spherical head model," J. Acoust. Soc.
Amer., vol. 104, no. 5, pp. 3048-3058, Nov. 1998, the transfer functions H(ω) and G(ω) are determined. The transfer functions only represent the effect of head shadow, and not the effect of room reverberation. Thus the following analysis is specifically relevant in substantially anechoic environments. Fig. 2 illustrates an example of a binaural hearing aid setup with three microphones on each ear. The example will be used to describe the model.
Firstly, define the origin to be the center of the sphere (corresponding to the head). Let a be the radius of the sphere, and r be the distance between the origin and the sound source, and define p = rla . Let θ denote the angle between a ray from the origin to the sound source and a ray from the origin to the point of observation on the surface of the sphere. The Head Related Transfer Function (HRTF) corresponding to the angle of incidence θ is then given by
77(p ,ω,θ) = -^-e CΨ, (4) ωα with hm(ωpa/c)
Ψ(p,co,θ) = £(2m + l)Pffl(cosθ) (5) m=0 hm(ωa/c) '
where Pm is the Legendre polynomial of degree m, hm is the spherical Hankel function of order m , and hm is the derivative of hm w.r.t its argument. Let θ^ denote the angle between the vertical y-axis and a ray from the origin to the desired source. Let θ; be defined similarly for the interfering source. The first microphone on the left and right ears are assumed to be located at 5π/9 and - 5π/9 respectively. It is assumed that the microphones are located on the surface of the sphere, and let d denote the length of the arc between two adjacent microphones on a single hearing aid. This yields:
HL k(ω) = H(p,ω,θs + 5π/9 + (k - \)δθ )
(P)
HR k(ω) = H(p,ω,θ, -5π/9 - (£ - l)δθ ), k = \... N,
where δ^, = dla is the angle subtended by the arc between two adjacent microphones. Similarly the transfer functions corresponding to the interferer are given by
GL k(ω) = H(p,ω,θ! + 5π/9 + (£ - l)δθ )
GR k(ω) = H(p,ω,θ! - 5π/9 - (^ - l)δθ ), k = \... N,
Multi Channel Wiener Filter
The performance of both the monaural and binaural operation will be evaluated for the example of a Multi-channel Wiener Filter (MWF) being used. An MWF is particularly suitable as it minimizes the mean squared error between the desired and estimated signal and thus serves as the theoretical optimum in terms of SNR improvement. The problem can be looked at from the perspective of the left hearing aid and one wishes to obtain a Minimum Mean Squared Error (MMSE) estimate of the desired signal observed at the first microphone of the left ear device, i/}(ω)S(ω) . The monaural MWF is given by
W^(ω) = E(Hl (ω)5(ω)X[(ω)} E(X, (ω)Xl(ω)}-1
Figure imgf000017_0001
where
Φw = Φ,Hi(ω)H[(ω) + Φ!Gi(ω)Gl(ω) + ΦU\N + Φ^fω), (9) IN is the identity matrix of dimension N , and the (i,j)th entry of TM(ω) = E{YL (co) V^ (ω)} is given by
TM'J (ω) =sinc(ωd\i-j\/c) l≤iJ≤N. (10)
The binaural MWF is given by
W5(ω) = E{H^(ω)5'(ω)Xt(ω)}E{X(ω)Xt(ω)}"1
= Φ^(ω)Hτ(ω)Φ; -1 (H)
where
Φx = Φ,H(ω)Ht(ω) + Φ!G(ω)Gt(ω) + ΦHI, + ΦvrB(co), (12)
I2N is the identity matrix of dimension 2N , and the (i,j)Λ entry of F5(CO)E(V(CO)V1XcO)) is given by
sinc(coJ \i-j\lc) l≤iJ≤N ovN≤i,j≤2N,
H(ω) = (13) sinc(ω(2α) \i- j\ Ic) otherwise.
It is assumed in (13) that d = 2a so that the distance between any pair of microphones on the left and right hearing aids can be assumed to be 2a . The corresponding mean squared error (MSE) can be written as
Figure imgf000018_0001
Using the expression for the MSE given in (14), one can compute the improvement in the signal-to-interference-plus-noise ratio (SINR) in the monaural and binaural cases as
Figure imgf000019_0001
where 101og10 — pj — is the input SINR (before processing) at the first
GL ι \z Φ1 + Φu + Φv microphone on the left hearing aid.
Based on the derived improvement measures for the SINR, the benefit at the left ear due to monaural and binaural processing as a function of the location of the interferer, the number of interferers, the signal-to-interference noise ratio (SIR), and the signal-to-noise ratio (SNR) can be assessed. In additional the impact of the head shadow effect on the performance of the binaural system can be considered.
The SIR and SNR are defined as lOtogJ — and 10tog10 — ,
respectively.
In the following specific performance measures will be illustrated for typical parameter values. Specifically, the level of the uncorrelated sensor noise is set to - 40 dB (i.e., Φu = I"4). Also, The other relevant parameters are a = 0.0875 m, d = 0.008 m, N = 2 , and c = 343 m/s. In the example, a desired source is considered to be located straight ahead of the user when the hearing aid arrangement is in use (corresponding to 0°). For this situation and for different locations of the interferer, Fig. 3 illustrates M and B for four different frequencies 2, 4, 6, and 8 kHz corresponding to an input SIR of 0 dB and input SNR of 30 dB. Both the desired and interfering sources are in the example located at a distance of r = 1 -^ m. Thus, the example illustrates the improvement in SINR after monaural (dotted) and binaural (solid) processing for SIR = 0 dB and SNR = 30 dB.
It can be seen from Fig. 3 that for all frequencies, the differences between the monaural and binaural systems are most pronounced for interferers located approx. in the angle of arrival interval of [-60°, 60°]. This is likely to be caused by the main lobe generated for the small microphone array in the monaural case being quite broad whereas the larger microphone spacing in the binaural setup enables better separation of closely located desired and interfering sources as a narrower beam can be created. At low frequencies, the monaural array is generally not able to perform as well as the binaural processing due to the smaller effective microphone array and accordingly the benefit due to the binaural systems is larger.
Fig. 4 illustrates M and B averaged over all frequencies.
Thus, in the system, the binaural processing may be made dependent on an estimated angle of arrival of an interferer. For example, if the estimated angle of arrival falls within a given angle interval including the angle of the desired signal (which is typically, or may be assumed to be, straight ahead of the user when in user (0°). For example, binaural processing may be used if the estimate falls within the interval of [-60°, 60°]. Thus, in the example, the binaural audio data exchange may be increased if the estimate falls within the given interval and may be reduced if it is outside the interval. It will be appreciated that any suitable method or algorithm of estimating the angle of arrival of an interferer may be used and that several different approaches will be known by the person skilled in the art.
Initially, a situation was considered wherein only a single interferer is present. In a binaural system with more than one microphone at each ear, it is possible to cancel more than one interferer. In the following an example with two interferers will be considered.
In a scenario wherein two interferers are simultaneously active, a four- microphone binaural system has a clear advantage over a two -microphone monaural system.
Specifically, experiments have shown that the additional improvement B m provided by a binaural system is significant and that the binaural system provides good performance in most regions where the monaural system performs relatively poorly.
However, the binaural system offers fewer benefits in some scenarios. For example, when both interferers are co-located, the binaural operation tends not to provide a significant additional benefit. However, this corresponds to a scenario with only a single interferer where the monaural system performs relatively well and the benefit of the binaural processing is relatively limited except when the interferers are located within the interval [- 60°, 60°] as previously described for the single interferer. Another example is when both interferers are located very close to the desired source. In this case, the binaural array is typically unable to place two spatial nulls close to the desired source and therefore cannot sufficiently attenuate the interferers.
Another example is when the interferers are located around 180°. In this example, the monaural system is able to suppress a single interferer relatively well. However, due to the front-back ambiguity in a broadside array, the binaural system is unable to sufficiently suppress an interferer located around 180° when the desired source is active at 0°.
Thus, in the system, the binaural processing may be made dependent on a number of interferers and may in particular be dependent on estimated angles of arrival for a plurality of interferers. For example, if two interferers are detected with estimated angle of arrivals that differ substantially from each other (i.e. by more than a suitable threshold) binaural processing may be switched on.
In the system, the binaural audio data exchange may furthermore be controlled in response to the SIR and/or SNR values experienced in the audio environment. For example, at high SIR values and for an interferer located at around 30°, the additional benefit of binaural processing tends to reduce to the 3 dB gain resulting from the reduction of uncorrelated noise due to the doubling of microphones.
In an example wherein the interferer is located at 120°, the monaural system is able to provide a significant improvement as the SNR increases. Since the monaural system already provides good performance, the additional benefit due to the binaural processing is not as high as when the interferer is located at 30°.
Fig. 5 illustrates M and B for four different frequencies 2, 4, 6, and 8 kHz corresponding to an input SIR of 0 dB and input SNR of 20 dB and Fig. 6 illustrates M and
B for four different frequencies 2, 4, 6, and 8 kHz corresponding to an input SIR of 0 dB and input SNR of 0 dB. As can be seen, there is a substantial SNR dependency of the performance gain from binaural processing.
Thus, in the system, the binaural processing may be made dependent on the SIR and/or the SNR. For example, the binaural audio data exchange may only be performed when the SIR is below a given threshold and the SNR is above a given threshold. The binaural audio data exchange may in some embodiments/ scenarios be controlled in consideration of the head shadow effect.
Specifically, to illustrate the effect of head shadow on the performance of the binaural system, results obtained using the head shadow model are compared to those obtained without applying the model. The latter case corresponds to the four microphone array mounted in free space, and the microphone signals differ from each other just by delays.
Specifically, the improvement in SINR at the left ear is considered. FIG. 7 illustrates the SINR improvement of the binaural processing with the head shadow model (dotted line) and without the head shadow model (solid line) for four different frequencies 2, 4, 6, and 8 kHz corresponding to an input SIR of 0 dB and input SNR of 30 dB. As can be seen from FIG. 7, the improvement with the free mounted array is symmetric with respect to interferer location whereas the head mounted array results in better performance when the interferer is located in the left half plane.
For interferers located in the left half plane, the input SINR is low at the left ear and higher at the right ear due to the attenuation provided by the head. In this case, the binaural system is able to benefit from the higher SINR signal observed at the right ear. The free mounted array does not have this advantage as signals at both ears have the same input SINR. This effect is more pronounced at higher frequencies. As the attenuation provided by the head (resulting in inter-aural level differences) is higher at high frequencies, the difference between the head and free mounted arrays is also higher at the high frequencies. For interferences located in the right half plane, the left ear already enjoys a high input SINR and there is not much added benefit due to the availability of the lower SINR right ear signal.
It should be noted that FIG. 7 shows the improvement in SINR due to the binaural processing, which is asymmetric with respect to interferer location in the case of the head mounted array (as only the impact on the left hearing aid is considered). The total output SINR after processing is however symmetric. A second effect especially at high frequencies is that the head mounted array suffers less from spatial aliasing compared to the free-mounted array. This is evident from the sharp nulls present in the front half plane in the free-mounted case. These nulls are less pronounced for the head mounted array.
Thus, in some embodiments, the binaural controller 117 may reduce a data rate from the right earphone to the left earphone if the angle of arrival is in an angle interval corresponding to a head shadow for the left earphone when in use by a user (i.e. when the hearing aids are worn on the left and right ears). In particular, when an interferer is located in the interval from [0°, -60°] there is not much added benefit at the left ear due to a binaural processing, and transmission of data from the right to left ear may be avoided. It will be appreciated that the symmetric situation will typically apply to the right hearing aid.
In the system of Fig. 1, the data rate of the audio data exchange is made dependent on the benefit due to binaural beam forming as assessed by the audio environment characteristic. Specifically, as illustrated the data rate may be varied depending on interferer location, frequency, angle of arrival, SNR and SINR. The resulting transmission scheme may conserve power and bandwidth and may specifically increase battery life.
It will be appreciated that many different transmission schemes modifying the data rate may be envisaged. In the following, two specific transmission schemes are presented. In the first method, which can be viewed as a hard decision method, transmission is allowed only when the audio environment characteristic meets a criterion that indicates that the benefits of the binaural processing are high, thus resulting in power savings in other situations as no signal needs to be transmitted.
The second approach is a soft decision scheme where an appropriate data-rate is selected for the audio data exchange resulting in an efficient use of the available bandwidth. The selection of the data rate takes into account the additional benefit provided by the binaural processing.
It will be appreciated that the two schemes may be combined; e.g. first, a hard decision may be made on whether or not to transmit, and in cases when transmission is performed, an appropriate bit-rate may then be calculated by the second method.
As previously shown, the additional benefit provided by the binaural processing depends on a number of parameters. In the hard decision scheme, binaural audio data is exchanged between the two hearing aids only when the different parameters of the audio environment characteristic are within a predetermined range. The exact parameter ranges may depend on the specific characteristics and preferences of the individual embodiment.
However, in many embodiments, an advantageous criterion may comprise a requirement that the SIR indication SIR is below a first threshold; a requirement that the SNR indication is above a second threshold; and a requirement that the angle of arrival estimate is within an angle interval.
As a specific example, at low SIRs (e.g., below 15 dB) and high SNRs (e.g., above 15 dB) audio data may be exchanged between the left and right hearing aids. The gain in performance resulting from a binaural system is only marginal at high SIRs and low SNRs and thus by restricting transmission to the identified range, power consumption can be minimized.
Furthermore, if only one localized interferer is present, transmission is beneficial when the interferer is located within e.g. [-60°, 60°]. Thus, the binaural audio data exchange may only be performed for interferers in this range.
If two localized interferers are present, binaural operation is typically beneficial when at least one interferer is located within [60°, 300°]. If both interferers are located within a 60° neighborhood of 0° or 180°], the benefit is only marginal. Thus, the criterion for audio data exchange may be set to reflect this. As an example of a soft decision approach, the data rate may be determined by a rate distortion algorithm. Specifically, the binaural beam forming problem can be seen as a remote Wyner-Ziv due to the fact that the encoder does not have direct access to the source but only to a noisy version of the source. The right hearing aid needs to encode ^05J such that an MMSE estimate of £vωωJ [s obtained at the left hearing aid using the side information L^ω) . Assuming that the sources are band limited and can be described as zero-mean jointly Gaussian processes, the corresponding parametric rate-distortion formula is given by
Figure imgf000024_0001
D(λ) = -L r (ξ5(ω) + min(λ,ξ(ω))yω,
J- (16)
where the bit-rate R is expressed in bits per second and
ξ(ω) = ξM(ω) -ξB(ω)
0 < λ ≤ esssupω ξ(ω). ^
The quantity ^B ^0 ^ represents the distortion incurred at R = °° , and ^M ^ω' represents the distortion incurred at R = 0 (monaural). The difference ^M \ω) ~ SB \ω) cane reduced by exchanging signals at a positive rate R . Thus, as an example, the above equations may be used in a rate distortion algorithm to determine the rate allocation across different frequency bands. For example, a certain desired SINR improvement may be defined and the data rate of the audio data exchange may be adjusted accordingly. It will be appreciated that in some embodiments, the frequency dependency of the binaural processing gain may be taken into account when controlling the data rate. For example, the frequency bandwidth for the audio signals exchanged by the audio data may be modified in response to the audio environment characteristic.
For example, for most scenarios, the binaural processing gain is higher for lower frequencies than for higher frequencies. Accordingly, the signal bandwidth may be reduced for scenarios wherein the benefit at higher frequencies is negligible whereas the benefit at lower frequencies is still significant. In particular, the frequency bandwidth represented by the exchanged audio data may be reduced if the angle of arrival estimate of a single interfere is within a given angle interval wherein the benefit at higher frequencies is less significant.
For example, from the previous performance gain analysis, full bandwidth microphone signals may be exchanged between the hearing aids if the estimated angle of arrival is within [-60°, 60°] . However, for interferers located outside [-60°, 60°] only the low frequency content (e.g., up to 2 kHz) may be transmitted. This, in this case binaural processing is only performed at lower frequencies whereas at higher frequencies, the monaural system already provides good performance.
Thus, as the data rate required to represent the signal can be reduced for lower bandwidths (e.g. a reduced sample rate may be used), a substantially reduced data rate for the wireless transmission may be achieved and thus reduced power consumption can be achieved.
Fig. 8 shows an example of an implementation wherein the binaural processing is a binaural beam forming that uses one or more low pass filtered audio signals communicated from the other hearing aid. FIG. 8 specifically shows the left hearing aid and the following description will focus on this example. However, it will be appreciated that the right hearing aid may be functionally identical to the left hearing aid and that the focus on the left ear is merely for clarity and brevity of the description. The hearing aid of FIG. 8 specifically corresponds to the hearing aid of FIG. 1 with additional functionality which will be described in the following. In the example of Fig. 8, the audio processor 105 is a binaural beam former which performs a binaural beam forming using audio signals derived from the microphones of both the left hearing aid and the right hearing aid. Thus, the binaural beam forming uses both the locally generated microphone signals and the microphone signals received by the audio data exchange, i.e. transmitted from the right hearing aid to the left hearing aid.
However, in the example, the audio signal received from the right hearing aid is not a full bandwidth signal but rather is a signal that has first been low pass filtered with a suitable cut-off frequency, such as e.g. 2 kHz. Thus, in the example only the low frequency part of the microphone signal from the right hearing aid is transmitted to the left hearing aid thereby resulting in a reduced data rate of the audio data exchange and thus a reduced resource usage.
In the example, the first and second microphone signals are furthermore low pass filtered in a low pass filter 801 prior to being fed to the audio processor 105 for binaural beam forming. In the example, the low pass filter characteristics of the low pass filter 801 is selected to match the characteristics of the low pass filtering performed at the right hearing aid. Specifically, the same filter and/or cut-off frequency may be used.
Thus, the binaural beam forming is based only on lower frequency components of the microphones signals. Although, this may not provide the same quality beam forming as a beam forming based on full bandwidth signals, the degradation is often acceptable in return for the reduced power consumption and the approach may accordingly provide increased user satisfaction in many scenarios.
In some embodiments, the beam formed low frequency output signal generated by the audio processor 105 may be used directly as an audio output signal of the hearing aid. However, in many embodiments, the beam formed low frequency output signal is combined with high frequency content of the locally generated microphones signals. For example, the first and second microphone signals may be high pass filtered with a cut-off frequency corresponding to the low pass filter cut-off frequency. The high pass filtered signal of one or more of the left ear microphone signals may e.g. be added directly to the beam formed low frequency output signal to generate the hearing aid output signal. In the specific example, the local microphone signals are monaurally beam formed before being combined with the beam formed low frequency output signal from the binaural beam former. Specifically, the first and second microphone signals are fed to a high pass filter 803 which performs a high pass filtering that corresponds to (is complementary to) the low pass filtering performed by the low pass filter 801. The high pass filter 803 is coupled to a monaural beam former 805 which receives the high pass filtered microphone signals. The monaural beam former 805 then performs a monaural beam forming on these signals to generate a beam formed high frequency output signal.
The audio processor 105 and the monaural beam former 805 are coupled to a combiner 807 which is further coupled to the audio transducer 107. The combiner 807 combines the binaurally beam formed low frequency output signal and the monaurally beam formed high frequency output signal to generate the hearing aid output signal fed to the sound transducer 107. The combination may for example be a simple addition.
This approach may provide improved performance and may in particular provide improved beam forming. The approach may allow high performance while substantially reducing the power consumption of the hearing aids.
In the specific example, the left and right hearing aids have identical functionality. Accordingly, the hearing aid of FIG. 8 also comprises a low pass filter 809 for filtering the locally generated microphone signals prior to their transmission to the right hearing aid. It will be appreciated that in some embodiments, the low pass filtering may be symmetric such that the transmitted signals may be the output signals from the low pass filter 801. However, it will also be appreciated that in other embodiments, the low pass filtering may e.g. be dynamically varied asymmetrically between the first and second hearing aid (e.g. depending on the location of a dominant interferer). It will be appreciated that in many embodiments, the data rate of the audio data exchange may be adapted by adapting a characteristic of the low pass filtering. As a simple example, the cut-off frequency of the low pass filtering may be adjusted in response to angle of arrival, SIR and/or SNR measures. As a simple example, the low pass filtering may simply be switched on and off depending on whether the audio environment characteristic meets a suitable criterion.
Fig. 9 illustrates an example of performance gains from binaural and monaural processing. Specifically, FIG. 9 illustrates the improvement in SINR (Signal-To-Interference- Plus-Noise Ratio) at the left hearing aid for different locations of an interfering source for three scenarios. The dashed line corresponds to the scenario when the entire frequency content is transmitted from the right hearing aid (cut-off frequency of 8 kHz). The dotted line corresponds to full monaural processing, when no signal is transmitted from the right hearing aid (corresponding to a cut-off frequency of 0 kHz). In this scenario, only the microphone signals from the left hearing aid are processed. The solid line corresponds to a particular scenario using the approach described in relation to FIG. 8. In the example, the low frequency content of the right hearing aid microphone signals up to 2 kHz are transmitted from the right hearing aid, the desired source is assumed to be located at 0 deg., the input SIR (signal-to-interference ratio) is 0 dB and the input SNR is 30 dB. The signals are sampled at 16 kHz. Fig. 10 illustrates the relative performance for the same scenario but with a cut-off frequency of 4 kHz.
As can be seen, efficient performance can be achieved with transmission of reduced bandwidth signals and thus with reduced power consumption. In particular an improved flexibility in the trade-off between power consumption and quality can be achieved. E.g. the cut-off frequency can be adjusted in response to e.g. the audio environment characteristic or e.g. in response to a current remaining battery charge.
It will be appreciated that the above description for clarity has described embodiments of the invention with reference to different functional units and processors. However, it will be apparent that any suitable distribution of functionality between different functional units or processors may be used without detracting from the invention. For example, functionality illustrated to be performed by separate processors or controllers may be performed by the same processor or controllers. Hence, references to specific functional units are only to be seen as references to suitable means for providing the described functionality rather than indicative of a strict logical or physical structure or organization. The invention can be implemented in any suitable form including hardware, software, firmware or any combination of these. The invention may optionally be implemented at least partly as computer software running on one or more data processors and/or digital signal processors. The elements and components of an embodiment of the invention may be physically, functionally and logically implemented in any suitable way. Indeed the functionality may be implemented in a single unit, in a plurality of units or as part of other functional units. As such, the invention may be implemented in a single unit or may be physically and functionally distributed between different units and processors.
Although the present invention has been described in connection with some embodiments, it is not intended to be limited to the specific form set forth herein. Rather, the scope of the present invention is limited only by the accompanying claims. Additionally, although a feature may appear to be described in connection with particular embodiments, one skilled in the art would recognize that various features of the described embodiments may be combined in accordance with the invention. In the claims, the term comprising does not exclude the presence of other elements or steps. Furthermore, although individually listed, a plurality of means, elements or method steps may be implemented by e.g. a single unit or processor. Additionally, although individual features may be included in different claims, these may possibly be advantageously combined, and the inclusion in different claims does not imply that a combination of features is not feasible and/or advantageous. Also the inclusion of a feature in one category of claims does not imply a limitation to this category but rather indicates that the feature is equally applicable to other claim categories as appropriate. Furthermore, the order of features in the claims do not imply any specific order in which the features must be worked and in particular the order of individual steps in a method claim does not imply that the steps must be performed in this order. Rather, the steps may be performed in any suitable order. In addition, singular references do not exclude a plurality. Thus references to "a", "an", "first", "second" etc do not preclude a plurality. Reference signs in the claims are provided merely as a clarifying example shall not be construed as limiting the scope of the claims in any way.

Claims

CLAIMS:
1. An earphone arrangement comprising a first and second earphone arranged to operate in a binaural arrangement, the first earphone comprising: determining means (119) for determining an audio environment characteristic in response to a signal from at least one microphone (101, 103) of the first earphone; and control means (117) for controlling a data rate of an audio data exchange between the first and second earphone in response to the audio environment characteristic, the audio data exchange supporting a binaural processing of the earphone arrangement.
2. The earphone arrangement of claim 1 wherein the control means (117) is arranged to reduce the data rate if the audio environment characteristic does not meet a criterion.
3. The earphone arrangement of claim 2 wherein the audio environment characteristic comprises a Signal to Interference Ratio, SIR, indication, a Signal to Noise Ratio, SNR, indication and an angle of arrival estimate for an interferer; and the criterion comprises: a requirement that the SIR indication is below a first threshold; a requirement that the SNR indication is above a second threshold; and a requirement that the angle of arrival estimate is within an angle interval.
4. The earphone arrangement of claim 1 wherein the audio environment characteristic is indicative of a performance gain of the binaural processing of the earphone arrangement relative to a monaural operation of the earphone arrangement.
5. The earphone arrangement of claim 1 wherein the audio environment characteristic comprises a Signal to Interference Ratio, SIR, indication.
6. The earphone arrangement of claim 1 wherein the audio environment characteristic comprises a Signal to Noise Ratio, SNR, indication.
7. The earphone arrangement of claim 1 wherein the audio environment characteristic comprises an angle of arrival estimate for an interferer.
8. The earphone arrangement of claim 1 wherein the control means (117) is arranged to set a frequency bandwidth for audio signals exchanged by the audio data in response to the audio environment characteristic.
9. The earphone arrangement of claim 1 wherein at least one earphone of the first and second earphones comprises a binaural beam former for performing a binaural beam forming using at least a first signal from a first microphone (101, 103) of the at least one earphone and at least a second signal from a second microphone (101, 103) of an other earphone of the first and second earphones, the second signal being communicated from the other earphone to the at least one earphone by the audio data exchange.
10. The earphone arrangement of claim 9 wherein the other earphone is arranged to low pass filter the second signal prior to communication to the at least one earphone.
11. The earphone arrangement of claim 9 wherein the at least one earphone is arranged to low pass filter the first signal prior to performing the binaural beam forming.
12. The earphone arrangement of claim 9 wherein the at least one earphone further comprises a monaural beam former arranged to perform a monaural beam forming based only on signals from microphones of the at least one earphone; and means for combining an output signal of the binaural beam former and an output signal of the monaural beam former to generate an output signal of the at least one earphone.
13. The earphone arrangement of claim 1 wherein the audio data exchange comprises a first audio data exchange from the first earphone to the second earphone and a second audio data exchange from the second earphone to the first earphone; and the control means (117) is arranged to control the data rate differently in response to the audio environment characteristic for the first audio data exchange and the second audio exchange.
14. An earphone of an earphone arrangement comprising the earphone and a second earphone arranged to operate in a binaural arrangement, the earphone comprising: determining means (119) for determining an audio environment characteristic in response to a signal from at least one microphone of the earphone; and control means (117) for controlling a data rate of an audio data exchange between the earphone and the second earphone in response to the audio environment characteristic, the audio data exchange supporting a binaural processing of the earphone arrangement.
15. A method of operation for an earphone arrangement comprising a first and second earphone arranged to operate in a binaural arrangement, the method comprising the first earphone performing the steps of: determining an audio environment characteristic in response to a signal from at least one microphone of the first earphone; and controlling a data rate of an audio data exchange between the first and second earphone in response to the audio environment characteristic, the audio data exchange supporting a binaural processing of the earphone arrangement.
PCT/IB2009/052511 2008-06-17 2009-06-12 Earphone arrangement and method of operation therefor WO2009153718A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP08158411 2008-06-17
EP08158411.2 2008-06-17

Publications (1)

Publication Number Publication Date
WO2009153718A1 true WO2009153718A1 (en) 2009-12-23

Family

ID=41077641

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2009/052511 WO2009153718A1 (en) 2008-06-17 2009-06-12 Earphone arrangement and method of operation therefor

Country Status (1)

Country Link
WO (1) WO2009153718A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2592850A1 (en) * 2011-11-08 2013-05-15 Siemens Medical Instruments Pte. Ltd. Automatic activating and deactivating of a binaural hearing system
US20130308804A1 (en) * 2012-05-15 2013-11-21 Cochlear Limited Adaptive Data Rate for a Bilateral Hearing Prosthesis System
WO2015120475A1 (en) * 2014-02-10 2015-08-13 Bose Corporation Conversation assistance system
EP3029956A1 (en) * 2014-12-05 2016-06-08 GN Resound A/S Hearing device with dynamic mirror service and related method
CN105681992A (en) * 2014-12-05 2016-06-15 Gn瑞声达 A/S Hearing device with dynamic mirror service and related method
EP3410744B1 (en) 2015-07-08 2020-09-23 Oticon A/s Method for selecting transmission direction in a binaural hearing aid
WO2020190317A1 (en) * 2019-03-15 2020-09-24 Advanced Bionics Ag Systems and methods for frequency-specific localization and speech comprehension enhancement
CN111713119A (en) * 2018-02-23 2020-09-25 索尼公司 Headset, headset system and method in headset system
EP3993446A1 (en) * 2020-10-30 2022-05-04 Sonova AG Systems and methods for data exchange between binaural hearing devices

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006105664A1 (en) * 2005-04-07 2006-10-12 Gennum Corporation Binaural hearing instrument systems and methods
WO2008006401A1 (en) * 2006-07-12 2008-01-17 Phonak Ag Methods for generating audible signals in binaural hearing devices

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006105664A1 (en) * 2005-04-07 2006-10-12 Gennum Corporation Binaural hearing instrument systems and methods
WO2008006401A1 (en) * 2006-07-12 2008-01-17 Phonak Ag Methods for generating audible signals in binaural hearing devices

Non-Patent Citations (9)

* Cited by examiner, † Cited by third party
Title
CHISAKI Y ET AL: "On bit rate reduction of inter-channel communication for a binaural hearing assistance system", IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS,COMMUNICATIONS AND COMPUTER SCIENCES, ENGINEERING SCIENCES SOCIETY, TOKYO, JP, vol. E91A, no. 8, 1 August 2008 (2008-08-01), pages 2041 - 2044, XP001515809, ISSN: 0916-8508 *
OLIVIER ROY ET AL: "Rate-Constrained Beamforming for Collaborating Hearing Aids", INFORMATION THEORY, 2006 IEEE INTERNATIONAL SYMPOSIUM ON, IEEE, PI, 1 July 2006 (2006-07-01), pages 2809 - 2813, XP031032732, ISBN: 978-1-4244-0505-3 *
OLIVIER ROY ET AL: "Rate-Constrained Collaborative Noise Reduction for Wireless Hearing Aids", IEEE TRANSACTIONS ON SIGNAL PROCESSING, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 47, no. 2, 1 February 2009 (2009-02-01), pages 645 - 657, XP011238019, ISSN: 1053-587X *
SIMON DOCLO ET AL: "Comparison of Reduced-Bandwidth MWF-Based Noise Reduction Algorithms for Binaural Hearing Aids", APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS, 2007 IEEE WO RKSHOP ON, IEEE, PI, 1 October 2007 (2007-10-01), pages 223 - 226, XP031167117, ISBN: 978-1-4244-1618-9 *
SRINIVASAN S: "Low-bandwidth binaural beamforming", THE INSTITUTION OF ENGINEERING AND TECHNOLOGY. JOURNAL,, vol. 44, no. 22, 23 October 2008 (2008-10-23), pages 1292 - 1294, XP006031952, ISSN: 1350-911X *
SRINIVASAN SRIRAM: "Noise reduction in binaural hearing aids: Analyzing the benefit over monaural systems", JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, vol. 124, no. 6, 11 November 2008 (2008-11-11), pages 353 - 359, XP012120664, ISSN: 0001-4966 *
SRIRAM SRINIVASAN, ALBERTUS C. DEN BRINKER: "Analyzing rate-constrained beamforming schemes in wireless binaural hearing aids", 17TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2009), 24 August 2009 (2009-08-24) - 28 August 2009 (2009-08-28), Glasgow, Scotland, pages 1854 - 1858, XP002547218 *
SRIRAM SRINIVASAN, ASHISH PANDHARIDANDE, KEES JANSE: "Effect of quantization on beamforming in binaural hearing aids", PROCEEDINGS OF THE ICST 3RD INTERNATIONAL CONFERENCE ON BODY AREA NETWORK, 13 March 2008 (2008-03-13), Tempe, Arizona, XP002547216, ISBN: 978-963-9799-17-2, Retrieved from the Internet <URL:http://portal.acm.org/citation.cfm?id=1460271> [retrieved on 20090924] *
SRIRAM SRINIVASAN, ASHISH PANDHARIPANDE, KEES JANSE: "Beamforming under Quantization Errors in Wireless Binaural Hearing Aids", EURASIP JOURNAL ON AUDIO, SPEECH, AND MUSIC PROCESSING, vol. 2008, 2008, XP002547217, Retrieved from the Internet <URL:http://www.hindawi.com/journals/asmp/2008/824797.html> [retrieved on 20090924] *

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2592850A1 (en) * 2011-11-08 2013-05-15 Siemens Medical Instruments Pte. Ltd. Automatic activating and deactivating of a binaural hearing system
US9584914B2 (en) 2011-11-08 2017-02-28 Sivantos Pte. Ltd. Method for automatic activation and deactivation of a binaural hearing system and binaural hearing system
US20130308804A1 (en) * 2012-05-15 2013-11-21 Cochlear Limited Adaptive Data Rate for a Bilateral Hearing Prosthesis System
US9020169B2 (en) * 2012-05-15 2015-04-28 Cochlear Limited Adaptive data rate for a bilateral hearing prosthesis system
US9560451B2 (en) 2014-02-10 2017-01-31 Bose Corporation Conversation assistance system
WO2015120475A1 (en) * 2014-02-10 2015-08-13 Bose Corporation Conversation assistance system
EP3496421A1 (en) * 2014-12-05 2019-06-12 GN Hearing A/S Hearing device with dynamic mirror service and related method
CN105681992A (en) * 2014-12-05 2016-06-15 Gn瑞声达 A/S Hearing device with dynamic mirror service and related method
US9930457B2 (en) 2014-12-05 2018-03-27 Gn Hearing A/S Hearing device with dynamic mirror service and related method
EP3029956A1 (en) * 2014-12-05 2016-06-08 GN Resound A/S Hearing device with dynamic mirror service and related method
CN105681992B (en) * 2014-12-05 2019-10-11 Gn瑞声达 A/S Hearing device and correlation technique with dynamic mirror service
JP2016136719A (en) * 2014-12-05 2016-07-28 ジーエヌ リザウンド エー/エスGn Resound A/S Hearing aid device for performing dynamic mirror service and related method
EP3410744B1 (en) 2015-07-08 2020-09-23 Oticon A/s Method for selecting transmission direction in a binaural hearing aid
US11323803B2 (en) 2018-02-23 2022-05-03 Sony Corporation Earphone, earphone system, and method in earphone system
CN111713119A (en) * 2018-02-23 2020-09-25 索尼公司 Headset, headset system and method in headset system
EP3758389A4 (en) * 2018-02-23 2021-04-07 Sony Corporation Earphone, earphone system, and method employed by earphone system
CN111713119B (en) * 2018-02-23 2022-07-08 索尼公司 Headset, headset system and method in headset system
WO2020190317A1 (en) * 2019-03-15 2020-09-24 Advanced Bionics Ag Systems and methods for frequency-specific localization and speech comprehension enhancement
CN113632503A (en) * 2019-03-15 2021-11-09 领先仿生公司 System and method for frequency-specific localization and speech understanding enhancement
CN113632503B (en) * 2019-03-15 2024-03-08 领先仿生公司 System and method for frequency-specific localization and speech understanding enhancement
EP3993446A1 (en) * 2020-10-30 2022-05-04 Sonova AG Systems and methods for data exchange between binaural hearing devices
US11412332B2 (en) 2020-10-30 2022-08-09 Sonova Ag Systems and methods for data exchange between binaural hearing devices

Similar Documents

Publication Publication Date Title
AU2008207437B2 (en) Method of estimating weighting function of audio signals in a hearing aid
WO2009153718A1 (en) Earphone arrangement and method of operation therefor
CN107071674B (en) Hearing device and hearing system configured to locate a sound source
US8532307B2 (en) Method and system for providing binaural hearing assistance
US9432778B2 (en) Hearing aid with improved localization of a monaural signal source
US20100002886A1 (en) Hearing system and method implementing binaural noise reduction preserving interaural transfer functions
JP2004312754A (en) Binaural signal reinforcement system
JP6783385B2 (en) How the Binaural Hearing Aid System and Binaural Hearing Aid System work
CN108694956B (en) Hearing device with adaptive sub-band beamforming and related methods
US10536785B2 (en) Hearing device and method with intelligent steering
CN111757233A (en) Hearing device or system for evaluating and selecting external audio sources
CN114631331A (en) Binaural hearing system providing beamformed and omnidirectional signal outputs
EP3908010B1 (en) Binaural hearing aid system providing a beamforming signal output and comprising an asymmetric valve state
CN108243381B (en) Hearing device with adaptive binaural auditory guidance and related method
US10051387B2 (en) Hearing device with adaptive processing and related method
US20230034525A1 (en) Spatially differentiated noise reduction for hearing devices
US11653153B2 (en) Binaural hearing system comprising bilateral compression
CN113940097B (en) Bilateral hearing aid system including a time decorrelating beamformer
US10715933B1 (en) Bilateral hearing aid system comprising temporal decorrelation beamformers
JP2022083433A (en) Binaural hearing system comprising bilateral compression
JP2022122270A (en) Binaural hearing device reducing noises of voice in telephone conversation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09766255

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 09766255

Country of ref document: EP

Kind code of ref document: A1