CN108694956B

CN108694956B - Hearing device with adaptive sub-band beamforming and related methods

Info

Publication number: CN108694956B
Application number: CN201810245866.7A
Authority: CN
Inventors: R·德弗里斯; 马长学; A·迪特贝尔纳
Original assignee: GN Hearing AS
Current assignee: GN Hearing AS
Priority date: 2017-03-29
Filing date: 2018-03-23
Publication date: 2023-08-22
Anticipated expiration: 2038-03-23
Also published as: CN108694956A; JP2018186494A

Abstract

A hearing device for a binaural hearing system comprising a hearing device and a contralateral hearing device is disclosed. The hearing instrument comprises: a transceiver module; a microphone for providing first and second microphone input signals; a first beamforming module for providing a first beamformed signal based on the first microphone input signal and the second microphone input signal; a filter bank for filtering the first beamformed signal into a plurality of first sub-band beamformed signals including a first bandpass beamformed signal and for filtering the contralateral beamformed signal into a contralateral bandpass beamformed signal; a second beamforming module comprising an adaptive bandpass beamformer for providing a second bandpass beamformed signal; an adder for providing a beamformed input signal; a processor for providing an electrical output signal based on the beamformed input signal; and a receiver for converting the electrical output signal into an audio output signal.

Description

Hearing device with adaptive sub-band beamforming and related methods

Technical Field

The present disclosure relates to a hearing device with adaptive binaural hearing guidance and a method of operating a hearing device in a binaural hearing system.

Background

In an acoustic environment, it is natural for a normal listener to focus on one speaker while listening to other sound sources. One example of this is a cocktail party or other speaker in other complex acoustic environments. In this regard, acoustic filtering due to head shadow effects and binaural nerve interactions plays an important role in enhancing the speech of the speaker of interest while suppressing other disturbances. In addition, the brain forms another sound image from both ears listening to other sound sources that are suppressed by the binaural beamforming effect.

US2015/0289065A1 relates to a binaural hearing aid system comprising binaural noise reduction. The user may input the position of the target sound source, for example, using a remote controller or a cellular phone, and the noise reduction system operates based on the input position.

When a person wears a hearing aid, the signal from the sound source is spatially filtered through an extra stage (i.e. the hearing aid), especially when the hearing aid applies higher order beamforming techniques to enhance directivity.

Disclosure of Invention

Thus, there is a need for devices and methods for enhancing speech in noisy environments and cocktail venues.

A hearing device for a binaural hearing system comprising a hearing device and a contralateral hearing device is disclosed. The hearing instrument comprises: a transceiver module for communicating with a contralateral hearing device of the binaural hearing system, the transceiver module configured to provide contralateral beamformed signals received from the contralateral hearing device; a microphone set comprising a first microphone for providing a first microphone input signal and a second microphone for providing a second microphone input signal; a first beamforming module connected to the microphone set for providing a first beamformed signal based on the first microphone input signal and the second microphone input signal; a filter bank connected to the first beamforming module and optionally to the transceiver module for filtering the first beamformed signal into a plurality of first sub-band beamformed signals including a first band-pass beamformed signal and optionally for filtering the opposite side beamformed signal into a side band-pass beamformed signal; a second beamforming module connected to the filter bank, the second beamforming module comprising a bandpass beamformer for providing a second bandpass beamformed signal based on the first bandpass beamformed signal and/or the contralateral bandpass beamformed signal; an adder connected to the bandpass beamformer for providing a beamformed input signal based on the second bandpass beamformed signal; a processor for processing the beamformed input signals and providing electrical output signals based on the beamformed input signals; and a receiver for converting the electrical output signal into an audio output signal. The bandpass beamformer of the second beamforming module is optionally an adaptive beamformer.

Also disclosed is a binaural hearing system comprising a hearing device and a contralateral hearing device, wherein the hearing device is a hearing device as disclosed herein. The contralateral hearing device may be a hearing device as disclosed herein.

A method of operating a hearing device in a binaural hearing system comprising a hearing device and a contralateral hearing device is disclosed, the method comprising: obtaining a contralateral beamformed signal from a contralateral hearing device; obtaining a first microphone input signal and a second microphone input signal; providing a first beamformed signal based on the first microphone input signal and the second microphone input signal; filtering the first beamformed signal and optionally filtering the contralateral beamformed signal to provide a first bandpass beamformed signal and a contralateral bandpass beamformed signal; providing a second bandpass beamformed signal based on the first bandpass beamformed signal and/or the contralateral bandpass beamformed signal; providing a beamformed input signal based on the second bandpass beamformed signal; performing a hearing compensation process on the beamformed input signal to provide an electrical output signal; and converting the electrical output signal to an audio output signal. In the method, providing the second bandpass beamformed signal optionally includes applying adaptive beamforming to the first bandpass beamformed signal and the contralateral bandpass beamformed signal.

The present apparatus and method provide an improved binaural auditory guidance strategy (BASS) for integrating acoustic, auditory processing and selective listening mechanisms. The present apparatus and method forms a highly focused directional microphone beam for the speaker of interest and simultaneously forms a reception pattern similar to the omnidirectional microphone characteristics for other speakers on the side.

The present disclosure integrates acoustic filtering, peripheral processing, and a central listening level to provide an improved hearing device solution.

The present disclosure provides optimized beamforming to accommodate both selective/targeted listening and situational awareness.

A hearing device for a binaural hearing system comprising a hearing device and a contralateral hearing device, the hearing device comprising: a transceiver module for communicating with a contralateral hearing device of the binaural hearing system, the transceiver module configured to obtain a contralateral beamformed signal from the contralateral hearing device; a microphone set comprising a first microphone for providing a first microphone input signal and a second microphone for providing a second microphone input signal; a first beamforming module connected to the microphone set for providing a first beamformed signal based on the first microphone input signal and the second microphone input signal; a filter bank connected to the first beamforming module and the transceiver module for filtering the first beamformed signal into a plurality of first sub-band beamformed signals including a first band-pass beamformed signal and for filtering the opposite-side beamformed signal into an opposite-side band-pass beamformed signal; a second beamforming module connected to the filter bank, the second beamforming module comprising a bandpass beamformer for providing a second bandpass beamformed signal based on the first bandpass beamformed signal and the contralateral bandpass beamformed signal; an adder connected to the bandpass beamformer for providing a beamformed input signal based on the second bandpass beamformed signal; a processor for processing the beamformed input signals and providing electrical output signals based on the beamformed input signals; and a receiver for converting the electrical output signal to an audio output signal, wherein the bandpass beamformer of the second beamforming module is an adaptive beamformer. As non-limiting examples, the second band pass beamformed signal may be a low pass beamformed signal and/or a high pass beamformed signal.

Optionally, the band-pass beamformer comprises a band-pass beamforming controller and a first multiplier, wherein the band-pass beamformer is configured to determine a first bandpass coefficient of the first bandpass beamformed signal based on the first bandpass beamformed signal and the opposite-side bandpass beamformed signal, and to apply the first bandpass coefficient in the first multiplier.

Optionally, the bandpass beamformer is configured to determine the first bandpass coefficient of the first bandpass beamformed signal by solving a minimization problem based on the desired power values of the first bandpass beamformed signal and the opposite-side bandpass beamformed signal.

Optionally, the bandpass beamformer is configured to determine the first bandpass coefficients of the first bandpass beamformed signals by solving a minimization problem based on a desired mean square value of the linear combination of the first bandpass beamformed signals and the opposite-side bandpass beamformed signals.

Optionally, the bandpass beamformer comprises a contralateral multiplier, and wherein the bandpass beamforming controller is configured to determine contralateral bandpass coefficients of the contralateral bandpass beamformed signal based on the first bandpass beamformed signal and the contralateral bandpass beamformed signal, and to apply the contralateral bandpass coefficients in the contralateral multiplier.

Optionally, the bandpass beamforming controller is configured to determine the contralateral bandpass coefficients of the contralateral bandpass beamformed signal by solving a minimization problem based on the desired power values of the first bandpass beamformed signal and the contralateral bandpass beamformed signal.

Optionally, the bandpass beamforming controller is configured to determine the contralateral bandpass coefficients of the contralateral bandpass beamformed signal by solving a minimization problem based on a desired mean square value of the linear combination of the first bandpass beamformed signal and the contralateral bandpass beamformed signal.

Optionally, the band-pass beamformer comprises a band-pass equalizer configured to provide the second band-pass beamformed signal based on an equalizer input, wherein the equalizer input is based on the first band-pass beamformed signal and/or the opposite-side band-pass beamformed signal.

Optionally, the second beamforming module comprises a low-pass beamformer for providing a second low-pass beamformed signal based on the first low-pass beamformed signal and further based on the opposite side low-pass beamformed signal, and wherein the summer is connected to the low-pass beamformer for providing a beamformed input signal based on the second low-pass beamformed signal.

Optionally, the second beamforming module comprises a high-pass beamformer for providing a second high-pass beamformed signal based on the first high-pass beamformed signal and further based on the opposite-side high-pass beamformed signal, and wherein the summer is connected to the high-pass beamformer for providing a beamformed input signal based on the second high-pass beamformed signal.

Optionally, the hearing device comprises a beamforming controller connected to the second beamforming module for controlling the second beamforming module, wherein the beamforming controller is configured to apply the second main beamforming scheme in the second beamforming module in a main operation mode of the hearing device and to apply the second auxiliary beamforming scheme in the second beamforming module in an auxiliary operation mode of the hearing device.

Optionally, the first beamforming module is configured to receive the first primary beam forming scheme from the first beamforming controller, and to receive the second primary beam forming scheme from the second beamforming controller, wherein the first primary beam forming scheme is configured to be applied in the first beamforming module in a primary mode of operation of the hearing device and the second primary beam forming scheme is configured to be applied in a secondary mode of operation of the hearing device.

Optionally, the first beamforming module is connected to the transceiver module, and wherein the transceiver module is configured to transmit at least a portion of the first beamformed signal to the contralateral hearing device.

Binaural hearing systems include any of the hearing devices and contralateral hearing devices described herein.

A method of operating a hearing device in a binaural hearing system comprising a hearing device and a contralateral hearing device, the method comprising: obtaining a contralateral beamformed signal from a contralateral hearing device; obtaining a first microphone input signal and a second microphone input signal; providing a first beamformed signal based on the first microphone input signal and the second microphone input signal; filtering the first and contralateral beamformed signals to provide first and contralateral bandpass beamformed signals; providing a second bandpass beamformed signal based on the first bandpass beamformed signal and the contralateral bandpass beamformed signal; providing a beamformed input signal based on the second bandpass beamformed signal; performing a hearing compensation process on the beamformed input signal to provide an electrical output signal; and converting the electrical output signal to an audio output signal; wherein the step of providing the second bandpass beamformed signal comprises applying adaptive beamforming to the first bandpass beamformed signal and the contralateral bandpass beamformed signal.

Drawings

The above and other features and advantages will be readily apparent to those skilled in the art from the following detailed description of exemplary embodiments of the invention, taken in conjunction with the accompanying drawings, in which:

figure 1 schematically illustrates an exemplary hearing device,

figure 2 schematically illustrates an exemplary hearing device,

figure 3 schematically illustrates an exemplary hearing device,

fig. 4 shows an exemplary bandpass beamformer of the second beamforming module, and

fig. 5 is a flow chart of an exemplary method.

List of reference numerals

2. Hearing device

4. Transceiver module

4A antenna

4B transceiver/radio unit

5. Contralateral beamforming signal

6. First microphone

6A first microphone input Signal

8. Second microphone

8A second microphone input Signal

10. First beam forming module

10A first Beam formed Signal

12. Filter bank

12A first bandpass beamforming signal

12B first Low pass Beam formed Signal

12C first high pass beamforming signal

14A contralateral bandpass beamformed signals

14B contralateral low pass beamformed signal

14C contralateral high pass beamforming signal

16. Second beam forming module

17A band-pass beam shaper

17B low pass beam shaper

17C high-pass beam shaper

18A second bandpass beamformed signal

18B second low pass beamformed signal

18C second high pass beamforming signal

20. Adder device

22. Beamformed input signals

24. Processor and method for controlling the same

26. Electric output signal

28. Receiver with a receiver body

52. Bandpass beamforming controller

54. First multiplier

56. Contralateral multiplier

58. Band-pass equalizer

60. Adder device

100. Method of operating a hearing device

102. Obtaining contralateral beamformed signals

104. Obtaining a first microphone input signal and a second microphone input signal

106. Obtaining a first beamformed signal

108. Filtering the first and side beamformed signals

110. Providing a second bandpass beamformed signal

112. Providing beamformed input signals

114. Performing hearing compensation processing

116. Converting an electrical output signal to an audio output signal

Detailed Description

Various exemplary embodiments and details are described below with reference to the associated drawings. It should be noted that the figures may or may not be drawn to scale and that elements of similar structure or function are represented by like reference numerals throughout the figures. It should also be understood that the drawings are merely intended to facilitate description of the embodiments. They are not intended as an exhaustive description of the invention or as a limitation on the scope of the invention. In addition, the illustrated embodiments need not exhibit all aspects or advantages. Aspects or advantages described in connection with a particular embodiment are not necessarily limited to that embodiment and may be practiced in any other embodiment even if not shown or explicitly described.

The disclosed hearing devices and methods provide improved spatial unmasking and improved off-axis listening for the ears of a user. Furthermore, better context awareness is provided to provide multiple streams for selective listening. The present disclosure provides an asymmetric listening experience by utilizing binaural hearing mechanisms of the human auditory system. Thus, asymmetric and different polarity patterns, namely a focused polarity pattern and a listening polarity pattern, are applied in the two hearing devices of the binaural hearing system. The focused polarity pattern is optionally designed for handling diffuse noise and the listening polarity pattern is optionally designed together with the focused polarity pattern for providing optimized situational awareness and better speech intelligibility, e.g. with a selective attention mechanism of the auditory system. The disclosed hearing devices and methods relate to designing concentration and listening ear spatial filtering systems to meet the needs of human listeners.

The hearing device may be a hearing aid, such as a Behind The Ear (BTE) type, an In The Ear (ITE) type, an in the ear (ITC) type, an in-the-canal Receiver (RIC) type, or an in-the-ear Receiver (RIE) type. The hearing aid may be a binaural hearing aid.

The hearing device comprises a transceiver module for communicating (receiving and/or transmitting) with a contralateral hearing device of the binaural hearing system. The transceiver module is optionally configured to provide a contralateral beamformed signal received from a contralateral hearing device. The transceiver module may comprise an antenna for converting one or more wireless input signals from the contralateral hearing device into an antenna output signal. The transceiver module optionally includes a radio transceiver coupled to the antenna for converting the antenna output signal to a transceiver input signal. The transceiver module may include multiple antennas and/or the antennas may be configured to operate in one or more antenna modes.

The contralateral beamformed signal may be a combination of multiple microphone input signals to the contralateral hearing device, enabling efficient use of limited transceiver resources (bandwidth and battery). In one or more exemplary hearing devices or methods, the contralateral beamformed signal may be a listening beamformed signal. In one or more exemplary hearing devices or methods, the contralateral beamformed signal may be a microphone input signal from the contralateral hearing device.

The hearing instrument comprises a microphone set. The microphone set may include one or more microphones. The microphone set comprises a first microphone for providing a first microphone input signal and/or a second microphone for providing a second microphone input signal. The microphone set may comprise N microphones for providing N microphone signals, where N is an integer ranging from 1 to 10. In one or more exemplary hearing devices, the number N of microphones is 2, 3, 4, 5 or more. The microphone set may comprise a third microphone for providing a third microphone input signal.

The hearing device comprises a first beamforming module for providing a first beamformed signal based on the first microphone input signal and/or the second microphone input signal. The first beamforming module is connected to the microphone set for receiving microphone input signals. The first beamformed signal may be based on the third microphone input signal (if present). The first beamforming module may operate in the time domain.

The hearing device comprises a filter bank, optionally comprising a plurality of filters, for filtering the first beamformed signal into a plurality of first sub-band beamformed signals comprising a first band-pass beamformed signal. The filter bank is connected to the first beamforming module for receiving the first beamformed signal. The plurality of first sub-band beamformed signals may include a first low-pass beamformed signal and/or a first high-pass beamformed signal. The plurality of first sub-band beamformed signals may include a plurality of first band pass beamformed signals. The filter bank may operate in the time domain.

The filter bank optionally comprises a first band pass filter for filtering the first beamformed signal into a first band pass beamformed signal. The first band pass filter may have a lower cut-off frequency in the range from 300Hz to 2.0 kHz. The first band pass filter may have a higher cut-off frequency in the range from 4.0kHz to 8.0 kHz. In one or more exemplary hearing devices, the first band pass filter has a lower cut-off frequency in the range from 1.0kHz to 1.8kHz and a higher cut-off frequency in the range from 5.0kHz to 7.0 kHz.

The filter bank optionally includes a contralateral band pass filter for filtering the contralateral beamformed signal to a contralateral band pass beamformed signal. The contralateral band pass filter may have a lower cut-off frequency in the range from 300Hz to 2.0 kHz. The contralateral band pass filter may have a higher cut-off frequency in the range from 4.0kHz to 8.0 kHz. In one or more exemplary hearing devices, the contralateral band pass filter has a lower cutoff frequency in the range from 1.0kHz to 1.8kHz and a higher cutoff frequency in the range from 5.0kHz to 7.0 kHz.

The filter bank optionally comprises a first low pass filter for filtering the first beamformed signal into a first low pass beamformed signal. The first low pass filter may have a cut-off frequency in the range from 300Hz to 2.0 kHz. In one or more exemplary hearing devices, the first low pass filter has a cutoff frequency in a range from 1.0kHz to 1.8 kHz. The first low-pass filter may be implemented as a band-pass filter with a lower cut-off frequency in the range from 0Hz to 300Hz and a higher cut-off frequency in the range from 1.0kHz to 1.8 kHz.

The filter bank optionally comprises a first high pass filter for filtering the first beamformed signal into a first high pass beamformed signal. The first high pass filter may have a cutoff frequency greater than 4.0kHz, such as in the range from 5.0kHz to 7.0 kHz. In one or more exemplary hearing devices, the first high-pass filter may be implemented as a band-pass filter having a lower cut-off frequency in the range from 5.0kHz to 7.0kHz and a higher cut-off frequency greater than 8kHz, such as in the range from 8.0kHz to 12 kHz.

The filter bank is optionally connected to the transceiver module for receiving and/or filtering at least the pair-wise side-bandpass beamformed signals. The filter bank may be configured to filter the contralateral beamformed signal into a plurality of contralateral subband beamformed signals including contralateral bandpass beamformed signals. The plurality of contralateral subband beamformed signals may include contralateral low-pass beamformed signals and/or contralateral high-pass beamformed signals.

The filter bank optionally includes a contralateral low pass filter for filtering the contralateral beamformed signal into a contralateral low pass beamformed signal. The contralateral low pass filter may have a cut-off frequency in the range from 300Hz to 2.0 kHz. In one or more exemplary hearing devices, the contralateral low pass filter has a cutoff frequency in the range from 1.0kHz to 1.8 kHz. The contralateral low pass filter may be implemented as a band pass filter with a lower cut-off frequency in the range from 0Hz to 300Hz and a higher cut-off frequency in the range from 1.0kHz to 1.8 kHz.

The filter bank optionally includes a contralateral high-pass filter for filtering the contralateral beamformed signal into a contralateral high-pass beamformed signal. The contralateral high pass filter may have a cutoff frequency greater than 4.0kHz, such as in the range from 5.0kHz to 7.0 kHz. In one or more exemplary hearing devices, the contralateral high pass filter may be implemented as a band pass filter having a lower cut-off frequency in the range from 5.0kHz to 7.0kHz and a higher cut-off frequency greater than 8kHz, such as in the range from 8.0kHz to 12 kHz.

An important advantage of the present disclosure is that noise suppression may be performed in selected sub-bands, while from an auditory perspective it is desirable to modify the input signal as little as possible to aid in auditory scene analysis. Furthermore, some frequency regions are more susceptible to noise interference, and the present disclosure allows for selectively improving SNR in these regions.

The hearing device comprises a second beamforming module for providing one or more second beamformed signals (e.g. comprising second bandpass beamformed signals) based on the first bandpass beamformed signals and/or the contralateral bandpass beamformed signals. The second beamforming module is connected to the filter bank for receiving the first sub-band beamformed signal and/or the opposite sub-band beamformed signal. The second beamforming module may operate in the time domain.

The second beamforming module includes one or more beamformers including a bandpass beamformer. The bandpass beamformer may be an adaptive beamformer. An adaptive beamformer is a beamformer in which the beamforming is adjusted according to one or more input signals to the beamformer.

The second beamforming module may be directly connected to the transceiver module for receiving the contralateral beamformed signal. Thus, for example, the contralateral beamformed signal may be a contralateral bandpass beamformed signal due to encoding/decoding in the transceiver module and/or filtering prior to transmission from the contralateral hearing device.

The hearing instrument comprises an adder. The summer is optionally connected to one or more outputs of the second beamforming module, e.g. to a bandpass beamformer, for providing a beamformed input signal, e.g. based on one or more second beamformed signals from the second beamforming module. The beamformed input signal may be based on the second bandpass beamformed signal.

The hearing device comprises a processor for processing the beamformed input signal and providing an electrical output signal based on the beamformed input signal. The processor may be configured to compensate for a hearing loss of the user, for example by filtering and/or compressing the beamformed input signal.

The beamformer of the second beamforming module may comprise a beamforming controller and/or one or more multipliers, such as a plurality of multipliers. The beamformer of the second beamforming module optionally comprises an adder connected to the multiplier for adding the multiplier outputs to provide a corresponding second beamformed signal. The beamforming controller is configured to determine and/or apply the respective coefficients (also denoted as a_1, b_1, a_2, b_2, a_3, b_3, a_4, b_4, etc.) in one or more multipliers.

The bandpass beamformer may include a bandpass beamforming controller and a first multiplier, wherein the bandpass beamformer (e.g., bandpass beamforming controller) is optionally configured to determine a first bandpass coefficient of the first bandpass beamformed signal based on the first bandpass beamformed signal and/or the contralateral bandpass beamformed signal. A bandpass beamformer (e.g., a bandpass beamforming controller) is optionally configured to apply a first bandpass coefficient in a first multiplier. The adaptive bandpass beamformer in the second beamforming module allows beamforming in a selected frequency band (e.g., a frequency band covering speech) while allowing, for example, upper and/or lower frequencies to pass without or significantly reduced beamforming. This is very advantageous because the ILD (Interaural Level Difference) and ITD (Interaural Time Difference) sound input signals typically reside in the upper and lower frequency bands.

The present hearing device is based on time domain subband signals from both ears. The benefits of double-sided beamforming using time-domain subband signals from both ears are apparent from the perspective of improved SNR. In addition, the present disclosure provides reduced tunneling hearing effects by allowing spatial cues and dialog context cues to be maintained.

An important advantage of the present disclosure is that the signal-to-noise ratio (SNR) can be improved in selected frequency bands while leaving other frequency bands unaffected or enabling different beamforming schemes in different frequency bands, e.g., in order to optimize spatial cues (ILD and ITD).

The hearing device (e.g., a bandpass beamforming controller) may be configured to determine a first bandpass coefficient (also denoted as a_1) of the first bandpass beamformed signal. For example, determining the first bandpass coefficient of the first bandpass beamformed signal may include solving a minimization problem. The minimization problem may be based on a desired power value of the first bandpass beamformed signal and/or the contralateral bandpass beamformed signal.

The minimization problem may optionally be given by a cost function under one or more constraints.

In one or more example hearing devices, determining the first bandpass coefficient of the first bandpass beamformed signal may include: a minimization problem is solved, for example, based on a desired mean square value of a linear combination of the first bandpass beamformed signal and the contralateral bandpass beamformed signal.

The beamformer of the second beamforming module may comprise a contralateral multiplier. The beamforming controller of the beamformer may be configured to determine the contralateral coefficients of the contralateral multiplier, e.g. based on the first beamformed signal and the contralateral beamformed signal, and to apply the contralateral coefficients in the contralateral multiplier, e.g. to the contralateral subband beamformed signal.

In one or more exemplary hearing devices, the band-pass beamformer includes a contralateral multiplier. The bandpass beamforming controller may be configured to determine a contralateral bandpass coefficient (also denoted b_1) of the contralateral bandpass beamformed signal based on the first bandpass beamformed signal and/or the contralateral bandpass beamformed signal. The bandpass beamforming controller may be configured to apply the contralateral bandpass coefficients in the contralateral multiplier, e.g., to the contralateral bandpass beamformed signals.

In one or more example hearing devices, determining the contralateral band pass coefficients of the contralateral band pass beamformed signal may include: the minimization problem is solved, for example, based on the desired power values of the first bandpass beamformed signal and/or the contralateral bandpass beamformed signal.

In one or more example hearing devices, determining the contralateral band pass coefficients of the contralateral band pass beamformed signal may include: a minimization problem is solved, for example, based on a desired mean square value of the linear combination of the first bandpass beamformed signal and/or the contralateral bandpass beamformed signal.

In one or more exemplary hearing devices, the coefficients a_1, b_1, a_2, b_2, a_3, b_3, etc. are in the range from 0 to 1.

For example, determining a first bandpass coefficient (also denoted as α or a_1) of the first bandpass beamformed signal and/or a contralateral bandpass coefficient (also denoted as β or b_1) of the contralateral bandpass beamformed signal may comprise solving a minimization problem, e.g., given as:

s _i ＝argmax(SNR(l _i )，SNR(r _i )，SNR(αl _i +(1-α)r ₁ )，

here, l _i For a first band-pass beamformed signal r _i Is the contralateral bandpass beamformed signal and a is the first bandpass coefficient. For hearing device design, it is assumed that the target sound source is located at the zero direction axis. The above formula can be simplified as:

s _i ＝argmin(rms(l _i )，rms(r _i )，rms(αl _i +(1-α)r _i )，

here, rms represents the root mean square value of the signal. Thus, it is necessary to obtain the optimal alpha value to achieve our goal. It corresponds to solving for α and β in the following cost function C (α, β):

argmin{E[(αl _i +βr _i )·(αl _i +βr _i )]}

and E is a statistically expected value under the constraint that α+β=1, where α is a first bandpass coefficient and β is a contralateral bandpass coefficient.

In one or more exemplary hearing devices, solving the minimization problem may include applying a random steepest descent algorithm.

In one or more example hearing devices, solving the minimization problem may include applying a least mean square algorithm or a normalized least mean square algorithm.

Minimization problems may be adaptively achieved, for example, by:

C(α，β)＝{E{(αl _i +βr _i )·(αl _i +βr _i )}+λ(α+β-1)。

The minimization problem may be solved by using a random steepest descent algorithm, including:

gradient taking

Solving lagrangeλ= -E { v·l } -E { v·r } and v=al+βr

·

Solution as

Mu is the step size

The minimization problem can be solved by using the LMS algorithm (least mean square):

the minimization problem can be solved by using the NLMS algorithm (normalized least mean square):

or (b)

For all three algorithms, the update is completed when v.v > 0.

The solution achieved is as follows:

here, the output is v=α _n l _i +β _n r _i And step μ=0.001, α _n For the first bandpass coefficient, beta _n Is the opposite side bandpass coefficient used in the bandpass beamformer.

The size of the beamformed signal vectors l and r may be from 20 to 60 (e.g., 48) samples at a sampling rate from 8kHz to 33kHz (e.g., 16 kHz). In the calculation, the beamforming signal vector may be accumulated in two frames.

In one or more exemplary hearing devices, a better ear strategy (minimization problem) may be expressed, for example, as for one or more sub-bands:

s _i ＝argmin(rms(l _i )，rms(r _i )，rms(v))，

for example, the bandpass beamforming controller may be configured to determine the first bandpass coefficient and the contralateral bandpass coefficient by solving the minimization problem. When the adaptation process converges, the solution is a beamforming result (first bandpass coefficient and contralateral bandpass coefficient). When the adaptation process starts from equal weights (alpha ₀ ＝β ₀ =0.5), a better ear listening strategy may select the signal based on the minimum RMS of the three signals.

In one or more example hearing devices, the band-pass beamformer includes a band-pass equalizer configured to provide a second band-pass beamformed signal based on an equalizer input, wherein the equalizer input is based on the first band-pass beamformed signal and/or the contralateral band-pass beamformed signal. The multi-channel selective subband directed filtering schemes of the present disclosure may effectively reduce noise interference in selected frequency bands. However, due to the reduced noise, the total loudness of these sub-bands may be softer or have more bass relative to other bands. The bandpass equalizer can compensate for this loudness loss. Furthermore, the spread of masking from high low frequency sub-bands is reduced or substantially avoided. The bandpass equalizer may be activated according to the sound environment and/or the particular listening scenario.

In one or more exemplary hearing devices, optionally, when the target speech is not detected, the band-pass equalizer is configured to determine a compensation coefficient, also denoted g_1, and apply the compensation coefficient to the linear combination of the first band-pass beamformed signal and/or the contralateral band-pass beamformed signal. In one or more exemplary hearing devices, the compensation coefficient is used as a scaling factor G ₁ Given/calculated as:

here, l is the first bandpass beamformed signal, v=a_1×l+b_1×r, and r is the square root of the intensity ratio of the contralateral bandpass beamformed signal, i.e. before and after beamforming. Thus, the beamformed frequency band may be amplified to its original RMS level.

In one or more exemplary hearing devices, the unprocessed frequency bands may be scaled down based on the scale.

The second beamforming module may comprise a low-pass beamformer for providing a second low-pass beamformed signal, e.g. based on the first low-pass beamformed signal and the opposite-side low-pass beamformed signal. The low pass beamformer may be an adaptive beamformer. The summer may be connected to a low-pass beamformer for providing a beamformed input signal based on the second low-pass beamformed signal.

The low-pass beamformer may include a low-pass beamforming controller and a first multiplier, wherein the low-pass beamformer (e.g., the low-pass beamforming controller) is optionally configured to determine a first low-pass coefficient of the first low-pass beamformed signal based on the first low-pass beamformed signal and/or the contralateral low-pass beamformed signal. A low-pass beamformer (e.g., a low-pass beamforming controller) is optionally configured to apply a first low-pass coefficient in a first multiplier.

The hearing device (e.g., the low-pass beamforming controller) may be configured to determine a first low-pass coefficient (also denoted as a_2) of the first low-pass beamformed signal. For example, determining the first low-pass coefficient of the first low-pass beamformed signal may include solving a minimization problem. The minimization problem may be based on a desired power value of the first low-pass beamformed signal and/or the opposite-side low-pass beamformed signal.

In one or more exemplary hearing devices, the low-pass beamformer includes a contralateral multiplier. The low-pass beamforming controller may be configured to determine a contralateral low-pass coefficient (also denoted b_2) of the contralateral low-pass beamforming signal based on the first low-pass beamforming signal and/or the contralateral low-pass beamforming signal. The low-pass beamforming controller may be configured to apply the contralateral low-pass coefficients in the contralateral multiplier, e.g., to the contralateral low-pass beamformed signal.

The second beamforming module may comprise a high-pass beamformer for providing a second high-pass beamformed signal, e.g. based on the first high-pass beamformed signal and the opposite-side high-pass beamformed signal. The high pass beamformer may be an adaptive beamformer. The summer may be connected to a high-pass beamformer for providing a beamformed input signal based on the second high-pass beamformed signal.

The high pass beamformer may include a high pass beamforming controller and a first multiplier, wherein the high pass beamformer (e.g., the high pass beamforming controller) is optionally configured to determine a first high pass coefficient of the first high pass beamforming signal based on the first high pass beamforming signal and/or the opposite side high pass beamforming signal. A high pass beamformer (e.g., a high pass beamforming controller) is optionally configured to apply a first high pass coefficient in a first multiplier.

The hearing device (e.g., the high-pass beamforming controller) may be configured to determine a first high-pass coefficient (also denoted as a_3) of the first high-pass beamformed signal. For example, determining the first high pass coefficient of the first high pass beamformed signal may include solving a minimization problem. The minimization problem may be based on a desired power value of the first high-pass beamformed signal and/or the opposite-side low-pass beamformed signal.

In one or more exemplary hearing devices, the high-pass beamformer includes a contralateral multiplier. The high pass beamforming controller may be configured to determine a contralateral high pass coefficient (also denoted b_3) of the contralateral high pass beamforming signal based on the first high pass beamforming signal and/or the contralateral high pass beamforming signal. The high-pass beamforming controller may be configured to apply the contralateral high-pass coefficient in the contralateral multiplier, e.g., to the contralateral high-pass beamforming signal.

The second beamforming module may comprise a plurality of bandpass beamformers for providing a plurality of second bandpass beamformed signals. Thus, further improved SNR can be obtained in different frequency bands.

The second beamforming module may comprise an auxiliary bandpass beamformer for providing a second auxiliary bandpass beamformed signal, e.g. based on the first auxiliary bandpass beamformed signal and the opposite side auxiliary bandpass beamformed signal. The secondary bandpass beamformer may be an adaptive beamformer. The summer may be connected to the secondary bandpass beamformer for providing a beamformed input signal based on the second secondary bandpass beamformed signal.

The secondary bandpass beamformer may include a secondary bandpass beamformer controller and a first multiplier, wherein the secondary bandpass beamformer (e.g., the secondary bandpass beamformer controller) is optionally configured to determine a first secondary bandpass coefficient of the first secondary bandpass beamformed signal based on the first secondary bandpass beamformed signal and/or the contralateral secondary bandpass beamformed signal. The secondary bandpass beamformer (e.g., secondary bandpass beamforming controller) is optionally configured to apply a first secondary bandpass coefficient in a first multiplier.

The hearing device (e.g., the secondary band-pass beamforming controller) may be configured to determine a first secondary band-pass coefficient (also denoted as a_4) of the first secondary band-pass beamformed signal. For example, determining the first secondary bandpass coefficient of the first secondary bandpass beamformed signal may include solving a minimization problem. The minimization problem may be based on the desired power value of the first secondary band pass beamformed signal and/or the contralateral secondary band pass beamformed signal.

In one or more exemplary hearing devices, the secondary band-pass beamformer includes a contralateral multiplier. The secondary band-pass beamforming controller may be configured to determine a contralateral secondary band-pass coefficient (also denoted b_4) of the contralateral secondary band-pass beamformed signal based on the first secondary band-pass beamformed signal and/or the contralateral secondary band-pass beamformed signal. The secondary bandpass beamforming controller may be configured to apply the contralateral secondary bandpass coefficients in the contralateral multiplier, e.g., to the contralateral secondary bandpass beamformed signals.

In one or more hearing devices with auxiliary band-pass beamformers, the filter bank optionally comprises first and opposite side auxiliary band-pass filters for providing a first auxiliary band-pass beamformed signal and an opposite side auxiliary band-pass beamformed signal, respectively. The lower cut-off frequencies of the first and contralateral auxiliary band-pass filters may correspond to the higher cut-off frequencies of the first and contralateral band-pass filters, e.g., in the range from 2kHz to 4kHz, and the higher cut-off frequencies of the first and contralateral auxiliary band-pass filters may correspond to the cut-off frequencies of the first and contralateral high-pass filters, e.g., in the range from 5.0kHz to 7.0 kHz.

The hearing device may comprise a beamforming controller connected to the second beamforming module for controlling the second beamforming module, wherein the beamforming controller is configured to apply the second main beamforming scheme in the second beamforming module in a main operation mode of the hearing device and optionally to apply the second auxiliary beamforming scheme in the second beamforming module in an auxiliary operation mode of the hearing device.

The beam forming controller may be connected to the first beam forming module for controlling the first beam forming module. The beamforming controller may be configured to apply a first main beamforming scheme in the first beamforming module in a main operation mode of the hearing device, and optionally to apply a first auxiliary beamforming scheme in an auxiliary operation mode of the hearing device.

The first beamforming module may be connected to the transceiver module, for example, for feeding the first beamforming signal to the transceiver module. The transceiver module may be configured to transmit at least a portion of the first beamformed signal to the contralateral hearing device. The first microphone and/or the second microphone may be connected to the transceiver module, for example, for feeding the first microphone input signal and/or the second microphone input signal to the transceiver module. The transceiver module may be configured for transmitting at least a portion of the first microphone input signal and/or the second microphone input signal to the contralateral hearing device.

The method comprises obtaining a contralateral beamformed signal from a contralateral hearing device, for example, using a transceiver module of the hearing device.

The method comprises obtaining a first microphone input signal and a second microphone input signal, for example with respective first and second microphones of the hearing device. The method comprises providing a first beamformed signal based on the first microphone input signal and the second microphone input signal, for example, with a first beamforming module of the hearing device. The method comprises filtering the first beamformed signal and/or the contralateral beamformed signal, for example with a filter of the hearing device, to provide a first band pass beamformed signal and a contralateral band pass beamformed signal. The method comprises providing a second band pass beamformed signal based on the first band pass beamformed signal and the contralateral band pass beamformed signal, for example, with a second beamforming module of the hearing device. Providing the second bandpass beamformed signal optionally includes applying adaptive beamforming to the first bandpass beamformed signal and the contralateral bandpass beamformed signal. The method comprises providing a beamformed input signal based on the second band-pass beamformed signal, e.g. with a summer of the hearing device. The method comprises performing a hearing compensation process on the beamformed input signal, e.g. with a processor of the hearing device, to provide an electrical output signal. The method comprises converting the electrical output signal into an audio output signal, for example with a receiver of the hearing device.

The present hearing devices and methods use binaural hearing guidance strategy (BASS) to help hearing device designers integrate acoustic filtering, peripheral processing, and a central listening level. The present disclosure aims to preserve spatial cues in two audio streams to obtain spatial unmasking benefits.

Fig. 1 illustrates an exemplary hearing device. The hearing device 2 is configured for use in a binaural hearing system comprising a hearing device and a contralateral hearing device. The hearing device 2 (left/right hearing device) of the binaural hearing system comprises a transceiver module 4 for (wireless) communication with a contralateral (right/left) hearing device (not shown in fig. 1) of the binaural system. The transceiver module 4 comprises an antenna 4A and a transceiver 4B and is configured to provide a contralateral beamformed signal 5 received from the remote hearing device. The hearing device 2 comprises a microphone set comprising a first microphone 6 and a second microphone 8 for providing a first microphone input signal 6A and a second microphone input signal 8A, respectively. The hearing device 2 comprises a first beamforming module 10 connected to the first microphone 6 and the second microphone 8 for receiving and processing the first microphone input signal 6A and the second microphone input signal 8A. The first beamforming module 10 provides or outputs a first beamformed signal 10A based on the first microphone input signal 6A and the second microphone input signal 8A.

The hearing device 2 comprises a filter bank 12 connected to the first beamforming module 10. The filter bank is configured for filtering the first beamformed signal 10A into a plurality of first sub-band beamformed signals including a first band-pass beamformed signal 12A. The filter bank 12 is optionally connected to the transceiver module 5 and is configured for filtering the contralateral beamformed signal into a contralateral bandpass beamformed signal 14A.

The hearing device 2 comprises a second beamforming module 16 connected to the filter bank 12, the second beamforming module 16 comprising an adaptive bandpass beamformer 17A for providing a second bandpass beamformed signal 18A based on the first bandpass beamformed signal 12A and the contralateral bandpass beamformer 14A. The hearing device 2 comprises a summer 20 connected to the band-pass beamformer 17A and configured for providing a beamformed input signal 22 based on the second band-pass beamformed signal 18A. Furthermore, an adder 20 is connected to the filter bank 12 for providing a beamformed input signal 22 based on the first low-pass beamformed signal 12B and/or the first high-pass beamformed signal 12C. Thus, the second beamforming is not performed at low and high frequencies in order to maintain the ITD and ILD of the first beamformed signal in the binaural hearing system.

The hearing device 2 comprises a processor 24 for processing the beamformed input signal 22 and providing an electrical output signal 26 based on the beamformed input signal 22, and a receiver 28 for converting the electrical output signal 26 into an audio output signal.

Fig. 2 shows an exemplary hearing device 2A configured for use in a binaural hearing system comprising a hearing device and a contralateral hearing device. The hearing device 2A (left/right hearing device) of the binaural hearing system comprises a transceiver module 4 for (wireless) communication with a contralateral (right/left) hearing device (not shown in fig. 2) of the binaural system. The transceiver module 4 is configured to provide a contralateral beamformed signal 5 received from the remote hearing device. The hearing device 2A comprises a microphone set comprising a first microphone 6 and a second microphone 8 for providing a first microphone input signal 6A and a second microphone input signal 8A, respectively. The hearing device 2A comprises a first beamforming module 10 connected to the first microphone 6 and the second microphone 8 for receiving and processing the first microphone input signal 6A and the second microphone input signal 8A. The first beamforming module 10 provides or outputs a first beamformed signal 10A based on the first microphone input signal 6A and the second microphone input signal 8A.

The hearing device 2A comprises a filter bank 12 connected to the first beamforming module 10. The filter bank is configured for filtering the first beamformed signal 10A into a plurality of first sub-band beamformed signals including a first band-pass beamformed signal 12A and a first low-pass beamformed signal 12B. The filter bank 12 is optionally connected to the transceiver module 5 and configured for filtering the contralateral beamformed signal into a contralateral bandpass beamformed signal 14A and a contralateral lowpass beamformed signal 14B.

The hearing device 2A comprises a second beamforming module 16 connected to the filter bank 12, the second beamforming module 16 comprising an adaptive bandpass beamformer 17A for providing a second bandpass beamformed signal 18A based on the first bandpass beamformed signal 12A and the contralateral bandpass beamformer 14A. The second beamforming module 16 comprises an adaptive low-pass beamformer 17B for providing a second low-pass beamformed signal 18B based on the first low-pass beamformed signal 12B and the opposite side low-pass beamformed signal 14B. The hearing device 2A comprises a summer 20 connected to a band-pass beamformer 17A and a low-pass beamformer 17B. Summer 20 is configured to provide a beamformed input signal 22 based on second bandpass beamformed signal 18A and the second lowpass beamformed signal. Furthermore, an adder 20 is connected to the filter bank 12 for providing a beamformed input signal 22 based on the first high-pass beamformed signal 12C. Thus, the second beamforming is not performed at high frequencies in order to maintain the ILD of the first beamformed signal in the binaural hearing system.

The hearing device 2A comprises a processor 24 for processing the beamformed input signal 22 and providing an electrical output signal 26 based on the beamformed input signal 22, and a receiver 28 for converting the electrical output signal 26 into an audio output signal.

Fig. 3 shows an exemplary hearing device 2B configured for use in a binaural hearing system comprising a hearing device and a contralateral hearing device. The hearing device 2B (left/right hearing device) of the binaural hearing system comprises a transceiver module 4 for (wireless) communication with a contralateral (right/left) hearing device (not shown in fig. 3) of the binaural system. The transceiver module 4 is configured to provide a contralateral beamformed signal 5 received from the remote hearing device. The hearing device 2B comprises a microphone set comprising a first microphone 6 and a second microphone 8 for providing a first microphone input signal 6A and a second microphone input signal 8A, respectively. The hearing device 2B comprises a first beamforming module 10 connected to the first microphone 6 and the second microphone 8 for receiving and processing the first microphone input signal 6A and the second microphone input signal 8A. The first beamforming module 10 provides or outputs a first beamformed signal 10A based on the first microphone input signal 6A and the second microphone input signal 8A.

The hearing device 2B comprises a filter bank 12 connected to the first beamforming module 10. The filter bank is configured for filtering the first beamformed signal 10A into a plurality of first sub-band beamformed signals including a first band pass beamformed signal 12A, a first low pass beamformed signal 12B, and a first high pass beamformed signal 12C. The filter bank 12 is optionally connected to the transceiver module 5 and is configured for filtering the contralateral beamformed signal into a contralateral band-pass beamformed signal 14A, a contralateral low-pass beamformed signal 14B and a contralateral high-pass beamformed signal 14C. Filtering the side-to-side beamformed signals into side-to-side sub-band beamformed signals 14A, 14B, 14C increases design flexibility by enabling sub-band beamforming based on the side-to-side sub-band beamformed signals.

The hearing device 2B comprises a second beamforming module 16 connected to the filter bank 12, the second beamforming module 16 comprising an adaptive bandpass beamformer 17A for providing a second bandpass beamformed signal 18A based on the first bandpass beamformed signal 12A and the contralateral bandpass beamformer 14A. The second beamforming module 16 comprises an adaptive low-pass beamformer 17B for providing a second low-pass beamformed signal 18B based on the first low-pass beamformed signal 12B and the opposite side low-pass beamformed signal 14B. The second beamforming module 16 comprises an adaptive high-pass beamformer 17C for providing a second high-pass beamformed signal 18C based on the first high-pass beamformed signal 12C and the opposite side high-pass beamformed signal 14C. The hearing device 2B comprises a summer 20 connected to the band-pass beamformer 17A, the high-pass beamformer 17C and the low-pass beamformer 17B (if present). Summer 20 is configured to provide a beamformed input signal 22 based on second bandpass beamformed signal 18A, second highpass beamformed signal 18C, and second lowpass beamformed signal 18B. In an exemplary hearing device similar to the hearing device 2B, the low-pass beamformer 17B may be omitted and the first low-pass beamformed signal 12B may be fed directly to the adder 20. The hearing device 2 comprises a processor 24 for processing the beamformed input signal 22 and providing an electrical output signal 26 based on the beamformed input signal 22, and a receiver 28 for converting the electrical output signal 26 into an audio output signal.

Fig. 4 shows an exemplary bandpass beamformer 17A of the second beamforming module 16. The bandpass beamformer comprises a bandpass beamforming controller 52 and a first multiplier 54, wherein the bandpass beamformer is configured to determine a first bandpass coefficient a_1 of the first bandpass beamformed signal 12A based on the first bandpass beamformed signal 12A and the opposite side bandpass beamformed signal 14A. The band pass beamforming controller 52 is configured to apply the first band pass coefficient a_1 to the first band pass beamformed signal 12A in the first multiplier 54, for example, by sending the first band pass coefficient or a first control signal indicative of the first band pass coefficient to the first multiplier 54. The bandpass beamformer 17A includes an opposite side multiplier 56 and the bandpass beamforming controller 52 is configured to determine opposite side bandpass coefficients b_1 of the opposite side bandpass beamformed signal 14A based on the first bandpass beamformed signal 12A and the opposite side bandpass beamformed signal 14A. The bandpass beamforming controller 52 is configured to apply the contralateral bandpass coefficient b_1 in the contralateral multiplier 56, for example, by sending the contralateral bandpass coefficient b_1 or a contralateral control signal indicative of the contralateral bandpass coefficient b_1 to the contralateral multiplier 56. The bandpass beamformer 17A includes an adder 60 connected to the multipliers 54, 56 for adding the output signals of the respective multipliers 54, 56. The bandpass beamformer 17A includes a bandpass equalizer 58 connected to the summer 60 and configured to provide a second bandpass beamformed signal 18A based on an equalizer input as an output signal of the summer 60. Thus, the equalizer input is based on the first bandpass beamformed signal and/or the contralateral bandpass beamformed signal, depending on the current values of coefficients a_1 and b_1. The bandpass equalizer 58 is configured to determine a compensation coefficient (also denoted g_1) and apply the compensation coefficient to the summer output as a linear combination of the first bandpass beamformed signal 12A and/or the contralateral bandpass beamformed signal 14A. The compensation coefficient is optionally determined as:

Here, l is the first bandpass beamformed signal 12a, v=a_1×l+b_1×r, and r is the contralateral bandpass beamformed signal 14A. Thus, the compensation factor is the square root of the intensity ratio before and after beamforming, and the bandpass subband is amplified to its original RMS level.

The bandpass beamforming controller 52 is configured to determine the first bandpass coefficient a_1 and the contralateral bandpass coefficient b_1, for example, by solving a minimization problem given by the cost function C and constraint conditions described above using a random steepest descent algorithm with the determiner 52A.

Thus, in the bandpass beamformer 17A, the second bandpass beamformed signal 18A (also denoted x_1) is given as:

X ₁ ＝G ₁ *(A_1*l+B_1*r)；

here, l is the first bandpass beamformed signal 12A and r is the contralateral bandpass beamformed signal 14A.

Fig. 5 is a flow chart of an exemplary method 100 of operating a hearing device in a binaural hearing system comprising a hearing device and a contralateral hearing device. The method 100 comprises obtaining (102) a contralateral beamformed signal from a contralateral hearing device and obtaining (104) a first microphone input signal and a second microphone input signal. Further, the method 100 includes providing (106) a first beamformed signal based on the first microphone input signal and the second microphone input signal and filtering (108) the first beamformed signal and the side beamformed signal to provide a first bandpass beamformed signal and a side bandpass beamformed signal. The method proceeds to provide (110) a second bandpass beamformed signal based on the first bandpass beamformed signal and the contralateral bandpass beamformed signal, wherein providing (110) the second bandpass beamformed signal includes applying adaptive beamforming to the first bandpass beamformed signal and the contralateral bandpass beamformed signal. The method 100 comprises providing (112) a beamformed input signal based on the second bandpass beamformed signal, performing (114) a hearing compensation process on the beamformed input signal to provide an electrical output signal, and converting (116) the electrical output signal to an audio output signal.

A hearing device and a method according to any of the following are also disclosed.

Item 1. A hearing device for a binaural hearing system comprising the hearing device and a contralateral hearing device, the hearing device comprising:

a transceiver module for communicating with a contralateral hearing device of the binaural hearing system, the transceiver module configured for providing contralateral beamformed signals received from the contralateral hearing device;

a microphone set comprising a first microphone for providing a first microphone input signal and a second microphone for providing a second microphone input signal;

a first beamforming module connected to the microphone set for providing a first beamformed signal based on the first microphone input signal and the second microphone input signal;

a filter bank connected to the first beamforming module and the transceiver module for filtering the first beamformed signal into a plurality of first sub-band beamformed signals including a first band-pass beamformed signal and for filtering the pair of side-band beamformed signals into a pair of side-band beamformed signals;

A second beamforming module connected to the filter bank, the second beamforming module comprising a bandpass beamformer for providing a second bandpass beamformed signal based on the first bandpass beamformed signal and the contralateral bandpass beamformed signal;

a summer connected to the bandpass beamformer for providing a beamformed input signal based on the second bandpass beamformed signal;

a processor for processing the beamformed input signals and providing electrical output signals based on the beamformed input signals; and

a receiver for converting the electrical output signal into an audio output signal,

wherein the bandpass beamformer of the second beamforming module is an adaptive beamformer.

The hearing device of item 2, wherein the band-pass beamformer comprises a band-pass beamforming controller and a first multiplier, wherein the band-pass beamformer is configured to determine a first band-pass coefficient of the first band-pass beamformed signal based on the first band-pass beamformed signal and the contralateral band-pass beamformed signal, and to apply the first band-pass coefficient in the first multiplier.

Item 3. The hearing device of item 2, wherein determining the first bandpass coefficient of the first bandpass beamformed signal comprises: a minimization problem based on the desired power values of the first and the opposite side bandpass beamformed signals is solved.

Item 4. The hearing device of any one of items 2-3, wherein determining the first bandpass coefficients of the first bandpass beamformed signal comprises: a minimization problem based on a desired mean square value of a linear combination of the first bandpass beamformed signal and the contralateral bandpass beamformed signal is solved.

Item 5 the hearing device of any one of items 1-4, wherein the band-pass beamformer comprises a contralateral multiplier, and wherein the band-pass beamforming controller is configured to determine contralateral band-pass coefficients of the contralateral band-pass beamformed signal based on the first band-pass beamformed signal and the contralateral band-pass beamformed signal, and to apply the contralateral band-pass coefficients in the contralateral multiplier.

Item 6. The hearing device of item 5, wherein determining the contralateral band pass coefficients of the contralateral band pass beamformed signal comprises: a minimization problem based on the desired power values of the first and the opposite side bandpass beamformed signals is solved.

Item 7. The hearing device of any one of items 5-6, wherein determining the contralateral band pass coefficients of the contralateral band pass beamformed signal comprises: a minimization problem based on a desired mean square value of a linear combination of the first bandpass beamformed signal and the contralateral bandpass beamformed signal is solved.

The hearing device of any one of items 1-7, wherein the band-pass beamformer comprises a band-pass equalizer configured to provide the second band-pass beamformed signal based on an equalizer input, wherein the equalizer input is based on the first band-pass beamformed signal and/or the contralateral band-pass beamformed signal.

The hearing device of any one of items 1-8, wherein the second beamforming module comprises a low-pass beamformer for providing a second low-pass beamformed signal based on the first low-pass beamformed signal and the opposite-side low-pass beamformed signal, and wherein the summer is connected to the low-pass beamformer for providing a beamformed input signal based on the second low-pass beamformed signal.

The hearing device according to any one of items 1-9, wherein the second beamforming module comprises a high-pass beamformer for providing a second high-pass beamformed signal based on the first high-pass beamformed signal and the opposite-side high-pass beamformed signal, and wherein the summer is connected to the high-pass beamformer for providing a beamformed input signal based on the second high-pass beamformed signal.

The hearing device according to any one of items 1-10, wherein the hearing device comprises a beamforming controller connected to the second beamforming module for controlling the second beamforming module, wherein the beamforming controller is configured to apply a second main beamforming scheme in the second beamforming module in a main operation mode of the hearing device and to apply a second auxiliary beamforming scheme in the second beamforming module in an auxiliary operation mode of the hearing device.

The hearing device according to any one of items 1-11, wherein the beamforming controller is connected to the first beamforming module for controlling the first beamforming module, wherein the beamforming controller is configured to apply a first main beamforming scheme in the first beamforming module in a main operation mode of the hearing device and to apply a first auxiliary beamforming scheme in an auxiliary operation mode of the hearing device.

Item 13 the hearing device of any one of items 1-12, wherein the first beamforming module is connected to the transceiver module, and wherein the transceiver module is configured to transmit at least a portion of the first beamformed signal to the contralateral hearing device.

Item 14. A binaural hearing system comprising a hearing device and a contralateral hearing device, wherein the hearing device is according to any one of items 1-13.

A method of operating a hearing device in a binaural hearing system, the binaural hearing system comprising the hearing device and a contralateral hearing device, the method comprising:

obtaining a contralateral beamformed signal from the contralateral hearing device;

obtaining a first microphone input signal and a second microphone input signal;

providing a first beamformed signal based on the first microphone input signal and the second microphone input signal;

filtering the first and contralateral beamformed signals to provide first and contralateral bandpass beamformed signals;

providing a second bandpass beamformed signal based on the first bandpass beamformed signal and the contralateral bandpass beamformed signal;

providing a beamformed input signal based on the second bandpass beamformed signal;

performing an auditory compensation process on the beamformed input signal to provide an electrical output signal; and

converts the electrical output signal to an audio output signal,

Wherein providing a second bandpass beamformed signal includes applying adaptive beamforming to the first bandpass beamformed signal and the contralateral bandpass beamformed signal.

While particular features have been shown and described, it will be understood that they are not intended to limit the claimed invention, and it will be obvious to those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the claimed invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense. The claimed invention is intended to cover all alternatives, modifications and equivalents.

Claims

1. A hearing device for a binaural hearing system, the binaural hearing system comprising the hearing device and an contralateral hearing device, the hearing device comprising:

a transceiver module for communicating with a contralateral hearing device of the binaural hearing system, the transceiver module configured to obtain a contralateral band-pass beamformed signal from the contralateral hearing device;

a filter bank connected to the first beamforming module for filtering the first beamformed signal into a plurality of first sub-band beamformed signals including a first band-pass beamformed signal;

a second beamforming module connected to the filter bank and the transceiver module, the second beamforming module comprising a bandpass beamformer for providing a second bandpass beamformed signal based on the first bandpass beamformed signal and the contralateral bandpass beamformed signal;

a receiver for converting the electrical output signal into an audio output signal.

2. The hearing device of claim 1, wherein the bandpass beamformer of the second beamforming module is an adaptive beamformer.

3. A hearing device for a binaural hearing system, the binaural hearing system comprising the hearing device and an contralateral hearing device, the hearing device comprising:

a transceiver module for communicating with a contralateral hearing device of the binaural hearing system, the transceiver module configured to obtain a contralateral beamformed signal from the contralateral hearing device;

4. The hearing device of any one of claims 1-3, wherein the band-pass beamformer comprises a band-pass beamforming controller and a first multiplier, wherein the band-pass beamformer is configured to determine first bandpass coefficients of the first bandpass beamformed signal based on the first bandpass beamformed signal and the contralateral bandpass beamformed signal, and to apply the first bandpass coefficients in the first multiplier.

5. The hearing device of claim 4, wherein the band pass beamformer is configured to determine the first bandpass coefficients of the first bandpass beamformed signal by solving a minimization problem based on desired power values of the first bandpass beamformed signal and the contralateral bandpass beamformed signal.

6. The hearing device of claim 4, wherein the band pass beamformer is configured to determine the first bandpass coefficients of the first bandpass beamformed signals by solving a minimization problem based on a desired mean square value of a linear combination of the first bandpass beamformed signals and the contralateral bandpass beamformed signals.

7. The hearing device of any one of claims 1-3, wherein the band-pass beamformer comprises a contralateral multiplier, and wherein the band-pass beamforming controller is configured to determine contralateral band-pass coefficients of the contralateral band-pass beamformed signal based on the first band-pass beamformed signal and the contralateral band-pass beamformed signal, and to apply the contralateral band-pass coefficients in the contralateral multiplier.

8. The hearing device of claim 7, wherein the band pass beamforming controller is configured to determine the contralateral band pass coefficients of the contralateral band pass beamformed signal by solving a minimization problem based on desired power values of the first band pass beamformed signal and the contralateral band pass beamformed signal.

9. The hearing device of claim 7, wherein the band pass beamforming controller is configured to determine the contralateral band pass coefficients of the contralateral band pass beamforming signal by solving a minimization problem based on a desired mean square value of a linear combination of the first band pass beamforming signal and the contralateral band pass beamforming signal.

10. A hearing device according to any of claims 1-3, wherein the band-pass beamformer comprises a band-pass equalizer configured to provide the second band-pass beamformed signal based on an equalizer input, wherein the equalizer input is based on the first band-pass beamformed signal and/or the contralateral band-pass beamformed signal.

11. A hearing device according to any of claims 1-3, wherein the second beamforming module comprises a low-pass beamformer for providing a second low-pass beamformed signal based on a first low-pass beamformed signal and further based on a contralateral low-pass beamformed signal, and wherein the summer is connected to the low-pass beamformer for providing the beamformed input signal based on the second low-pass beamformed signal.

12. A hearing device according to any of claims 1-3, wherein the second beamforming module comprises a high-pass beamformer for providing a second high-pass beamformed signal based on a first high-pass beamformed signal and further based on a contralateral high-pass beamformed signal, and wherein the adder is connected to the high-pass beamformer for providing the beamformed input signal based on the second high-pass beamformed signal.

13. A hearing device according to any of claims 1-3, wherein the hearing device comprises a beam forming controller connected to the second beam forming module for controlling the second beam forming module, wherein the beam forming controller is configured to apply a second main beam forming scheme in the second beam forming module in a main operation mode of the hearing device and to apply a second auxiliary beam forming scheme in the second beam forming module in an auxiliary operation mode of the hearing device.

14. The hearing device of claim 13, wherein the beamforming controller is connected to the first beamforming module for controlling the first beamforming module, wherein the beamforming controller is configured to apply a first main beamforming scheme in the first beamforming module in a main operation mode of the hearing device and to apply a first auxiliary beamforming scheme in an auxiliary operation mode of the hearing device.

15. The hearing device of any one of claims 1-3, wherein the first beamforming module is connected to the transceiver module, and wherein the transceiver module is configured to transmit at least a portion of the first beamformed signal to the contralateral hearing device.

16. A binaural hearing system comprising a hearing device according to any one of claims 1-15 and a contralateral hearing device.

17. A method of operating a hearing device in a binaural hearing system, the binaural hearing system comprising the hearing device and a contralateral hearing device, the method comprising:

obtaining a contralateral band-pass beamformed signal from the contralateral hearing device;

obtaining a first microphone input signal and a second microphone input signal;

filtering the first beamformed signal to provide a first bandpass beamformed signal;

the electrical output signal is converted to an audio output signal.

18. A method of operating a hearing device in a binaural hearing system, the binaural hearing system comprising the hearing device and a contralateral hearing device, the method comprising:

obtaining a first microphone input signal and a second microphone input signal;

converting the electrical output signal to an audio output signal;

wherein the step of providing the second bandpass beamformed signal comprises applying adaptive beamforming to the first bandpass beamformed signal and the contralateral bandpass beamformed signal.