EP2890156A1

EP2890156A1 - Hearing device with position data and method of operating a hearing device

Info

Publication number: EP2890156A1
Application number: EP13199856.9A
Authority: EP
Inventors: Jesper UDESEN; Adam Weisser
Original assignee: GN Resound AS
Current assignee: GN Hearing AS
Priority date: 2013-12-30
Filing date: 2013-12-30
Publication date: 2015-07-01
Anticipated expiration: 2033-12-30
Also published as: EP2890156B1; DK2890156T3

Abstract

Hearing device and related method, the hearing device comprising a first antenna; a first transceiver coupled to the first antenna and configured to wirelessly receive one or more audio streams from an audio system, the one or more audio streams including a first audio stream; a primary processing unit adapted for processing an input signal according to a hearing prescription in order to alleviate a hearing loss; an acoustic output transducer coupled to an output of the primary processing unit for conversion of an output signal from the primary processing unit into an audio output signal; at least one microphone; a secondary processing unit with a first input coupled to an output of the first transceiver for receiving a first wireless input signal representative of the first audio stream from the first transceiver; and a position controller for detecting position data of the hearing device, the position controller having an output coupled to a position input of the secondary processing unit for sending a position control signal to the secondary processing unit; wherein the secondary processing unit is configured to process the first wireless input signal from the first transceiver based on the position control signal.

Description

The present disclosure relates to a hearing device and a method of operating a hearing device. In particular, the present disclosure relates to a hearing device with position data and related method for improving the correspondence of the visual and the auditory cues of a hearing aid user in a crowded environment.

BACKGROUND

It is known to stream audio to hearing devices via a telecoil solution having a limited bandwidth with limited possibilities of separating different audio streams. Further, wireless communication to and from hearing devices has been increasing in continuation of the developments within wireless communication technology. In an environment where audio is distributed to the crowd via a number of external microphones or other audio sources the present technology provides limited possibilities of separating audio signals from different positions.

SUMMARY

There is a need for a hearing device that improves separation of audio signals from different audio sources in an audio system.
Despite the known solutions there is still a need for improved user experience in a crowded area with multiple microphones/audio sources.
Accordingly, a hearing device is provided, the hearing device comprising a first antenna, a first transceiver coupled to the first antenna and configured to wirelessly receive one or more audio streams from an audio system, the one or more audio streams including a first audio stream; a primary processing unit adapted for processing an input signal according to a hearing prescription in order to alleviate a hearing loss; an acoustic output transducer coupled to an output of the primary processing unit for conversion of an output signal from the primary processing unit into an audio output signal; at least one microphone; a secondary processing unit with a first input coupled to an output of the first transceiver for receiving a first wireless input signal representative of the first audio stream from the first transceiver; and a position controller for detecting position data of the hearing device, the position controller having an output coupled to a position input of the secondary processing unit for sending a position control signal to the secondary processing unit; wherein the secondary processing unit is configured to process the first wireless input signal from the first transceiver based on the position control signal.
Also disclosed is a method for operating a hearing device, the method comprising: receiving a first audio stream; converting the first audio stream to a first wireless input signal; determining position data of the hearing device; processing the first wireless audio signal based on the position data of the hearing device to form an output signal; and converting the output signal to an audio output signal.
It is an advantage of the present invention that processing of wireless input signal(s) in the hearing device is based on the position (direction and/or distance) of the hearing device, thereby improving the user experience of the hearing device. Thus, the position (distance and/or orientation) of the hearing device may provide prioritization of input signals.
Further, the disclosed hearing aid and methods improve the correspondence of the visual and the auditory cues of the listener, otherwise lost in crowd amplification.
The primary processing unit and/or the secondary processing unit of the hearing device may be configured to compensate for hearing loss or hearing disability of the user of the hearing device. The primary processing unit and/or the secondary processing unit of the hearing device may be configured to alter a received audio stream, e.g. the first audio stream, a wireless input signal, e.g. the first wireless input signal, and/or the input signal to compensate for hearing loss or hearing disability of the user of the hearing device.
The hearing device comprises a secondary processing unit and a primary processing unit. The secondary processing unit and the primary processing unit may be embedded as a single processing unit performing the tasks of both the secondary processing unit and the primary processing unit.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other features and advantages of the present invention will become readily apparent to those skilled in the art by the following detailed description of exemplary embodiments thereof with reference to the attached drawings, in which:

Fig. 1 schematically illustrates an exemplary hearing device,
Fig. 2 schematically illustrates an exemplary hearing device,
Fig. 3 schematically illustrates an exemplary position controller,
Fig. 4 schematically illustrates an exemplary secondary processing unit, and
Fig. 5 is a flow diagram for an exemplary method for operating a hearing device.

Various embodiments are described hereinafter with reference to the figures. It should be noted that the figures are not necessarily drawn to scale and that elements of similar structures or functions are represented by like reference numerals throughout the figures. It should also be noted that the figures are only intended to facilitate the description of the embodiments. They are not intended as an exhaustive description of the claimed invention or as a limitation on the scope of the claimed invention. In addition, an illustrated embodiment needs not have all the aspects or advantages shown. An aspect or an advantage described in conjunction with a particular embodiment is not necessarily limited to that embodiment and can be practiced in any other embodiments even if not so illustrated, or if not so explicitly described.

DETAILED DESCRIPTION

The present invention relates to a hearing device and a method enabling adaptation of signal processing in the hearing device based on position data of the hearing device and/or position data of an audio system comprising one or more audio sources.
The hearing device comprises a first transceiver coupled to the first antenna and configured to wirelessly receive one or more audio streams from an audio system, the one or more audio streams including a first audio stream. The first transceiver may be configured to receive and/or sent position data of the audio system and/or the hearing device.
The hearing device comprises a position controller for detecting position data of the hearing device. The position controller has an output coupled to a position input of the secondary processing unit for sending a position control signal to the secondary processing unit. The position controller may comprise a motion detector and a position processing unit connected to the motion detector. The position processing unit is configured to estimate position data of the hearing device based on motion sensor output. The motion detector may comprise one or a plurality of sensors e.g. one or more gyroscopes and/or one or more accelerometers.
The position controller may be configured for determining a position control signal based on the position data of the hearing device. The position controller may comprise a position port and may be configured to receive audio system position data and/or send hearing device position data via the position port. Accordingly, the position controller may be configured for receiving audio system position data, and the position control signal may be based on the audio system position data. The position port may be coupled to the first transceiver and/or second transceiver. Thus, the position controller may be configured to determine and send position control signal based on audio system position data received via the position port. The position controller may comprise a control port for coupling to the primary processing unit for exchange of control signals.
The position data of the hearing device may comprise angular position data of the hearing device, and the position control signal is based on angular position data of the hearing device.
For example, the position data may comprise information of the azimuth angle of the hearing device. The azimuth angle may be indicative of the looking direction of the user wearing the hearing device. Alternatively, or additionally, the position data may comprise information of the altitude angle.
The position data may comprise distance position data of the hearing device. For example, the position data may comprise information of the distance of the hearing device relative to an audio source and/or a reference point.
The secondary processing unit is configured to process input signal(s) such as audio input signal and/or wireless input signal(s) depending on the position control signal.
The position control signal may select the value(s) of gain(s) applied to input signal(s) to the secondary processing unit. Thus the position control signal may be indicative of gain(s) to be applied to input signal(s) to the secondary processing unit. Accordingly, the position control signal may select a value of a first gain to be applied to the first wireless input signal based on the position data of the hearing device.
The one or more audio streams may include a second audio stream that is converted to a second wireless input signal in the first transceiver. The secondary processing unit may be configured to process the second wireless input signal from the first transceiver based on the position control signal. The position control signal may select a value of a second gain to be applied to the second wireless input signal based on the position data of the hearing device. The secondary processing unit may apply a second gain to the second wireless input signal based on the position control signal from the position controller.
The hearing device may comprise a second antenna and/or a second transceiver connected to the position controller for receiving and/or sending position data from/to an audio system.
The at least one microphone may include a first microphone for receiving an acoustic audio signal and converting the acoustic audio signal to an audio input signal. The first microphone may have an output coupled to a second input of the secondary processing unit for feeding the audio input signal to the secondary processing unit. The secondary processing unit may be configured to process the audio input signal based on the position control signal. For example, the position control signal may select a value of a microphone gain to be applied to the audio input signal from the first microphone based on the position data of the hearing device.
The method for operating a hearing device comprises receiving a first audio stream and converting the first audio stream to a first wireless input signal. A first audio stream may be converted into a first and a second wireless input signal.
The method comprises determining position data of the hearing device and processing the first wireless audio signal based on the position data of the hearing device to form an output signal. The method may comprise obtaining position data of an audio system and processing the first wireless audio signal based on the position data of the hearing device and the position data of the audio system to form an output signal; and converting the output signal to an audio output signal.
In an audio system, one or more transceivers or transmitter units comprising transceivers are configured for broadcasting or transmitting audio track(s) and/or audio stream(s), e.g. to one or more hearing devices. The audio system may comprise a first transceiver and optionally a second transceiver. A transceiver may transmit one or more audio streams. A transceiver may be identified by a transceiver address. A transmitter unit may be configured to wirelessly transmit audio track(s) and/or audio stream(s).
An audio track is an audible signal. Exemplary audible signals are speech, music, an airport call, a movie sound track or a combination thereof.
An audio stream is an electromagnetic signal representative of an audio track. An audio stream is represented by a number of audio blocks each comprising one or more audio packets. An audio packet comprises a finite part of an audio stream.
An audio packet may comprise an audio stream identifier, which may comprise one or more elements such as audio track identification, transceiver address or identification, audio group identification, audio source identification, etc. Audio track identification may enable selection of audio streams representative of the same audio track, and audio group identification may identify a certain group of audio tracks or audio streams e.g. an audio group may be audio tracks in the same or similar language, e.g. English, Danish or Chinese.
An audio packet may comprise transceiver address of the transceiver transmitting the audio packet, thus enabling the hearing device to sort out or separate audio packets sent from other transceivers.
Transmitting and receiving the wireless audio stream(s) may be achieved by using wireless technology, thus transmitting/receiving audio blocks at one or more frequencies, e.g. in the range from 2.4 GHz to 2.5 GHz, in the range from 800 MHz to 1 GHz, in the range from 3.6 GHz to 3.7 GHz, and/or in the range from 4.9 GHz to 5.9 GHz.
In the hearing device, the primary processing unit may be configured to control the first transceiver. The first transceiver and/or the second transceiver may be configured to receive and/or send audio streams and/or position data at frequencies in the range from 2.4 GHz to 2.5 GHz, in the range from 800 MHz to 1 GHz, in the range from 3.6 GHz to 3.7 GHz, and/or in the range from 4.9 GHz to 5.9 GHz. The first transceiver and/or the second transceiver may be configured to receive audio streams at frequencies in the range from 169 MHz to 218 MHz and/or in the range from 480 MHz to 520 MHz.
The first and/or second transceiver may be configured to transmit and/or receive wirelessly from/to an audio system with one or more audio sources or other external devices, such as other hearing devices, mobile phone.
The hearing device may be configured for pairing the hearing device with an audio system, e.g. with one or more audio sources of the audio system. Pairing may comprise transmitting hearing device information from the hearing device to the audio system. The hearing device information may comprise one or more of hearing device idenfication, hearing device manufacturer, hearing device model, and/or hearing device configuration data. Pairing of the hearing device with the audio system may additionally or alternatively comprise transmitting audio system information from the audio system to the hearing device and/or receiving audio system information from the audio system. The audio system information may comprise one or more of audio system identification, audio source identification(s), transceiver identification(s) and/or audio stream configuration data. The audio system may be configured to adapt the format of the first audio stream to be sent to the hearing device based on hearing device information received from the hearing device, e.g. model and/or manufacturer, data encoding format etc. Furthermore, pairing of the hearing device with the audio system may comprise exchanging an encryption key, such as to enable encryption of an audio stream, such as the first audio stream, before sending from the audio system, and decryption of the received wireless input signal, e.g. the first wireless input signal, in the hearing device.
Pairing of the hearing device with the audio system may initiate sending of an audio stream, e.g. the first audio stream, from the audio system.
Pairing of the hearing device with the audio system may cause the hearing device to inititate receiving audio stream(s), which is/are sent by the audio system.
The secondary processing unit is configured to process input signal(s) from microphone(s) and/or transceiver(s) to form an input signal to the primary processing unit. The secondary processing unit may apply gain(s) to the input signal(s) and subsequently mix the amplified input signals to form the input signal to the primary processing unit, wherein the gain(s) are controlled by the position controller with the position control signal.
The position controller may be configured to determine a gain or a vector of gains based on position data of the hearing device and/or position data of the audio system.
The first gain G₁ may be given by: $G_{1} = f (P_{HD}),$
where P_HD is position data for the hearing device.
In a hearing device with a plurality of input signals, processing of the input signals may comprise applying a vector of gains. The vector of gains may comprise a gain for each of the input signals. The vector of gains G may be given by: $\underset{̲}{G} = \underset{̲}{f} (P_{HD})$
The plurality of gains and/or the first gain may comprise further inputs, such as position data of the audio system: $\underset{̲}{G} = \underset{̲}{f} (P_{HD}, P_{AS}),$
Where P_HD is position data for the hearing device, and P_AS is position data for the audio system. P_AS may be a vector with position data of the audio system.
The position controller may be configured to set the first gain to a first value if a first field of listening (FIL) criterion is fulfilled, i.e. if the position of the hearing aid indicates that the hearing aid user wishes to listen to a first audio source of the audio system. The position controller may be configured to set the first gain to a second value if the first FIL criterion is not fulfilled or if a secondary first FIL criterion is fulfilled. The first value may be larger than the second value.
The first FIL criterion may be based on the first view angle being the angle between the users direction of view and the direction from the hearing device to the first audio source. The first FIL criterion may be given by: $|α_{1}| < T_{1, 1},$
where α₁ is the first view angle and T_1,1 is a first threshold angle for the first audio source. The first threshold angle T_1,1 may be in the range from 15 to 60 degrees.
The position controller may be configured to set the second gain to a first value if a second field of listening (FIL) criterion is fulfilled, i.e. if the position of the hearing aid indicates that the hearing aid user wishes to listen to a second audio source of the audio system. The position controller may be configured to set the second gain to a second value if the second FIL criterion is not fulfilled or if a secondary second FIL criterion is fulfilled. The first value may be larger than the second value.
The second FIL criterion may be based on the second view angle being the angle between the users direction of view and the direction from the hearing device to the second audio source. The second FIL criterion may be given by: $|α_{2}| < T_{2, 1},$
where α₂ is the second view angle and T_2,1 is a first threshold angle for the second audio source. The first threshold angle T_2,1 may be in the range from 15 to 60 degrees.
The position controller may be configured to set the microphone gain to a first value if a criterion, such as the first FIL criterion and/or the second FIL criterion, is fulfilled. The position controller may be configured to set the microphone gain to a second value if a criterion, such as the first FIL criterion and/or the second FIL criterion, is not fulfilled. The first value may be less than the second value.
The position controller may be configured to determine a gain or a vector of gains based on an audio input signal from a microphone. Thus, the position controller may be coupled to an output of the first microphone. Accordingly, the gains applied to the input signals may be given by: $\underset{̲}{G} = \underset{̲}{f} (P_{HD}, P_{AS}, S_{mic}),$
Where G is a vector with gains for the wireless input signal(s) and/or the audio input signal, P_HD is position data for the hearing device, P_AS is position data from the audio system, and S_mic is a control signal received by the microphone. The control signal S received by the microphone may be within a selected frequency range outside the audible range. P_AS and/or S_mic may be omitted.
Fig. 1 schematically illustrates an exemplary hearing device. The hearing device 1 comprises a first antenna 4 and a first transceiver 6 coupled to the first antenna 4. The first transceiver 6 is configured to wirelessly receive one or more audio streams 54 from an audio system, the one or more audio streams including a first audio stream. Further, the hearing device 1 comprises a primary processing unit 8 adapted for processing an input signal 60 according to a hearing prescription in order to alleviate a hearing loss, an acoustic output transducer 10 coupled to an output of the primary processing unit 8 for conversion of an output signal 62 from the primary processing unit 8 into an audio output signal 64, and at least one microphone including a first microphone 14. The hearing device 1 comprises a secondary processing unit 16 with a first input 18 coupled to an output of the first transceiver 6 for receiving a first wireless input signal 56 representative of the first audio stream from the first transceiver 6, and a position controller 12 for detecting position data of the hearing device, the position controller 12 having an output coupled to a position input of the secondary processing unit for sending a position control signal 66 to the secondary processing unit 16. The secondary processing unit 16 is configured to process the first wireless input signal 56 from the first transceiver 6 based on the position control signal 66. The primary processor 8 may be coupled to the first transceiver 6, e.g. for sending and/or receiving pairing information to/from an audio system.The secondary processing unit 16 has a second input 20 coupled to an output of the first microphone 14 for receiving an audio input signal 58.
The hearing device 1 is configured to pair with an audio system including one or more audio sources. For example, pairing of the hearing device 1 with the one or more audio sources is achieved by pairing the hearing device 1 with the audio system.
The secondary processing unit 16 is configured to process wireless input signal(s) including the first wireless input signal 56 and optionally the audio input signal 58 to form the input signal 60 on an output of the secondary processing unit 16.
The primary processing unit 8 may perform signal processing such as noise reduction, filtering, amplification, etc. of the input signal 60. The primary processing unit 8 may perform signal processing of the input signal 60 to account for hearing disability of the user of the hearing device 1.
The secondary processing unit 16 and the primary processing unit 8 may be embedded as a single processing unit as also indicated with the dotted box in Fig. 2.
The position controller 12 is configured for detecting position data of the hearing device. Based on the position data of the hearing device, the position controller 12 determines gain(s) to be applied to the respective input signals to the secondary processing unit 16 and sends position control signal 66 indicative thereof to the secondary processing unit 16. The secondary processing unit processes the input signal(s) including the first wireless input signal from the first transceiver based on the position control signal 66 from the position controller 12. The first transceiver 6 may be coupled to the position controller 12 for receiving audio system position signal 68 indicative of position data of an audio system and/or sending position data of the hearing device to an audio system.
Fig. 2 schematically illustrates an exemplary hearing device. The hearing device 1 comprises a second antenna 26 and a second transceiver 28 coupled to the position controller 12 for receiving audio system position signal 68 indicative of position data of an audio system and/or sending position data of the hearing device to an audio system.
Fig. 3 schematically illustrates an exemplary position controller 12. The position controller 12 is configured for detecting position data of the hearing device 1 and has an output 30 coupled to a position input of the secondary processing unit 16 for sending a position control signal 66 to the secondary processing unit. The position controller 12 comprises a motion detector 22 and a position processing unit 24 configured for estimating position data of the hearing device based on an output of the motion detector 22 and determining a position control signal 66 based on the position data of the hearing device. Optionally, the position controller may be configured to receive audio system position data and/or send hearing device position data via position port 32. The position port 32 may be coupled to the first transceiver 6 and/or second transceiver 28. The position controller 12 may be configured to determine and send position control signal 66 based on audio system position data from first transceiver 6 and/or second transceiver 28. Optionally, the position controller comprises a control port 34 for coupling to the primary processing unit 8 for exchange of control signals.
Fig. 4 illustrates an exemplary secondary processing unit. The secondary processing unit 16 comprises a number of gain units including a first gain unit with adjustable first gain G₁ and a microphone gain unit with adjustable microphone gain G_MIC. The first gain G₁ applied to the input signal on the first input 18 is controlled by the position control signal 66. The microphone gain G_MIC applied to the audio input signal on the second input 20 is also controlled by the position control signal 66. The amplified/attenuated signals from the gain units are summed in summation unit to form an input signal 60 to the primary processing unit.
Fig. 5 is a flow diagram of an exemplary method for operating a hearing device. The method 100 comprises receiving 102 a first audio stream; converting 104 the first audio stream to a first wireless input signal; determining 106 position data of the hearing device; processing 108 the first wireless audio signal based on the position data of the hearing device to form an output signal; and converting 110 the output signal to an audio output signal.

LIST OF REFERENCES

1: hearing device
4: first antenna
6: first transceiver
8: primary processing unit
10: acoustic output transducer
12: position controller
14: first microphone
16: secondary processing unit
18: first input
20: second input
22: motion detector
24: position processing unit
26: second antenna
28: second transceiver
30: position controller output(s)
32: position port
54: audio stream
56: first wireless input signal
57: second wireless input signal
58: audio input signal
60: input signal
62: output signal
64: audio output signal
66: position control signal
68: audio system position signal
100: method for operating a hearing device
102: receiving audio stream(s)
104: converting audio stream(s) to wireless input signal(s)
106: determining position data of hearing device
108: processing wireless input signal(s) based on position data
110: converting output signal to audio output signal

Claims

Hearing device comprising
- a first antenna;

- a first transceiver coupled to the first antenna and configured to wirelessly receive one or more audio streams from an audio system, the one or more audio streams including a first audio stream;

- a primary processing unit adapted for processing an input signal according to a hearing prescription in order to alleviate a hearing loss;

- an acoustic output transducer coupled to an output of the primary processing unit for conversion of an output signal from the primary processing unit into an audio output signal;

- at least one microphone;

- a secondary processing unit with a first input coupled to an output of the first transceiver for receiving a first wireless input signal representative of the first audio stream from the first transceiver; and

- a position controller for detecting position data of the hearing device, the position controller having an output coupled to a position input of the secondary processing unit for sending a position control signal to the secondary processing unit;
wherein the secondary processing unit is configured to process the first wireless input signal from the first transceiver based on the position control signal.
Hearing device according to claim 1, wherein the position controller comprises a motion detector and a position processing unit connected to the motion detector and configured to estimate position data of the hearing device based on motion sensor output.
Hearing device according to any of claims 1-2, wherein the position data comprises angular position data of the hearing device, and wherein the position control signal is based on angular position data of the hearing device.
Hearing device according to any of the preceding claims, wherein a first gain signal is applied to the first wireless input signal based on the position data of the hearing device.
Hearing device according to any of the preceding claims, wherein the one or more audio streams includes a second audio stream converted to a second wireless input signal in the first transceiver, and wherein the secondary processing unit is configured to process the second wireless input signal from the first transceiver based on the position control signal.
Hearing device according to claim 4, wherein a second gain signal is applied to the second wireless input signal based on the position data of the hearing device.
Hearing device according to any of the preceding claims, wherein the hearing device comprises a second antenna connected to the position controller for receiving and/or sending position data from/to an audio system.
Hearing device according to any of the preceding claims, wherein the position controller is configured for receiving audio system position data, and wherein the position control signal is based on the audio system position data.
Hearing device according to any of the preceding claims, wherein the at least one microphone includes a first microphone for receiving an acoustic audio signal and converting the acoustic audio signal to an audio input signal, the first microphone having an output coupled to a second input of the secondary processing unit for feeding the audio input signal to the secondary processing unit, and wherein the secondary processing unit is configured to process the audio input signal based on the position control signal.
Method for operating a hearing device, the method comprising:
- receiving a first audio stream;

- converting the first audio stream to a first wireless input signal;

- determining position data of the hearing device;

- processing the first wireless audio signal based on the position data of the hearing device to form an output signal; and

- converting the output signal to an audio output signal.
Method according to claim 10, the method comprising
- receiving an acoustic audio signal;

- converting the acoustic audio signal to an audio input signal; and

- processing the audio input signal and the first wireless audio signal based on the position data of the hearing device to form the output signal.