EP4311262A1

EP4311262A1 - A hearing aid with ultrasonic transceiver

Info

Publication number: EP4311262A1
Application number: EP23157312.2A
Authority: EP
Inventors: Lars Riemer
Original assignee: Oticon AS
Current assignee: Oticon AS
Priority date: 2023-02-17
Filing date: 2023-02-17
Publication date: 2024-01-24

Abstract

Disclosed herein is a hearing aid. In some examples, the hearing aid includes an input unit configured to convert a sound in an environment of the hearing aid to at least one electrical input signal representative of the sound. The hearing aid can include an ultrasonic transceiver configured to output an ultrasonic signal and to receive a reflected ultrasonic signal from the environment. The hearing aid can include a signal processor configured to determine, based on the reflected ultrasonic signal and optionally the at least one electrical input signal, an audio parameter indicative of an object in the environment.

Description

SUMMARY

A hearing aid:

In an aspect of the present application, a hearing aid is provided. The hearing aid comprises an input unit. The input unit can be configured to convert a sound in an environment of the hearing aid to at least one electrical input signal representative of the sound. The hearing aid includes an ultrasonic transceiver. The ultrasonic transceiver can be configured to output an ultrasonic signal. The ultrasonic transceiver can be configured to receive a reflected ultrasonic signal from the environment. The hearing aid includes a signal processor. The signal processor configured to determine, based on the reflected ultrasonic signal and optionally the at least one electrical input signal, an audio parameter indicative of an object in the environment. The signal processor configured to determine, based on the reflected ultrasonic signal and the at least one electrical input signal, an audio parameter indicative of an object in the environment. The signal processor configured to determine, based on the reflected ultrasonic signal and optionally the at least one electrical input signal, an audio parameter indicative of a desired sound in the environment.
Advantageously, embodiments of the disclosed hearing aid can utilize ultrasonic signals for determining aspects of the environment around a user. For example, the ultrasonic signals can advantageously be used to determine objects around a user. Further, the ultrasonic signals can be used to determine sound source locations and/or sound source movement. For example, the disclosed hearing aid can use the Doppler frequency shift to detect movement of a sound source. In some instances, ultrasonic signals can have improved resolution for large distances as compared to current microphones in hearing aids. Moreover, ultrasonic signals can be simpler, cheaper, and less power consumptive than radar technology. Using sonar technology, much of the cost and complexity of the radar solution is avoided. For example, the disclosed hearing aid only uses the addition of an ultrasound transmitter, instead of a whole radar subsystem. Additionally, as ultrasound signals move much slower than radar signals, a greater resolution is possible with a cheaper and/or simpler implementation. Moreover, ultrasonic signals can avoid interfering with normal hearing aid operation, while the already-existing hearing aid microphones can be used to receive the return signal.
The hearing aid may be adapted to provide a frequency dependent gain and/or a level dependent compression and/or a transposition (with or without frequency compression) of one or more frequency ranges to one or more other frequency ranges, e.g. to compensate for a hearing impairment of a user. The hearing aid may comprise a signal processor for enhancing the input signals and providing a processed output signal.
The hearing aid may comprise an input unit for providing an electric input signal representing sound. The input unit may comprise an input transducer, e.g. a microphone, for converting an input sound to an electric input signal. The input unit may comprise a sound microphone and/or an ultrasound microphone. The sound microphone can be configured to receive sound from the environment. The ultrasound microphone can be configured to receive reflected ultrasonic signals. In certain implementations, the same input unit (e.g., microphone) may receive both the sounds from the environment and the reflected ultrasonic signals. The input unit may comprise a wireless receiver for receiving a wireless signal comprising or representing sound and for providing an electric input signal representing said sound. For example, the hearing aid may comprise a directional microphone system adapted to spatially filter sounds from the environment, and thereby enhance a target acoustic source among a multitude of acoustic sources in the local environment of the user wearing the hearing aid. The directional system may be adapted to detect (such as adaptively detect) from which direction a particular part of the microphone signal originates. This can be achieved in various different ways as e.g. described in the prior art. In hearing aids, a microphone array beamformer is often used for spatially attenuating background noise sources. The beamformer may comprise a linear constraint minimum variance (LCMV) beamformer. Many beamformer variants can be found in literature. The minimum variance distortionless response (MVDR) beamformer is widely used in microphone array signal processing. Ideally the MVDR beamformer keeps the signals from the target direction (also referred to as the look direction) unchanged, while attenuating sound signals from other directions maximally. The generalized sidelobe canceller (GSC) structure is an equivalent representation of the MVDR beamformer offering computational and numerical advantages over a direct implementation in its original form.
The hearing aid may comprise an output unit for providing a stimulus perceived by the user as an acoustic signal based on a processed electric signal. The output unit may comprise a number of electrodes of a cochlear implant (for a CI type hearing aid) or a vibrator of a bone conducting hearing aid. The output unit may comprise an output transducer. The output transducer may comprise a receiver (loudspeaker) for providing the stimulus as an acoustic signal to the user (e.g. in an acoustic (air conduction based) hearing aid). The output transducer may comprise a vibrator for providing the stimulus as mechanical vibration of a skull bone to the user (e.g. in a bone-attached or bone-anchored hearing aid). The output unit may (additionally or alternatively) comprise a transmitter for transmitting sound picked up-by the hearing aid to another device, e.g. a far-end communication partner (e.g. via a network, e.g. in a telephone mode of operation, or in a headset configuration).
The hearing aid can include an ultrasonic transceiver. The ultrasonic transceiver may be known as a sonar transceiver (e.g., the sonar transceiver is configured to output a sonar signal and receive a reflected sonar signal). In one or more examples, the ultrasonic transceiver may act as an ultrasonic transmitter and/or an ultrasonic receiver. In one or more examples, the ultrasonic transceiver may comprise an ultrasonic transmitter and/or an ultrasonic receiver in place of the ultrasonic transceiver. As used herein, the ultrasonic transceiver can be an ultrasonic transmitter, an ultrasonic receiver, or both.
The ultrasonic transmitter can be configured to output an ultrasonic signal. The ultrasonic receiver can be configured to receive the reflected ultrasonic signal from the environment. The receiver portion of the ultrasonic transceiver (such as the ultrasonic receiver) may be the input unit (e.g., part of the input unit and/or an addition the input unit). The receiver portion of the ultrasonic transceiver (such as the ultrasonic receiver) may be a microphone.
The ultrasonic transceiver and/or the signal processor can include, for example, an array of transducers for beamforming. For example, the ultrasonic transceiver and/or the signal processor can be configured for vertical plane beamforming, horizontal plane beamforming, and combinations thereof.
The ultrasonic transceiver may be located within a housing of the hearing aid. The ultrasonic transceiver may be attached onto a housing of the hearing aid. For example, the ultrasonic transceiver may be attached on an outer surface of the housing of the hearing aid.
The ultrasonic transceiver can be configured to produce an ultrasonic signal. The ultrasonic transceiver can then output (e.g., transmit, send) the ultrasonic signal into the environment. When the ultrasonic signal interacts with an object in the environment, it is reflected by the object (e.g., in the form of a reflected ultrasonic signal). The ultrasonic transceiver can then receive such a reflected ultrasonic signal.
The signal processor associated the ultrasonic transceiver may be the signal processor associated with the input unit. The signal process associated the ultrasonic transceiver may be different from a signal processor associated with the input unit. The signal processor can be configured to determine the audio parameter. The audio parameter can be one or more audio parameters. The signal processor can be configured to determine the audio parameter based on the reflected ultrasonic signal. The signal processor can be configured to determine the audio parameter based on the reflected ultrasonic signal and the at least one electrical input signal.
The audio parameter can be seen as a parameter indicative of an object in the environment. The audio parameter can be seen as a parameter indicative of a plurality of objects in the environment. The audio parameter can be indicative of a location of the object in the environment. The audio parameter can be indicative of a distance of the object to the hearing aid. The audio parameter can be indicative of a location of an object in the environment producing the sound. The audio parameter can be indicative of a location of an object in the environment not producing the sound. For example, the audio parameter can be used by the signal processor for remote object detecting. The hearing aid can be understood to include an object detector. The audio parameter can be a representation of the object in the environment.
The audio parameter may be indicative of whether the object is an active sound source or not. If the signal processor determines that the audio parameter is indicative of the object being an active sound source, the signal process can be configured to adjust a directionality of the input unit based on the audio parameter. If the signal processor determines that the audio parameter is not indicative of the object being an active sound source, the signal process can be configured to not adjust a directionality of the input unit. In the cocktail scenario, one source may be identified as a preferred source and the directional microphone system may be adapted accordingly, even if more active sound sources are identified. A combination of the remote object detection unit and the directional microphone system may be used for identifying remote active sound sources.
The ultrasonic transceiver can be used to detect active and silent remote objects and the directionality of the input unit could be used for scanning the remote objects detected by the remote object detection unit to classify them as active or silent. For example, the signal processor can be configured to determine the audio parameter indicative of whether the object is active or silent. In certain examples, the signal process can be configured to determine whether the audio parameter is indicative of the object being active or silent based on the at least one electrical input signal and the reflected ultrasonic signal. For example, if the reflected ultrasonic signal matches with the at least one electrical input signal, the signal processor can determine the audio parameter indicative of the object being active. For example, if the reflected ultrasonic signal does not match with the at least one electrical input signal, the signal processor can determine the audio parameter indicative of the object being silent.
Sound processing algorithms may be used to track the relative movement of a sound source identified via the input unit (e.g., directional microphone). In addition to this, or in the alternative, the ultrasonic transceiver may be employed for remote object detection (e.g., remote objection detection unit). The ultrasonic transceiver can be configured to detect a remote object, such as a person or an inanimate object, by detecting the reflected ultrasonic signal which has been reflected from the object (e.g., via the audio parameter).
For conserving power, the ultrasonic transceiver may be set up to sweep a certain angle interval relative to the hearing aid. In some examples, the ultrasonic transceiver may be configured to sweep an area or angle at certain intervals. The ultrasonic transceiver may be setup for detecting objects according to previously detected object, e.g., if one object has been identified recently via the audio parameter, a scheme for sweeping may be adapted accordingly. This scheme could be aimed at detecting new sound sources and/or to maintain the direction of the input unit pointed at the sound source, which may be shifted due to head movements and/or the sound source moving. In environments where multiple people are present, e.g. the classic cocktail party scenario, the ultrasonic transceiver may be used to keep track of possible sound sources, and the input unit and the accompanying audio processing algorithms, may then be used to point out the desired sound target from the identified possible sound sources. This may alleviate the sound processing as less time and processing is used to identify active sound targets.
In one or more examples, the signal processor can be configured to apply noise reduction to the at least one electrical input signal based on the audio parameter. In one or more examples, the signal processor can be configured to apply noise enhancement to the at least one electrical input signal based on the audio parameter.
In one or more example hearing aids, the signal processor can be configured to determine an audio parameter indicative of the object being the object producing the sound as moving away from the hearing aid. Based on the determination that the object being the object producing the sound as moving away from the hearing aid, the signal processor can apply noise reduction to the at least one electrical input signal representative of the sound. As the object is moving away from the hearing aid, it may be advantageous to reduce the level of the at least one electrical input signal. For example, the sound may not be relevant to the user.
In one or more example hearing aids, the signal processor can be configured to determine an audio parameter indicative of the object being the object producing the sound as moving towards the hearing aid. Based on the determination that the object being the object producing the sound as moving towards the hearing aid, the signal processor can apply noise enhancement to the at least one electrical input signal representative of the sound. As the object is moving towards the hearing aid, it may be advantageous to enhance the level of the at least one electrical input signal.
In one or more examples, the signal processor is configured to determine a directionality of the sound. In one or more examples, the signal processor is configured to determine, based on the reflected ultrasonic signal and the audio parameter, a directionality of the sound. In one or more examples, the signal processor is configured to determine a directionality of the object. In one or more examples, the signal processor is configured to determine, based on the reflected ultrasonic signal and the audio parameter, a directionality of the object. For example, the signal processor may be configured to adjust the input unit, such as the directional microphone, towards the sound. For example, the signal processor can apply beamforming to the input unit towards the object and/or sound. This can improve the at least one electrical input signal of the hearing aid. In one or more examples, the signal processor is configured to determine a directional parameter of the object and/or the sound. The output unit of the hearing aid can be configured to output an audio signal hearable by the user, based on the directional parameter. This audio signal may be understood as an audio cue representative of the location of the sound source. The directionality of the object may be considered a direction of the object from the user.
In one or more examples, the signal processor is configured to determine a location of the sound. In one or more examples, the signal processor is configured to determine, based on the reflected ultrasonic signal and the audio parameter, a location of the sound. In one or more examples, the signal processor is configured to determine a location of the object. In one or more examples, the signal processor is configured to determine, based on the reflected ultrasonic signal and the audio parameter, a location of the object. For example, the signal processor can determine the time from the ultrasonic transceiver outputting the ultrasonic signal to the ultrasonic transceiver receiving the reflected ultrasonic signal as compared to the speed of sound.
In one or more examples, the input unit is a directional microphone having adaptable directionality. In certain examples, the signal processor is configured to adjust the directionality of the directional microphone based on the reflected ultrasonic signal. For example, the signal processor is configured to adjust the directionality by applying a beamforming to the directional microphone. In some examples, the signal processor is configured to output a control signal to adjust the directionality by physically moving (e.g., translating and/or rotating) the directional microphone. The signal processor can be configured to adjust the directionality of the directional microphone in order to receive the sound in an improved manner.
In one or more examples, the ultrasonic transceiver is configured to output pulses of the ultrasonic signal and/or the ultrasonic signal continuously. Outputting the ultrasonic signal continuously may be understood as outputting a continuous wave. The ultrasonic transceiver can be configured to switch between outputting the pluses of the ultrasonic signal and the ultrasonic signal continuously.
In one or more examples, the signal processor is configured to determine a velocity of the object in the environment. In one or more examples, the signal processor is configured to determine, based on the audio parameter, a velocity of the object in the environment. The audio parameter can be indicative of the velocity of the object. In one or more examples, the signal processor is configured to determine, based on the reflected ultrasonic signal and the audio parameter, a velocity of the object in the environment. The velocity can be a linear velocity and/or a radial velocity. For example, the signal processor can utilize the doppler principle for determining a velocity of the object. The signal processor can be configured to determine the velocity of the object which is producing the sound. The signal processor can be configured to determine the velocity of the object which is not producing the sound. For example, the signal processor can be configured to determine a time difference between the audio transceiver outputting the ultrasonic signal and the ultrasonic transceiver receiving the ultrasonic signal over a period of time.
In one or more examples, the hearing aid can further include an output unit. The output unit can be configured to provide an acoustic signal upon determination of an object in the environment having a velocity above a threshold. The output unit can be configured to not provide an acoustic signal upon determination of an object in the environment having a velocity at or below the threshold. The output unit can be a speaker unit, such as a loudspeaker. The output unit can be configured to provide the at least one electrical input signal as an audible sound to a user, such as after any gain or sound attenuation is applied.
The determined velocity, possibly along with the direction, could be used to determine if imminent danger of collision. For example, based on the audio parameter indicative of the velocity and/or direction of the object, the signal processor can determine a likelihood of interaction of the object and the user. This could be advantageous when the user is moving around in a busy environment, such as a city center with cars, busses, trucks, bicycles, and people. A speaker unit could then provide an acoustic signal upon detection of a remote object having a speed above a given threshold, as this could indicate e.g. an approaching vehicle.
In one or more examples, the ultrasonic signal includes a unique identifier. For example, the ultrasonic signal can have a unique identifier of a unique "chirp". The signal processor can use the unique identifier to separate out other hearing aid's ultrasonic signals. The signal processor can determine the reflected ultrasonic signal based on the unique identifier.
In one or more examples, the signal processor is configured to determine a speaker's mouth and/or tongue movement. In one or more examples, the signal processor is configured to determine, based on the reflected ultrasonic signal and the audio parameter, a speaker's mouth and/or tongue movement. In one or more examples, the signal processor is configured to determine, based on the reflected ultrasonic signal and the audio parameter, a speaker's mouth and/or tongue movement. For example, the reflected ultrasonic signal can be indicative of a speaker's mouth position as the reflected ultrasonic signal may be angled based on the particular mouth position. In one or more examples, the signal processor is configured to determined, based on the reflected ultrasonic signal and possibly the audio parameter, fine-structure signal content indicative of the speaker's mouth opening and/or closing and/or tongue movement.
In one or more examples, the signal processor is configured to output a warning signal. In one or more examples, the signal processor is configured to, based on the reflected ultrasonic signal, output a warning signal. For example, the hearing aid may output the warning signal as an audio output, such as from an output unit. The warning signal can be a general warning signal, like a beep or a tone. The warning signal may be configured as a cue to a user, such as for a distance to the nearest object, a distance-and-direction to the object(s), and/or a movement of object(s) as indicated by the audio parameter. Advantageously, the hearing aid can be used to enable warning the user of fast-moving objects, like cars. In some examples, the warning signal may be a vibration. For example, a small vibrational unit may be included in the hearing aid to provide a vibrational sensation at the ear. For binaural systems, that is a system with a hearing aid at each ear, it is also possible to provide directionality the warning, so that if something is approaching from the left, a warning is given at the left ear, etc.
In certain examples, the signal processor can be configured to determine whether the audio parameter is indicative of the object being below a proximity threshold. In accordance with the audio parameter being indicative of the object being below the proximity threshold, the hearing aid is configured to output an audio warning signal. In accordance with the audio parameter being indicative of the object being at or above the proximity threshold, the hearing aid is configured to not output an audio warning signal. The proximity threshold can be a specific distance away from the user. The proximity threshold may be set by the user and/or set during manufacturing and/or setup of the hearing aid.
In one or more examples, the signal processor is configured to determine a navigation parameter. In one or more examples, the signal processor is configured to determine, based on the reflected ultrasonic signal and the audio parameter, a navigation parameter. In certain examples, the signal processor is configured to provide the navigation parameter to a user of the hearing aid. The hearing aid may be configured to provide an audible tone and/or a vibration based on the navigation parameter. For example, the hearing aid can use the ultrasonic transceiver to function as a navigation aid for a vision-impaired user. The hearing aid can be configured to determine an acoustic map based on the navigation parameter. A vision-impaired user with perfect hearing could also use the hearing aid as a navigation aid without needing any audio enhancements.
In one or more examples, the ultrasonic signal is in a frequency between 20kHz and 500 kHz. The ultrasonic signal can be in a frequency above 20kHz. Advantageously, the ultrasonic signal may not be heard by humans. In some examples, the ultrasonic signal may be at a frequency that does not bother animals, such as dogs.
In one or more examples, the hearing aid further includes an output unit. The output unit can be configured to output an audible signal. The output unit can be configured to output, based on the at least one electronic signal and the audio parameter, an audible signal. The audible signal may be indicative of the warning signal. The audible signal can be the electrical input signal with gain and/or attenuation applied.
In one or more examples, the hearing aid can be constituted by or comprising an air-conduction type hearing aid, a bone-conduction type hearing aid, a cochlear implant type hearing aid, or a combination thereof.
The hearing aid may be or form part of a portable (i.e. configured to be wearable) device, e.g. a device comprising a local energy source, e.g. a battery, e.g. a rechargeable battery. The hearing aid may e.g. be a low weight, easily wearable, device, e.g. having a total weight less than 100 g, such as less than 20 g.
The hearing aid may comprise a 'forward' (or `signal') path for processing an audio signal between an input and an output of the hearing aid. A signal processor may be located in the forward path. The signal processor may be adapted to provide a frequency dependent gain according to a user's particular needs (e.g. hearing impairment). The hearing aid may comprise an 'analysis' path comprising functional components for analyzing signals and/or controlling processing of the forward path. Some or all signal processing of the analysis path and/or the forward path may be conducted in the frequency domain, in which case the hearing aid comprises appropriate analysis and synthesis filter banks. Some or all signal processing of the analysis path and/or the forward path may be conducted in the time domain.
An analogue electric signal representing an acoustic signal may be converted to a digital audio signal in an analogue-to-digital (AD) conversion process, where the analogue signal is sampled with a predefined sampling frequency or rate f_s, f_s being e.g. in the range from 8 kHz to 48 kHz (adapted to the particular needs of the application) to provide digital samples x_n (or x[n]) at discrete points in time t_n (or n), each audio sample representing the value of the acoustic signal at t_n by a predefined number N_b of bits, N_b being e.g. in the range from 1 to 48 bits, e.g. 24 bits. Each audio sample is hence quantized using N_b bits (resulting in 2^Nb different possible values of the audio sample). A digital sample x has a length in time of 1/f_s, e.g. 50 µs, for f_s = 20 kHz. A number of audio samples may be arranged in a time frame. A time frame may comprise 64 or 128 audio data samples. Other frame lengths may be used depending on the practical application.
The hearing aid may comprise an analogue-to-digital (AD) converter to digitize an analogue input (e.g. from an input transducer, such as a microphone) with a predefined sampling rate, e.g. 20 kHz. The hearing aids may comprise a digital-to-analogue (DA) converter to convert a digital signal to an analogue output signal, e.g. for being presented to a user via an output transducer.
The hearing aid may be configured to operate in different modes, e.g. a normal mode and one or more specific modes, e.g. selectable by a user, or automatically selectable. A mode of operation may be optimized to a specific acoustic situation or environment, e.g. a communication mode, such as a telephone mode. A mode of operation may include a low-power mode, where functionality of the hearing aid is reduced (e.g. to save power), e.g. to disable wireless communication, and/or to disable specific features of the hearing aid. A mode of ultrasonic can be a mode in which the hearing aid enables the ultrasonic transceiver. A mode of ultrasonic can be a mode in which the hearing aid disables the ultrasonic transceiver.
The hearing aid may further comprise other relevant functionality for the application in question, e.g. compression, noise reduction, etc.
The hearing aid may comprise a hearing instrument, e.g. a hearing instrument adapted for being located at the ear or fully or partially in the ear canal of a user, e.g. a headset, an earphone, an ear protection device or a combination thereof. A hearing system may comprise a speakerphone (comprising a number of input transducers and a number of output transducers, e.g. for use in an audio conference situation), e.g. comprising a beamformer filtering unit, e.g. providing multiple beamforming capabilities.

Use:

In an aspect, use of a hearing aid as described above, in the `detailed description of embodiments' and in the claims, is moreover provided. Use may be provided in a system comprising one or more hearing aids (e.g. hearing instruments), headsets, earphones, active ear protection systems, etc., e.g. in handsfree telephone systems, teleconferencing systems (e.g. including a speakerphone), public address systems, karaoke systems, classroom amplification systems, etc.

A method:

In an aspect, a method of operating a hearing aid furthermore provided by the present application. The method includes receiving a sound from the environment. The method can include converting the sound into at least one electrical input signal representative of the sound. The method can include outputting an ultrasonic signal. The method can include receiving a reflected ultrasonic signal from the environment. The method can include determining, based on the reflected ultrasonic signal and optionally the at least one electrical input signal, an audio parameter indicative of an object in the environment. The method can include determining, based on the reflected ultrasonic signal and the at least one electrical input signal, an audio parameter indicative of an object in the environment.
It is intended that some or all of the structural features of the hearing aid described above, in the `detailed description of embodiments' or in the claims can be combined with embodiments of the method, when appropriately substituted by a corresponding process and vice versa. Embodiments of the method have the same advantages as the corresponding hearing aids.

A computer readable medium or data carrier:

In an aspect, a tangible computer-readable medium (a data carrier) storing a computer program comprising program code means (instructions) for causing a data processing system (a computer) to perform (carry out) at least some (such as a majority or all) of the (steps of the) method described above, in the `detailed description of embodiments' and in the claims, when said computer program is executed on the data processing system is furthermore provided by the present application.
By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. Disk and disc, as used herein, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Other storage media include storage in DNA (e.g. in synthesized DNA strands). Combinations of the above should also be included within the scope of computer-readable media. In addition to being stored on a tangible medium, the computer program can also be transmitted via a transmission medium such as a wired or wireless link or a network, e.g. the Internet, and loaded into a data processing system for being executed at a location different from that of the tangible medium.

A computer program:

A computer program (product) comprising instructions which, when the program is executed by a computer, cause the computer to carry out (steps of) the method described above, in the `detailed description of embodiments' and in the claims is furthermore provided by the present application.

A data processing system:

In an aspect, a data processing system comprising a processor and program code means for causing the processor to perform at least some (such as a majority or all) of the steps of the method described above, in the `detailed description of embodiments' and in the claims is furthermore provided by the present application.

A hearing system:

In a further aspect, a hearing system comprising a hearing aid as described above, in the `detailed description of embodiments', and in the claims, and an auxiliary device is moreover provided.
The hearing system may be adapted to establish a communication link between the hearing aid and the auxiliary device to provide that information (e.g. control and status signals, possibly audio signals) can be exchanged or forwarded from one to the other.
The auxiliary device may comprise a remote control, a smartphone, or other portable or wearable electronic device, such as a smartwatch or the like.
The auxiliary device may be constituted by or comprise a remote control for controlling functionality and operation of the hearing aid(s). The function of a remote control may be implemented in a smartphone, the smartphone possibly running an APP allowing to control the functionality of the audio processing device via the smartphone (the hearing aid(s) comprising an appropriate wireless interface to the smartphone, e.g. based on Bluetooth or some other standardized or proprietary scheme).
The auxiliary device may be constituted by or comprise an audio gateway device adapted for receiving a multitude of audio signals (e.g. from an entertainment device, e.g. a TV or a music player, a telephone apparatus, e.g. a mobile telephone or a computer, e.g. a PC) and adapted for selecting and/or combining an appropriate one of the received audio signals (or combination of signals) for transmission to the hearing aid.
The auxiliary device may be constituted by or comprise another hearing aid. The hearing system may comprise two hearing aids adapted to implement a binaural hearing system, e.g. a binaural hearing aid system.

An APP:

In a further aspect, a non-transitory application, termed an APP, is furthermore provided by the present disclosure. The APP comprises executable instructions configured to be executed on an auxiliary device to implement a user interface for a hearing aid or a hearing system described above in the `detailed description of embodiments', and in the claims. The APP may be configured to run on cellular phone, e.g. a smartphone, or on another portable device allowing communication with said hearing aid or said hearing system.

Definitions:

In the present context, a hearing aid, e.g. a hearing instrument, refers to a device, which is adapted to improve, augment and/or protect the hearing capability of a user by receiving acoustic signals from the user's surroundings, generating corresponding audio signals, possibly modifying the audio signals and providing the possibly modified audio signals as audible signals to at least one of the user's ears. Such audible signals may e.g. be provided in the form of acoustic signals radiated into the user's outer ears, acoustic signals transferred as mechanical vibrations to the user's inner ears through the bone structure of the user's head and/or through parts of the middle ear as well as electric signals transferred directly or indirectly to the cochlear nerve of the user.
The hearing aid may be configured to be worn in any known way, e.g. as a unit arranged behind the ear with a tube leading radiated acoustic signals into the ear canal or with an output transducer, e.g. a loudspeaker, arranged close to or in the ear canal, as a unit entirely or partly arranged in the pinna and/or in the ear canal, as a unit, e.g. a vibrator, attached to a fixture implanted into the skull bone, as an attachable, or entirely or partly implanted, unit, etc. The hearing aid may comprise a single unit or several units communicating (e.g. acoustically, electrically or optically) with each other. The loudspeaker may be arranged in a housing together with other components of the hearing aid or may be an external unit in itself (possibly in combination with a flexible guiding element, e.g. a dome-like element).
A hearing aid may be adapted to a particular user's needs, e.g. a hearing impairment. A configurable signal processing circuit of the hearing aid may be adapted to apply a frequency and level dependent compressive amplification of an input signal. A customized frequency and level dependent gain (amplification or compression) may be determined in a fitting process by a fitting system based on a user's hearing data, e.g. an audiogram, using a fitting rationale (e.g. adapted to speech). The frequency and level dependent gain may e.g. be embodied in processing parameters, e.g. uploaded to the hearing aid via an interface to a programming device (fitting system) and used by a processing algorithm executed by the configurable signal processing circuit of the hearing aid.
A 'hearing system' refers to a system comprising one or two hearing aids, and a `binaural hearing system' refers to a system comprising two hearing aids and being adapted to cooperatively provide audible signals to both of the user's ears. Hearing systems or binaural hearing systems may further comprise one or more `auxiliary devices', which communicate with the hearing aid(s) and affect and/or benefit from the function of the hearing aid(s). Such auxiliary devices may include at least one of a remote control, a remote microphone, an audio gateway device, an entertainment device, e.g. a music player, a wireless communication device, e.g. a mobile phone (such as a smartphone) or a tablet or another device, e.g. comprising a graphical interface. Hearing aids, hearing systems or binaural hearing systems may e.g. be used for compensating for a hearing-impaired person's loss of hearing capability, augmenting or protecting a normal-hearing person's hearing capability and/or conveying electronic audio signals to a person. Hearing aids or hearing systems may e.g. form part of or interact with public-address systems, active ear protection systems, handsfree telephone systems, car audio systems, entertainment (e.g. TV, music playing or karaoke) systems, teleconferencing systems, classroom amplification systems, etc.

BRIEF DESCRIPTION OF DRAWINGS

The aspects of the disclosure may be best understood from the following detailed description taken in conjunction with the accompanying figures. The figures are schematic and simplified for clarity, and they just show details to improve the understanding of the claims, while other details are left out. Throughout, the same reference numerals are used for identical or corresponding parts. The individual features of each aspect may each be combined with any or all features of the other aspects. These and other aspects, features and/or technical effect will be apparent from and elucidated with reference to the illustrations described hereinafter in which:

FIG. 1 shows an example hearing aid according to the disclosure,
FIG. 2 shows an example ultrasonic transceiver according to the disclosure,
FIG. 3 shows an example block diagram of a hearing aid according to the disclosure, and
FIG. 4 shows an example method of operating a hearing aid according to the disclosure.

The figures are schematic and simplified for clarity, and they just show details which are essential to the understanding of the disclosure, while other details are left out. Throughout, the same reference signs are used for identical or corresponding parts.
Further scope of applicability of the present disclosure will become apparent from the detailed description given hereinafter. However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the disclosure, are given by way of illustration only. Other embodiments may become apparent to those skilled in the art from the following detailed description.

DETAILED DESCRIPTION OF EMBODIMENTS

The detailed description set forth below in connection with the appended drawings is intended as a description of various configurations. The detailed description includes specific details for the purpose of providing a thorough understanding of various concepts. However, it will be apparent to those skilled in the art that these concepts may be practiced without these specific details. Several aspects of the apparatus and methods are described by various blocks, functional units, modules, components, circuits, steps, processes, algorithms, etc. (collectively referred to as "elements"). Depending upon particular application, design constraints or other reasons, these elements may be implemented using electronic hardware, computer program, or any combination thereof.
The electronic hardware may include micro-electronic-mechanical systems (MEMS), integrated circuits (e.g. application specific), microprocessors, microcontrollers, digital signal processors (DSPs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), gated logic, discrete hardware circuits, printed circuit boards (PCB) (e.g. flexible PCBs), and other suitable hardware configured to perform the various functionality described throughout this disclosure, e.g. sensors, e.g. for sensing and/or registering physical properties of the environment, the device, the user, etc. Computer program shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.
The present application relates to the field of hearing aids.
FIG. 1 shows an example hearing aid 10 according to the disclosure. The hearing aid 10 is configured to be worn behind the user's ears and comprises a behind-the-ear part 12 and an in-the-ear part 14. The behind-the-ear part 12 is connected to the in-the-ear part 14 via connecting member 16. However, the hearing aid 10 may be configured in other ways e.g., as completely-in-the-ear hearing aids. The behind-the-ear part 12 can include an input unit. The input unit can be configured to convert a sound in an environment of the hearing aid 10 to at least one electrical input signal representative of the sound. The in-the-ear part 14 can include an output unit.
The hearing aid 10 can further include an ultrasonic transceiver 20. The ultrasonic transceiver 20 can be configured to output an ultrasonic signal 22. The ultrasonic signal 22 can be in a frequency between 20kHZ and 500 kHz. The ultrasonic transceiver 20 can be configured to receive a reflected ultrasonic signal 24 from the environment. The ultrasonic transceiver 20 is configured to output pulses of the ultrasonic signal and/or the ultrasonic signal continuously. The ultrasonic transceiver 20 could alternatively be an ultrasonic transmitter and/or an ultrasonic receiver.
The hearing aid 10 can further include a signal processor (shown in FIG. 3) configured to determine, based on the reflected ultrasonic signal and optionally the at least one electrical input signal, an audio parameter indicative of an object in the environment.
FIG. 2 shows an example ultrasonic transceiver 20 according to the disclosure. As shown, the ultrasonic transceiver 20 can optionally be an ultrasonic transmitter 26 and an ultrasonic receiver 28. The ultrasonic transceiver 20 and/or the ultrasonic transmitter 26 output an ultrasonic signal 22. The ultrasonic signal 22 can interact with an object 30 in the environment, which would cause a reflected ultrasonic signal 24 to travel back to the hearing aid 10. One or more of the ultrasonic transceivers 20, the ultrasonic receiver 28, and the output unit of the hearing aid can receive the reflected ultrasonic signal 24. The the ultrasonic signal 22 can have a unique identifier.
FIG. 3 shows an example block diagram of an example hearing aid 10 according to the disclosure. The hearing aid 10 comprises an input unit 111, an output unit 112, a man-machine interface unit 114, a memory 115, a wireless communication unit (WLC unit) 116, a battery 117 and a processor 120. The battery may be a single-use battery or a rechargeable battery. The processor 120 may comprise a unit 121 configured to perform hearing loss compensation, a unit 122 configured to perform noise reduction, and a unit (MMI control) 123 for controlling man-machine interfacing. The signal processor 120 is configured to apply noise reduction to the at least one electrical input signal based on the audio parameter, such as via unit 122.
The signal processor 120 can be configured to determine, based on the reflected ultrasonic signal and the audio parameter, a directionality of the sound. The signal processor 120 can be configured to determine, based on the reflected ultrasonic signal and the audio parameter, a velocity of the object in the environment. The signal processor 120 can be configured to determine, based on the reflected ultrasonic signal and the audio parameter, a speaker's mouth and/or tongue movement. The signal processor 120 can be configured to, based on the reflected ultrasonic signal, output a warning signal. The signal processor 120 can be configured to determine, based on the reflected ultrasonic signal and the audio parameter, a navigation parameter and provide the navigation parameter to a user of the hearing aid 10.
The input unit 111 is configured to generate an electrical input signal representative of a. The input unit may comprise an input transducer, e.g., one or more microphones, for converting an input sound to the electrical input signal. The input unit may comprise a wireless receiver for receiving a wireless signal comprising or representing sound and for providing the electrical input signal representing sound.
The output unit 112 may comprise an output transducer. The output transducer may comprise a speaker and/or a loudspeaker (sometimes denoted a receiver) for providing an acoustic signal to the user of the hearing aid. The output unit may, additionally or alternatively, comprise a transmitter for transmitting sound picked up by the hearing aid to another device. The hearing aid 10 can include a speaker unit configured to provide an acoustic signal upon determination of an object in the environment having a velocity above a threshold. The output unit 112 can be configured to output, based on the at least one electronic signal and the audio parameter, an audible signal.
One or both of the input unit 111 and the noise reduction unit 122 may comprise a directional microphone system. The directional microphone system is adapted to spatially filter sounds from the surroundings of the user wearing the hearing aid, and thereby enhance a target acoustic source among a multitude of acoustic sources in the surroundings of the user. The directional system may be adapted to detect, e.g., adaptively detect, from which direction a particular part of the microphone signal originates. This can be achieved in different ways as described e.g., in the prior art. In hearing aids, a microphone array beamformer is often used for spatially attenuating background noise sources. The beamformer may comprise a linear constraint minimum variance (LCMV) beamformer. Many beamformer variants can be found in literature. The minimum variance distortionless response (MVDR) beamformer is widely used in microphone array signal processing. Ideally the MVDR beamformer keeps the signals from the target direction (also referred to as the look direction) unchanged, while attenuating sound signals from other directions maximally. The generalized sidelobe canceller (GSC) structure is an equivalent representation of the MVDR beamformer offering computational and numerical advantages over a direct implementation in its original form. The input unit 111 can be a directional microphone having adaptable directionality, wherein the signal processor 120 is configured to adjust the directionality of the directional microphone based on the reflected ultrasonic signal.
The hearing aid 10 can include an ultrasonic transceiver 20. The ultrasonic transceiver 20can be configured to output an ultrasonic signal. The ultrasonic transceiver 20and/or the input unit 111 can be configured to receive a reflected ultrasonic signal. The signal processor 120 can be configured to determine, based on the reflected ultrasonic signal and optionally the at least one electrical input signal, an audio parameter indicative of an object in the environment.
The man-machine interface unit 114 may comprise one or more hardware elements, e.g., one or more buttons, one or more accelerometers and one or more microphones, to detect user interaction.
The wireless communication unit 116 may include a short-range wireless radio e.g., including a controller in communication with the processor.
The processor 120 may be configured with a signal processing path receiving audio data via the input unit with one or more microphones and/or via a radio unit; processing the audio data to compensate for a hearing loss; and rendering processed audio data via an output unit e.g., comprising a loudspeaker. The signal processing path may comprise one or more control paths and one or more feedback paths. The signal processing path may comprise a multitude of signal processing stages.
The hearing aid 10 can be constituted by or comprising an air-conduction type hearing aid, a bone-conduction type hearing aid, a cochlear implant type hearing aid, or a combination thereof.
FIG. 4 shows an example method 400 of operating a hearing aid according to the disclosure. The method 400 includes receiving 402 a sound from the environment. The method 400 can include converting 404 the sound into at least one electrical input signal representative of the sound. In certain implementations, receiving 402 and/or converting 404 may be optional. The method 400 can include outputting 406 an ultrasonic signal. The method 400 can include receiving 408 a reflected ultrasonic signal from the environment. The method 400 can include determining 410, based on the reflected ultrasonic signal and optionally the at least one electrical input signal, an audio parameter indicative of an object in the environment. The method 400 can include determining, based on the reflected ultrasonic signal and the at least one electrical input signal, an audio parameter indicative of an object in the environment.
It is intended that the structural features of the devices described above, either in the detailed description and/or in the claims, may be combined with steps of the method, when appropriately substituted by a corresponding process.
As used, the singular forms "a," "an," and "the" are intended to include the plural forms as well (i.e. to have the meaning "at least one"), unless expressly stated otherwise. It will be further understood that the terms "includes," "comprises," "including," and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will also be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element, but an intervening element may also be present, unless expressly stated otherwise. Furthermore, "connected" or "coupled" as used herein may include wirelessly connected or coupled. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items. The steps of any disclosed method are not limited to the exact order stated herein, unless expressly stated otherwise.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" or "an aspect" or features included as "may" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. Furthermore, the particular features, structures or characteristics may be combined as suitable in one or more embodiments of the disclosure. The previous description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects.
The claims are not intended to be limited to the aspects shown herein but are to be accorded the full scope consistent with the language of the claims, wherein reference to an element in the singular is not intended to mean "one and only one" unless specifically so stated, but rather "one or more." Unless specifically stated otherwise, the term "some" refers to one or more.

Claims

A hearing aid (10) comprising:
an input unit (111) configured to convert a sound in an environment of the hearing aid (10) to at least one electrical input signal representative of the sound;

an ultrasonic transceiver (20) configured to output an ultrasonic signal (22) and to receive a reflected ultrasonic signal (24) from the environment; and

a signal processor (120) configured to determine, based on the reflected ultrasonic signal (24) and optionally the at least one electrical input signal, an audio parameter indicative of an object (30) in the environment.
The hearing aid (10) according to claim 1, wherein the signal processor (120) is configured to apply noise reduction to the at least one electrical input signal based on the audio parameter.
The hearing aid (10) according to any one of the previous claims, wherein the signal processor (120) is configured to determine, based on the reflected ultrasonic signal and the audio parameter, a directionality of the sound.
The hearing aid (10) according to claim 3, wherein the input unit (111) is a directional microphone having adaptable directionality, and wherein the signal processor (120) is configured to adjust the directionality of the directional microphone based on the reflected ultrasonic signal.
The hearing aid (10) according to any one of the previous claims, wherein the ultrasonic transceiver (20) is configured to output pulses of the ultrasonic signal and/or the ultrasonic signal continuously.
The hearing aid (10) according to any one of the previous claims, wherein the signal processor (120) is configured to determine, based on the reflected ultrasonic signal and the audio parameter, a velocity of the object (30) in the environment.
The hearing aid (10) according to claim 6, further comprising an output unit (112) configured to provide an acoustic signal upon determination of an object (30) in the environment having a velocity above a threshold.
The hearing aid (10) according to any one of the previous claims, wherein the ultrasonic signal (22) has a unique identifier.
The hearing aid (10) according to any one of the previous claims, wherein the signal processor (120) is configured to determine, based on the reflected ultrasonic signal and the audio parameter, a speaker's mouth and/or tongue movement.
The hearing aid (10) according to any one of the previous claims, wherein the signal processor (120) is configured to, based on the reflected ultrasonic signal, output a warning signal.
The hearing aid (10) according to any one of the previous claims, wherein the signal processor (120) is configured to determine, based on the reflected ultrasonic signal and the audio parameter, a navigation parameter and provide the navigation parameter to a user of the hearing aid (10).
The hearing aid (10) according to any one of the previous claims, wherein the ultrasonic signal (22) is in a frequency between 20kHZ and 500 kHz.
The hearing aid (10) according to any one of the previous claims, further comprising an output unit (112) configured to output, based on the at least one electronic signal and the audio parameter, an audible signal.
The hearing aid (10) according to any one of the previous claims, the hearing aid (10) being constituted by or comprising an air-conduction type hearing aid, a bone-conduction type hearing aid, a cochlear implant type hearing aid, or a combination thereof.
A method (400) of operating a hearing aid, the method comprising:
receiving (402) a sound from the environment;

converting (404) the sound into at least one electrical input signal representative of the sound;

outputting (406) an ultrasonic signal;

receiving (408) a reflected ultrasonic signal from the environment; and

determining (410), based on the reflected ultrasonic signal and optionally the at least one electrical input signal, an audio parameter indicative of an object in the environment.