EP2928213A1 - Prothèse auditive à localisation améliorée d'une source de signal monophonique - Google Patents

Prothèse auditive à localisation améliorée d'une source de signal monophonique Download PDF

Info

Publication number
EP2928213A1
EP2928213A1 EP14163573.0A EP14163573A EP2928213A1 EP 2928213 A1 EP2928213 A1 EP 2928213A1 EP 14163573 A EP14163573 A EP 14163573A EP 2928213 A1 EP2928213 A1 EP 2928213A1
Authority
EP
European Patent Office
Prior art keywords
signal
hearing aid
audio signal
output signal
ite microphone
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP14163573.0A
Other languages
German (de)
English (en)
Other versions
EP2928213B1 (fr
Inventor
Guilin Ma
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GN Hearing AS
Original Assignee
GN Resound AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GN Resound AS filed Critical GN Resound AS
Priority to DK14163573.0T priority Critical patent/DK2928213T3/en
Priority to EP14163573.0A priority patent/EP2928213B1/fr
Priority to US14/252,631 priority patent/US9432778B2/en
Publication of EP2928213A1 publication Critical patent/EP2928213A1/fr
Application granted granted Critical
Publication of EP2928213B1 publication Critical patent/EP2928213B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/43—Electronic input selection or mixing based on input signal analysis, e.g. mixing or selection between microphone and telecoil or between microphones with different directivity characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/021—Behind the ear [BTE] hearing aids
    • H04R2225/0216—BTE hearing aids having a receiver in the ear mould
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/554—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired using a wireless connection, e.g. between microphone and amplifier or using Tcoils
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Definitions

  • a new hearing aid is provided with improved localization of a monaural signal source.
  • today's digital hearing aids typically use multi-channel amplification and compression signal processing to restore audibility of sound for a hearing impaired individual. In this way, the patient's hearing ability is improved by making previously inaudible speech cues audible.
  • One tool available to a hearing aid user in order to increase the signal to noise ratio of speech originating from a specific speaker is to equip the speaker in question with a microphone, often referred to as a spouse microphone, that picks up speech from the speaker in question with a high signal to noise ratio due to its proximity to the speaker.
  • the spouse microphone converts the speech into a corresponding audio signal with a high signal to noise ratio and transmits the signal, preferably wirelessly, to the hearing aid for hearing loss compensation.
  • a speech signal is provided to the user with a signal to noise ratio well above the SRT of the user in question.
  • Another way of increasing the signal to noise ratio of speech from a speaker that a hearing aid user desires to listen to is to use a telecoil to magnetically pick up audio signals generated, e.g., by telephones, FM systems (with neck loops), and induction loop systems (also called "hearing loops").
  • a telecoil to magnetically pick up audio signals generated, e.g., by telephones, FM systems (with neck loops), and induction loop systems (also called "hearing loops").
  • sound may be transmitted to hearing aids with a high signal to noise ratio well above the SRT of the hearing aid users.
  • a monaural audio signal is transmitted wirelessly to the hearing aid.
  • Hearing aids and in particular binaural hearing aid systems, typically reproduce sound in such a way that the user perceives sound sources to be localized inside the head. The sound is said to be internalized rather than being externalized.
  • a common complaint for hearing aid users when referring to the "hearing speech in noise problem" is that it is very hard to follow anything that is being said even though the signal to noise ratio (SNR) should be sufficient to provide the required speech intelligibility.
  • SNR signal to noise ratio
  • a significant contributor to this fact is that the hearing aid reproduces an internalized sound field. This adds to the cognitive loading of the hearing aid user and may result in listening fatigue and ultimately that the user removes the hearing aid(s).
  • a new hearing aid with improved localization of sound sources emitting sound signals that are transmitted wirelessly as monaural sound signals to a user, i.e. there is a need for a new hearing aid capable of adding spatial cues to a monaural sound signal corresponding to a direction and possibly distance of a sound source from which the monaural signal originates, with relation to the orientation of the head of a user of the hearing aid.
  • the user's auditory system's binaural signal processing is utilized to improve the user's capability of separating signals from different sound sources and of focussing his or her listening to a desired one of the sound sources, or even to simultaneously listen to and understand more than one of the sound sources.
  • Human beings detect and localize sound sources in three-dimensional space by means of the human binaural sound localization capability.
  • the input to the hearing consists of two signals, namely the sound pressures at each of the eardrums, in the following termed the binaural sound signals.
  • HRTF Head Related Transfer Function
  • the HRTF contains all information relating to the sound transmission to the ears of the listener, including diffraction around the head, reflections from shoulders, reflections in the ear canal, etc., and therefore, the HRTF varies from individual to individual.
  • the HRTF changes with direction and distance of the sound source in relation to the ears of the listener. It is possible to measure the HRTF for any direction and distance and simulate the HRTF, e.g. electronically, e.g. by filters. If such filters are inserted in the signal path between a audio signal source, such as a microphone, and headphones used by a listener, the listener will achieve the perception that the sounds generated by the headphones originate from a sound source positioned at the distance and in the direction as defined by the transfer functions of the filters simulating the HRTF in question, because of the true reproduction of the sound pressures in the ears.
  • a audio signal source such as a microphone
  • Binaural processing by the brain when interpreting the spatially encoded information, results in several positive effects, namely better signal source segregation, direction of arrival (DOA) estimation, and depth/distance perception.
  • DOE direction of arrival
  • the human auditory system extracts information about distance and direction to a sound source, but it is known that the human auditory system uses a number of cues in this determination. Among the cues are spectral cues, reverberation cues, interaural time differences (ITD), interaural phase differences (IPD) and interaural level differences (ILD).
  • ITD interaural time differences
  • ILD interaural level differences
  • the level difference is a result of diffraction and is determined by the relative position of the ears compared to the source. This cue is dominant above 2 kHz but the auditory system is equally sensitive to changes in ILD over the entire spectrum.
  • a new method of processing a monaural audio signal in a hearing aid wherein a monaural audio signal originating from a sound source, such as a monaural signal received from a spouse microphone, a loudspeaker, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc., is filtered in such a way that the user perceives the received monaural audio signal to be emitted by the sound source positioned in its current position and/or arriving from a direction towards its current position.
  • a sound source such as a monaural signal received from a spouse microphone, a loudspeaker, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc.
  • the perceived externalization and perceived spatial positioning of the sound source assists the user in understanding speech from the sound source, and in focussing the user's listening on the sound source, if desired.
  • a binaural filter may be configured to output signals based on the monaural audio signal and intended for the right ear and left ear of the user of the binaural hearing aid system, wherein the output signals are phase shifted with a phase shift with relation to each other in order to introduce an interaural time difference based on and corresponding to the position of the sound source from which the monaural audio signal originates, whereby the perceived position of the corresponding sound source is shifted outside the head and laterally with relation to the orientation of the head of the user of the binaural hearing aid system.
  • a filter may be configured to output a signal based on the monaural audio signal and intended for the right ear or left ear of the user of the monaural hearing aid, wherein the output signal is phase shifted with relation to the monaural signal in order to introduce an interaural time difference with respect to the naturally received sound at the other ear of the user, corresponding to the position of the sound source from which the monaural audio signal originates, whereby the perceived position of the corresponding sound source is shifted outside the head and laterally with relation to the orientation of the head of the user of the binaural hearing aid system.
  • the binaural filter may be configured to output signals based on the monaural audio signal and intended for the right ear and left ear, respectively, of the user of the binaural hearing aid system, wherein the output signals are equal to the monaural audio signal multiplied with a right gain and a left gain, respectively; in order to obtain an interaural level difference based on and corresponding to the position of the sound source from which the monaural audio signal originates, whereby the perceived position of the corresponding sound source is shifted laterally with relation to the orientation of the head of the user of the binaural hearing aid system.
  • the filter may be configured to output a signal based on the monaural audio signal and intended for the right or left ear of the user of the binaural hearing aid system, wherein the output signal is equal to the monaural audio signal multiplied with a right gain or a left gain; in order to obtain an interaural level difference with respect to the naturally received sound at the other ear of the user, based on and corresponding to the position of the sound source from which the monaural audio signal originates, whereby the perceived position of the corresponding sound source is shifted laterally with relation to the orientation of the head of the user of the binaural hearing aid system.
  • the binaural filter may have a selected HRTF of a the direction and distance towards the sound source from which the monaural signal originates so that the user perceives the received monaural audio signal to be emitted by the sound source at its current position with relation to the user.
  • the filter may have the right ear part or the left ear part of the HRTF of the direction and distance towards the sound source from which the monaural signal originates so that the user perceives the received monaural audio signal to be emitted by the sound source at its current position with relation to the user, since the other part of the HRTF is naturally performed by the other ear.
  • the monaural audio signal may be filtered with approximations to respective HRTFs.
  • HRTFs may be determined using a manikin, such as KEMAR.
  • KEMAR a manikin
  • an approximation to the individual HRTFs is provided that can be of sufficient accuracy for the hearing aid user to maintain sense of direction when wearing the hearing aid. Sufficient accuracy is obtained when a user perceives a sensation of direction towards a sound source from which the monaural audio signal originates; or, a user perceives localization of the sound source.
  • the user may receive acoustic signals at his or her eardrums with an interaural time difference and/or an interaural level difference sufficient for the perceived position of the sound source from which the monaural signal originates, to be shifted outside the head and laterally with relation to the orientation of the head of the user of the binaural hearing aid system, preferably into a perceived position corresponding to the actual position of the sound source, e.g. laterally within ⁇ 45° of the actual position.
  • a panel of listeners may assess the perceived sense of direction in a listening test, e.g. a three-alternative-forced-choice test.
  • the filtering of the monaural audio signal performed by the filter may be determined based on a signal provided by one microphone, or a combination of microphones, located in position(s) with relation to a user of the hearing aid, wherein spatial cues of sounds arriving at these position(s) are substantially the same as the spatial cues of sound that would have been received at the user's eardrum with the hearing aid absent.
  • a microphone may for example be positioned in the outer ear of the user in front of the pinna, for example at the entrance to the ear canal; or, inside the ear canal, in which positions spatial cues of sounds are substantially identical to the corresponding spatial cues of sounds arriving at the ear drum with the hearing aid absent, to a much larger extent than what is possible with e.g. the microphone behind the ear as with a conventional BTE hearing aid.
  • a position below the triangular fossa has also proven advantageous with relation to preservation of spatial cues.
  • a new hearing aid in which a monaural signal that does not originate from a microphone accommodated in a hearing aid housing; rather the monaural signal originates from another sound source external to the hearing aid housing, such as a spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc., is filtered with a filter in such a way that a user can locate the position of the sound source from which the monaural signal originates.
  • a monaural signal that does not originate from a microphone accommodated in a hearing aid housing; rather the monaural signal originates from another sound source external to the hearing aid housing, such as a spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc.
  • the new hearing aid may comprise an electronic input for provision of a monaural audio signal received at the electronic input, the monaural audio signal representing sound output by a sound source located in a position with relation to a user of the hearing aid, an ITE microphone housing accommodating at least one ITE microphone and that may be configured to be positioned in the outer ear of the user for fastening and retaining the at least one ITE microphone in its operating position, the at least one ITE microphone being configured to provide an output signal, a filter for filtering the monaural audio signal and configured to output an output signal, wherein the filter is configured to phase shift the monaural audio signal based on the output signal of the at least one ITE microphone, apply a gain to the monaural audio signal based on the output signal of the at least one ITE microphone, or phase shift and apply the gain to the monaural audio signal based on the output signal of the at least one ITE microphone.
  • the at least one ITE microphone may be constituted by one ITE microphone.
  • the hearing aid may form part of a binaural hearing aid system.
  • the hearing aid may further have a processor configured to generate a hearing loss compensated output signal based on the output signal of the filter.
  • the hearing aid may further have a receiver for conversion of the hearing loss compensated output signal into an acoustic signal for transmission towards an eardrum of the user of the hearing aid.
  • the processor may control the filter based on an output signal of the at least one ITE microphone in such a way that at least one spatial cue contained in the acoustic sound received by the at least one ITE microphone and indicating the position of the sound source from which the monaural audio signal originates, is transferred to the monaural audio signal and included in the output signal of the filter.
  • the at least one ITE microphone is utilized to obtain spatial cues relating to the sound source from which the monaural audio signal originates, and the filter is utilized to transfer at least one the spatial cues relating to the position of the sound source, to the monaural audio signal.
  • the acoustic speech of a person speaking into a spouse microphone, or a hearing loop system, providing the monaural audio signal is also received by the at least one ITE microphone probably with a relatively low signal-to-noise ratio; however including at least one spatial cue relating to the position of the person.
  • the processor may be configured to calculate a cross-correlation between the monaural audio signal and an output signal of the at least one ITE microphone and to determine the phase shift based on the calculated cross-correlation.
  • the filter may be a digital filter having an input that is configured for reception of the monaural audio signal, and filter coefficients that are adapted to reduce a difference between the output signal of the at least one ITE microphone and an output signal of the filter.
  • the filter coefficients may be adapted towards a solution of: min G f t ⁇ ⁇ W f ⁇ S IEC ⁇ f f t - G f t ⁇ S f t ⁇ p
  • S IEC ( f, t) is a short time spectrum at time t of the output signal of the at least one ITE microphone
  • S is a short time spectrum at time t of the monaural audio signal
  • G ( f , t) is a transfer function of the -processing filter
  • p is a norm factor
  • LMS least mean square
  • RLS recursive least squares
  • frequency weights W(f) may optimize the solution in certain one or more frequency ranges.
  • the filter may be prevented from further adapting when the filter coefficient values have ceased changing significantly.
  • only magnitude of the transfer functions may be taken into account during minimization while phase is disregarded, i.e. in the one or more selected frequency range, the transfer function is substituted by its absolute value.
  • the processor may be configured for determination of signal magnitudes of an output signal of the at least one ITE microphone at a plurality of frequencies, and determination of signal magnitudes of the monaural audio signal at the plurality of frequencies, and determination of gain values of the filter at respective frequencies of the plurality of frequencies based on the determined signal magnitudes.
  • Signal magnitudes at the plurality of frequencies may be determined as absolute values of the Fourier transformed signal, or as rms-values, absolute values, amplitude values, etc., of the signal, appropriately bandpass filtered and averaged, etc.
  • the monaural audio signal may be processed so that differences in signal magnitudes between the monaural audio signal and the output signal of the at least one ITE microphone are reduced.
  • the processing may be performed in a selected frequency range, or in a plurality of selected frequency ranges, or in the entire frequency range in which the hearing aid circuitry is capable of operating.
  • determined gain values at the plurality of frequencies may be converted to corresponding filter coefficients of a linear phase filter inserted into the signal path of the monaural audio signal; or, the gain values may be applied directly to the monaural audio signal in the frequency domain.
  • determined gain values may be compared to the respective maximum stable gain values at each of the plurality of frequencies, and gain values that are larger than the respective maximum stable gain values may be substituted by the respective maximum stable gain value, possibly minus a margin, to avoid risk of feedback.
  • the new hearing aid may be a BTE hearing aid of the type disclosed in EP 2 611 218 A1 .
  • the new hearing aid may further comprise a BTE hearing aid housing to be worn behind the pinna of a user and accommodating at least one BTE sound input transducer, such as an omni-directional microphone, a directional microphone, a transducer for an implantable hearing aid, etc., for conversion of a sound signal into respective audio sound signals, and a processor configured to generate a hearing loss compensated output signal based on the audio sound signals, an output signal of the at least one ITE microphone, and the monaural audio signal.
  • BTE sound input transducer such as an omni-directional microphone, a directional microphone, a transducer for an implantable hearing aid, etc.
  • a processor configured to generate a hearing loss compensated output signal based on the audio sound signals, an output signal of the at least one ITE microphone, and the monaural audio signal.
  • the new hearing aid may further comprise a sound signal transmission member for transmission of a signal representing the hearing loss compensated output signal from a sound output of the BTE hearing aid housing at a first end of the sound signal transmission member to the ear canal of the user at a second end of the sound signal transmission member, and an earpiece configured to be inserted in the ear canal of the user for fastening and retaining the sound signal transmission member in its intended position in the ear canal of the user.
  • the ITE microphone housing accommodating at least one ITE microphone may be combined with, or be constituted by, the earpiece so that the at least one microphone is positioned proximate the entrance to the ear canal when the earpiece is fastened in its intended position in the ear canal.
  • the ITE microphone housing may be connected to the earpiece with an arm, possibly a flexible arm that is intended to be positioned inside the pinna, e.g. around the circumference of the conchae abutting the antihelix and at least partly covered by the antihelix for retaining its position inside the outer ear of the user.
  • the arm may be pre-formed during manufacture, preferably into an arched shape with a curvature slightly larger than the curvature of the antihelix, for easy fitting of the arm into its intended position in the pinna.
  • the arm has a length and a shape that facilitate positioning of the at least one ITE microphone in an operating position immediately below the triangular fossa.
  • the processor may be accommodated in the BTE hearing aid housing, or in the ear piece, or part of the processor may be accommodated in the BTE hearing aid housing and part of the processor may be accommodated in the ear piece.
  • the link may be wired or wireless.
  • the link may be wired or wireless.
  • the new hearing aid may be a multi-channel hearing aid in which signals to be processed are divided into a plurality of frequency channels, and wherein signals, including the monaural audio signal, are processed individually in each of the frequency channels.
  • the processor may be configured for processing the output signals of the at least one ITE microphone and the monaural audio signal in such a way that the hearing loss compensated output signal substantially preserves spatial cues of the output signals of the at least one ITE microphone in a selected frequency band.
  • spatial cues are said to be substantially preserved when a user perceives a sensation of direction towards a sound source from which the monaural audio signal originates; or, a user perceives localization of the sound source.
  • the user may receive acoustic signals at his or her eardrums with an interaural time difference and/or an interaural level difference sufficient for the perceived position of the sound source from which the monaural signal originates, to be shifted outside the head and laterally with relation to the orientation of the head of the user of the binaural hearing aid system, preferably into a perceived position corresponding to the actual position of the sound source, e.g. laterally within ⁇ 45° of the actual position.
  • a panel of listeners may assess the preservation of spatial cues in a listening test, e.g. a three-alternative-forced-choice test.
  • the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
  • the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • the at least one ITE microphone may be connected conventionally in the hearing aid circuitry as is well-known in the art of hearing aids.
  • the "output signals of the at least one ITE microphone” may be used to identify any analogue or digital signal forming part of the signal path from the output of the at least one ITE microphone to an input of the processor, including pre-processed output signals of the at least one ITE microphone.
  • the "output signals of the at least one BTE sound input transducer" may be used to identify any analogue or digital signal forming part of the signal path from the at least one BTE sound input transducer to an input of the processor, including pre-processed output signals of the at least one BTE sound input transducer.
  • the at least one ITE microphone is positioned so that the output signal of the at least one ITE microphone generated in response to the incoming sound has a transfer function that constitutes a good approximation to the HRTFs of the user.
  • the filter conveys the directional information contained in the output signal of the at least one ITE microphone to the resulting hearing loss compensated output signal of the processor so that the hearing aid transfer function constitutes a good approximation to the HRTFs of the user whereby improved localization is provided to the user.
  • the output signal of the at least one ITE microphone of the earpiece may be a combination of several pre-processed ITE microphone signals or the output signal of a single ITE microphone of the at least one ITE microphone.
  • One or more output signals of the at least one BTE sound input transducers are provided.
  • the output signals may be pre-processed. Preprocessing may include, without excluding any form of processing; adaptive and/or static feedback suppression, adaptive or fixed beamforming and pre-filtering.
  • adaptive filters may be configured to adaptively filter the electronic output signals of the at least one BTE sound input transducer so that they correspond to the output signal of the at least one ITE microphone as closely as possible.
  • the adaptive filters G 1 , G 2 , ... , G n have the respective transfer functions: G 1 ( f , t), G 2 ( f , t ), ..., G n ( f, t).
  • the at least one ITE microphone operates as monitor microphone(s) for generation of an electronic sound signal with the desired spatial information of the current sound environment.
  • the filter i.e. the algorithm adjusting the filter coefficients, adapts towards the new HRTF.
  • the time constants of the adaptation are set to appropriately respond to changes of the current sound environment.
  • one signal is said to represent another signal when the one signal is a function of the other signal, for example the one signal may be formed by analogue-to-digital conversion, or digital-to-analogue conversion of the other signal; or, the one signal may be formed by conversion of an acoustic signal into an electronic signal or vice versa; or the one signal may be formed by analogue or digital filtering or mixing of the other signal; or the one signal may be formed by transformation, such as frequency transformation, etc., of the other signal; etc.
  • signals that are processed by specific circuitry may be identified by a name that may be used to identify any analogue or digital signal forming part of the signal path of the signal in question from its input of the circuitry in question to its output of the circuitry.
  • a name e.g. a name that may be used to identify any analogue or digital signal forming part of the signal path of the signal in question from its input of the circuitry in question to its output of the circuitry.
  • an output signal of a microphone i.e. the microphone audio signal
  • the microphone audio signal may be used to identify any analogue or digital signal forming part of the signal path from the output of the microphone to its input to the receiver, including any processed microphone audio signals.
  • the new monaural hearing aid and the new binaural hearing aid system may additionally provide circuitry used in accordance with other conventional methods of hearing loss compensation so that the new circuitry or other conventional circuitry can be selected for operation as appropriate in different types of sound environment.
  • the different sound environments may include speech, babble speech, restaurant clatter, music, traffic noise, etc.
  • the new monaural hearing aid and the new binaural hearing aid system may for example comprise a Digital Signal Processor (DSP), the processing of which is controlled by selectable signal processing algorithms, each of which having various parameters for adjustment of the actual signal processing performed.
  • DSP Digital Signal Processor
  • the gains in each of the frequency channels of a multi-channel hearing aid are examples of such parameters.
  • One of the selectable signal processing algorithms operates in accordance with the new method.
  • various algorithms may be provided for conventional noise suppression, i.e. attenuation of undesired signals and amplification of desired signals.
  • Signal processing in the new hearing aid may be performed by dedicated hardware or may be performed in a signal processor, or performed in a combination of dedicated hardware and one or more signal processors.
  • processor As used herein, the terms “processor”, “signal processor”, “controller”, “system”, etc., are intended to refer to CPU-related entities, either hardware, a combination of hardware and software, software, or software in execution.
  • the term processor may also refer to any integrated circuit that includes some hardware, which may or may not be a CPU-related entity.
  • a processor may include a filter.
  • a "processor”, “signal processor”, “controller”, “system”, etc. may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
  • processor designate both an application running on a processor and a hardware processor.
  • processors may reside within a process and/or thread of execution, and one or more "processors”, “signal processors”, “controllers”, “systems”, etc., or any combination hereof, may be localized on one hardware processor, possibly in combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
  • a processor may be any component or any combination of components that is capable of performing signal processing.
  • the signal processor may be an ASIC processor, a FPGA processor, a general purpose processor, a microprocessor, a circuit component, or an integrated circuit.
  • Fig. 1 shows a BTE hearing aid 10 in its operating position with the BTE housing 12 behind the ear, i.e. behind the pinna 100, of the user.
  • the BTE housing 12 conventionally accommodates a front microphone (not visible) and a rear microphone (not visible) for conversion of a sound signal into respective audio sound signals.
  • the illustrated BTE hearing aid 10 has an ITE microphone 26 positioned in the outer ear of the user outside the ear canal at the free end of an arm 30.
  • the arm 30 is flexible and the arm 30 is intended to be positioned inside the pinna 100 , e.g. around the circumference of the conchae 102 behind the tragus 104 and antitragus 106 and abutting the antihelix 108 and at least partly covered by the antihelix for retaining its position inside the outer ear of the user.
  • the arm may be pre-formed during manufacture, preferably into an arched shape with a curvature slightly larger than the curvature of the antihelix 104, for easy fitting of the arm 30 into its intended position in the pinna.
  • the arm 30 contains electrical wires (not visible) for interconnection of the ITE microphone 26 with other parts of the BTE hearing aid circuitry.
  • the arm 30 has a length and a shape that facilitate positioning of the ITE microphone 26 in an operating position below the triangular fossa.
  • An earpiece 24 may alternatively, or additionally, hold one ITE microphone that is positioned at the entrance to the ear canal when the earpiece is positioned in its intended position in the ear canal of the user.
  • the ITE microphone 26 is connected to an A/D converter (not shown) and optional to a pre-filter (not shown) in the BTE housing 12, with electrical wires (not visible) contained in a sound transmission member 20.
  • a processor is also accommodated in the BTE housing 12 and configured to generate a hearing loss compensated output signal based on the audio sound signals, an output signal of the at least one ITE microphone, and a monaural audio signal.
  • the hearing loss compensated output signal is transmitted through electrical wires contained in the sound signal transmission member 20 to a receiver (not visible) for conversion of the hearing loss compensated output signal to an acoustic output signal for transmission towards the eardrum of the user.
  • the receiver (not visible) is contained in the earpiece 24 that is shaped (not shown) to be comfortably positioned in the ear canal of the user for fastening and retaining the sound signal transmission member 20 in its intended position in the ear canal of the user as is well-known in the art of BTE hearing aids.
  • Fig. 2 is a block diagram illustrating one example of signal processing in the new hearing aid 10, e.g. the hearing aid shown in Fig. 1 .
  • the hearing aid 10 has an ITE microphone 26 to be positioned in the outer ear of the user.
  • An output signal 28 of the ITE microphone 26 is digitized and optionally pre-processed, such as pre-filtered, in a pre-processor 30, and an output 32 of the pre-processor 30 is input to a processor 34.
  • the hearing aid 10 also comprises an electronic input 36, such as an antenna, a telecoil, etc., for provision of a received 38 signal representing sound emitted by a sound source (not shown) and received at the input 36 that is not coupled to a microphone that is accommodated in a housing of the hearing aid 10.
  • an electronic input 36 such as an antenna, a telecoil, etc.
  • the sound emitted by the sound source may be recorded with a spouse microphone (not shown) carried by a person that the hearing aid user desires to listen to.
  • the output signal of the spouse microphone is encoded for transmission to the hearing aid 10 using wireless or wired data transmission, preferably wireless data transmission.
  • the receiver and decoder 40 receive the transmitted data representing the spouse microphone output signal and decode the received signal 38 into the monaural audio signal 42.
  • the monaural audio signal 42 is filtered with a filter 44 in such a way that a user can locate the position of the sound source from which the monaural signal 42 originates.
  • the filter 44 is controlled by processor 34 based on the, optionally pre-processed, output signal 32 of the ITE microphone 26 and the monaural audio signal 42, and possibly an output signal 46 of the filter 44 providing feedback to the processor 34.
  • the processor 34 controls the filter 44 in such a way that spatial cues in the acoustic sound signal received by the ITE microphone 26 are transferred, or substantially transferred, to the filtered monaural audio signal 46, whereby spatial cues of the acoustic sound signal received by the ITE microphone 26 are transferred, or substantially transferred, to the filtered monaural audio signal 46 so that a user perceives a sensation of direction towards a sound source from which the monaural audio signal originates; or, a user perceives localization of the sound source.
  • the user may receive acoustic signals at his or her eardrums with an interaural time difference and/or an interaural level difference sufficient for the perceived position of the sound source from which the monaural signal originates, to be shifted outside the head and laterally with relation to the orientation of the head of the user of the binaural hearing aid system, preferably into a perceived position corresponding to the actual position of the sound source, e.g. laterally within ⁇ 45° of the actual position.
  • the filtered monaural audio signal 46 is input to a processor 48 for hearing loss compensation.
  • the hearing loss compensated signal 50 is output to a receiver 52 that converts the signal 50 into an acoustic signal for transmission towards the ear drum of the user.
  • the processor 34 may for example control the filter 44 to phase shift the monaural audio signal 42 with a phase shift ⁇ , wherein ⁇ is based on the output signal 32 of the ITE microphone 26, and/or to multiply the monaural audio signal 42 with a gain based on the output signal 32 of the ITE microphone.
  • the processor 34 may be configured to calculate a cross-correlation between the monaural audio signal 42 and the output signal 32 of the ITE microphone 26 and to determine the phase shift ⁇ to correspond to the maximum value of the cross-correlation and, thus, to correspond to the phase shift between the monaural audio signal 42 and the output signal 32 of the ITE microphone 26 and/or the gain as the ratio between the monaural signal phase shifted with the determined phase shift ⁇ and the output signal 32 of the ITE microphone 26.
  • the output signal 46 of the filter 44 will contribute to the interaural time difference and/or the interaural level difference, respectively, in substantially the same way as the acoustic signal received by the ITE microphone 26 would have done in absence of the hearing aid.
  • the monaural audio signal is received in both hearing aids and the respective filters 44 may output signals intended for the right ear and left ear of the user of the binaural hearing aid system that are phase shifted and/or amplified based on the respective cross-correlations as disclosed above, whereby the filtered monaural signals 46 in the hearing aids obtain substantially the same interaural time difference and/or substantially the same interaural level difference as the corresponding acoustic signals arriving at the ears in absence of the hearing aids so that the perceived position of the sound source from which the monaural signal originates is shifted outside the head and laterally with relation to the orientation of the head of the user of the binaural hearing aid system into a perceived position corresponding to the actual position of the sound source.
  • the phase shift and/or amplification of the filter 44 introduce an interaural time difference and/or interaural level difference with respect to the naturally received sound at the other ear of the user, corresponding to the position of the sound source from which the monaural audio signal originates.
  • the processor 34 may control the transfer function of the filter 44 to be an appropriate one of the right ear part or left ear part of a selected HRTF with the interaural time difference and/or interaural level difference corresponding to the phase shift ⁇ and/or gain, respectively, determined with the cross-correlation so that the user perceives the received monaural audio signal to be emitted by the sound source at its current position with relation to the user.
  • the new hearing aid circuitry shown in Fig. 2 may operate in the entire frequency range of the hearing aid 10.
  • the hearing aid 10 shown in Fig. 2 may be a multi-channel hearing aid in which the ITE microphone audio signal 28 and the monaural audio signal to be processed are divided into a plurality of frequency channels, and wherein the signals are processed individually in each of the frequency channels.
  • Fig. 2 may illustrate the circuitry and signal processing in a single frequency channel.
  • the circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
  • the signal processing illustrated in Fig. 2 may be performed in a selected frequency band, e.g. selected during fitting of the hearing aid to a specific user at a dispenser's office.
  • the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
  • the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • the ITE microphone 26 may be connected conventionally as an input source to the processor 48 of the hearing aid so that in some situations, conventional hearing loss compensation may be selected, and in other situations the filtered monaural audio signal 46 may be selected for hearing loss compensation in processor 48.
  • An arbitrary number N of ITE microphones may substitute the ITE microphone 26, and a combination of output signals from the N ITE microphones may be combined in a ITE signal combiner to form the, optionally pre-processed, output signal 32, e.g. as a weighted sum.
  • the weights may be frequency dependent.
  • Fig. 3 shows a hearing aid 10 similar to the hearing aid of Fig. 2 ; however with an example of filtering of the monaural audio signal 42 that is different from the examples explained in connection with Fig. 2 .
  • the explanation of similar components and features is not repeated, but reference is made to the description of Fig. 2 .
  • the filter 44 is a digital adaptive filter with filter coefficients controlled by the processor 34 including adaptive controller 54.
  • the controller 54 controls the adaptation of the filter coefficients to minimize the difference 56 between the filtered monaural audio signal 46 and the, optionally pre-processed, output signal 32 of the ITE microphone 26.
  • the difference 56 is provided by subtractor 58 of the processor 34.
  • the filtered monaural audio signal 46 approximates the, optionally pre-processed, output signal 32 of the ITE microphone 26, and thus also substantially attains a transfer function corresponding to an HRTF of the user, since the ITE microphone 26 is positioned in a position in the outer ear of the user, wherein the hearing aid transfer functions are substantially equal to the right ear part or the left ear part of the HRTFs of the user.
  • Preprocessing may include, without excluding any form of processing; adaptive and/or static feedback suppression, adaptive or fixed beamforming and pre-filtering.
  • the adaptive controller 54 is configured to control the filter coefficients of adaptive filter 44 so that the filter output 46 corresponds to the, optionally pre-processed, output signal 32 of the ITE microphone 26 as closely as possible.
  • the filter 44 has the transfer function: G(f, t).
  • the ITE microphone 26 operates as monitor microphone for generation of an electronic sound signal 46 with the desired spatial information of the current sound environment.
  • the filter coefficients are adapted to obtain an exact or approximate solution to the following minimization problem: lim G f t ⁇ ⁇ W f ⁇ S IEC f t - G f t ⁇ S f t ⁇ p
  • LMS least mean square
  • RLS recursive least squares
  • the adaptive filter 44 i.e. the controller 54 adjusting the filter coefficients, adapt towards the new HRTF.
  • the time constants of the adaptation are set to appropriately respond to changes of the current sound environment.
  • the new hearing aid circuitry shown in Fig. 3 may operate in the entire frequency range of the hearing aid 10.
  • the hearing aid 10 shown in Fig. 3 may be a multi-channel hearing aid in which the ITE microphone audio signal 28 and the monaural audio signal to be processed are divided into a plurality of frequency channels, and wherein the signals are processed individually in each of the frequency channels.
  • Fig. 3 may illustrate the circuitry and signal processing in a single frequency channel.
  • the circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
  • the signal processing illustrated in Fig. 3 may be performed in a selected frequency band, e.g. selected during fitting of the hearing aid to a specific user at a dispenser's office.
  • the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
  • the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • the ITE microphone 26 may be connected conventionally as an input source to the processor 48 of the hearing aid so that in some situations, conventional hearing loss compensation may be selected, and in other situations the filtered monaural audio signal 46 may be selected for hearing loss compensation in processor 48.
  • An arbitrary number N of ITE microphones may substitute the ITE microphone 26, and a combination of output signals from the N ITE microphones may be combined in a ITE signal combiner to form the, optionally pre-processed, output signal 32, e.g. as a weighted sum.
  • the weights may be frequency dependent.
  • Fig. 4 shows a hearing aid 10 similar to the hearing aids of Figs. 2 and 3 , respectively; however, with an example of filtering of the monaural audio signal 42 that is different from the examples explained in connection with Figs. 2 and 3 .
  • the explanation of similar components and features is not repeated, but reference is made to the descriptions of Figs. 2 and 3 .
  • the filter 44 amplifies the monaural audio signal 42 with gain values that are determined so that the signal magnitudes of the filtered monaural audio signal 46 are identical to, or substantially identical to, the signal magnitudes of the, optionally pre-processed, output signal 32 of the ITE microphone 26 at a plurality of frequencies, whereby spatial cues in the, optionally pre-processed, output signal 32 of the ITE microphone 26, are transferred to the filtered monaural audio signal 46.
  • the processor 60 performs a spectral analysis of the, optionally pre-processed, output signal 32 of the ITE microphone 26, and the signal magnitude calculator 62 calculates signal magnitudes of the, optionally pre-processed, output signal 32 of the ITE microphone 26 at a plurality of frequencies.
  • the processor 64 performs a spectral analysis of the monaural audio signal 42, and the signal magnitude calculator 66 determines signal magnitudes of the monaural audio signal 42 at the plurality of frequencies.
  • the gain processor 68 calculates gain values at respective frequencies of the plurality of frequencies based on a ratio between calculated signal magnitudes of monaural audio signal 42 and signal magnitudes of the, optionally pre-processed, output signal 32 of the ITE microphone 26, and outputs the determined gain values to the filter 44 that is connected for multiplying the monaural audio signal 42 with the determined gain values at the respective frequencies.
  • the monaural audio signal 42 is processed so that differences in signal magnitudes between the monaural audio signal 42 and the ITE audio sound signal 32 are reduced.
  • the processing may be performed in a selected frequency range, or in a plurality of selected frequency ranges, or in the entire frequency range in which the hearing aid circuitry is capable of operating.
  • the determined gain values at the plurality of frequencies may be converted to corresponding filter coefficients of a linear phase filter inserted into the signal path of the monaural sound signal 42, or, the gain values may be applied directly to the monaural sound signal 42 in the frequency domain.
  • the new hearing aid circuitry shown in Fig. 4 may operate in the entire frequency range of the hearing aid 10.
  • the hearing aid 10 shown in Fig. 4 may be a multi-channel hearing aid in which the ITE microphone audio signal 28 and the monaural audio signal to be processed are divided into a plurality of frequency channels, and wherein the signals are processed individually in each of the frequency channels.
  • Fig. 4 may illustrate the circuitry and signal processing in a single frequency channel.
  • the circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
  • the signal processing illustrated in Fig. 4 may be performed in a selected frequency band, e.g. selected during fitting of the hearing aid to a specific user at a dispenser's office.
  • the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
  • the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
  • the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
  • An arbitrary number N of ITE microphones may substitute the ITE microphone 26, and a combination of output signals from the N ITE microphones may be combined in a ITE signal combiner to form the, optionally pre-processed, output signal 32, e.g. as a weighted sum.
  • the weights may be frequency dependent.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)
EP14163573.0A 2014-04-04 2014-04-04 Prothèse auditive à localisation améliorée d'une source de signal monophonique Active EP2928213B1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
DK14163573.0T DK2928213T3 (en) 2014-04-04 2014-04-04 A hearing aid with improved localization of monaural signal sources
EP14163573.0A EP2928213B1 (fr) 2014-04-04 2014-04-04 Prothèse auditive à localisation améliorée d'une source de signal monophonique
US14/252,631 US9432778B2 (en) 2014-04-04 2014-04-14 Hearing aid with improved localization of a monaural signal source

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP14163573.0A EP2928213B1 (fr) 2014-04-04 2014-04-04 Prothèse auditive à localisation améliorée d'une source de signal monophonique

Publications (2)

Publication Number Publication Date
EP2928213A1 true EP2928213A1 (fr) 2015-10-07
EP2928213B1 EP2928213B1 (fr) 2018-05-30

Family

ID=50424144

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14163573.0A Active EP2928213B1 (fr) 2014-04-04 2014-04-04 Prothèse auditive à localisation améliorée d'une source de signal monophonique

Country Status (2)

Country Link
EP (1) EP2928213B1 (fr)
DK (1) DK2928213T3 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111142665A (zh) * 2019-12-27 2020-05-12 恒玄科技(上海)股份有限公司 耳机组件的立体声处理方法、系统及耳机组件
CN112526495A (zh) * 2020-12-11 2021-03-19 厦门大学 一种基于耳廓传导特性的单耳声源定位方法及系统
WO2021055413A1 (fr) * 2019-09-17 2021-03-25 Bose Corporation Amélioration de l'audio à partir de sources audio distante
WO2021087524A1 (fr) * 2019-10-30 2021-05-06 Starkey Laboratories, Inc. Génération d'un signal audio à partir de multiples entrées
CN113660593A (zh) * 2021-08-21 2021-11-16 武汉左点科技有限公司 一种消除头影效应的助听方法及装置

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2584794A1 (fr) * 2011-10-17 2013-04-24 Oticon A/S Système d'écoute adapté à la communication en temps réel fournissant des informations spatiales dans un flux audio
EP2611218A1 (fr) 2011-12-29 2013-07-03 GN Resound A/S Prothèse auditive avec localisation améliorée

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2584794A1 (fr) * 2011-10-17 2013-04-24 Oticon A/S Système d'écoute adapté à la communication en temps réel fournissant des informations spatiales dans un flux audio
EP2611218A1 (fr) 2011-12-29 2013-07-03 GN Resound A/S Prothèse auditive avec localisation améliorée

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021055413A1 (fr) * 2019-09-17 2021-03-25 Bose Corporation Amélioration de l'audio à partir de sources audio distante
US11373668B2 (en) * 2019-09-17 2022-06-28 Bose Corporation Enhancement of audio from remote audio sources
WO2021087524A1 (fr) * 2019-10-30 2021-05-06 Starkey Laboratories, Inc. Génération d'un signal audio à partir de multiples entrées
CN111142665A (zh) * 2019-12-27 2020-05-12 恒玄科技(上海)股份有限公司 耳机组件的立体声处理方法、系统及耳机组件
CN111142665B (zh) * 2019-12-27 2024-02-06 恒玄科技(上海)股份有限公司 耳机组件的立体声处理方法、系统及耳机组件
CN112526495A (zh) * 2020-12-11 2021-03-19 厦门大学 一种基于耳廓传导特性的单耳声源定位方法及系统
CN113660593A (zh) * 2021-08-21 2021-11-16 武汉左点科技有限公司 一种消除头影效应的助听方法及装置

Also Published As

Publication number Publication date
DK2928213T3 (en) 2018-08-27
EP2928213B1 (fr) 2018-05-30

Similar Documents

Publication Publication Date Title
US9432778B2 (en) Hearing aid with improved localization of a monaural signal source
US10869142B2 (en) Hearing aid with spatial signal enhancement
DK2611218T3 (en) A hearing aid with improved location determination
US11438713B2 (en) Binaural hearing system with localization of sound sources
CN104185129B (zh) 具有改善的定位的助听器
EP2611218B1 (fr) Prothèse auditive avec localisation améliorée
JP5886737B2 (ja) 信号強調機能を有する補聴器
US9148735B2 (en) Hearing aid with improved localization
US20140185847A1 (en) Hearing aid with improved localization
US20100002886A1 (en) Hearing system and method implementing binaural noise reduction preserving interaural transfer functions
EP2928213B1 (fr) Prothèse auditive à localisation améliorée d'une source de signal monophonique
US9148733B2 (en) Hearing aid with improved localization
EP2806661B1 (fr) Prothèse auditive avec amélioration spatiale de signal
EP2806660B1 (fr) Prothèse auditive avec localisation améliorée
EP2750410B1 (fr) Prothèse auditive avec une meilleure localisation
EP2750411B1 (fr) Prothèse auditive avec une meilleure localisation
EP2750412B1 (fr) Localisation améliorée avec rétroaction
EP2611215B1 (fr) Aide auditive dotée d'un meilleur signal
CN104980869A (zh) 改进的单声道信号源定位的助听器
DK201370280A1 (en) A hearing aid with spatial signal enhancement
JP2013153427A (ja) 周波数アンマスキング機能を有する両耳用補聴器

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20160407

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

R17P Request for examination filed (corrected)

Effective date: 20160407

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20170329

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20171120

INTG Intention to grant announced

Effective date: 20171204

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: GN HEARING A/S

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAR Information related to intention to grant a patent recorded

Free format text: ORIGINAL CODE: EPIDOSNIGR71

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTC Intention to grant announced (deleted)
GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

INTG Intention to grant announced

Effective date: 20180411

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1004869

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180615

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602014026074

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20180821

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20180530

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180830

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180831

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1004869

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602014026074

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20190301

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190404

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190404

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181001

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20140404

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230525

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240419

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240419

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20240418

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20240501

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240415

Year of fee payment: 11