EP2611218A1 - Hörgerät mit verbesserter Ortung - Google Patents
Hörgerät mit verbesserter Ortung Download PDFInfo
- Publication number
- EP2611218A1 EP2611218A1 EP12197705.2A EP12197705A EP2611218A1 EP 2611218 A1 EP2611218 A1 EP 2611218A1 EP 12197705 A EP12197705 A EP 12197705A EP 2611218 A1 EP2611218 A1 EP 2611218A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- sound
- hearing aid
- bte
- output
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000013707 sensory perception of sound Effects 0.000 title claims abstract description 124
- 230000004807 localization Effects 0.000 title description 7
- 230000005236 sound signal Effects 0.000 claims abstract description 54
- 230000003044 adaptive effect Effects 0.000 claims abstract description 41
- 210000000613 ear canal Anatomy 0.000 claims abstract description 40
- 206010011878 Deafness Diseases 0.000 claims abstract description 28
- 230000010370 hearing loss Effects 0.000 claims abstract description 28
- 231100000888 hearing loss Toxicity 0.000 claims abstract description 28
- 208000016354 hearing loss disease Diseases 0.000 claims abstract description 28
- 230000005540 biological transmission Effects 0.000 claims abstract description 27
- 210000000883 ear external Anatomy 0.000 claims abstract description 11
- 238000006243 chemical reaction Methods 0.000 claims abstract description 10
- 241000282414 Homo sapiens Species 0.000 claims abstract description 8
- 238000012545 processing Methods 0.000 claims description 21
- 230000006870 function Effects 0.000 claims description 17
- 238000012546 transfer Methods 0.000 claims description 16
- 238000001228 spectrum Methods 0.000 claims description 12
- 238000007781 pre-processing Methods 0.000 claims description 6
- 238000004321 preservation Methods 0.000 abstract description 2
- 238000001914 filtration Methods 0.000 description 8
- 210000003454 tympanic membrane Anatomy 0.000 description 8
- 230000006978 adaptation Effects 0.000 description 7
- 230000000295 complement effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 210000003128 head Anatomy 0.000 description 5
- 230000003595 spectral effect Effects 0.000 description 5
- 210000005069 ears Anatomy 0.000 description 4
- 238000000034 method Methods 0.000 description 4
- 239000004020 conductor Substances 0.000 description 3
- 230000001934 delay Effects 0.000 description 3
- 230000000903 blocking effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 238000011045 prefiltration Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001629 suppression Effects 0.000 description 2
- 208000032041 Hearing impaired Diseases 0.000 description 1
- 241000746998 Tragus Species 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/40—Arrangements for obtaining a desired directivity characteristic
- H04R25/407—Circuits for combining signals of a plurality of transducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/021—Behind the ear [BTE] hearing aids
- H04R2225/0216—BTE hearing aids having a receiver in the ear mould
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
- H04R2430/03—Synergistic effects of band splitting and sub-band processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/45—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback
- H04R25/453—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback electronically
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
Definitions
- a new Behind-The-Ear (BTE) hearing aid is provided with improved localization of sound sources with relation to the wearer of the hearing aid.
- Hearing aid users have been reported to have poorer ability to localize sound sources when wearing their hearing aids than without their hearing aids. This represents a serious problem for the mild-to-moderate hearing impaired population.
- hearing aids typically reproduce sound in such a way that the user perceives sound sources to be localized inside the head. The sound is said to be internalized rather than being externalized.
- a common complaint for hearing aid users when referring to the "hearing speech in noise problem" is that it is very hard to follow anything that is being said even though the signal to noise ratio (SNR) should be sufficient to provide the required speech intelligibility.
- SNR signal to noise ratio
- a significant contributor to this fact is that the hearing aid reproduces an internalized sound field. This adds to the cognitive loading of the hearing aid user and may result in listening fatigue and ultimately that the user removes the hearing aid(s).
- the new hearing aid preserves information of the directions and distances of respective sound sources in the sound environment with relation to the orientation of the head of the wearer of the hearing aid.
- Human beings detect and localize sound sources in three-dimensional space by means of the human binaural sound localization capability.
- the input to the hearing consists of two signals, namely the sound pressures at each of the eardrums, in the following termed the binaural sound signals.
- the human auditory system extracts information about distance and direction to a sound source, but it is known that the human auditory system uses a number of cues in this determination. Among the cues are spectral cues, reverberation cues, interaural time differences (ITD), interaural phase differences (IPD) and interaural level differences (ILD).
- HRTF Head-Related Transfer Function
- the HRTF contains all information relating to the sound transmission to the ears of the listener, including diffraction around the head, reflections from shoulders, reflections in the ear canal, etc., and therefore, the HRTF varies from individual to individual.
- the hearing aid related transfer function is defined similar to a HRTF, namely as the ratio between a sound pressure p generated by the hearing aid at a specific point in the appertaining ear canal in response to a plane wave and a reference.
- the reference traditionally chosen is the sound pressure p I that would have been generated by a plane wave at a position right in the middle of the head with the listener absent.
- the HRTF changes with direction and distance of the sound source in relation to the ears of the listener. It is possible to measure the HRTF for any direction and distance and simulate the HRTF, e.g. electronically, e.g. by filters. If such filters are inserted in the signal path between a playback unit, such as a tape recorder, and headphones used by a listener, the listener will achieve the perception that the sounds generated by the headphones originate from a sound source positioned at the distance and in the direction as defined by the transfer functions of the filters simulating the HRTF in question, because of the true reproduction of the sound pressures in the ears.
- a playback unit such as a tape recorder
- Binaural processing by the brain when interpreting the spatially encoded information, results in several positive effects, namely better signal-to-noise ratio (SNR); direction of arrival (DOA) estimation; depth/distance perception and synergy between the visual and auditory systems.
- SNR signal-to-noise ratio
- DOA direction of arrival
- the complex shape of the ear is a major contributor to the individual spatial-spectral cues (ITD, ILD and spectral cues) of a listener. Devices which pick up sound behind the ear will, hence, be at a disadvantage in reproducing the HRTF since much of the spectral detail will be lost or heavily distorted.
- Fig. 1 the angular frequency spectrum of an open ear, i.e. non-occluded, measurement is shown together with the corresponding measurement on the front microphone on a behind the ear device (BTE) using the same ear.
- BTE behind the ear device
- one or more microphones of the hearing aid at position(s) with relation to a user of the hearing aid in which spatial cues of sounds arriving at the user is preserved. It is for example advantageous to position a microphone in the outer ear of the user in front of the pinna, for example at the entrance to the ear canal; or, inside the ear canal, in order to preserve spatial cues of sounds arriving at the ear to a much larger extent than what is possible with the microphone behind the ear. A position below the triangular fossa has also proven advantageous with relation to preservation of spatial cues.
- Positioning of the microphone at the entrance to the ear canal or inside the ear canal leads to the problem that the microphone is moved close to the sound emitting device of the hearing aid, whereby the risk of feedback generation is increased, which in turn limits the maximum stable gain which can be prescribed with the hearing aid.
- a BTE hearing aid with front and rear microphones positioned behind the ear and an In-The-Ear (ITE) hearing aid with an open fitted microphone positioned in the ear canal is shown in Fig. 2 . It can be seen that the ITE hearing aid has much lower maximum stable gain (MSG) than the front and rear BTE microphones for nearly all frequencies.
- MSG maximum stable gain
- output signals of an arbitrary configuration of microphones undergo signal processing in such a way that spatial cues are preserved and conveyed to the user of the hearing aid.
- the output signals are filtered with filters that are configured to preserve spatial cues.
- the new BTE hearing aid may provide improved localization to the user by providing, in addition to conventionally positioned microphones of the BTE hearing aid, at least one ITE microphone intended to be positioned in the outer ear of the user in front of the pinna; or, inside the ear canal, when in use in order to record sound arriving at the ear of the user and containing the desired spatial information relating to localization of sound sources in the sound environment.
- the signal processor of the new BTE hearing aid combines an output signal of the at least one ITE microphone in the outer ear of the user with the microphone signal(s) of the conventionally positioned microphone(s) of the BTE hearing aid in such a way that spatial cues are preserved.
- a BTE hearing aid comprising a BTE hearing aid housing to be worn behind the pinna of a user, at least one BTE sound input transducer, such as an omni-directional microphone, a directional microphone, a transducer for an implantable hearing aid, a telecoil, a receiver of a digital audio datastream, etc., for conversion of a sound signal into respective audio sound signals , a processor configured to generate a hearing loss compensated output signal based on the audio sound signals , a sound signal transmission member for transmission of a signal representing the hearing loss compensated output signal from a sound output of the BTE hearing aid housing at a first end of the sound signal transmission member to the ear canal of the user at a second end of the sound signal transmission member, an earpiece configured to be inserted in the ear canal of the user for fastening and retaining the sound signal transmission member in its intended position in the ear canal of the user, and an output transducer for conversion of the hearing loss compensated output signal to an auditory output
- the BTE hearing aid may be a multi-channel hearing aid in which signals to be processed are divided into a plurality of frequency channels, and wherein signals are processed individually in each of the frequency channels.
- the processor may be configured for processing the output signals of the at least one ITE microphone and the at least one BTE sound input transducer in such a way that the hearing loss compensated output signal substantially preserves spatial cues in a selected frequency band.
- the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
- the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
- the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
- the at least one ITE microphone may be connected conventionally as an input source to the signal processor of the hearing aid and may cooperate with the signal processor of the hearing aid in a well-known way.
- the at least one ITE microphone supplies the input to the hearing aid at frequencies where the hearing aid is capable of supplying the desired gain with this configuration.
- the microphones of BTE hearing aid housing are included in the signal processing as disclosed above. In this way, the gain can be increased while simultaneously maintain the spatial information about the sound environment provided by the at least one ITE microphone.
- the hearing aid may for example comprise a first filter connected between the processor input and the at least one ITE microphone, and a second complementary filter connected between the processor input and a combined output of the at least one BTE sound input transducer, the filters passing and blocking frequencies in complementary frequency bands so that one of the at least one ITE microphone and the combined output of at least one BTE sound input transducer constitutes the main part of the input signal supplied to the processor input in one frequency band, and the other one of the at least one ITE microphone and the combined output of at least one BTE sound input transducer constitutes the main part of the input signal supplied to the processor input in the complementary frequency band.
- the at least one ITE microphone may be used as the sole input source to the processor in a frequency band wherein the required gain for hearing loss compensation can be applied to the output signal of the at least one ITE microphone. Outside this frequency band, the combined output signal of the at least one BTE sound input transducer is applied to the signal processor for provision of the required gain.
- the combined output signal of the at least one BTE sound input transducer may be subject to adaptive filtering in the ways described elsewhere in the present description.
- the combination of the signals could e.g. be based on different types of band pass filtering.
- the "output signals of the at least one ITE microphone” may be used to identify any analogue or digital signal forming part of the signal path from the output of the at least one ITE microphone to an input of the processor, including pre-processed output signals of the at least one ITE microphone.
- the "output signals of the at least one BTE sound input transducer" may be used to identify any analogue or digital signal forming part of the signal path from the at least one BTE sound input transducer to an input of the processor, including pre-processed output signals of the at least one BTE sound input transducer.
- the at least one ITE microphone is positioned so that the output signal of the at least one ITE microphone generated in response to the incoming sound has a transfer function that constitutes a good approximation to the HRTFs of the user.
- the signal processor conveys the directional information contained in the output signal of the at least one ITE microphone to the resulting hearing loss compensated output signal of the processor so that the hearing loss compensated output signal of the processor also attains a transfer function that constitutes a good approximation to the HRTFs of the user whereby improved localization is provided to the user.
- a BTE hearing aid has a BTE housing that is shaped to be worn behind the pinna of the user.
- the BTE housing accommodates components for hearing loss compensation.
- a sound signal transmission member i.e. a sound tube or an electrical conductor, transmits a signal representing the hearing loss compensated sound from the BTE housing into the ear canal of the user.
- an earpiece, shell, or earmould may be provided for insertion into the ear canal of the user constituting an open solution.
- the earpiece, shell, or earmould does not obstruct the ear canal when it is positioned in its intended operational position in the ear canal.
- the earpiece, shell, or earmould is individually custom manufactured or manufactured in a number of standard sizes to fit the user's ear to sufficiently secure the sound signal transmission member in its intended position in the ear canal and prevent the earpiece from falling out of the ear, e.g., when the user moves the jaw.
- the output transducer may be a receiver positioned in the BTE hearing aid housing.
- the sound signal transmission member comprises a sound tube for propagation of acoustic sound signals from the receiver positioned in the BTE hearing aid housing and through the sound tube to an earpiece positioned and retained in the ear canal of the user and having an output port for transmission of the acoustic sound signal to the eardrum in the ear canal.
- the output transducer may be a receiver positioned in the earpiece.
- the sound signal transmission member comprises electrical conductors for propagation of audio sound signals from the output of a signal processor in the BTE hearing aid housing through the conductors to a receiver positioned in the earpiece for emission of sound through an output port of the earpiece.
- the ITE microphone housing accommodating at least one ITE microphone may be combined with, or be constituted by, the earpiece so that the at least one microphone is positioned proximate the entrance to the ear canal when the earpiece is fastened in its intended position in the ear canal.
- the ITE microphone housing may be connected to the earpiece with an arm, possibly a flexible arm that is intended to be positioned inside the pinna, e.g. around the circumference of the conchae abutting the antihelix and at least partly covered by the antihelix for retaining its position inside the outer ear of the user.
- the arm may be pre-formed during manufacture, preferably into an arched shape with a curvature slightly larger than the curvature of the antihelix, for easy fitting of the arm into its intended position in the pinna.
- the arm has a length and a shape that facilitate positioning of the at least one ITE microphone in an operating position immediately below the triangular fossa.
- the signal processor may be accommodated in the BTE hearing aid housing, or in the ear piece, or part of the signal processor may be accommodated in the BTE hearing aid housing and part of the signal processor may be accommodated in the ear piece.
- the link may be wired or wireless.
- the signal processor operates to perform hearing loss compensation while maintaining spatial information of the sound environment for optimum spatial performance of the hearing aid and while at the same time providing as large maximum stable gain as possible.
- the output signal of the at least one ITE microphone of the earpiece may be a combination of several pre-processed ITE microphone signals or the output signal of a single ITE microphone of the at least one ITE microphone.
- One or more output signals of the at least one BTE sound input transducers are provided.
- the output signals may be pre-processed. Pre-processing may include, without excluding any form of processing; adaptive and/or static feedback suppression, adaptive or fixed beamforming and pre-filtering.
- Adaptive filters may be configured to adaptively filter the electronic output signals of the at least one BTE sound input transducer so that they correspond to the output signal of the at least one ITE microphone as closely as possible.
- the adaptive filters G 1 , G 2 , ... , G n have the respective transfer functions: G 1 ( f , t), G 2 ( f,t), ..., G n ( f,t).
- the at least one ITE microphone operates as monitor microphone(s) for generation of an electronic sound signal with the desired spatial information of the current sound environment.
- Each output signal of the at least one BTE sound input transducer is filtered with a respective adaptive filter, the filter coefficients of which are adapted to provide a combined output signal of the adaptive filter(s) that resembles the electronic sound signal provided by the at least one ITE microphone as closely as possible.
- LMS least mean square
- RLS recursive least squares
- Various weights may be incorporated into the minimization problems above so that the solution is optimized as specified by the values of the weights.
- frequency weights W(f) may optimize the solution in certain one or more frequency ranges.
- the minimization problem may be modified into: min G 1 f ⁇ t ... G n f ⁇ t ⁇ ⁇ W f ⁇ S IEC f ⁇ t - G 1 f ⁇ t S 1 BTEC f ⁇ t - ... - G n f ⁇ t S n BTEC f ⁇ t ⁇ p
- only magnitude of the transfer functions may be taken into account during minimization while phase is disregarded, i.e. in the one or more selected frequency range, the transfer function is substituted by its absolute value.
- the combined output signal of the adaptive filter(s) is passed on for further hearing loss compensation processing, e.g. with a compressor.
- hearing loss compensation processing e.g. with a compressor.
- the adaptive filters i.e. the algorithm adjusting the filter coefficients, adapt towards the new minimum of Eqn. 1.
- the time constants of the adaptation are set to appropriately respond to changes of the current sound environment.
- processor As used herein, the terms "processor”, “signal processor”, “controller”, “system”, etc., are intended to refer to CPU-related entities, either hardware, a combination of hardware and software, software, or software in execution.
- a "processor”, “signal processor”, “controller”, “system”, etc. may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
- processor designate both an application running on a processor and a hardware processor.
- processors may reside within a process and/or thread of execution, and one or more "processors”, “signal processors”, “controllers”, “systems”, etc., or any combination hereof, may be localized on one hardware processor, possibly in combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
- Fig. 4 schematically illustrates a BTE hearing aid 10 comprising a BTE hearing aid housing 12 (not shown - outer walls have been removed to make internal parts visible) to be worn behind the pinna 100 of a user.
- the BTE housing 12 accommodates at least one BTE sound input transducer 14, 16 with a front microphone 14 and a rear microphone 16 for conversion of a sound signal into a microphone audio sound signal, optional pre-filters (not shown) for filtering the respective microphone audio sound signals, A/D converters (not shown) for conversion of the respective microphone audio sound signals into respective digital microphone audio sound signals that are input to a processor 18 configured to generate a hearing loss compensated output signal based on the input digital audio sound signals.
- the hearing loss compensated output signal is transmitted through electrical wires contained in a sound signal transmission member 20 to a receiver 22 for conversion of the hearing loss compensated output signal to an acoustic output signal for transmission towards the eardrum of a user and contained in an earpiece 24 that is shaped (not shown) to be comfortably positioned in the ear canal of a user for fastening and retaining the sound signal transmission member in its intended position in the ear canal of the user as is well-known in the art of BTE hearing aids.
- the earpiece 24 also holds one ITE microphone 26 that is positioned at the entrance to the ear canal when the earpiece is positioned in its intended position in the ear canal of the user.
- the ITE microphone 26 is connected to an A/D converter (not shown) and optional to a pre-filter (not shown) in the BTE housing 12, with electrical wires (not visible) contained in the sound transmission member 20.
- the BTE hearing aid 10 is powered by battery 28.
- processor 18 Various possible functions of the processor 18 are disclosed above and some of these in more detail below.
- Fig. 5 schematically illustrates another BTE hearing aid 10 similar to the hearing aid shown in Fig. 1 , except for the difference that in Fig. 5 , the receiver 22 is positioned in the hearing aid housing 12 and not in the earpiece 24, so that acoustic sound output by the receiver 22 is transmitted through the sound tube 20 and towards the eardrum of the user when the earpiece 24 is positioned in its intended position in the ear canal of the user.
- the positioning of the ITE microphone 26 proximate the entrance to the ear canal of the user when the BTE hearing aids 10 of Figs. 4 and 5 are used is believed to lead to a good reproduction of the HRTFs of the user.
- Fig. 6 shows a BTE hearing aid 10 in its operating position with the BTE housing 12 behind the ear, i.e. behind the pinna 100, of the user.
- the illustrated BTE hearing aid 10 is similar to the hearing aids shown in Figs. 4 and 5 except for the fact that the ITE microphone 26 is positioned in the outer ear of the user outside the ear canal at the free end of an arm 30.
- the arm 30 is flexible and the arm 30 is intended to be positioned inside the pinna 100 , e.g. around the circumference of the conchae 102 behind the tragus 104 and antitragus 106 and abutting the antihelix 108 and at least partly covered by the antihelix for retaining its position inside the outer ear of the user.
- the arm may be pre-formed during manufacture, preferably into an arched shape with a curvature slightly larger than the curvature of the antihelix 104, for easy fitting of the arm 30 into its intended position in the pinna.
- the arm 30 contains electrical wires (not visible) for interconnection of the ITE microphone 26 with other parts of the BTE hearing aid circuitry.
- the arm 30 has a length and a shape that facilitate positioning of the ITE microphone 26 in an operating position below the triangular fossa.
- Fig. 7 is a block diagram illustrating one example of signal processing in the new BTE hearing aid 10.
- the BTE hearing aid 10 has a front microphone 14 and a rear microphone 16 for conversion of a sound signals arriving at the microphones 14, 16 into microphone audio sound signals.
- an ITE microphone 26 resides in an earpiece to be positioned in the outer ear of the user.
- the microphone audio sound signals are digitized and pre-processed, such as pre-filtered, in respective pre-processors 32, 34, 36.
- the microphone audio sound signals 38, 40 of the front and rear microphones 14, 16 are filtered in adaptive filter 42, 44, and the adaptively filtered signals are added to each other in adder 46 and input to a processor 18 for hearing loss compensation.
- the hearing loss compensated signal is output to a receiver 22 that converts the signal to an acoustic signal for transmission towards the ear drum of the user.
- Adaptation of the filter coefficients of adaptive filters 42, 44 are controlled by adaptive controller 48 that controls the adaptation of the filter coefficients to minimize the difference 50 between the output of adder 46 and the ITE microphone audio sound signal 52 provided by subtractor 54.
- the input signal 56 to the processor 18 models the microphone audio sound signal 52 of the ITE microphone 26, and thus also substantially models the HRTFs of the user.
- Pre-processing may include, without excluding any form of processing; adaptive and/or static feedback suppression, adaptive or fixed beamforming and pre-filtering.
- the adaptive controller 48 is configured to control the filter coefficients of adaptive filters 42, 44 so that their summed output 56 corresponds to the pre-processed output signal 52 of the ITE microphone 26 as closely as possible.
- the adaptive filters 42, 44 have the respective transfer functions: G 1 ( f,t), and G 2 ( f,t).
- the ITE microphone 26 operates as monitor microphone for generation of an electronic sound signal 56 with the desired spatial information of the current sound environment.
- the filter coefficients are adapted to obtain an exact or approximate solution to the following minimization problem: min G 1 f ⁇ t , G 2 f ⁇ t ⁇ ⁇ S IEC f ⁇ t - G 1 f ⁇ t S 1 BTEC f ⁇ t - G 2 f ⁇ t S 2 BTEC f ⁇ t ⁇ p
- LMS least mean square
- RLS recursive least squares
- Various weights may be incorporated into the minimization problems above so that the solution is optimized as specified by the values of the weights.
- frequency weights W(f) may optimize the solution in certain one or more frequency ranges.
- the minimization problem may be modified into: min G 1 f ⁇ t ... G n f ⁇ t ⁇ ⁇ W f ⁇ S IEC f ⁇ t - G 1 f ⁇ t S 1 BTEC f ⁇ t - ... - G n f ⁇ t S n BTEC f ⁇ t ⁇ p
- the combined output signal of the adaptive filter(s) is passed on for further hearing loss compensation processing, e.g. with a compressor.
- hearing loss compensation processing e.g. with a compressor.
- the adaptive filters 42, 44 i.e. the controller 48 adjusting the filter coefficients, adapt towards the new minimum of Eqn. 1.
- the time constants of the adaptation are set to appropriately respond to changes of the current sound environment.
- the new BTE hearing aid circuitry shown in Fig. 7 may operate in the entire frequency range of the BTE hearing aid 10.
- the BTE hearing aid 10 shown in Fig. 7 may be a multi-channel hearing aid in which microphone audio sound signals 38, 40, 52 to be processed are divided into a plurality of frequency channels, and wherein signals are processed individually in each of the frequency channels.
- Fig. 7 may illustrate the circuitry and signal processing in a single frequency channel.
- the circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
- the signal processing illustrated in Fig. 7 may be performed in a selected frequency band, e.g. selected during fitting of the hearing aid to a specific user at a dispenser's office.
- the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
- the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
- the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
- the at least one ITE microphone may be connected conventionally as an input source to the signal processor of the hearing aid and may cooperate with the signal processor of the hearing aid in a well-known way.
- the at least one ITE microphone supplies the input to the hearing aid at frequencies where the hearing aid is capable of supplying the desired gain with this configuration.
- the microphones of BTE hearing aid housing are included in the signal processing as disclosed above. In this way, the gain can be increased while simultaneously maintain the spatial information about the sound environment provided by the at least one ITE microphone.
- Fig. 8 is a block diagram illustrating a new BTE hearing aid 10 similar to the hearing aid 10 shown in Fig. 7 and operating in a way similar to the hearing aid 10 shown in Fig. 7 , except for the fact that the circuit has been generalized to include an arbitrary number N of ITE microphones 26-1, 26-2, ... , 26-N, and an arbitrary number M of BTE microphones 14-1, 14-2, ... , 14-M.
- N and M can be any non-negative integer.
- the output signals from the N ITE microphones 26-1, 26-2, ... , 26-N are delayed in delays 44-1, 44-2, ... , 44-N after pre-processing in pre-processors 32-1, 32-2, ... , 32-N to compensate for the delays of the output signals from the M BTE microphones 14-1, 14-2, ... , 14-M caused by the adaptive cue filters 42-1, 42-2, ... , 42-M.
- the delays 44-1, 44-2, ... , 44-N may also be used for beamforming.
- the output signals from the N ITE microphones 26-1, 26-2, ... , 26-N are further combined in the signal combiner 64, e.g. as a weighted sum, and the output 52 of the signal combiner 64 is fed to a subtractor 54 analogous to the circuit of Fig. 7 .
- the output signals from the M BTE microphones 14-1, 14-2, ... , 14-M are pre-processed in pre-processors 34-1, 34-2, ... , 34-M and filtered in the respective adaptive cue filters 42-1, 42-1, ... , 42-M and combined in the signal combiner 58, e.g. as a weighted sum, and the output 56 of the signal combiner 58 is fed to the subtractor 54 and the hearing aid processor 18 analogous to the circuit of Fig. 7 .
- the adaptive controller 48 controls the adaptation of the filter coefficients of adaptive cue filters 42-1, 42-1, ... , 42-M to minimize the difference 32 between the output of BTE signal combiner 58 and ITE signal combiner 64 provided by subtractor 54.
- the input signal 56 to the processor 18 models the microphone audio sound signal of the ITE microphones 26-1, 26-2, ... , 26-N, and thus also substantially models the HRTFs of the user.
- the new BTE hearing aid circuitry shown in Fig. 8 may operate in the entire frequency range of the BTE hearing aid 10.
- the BTE hearing aid 10 shown in Fig. 8 may be a multi-channel hearing aid in which microphone audio sound signals 38-1, 38-2, ... , 38-N, 40-1, 40-2, ... , 40-M to be processed are divided into a plurality of frequency channels, and wherein signals 38-1, 38-2, ... , 38-N, 40-1, 40-2, ... , 40-M are processed individually in each of the frequency channels.
- Fig. 8 may illustrate the circuitry and signal processing in a single frequency channel.
- the circuitry and signal processing may be duplicated in a plurality of the frequency channels, e.g. in all of the frequency channels.
- the signal processing illustrated in Fig. 8 may be performed in a selected frequency band, e.g. selected during fitting of the hearing aid to a specific user at a dispenser's office.
- the selected frequency band may comprise one or more of the frequency channels, or all of the frequency channels.
- the selected frequency band may be fragmented, i.e. the selected frequency band need not comprise consecutive frequency channels.
- the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
- the at least one ITE microphone 26-1, 26-2, ... , 26-N may be connected conventionally as an input source to the signal processor 18 of the hearing aid 10 and may cooperate with the signal processor 18 of the hearing aid 10 in a well-known way.
- the at least one ITE microphone 26-1, 26-2, ... , 26-N supplies the input to the hearing aid 10 at frequencies where the hearing aid 10 is capable of supplying the desired gain with this configuration.
- the microphones 14-1, 14-2, ... , 14-M of BTE hearing aid housing are included in the signal processing as disclosed above. In this way, the gain can be increased while simultaneously maintain the spatial information about the sound environment provided by the at least one ITE microphone 26-1, 26-2, ... , 26-N.
- a signal combiner 66 has been inserted in front of the processor 18 (not shown), comprising first filters connected between the processor input and the output of the signal combiner 64 of the at least one ITE microphone 26-1, 26-2, ... , 26-N, and second complementary filters connected between the processor input and the output of the signal combiner 58 of the at least one BTE microphone 14-1, 14-2, ... , 14-M, the filters passing and blocking, respectively, frequencies in complementary frequency bands so that the output of the signal combiner 64 of the at least one ITE microphone 26-1, 26-2, ...
- 26-N constitutes the main part of the input signal supplied to the processor input in one or more first frequency bands
- the output of the signal combiner 58 of the at least one BTE microphone 14-1, 14-2, ... , 14-M constitutes the main part of the input signal supplied to the processor input in one or more complementary second frequency bands.
- the at least one ITE microphone 26-1, 26-2, ... , 26-N may be used as the sole input source to the processor 18 in one or more frequency bands wherein the required gain for hearing loss compensation can be applied to the output signal of the at least one ITE microphone 26-1, 26-2, ... , 26-N. Outside these one or more frequency bands, the combined output signal 56 of the at least one BTE sound input transducer is applied to the signal processor 18 for provision of the required gain.
- the combination of the signals could e.g. be based on different types of band pass filtering.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP12197705.2A EP2611218B1 (de) | 2011-12-29 | 2012-12-18 | Hörgerät mit verbesserter Ortung |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP11196089 | 2011-12-29 | ||
DKPA201170759 | 2011-12-29 | ||
US13/352,133 US8638960B2 (en) | 2011-12-29 | 2012-01-17 | Hearing aid with improved localization |
EP12197705.2A EP2611218B1 (de) | 2011-12-29 | 2012-12-18 | Hörgerät mit verbesserter Ortung |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2611218A1 true EP2611218A1 (de) | 2013-07-03 |
EP2611218B1 EP2611218B1 (de) | 2015-03-11 |
Family
ID=47351529
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP12197705.2A Active EP2611218B1 (de) | 2011-12-29 | 2012-12-18 | Hörgerät mit verbesserter Ortung |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP2611218B1 (de) |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2849462A1 (de) * | 2013-09-17 | 2015-03-18 | Oticon A/s | Hörgerätevorrichtung mit einem Eingangswandlersystem |
US9100762B2 (en) | 2013-05-22 | 2015-08-04 | Gn Resound A/S | Hearing aid with improved localization |
US9148733B2 (en) | 2012-12-28 | 2015-09-29 | Gn Resound A/S | Hearing aid with improved localization |
US9148735B2 (en) | 2012-12-28 | 2015-09-29 | Gn Resound A/S | Hearing aid with improved localization |
EP2928213A1 (de) | 2014-04-04 | 2015-10-07 | GN Resound A/S | Hörgerät mit verbesserter Lokalisierung einer monauralen Signalquelle |
US9338561B2 (en) | 2012-12-28 | 2016-05-10 | Gn Resound A/S | Hearing aid with improved localization |
EP3038381A1 (de) * | 2014-12-22 | 2016-06-29 | GN Resound A/S | Anhören eines diffusen Geräusches |
WO2016102300A1 (en) * | 2014-12-22 | 2016-06-30 | Gn Resound A/S | Diffuse noise listening |
US9432778B2 (en) | 2014-04-04 | 2016-08-30 | Gn Resound A/S | Hearing aid with improved localization of a monaural signal source |
US9843859B2 (en) | 2015-05-28 | 2017-12-12 | Motorola Solutions, Inc. | Method for preprocessing speech for digital audio quality improvement |
CN110996238A (zh) * | 2019-12-17 | 2020-04-10 | 杨伟锋 | 双耳同步信号处理助听系统及方法 |
EP3116240B1 (de) | 2015-07-09 | 2020-04-15 | Oticon A/s | Hörgerät mit abnehmbarer lautsprechereinheit |
WO2021015938A1 (en) * | 2019-07-25 | 2021-01-28 | X Development Llc | Partial hrtf compensation or prediction for in-ear microphone arrays |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1414268A2 (de) * | 2002-10-23 | 2004-04-28 | Siemens Audiologische Technik GmbH | Verfahren zum Einstellen und zum Betrieb eines Hörhilfegerätes sowie Hörhilfegerät |
EP1594344A2 (de) * | 2005-08-03 | 2005-11-09 | Phonak Ag | Verfahren zur Erlangen der Eigenschaften, und Hörgerät |
EP2088802A1 (de) * | 2008-02-07 | 2009-08-12 | Oticon A/S | Verfahren zur Schätzung der Gewichtungsfunktion von Audiosignalen in einem Hörgerät |
EP2124483A2 (de) * | 2008-05-21 | 2009-11-25 | Starkey Laboratories, Inc. | Mischen von Signalen eines In-Ohr-Mikrofons und Signalen eines Mikrofons außerhalb des Ohrs, um die räumliche Wahrnehmung zu steigern |
-
2012
- 2012-12-18 EP EP12197705.2A patent/EP2611218B1/de active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1414268A2 (de) * | 2002-10-23 | 2004-04-28 | Siemens Audiologische Technik GmbH | Verfahren zum Einstellen und zum Betrieb eines Hörhilfegerätes sowie Hörhilfegerät |
EP1594344A2 (de) * | 2005-08-03 | 2005-11-09 | Phonak Ag | Verfahren zur Erlangen der Eigenschaften, und Hörgerät |
EP2088802A1 (de) * | 2008-02-07 | 2009-08-12 | Oticon A/S | Verfahren zur Schätzung der Gewichtungsfunktion von Audiosignalen in einem Hörgerät |
EP2124483A2 (de) * | 2008-05-21 | 2009-11-25 | Starkey Laboratories, Inc. | Mischen von Signalen eines In-Ohr-Mikrofons und Signalen eines Mikrofons außerhalb des Ohrs, um die räumliche Wahrnehmung zu steigern |
Cited By (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9148735B2 (en) | 2012-12-28 | 2015-09-29 | Gn Resound A/S | Hearing aid with improved localization |
US9338561B2 (en) | 2012-12-28 | 2016-05-10 | Gn Resound A/S | Hearing aid with improved localization |
US9148733B2 (en) | 2012-12-28 | 2015-09-29 | Gn Resound A/S | Hearing aid with improved localization |
US9100762B2 (en) | 2013-05-22 | 2015-08-04 | Gn Resound A/S | Hearing aid with improved localization |
EP3214857A1 (de) * | 2013-09-17 | 2017-09-06 | Oticon A/s | Hörhilfegerät mit einem eingangswandlersystem |
EP2849462A1 (de) * | 2013-09-17 | 2015-03-18 | Oticon A/s | Hörgerätevorrichtung mit einem Eingangswandlersystem |
US20150078600A1 (en) * | 2013-09-17 | 2015-03-19 | Oticon A/S | Hearing assistance device comprising an input transducer system |
US10182298B2 (en) | 2013-09-17 | 2019-01-15 | Oticfon A/S | Hearing assistance device comprising an input transducer system |
US9538296B2 (en) | 2013-09-17 | 2017-01-03 | Oticon A/S | Hearing assistance device comprising an input transducer system |
US20170078803A1 (en) * | 2013-09-17 | 2017-03-16 | Oticon A/S | Hearing assistance device comprising an input transducer system |
EP2928213A1 (de) | 2014-04-04 | 2015-10-07 | GN Resound A/S | Hörgerät mit verbesserter Lokalisierung einer monauralen Signalquelle |
US9432778B2 (en) | 2014-04-04 | 2016-08-30 | Gn Resound A/S | Hearing aid with improved localization of a monaural signal source |
JP2017539181A (ja) * | 2014-12-22 | 2017-12-28 | ジーエヌ ヒアリング エー/エスGN Hearing A/S | 拡散性雑音聴取 |
WO2016102300A1 (en) * | 2014-12-22 | 2016-06-30 | Gn Resound A/S | Diffuse noise listening |
EP3038381A1 (de) * | 2014-12-22 | 2016-06-29 | GN Resound A/S | Anhören eines diffusen Geräusches |
US9774960B2 (en) | 2014-12-22 | 2017-09-26 | Gn Hearing A/S | Diffuse noise listening |
US9843859B2 (en) | 2015-05-28 | 2017-12-12 | Motorola Solutions, Inc. | Method for preprocessing speech for digital audio quality improvement |
EP3116240B1 (de) | 2015-07-09 | 2020-04-15 | Oticon A/s | Hörgerät mit abnehmbarer lautsprechereinheit |
WO2021015938A1 (en) * | 2019-07-25 | 2021-01-28 | X Development Llc | Partial hrtf compensation or prediction for in-ear microphone arrays |
US10959026B2 (en) | 2019-07-25 | 2021-03-23 | X Development Llc | Partial HRTF compensation or prediction for in-ear microphone arrays |
CN114586378A (zh) * | 2019-07-25 | 2022-06-03 | 依羽公司 | 用于入耳式麦克风阵列的部分hrtf补偿或预测 |
US11510013B2 (en) | 2019-07-25 | 2022-11-22 | Iyo Inc. | Partial HRTF compensation or prediction for in-ear microphone arrays |
CN114586378B (zh) * | 2019-07-25 | 2023-06-16 | 依羽公司 | 用于入耳式麦克风阵列的部分hrtf补偿或预测 |
CN116567477A (zh) * | 2019-07-25 | 2023-08-08 | 依羽公司 | 用于入耳式麦克风阵列的部分hrtf补偿或预测 |
CN116567477B (zh) * | 2019-07-25 | 2024-05-14 | 依羽公司 | 用于入耳式麦克风阵列的部分hrtf补偿或预测 |
CN110996238A (zh) * | 2019-12-17 | 2020-04-10 | 杨伟锋 | 双耳同步信号处理助听系统及方法 |
CN110996238B (zh) * | 2019-12-17 | 2022-02-01 | 杨伟锋 | 双耳同步信号处理助听系统及方法 |
Also Published As
Publication number | Publication date |
---|---|
EP2611218B1 (de) | 2015-03-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DK2611218T3 (en) | A hearing aid with improved location determination | |
EP2611218B1 (de) | Hörgerät mit verbesserter Ortung | |
US9338561B2 (en) | Hearing aid with improved localization | |
US9148735B2 (en) | Hearing aid with improved localization | |
US9100762B2 (en) | Hearing aid with improved localization | |
US9432778B2 (en) | Hearing aid with improved localization of a monaural signal source | |
US9148733B2 (en) | Hearing aid with improved localization | |
JP2014140159A5 (de) | ||
EP2928213B1 (de) | Hörgerät mit verbesserter Lokalisierung einer monauralen Signalquelle | |
EP2806660B1 (de) | Hörgerät mit verbesserter Ortung | |
EP2750412B1 (de) | Verbesserte Lokalisierung mit Feedback | |
EP2750411B1 (de) | Hörgerät mit verbesserter Lokalisation | |
EP2750410B1 (de) | Hörgerät mit verbesserter Lokalisation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
17P | Request for examination filed |
Effective date: 20140103 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04R 25/00 20060101AFI20140806BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20141001 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 715884 Country of ref document: AT Kind code of ref document: T Effective date: 20150415 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602012005804 Country of ref document: DE Effective date: 20150423 |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20150522 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20150311 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20150311 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150611 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 715884 Country of ref document: AT Kind code of ref document: T Effective date: 20150311 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150612 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150713 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150711 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602012005804 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 4 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20151214 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 Ref country code: LU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151218 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151218 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 5 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20121218 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 6 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150311 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20211221 Year of fee payment: 10 Ref country code: DK Payment date: 20211217 Year of fee payment: 10 Ref country code: FR Payment date: 20211215 Year of fee payment: 10 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20211217 Year of fee payment: 10 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230530 |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: EBP Effective date: 20221231 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20221218 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221218 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20231218 Year of fee payment: 12 |