EP2806661B1 - Hörgerät mit räumlicher Signalverstärkung - Google Patents
Hörgerät mit räumlicher Signalverstärkung Download PDFInfo
- Publication number
- EP2806661B1 EP2806661B1 EP13168917.6A EP13168917A EP2806661B1 EP 2806661 B1 EP2806661 B1 EP 2806661B1 EP 13168917 A EP13168917 A EP 13168917A EP 2806661 B1 EP2806661 B1 EP 2806661B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- hearing aid
- ear
- binaural
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/552—Binaural
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/41—Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/554—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired using a wireless connection, e.g. between microphone and amplifier or using Tcoils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/556—External connectors, e.g. plugs or modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
Definitions
- a new binaural hearing aid system is provided that is configured to impart perceived spatial separation on monaural signal sources.
- today's digital hearing aids typically use multi-channel amplification and compression signal processing to restore audibility of sound for a hearing impaired individual. In this way, the patient's hearing ability is improved by making previously inaudible speech cues audible.
- One tool available to a hearing aid user in order to increase the signal to noise ratio of speech originating from a specific speaker is to equip the speaker in question with a microphone, often referred to as a spouse microphone, that picks up speech from the speaker in question with a high signal to noise ratio due to its proximity to the speaker.
- the spouse microphone converts the speech into a corresponding audio signal with a high signal to noise ratio and transmits the signal, preferably wirelessly, to the hearing aid for hearing loss compensation.
- a speech signal is provided to the user with a signal to noise ratio well above the SRT of the user in question.
- Another way of increasing the signal to noise ratio of speech from a speaker that a hearing aid user desires to listen to is to use a telecoil to magnetically pick up audio signals generated, e.g., by telephones, FM systems (with neck loops), and induction loop systems (also called "hearing loops").
- a telecoil to magnetically pick up audio signals generated, e.g., by telephones, FM systems (with neck loops), and induction loop systems (also called "hearing loops").
- sound may be transmitted to hearing aids with a high signal to noise ratio well above the SRT of the hearing aid users.
- a monaural audio signal is transmitted to the hearing aid.
- US 8,208,642 B2 discloses a method and an apparatus for a binaural hearing aid in which sound from a single monaural signal source is presented to both ears of a user wearing the binaural hearing aid in order to obtain benefits of binaural hearing when listening to the monaural signal source.
- the sound presented to one ear is phase shifted relative to the sound presented to the other ear, and additionally, the sound presented to one ear may be set to a different level relative to the sound presented to the other ear.
- a telephone signal may be presented to both ears in order to benefit from binaural reception of a telephone call, e.g. by relaying of the caller's voice to the ear without the telephone against it, albeit at the proper phase and level to properly lateralize the sound of the caller's voice.
- WO 2010/043223 discloses a binaural hearing aid system capable of delivering binaural stereo signals such that the user perceives the stereo image as being wider and more natural.
- Hearing aids typically reproduce sound in such a way that the user perceives sound sources to be localized inside the head. The sound is said to be internalized rather than being externalized.
- a common complaint for hearing aid users when referring to the "hearing speech in noise problem" is that it is very hard to follow anything that is being said even though the signal to noise ratio (SNR) should be sufficient to provide the required speech intelligibility.
- SNR signal to noise ratio
- a significant contributor to this fact is that the hearing aid reproduces an internalized sound field. This adds to the cognitive loading of the hearing aid user and may result in listening fatigue and ultimately that the user removes the hearing aid(s).
- an exemplary method is disclosed of enhancement in a hearing aid of a signal that is not received by the microphone accommodated in the hearing aid.
- the new method makes use of the human auditory system's capability of distinguishing sound sources located in different spatial positions in the sound environment, and concentrating on a selected one or more of the spatially separated sound sources.
- a new binaural hearing aid system using the new method is also disclosed.
- signals from different sound sources are presented to the ears of human in such a way that the human perceives the sound sources to be positioned in different spatial positions in the sound environment of the user.
- the user's auditory system's binaural signal processing is utilized to improve the user's capability of separating the signals from the different sound sources and of focussing his or her listening to a desired one of the sound sources, or even to simultaneously listen to and understand more than one of the sound sources.
- Human beings detect and localize sound sources in three-dimensional space by means of the human binaural sound localization capability.
- the input to the hearing consists of two signals, namely the sound pressures at each of the eardrums, in the following termed the binaural sound signals.
- HRTF Head-Related Transfer Function
- the HRTF contains all information relating to the sound transmission to the ears of the listener, including diffraction around the head, reflections from shoulders, reflections in the ear canal, etc., and therefore, the HRTF varies from individual to individual.
- the HRTF changes with direction and distance of the sound source in relation to the ears of the listener. It is possible to measure the HRTF for any direction and distance and simulate the HRTF, e.g. electronically, e.g. by filters. If such filters are inserted in the signal path between a audio signal source, such as a microphone, and headphones used by a listener, the listener will achieve the perception that the sounds generated by the headphones originate from a sound source positioned at the distance and in the direction as defined by the transfer functions of the filters simulating the HRTF in question, because of the true reproduction of the sound pressures in the ears.
- a audio signal source such as a microphone
- Binaural processing by the brain when interpreting the spatially encoded information, results in several positive effects, namely better signal source segregation ; direction of arrival (DOA) estimation; and depth/distance perception.
- DOE direction of arrival
- the human auditory system extracts information about distance and direction to a sound source, but it is known that the human auditory system uses a number of cues in this determination. Among the cues are spectral cues, reverberation cues, interaural time differences (ITD), interaural phase differences (IPD) and interaural level differences (ILD).
- ITD interaural time differences
- ILD interaural level differences
- the level difference is a result of diffraction and is determined by the relative position of the ears compared to the source. This cue is dominant above 2 kHz but the auditory system is equally sensitive to changes in ILD over the entire spectrum.
- a first monaural audio signal in a binaural hearing aid system originating from a first sound source such as a first monaural signal received from a first spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc.
- a first sound source such as a first monaural signal received from a first spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc.
- a second monaural audio signal in the binaural hearing aid system originating from a second sound source such as a second monaural signal received from a second spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc.
- a second sound source such as a second monaural signal received from a second spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc.
- the perceived spatial separation of the first and second signal sources assists the user in understanding speech in the first and second monaural audio signals, and in focussing the user's listening to a desired one of the first and second monaural audio signals.
- the first binaural filter may be configured to output signals intended for the right ear and left ear of the user of the binaural hearing aid system that are phase shifted with relation to each other in order to introduce a first interaural time difference whereby the perceived position of the corresponding sound source is shifted outside the head and laterally with relation to the orientation of the head of the user of the binaural hearing aid system.
- Further separation of sound sources may be obtained by provision of a second binaural filter so that the second monaural signal, such as a second monaural signal received from a second spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc., is filtered with the second binaural filter in such a way that the user perceives the received second monaural audio signal to be emitted by a sound source positioned in a second position and/or arriving from a second direction in space different from the first position and first direction.
- the second monaural signal such as a second monaural signal received from a second spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc.
- the second binaural filter may be configured to output signals intended for the right ear and left ear of the user of the binaural hearing aid system that are phase shifted with relation to each other in order to introduce a second interaural time difference whereby the corresponding position of the second sound source is shifted laterally, preferably in the opposite direction of the first sound source, with relation to the orientation of the head of the user of the binaural hearing aid system.
- the first binaural filter may be configured to output signals intended for the right ear and left ear of the user of the binaural hearing aid system that are equal to the first audio input signal multiplied with a first right gain and a first left gain, respectively; in order to obtain a first interaural level difference whereby the perceived position of the corresponding sound source is shifted laterally with relation to the orientation of the head of the user of the binaural hearing aid system.
- the second binaural filter may be configured to output signals intended for the right ear and left ear of the user of the binaural hearing aid system that are equal to the second audio input signal multiplied with a second right gain and a second left gain, respectively, in order to obtain a second interaural level difference whereby the perceived position of the corresponding sound source is shifted laterally, preferably in the opposite direction of the other sound source, with relation to the orientation of the head of the user of the binaural hearing aid system.
- the pair of first interaural time difference and first interaural level difference must be different from the pair of second interaural time difference and second interaural level difference, i.e. the first and second interaural level differences may be identical provided that the first and second interaural time differences are different and vice versa.
- a first monaural audio signal in a binaural hearing aid such as a first monaural signal received from a first spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc.
- a first monaural audio signal in a binaural hearing aid may be filtered with a selected first HRTF of a given first direction and first distance towards a sound source so that the user perceives the received first monaural audio signal to be emitted by a sound source positioned outside the head and in the first direction and at the first distance of the first HRTF.
- a second monaural audio signal such as a second monaural signal received from a second spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc., may be conventionally hearing loss compensated in the binaural hearing aid system whereby the second monaural signal is perceived to originate from the centre of the head.
- the perceived spatial separation of the perceived signal sources of the first and second monaural audio signals assists the user in understanding speech in the first and second monaural audio signals, and in focussing the user's listening to a desired one of the first and second monaural audio signals.
- Further separation of sound sources may be obtained by provision of a selected second HRTF so that the second monaural signal, such as a second monaural signal received from a second spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc., is filtered with the selected second HRTF different from the first HRTF of a given second direction and second distance towards a sound source so that the user perceives the received second monaural audio signal to be emitted by a sound source positioned in the second direction and at the second distance corresponding to the second HRTF, i.e. the first and second monaural audio signals are perceived to be emitted by sound sources located in different positions in space.
- the second monaural signal such as a second monaural signal received from a second spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc.
- the perceived spatial separation of the perceived signal sources of the first and second monaural audio signals assists the user in understanding speech in the first and second monaural audio signals, and in focussing the user's listening to a desired one of the first and second monaural audio signals.
- the first and second monaural audio signals may be filtered with approximations to respective HRTFs.
- HRTFs may be determined using a manikin, such as KEMAR. In this way, an approximation to the individual HRTFs is provided that can be of sufficient accuracy for the hearing aid user to maintain sense of direction when wearing the hearing aid.
- a new binaural hearing aid system in which signals that are not received by a microphone, such as a spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc., are filtered with binaural filters in such a way that a user perceives the signals to be emitted by respective sound sources positioned in different spatial positions in the sound environment of the user, whereby improved spatial separation of the different sound sources is facilitated.
- a microphone such as a spouse microphone, a media player, a hearing loop system, a teleconference system, a radio, a TV, a telephone, a device with an alarm, etc.
- a new method of binaural signal enhancement in a binaural hearing aid system comprising the steps of, binaurally filtering a first audio input signal into a first right ear signal for the right ear and a first left ear signal for the left ear selected from the group of signal pairs consisting of:
- the method may further comprise the steps of:
- Each of the first and second phase shifts and/or each of the first and second interaural level differences may correspond to azimuth directional changes towards the respective one of the first and second sound sources, ranging from - 90° to 90°.
- Azimuth is the perceived angle of direction towards the sound source projected onto the horizontal plane with reference to the forward looking direction of the user.
- the forward looking direction is defined by a virtual line drawn through the centre of the user's head and through a centre of the nose of the user.
- a sound source located in the forward looking direction has an azimuth value of 0°
- a sound source located directly in the opposite direction has an azimuth value of 180°.
- a sound source located in the left side of a vertical plane perpendicular to the forward looking direction of the user has an azimuth value of - 90°
- a sound source located in the right side of the vertical plane perpendicular to the forward looking direction of the user has an azimuth value of + 90°
- one signal is said to represent another signal when the one signal is a function of the other signal, for example the one signal may be formed by analogue-to-digital conversion, or digital-to-analogue conversion of the other signal; or, the one signal may be formed by conversion of an acoustic signal into an electronic signal or vice versa; or the one signal may be formed by analogue or digital filtering or mixing of the other signal; or the one signal may be formed by transformation, such as frequency transformation, etc, of the other signal; etc.
- signals that are processed by specific circuitry may be identified by a name that may be used to identify any analogue or digital signal forming part of the signal path of the signal in question from its input of the circuitry in question to its output of the circuitry.
- a name e.g. a name that may be used to identify any analogue or digital signal forming part of the signal path of the signal in question from its input of the circuitry in question to its output of the circuitry.
- an output signal of a microphone i.e. the microphone audio signal
- the microphone audio signal may be used to identify any analogue or digital signal forming part of the signal path from the output of the microphone to its input to the receiver, including any processed microphone audio signals.
- the new binaural hearing aid system may comprise multi-channel first and/or second hearing aids in which the audio input signals are divided into a plurality of frequency channels for individual processing of at least some of the audio input signals in each of the frequency channels.
- the plurality of frequency channels may include warped frequency channels, for example all of the frequency channels may be warped frequency channels.
- the new binaural hearing aid system may additionally provide circuitry used in accordance with other conventional methods of hearing loss compensation so that the new circuitry or other conventional circuitry can be selected for operation as appropriate in different types of sound environment.
- the different sound environments may include speech, babble speech, restaurant clatter, music, traffic noise, etc.
- the new binaural hearing aid system may for example comprise a Digital Signal
- DSP DSP Processor
- One of the selectable signal processing algorithms operates in accordance with the new method.
- various algorithms may be provided for conventional noise suppression, i.e. attenuation of undesired signals and amplification of desired signals.
- Microphone audio signals obtained from different sound environments may possess very different characteristics, e.g. average and maximum sound pressure levels (SPLs) and/or frequency content. Therefore, each type of sound environment may be associated with a particular program wherein a particular setting of algorithm parameters of a signal processing algorithm provides processed sound of optimum signal quality in a specific sound environment.
- a set of such parameters may typically include parameters related to broadband gain, corner frequencies or slopes of frequency-selective filter algorithms and parameters controlling e.g. knee-points and compression ratios of Automatic Gain Control (AGC) algorithms.
- AGC Automatic Gain Control
- Signal processing characteristics of each of the algorithms may be determined during an initial fitting session in a dispenser's office and programmed into the new binaural hearing aid system in a non-volatile memory area.
- the new binaural hearing aid system may have a user interface, e.g. buttons, toggle switches, etc, of the hearing aid housings, or a remote control, so that the user of the new binaural hearing aid system can select one of the available signal processing algorithms to obtain the desired hearing loss compensation in the sound environment in question.
- a user interface e.g. buttons, toggle switches, etc
- the user of the new binaural hearing aid system can select one of the available signal processing algorithms to obtain the desired hearing loss compensation in the sound environment in question.
- the new binaural hearing aid system may be capable of automatically classifying the user's sound environment into one of a number of sound environment categories, such as speech, babble speech, restaurant clatter, music, traffic noise, etc, and may automatically select the appropriate signal processing algorithm accordingly as known in the art.
- the new method and binaural hearing aid system will now be described more fully hereinafter with reference to the accompanying drawings, in which various examples of the new binaural hearing aid system are shown.
- the new method and binaural hearing aid system may, however, be embodied in different forms and should not be construed as limited to the examples set forth herein. Rather, these examples are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
- Fig. 1 schematically illustrates an example of the new binaural hearing aid system 10.
- the new binaural hearing aid system 10 has first and second hearing aids 10A, 10B.
- the first hearing aid 10A comprises a first microphone 12A for provision of first microphone audio signal 14A in response to sound received at the first microphone 12A.
- the microphone audio signal 14A may be pre-filtered in a first pre-filter 16A well-known in the art, and input to a signal processor 18.
- the first microphone 12A may include two or more microphones with signal processing circuitry for combining the microphone signals into the microphone audio signal 14A.
- the first hearing aid 10A may have two microphones and a beamformer for combining the microphone signals into a microphone audio signal 14A with a desired directivity pattern as is well-known in the art of hearing aids.
- the first hearing aid 10A also comprises a first input 20A for provision of a first audio input signal 24A representing sound output by a first sound source (not shown) and received at the first input 20A that is not a microphone input.
- the first sound source may be a spouse microphone (not shown) carried by a person the hearing aid user desires to listen to.
- the output signal of the spouse microphone is encoded for transmission to the first hearing aid 10A using wireless or wired data transmission.
- the transmitted data representing the spouse microphone audio signal are received by a receiver and decoder 22A for decoding into the first audio input signal 24A.
- the second hearing aid 10B comprises a second microphone 12B for provision of second microphone audio signal 14B in response to sound received at the second microphone 12B.
- the microphone audio signal 14B may be pre-filtered in a second pre-filter 16B well-known in the art, and input to signal processor 18.
- the second microphone 12B may include two or more microphones with signal processing circuitry for combining the microphone signals into the microphone audio signal 14B.
- the second hearing aid 10B may have two microphones and a beamformer for combining the microphone signals into a microphone audio signal 14B with a desired directivity pattern as is well-known in the art of hearing aids.
- the binaural hearing aid system 10 also comprises a second input 26 for provision of a second audio input signal 30 representing sound output by a second sound source (not shown) and received at the second input 26.
- the second sound source may be a second spouse microphone (not shown) carried by a second person the hearing aid user desires to listen to.
- the output signal of the second spouse microphone is encoded for transmission to the binaural hearing aid system 10 using wireless or wired data transmission.
- the transmitted data representing the spouse microphone audio signal are received by a receiver and decoder 28 for decoding into the second audio input signal 30.
- the second input 26 and receiver and decoder 28 may be accommodated in the first hearing aid 10A or in the second hearing aid 10B.
- first and second audio input signal 24A, 30 are presented to the ears of the user as monaural signals, i.e. the same signal is presented to both ears of the user, and both signals will be perceived to originate from the centre of the head of the user of the binaural hearing aid system.
- At least one of the first and second audio input signals 24A, 30 is filtered in such a way that the user of the binaural hearing aid system 10 perceives the corresponding signal source to be moved away from the centre of the head of the user.
- the resulting perceived spatial separation of the sound sources facilitates that the user's auditory system's binaural signal processing is utilized to improve the user's capability of separating the signals from the sound sources and of focussing his or her listening to a desired one of the sound sources, or even to simultaneously listen to and understand more than one of the sound sources.
- a set of two filters 32A-R, 32A-L, 34-R, 34-L is provided with inputs connected to the respective outputs 24A, 30 of each of the respective receivers and decoders 22A, 28 and with outputs 36A-R, 36A-L, 38-R, 38-L, one of which 36A-R, 38-R provides an output signal to the right ear and the other 36A-L, 38-L provides an output signal to the left ear.
- the sets of two filters 32A-R, 32A-L, 34-R, 34-L have transfer functions of respective HRTFs 32A, 34 imparting selected directions of arrival to the first and second sound sources.
- the HRTF 32A imparts a perceived direction of arrival to the first sound source having a direction of arrival with -45° azimuth, while the HRTF 34 imparts a perceived direction of arrival to the second sound source having a direction of arrival with + 45° azimuth.
- the first hearing aid 10A and the second hearing aid 10B may be configured for hearing loss compensation of the right ear and the left ear of the user, respectively; or, vice versa.
- the first hearing aid 10A is assumed to be configured for hearing loss compensation of the right ear; however, the operating principles of the new binaural hearing aid system and method do not depend on for which of the right and left ears, the first and second hearing aids perform hearing loss compensation.
- the output of the filters 32A-R, 32A-L, 34-R, 34-L, are processed in signal processor 18 for hearing loss compensation and the processor output signal 40A intended to be transmitted towards the right ear is connected to a first receiver 42A of the first hearing aid 10A for conversion into an acoustic signal for transmission towards an eardrum of the right ear of a user of the binaural hearing aid system 10, and the processor output signal 40B intended to be transmitted towards the left ear is connected to a second receiver 42B of the second hearing aid 10B for conversion into an acoustic signal for transmission towards an eardrum of the left ear of the user of the binaural hearing aid system 10.
- the HRTFs 32A, 34 may be individually determined for the user of the binaural hearing aid system, whereby the user's perceived externalization of and sense of direction towards the first and second sound sources will be distinct since the HRTFs will contain all information relating to the sound transmission to the ears of the user, including diffraction around the head, reflections from shoulders, reflections in the ear canal, etc., which cause variations of HRTFs of different users.
- Good sense of directions may also be obtained by approximations to individually determined HRTFs, such as HRTFs determined on a manikin, such as a KEMAR head, provided that the approximation to the individual HRTF is sufficiently accurate for the hearing aid user to maintain sense of direction towards the first and second sound sources.
- approximations may be constituted by HRTFs determined as averages of individual HRTFs of humans in a selected group of humans with certain physical similarities leading to corresponding similarities of the individual HRTFs, e.g. humans of the same age or in the same age range, humans of the same race, humans with similar sizes of pinnas, etc.
- Fig. 2 shows an example of the new binaural hearing aid system 10 similar to the example shown in Fig. 1 except for the fact that sufficient perceived spatial separation between the first and second sound sources is obtained by introducing a delay equal to the ITD of a desired azimuth direction of arrival in the signal path from the first receiver and decoder 22A to one of the ears of the user.
- the filter 32A-R introduces a time delay between its input signal 24A and output signal 36A-R intended for the right ear of the user, while the filter 32A-L shown in Fig. 1 is constituted by a direct connection between input 24A and output 36A-L.
- the perceived azimuth of the direction of arrival of the first sound source is shifted, e.g. to - 45°, while the signal from the second sound source is presented monaurally to the ears of the user, i.e. the output 30 of the receiver and decoder 28 is input as a monaural signal to the signal processor 18 and output to both ears of the user.
- perceived spatial separation of the first and second sound sources is obtained, since the first sound source is perceived to be position in a direction determined by the delay 32A-R, e.g. 45° azimuth, while the second sound source is perceived to be positioned at the centre inside the head of the user.
- Fig. 3 shows an example of the new binaural hearing aid system 10 similar to the example shown in Fig. 2 except for the fact that improved perceived spatial separation between the first and second sound sources is obtained by introducing an additional delay equal to the ITD of a desired second azimuth direction of arrival in the signal path from the second receiver and decoder 28 to one of the ears of the user.
- the filter 34-L may introduce a time delay between its input signal 30 and output signal 38-L intended for the left ear of the user, while the filter 34-R shown in Fig. 1 is constituted by a short-circuit between input 30 and output 38-R.
- the perceived azimuth of the direction of arrival of the second sound source is shifted, e.g. to + 45° while the perceived azimuth of the direction of arrival of the first sound source remains shifted, e.g. to - 45 °.
- improved perceived spatial separation of the first and second sound sources is obtained, since the first sound source is perceived to be position in a direction determined by the delay 32A-R, e.g. at - 45° azimuth, while the second sound source is perceived to be positioned in a direction determined by the delay 34-L, e.g. at +45° azimuth.
- the dashed lines indicate the housings of the first and second hearing aids 10A, 10B accommodating the components of the binaural hearing aid system 10.
- Each of the housings accommodates the one or more microphones 12A, 12B for reception of sound at the respective ear of the user for which the respective hearing aid 10A, 10B is intended for performing hearing loss compensation, and the respective receiver 42A, 42B for conversion of the respective output signal 40A, 40B of the signal processor 18 into acoustic signals for transmission towards eardrum of the respective one of the right and left ears of the user.
- the remaining circuitry may be distributed in arbitrary ways between the two hearing aid housings in accordance with design choices made by the designer of the binaural hearing aid system.
- Each of the signals in the binaural hearing aid system shown in Figs. 1 , 2 and 3 may be transmitted by wired or wireless transmission between the hearing aids 10A, 10B in a way well-known in the art of signal transmission.
- Fig. 4 shows an example of the new binaural hearing aid system 10 shown in Fig. 1 , wherein the second hearing aid 10B does not have a signal processor 18 and does not have inputs for provision of first and second audio input signals representing sound from respective first and second sound sources.
- the second hearing aid 10B only has the one or more second microphone 12B and the second receiver 42B and the required encoder and transmitter (not shown) for transmission of the microphone audio signal 14B for signal processing in the first hearing aid 10A, and receiver and decoder (not shown) for reception of the output signal 40B of the signal processor 18A.
- the remaining circuitry shown in Fig. 1 is accommodated in the housing of the first hearing aid 10A.
- Fig. 5 shows an example of the new binaural hearing aid system 10 shown in Fig. 1 , wherein the first and second hearing aids 10A, 10B both comprise a microphone, and a receiver, and a hearing aid processor.
- the illustrated new binaural hearing aid system comprises,
- a first hearing aid 10A comprising
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
Claims (8)
- Binaurales Hörgerätesystem (10), das umfasst:ein erstes Hörgerät (10A),ein zweites Hörgerät (10B),ein erstes Partnermikrofon zum Aufnehmen von Sprache von einem mit dem ersten Partnermikrofon ausgestatteten Lautsprecher und zum Umwandeln der Sprache in ein erstes monaurales Audiosignal (24A) zur Übertragung an das erste Hörgerät (10A), undein zweites Partnermikrofon zum Aufnehmen von Sprache von einem mit dem zweiten Partnermikrofon ausgestatteten Lautsprecher und zum Umwandeln der Sprache in ein zweites monaurales Audiosignal (30) zur Übertragung an eines von dem ersten Hörgerät (10A) und dem zweiten Hörgerät (10B), wobeidas erste Hörgerät (10A)einen ersten Eingang (20A) zum Bereitstellen des ersten monauralen Audioeingangssignals (24A) umfasst, das eine Sprache repräsentiert und von dem ersten Partnermikrofon ausgegeben wird und an dem ersten Eingang (20A) empfangen wird,eines von dem ersten Hörgerät (10A) und dem zweiten Hörgerät (10B)einen zweiten Eingang (26) zum Bereitstellen eines zweiten monauralen Audioeingangssignals (30) umfasst, das eine Sprache repräsentiert und von dem zweiten Partnermikrofon ausgegeben wird und an dem zweiten Eingang (26) empfangen wird,das erste Hörgerät (10A)einen ersten binauralen Filter (32A-R, 32A-L) zum Filtern des ersten monauralen Audioeingangssignals (24A) umfasst, der konfiguriert ist, um ein erstes rechtes Ohrsignal (36A-R) für ein rechtes Ohr eines Benutzers des binauralen Hörgerätesystems (10) und ein erstes linkes Ohrsignal (36A-L) für ein linkes Ohr des Benutzers auszugeben, die aus der Gruppe von Signalpaaren ausgewählt sind, die besteht aus:einem ersten rechten Ohrsignal (36A-R) und einem ersten linken Ohrsignal (36A-L), die um eine erste Phasenverschiebung in Beziehung zueinander phasenverschoben sind;einem ersten rechten Ohrsignal (36A-R) und einem erstem linken Ohrsignal (36A-L), die gleich dem ersten monauralen Audioeingangssignal (24A) sind, das mit einer ersten rechten Verstärkung bzw. einer unterschiedlichen ersten linken Verstärkung multipliziert ist;einem ersten rechten Ohrsignal (36A-R) und einem ersten linken Ohrsignal (36A-L), die gleich dem ersten monauralen Audioeingangssignal (24A) sind, das mit einer ersten rechten Verstärkung bzw. einer unterschiedlichen ersten linken Verstärkung multipliziert sind und um eine erste Phasenverschiebung in Beziehung zueinander phasenverschoben sind,eines von dem ersten Hörgerät (10A) und dem zweiten Hörgerät (10B)einen zweiten binauralen Filter (34B-R, 34B-L) zum Filtern des zweiten monauralen Audioeingangssignals (30) umfasst, der konfiguriert ist, um ein zweites rechtes Ohrsignal (38B-R) für das rechte Ohr und ein zweites linkes Ohrsignal (38B-L) für das linke Ohr auszugeben, die aus der Gruppe von Signalpaaren ausgewählt sind, die besteht aus:einem zweiten rechten Ohrsignal (38B-R) und einem zweiten linken Ohrsignal (38B-L), die um eine zweite Phasenverschiebung, die sich von der ersten Phasenverschiebung unterscheidet, in Beziehung zueinander phasenverschoben sind;einem zweiten rechten Ohrsignal (38B-R) und einem zweiten linken Ohrsignal (38B-L), die gleich dem zweiten monauralen Audioeingangssignal (30) sind, das mit einer zweiten rechten Verstärkung bzw. einer unterschiedlichen zweiten linken Verstärkung multipliziert ist;einem zweiten rechten Ohrsignal (38B-R) und einem zweiten linken Ohrsignal (38B-L), die gleich dem zweiten monauralen Audioeingangssignal (30) sind, das mit einer zweiten rechten Verstärkung bzw. einer unterschiedlichen zweiten linken Verstärkung multipliziert ist, und mit einer zweiten Phasenverschiebung in Beziehung zueinander phasenverschoben sind,wobei das erste Hörgerät (10A)einen ersten Ohrempfänger (42A) zur Umwandlung eines Eingangssignals (40A) des ersten Ohrempfängers in ein akustisches Signal zur Übertragung zu einem Trommelfell des ersten Ohrs des Benutzers des binauralen Hörgerätesystems (10) umfasst, unddas zweite Hörgerät (10B)einen zweiten Ohrempfänger (42B) zur Umwandlung eines Eingangssignals (40B) des zweiten Ohrhörers in ein akustisches Signal zur Übertragung zu einem Trommelfell des zweiten Ohrs des Benutzers des binauralen Hörgerätesystems (10) umfasst, und wobeidas erste rechte Ohrsignal (36A-R) und das zweite rechte Ohrsignal (38B-R) an einem von dem ersten Ohrempfängereingang (40A) und dem zweiten Ohrempfängereingang (40B) bereitgestellt werden, und das erste linke Ohrsignal (36A-L) und das zweite linke Ohrsignal (38B-L) an dem anderen von dem ersten Ohrempfängereingang (40A) und dem zweiten Ohrempfängereingang (40B) bereitgestellt werden, wobeider Benutzer wahrnimmt, dass das erste monaurale Audioeingangssignal (24A) von dem ersten Partnermikrofon aus einer ersten Richtung im Raum ankommt, und dass das zweite monaurale Audioeingangssignal (30) von dem zweiten Partnermikrofon von einer zweiten Richtung im Raum ankommt, die von der ersten Richtung im Raum unterschiedlich ist, wodurch der Benutzer dabei unterstützt wird, die Sprache in dem ersten und dem zweiten monauralen Audiosignal zu verstehen, und das Hören des Benutzers auf ein gewünschtes von dem ersten und dem zweiten monauralen Audiosignal zu fokussieren.
- Binaurales Hörgerätesystem (10) nach Anspruch 1, wobei die erste Phasenverschiebung von 150° bis 210° reicht.
- Binaurales Hörgerätesystem (10) nach Anspruch 1, wobei die erste Phasenverschiebung Azimutrichtungsänderungen entspricht, die von - 90° bis 90° reichen.
- Binaurales Hörgerätesystem (10) nach einem der vorhergehenden Ansprüche, wobei eines von dem ersten rechten Ohrsignal (36A-R) und dem ersten linken Ohrsignal (36A-L) in Bezug auf das erste monaurale Audioeingangssignal (24A) phasenverschoben ist, und das andere von dem ersten rechten Ohrsignal (36A-R) und dem ersten linken Ohrsignal (36A-L) das erste monaurale Audioeingangssignal (24A) ist.
- Binaurales Hörgerätesystem (10) nach einem der vorhergehenden Ansprüche, wobei das erste Hörgerät (10A) umfasstden zweiten Eingang (26) undden zweiten binauralen Filter (34B-R, 34B-L).
- Binaurales Hörgerätesystem (10) nach einem der Ansprüche 1 bis 4, wobei das zweite Hörgerät (10B) umfasstden zweiten Eingang (26) undden zweiten binauralen Filter (34B-R, 34B-L).
- Binaurales Hörgerätesystem (10) nach einem der vorhergehenden Ansprüche, wobei der erste binaurale Filter (32A-R, 32A-L) ein HRTF-Filter ist.
- Binaurales Hörgerätesystem (10) nach einem der vorhergehenden Ansprüche, wobei der zweite binaurale Filter (34B-R, 34B-L) ein HRTF-Filter ist.
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP13168917.6A EP2806661B1 (de) | 2013-05-23 | 2013-05-23 | Hörgerät mit räumlicher Signalverstärkung |
DK13168917.6T DK2806661T3 (en) | 2013-05-23 | 2013-05-23 | A hearing aid with spatial signal enhancement |
US13/901,922 US10425747B2 (en) | 2013-05-23 | 2013-05-24 | Hearing aid with spatial signal enhancement |
JP2014106341A JP6092151B2 (ja) | 2013-05-23 | 2014-05-22 | 空間的に信号を強調する補聴器 |
CN201410222338.1A CN104185130B (zh) | 2013-05-23 | 2014-05-23 | 具有空间信号增强的助听器 |
US16/515,481 US10869142B2 (en) | 2013-05-23 | 2019-07-18 | Hearing aid with spatial signal enhancement |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP13168917.6A EP2806661B1 (de) | 2013-05-23 | 2013-05-23 | Hörgerät mit räumlicher Signalverstärkung |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2806661A1 EP2806661A1 (de) | 2014-11-26 |
EP2806661B1 true EP2806661B1 (de) | 2017-09-06 |
Family
ID=48446202
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13168917.6A Active EP2806661B1 (de) | 2013-05-23 | 2013-05-23 | Hörgerät mit räumlicher Signalverstärkung |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP2806661B1 (de) |
DK (1) | DK2806661T3 (de) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9774960B2 (en) | 2014-12-22 | 2017-09-26 | Gn Hearing A/S | Diffuse noise listening |
WO2017156276A1 (en) * | 2016-03-11 | 2017-09-14 | Mayo Foundation For Medical Education And Research | Cochlear stimulation system with surround sound and noise cancellation |
US10136229B2 (en) | 2017-03-24 | 2018-11-20 | Cochlear Limited | Binaural segregation of wireless accessories |
DE102018210053A1 (de) * | 2018-06-20 | 2019-12-24 | Sivantos Pte. Ltd. | Verfahren zur Audio-Wiedergabe in einem Hörgerät |
CN113473313A (zh) * | 2021-08-03 | 2021-10-01 | 深圳市兴华健实业有限公司 | 一种影院智能音响电路 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050100182A1 (en) * | 2003-11-12 | 2005-05-12 | Gennum Corporation | Hearing instrument having a wireless base unit |
WO2010043223A1 (en) * | 2008-10-14 | 2010-04-22 | Widex A/S | Method of rendering binaural stereo in a hearing aid system and a hearing aid system |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE60328402D1 (de) * | 2002-09-23 | 2009-08-27 | Koninkl Philips Electronics Nv | Tonsignalerzeugung |
WO2005120133A1 (en) * | 2004-06-04 | 2005-12-15 | Samsung Electronics Co., Ltd. | Apparatus and method of reproducing wide stereo sound |
US8208642B2 (en) * | 2006-07-10 | 2012-06-26 | Starkey Laboratories, Inc. | Method and apparatus for a binaural hearing assistance system using monaural audio signals |
ATE522094T1 (de) * | 2008-03-14 | 2011-09-15 | Am3D As | Audioprozessor zur umwandlung eines monosignals in ein stereosignal |
JP5409656B2 (ja) * | 2009-01-22 | 2014-02-05 | パナソニック株式会社 | 補聴装置 |
-
2013
- 2013-05-23 EP EP13168917.6A patent/EP2806661B1/de active Active
- 2013-05-23 DK DK13168917.6T patent/DK2806661T3/en active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050100182A1 (en) * | 2003-11-12 | 2005-05-12 | Gennum Corporation | Hearing instrument having a wireless base unit |
WO2010043223A1 (en) * | 2008-10-14 | 2010-04-22 | Widex A/S | Method of rendering binaural stereo in a hearing aid system and a hearing aid system |
Also Published As
Publication number | Publication date |
---|---|
DK2806661T3 (en) | 2017-12-11 |
EP2806661A1 (de) | 2014-11-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10869142B2 (en) | Hearing aid with spatial signal enhancement | |
US9307331B2 (en) | Hearing device with selectable perceived spatial positioning of sound sources | |
US9930456B2 (en) | Method and apparatus for localization of streaming sources in hearing assistance system | |
EP3468228B1 (de) | Binaurales hörsystem mit lokalisierung von schallquellen | |
AU2008362920B2 (en) | Method of rendering binaural stereo in a hearing aid system and a hearing aid system | |
JP6193844B2 (ja) | 選択可能な知覚空間的な音源の位置決めを備える聴覚装置 | |
US9432778B2 (en) | Hearing aid with improved localization of a monaural signal source | |
EP2806661B1 (de) | Hörgerät mit räumlicher Signalverstärkung | |
EP2928213B1 (de) | Hörgerät mit verbesserter Lokalisierung einer monauralen Signalquelle | |
US8666080B2 (en) | Method for processing a multi-channel audio signal for a binaural hearing apparatus and a corresponding hearing apparatus | |
EP2887695B1 (de) | Hörgerät mit wählbarer wahrgenommener räumlicher Positionierung von Schallquellen | |
DK201370280A1 (en) | A hearing aid with spatial signal enhancement |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20130523 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
R17P | Request for examination filed (corrected) |
Effective date: 20150512 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
17Q | First examination report despatched |
Effective date: 20151117 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04R 25/00 20060101AFI20160324BHEP Ipc: H04S 7/00 20060101ALN20160324BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04R 25/00 20060101AFI20170310BHEP Ipc: H04S 7/00 20060101ALN20170310BHEP |
|
INTG | Intention to grant announced |
Effective date: 20170407 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: PEDERSEN, BRIAN DAM Inventor name: GRAN, KARL-FREDRIK JOHAN |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 927098 Country of ref document: AT Kind code of ref document: T Effective date: 20170915 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602013026042 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20171207 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20170906 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171206 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: GN HEARING A/S |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 927098 Country of ref document: AT Kind code of ref document: T Effective date: 20170906 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171206 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171207 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 6 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180106 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602013026042 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20180607 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20180531 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180523 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180523 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180531 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180523 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20130523 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 Ref country code: MK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170906 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170906 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230525 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230516 Year of fee payment: 11 Ref country code: DK Payment date: 20230515 Year of fee payment: 11 Ref country code: DE Payment date: 20230524 Year of fee payment: 11 Ref country code: CH Payment date: 20230602 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230523 Year of fee payment: 11 |