EP2622879B1 - Procédé et dispositif de compression de fréquence - Google Patents

Procédé et dispositif de compression de fréquence Download PDF

Info

Publication number
EP2622879B1
EP2622879B1 EP10763664.9A EP10763664A EP2622879B1 EP 2622879 B1 EP2622879 B1 EP 2622879B1 EP 10763664 A EP10763664 A EP 10763664A EP 2622879 B1 EP2622879 B1 EP 2622879B1
Authority
EP
European Patent Office
Prior art keywords
channel
frequency
amplitude
signal
spectral model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP10763664.9A
Other languages
German (de)
English (en)
Other versions
EP2622879A1 (fr
Inventor
Ulrich Kornagel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos Pte Ltd
Original Assignee
Sivantos Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sivantos Pte Ltd filed Critical Sivantos Pte Ltd
Publication of EP2622879A1 publication Critical patent/EP2622879A1/fr
Application granted granted Critical
Publication of EP2622879B1 publication Critical patent/EP2622879B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/35—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using translation techniques
    • H04R25/353—Frequency, e.g. frequency shift or compression
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility

Definitions

  • the present invention relates to a method for frequency compression of an audio signal in a listening device. Moreover, the present invention relates to a corresponding device for frequency compression.
  • a hearing device is understood to mean any sound-emitting device which can be worn in or on the ear, in particular a hearing aid, a headset, headphones and the like.
  • Hearing aids are portable hearing aids that are used to care for the hearing impaired.
  • different types of hearing aids such as behind-the-ear hearing aids (BTE), hearing aid with external receiver (RIC: receiver in the canal) and in-the-ear hearing aids (IDO), e.g. Concha hearing aids or canal hearing aids (ITE, CIC).
  • BTE behind-the-ear hearing aids
  • RIC hearing aid with external receiver
  • IDO in-the-ear hearing aids
  • ITE canal hearing aids
  • the hearing aids listed by way of example are worn on the outer ear or in the ear canal.
  • bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.
  • Hearing aids have in principle as essential components an input transducer, an amplifier and an output transducer.
  • the input transducer is usually a sound receiver, z. As a microphone, and / or an electromagnetic receiver, for. B. an induction coil.
  • the output transducer is usually used as an electroacoustic transducer, z. As miniature speaker, or as an electromechanical transducer, z. B. bone conduction, realized.
  • the amplifier is usually integrated in a signal processing unit. This basic structure is in FIG. 1 shown using the example of a behind-the-ear hearing aid. In a hearing aid housing 1 for carrying behind the ear, one or more microphones 2 for receiving the sound from the environment are installed.
  • a signal processing unit 3 which is also integrated into the hearing aid housing 1, processes the microphone signals and amplifies them.
  • the output signal of the signal processing unit 3 is transmitted to a loudspeaker or earpiece 4, which outputs an acoustic signal.
  • the sound is optionally transmitted via a sound tube, which is fixed with an earmold in the ear canal, to the eardrum of the device carrier.
  • the power supply of the hearing device and in particular the signal processing unit 3 is effected by a likewise integrated into the hearing aid housing 1 battery. 5
  • Dead regions are frequency ranges in which spectral components can no longer be audibly amplified.
  • spectral components from a source frequency range typically at higher frequencies and in which no gain is to be applied (e.g., "dead region"), are shifted to a lower target frequency range. Audibility is generally guaranteed in this target frequency range, which is why amplification can be usefully applied.
  • Known frequency compressions work as follows, for example: A compression rule for an individual hearing loss is tailored, wherein the compression rule defines which source frequency should be compressed or mapped to which target frequency.
  • the practical realization of this compression rule is carried out by a filter bank. This means that the compression rule defines which source channel of the filter bank is mapped or compressed to which target channel. The smallest element So this process is a channel. This means that the spectral components within a channel are not compressed.
  • the possible positions of the channels are defined by the structure of the filter bank and thus fixed (fixed filter bank grid). Such a system is for example from the US 6,577,739 B1 known.
  • the described method for frequency compression is particularly unsuitable for speech sound.
  • voiced sounds is a fundamental frequency and several harmonics, which are found at integer multiples of the fundamental frequency.
  • the fine structure is responsible for the perception of the pitch of the speech sound.
  • the amplitudes of the fundamental frequency and the harmonics define the color of the sound and form the so-called spectral envelope.
  • the spectral envelope of vowels shows a typical formant structure in each case.
  • the spectral envelope carries the essential information that allows discrimination of the different sounds (e.g., distinguishing the vowels).
  • prior art frequency compression is accomplished by shifting source channels on a fixed filter bank grid.
  • the fixed filter bank grid is defined by the filter bank structure and not by the harmonic structure of the signal. Therefore, movement of source channels on the fixed filter bank grid to their destination channels in accordance with the compression rule destroys the harmonic structure.
  • the reason for this is that when moving the harmonic structure is just not considered. That the harmonics no longer inevitably appear at integer multiples of the fundamental frequency after compression. The destruction of the harmonic structure, however, leads to audible artifacts.
  • FFT Fast Fourier Transform
  • the object of the present invention is therefore to be able to better avoid artifacts in the frequency compression.
  • this object is achieved by a method for frequency compression of an audio signal in a listening device by obtaining an amplitude information of a source channel from a plurality of frequency channels of the audio signal and impressing an amplitude corresponding to the amplitude information to a signal in a destination channel of the plurality of frequency channels to which the source channel at Frequency compression is mapped, wherein the phase of the signal is maintained in the target channel.
  • an apparatus for frequency-compressing an audio signal for a listening device comprising estimating means for obtaining amplitude information of a source channel of a plurality of frequency channels of the audio signal and processing means for impressing an amplitude corresponding to the amplitude information on a signal in a destination channel of the plurality of frequency channels the source channel for frequency compression is to be mapped, wherein the processing means is adapted to maintain the phase of the signal in the target channel.
  • the amplitude information in a source channel of an audio signal is separated from the actual signal and used to impose a corresponding amplitude on a signal in a destination channel. Frequencies in the target channel are not affected thereby, whereby the harmonic structure of the audio signal can be maintained.
  • the amplitude information may be a mean channel amplitude. This is easy to win for a channel and can also be transferred to a target channel with little effort.
  • the amplitude information is preferably a spectral model of the audio signal, the spectral model is subjected to frequency compression, and the amplitude to be applied to the signal of the destination channel is determined from the compressed spectral model.
  • the spectral model is the spectral envelope resulting from the amplitudes the fundamental frequency and harmonic of a harmonic signal.
  • the spectral model thus represents a function that models the amplitude values over the frequency.
  • the amplitude to be recorded for the target channel can be obtained by sampling the compressed spectral model.
  • the amplitude for a certain frequency is obtained from the compressed spectral model or the compressed spectral envelope.
  • the amplitude to be recorded can be obtained by integrating or summing values of the compressed spectral model in the region of the target channel. As a result, a mean amplitude value for the target channel is determined from the spectral model.
  • At least one channel amplitude is obtained for each of the frequency channels and the spectral model of the audio signal is obtained from the channel amplitudes.
  • at least one value per frequency channel is provided for the spectral model.
  • the spectral model can be obtained by interpolation (spline). The individual points are connected by linear functions, quadratic functions, cubic functions and the like.
  • the spectral model can also be a polynomial function. In this case, the spectral model or the spectral envelope is simulated by an analytical function. From this in turn, amplitude values can be obtained without high computational effort.
  • the spectral model can also be obtained by a linear predictive coefficient (LPC) analysis in the time domain. This can be dispensed with a filter bank.
  • LPC linear predictive coefficient
  • the device for frequency compression comprises a polyphase filter bank to provide the audio signal in multiple frequency channels. This makes it possible to generate only positive frequency components in the channels.
  • the device according to the invention is particularly advantageously used in a listening device and in particular in a hearing aid.
  • a frequency compression in hearing aid users can be realized with fewer artifacts.
  • the main object of the present invention is to leave the spectral fine structure, in particular of a harmonic signal, untouched by subjecting only the amplitude information of a spectrum to compression.
  • a spectral envelope which represents a measure of the magnitude of the amplitude in the spectrum, is compressed.
  • the input signal is spectrally decomposed by a filter bank.
  • a corresponding Channel strength calculated for each channel participating in the compression process. Examples of channel strengths are the amplitude, the amplitude square, or any other measure of the power or strength of the signal in the corresponding channel.
  • the channel strengths can be interpreted as samples of the spectral envelopes that are to be compressed.
  • the channel strength represents an amplitude information in the sense of the present application.
  • the compression is achieved by shifting the channel strengths from the source channels to the destination channels according to a predetermined compression rule.
  • the original channel strengths of the destination channel (before compression) will be overwritten. That is, according to the present invention, the phase of an original signal (before compression) is maintained in the target channel. Only the channel strengths are modified. Thus, for example, after the filter bank, the envelope is impressed on the respective signals, and the phases are retained.
  • the compression rule according to the present invention is similar to the compression rule of a compression system according to the prior art.
  • the difference between the prior art approach and the inventive approach is that, according to the approach of the invention, only the channel strengths are shifted while in the prior art approach the complete channel signals are shifted. In the approach according to the invention, therefore, the spectral fine structure is retained. A harmonic remains a harmonic. Optionally, only its amplitude is varied.
  • the input signal is spectrally decomposed using a filter bank.
  • the channel strengths of all channels to be compressed are used to obtain a spectral model (eg an envelope).
  • This spectral model is obtained, for example, by linear interpolation, quadratic interpolation, cubic interpolation or by analytical modeling obtained using a polynomial function.
  • the spectral model or the envelope is compressed according to the compression rule.
  • the compressed spectral model is used to calculate the strengths of the target channels.
  • the phases of the destination channels are not modified as in the first implementation variant described above.
  • FIG. 2 shows a spectral model of an input signal of a hearing aid.
  • the channel strength (eg, amplitude, power, etc.) is plotted against frequency f for each of the frequency channels 10. The respective channel strength is symbolized by a point 11. Adjacent points 11 are each connected by a straight line. This results in a spectral envelope 12 by linear spline interpolation.
  • the spectral envelope 12 thus represents a spectral model of the input signal.
  • a high-frequency portion 13 of the entire spectrum is to be compressed.
  • the compression starts at a frequency f_cut_off.
  • the range to be compressed ranges from this frequency f_cut_off to the highest processed frequency channel.
  • the channels in the compression area 13 may be referred to as source channels 14 for frequency compression.
  • FIG. 4 shows a section of the target channels 15 of FIG. 3 , In the middle between the channel boundaries of each target channel 15, the compressed envelope 12 'is scanned.
  • the sampled values are not necessarily at the break points of the compressed envelope 12 '.
  • the value for the channel strength of the target channel is obtained directly from the sample, which results at the respective channel center of the compressed envelope 12 '.
  • the sampling may also be performed at a different frequency position within each destination channel 15.
  • the sampling can also take place at a channel boundary.
  • the value of a destination channel 15 is determined in another way. Namely, it is determined by averaging based on an integral or a sum of all values of the compressed envelope 12 'within each channel.
  • the respective mean value 16 is then a measure of the strength of the target channel 15. Again, the channel structure and in particular the distance between harmonics of the frequency compression remains unaffected. Only the amplitude of the spectral components in the compressed range is adapted or changed.
  • the decomposition of the input signal into the spectral fine structure and the spectral envelope can also be effected by means of an LPC (linear predictive coefficient) analysis and calculation of the residual signal in the time domain.
  • LPC linear predictive coefficient
  • a decomposition of the input signal into a spectral fine structure and a spectral envelope takes place and the spectral envelope is compressed independently of the spectral fine structure by a compression rule dependent on the hearing loss.
  • the spectral fine structure is retained. Consequently, the harmonic structure of a tonal signal remains unaffected, so that the described artifacts do not occur or are reduced. Frequency estimation is not necessary for this procedure.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Stereophonic System (AREA)

Claims (12)

  1. Procédé de compression de fréquence d'un signal audio au niveau d'un appareil auditif, par
    - acquisition d'une information d'amplitude d'un canal source (14) de plusieurs canaux de fréquence (10) du signal audio, caractérisé par
    - application d'une amplitude correspondant à l'information d'amplitude à un signal dans un canal cible (15) des plusieurs canaux de fréquence (10), sur lequel le canal source (14) est représenté lors de la compression de fréquence, la phase du signal dans le canal cible étant conservée.
  2. Procédé selon la revendication 1, selon lequel l'information d'amplitude est une intensité de canal qui représente une mesure pour la puissance du signal ou l'intensité du signal dans le canal correspondant.
  3. Procédé selon la revendication 1, selon lequel l'information d'amplitude est un modèle spectral (12) du signal audio, lequel restitue sous forme de modèle les valeurs d'amplitude d'une enveloppante spectrale, le modèle spectral (12) est soumis à la compression de fréquence en vue de former un modèle spectral comprimé et l'amplitude à appliquer au signal du canal cible (15) est déterminée à partir du modèle spectral comprimé (12').
  4. Procédé selon la revendication 3, selon lequel l'amplitude à appliquer est obtenue par balayage du modèle spectral comprimé (12').
  5. Procédé selon la revendication 3, selon lequel l'amplitude à appliquer est obtenue par calcul de l'intégrale ou de la somme des valeurs d'amplitude du modèle spectral comprimé (12') dans la plage du canal cible (15).
  6. Procédé selon l'une des revendications 3 à 5, selon lequel au moins une amplitude de canal est obtenue pour chacun des canaux de fréquence (10) et le modèle spectral (12) du signal audio est obtenu à partir des amplitudes de canal.
  7. Procédé selon la revendication 6, selon lequel le modèle spectral (12) est obtenu par interpolation des amplitudes de canal.
  8. Procédé selon la revendication 6 ou 7, selon lequel le modèle spectral (12) est une fonction en polynôme.
  9. Procédé selon la revendication 6, selon lequel le modèle spectral (12) est obtenu par analyse LPC dans le domaine temporel.
  10. Dispositif de compression de fréquence d'un signal audio pour un appareil auditif, comprenant
    - un dispositif d'estimation destiné à acquérir une information d'amplitude d'un canal source (14) de plusieurs canaux de fréquence (10) du signal audio et caractérisé par
    - un dispositif de traitement destiné à appliquer une amplitude correspondant à l'information d'amplitude à un signal dans un canal cible (15) des plusieurs canaux de fréquence (10), sur lequel le canal source (14) doit être représenté pour la compression de fréquence, le dispositif de traitement étant configuré pour conserver la phase du signal dans le canal cible.
  11. Dispositif selon la revendication 10, lequel possède un banc de filtres polyphasé pour effectuer une décomposition spectrale du signal audio et le délivrer ainsi dans plusieurs canaux de fréquence (10).
  12. Appareil auditif équipé d'un dispositif selon la revendication 10 ou 11.
EP10763664.9A 2010-09-29 2010-09-29 Procédé et dispositif de compression de fréquence Active EP2622879B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2010/064480 WO2012041373A1 (fr) 2010-09-29 2010-09-29 Procédé et dispositif de compression de fréquence

Publications (2)

Publication Number Publication Date
EP2622879A1 EP2622879A1 (fr) 2013-08-07
EP2622879B1 true EP2622879B1 (fr) 2015-11-11

Family

ID=44012481

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10763664.9A Active EP2622879B1 (fr) 2010-09-29 2010-09-29 Procédé et dispositif de compression de fréquence

Country Status (4)

Country Link
US (1) US8923538B2 (fr)
EP (1) EP2622879B1 (fr)
DK (1) DK2622879T3 (fr)
WO (1) WO2012041373A1 (fr)

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4051331A (en) 1976-03-29 1977-09-27 Brigham Young University Speech coding hearing aid system utilizing formant frequency transformation
US6577739B1 (en) 1997-09-19 2003-06-10 University Of Iowa Research Foundation Apparatus and methods for proportional audio compression and frequency shifting
AU2002368073B2 (en) * 2002-07-12 2007-04-05 Widex A/S Hearing aid and a method for enhancing speech intelligibility
AU2004201374B2 (en) * 2004-04-01 2010-12-23 Phonak Ag Audio amplification apparatus
WO2006133431A2 (fr) 2005-06-08 2006-12-14 The Regents Of The University Of California Procedes, dispositifs et systemes utilisant des algorithmes de traitement de signaux pour ameliorer l'intelligibilite de la parole et le confort d'ecoute
KR100678770B1 (ko) * 2005-08-24 2007-02-02 한양대학교 산학협력단 궤환 신호 제거 기능을 구비한 보청기
US8000487B2 (en) 2008-03-06 2011-08-16 Starkey Laboratories, Inc. Frequency translation by high-frequency spectral envelope warping in hearing assistance devices

Also Published As

Publication number Publication date
DK2622879T3 (da) 2016-02-15
US8923538B2 (en) 2014-12-30
EP2622879A1 (fr) 2013-08-07
WO2012041373A1 (fr) 2012-04-05
US20130188815A1 (en) 2013-07-25

Similar Documents

Publication Publication Date Title
DE102010026884B4 (de) Verfahren zum Betreiben einer Hörvorrichtung mit zweistufiger Transformation
EP2437258B1 (fr) Procédé et dispositif de compression de fréquence à décalage de fréquence sélectif
EP2919485B1 (fr) Transmission d'un signal à bruits de vent réduits à temps de latence diminué
EP2229010B1 (fr) Appareil auditif et procédé de compensation du bruit dans un appareil auditif
EP2620940A1 (fr) Procédé et dispositif d'écoute pour l'évaluation d'un composant de la voix
DE102008031150B3 (de) Verfahren zur Störgeräuschunterdrückung und zugehöriges Hörgerät
EP3926982A2 (fr) Procédé de réduction directionnelle du bruit pour un système auditif comprenant un dispositif auditif
EP2124335B1 (fr) Procédé d'optimisation d'un banc de filtres multi-étage ainsi que banc de filtres correspondant et dispositif auditif
EP1912470B1 (fr) Procédé pour la compression dynamique d'un signal audio et appareil auditif correspondant
DE102008017550A1 (de) Mehrstufiges Schätzverfahren zur Störgeräuschreduktion und Hörvorrichtung
EP2584795B1 (fr) Procédé de détermination d'une ligne caractéristique de compression
DE102007008739A1 (de) Hörvorrichtung mit Störsignaltrennung und entsprechendes Verfahren
EP2437521B2 (fr) Procédé de compression fréquentielle à l'aide d'une correction harmonique et dispositif correspondant
EP2622879B1 (fr) Procédé et dispositif de compression de fréquence
EP1945000A1 (fr) Procédé destiné à la réduction de puissances d'interférence et système acoustique correspondant
EP2190218B1 (fr) Système d'ensemble de filtres avec atténuation de bande affaiblie spécifique pour un dispositif auditif
DE102013207080B4 (de) Binaurale Mikrofonanpassung mittels der eigenen Stimme
DE102011006472B4 (de) Verfahren zur Verbesserung der Sprachverständlichkeit mit einem Hörhilfegerät sowie Hörhilfegerät
EP3048813B1 (fr) Procédé et dispositif de suppression du bruit basée sur l'inter-corrélation de bandes secondaires
DE102011087692B4 (de) Hörvorrichtung und Verfahren zur Verbesserung der Wahrnehmbarkeit eines Anteils eines Eingangssignals für einen Benutzer der Hörvorrichtung
WO2012041372A1 (fr) Procédé de compression de fréquence, dispositif d'adaptation et prothèse auditive
DE102009015564A1 (de) Verfahren zum Erzeugen eines direktionalen Signals und entsprechende Hörvorrichtung
DE102008064382A1 (de) Hörvorrichtung mit Transpositionsmöglichkeit und entsprechendes Verfahren
EP2699020A2 (fr) Procédé et dispositif de détermination d'un facteur d'amplification d'un appareil de correction auditive

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20130320

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150611

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIVANTOS PTE. LTD.

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 760970

Country of ref document: AT

Kind code of ref document: T

Effective date: 20151215

Ref country code: CH

Ref legal event code: NV

Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502010010654

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20160209

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160211

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160311

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160211

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160212

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160311

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502010010654

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

26N No opposition filed

Effective date: 20160812

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160929

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160929

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 760970

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160929

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20160930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160929

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20100929

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230921

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230919

Year of fee payment: 14

Ref country code: DK

Payment date: 20230921

Year of fee payment: 14

Ref country code: DE

Payment date: 20230919

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20231001

Year of fee payment: 14