EP1443798B1 - Prothèse auditive avec une fonction zoom pour l'oreille d'un individu - Google Patents

Prothèse auditive avec une fonction zoom pour l'oreille d'un individu Download PDF

Info

Publication number
EP1443798B1
EP1443798B1 EP20040002886 EP04002886A EP1443798B1 EP 1443798 B1 EP1443798 B1 EP 1443798B1 EP 20040002886 EP20040002886 EP 20040002886 EP 04002886 A EP04002886 A EP 04002886A EP 1443798 B1 EP1443798 B1 EP 1443798B1
Authority
EP
European Patent Office
Prior art keywords
ear
microphone
output
hearing
khz
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP20040002886
Other languages
German (de)
English (en)
Other versions
EP1443798A2 (fr
EP1443798A3 (fr
Inventor
Friedrich Bock
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sonova Holding AG
Original Assignee
Phonak AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Phonak AG filed Critical Phonak AG
Priority to DK04002886T priority Critical patent/DK1443798T3/da
Priority to EP20040002886 priority patent/EP1443798B1/fr
Priority to DE200460001058 priority patent/DE602004001058T2/de
Publication of EP1443798A2 publication Critical patent/EP1443798A2/fr
Publication of EP1443798A3 publication Critical patent/EP1443798A3/fr
Priority to CA2490845A priority patent/CA2490845C/fr
Application granted granted Critical
Publication of EP1443798B1 publication Critical patent/EP1443798B1/fr
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40—Arrangements for obtaining a desired directivity characteristic
    • H04R25/407—Circuits for combining signals of a plurality of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones

Definitions

  • the present invention departs from needs which have been recognized at behind-the-ear hearing devices, thereby especially at behind-the-ear hearing aid devices. Nevertheless, although departing from such devices, the present invention may be applied to all hearing systems where there is applied a microphone arrangement not within the ear canal, thereby especially behind the pinna of an individual's ear, the output of which operationally acting on an electrical to mechanical output converter which is applied to the same and/or the other ear of the individual.
  • the hearing device may be a device for increasing hearing capability or a hearing protection device.
  • the microphone arrangement which, for this mode, may consist of one omnidirectional microphone, provides per se for an omnidirectional transfer characteristic, which means that acoustical signals impinging on the microphone arrangement are converted to an electrical output signal with a predetermined constant amplification irrespective of the direction with which such acoustical signals impinge on the arrangement.
  • the acoustical to electrical transfer characteristic becomes not anymore independent of the direction at which acoustical sources appear to the microphone due to the so-called head-related transfer function HRTF, which results in some degree from "shadowing" of the acoustical signals dependent where the acoustical signal source is located with respect to the microphone arrangement.
  • 0° direction is defined in the direction at which individual's head H faces and 90° direction is defined perpendicularly thereto in a direction pointing outwards of individual's right ear E R one recognizes at this right ear a transfer characteristic at a frequency f of 0.5 kHz of acoustical signals as shown in fig. 2.
  • the acoustical signals from acoustical sources seen under an angle of 180° to 0° are considerably attenuated, which is predominantly caused by the shadowing effect of individual's head, i.e. by the HRTF.
  • the amplification is substantially equal.
  • the transfer characteristic is shown at 4 kHz.
  • the directivity of the pinna becomes effective.
  • the pinna provides for a beam forming effect in a frequency band of 2 kHz to 7 kHz, thus with a significant frequency at 5 kHz.
  • the beam forming effect results in a higher amplification in 45° direction than in the 135° direction.
  • the 5 kHz frequency is significant for pronounced pinna directivity effect.
  • the transfer characteristics as exemplified by figs. 2 to 5 are transfer characteristics at respective acoustical signal frequencies of an individual's ear per se.
  • the directivity characteristic of the pinna becomes moot, whereas the HRTF-based characteristic as of the figs. 2 to 4 is still effective.
  • an intrinsically omnidirectional beam former with microphone arranged not in the ear canal thus especially behind the pinna will establish a transfer characteristic with substantially equal amplification symmetrical to the 90° direction.
  • the pinna-caused beam forming characteristic with an attenuation of signals impinging from 45° relative to such signals from 135° which according to fig. 4 is about +6 dB is lost. It results therefrom that whenever the hearing device enabled or controllably switched in omnidirectional mode will not establish for a transfer characteristics which accords to natural beam forming of the ear at frequencies above 2 kHz and, with respect to speech understanding, in the relevant frequency band up to about 7 kHz, but will establish as shown in fig. 5 by dashed lines a transfer characteristic as if no pinna was present.
  • a hearing device with a behind-the-ear microphone arrangement to be placed not in the ear canal of an individual's ear, wherein the microphone arrangement has at least one microphone with an output, the device further having an electrical/mechanical output converter and has a further microphone and a beam former unit.
  • Latter has at least two inputs and an output. One input of the beam forming unit is operationally connected to the output of the one microphone and the second input of the beam former unit is operationally connected to the output of the further microphone.
  • the output of the beamformer unit is operationally connected to an input of the output converter and establishes together with the one and the further microphones a transfer characteristic of acoustical signals impinging on the one and the further microphones to an electrical signal at the output of the beam former unit with an amplification which is dependent on the direction with which acoustical signals impinge on the microphone and on the frequency of such acoustical signals.
  • the transfer characteristic established by the beam former unit and the at least two microphones has the following features:
  • the beam former unit behaves at frequencies below 2 kHz, as at the significant frequency of 1 kHz, like an omnidirectional microphone. Applied to the head, the HRTF is effective as at the unequipped ear. At higher frequencies above 2 kHz as established by the characteristic frequency of 5 kHz, the beam former unit and microphones establish an increased amplification in forwards direction as in the 45° direction compared with attenuation in the backwards direction of 135°. This simulates the pinna directivity effect.
  • the ratio of amplification in 135° direction to amplification in 45° direction is selected to be approx. -6 dB.
  • the amplification in 45° direction is at least approx. 6 dB higher than the amplification in 135° direction.
  • hearing devices of the addressed type and thereby especially behind-the-ear hearing devices are customarily equipped with different operating modes or programs which may be manually or automatically enabled, be it by remote control or by automatic evaluation of the acoustical surrounding.
  • it is customary to provide in context with such switchable operating modes different selectively enabled beam forming abilities.
  • one operating mode is characterized by the mode which was described, i.e. the mode enabling natural ear simulation due to the specific, frequency-dependent beam forming.
  • the further microphone which is necessary for establishing beam forming ability and which may be provided remote from the microphone arrangement to be applied behind the pinna is most preferably provided as a part of the addressed microphone arrangement.
  • the device according to the present invention is preferably a behind-the-ear hearing device and thereby especially a behind-the-ear hearing aid device.
  • a behind-the-ear device a device with an output converter applied to the same ear as the microphone arrangement.
  • the addressed further microphone is part of a second hearing device to be placed at the second ear of the individual so that the device according to the present invention is e.g. part of a binaural hearing system.
  • the hearing device may be a device for increasing hearing capability or may be a device for hearing protection i.e. attenuating the effect of acoustical signals.
  • a microphone arrangement 1 of the device according to the present invention comprises at least one microphone 3, e.g. and in the most simple form of realization with an omnidirectional transfer characteristic as schematically shown at T 1 .
  • the microphone arrangement 1 is e.g. to be placed behind e.g. adjacent the top of individual's ear pinna 5.
  • a further microphone 7 Remote from microphone 3 there is provided a further microphone 7, which, again in the simplest form, has an omnidirectional transfer characteristic T 7 .
  • the respective electrical outputs A 3 , A 7 of the microphones 3 and 7 are operationally connected to a beam former unit 9.
  • the beam former unit 9 is a "delay and add" beam former unit.
  • the microphones 3, 7 and the beam former unit 9 provide for an omnidirectional characteristic up to about 2 kHz and, for higher frequencies, turn to a directional beam forming characteristic as e.g. to a first order cardoid transfer characteristic.
  • this is achieved by having the electrical signal from the output A 7 of the further omnidirectional microphone 7 first led via a high-pass filter unit 10 with a cut-off frequency at about 2 kHz before feeding such signal to the adding unit 11 of the beam forming unit 9.
  • the electrical signal at the output A 3 of microphone 3 is fed via the delay unit 13 to the adding unit 11 as well known to the skilled artisan for delay and add beam forming technique.
  • the microphone 7 up to the cut-off frequency of about 2 kHz the microphone 7 is not effective with respect to beam forming and thus the output signal at A 11 of adding unit 11 will establish for the omnidirectional characteristic according to T 1 of microphone 3. It is only starting at the cut-off frequency of filter unit 10 that the further microphone 7 becomes effective with respect to beam forming and establishes at the output A 11 a first order cardoid transfer function according to T 11 ( ⁇ 2 kHz) for frequencies of acoustical signals impinging on the microphones 3 and 7 above the cut-off frequency of filter unit 10.
  • the output A 11 of the adding unit 11 or more generically of beam forming unit 9 is operationally connected to an electrical/mechanical output converter 15 as to a loudspeaker unit of the device.
  • the transfer characteristic T 11 When applied to individual's ear the transfer characteristic T 11 will be subjected to individual's HRTF so that the established transfer characteristic will substantially be shadowed by individual's head between 180° and 0° resulting in a transfer function T 110 as schematically also shown in fig. 6.
  • the at least two microphones 3 and 7 which have to be provided to establish the desired beam forming according to the present invention are further preferably used to realize at the hearing device additional desired beam characteristics by techniques as e.g. shown in the above mentioned references, so as to operate the device in different operating modes, e.g. acoustically focusing on desired acoustical sources, thereby attenuating unwanted noise.
  • the specific frequency-dependent beam forming as exemplified by fig. 6 is realized only as one of more than one different operating modes of the hearing device.
  • the further microphone 7 must, generically, be remote from microphone 3. It thereby may be part of a hearing device applied at the second ear, e.g.
  • both microphones are parts of the microphone arrangement 1 which is placed adjacent the top of the pinna, thus forming part of one integrated single behind-the-ear hearing device, thereby especially of a hearing aid device.
  • Fig. 8 there is shown a further preferred embodiment of the hearing device according to the present invention. It was already addressed that preferably more than one different operating modus of the hearing device are preferably provided.
  • a first beam forming unit 9 which operates as was already described, i.e. simulating the directional behaviour of the pinna.
  • Unit 9 x represents a second beam former program or unit, whereat, according to specific needs at a specific acoustical situation, a different beam forming action is implemented.
  • the outputs A 9 and A 9x of the units 9 and 9 x are operationally connected to a weighting unit 13 which has an output A 13 operationally connected to the electrical input of the electrical/mechanical output converter 15.
  • the ratio, with which the output of unit 9 and the output of unit 9 x take effect upon the output A 13 may be adjusted.
  • the hearing device may be switched abruptly from the operating mode controlled by unit 9 to the operating mode controlled by unit 9 x by abruptly enabling output A 9 to take effect on output A 13 , thereby disabling output A 9x from taking such effect.
  • This is shown by the courses (a) within Fig. 8a. Instead of abruptly switching such effect, and as shown by the courses (b), the effect of the at least two modi may steadily be varied by adjusting the weighting coefficients ⁇ 9 and ⁇ 9x in unit 13 as by the control input C 13 .
  • Fig. 8 the device incorporating the two operating modes is shown and exemplified with two "units" 9 and 9 x , whereby, and as clear to the skilled artisan, the two units 9 and 9 x may be realized by one single unit with a programmed transfer function.
  • the ratio of effects, as controlled by unit 13 of Fig. 8, is then established e.g. by respectively adjusting, steadily or abruptly, coefficients of the program.
  • the device has been shown especially with beam former unit 90 rather in analog technique. Nevertheless, it is perfectly clear that preferably beam forming is performed within a digital signal processing unit, whereby the output signal of the microphone is analog to digital converted and preferably time-domain/frequency-domain converted to allow signal processing in frequency domain. Before feeding the output signal to the ectrical/mechanical output converter, the computed output signal is reconverted from digital to analog and, respectively, from frequency domain to time domain.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Neurosurgery (AREA)
  • Circuit For Audible Band Transducer (AREA)

Claims (10)

  1. Appareil auditif avec un agencement de microphone (1) derrière l'oreille à ne pas placer dans le canal auditif (5) de l'oreille d'un individu, ledit agencement de microphone (1) ayant au moins un microphone (3) avec une sortie (A3), comprenant en outre un convertisseur de sortie électrique/mécanique (15), caractérisée par un autre microphone (7), une unité de formation de faisceau (9) ayant au moins deux entrées et une sortie, une entrée étant fonctionnellement reliée à la sortie dudit microphone précité (3), la seconde entrée étant fonctionnellement reliée à la sortie dudit autre microphone (7), la sortie de l'unité de formation de faisceau (9) étant fonctionnellement reliée à une entrée dudit convertisseur de sortie (15), ladite unité de formation de faisceau conjointement avec ledit microphone précité et ledit autre microphone précité ayant une caractéristique de transfert de signaux acoustiques incidents sur un et l'autre microphone précité (3, 7) en un signal électrique à ladite sortie (A11) de ladite unité de formation de faisceau (9), son amplification dépendant de la direction d'incidence desdits signaux acoustiques sur lesdits microphones (3, 7) et sur la fréquence desdits signaux acoustiques, ladite direction étant 0° dans la direction de visée de l'individu et 90° substantiellement dans la direction vers l'extérieur du canal auditif de ladite oreille, ladite caractéristique de transfert ayant les propriétés suivantes:
    . une amplification substantiellement constante indépendante de ladite direction d'incidence à ladite fréquence de 1 kHz,
    . pour ladite direction de 45°, une plus grande amplification que pour ladite direction de 135° à ladite fréquence de 5 kHz.
  2. Appareil selon la revendication 1, où, dans laquelle ladite amplification à ladite direction de 45° est plus grande selon approximativement +6 dB que ladite amplification à ladite direction de 135°, ladite fréquence étant 5 kHz.
  3. Appareil selon la revendication 1 ou 2, ayant au moins deux modes de fonctionnement pouvant être commandés par rapport à la caractéristique de transfert des signaux acoustiques incidents sur l'un et l'autre microphone précité (3, 7) audit signal électrique à ladite sortie (A11), l'une desdites caractéristiques de transfert étant ladite caractéristique de transfert.
  4. Appareil selon la revendication 3, comprenant en outre une unité de pondération commandée établissant d'une manière commandée le quotient de l'effet desdits au moins deux modes de fonctionnement à la suite de ladite caractéristique de transfert.
  5. Appareil selon la revendication 4, où, dans laquelle ladite unité de pondération commandée change continuellement ledit rapport.
  6. Appareil selon l'une des revendications 1 à 5, ledit autre microphone (7) faisant partie dudit agencement de microphone (1).
  7. Appareil selon l'une des revendications 1 à 6, ledit autre microphone (7) faisant partie d'une seconde prothèse auditive à appliquer à ladite seconde oreille dudit individu.
  8. Appareil selon l'une des revendications 1 à 7 qui est une prothèse auditive derrière l'oreille.
  9. Appareil selon l'une des revendications 1 à 8, qui est un dispositif formant aide auditive derrière l'oreille.
  10. Appareil selon l'une des revendications 1 à 8, qui est un dispositif de protection d'écoute.
EP20040002886 2004-02-10 2004-02-10 Prothèse auditive avec une fonction zoom pour l'oreille d'un individu Expired - Lifetime EP1443798B1 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
DK04002886T DK1443798T3 (da) 2004-02-10 2004-02-10 Höreapparat med zoomfunktion til öret af et individ
EP20040002886 EP1443798B1 (fr) 2004-02-10 2004-02-10 Prothèse auditive avec une fonction zoom pour l'oreille d'un individu
DE200460001058 DE602004001058T2 (de) 2004-02-10 2004-02-10 Hörhilfegerät mit einer Zoom-Funktion für das Ohr eines Individuums
CA2490845A CA2490845C (fr) 2004-02-10 2004-12-22 Appareil auditif zoom veritable oreille

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP20040002886 EP1443798B1 (fr) 2004-02-10 2004-02-10 Prothèse auditive avec une fonction zoom pour l'oreille d'un individu

Publications (3)

Publication Number Publication Date
EP1443798A2 EP1443798A2 (fr) 2004-08-04
EP1443798A3 EP1443798A3 (fr) 2004-08-25
EP1443798B1 true EP1443798B1 (fr) 2006-06-07

Family

ID=32605523

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20040002886 Expired - Lifetime EP1443798B1 (fr) 2004-02-10 2004-02-10 Prothèse auditive avec une fonction zoom pour l'oreille d'un individu

Country Status (4)

Country Link
EP (1) EP1443798B1 (fr)
CA (1) CA2490845C (fr)
DE (1) DE602004001058T2 (fr)
DK (1) DK1443798T3 (fr)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DK2088802T3 (da) 2008-02-07 2013-10-14 Oticon As Fremgangsmåde til estimering af lydsignalers vægtningsfunktion i et høreapparat
EP2262285B1 (fr) 2009-06-02 2016-11-30 Oticon A/S Dispositif d'écoute fournissant des repères de localisation améliorés, son utilisation et procédé
EP2617204A2 (fr) 2010-09-14 2013-07-24 Phonak AG Dispositif et procédé de protection auditive dynamique
US9232318B2 (en) 2010-11-12 2016-01-05 Sonova Ag Hearing device with a microphone
EP3185589B1 (fr) * 2015-12-22 2024-02-07 Oticon A/s Dispositif auditif comprenant un système de commande de microphone
DE102020209555A1 (de) * 2020-07-29 2022-02-03 Sivantos Pte. Ltd. Verfahren zur direktionalen Signalverarbeitung für ein Hörgerät

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0820210A3 (fr) * 1997-08-20 1998-04-01 Phonak Ag Procédé électronique pour la formation de faisceaux de signaux acoustiques et dispositif détecteur acoustique
EP2348752A1 (fr) * 2000-09-29 2011-07-27 Knowles Electronics, LLC Réseau de microphones de deuxième ordre

Also Published As

Publication number Publication date
DE602004001058D1 (de) 2006-07-20
CA2490845A1 (fr) 2005-08-10
EP1443798A2 (fr) 2004-08-04
DE602004001058T2 (de) 2006-12-21
CA2490845C (fr) 2010-09-14
DK1443798T3 (da) 2006-10-09
EP1443798A3 (fr) 2004-08-25

Similar Documents

Publication Publication Date Title
CN106937196B (zh) 头戴式听力设备
EP2124483B2 (fr) Mélange de signaux d'un microphone intra-auriculaire et d'un microphone extra-auriculaire pour améliorer la perception spatiale
KR101689339B1 (ko) 이어폰 구조체 및 그 작동 방법
EP2360943B1 (fr) Formation de faisceau dans des dispositifs auditifs
US6704422B1 (en) Method for controlling the directionality of the sound receiving characteristic of a hearing aid a hearing aid for carrying out the method
US10070231B2 (en) Hearing device with input transducer and wireless receiver
US20080205659A1 (en) Method for improving spatial perception and corresponding hearing apparatus
CN105392096A (zh) 双耳听力系统及方法
CN109121055B (zh) 抑制梳状滤波效应的听力设备
AU2006200957A1 (en) Hearing device and method for wind noise supression
AU766876B2 (en) A method for controlling the directionality of the sound receiving characteristic of a hearing aid and a hearing aid for carrying out the method
US20180103327A1 (en) Binaural hearing aid system and a method of operating a binaural hearing aid system
AU2006252058A1 (en) An audio system with varying time delay and method for processing audio signals
EP1730993B1 (fr) Dispositif d'ecoute a deux microphones ou plus
EP1443798B1 (fr) Prothèse auditive avec une fonction zoom pour l'oreille d'un individu
JP3254789B2 (ja) 補聴装置
US7212643B2 (en) Real-ear zoom hearing device
EP4046396A1 (fr) Dispositifs de formation de faisceau destinés à l'aide auditive
EP3059979B1 (fr) Prothèse auditive avec amélioration de signal
EP1203508B1 (fr) Procede de commande de la directionalite de la caracteristique de reception de son d'une aide auditive, et aide auditive dans laquelle est applique ledit procede
EP4084501A1 (fr) Dispositif d'aide auditive à sensibilité omnidirectionnelle
EP4187927A1 (fr) Dispositif auditif avec restauration adaptative de pavillon de pavillon

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

RIC1 Information provided on ipc code assigned before grant

Ipc: 7H 04R 25/00 B

Ipc: 7H 04R 3/00 A

17P Request for examination filed

Effective date: 20041120

AKX Designation fees paid

Designated state(s): CH DE DK FR GB LI

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): CH DE DK FR GB LI

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: TROESCH SCHEIDEGGER WERNER AG

REF Corresponds to:

Ref document number: 602004001058

Country of ref document: DE

Date of ref document: 20060720

Kind code of ref document: P

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

ET Fr: translation filed
PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20070308

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 13

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 14

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 15

REG Reference to a national code

Ref country code: DE

Ref legal event code: R084

Ref document number: 602004001058

Country of ref document: DE

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20220225

Year of fee payment: 19

Ref country code: CH

Payment date: 20220302

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230223

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230227

Year of fee payment: 20

Ref country code: DE

Payment date: 20230223

Year of fee payment: 20

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230530

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20230228

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230228

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230228

REG Reference to a national code

Ref country code: DE

Ref legal event code: R071

Ref document number: 602004001058

Country of ref document: DE

REG Reference to a national code

Ref country code: GB

Ref legal event code: PE20

Expiry date: 20240209

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20240209