EP1650724A1 - Procédé et dispositif destinés à la surveillance du trafic routier - Google Patents

Procédé et dispositif destinés à la surveillance du trafic routier Download PDF

Info

Publication number
EP1650724A1
EP1650724A1 EP05108415A EP05108415A EP1650724A1 EP 1650724 A1 EP1650724 A1 EP 1650724A1 EP 05108415 A EP05108415 A EP 05108415A EP 05108415 A EP05108415 A EP 05108415A EP 1650724 A1 EP1650724 A1 EP 1650724A1
Authority
EP
European Patent Office
Prior art keywords
light
vehicle
flash
illuminating
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP05108415A
Other languages
German (de)
English (en)
Other versions
EP1650724B1 (fr
Inventor
Hans Theodor Wienand
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Radarlux Radar Systems GmbH
Original Assignee
Wienand Gisela
Wienand Sabine
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wienand Gisela, Wienand Sabine filed Critical Wienand Gisela
Publication of EP1650724A1 publication Critical patent/EP1650724A1/fr
Application granted granted Critical
Publication of EP1650724B1 publication Critical patent/EP1650724B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/017Detecting movement of traffic to be counted or controlled identifying vehicles
    • G08G1/0175Detecting movement of traffic to be counted or controlled identifying vehicles by photographing vehicles, e.g. when violating traffic rules

Definitions

  • the invention relates to a method and a device for monitoring road traffic with a camera for receiving vehicles, which have at least one highly reflective part, and with a flash unit for illuminating the vehicles.
  • the invention addresses the problem of reliably detecting vehicles with highly reflective license plates with photographic traffic surveillance systems.
  • Traffic surveillance systems are used, for example, at intersections to detect vehicles crossing a red traffic light.
  • Such systems are also used in conjunction with speedometers to detect vehicles traveling too fast. In this case, especially in bad weather or during the dark the recorded vehicle must be brightly lit so that the driver of the vehicle for reasons of reasoning in the photo is easily recognizable.
  • This is usually done with an electronic flash unit, which generates a flashlight with a gas discharge lamp.
  • the number plate of the vehicle must be clearly visible in order to identify the vehicle and its holder.
  • the document DE 35 35 588 A1 proposes to avoid overexposure to install in the photographic camera a filter that covers only part of the field of view.
  • the filter is attached, for example, as a strip in the lower portion of the recording, which is usually the license plate of the vehicle to be identified.
  • Object of the present invention is to provide a novel method and a novel device of the type mentioned, which reliably avoid overexposure by highly reflective license plates.
  • a lichtabschwambaender filter is disposed in the beam path of the flash device, which attenuates the incident on the highly reflective part light of the flash device.
  • the proposed displacement of the filter from the camera into the flash unit eliminates the cause of overexposure.
  • the fact that the flashlight which strikes the license plate is already attenuated on the flash unit, the feared overexposures do not occur.
  • the camera can do this without the filter Record flashlight illuminated vehicle.
  • the proposed method and apparatus are suitable for use in conjunction with film cameras as well as with digital still cameras which convert the captured image to digital image data via a CCD sensor.
  • the light attenuating filter may be disposed on a portion of a transparent member.
  • the translucent element may be constructed in the manner of a slide. It consists of a transparent film, wherein the filter is realized by a colored portion of the film.
  • the translucent element may be an LCD surface whose local translucency is electronically controllable.
  • LCD surfaces are known by flat screens. They have a liquid crystal layer, which is arranged on a transparent carrier made of glass or plastic. By applying a voltage to individual liquid crystal elements whose light transmittance can be changed. In this way, can be adjusted by an electronic control precisely the area that is darkened by the filter.
  • this embodiment is advantageous in connection with digital cameras.
  • Modern picture analysis programs can be used to quickly determine where the picture is taken, the windshield and where the recording is the highly reflective license plate. In the time just before the recording, this information can be used by an image analysis are taken from the continuously recorded by a digital camera image data. For the taking of evidence then the filtering section of the LCD surface can be selected such that the windshield is brightly lit and the license plate is darkened.
  • a projection optics can be used, which images the light-attenuating filter on the vehicle.
  • the flash device may be similar to a slide projector and include an objective lens which generates a sharp image of the light attenuating filter in the plane of the vehicle to be recorded. This creates a clear dividing line between the filtered and non-filtered area. Transitions are avoided.
  • the sharp image of the filter on the vehicle ensures that the desired reduced illumination is achieved in the area of the license plate.
  • the recording can be done with a lower flash output, which extends the life of the flash.
  • the projection optics may further comprise a condenser lens which focuses the light of the flashlamp on the filter to be imaged and the objective lens and optimizes the illumination.
  • the flash unit may be conventionally provided with a gas-discharge flash lamp and a reflector for generating the flash.
  • a roadway 1 is shown, on which a vehicle 2 drives.
  • a traffic monitoring device 3 is arranged according to the invention.
  • the monitoring device 3 comprises a digital camera 4 and a flash unit 5, which is formed by a flashlamp 6 within a reflector 7.
  • a condenser lens 8 is arranged in the beam path of the flash unit 5 and in front of the light exit of the reflector 7, a condenser lens 8 is arranged. Again, in front of the translucent element 9 and near the light exit from the light exit opening 10 of the traffic monitoring device 3 is an objective lens 11. The condenser lens 8 focuses the light of the light source, so that it is substantially completely the objective lens 11 impinges.
  • the objective lens 11 images the image on the flat transmissive member 9 in a plane close to the front of the vehicle 2.
  • the flash unit 5 is constructed like a slide projector and ensures optimal bright illumination of the windshield of the vehicle, the area of the license plate is darkened. Since the number plate of most vehicles is in a certain height range, the translucent element 9 may consist of a transparency in the form of a translucent disc having a filtering strip in the lower region.
  • the translucent element 9 is an LCD surface whose light transmission is locally controllable.
  • the data of the digital still camera 4 are supplied via a data line 12 to an image analysis unit 13 comprising a microprocessor.
  • the image analysis unit 13 can continuously evaluate the images taken by the digital camera 4 and determine where in the image the brightly reflecting license plate is.
  • Via a control line 14, in accordance with the data of the image analysis, the LCD panel 9 is controlled so that the area of the license plate is darkened. A non-reflective license plate is present on the vehicle, can be dispensed with the darkening of the flash.
  • the objective lens 11 images the image of the LCD surface 9 substantially in the plane of the vehicle. If the vehicle distance to the digital camera 4 can vary, the objective lens 11 can be adjusted, so that the imaging takes place substantially exactly in the vehicle level. For this purpose, a second control line 15 is provided.
  • the distance of the vehicle, the image analysis unit 13 can be determined based on distance measurement data of a built-in the digital camera 4 rangefinder or by analyzing the digital image.
  • Fig. 3 shows the illumination of the vehicle 2 with the device according to the invention. It can be seen that the lower portion of the vehicle 2 is located in a darkened zone 16. This ensures that the highly reflective license plate 17 of the vehicle 2 is illuminated with a reduced light intensity.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • Studio Devices (AREA)
  • Road Signs Or Road Markings (AREA)
  • Blocking Light For Cameras (AREA)
EP05108415A 2004-09-14 2005-09-14 Procédé et dispositif destinés à la surveillance du trafic routier Active EP1650724B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102004044887A DE102004044887A1 (de) 2004-09-14 2004-09-14 Verfahren und Vorrichtung zur Überwachung des Straßenverkehrs

Publications (2)

Publication Number Publication Date
EP1650724A1 true EP1650724A1 (fr) 2006-04-26
EP1650724B1 EP1650724B1 (fr) 2008-01-02

Family

ID=35840200

Family Applications (1)

Application Number Title Priority Date Filing Date
EP05108415A Active EP1650724B1 (fr) 2004-09-14 2005-09-14 Procédé et dispositif destinés à la surveillance du trafic routier

Country Status (3)

Country Link
EP (1) EP1650724B1 (fr)
AT (1) ATE382924T1 (fr)
DE (2) DE102004044887A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104702832A (zh) * 2015-03-31 2015-06-10 刘若琨 一种汽车安防监控摄像的成像方法及其设备
CN110944117A (zh) * 2019-11-15 2020-03-31 浙江大华技术股份有限公司 图像处理方法、计算机设备、存储装置和智能监控系统

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2157558B1 (fr) * 2008-08-19 2015-05-06 JENOPTIK Robot GmbH Procédé et dispositif pour photographier un véhicule
EP2449540A1 (fr) * 2009-06-30 2012-05-09 Siemens Aktiengesellschaft Procédé et dispositif de surveillance du trafic routier

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2466060A1 (fr) * 1979-06-28 1981-03-27 Sfim Installation de controle de vitesse des vehicules automobiles
US5915032A (en) * 1989-08-22 1999-06-22 Minnesota Mining And Manufacturing Company Method and apparatus for machine reading of retroreflective vehicle identification articles
EP1117082A2 (fr) * 2000-01-11 2001-07-18 Pulnix America, Inc. Système d'imagerie simultanée de véhicules et leurs plaques d'immatriculation

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2466060A1 (fr) * 1979-06-28 1981-03-27 Sfim Installation de controle de vitesse des vehicules automobiles
US5915032A (en) * 1989-08-22 1999-06-22 Minnesota Mining And Manufacturing Company Method and apparatus for machine reading of retroreflective vehicle identification articles
EP1117082A2 (fr) * 2000-01-11 2001-07-18 Pulnix America, Inc. Système d'imagerie simultanée de véhicules et leurs plaques d'immatriculation

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104702832A (zh) * 2015-03-31 2015-06-10 刘若琨 一种汽车安防监控摄像的成像方法及其设备
CN110944117A (zh) * 2019-11-15 2020-03-31 浙江大华技术股份有限公司 图像处理方法、计算机设备、存储装置和智能监控系统
CN110944117B (zh) * 2019-11-15 2021-08-31 浙江大华技术股份有限公司 图像处理方法、计算机设备、存储装置和智能监控系统

Also Published As

Publication number Publication date
DE102004044887A1 (de) 2006-03-30
EP1650724B1 (fr) 2008-01-02
ATE382924T1 (de) 2008-01-15
DE502005002387D1 (de) 2008-02-14

Similar Documents

Publication Publication Date Title
DE69836344T2 (de) Regensensor mit nebelerkennung
EP2558336B1 (fr) Procédé et dispositif d'assistance au conducteur lors de la conduite d'un véhicule consistant à détecter une visibilité réduite due aux conditions atmosphériques
EP1706773A1 (fr) Systeme de vision nocturne a filtre optique partiel pour des vehicules automobiles
DE102010043479B4 (de) Kameraanordnung und Verfahren zum Betreiben einer Kameraanordnung für ein Kraftfahrzeug
WO2013163991A1 (fr) Détection de gouttes de pluie sur un pare-brise au moyen d'une caméra et d'un éclairage
DE102009000003A1 (de) Kameraanordnung zur Erfassung eines Scheibenzustandes einer Fahrzeugscheibe
DE102009020919A1 (de) Vorrichtung zum Erkennen von Erhebungen und/oder Vertiefungen auf Flaschen, insbesondere in einer Etikettiermaschine
DE102005000650A1 (de) Vorrichtung zur Erfassung visueller Daten
DE102007032075A1 (de) System, Verfahren und Programmprodukt zur Erfassung von Fahrzeugen
DE102009002979A1 (de) Projektionsanzeigevorrichtung für Fahrzeuge
EP1049064B1 (fr) Dispositif de surveillance de la circulation avec des filtres de polarisation
EP1214224A1 (fr) Dispositif de capteurs automobiles pour detection de l'environnement
EP1650724B1 (fr) Procédé et dispositif destinés à la surveillance du trafic routier
DE102008042012A1 (de) Bildaufnahmevorrichtung und Fahrzeug mit einer Bildaufnahmevorrichtung
DE3535588A1 (de) Verfahren und vorrichtung zur photographischen erfassung stark leuchtender oder reflektierender teile eines zu photographierenden gesichtsfeldes
WO2020225123A1 (fr) Dispositif d'éclairage extérieur pour un véhicule à moteur
DE102010023593A1 (de) Optische Vorrichtung mit einem bifokalen optischen Element und einem Spiegelelement
DE102006056180A1 (de) Verfahren und Vorrichtung zum Kalibrieren eines Bildsensors im Kraftfahrzeug
DE102006004770B4 (de) Verfahren zur bildgestützten Erkennung von Fahrzeugen im Umfeld eines Sraßenfahrzeugs
DE4420560A1 (de) Mobiles Verkehrsüberwachungssystem
DE102004033047A1 (de) Anordnung und Verfahren zur Funktionsüberprüfung eines Fahrerassistenzsystems
DE102021120731A1 (de) Lichtmodul für einen Kraftfahrzeugscheinwerfer, Kraftfahrzeugscheinwerfer mit einem solchen Lichtmodul und Kraftfahrzeug mit einem solchen Kraftfahrzeugscheinwerfer
DE102011056690A1 (de) Verfahren und Vorrichtung zur Ermittlung von Feuchtigkeit auf einer Fahrzeugscheibe
DE102008009263B3 (de) Verfahren zum automatischen Erkennen, insbesondere bei der Verkehrsüberwachung, von Fahrzeugen oder von Fahrzeugkennzeichen
DE19938263B4 (de) Verfahren und Einrichtung zur elektronisch logischen Erkennung von Verkehrszeichen

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

17P Request for examination filed

Effective date: 20061023

17Q First examination report despatched

Effective date: 20061122

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: RADARLUX RADAR SYSTEMS GMBH

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REF Corresponds to:

Ref document number: 502005002387

Country of ref document: DE

Date of ref document: 20080214

Kind code of ref document: P

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

GBV Gb: ep patent (uk) treated as always having been void in accordance with gb section 77(7)/1977 [no translation filed]
PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080413

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080502

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080402

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: MICHELI & CIE SA

ET Fr: translation filed
PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080602

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

REG Reference to a national code

Ref country code: IE

Ref legal event code: FD4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

26N No opposition filed

Effective date: 20081003

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

BERE Be: lapsed

Owner name: RADARLUX RADAR SYSTEMS G.M.B.H.

Effective date: 20080930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080930

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080930

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080914

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080703

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080914

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080403

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20130920

Year of fee payment: 9

Ref country code: CH

Payment date: 20130923

Year of fee payment: 9

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: SE

Ref legal event code: EUG

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140915

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140930

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140930

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 13

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20230920

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230918

Year of fee payment: 19

Ref country code: DE

Payment date: 20230919

Year of fee payment: 19