EP1650724A1 - Method and device for monitoring road traffic - Google Patents

Method and device for monitoring road traffic Download PDF

Info

Publication number
EP1650724A1
EP1650724A1 EP05108415A EP05108415A EP1650724A1 EP 1650724 A1 EP1650724 A1 EP 1650724A1 EP 05108415 A EP05108415 A EP 05108415A EP 05108415 A EP05108415 A EP 05108415A EP 1650724 A1 EP1650724 A1 EP 1650724A1
Authority
EP
European Patent Office
Prior art keywords
light
vehicle
flash
illuminating
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP05108415A
Other languages
German (de)
French (fr)
Other versions
EP1650724B1 (en
Inventor
Hans Theodor Wienand
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Radarlux Radar Systems GmbH
Original Assignee
Wienand Gisela
Wienand Sabine
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wienand Gisela, Wienand Sabine filed Critical Wienand Gisela
Publication of EP1650724A1 publication Critical patent/EP1650724A1/en
Application granted granted Critical
Publication of EP1650724B1 publication Critical patent/EP1650724B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G08G1/017—Detecting movement of traffic to be counted or controlled identifying vehicles
    • G08G1/0175—Detecting movement of traffic to be counted or controlled identifying vehicles by photographing vehicles, e.g. when violating traffic rules

Definitions

  • the invention relates to a method and a device for monitoring road traffic with a camera for receiving vehicles, which have at least one highly reflective part, and with a flash unit for illuminating the vehicles.
  • the invention addresses the problem of reliably detecting vehicles with highly reflective license plates with photographic traffic surveillance systems.
  • Traffic surveillance systems are used, for example, at intersections to detect vehicles crossing a red traffic light.
  • Such systems are also used in conjunction with speedometers to detect vehicles traveling too fast. In this case, especially in bad weather or during the dark the recorded vehicle must be brightly lit so that the driver of the vehicle for reasons of reasoning in the photo is easily recognizable.
  • This is usually done with an electronic flash unit, which generates a flashlight with a gas discharge lamp.
  • the number plate of the vehicle must be clearly visible in order to identify the vehicle and its holder.
  • the document DE 35 35 588 A1 proposes to avoid overexposure to install in the photographic camera a filter that covers only part of the field of view.
  • the filter is attached, for example, as a strip in the lower portion of the recording, which is usually the license plate of the vehicle to be identified.
  • Object of the present invention is to provide a novel method and a novel device of the type mentioned, which reliably avoid overexposure by highly reflective license plates.
  • a lichtabschwambaender filter is disposed in the beam path of the flash device, which attenuates the incident on the highly reflective part light of the flash device.
  • the proposed displacement of the filter from the camera into the flash unit eliminates the cause of overexposure.
  • the fact that the flashlight which strikes the license plate is already attenuated on the flash unit, the feared overexposures do not occur.
  • the camera can do this without the filter Record flashlight illuminated vehicle.
  • the proposed method and apparatus are suitable for use in conjunction with film cameras as well as with digital still cameras which convert the captured image to digital image data via a CCD sensor.
  • the light attenuating filter may be disposed on a portion of a transparent member.
  • the translucent element may be constructed in the manner of a slide. It consists of a transparent film, wherein the filter is realized by a colored portion of the film.
  • the translucent element may be an LCD surface whose local translucency is electronically controllable.
  • LCD surfaces are known by flat screens. They have a liquid crystal layer, which is arranged on a transparent carrier made of glass or plastic. By applying a voltage to individual liquid crystal elements whose light transmittance can be changed. In this way, can be adjusted by an electronic control precisely the area that is darkened by the filter.
  • this embodiment is advantageous in connection with digital cameras.
  • Modern picture analysis programs can be used to quickly determine where the picture is taken, the windshield and where the recording is the highly reflective license plate. In the time just before the recording, this information can be used by an image analysis are taken from the continuously recorded by a digital camera image data. For the taking of evidence then the filtering section of the LCD surface can be selected such that the windshield is brightly lit and the license plate is darkened.
  • a projection optics can be used, which images the light-attenuating filter on the vehicle.
  • the flash device may be similar to a slide projector and include an objective lens which generates a sharp image of the light attenuating filter in the plane of the vehicle to be recorded. This creates a clear dividing line between the filtered and non-filtered area. Transitions are avoided.
  • the sharp image of the filter on the vehicle ensures that the desired reduced illumination is achieved in the area of the license plate.
  • the recording can be done with a lower flash output, which extends the life of the flash.
  • the projection optics may further comprise a condenser lens which focuses the light of the flashlamp on the filter to be imaged and the objective lens and optimizes the illumination.
  • the flash unit may be conventionally provided with a gas-discharge flash lamp and a reflector for generating the flash.
  • a roadway 1 is shown, on which a vehicle 2 drives.
  • a traffic monitoring device 3 is arranged according to the invention.
  • the monitoring device 3 comprises a digital camera 4 and a flash unit 5, which is formed by a flashlamp 6 within a reflector 7.
  • a condenser lens 8 is arranged in the beam path of the flash unit 5 and in front of the light exit of the reflector 7, a condenser lens 8 is arranged. Again, in front of the translucent element 9 and near the light exit from the light exit opening 10 of the traffic monitoring device 3 is an objective lens 11. The condenser lens 8 focuses the light of the light source, so that it is substantially completely the objective lens 11 impinges.
  • the objective lens 11 images the image on the flat transmissive member 9 in a plane close to the front of the vehicle 2.
  • the flash unit 5 is constructed like a slide projector and ensures optimal bright illumination of the windshield of the vehicle, the area of the license plate is darkened. Since the number plate of most vehicles is in a certain height range, the translucent element 9 may consist of a transparency in the form of a translucent disc having a filtering strip in the lower region.
  • the translucent element 9 is an LCD surface whose light transmission is locally controllable.
  • the data of the digital still camera 4 are supplied via a data line 12 to an image analysis unit 13 comprising a microprocessor.
  • the image analysis unit 13 can continuously evaluate the images taken by the digital camera 4 and determine where in the image the brightly reflecting license plate is.
  • Via a control line 14, in accordance with the data of the image analysis, the LCD panel 9 is controlled so that the area of the license plate is darkened. A non-reflective license plate is present on the vehicle, can be dispensed with the darkening of the flash.
  • the objective lens 11 images the image of the LCD surface 9 substantially in the plane of the vehicle. If the vehicle distance to the digital camera 4 can vary, the objective lens 11 can be adjusted, so that the imaging takes place substantially exactly in the vehicle level. For this purpose, a second control line 15 is provided.
  • the distance of the vehicle, the image analysis unit 13 can be determined based on distance measurement data of a built-in the digital camera 4 rangefinder or by analyzing the digital image.
  • Fig. 3 shows the illumination of the vehicle 2 with the device according to the invention. It can be seen that the lower portion of the vehicle 2 is located in a darkened zone 16. This ensures that the highly reflective license plate 17 of the vehicle 2 is illuminated with a reduced light intensity.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • Studio Devices (AREA)
  • Road Signs Or Road Markings (AREA)
  • Blocking Light For Cameras (AREA)

Abstract

The method involves arranging a light-diminishing filter (9) in a path of rays of a flashgun (5) that illuminates a vehicle. The light of the flashgun is diminished by the filter, where the light impinges on a strongly reflecting number plate of the vehicle. Light permeability of a translucent component e.g. liquid crystal display (LCD) surface, is electronically steered in an area that illuminates the number plate. An independent claim is also included for a device for monitoring of road traffic.

Description

Technisches GebietTechnical area

Die Erfindung betrifft ein Verfahren und eine Vorrichtung zur Überwachung des Straßenverkehrs mit einer Kamera zur Aufnahme von Fahrzeugen, welche mindestens ein stark reflektierendes Teil aufweisen, und mit einem Blitzlichtgerät zur Ausleuchtung der Fahrzeuge.The invention relates to a method and a device for monitoring road traffic with a camera for receiving vehicles, which have at least one highly reflective part, and with a flash unit for illuminating the vehicles.

Insbesondere widmet sich die Erfindung dem Problem, Fahrzeuge mit stark reflektierenden Nummernschildern mit fotografischen Verkehrsüberwachungsanlagen zuverlässig zu erfassen. Verkehrsüberwachungsanlagen werden beispielsweise an Kreuzungen eingesetzt, um Fahrzeuge zu erfassen, die eine Ampel bei Rot überqueren. Derartige Anlagen werden ebenfalls in Verbindung mit Geschwindigkeitsmeßgeräten eingesetzt, um zu schnell fahrende Fahrzeuge zu erfassen. Dabei muß insbesondere bei schlechter Witterung oder während der Dunkelheit das aufzunehmende Fahrzeug hell ausgeleuchtet werden, damit der Fahrer des Fahrzeuges aus Gründen der Beweisführung auf dem Foto gut erkennbar ist. Dies erfolgt in aller Regel mit einem elektronischen Blitzgerät, welches mit einer Gasentladungslampe ein Blitzlicht erzeugt. Gleichzeitig muß das Nummernschild des Fahrzeugs gut erkennbar sein, um das Fahrzeug und dessen Halter identifizieren zu können.In particular, the invention addresses the problem of reliably detecting vehicles with highly reflective license plates with photographic traffic surveillance systems. Traffic surveillance systems are used, for example, at intersections to detect vehicles crossing a red traffic light. Such systems are also used in conjunction with speedometers to detect vehicles traveling too fast. In this case, especially in bad weather or during the dark the recorded vehicle must be brightly lit so that the driver of the vehicle for reasons of reasoning in the photo is easily recognizable. This is usually done with an electronic flash unit, which generates a flashlight with a gas discharge lamp. At the same time the number plate of the vehicle must be clearly visible in order to identify the vehicle and its holder.

Moderne Fahrzeuge sind mit stark reflektierenden Nummernschildern ausgerüstet. Hierdurch soll die visuelle Identifizierung des Nummernschildes, beispielsweise im Scheinwerferlicht eines nachfolgenden Wagens, erleichtert werden. In Verbindung mit der genannten Verkehrsüberwachungsanlage stellt sich das Problem, daß das stark reflektierende Nummernschild das Licht des Blitzgerätes zurückwirft und die fotografische Aufnahme derart überbelichtet, daß eine Identifizierung der Zahlen und Buchstaben des Nummernschildes schwierig oder gar unmöglich wird.Modern vehicles are equipped with highly reflective license plates. As a result, the visual identification of the license plate, for example, in the headlight of a subsequent car to be facilitated. In connection with said traffic monitoring system, the problem arises that the highly reflective license plate throws back the light of the flash unit and overexposing the photograph so that a Identifying the numbers and letters of the license plate becomes difficult or even impossible.

Stand der TechnikState of the art

Die Druckschrift DE 35 35 588 A1 schlägt zur Vermeidung von Überbelichtungen vor, in der fotografischen Kamera einen Filter anzubringen, der nur einen Teil des Gesichtsfeldes überdeckt. Der Filter wird beispielsweise als Streifen im unteren Abschnitt der Aufnahme angebracht, in dem sich üblicherweise das Nummernschild des zu identifizierenden Fahrzeuges befindet.The document DE 35 35 588 A1 proposes to avoid overexposure to install in the photographic camera a filter that covers only part of the field of view. The filter is attached, for example, as a strip in the lower portion of the recording, which is usually the license plate of the vehicle to be identified.

Ein derartiger Eingriff in die Kamera kann sich als kompliziert erweisen. Außerdem besteht keine Möglichkeit, den gefilterten Bereich von Aufnahme zu Aufnahme zu ändern. Falls das Nummernschild eines Fahrzeuges beispielsweise außerhalb des Filters liegt, wird es aufgrund der Überbelichtung nicht erkennbar sein.Such interference with the camera can prove complicated. In addition, there is no way to change the filtered range from shot to shot. For example, if the license plate of a vehicle is outside the filter, it will not be visible due to overexposure.

Offenbarung der ErfindungDisclosure of the invention

Aufgabe der vorliegenden Erfindung ist es, ein neuartiges Verfahren und eine neuartige Vorrichtung der eingangs genannten Art zu schaffen, welche eine Überbelichtung durch stark reflektierende Nummernschilder zuverlässig vermeiden.Object of the present invention is to provide a novel method and a novel device of the type mentioned, which reliably avoid overexposure by highly reflective license plates.

Diese Aufgabe wird erfindungsgemäß dadurch gelöst, daß im Strahlengang des Blitzlichtgeräts ein lichtabschwächender Filter angeordnet wird, der das auf das stark reflektierende Teil auftreffende Licht des Blitzlichtgeräts abschwächt.This object is achieved in that a lichtabschwächender filter is disposed in the beam path of the flash device, which attenuates the incident on the highly reflective part light of the flash device.

Durch die vorgeschlagene Verlagerung des Filters aus der Kamera in das Blitzlichtgerät läßt sich die Ursache für eine Überbelichtung beseitigen. Dadurch, daß das Blitzlicht, welches auf das Nummernschild auftrifft, bereits am Blitzlichtgerät abgeschwächt wird, treten die befürchteten Überbelichtungen nicht auf. Die Kamera kann ohne Filter das durch das Blitzlicht ausgeleuchtete Fahrzeug aufnehmen. Auf einer einzigen fotografischen Aufnahme ist durch das Blitzlichtgerät einerseits die Windschutzscheibe und der dahinter sitzende Fahrer stark ausgeleuchtet und durch den Filter andererseits das Nummernschild abgeschwächt ausgeleuchtet, so daß auf der fotografischen Aufnahme keine Überbelichtung entsteht.The proposed displacement of the filter from the camera into the flash unit eliminates the cause of overexposure. The fact that the flashlight which strikes the license plate is already attenuated on the flash unit, the feared overexposures do not occur. The camera can do this without the filter Record flashlight illuminated vehicle. On a single photograph, the flashlight on the one hand, the windshield and the driver sitting behind it strongly illuminated and illuminated by the filter on the other hand, the license plate attenuated, so that on the photographic recording no overexposure.

Das vorgeschlagene Verfahren und die vorgeschlagene Vorrichtung eignen sich zur Verwendung in Verbindung mit Filmkameras sowie mit digitalen Fotokameras, welche das aufgenommene Bild über einen CCD-Sensor in digitale Bilddaten umwandeln.The proposed method and apparatus are suitable for use in conjunction with film cameras as well as with digital still cameras which convert the captured image to digital image data via a CCD sensor.

In der Praxis kann der lichtabschwächende Filter auf einem Teilbereich eines lichtdurchlässigen Elements angeordnet sein. Das lichtdurchlässige Element kann nach Art eines Diapositivs aufgebaut sein. Es besteht aus einer transparenten Folie, wobei der Filter durch einen eingefärbten Teilbereich der Folie realisiert ist.In practice, the light attenuating filter may be disposed on a portion of a transparent member. The translucent element may be constructed in the manner of a slide. It consists of a transparent film, wherein the filter is realized by a colored portion of the film.

Bei einer alternativen Ausführungsform der Erfindung kann das lichtdurchlässige Element eine LCD-Fläche sein, deren lokale Lichtdurchlässigkeit elektronisch steuerbar ist. LCD-Flächen sind von Flachbildschirmen bekannt. Sie haben eine Flüssigkristallschicht, die auf einem transparentem Träger aus Glas oder Kunststoff angeordnet ist. Durch Anlegen einer Spannung an einzelne Flüssigkristall-Elemente kann deren Lichtdurchlässigkeit verändert werden. Auf diese Weise läßt sich durch eine elektronische Steuerung präzise der Bereich einstellen, der durch den Filter abgedunkelt ist.In an alternative embodiment of the invention, the translucent element may be an LCD surface whose local translucency is electronically controllable. LCD surfaces are known by flat screens. They have a liquid crystal layer, which is arranged on a transparent carrier made of glass or plastic. By applying a voltage to individual liquid crystal elements whose light transmittance can be changed. In this way, can be adjusted by an electronic control precisely the area that is darkened by the filter.

Insbesondere ist diese Ausführungsform in Verbindung mit digitalen Kameras von Vorteil. Durch moderne Bild-Analyseprogramme läßt sich schnell ermitteln, an welchem Ort der Aufnahme die Windschutzscheibe und an welchem Ort der Aufnahme das stark reflektierende Nummernschild ist. In der Zeit kurz vor der Aufnahme können diese Informationen mittels einer Bildanalyse den kontinuierlich durch eine digitale Kamera aufgenommenen Bilddaten entnommen werden. Für die Beweisaufnahme kann dann der filternde Teilabschnitt der LCD-Fläche derart gewählt werden, daß die Windschutzscheibe hell ausgeleuchtet und das Nummernschild abgedunkelt ist.In particular, this embodiment is advantageous in connection with digital cameras. Modern picture analysis programs can be used to quickly determine where the picture is taken, the windshield and where the recording is the highly reflective license plate. In the time just before the recording, this information can be used by an image analysis are taken from the continuously recorded by a digital camera image data. For the taking of evidence then the filtering section of the LCD surface can be selected such that the windshield is brightly lit and the license plate is darkened.

In der Praxis kann eine Projektionsoptik eingesetzt werden, die den lichtabschwächenden Filter auf das Fahrzeug abbildet. Hierbei kann das Blitzlichtgerät ähnlich einem Diaprojektor aufgebaut sein und eine Objektivlinse umfassen, welche ein scharfes Bild des lichtabschwächenden Filters in der Ebene des aufzunehmenden Fahrzeuges erzeugt. Es entsteht hierdurch eine klare Trennlinie zwischen dem gefilterten und nicht-gefilterten Bereich. Überblendungen werden vermieden. Durch die scharfe Abbildung des Filters auf das Fahrzeug ist sichergestellt, daß im Bereich des Nummernschildes die gewünschte reduzierte Ausleuchtung erzielt wird. Außerdem kann die Aufnahme mit einer geringeren Blitzleistung erfolgen, wodurch die Lebensdauer des Blitzlichtes verlängert wird. Die Projektionsoptik kann ferner eine Kondensorlinse umfassen, welche das Licht der Blitzlichtlampe auf den abzubildenden Filter und die Objektivlinse konzentriert und die Ausleuchtung optimiert.In practice, a projection optics can be used, which images the light-attenuating filter on the vehicle. Here, the flash device may be similar to a slide projector and include an objective lens which generates a sharp image of the light attenuating filter in the plane of the vehicle to be recorded. This creates a clear dividing line between the filtered and non-filtered area. Transitions are avoided. The sharp image of the filter on the vehicle ensures that the desired reduced illumination is achieved in the area of the license plate. In addition, the recording can be done with a lower flash output, which extends the life of the flash. The projection optics may further comprise a condenser lens which focuses the light of the flashlamp on the filter to be imaged and the objective lens and optimizes the illumination.

Das Blitzlichtgerät kann in herkömmlicher Weise mit einer Gasentladungs-Blitzlampe und einem Reflektor zur Erzeugung des Blitzes versehen sein.The flash unit may be conventionally provided with a gas-discharge flash lamp and a reflector for generating the flash.

Kurze Beschreibung der ZeichnungenBrief description of the drawings

Eine Ausführungsform der Erfindung wird nachfolgend unter Bezugnahme auf die beigefügten Zeichnungen erläutert. Hierbei zeigt

Fig. 1
eine an einem Fahrbahnrand angeordnete Verkehrsüberwachungsvorrichtung gemäß der Erfindung;
Fig. 2
eine schematische Darstellung der verschiedenen Elemente einer erfindungsgemäßen Verkehrsüberwachungsvorrichtung und
Fig. 3
eine schematische Darstellung der Ausleuchtung eines Fahrzeuges durch die erfindungsgemäße Überwachungseinrichtung.
An embodiment of the invention will be explained below with reference to the accompanying drawings. This shows
Fig. 1
a roadside traffic monitoring device according to the invention;
Fig. 2
a schematic representation of various elements of a traffic monitoring device according to the invention and
Fig. 3
a schematic representation of the illumination of a vehicle by the monitoring device according to the invention.

Ausführungsform(en) der ErfindungEmbodiment (s) of the invention

In Fig. 1 ist eine Fahrbahn 1 dargestellt, auf der ein Fahrzeug 2 fährt. Am Rand der Fahrbahn 1 ist eine Verkehrsüberwachungsvorrichtung 3 gemäß der Erfindung angeordnet. Die Überwachungsvorrichtung 3 umfaßt eine Digitalkamera 4 und ein Blitzlichtgerät 5, welches von einer Blitzlichtlampe 6 innerhalb eines Reflektors 7 gebildet wird.In Fig. 1, a roadway 1 is shown, on which a vehicle 2 drives. At the edge of the lane 1, a traffic monitoring device 3 is arranged according to the invention. The monitoring device 3 comprises a digital camera 4 and a flash unit 5, which is formed by a flashlamp 6 within a reflector 7.

Im Strahlengang des Blitzlichtgerätes 5 und vor dem Lichtaustritt des Reflektors 7 ist eine Kondensorlinse 8 angeordnet. Vor der Kondensorlinse 8 liegt ein ebenes, lichtdurchlässiges Element 9. Wiederum vor dem lichtdurchlässigen Element 9 und nahe dem Lichtaustritt aus der Lichtaustrittsöffnung 10 der Verkehrsüberwachungsvorrichtung 3 liegt eine Objektivlinse 11. Die Kondensorlinse 8 bündelt das Licht der Lichtquelle, so daß es im wesentlichen vollständig auf der Objektivlinse 11 auftrifft.In the beam path of the flash unit 5 and in front of the light exit of the reflector 7, a condenser lens 8 is arranged. Again, in front of the translucent element 9 and near the light exit from the light exit opening 10 of the traffic monitoring device 3 is an objective lens 11. The condenser lens 8 focuses the light of the light source, so that it is substantially completely the objective lens 11 impinges.

Die Objektivlinse 11 bildet das Bild auf dem ebenen, lichtdurchlässigen Element 9 in einer Ebene ab, die nahe der Vorderseite des Fahrzeugs 2 liegt.The objective lens 11 images the image on the flat transmissive member 9 in a plane close to the front of the vehicle 2.

Das Blitzlichtgerät 5 ist wie ein Diaprojektor aufgebaut und sorgt für eine optimale helle Ausleuchtung der Windschutzscheibe des Fahrzeuges, wobei der Bereich des Nummernschildes abgedunkelt ist. Da sich das Nummernschild der meisten Fahrzeuge in einem bestimmten Höhenbereich befindet, kann das lichtdurchlässige Element 9 nach Art eines Diapositivs aus einer lichtdurchlässigen Scheibe bestehen, welche im unteren Bereich einen filternden Streifen aufweist.The flash unit 5 is constructed like a slide projector and ensures optimal bright illumination of the windshield of the vehicle, the area of the license plate is darkened. Since the number plate of most vehicles is in a certain height range, the translucent element 9 may consist of a transparency in the form of a translucent disc having a filtering strip in the lower region.

Bei der Ausführungsform der Fig. 2 ist das lichtdurchlässige Element 9 eine LCD-Fläche, deren Lichtdurchlässigkeit lokal steuerbar ist. Die Daten der digitalen Fotokamera 4 werden über eine Datenleitung 12 einer Bildanalyseeinheit 13 zugeführt, welche einen Mikroprozessor umfaßt. Die Bildanalyseeinheit 13 kann kontinuierlich die durch die Digitalkamera 4 aufgenommenen Bilder auswerten und ermitteln, an welcher Stelle des Bildes das hell reflektierende Nummernschild ist. Über eine Steuerleitung 14 wird in Übereinstimmung mit den Daten der Bildanalyse die LCD-Fläche 9 gesteuert, so daß der Bereich des Nummernschildes abgedunkelt ist. Ein nicht reflektierendes Nummernschild an dem Fahrzeug vorhanden ist, kann auf die Abdunklung des Blitzes verzichtet werden.In the embodiment of FIG. 2, the translucent element 9 is an LCD surface whose light transmission is locally controllable. The data of the digital still camera 4 are supplied via a data line 12 to an image analysis unit 13 comprising a microprocessor. The image analysis unit 13 can continuously evaluate the images taken by the digital camera 4 and determine where in the image the brightly reflecting license plate is. Via a control line 14, in accordance with the data of the image analysis, the LCD panel 9 is controlled so that the area of the license plate is darkened. A non-reflective license plate is present on the vehicle, can be dispensed with the darkening of the flash.

Die Objektivlinse 11 bildet das Bild der LCD-Fläche 9 im wesentlichen in der Ebene des Fahrzeuges ab. Wenn der Fahrzeugabstand zu der Digitalkamera 4 variieren kann, kann die Objektivlinse 11 verstellt werden, so daß die Abbildung im wesentlichen genau in der Fahrzeugebene erfolgt. Hierzu ist eine zweite Steuerleitung 15 vorgesehen. Den Abstand des Fahrzeuges kann die Bildanalyseeinheit 13 anhand von Entfernungs-Meßdaten eines in die Digitalkamera 4 eingebauten Entfernungsmessers oder anhand einer Analyse des digitalen Bildes ermitteln.The objective lens 11 images the image of the LCD surface 9 substantially in the plane of the vehicle. If the vehicle distance to the digital camera 4 can vary, the objective lens 11 can be adjusted, so that the imaging takes place substantially exactly in the vehicle level. For this purpose, a second control line 15 is provided. The distance of the vehicle, the image analysis unit 13 can be determined based on distance measurement data of a built-in the digital camera 4 rangefinder or by analyzing the digital image.

Die Fig. 3 zeigt die Ausleuchtung des Fahrzeuges 2 mit der erfindungsgemäßen Vorrichtung. Es ist zu erkennen, daß der untere Bereich des Fahrzeuges 2 sich in einer verdunkelten Zone 16 befindet. Hierdurch ist sichergestellt, daß das stark reflektierende Nummernschild 17 des Fahrzeugs 2 mit einer reduzierten Lichtstärke angestrahlt wird.Fig. 3 shows the illumination of the vehicle 2 with the device according to the invention. It can be seen that the lower portion of the vehicle 2 is located in a darkened zone 16. This ensures that the highly reflective license plate 17 of the vehicle 2 is illuminated with a reduced light intensity.

Bezugszeichenliste:

1
Fahrbahn
2
Fahrzeug
3
Verkehrsüberwachungsvorrichtung
4
Digiatalkamera
5
Blitzlichtgerät
6
Blitzlichtlampe
7
Reflektor
8
Kondensorlinse
9
ebenes lichtdurchlässiges Element, LCD-Fläche
10
Lichtaustrittsöffnung
11
Objektivlinse
12
Datenleitung
13
Bildanalyseeinheit
14
Steuerleitung
15
Steuerleitung
16
verdunkelte Zone
17
stark reflektierendes Teil, Nummernschild
LIST OF REFERENCE NUMBERS
1
roadway
2
vehicle
3
Traffic monitoring device
4
Digiatalkamera
5
Flashgun
6
Flash lamp
7
reflector
8th
condenser
9
flat translucent element, LCD surface
10
Light opening
11
objective lens
12
data line
13
Image analysis unit
14
control line
15
control line
16
darkened zone
17
strong reflective part, license plate

Claims (15)

Verfahren zur Überwachung des Straßenverkehrs mit einer Kamera (4) zur Aufnahme von Fahrzeugen (2), welche mindestens ein stark reflektierendes Teil (17) aufweisen, und mit einem Blitzlichtgerät (5) zur Ausleuchtung der Fahrzeuge (2), dadurch gekennzeichnet, daß im Strahlengang des Blitzlichtgeräts (5) ein lichtabschwächender Filter (9) angeordnet wird, der das auf das stark reflektierende Teil (17) auftreffende Licht des Blitzlichtgeräts (5) abschwächt.Method for monitoring road traffic with a camera (4) for receiving vehicles (2) which have at least one highly reflective part (17) and with a flash unit (5) for illuminating the vehicles (2), characterized in that Beam path of the flash device (5) a light-attenuating filter (9) is arranged, which attenuates the incident on the highly reflective part (17) light of the flash device (5). Verfahren nach Anspruch 1, dadurch gekennzeichnet, daß der lichtabschwächende Filter auf einem Teilabschnitt eines lichtdurchlässigen Elements (9) angeordnet ist.Method according to Claim 1, characterized in that the light-attenuating filter is arranged on a section of a light-transmitting element (9). Verfahren nach Anspruch 2, dadurch gekennzeichnet, daß das lichtdurchlässige Element eine LCD-Fläche (9) ist, deren lokale Lichtdurchlässigkeit elektronisch gesteuert wird.Method according to Claim 2, characterized in that the light-transmitting element is an LCD surface (9) whose local light transmission is controlled electronically. Verfahren nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, daß die Lichtdurchlässigkeit der LCD-Fläche (9) in dem das Nummernschild (17) des Fahrzeugs (2) ausleuchtenden Bereich reduziert wird.Method according to one of the preceding claims, characterized in that the light transmission of the LCD surface (9) in the area illuminating the license plate (17) of the vehicle (2) is reduced. Verfahren nach Anspruch 4, dadurch gekennzeichnet, daß die Kamera (4) das Bild über einen digitalen Bildsensor erfaßt und der das Nummernschild (17) des Fahrzeugs (2) ausleuchtende Bereich automatisch anhand des Bildes auf dem digitalen Bildsensor ermittelt wird.Method according to Claim 4, characterized in that the camera (4) acquires the image via a digital image sensor and the region illuminating the license plate (17) of the vehicle (2) is automatically determined on the basis of the image on the digital image sensor. Verfahren nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, daß der lichtabschwächende Filter durch eine Projektionsoptik (8,11) auf das Fahrzeug (2) abgebildet wird.Method according to one of the preceding claims, characterized in that the light-attenuating filter is imaged onto the vehicle (2) by projection optics (8, 11). Vorrichtung (3) zur Überwachung des Straßenverkehrs, mit einer Kamera (4) zur Aufnahme von Fahrzeugen (2), welche mindestens ein stark reflektierendes Teil (17) aufweisen, und mit einem Blitzlichtgerät (5) zur Ausleuchtung der Fahrzeuge (2), dadurch gekennzeichnet, daß im Strahlengang des Blitzlichtgeräts (5) ein lichtabschwächender Filter (9) angeordnet ist, der das auf das stark reflektierende Teil (17) auftreffende Licht des Blitzlichtgeräts (5) abschwächt.Means (3) for monitoring road traffic, having a camera (4) for accommodating vehicles (2) having at least one highly reflective part (17), and a flash unit (5) for illuminating the vehicles (2), characterized characterized in that a light-attenuating filter (9) in the beam path of the flash unit (5) is arranged, which attenuates the incident on the strong reflecting part (17) light of the flash device (5). Vorrichtung (3) nach Anspruch 7, dadurch gekennzeichnet, daß der lichtabschwächende Filter ein Teilabschnitt eines lichtdurchlässigen Elements (9) ist.Device (3) according to Claim 7, characterized in that the light-attenuating filter is a partial section of a light-transmissive element (9). Vorrichtung (3) nach Anspruch 8, dadurch gekennzeichnet, daß das lichtdurchlässige Element ein Diapositiv ist.Device (3) according to claim 8, characterized in that the translucent element is a transparency. Vorrichtung (3) nach Anspruch 8, dadurch gekennzeichnet, daß das lichtdurchlässige Element eine LCD-Fläche (9) ist, deren lokale Lichtdurchlässigkeit elektronisch steuerbar ist.Device (3) according to claim 8, characterized in that the translucent element is an LCD surface (9) whose local light transmission is electronically controllable. Vorrichtung (3) nach Anspruch 11, dadurch gekennzeichnet, daß die Kamera (4) einen digitalen Bildsensor aufweist, wobei eine digiatale Bild-analyseeinheit (13) vorgesehen ist, die den das Nummernschild (17) des Fahrzeugs (2) ausleuchtenden Bereich im Strahlengang des Bliztlichtgerätes (5) automatisch anhand des Bildes auf dem digitalen Bildsensor ermittelt.Apparatus (3) according to claim 11, characterized in that the camera (4) comprises a digital image sensor, wherein a digital image analysis unit (13) is provided, which illuminates the number plate (17) of the vehicle (2) illuminating area in the beam path of the Bliztlichtgerätes (5) automatically determined based on the image on the digital image sensor. Vorrichtung (3) nach einem der Ansprüche 7 bis 11, gekennzeichnet durch eine Projektionsoptik (8,11), die den lichtabschwächenden Filter (9) in eine Ebene nahe dem Fahrzeug (2) abbildet.Device (3) according to one of Claims 7 to 11, characterized by projection optics (8, 11) which image the light-attenuating filter (9) in a plane near the vehicle (2). Vorrichtung (3) nach Anspruch 13, dadurch gekennzeichnet, daß die Projektionsoptik eine Objektivlinse (11) umfaßt.Device (3) according to claim 13, characterized in that the projection optics comprise an objective lens (11). Vorrichtung (3) nach Anspruch 12 oder 13, dadurch gekennzeichnet, daß die Projektionsoptik eine Kondensorlinse (8) umfaßt.Device (3) according to claim 12 or 13, characterized in that the projection optics comprise a condenser lens (8). Vorrichtung (3) nach einem der Ansprüche 7 bis 14, dadurch gekennzeichnet, daß das Blitzlichtgerät (5) eine Gasentladungs-Blitzlampe (6) und einen Reflektor (7) aufweist.Device (3) according to one of Claims 7 to 14, characterized in that the flash unit (5) has a gas-discharge flash lamp (6) and a reflector (7).
EP05108415A 2004-09-14 2005-09-14 Method and device for monitoring road traffic Active EP1650724B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102004044887A DE102004044887A1 (en) 2004-09-14 2004-09-14 Road traffic monitoring method for use in crossings, involves arranging light-diminishing filter in path of rays of flashgun for diminishing light of flashgun, where light impinges on strongly reflecting number plate of vehicle

Publications (2)

Publication Number Publication Date
EP1650724A1 true EP1650724A1 (en) 2006-04-26
EP1650724B1 EP1650724B1 (en) 2008-01-02

Family

ID=35840200

Family Applications (1)

Application Number Title Priority Date Filing Date
EP05108415A Active EP1650724B1 (en) 2004-09-14 2005-09-14 Method and device for monitoring road traffic

Country Status (3)

Country Link
EP (1) EP1650724B1 (en)
AT (1) ATE382924T1 (en)
DE (2) DE102004044887A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104702832A (en) * 2015-03-31 2015-06-10 刘若琨 Imaging method and device for security prevention monitoring shooting of automobile
CN110944117A (en) * 2019-11-15 2020-03-31 浙江大华技术股份有限公司 Image processing method, computer equipment, storage device and intelligent monitoring system

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2157558B1 (en) * 2008-08-19 2015-05-06 JENOPTIK Robot GmbH Method and device for photographing a vehicle
WO2011000415A1 (en) * 2009-06-30 2011-01-06 Siemens Aktiengesellschaft Method and device for monitoring road traffic

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2466060A1 (en) * 1979-06-28 1981-03-27 Sfim MOTOR VEHICLE SPEED CONTROL SYSTEM
US5915032A (en) * 1989-08-22 1999-06-22 Minnesota Mining And Manufacturing Company Method and apparatus for machine reading of retroreflective vehicle identification articles
EP1117082A2 (en) * 2000-01-11 2001-07-18 Pulnix America, Inc. System for simultaneously imaging vehicles and their license plates

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2466060A1 (en) * 1979-06-28 1981-03-27 Sfim MOTOR VEHICLE SPEED CONTROL SYSTEM
US5915032A (en) * 1989-08-22 1999-06-22 Minnesota Mining And Manufacturing Company Method and apparatus for machine reading of retroreflective vehicle identification articles
EP1117082A2 (en) * 2000-01-11 2001-07-18 Pulnix America, Inc. System for simultaneously imaging vehicles and their license plates

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104702832A (en) * 2015-03-31 2015-06-10 刘若琨 Imaging method and device for security prevention monitoring shooting of automobile
CN110944117A (en) * 2019-11-15 2020-03-31 浙江大华技术股份有限公司 Image processing method, computer equipment, storage device and intelligent monitoring system
CN110944117B (en) * 2019-11-15 2021-08-31 浙江大华技术股份有限公司 Image processing method, computer equipment, storage device and intelligent monitoring system

Also Published As

Publication number Publication date
ATE382924T1 (en) 2008-01-15
EP1650724B1 (en) 2008-01-02
DE502005002387D1 (en) 2008-02-14
DE102004044887A1 (en) 2006-03-30

Similar Documents

Publication Publication Date Title
DE69836344T2 (en) RAIN SENSOR WITH FOG IDENTIFICATION
EP2558336B1 (en) Method and device for assisting a driver while driving a vehicle by detecting weather-related visibility limitations
EP1706773A1 (en) Night vision system for motor vehicles, comprising a partial optical filter
DE102010043479B4 (en) Camera arrangement and method for operating a camera arrangement for a motor vehicle
DE102009000003A1 (en) Camera arrangement for detecting a wheel condition of a vehicle window
DE102009020919A1 (en) Device for detecting elevations and / or depressions on bottles, in particular in a labeling machine
WO2013163991A1 (en) Detecting rain droplets on a glass pane by means of a camera and illumination
DE102005000650A1 (en) Visual data detection device for motor vehicle has camera in stem of interior mirror, diverting mirrors and prism
EP1049064B1 (en) Traffic monitoring device with polarisation filters
WO2001021438A1 (en) Sensor device for a motor vehicle used for detecting environmental parameters
DE102009010623A1 (en) Device for issuing visual warning information to driver of vehicle, particularly motor vehicle, has vehicle window pane, through which vehicle driver visually captures area of environment of vehicle
EP1650724B1 (en) Method and device for monitoring road traffic
DE102008042012A1 (en) Image acquisition device for driver assistance system of motor vehicle, has camera and lighting device, where camera has image sensor for image acquisition
DE3535588A1 (en) Method and device for photographic detection of highly luminous or reflecting parts of a field of vision to be photographed
EP3963408A1 (en) External lighting device for a motor vehicle
DE102010023593A1 (en) Optical device with a bifocal optical element and a mirror element
DE102006056180A1 (en) Image processing system calibrating method for motor vehicle, involves detecting and evaluating marking on vehicle pane using image sensor, where characteristics of vehicle pane are determined based on detected marking
DE102006004770B4 (en) Method for image-based recognition of vehicles in the vicinity of a road vehicle
DE4420560A1 (en) Mobile traffic monitoring system
DE102004033047A1 (en) Function testing system for driver assistance system in road vehicle has simulation lights mimicking lights on second road vehicle shining beam of light into transmitter on side of first vehicle
DE102021120731A1 (en) Light module for a motor vehicle headlight, motor vehicle headlight with such a light module and motor vehicle with such a motor vehicle headlight
DE10359345B3 (en) Device for improving the visibility in a motor vehicle
DE102017006781A1 (en) Method and device for adjusting a polarizing filter of a camera system in a motor vehicle and motor vehicle with such a device
DE102011056690A1 (en) Method and device for detecting moisture on a vehicle window
DE102008009263B3 (en) Motor vehicles or indicators e.g. number plate, recognition method, involves controlling light exposure in global shutter-mode to simultaneously expose all pixels of image sensor and selecting light energy that remains in permissible limit

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

17P Request for examination filed

Effective date: 20061023

17Q First examination report despatched

Effective date: 20061122

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: RADARLUX RADAR SYSTEMS GMBH

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REF Corresponds to:

Ref document number: 502005002387

Country of ref document: DE

Date of ref document: 20080214

Kind code of ref document: P

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

GBV Gb: ep patent (uk) treated as always having been void in accordance with gb section 77(7)/1977 [no translation filed]
PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080413

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080502

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080402

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: MICHELI & CIE SA

ET Fr: translation filed
PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080602

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

REG Reference to a national code

Ref country code: IE

Ref legal event code: FD4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

26N No opposition filed

Effective date: 20081003

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

BERE Be: lapsed

Owner name: RADARLUX RADAR SYSTEMS G.M.B.H.

Effective date: 20080930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080930

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080930

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080914

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080703

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080914

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080403

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20130920

Year of fee payment: 9

Ref country code: CH

Payment date: 20130923

Year of fee payment: 9

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: SE

Ref legal event code: EUG

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140915

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140930

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140930

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 13

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20230920

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230918

Year of fee payment: 19

Ref country code: DE

Payment date: 20230919

Year of fee payment: 19