EP0448803A2 - Système de commande d'affichage vidéo - Google Patents

Système de commande d'affichage vidéo Download PDF

Info

Publication number
EP0448803A2
EP0448803A2 EP90124078A EP90124078A EP0448803A2 EP 0448803 A2 EP0448803 A2 EP 0448803A2 EP 90124078 A EP90124078 A EP 90124078A EP 90124078 A EP90124078 A EP 90124078A EP 0448803 A2 EP0448803 A2 EP 0448803A2
Authority
EP
European Patent Office
Prior art keywords
image
flash
video control
control device
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP90124078A
Other languages
German (de)
English (en)
Other versions
EP0448803B1 (fr
EP0448803A3 (en
Inventor
Rainer Grundig E.M.V. Max Grundig Rumland
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Grundig EMV Elektromechanische Versuchsanstalt Max Grundig GmbH
Original Assignee
Grundig EMV Elektromechanische Versuchsanstalt Max Grundig GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Grundig EMV Elektromechanische Versuchsanstalt Max Grundig GmbH filed Critical Grundig EMV Elektromechanische Versuchsanstalt Max Grundig GmbH
Priority to AT90124078T priority Critical patent/ATE102726T1/de
Publication of EP0448803A2 publication Critical patent/EP0448803A2/fr
Publication of EP0448803A3 publication Critical patent/EP0448803A3/de
Application granted granted Critical
Publication of EP0448803B1 publication Critical patent/EP0448803B1/fr
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19639Details of the system layout
    • G08B13/19652Systems using zones in a single scene defined for different treatment, e.g. outer zone gives pre-alarm, inner zone gives alarm
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19634Electrical details of the system, e.g. component blocks for carrying out specific functions

Definitions

  • the invention relates to a video control device for the detection of stationary and moving objects in a delimited, preferably flat area with the aid of a surveillance camera.
  • Light barriers are often used to detect such objects. Although this type of monitoring is not very complex, it has the disadvantage that only objects that interrupt a light beam are recognized, so that the network of light beams must be very narrow. In order to recognize people lying down or flat obstacles, the light barriers must be installed very low, which, however, can easily lead to errors in the evaluation, e.g. if There is snow. Additional video surveillance is required, so that in the event of an alarm, the surveillance personnel can check the surveillance area for the cause of the alarm so that the train is not stopped in the event of a false alarm.
  • a more advantageous method is monitoring with television cameras and automatic evaluation with a video controller.
  • movements are detected here, so that a pedestrian or a car in the surveillance area triggers the alarm. Since in this type of monitoring two images in succession are checked for changes, the detection of an object depends on its movement. Objects at rest are not recognized.
  • a source of error arises from changes in the image caused by the moving shadow of passing clouds or trees moving in the wind. In the dark there are problems with the headlights of car headlights.
  • the object of the invention is therefore to provide a monitoring device that is both stationary and also reliably detects moving objects in the surveillance area and at the same time reduces the probability of false alarms.
  • This object is achieved by taking two images for evaluation and storing them in an image memory, one of the images being taken without artificial lighting, while the second image with a flash which is arranged opposite the camera, the axis of the radiation cone of the Flash forms an angle with the camera axis, which is smaller than 180 °, is recorded.
  • a difference image is now created from the two images stored in the image memory, which only contains portions which have arisen from the lighting by the flash, while portions which have arisen as a result of normal light are extinguished. If there is an object in the monitored area, the difference image results in a signal in the shadow areas that arise behind an object on the side facing away from the flash. The extent of these signals is evaluated. An alarm is triggered when a shadow is detected.
  • the monitoring device With the monitoring device according to the invention, three-dimensional objects can be recognized, it being irrelevant whether these are moving or at rest. By hiding the part of the image that is created by normal lighting, changes in the image that are caused by shadows as a result of normal lighting and the like and that lead to interference in known image processing systems are suppressed.
  • the area to be monitored can be limited by a mask if the detection range of the camera is larger than the area to be monitored.
  • the mask is electronically determined so that the excluded areas are not taken into account in the evaluation.
  • a second flash device which is arranged at a short distance next to the first, so that, for example, ruts in snow in the direction of the plane in which the axis of the camera optics and the flash cone of lightning lying, do not cause shadows. It is advantageous if the axis of the second flash has a slightly changed angle to the camera axis.
  • Limiting the spectral range of the flash and advantageously also of the camera also contributes to increasing the evaluation reliability, since the interference is reduced by this exclusion.
  • a range from dark red to infrared can still be processed well by the television cameras with semiconductor sensors (CCD cameras), the blue, green and yellow areas are suppressed and an appropriate optical filter makes the scene still appear natural. In this way, the image signals triggered by a limited spectral range can be fed to a central monitoring station for evaluation.
  • the light loss caused by the filter is compensated for by opening the diaphragm by 2 to 3 steps.
  • FIG. 1 shows a block diagram of an arrangement according to the invention
  • FIG. 2 shows the arrangement of flash unit (hereinafter referred to as flash) and camera using the example of a level crossing
  • FIG. 3 shows the image section with a restricted area and a three-dimensional object.
  • the camera 1 is connected to the masking device 2. From this masking device 2, lines lead to the synch separator 3 to the image processing unit 12 and to the switch S1, which optionally connects the signal at the output of the masking device 2 to the image memory 6 or to the image memory 7.
  • the switch S1 is controlled by the switch control 5.
  • the synch separator 3 is still connected to the field recognition 4. This in turn has a connection to the switch control 5 and to the flash control 8, which is connected to the switch S2 and to the flash 9.
  • the image memories 6 and 7 are also connected to the differential circuit 11, to which the image processing unit 12 connects.
  • a connection leads from the image processing unit 12 to the alarm transmitter 13, which is connected to an alarm output unit 14.
  • the camera 1 and the flash 9 are arranged elevated on opposite sides of the surveillance area.
  • a possible arrangement is shown in FIG. 2a using the example of a level crossing.
  • the arrangement can consist of the camera K and the flash B or of the camera K and the flashes B1 and B2. Furthermore, an arrangement with more than two flashes is also possible if the area to be monitored has other conditions that require this.
  • a side view of the arrangement is shown in Fig. 2b. 2c shows a view from above.
  • the switch S2 is coupled to the barrier at a level crossing so that it activates the monitoring device when the barrier is closed.
  • the camera When the monitoring device is activated, the camera first records a first field and then a second field with flash lighting. These video signals pass through the masking device 2, in which everything is hidden that does not belong to the area to be monitored.
  • the masking device 2 In Figure 3a, the parts that are masked out by the masking device are shown hatched, so that only the area between the barriers remains. In the masking device 2 However, ascertained bumps or the rails, which can also interfere with the evaluation, can be hidden.
  • the manipulated in the masking device 2 image signal is firstly applied to the synch separator 3, in which the synchronization signals are separated, which are then processed in the field recognition 4.
  • the image portions hidden by the mask are fed to the image processing unit, so that these image portions are not taken into account in the image evaluation.
  • the manipulated image signal is optionally sent to the image memory 6 or the image memory 7 via the switch S1.
  • the switch S1 is brought into the respectively required position by the switch control 5, a switching signal being given by the field recognition 4 to the switch control 5.
  • the control takes place in such a way that a first field is stored in the image memory 6. This first field is under normal conditions, i.e. taken by the camera without flash.
  • the field detection 4 again sends a switching signal to the switch control 5 and the flash control 8 and the flash image now generated is stored in the image memory 7.
  • the field detection can output a switching signal after each field or every frame, which is evaluated in the switch control 5 or in the flash control 8.
  • the evaluation can advantageously take place in such a way that after the first Field in the image memory 6, one field is not evaluated and the next field is then written into the image memory 7, the flash 9 being triggered by the flash control 8 when this field is recorded.
  • This field now contains image information that was obtained due to the normal lighting and additionally the image information that was caused by the flash.
  • the two fields are located in the image memories 6 and 7 and are subsequently manipulated in the differential circuit 11 by forming the difference from the corresponding image points of the image memory 6 and the image memory 7.
  • the resulting image which is evaluated in the image processing unit 12, only contains image information that was caused by the light of the flash. When this image was displayed on the monitor, everything would be largely shown and visible, just like on a normal picture. However, the disturbing external light sources, such as car headlights and their light cones, and their effects, such as the shadows caused by these light sources, are missing. Shadows are also invisible, which are caused by passing clouds or trees swaying in the wind and which can only be eliminated with great effort or not at all during image evaluation using known image recording methods.
  • the image information that only results from the light of the flash creates a shadow on the side of the object facing away from the flash, as shown in FIG. 3 is represented by the area S, which indicates the presence of a three-dimensional object O in the surveillance area.
  • the unlit side of the object also remains black and is also referred to as shadow in the following.
  • the simplest way to evaluate the image is to use a shadow, i.e. recognize an area whose image values have black levels. If such an area is recognized, the alarm device 13 can emit an alarm, which is indicated acoustically or optically by the alarm output unit 14.
  • the image evaluation in the image processing unit 12 can be expanded as far as is necessary for meaningful monitoring. For example, the extent and shape of the area can be evaluated with a black level. In this way, an alarm can be suppressed, for example by a cigarette packet. Thanks to a more complex image processing system, brightening of the shadows created by scattered light can also be taken into account.
  • the size of the shadow depends on the position to the flash. An object that is close to the flash creates a smaller shadow than an object of the same size that is further away because the angle of incidence is flatter here.
  • Three-dimensional objects which, as already mentioned, are constantly in the same area in the area to be monitored, can be masked out by the masking device 2 or they can be excluded from the evaluation in the image processing unit 12.
  • An adaptation to different places of use is easily possible here, in that the surveillance area is recorded in the manner described above when the surveillance system is set up, and the shadows that are created are taught in and are not taken into account in the evaluation in the surveillance area.
  • the surveillance camera of the surveillance system is also used for surveillance by surveillance personnel, i.e. for displaying an image on a monitor, the field that was additionally exposed by flash can be replaced by the previous field stored in the other image memory.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Processing (AREA)
  • Selective Calling Equipment (AREA)
  • Length Measuring Devices By Optical Means (AREA)
EP90124078A 1990-03-28 1990-12-13 Système de commande d'affichage vidéo Expired - Lifetime EP0448803B1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AT90124078T ATE102726T1 (de) 1990-03-28 1990-12-13 Videokontroll-einrichtung.

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE4009912A DE4009912A1 (de) 1990-03-28 1990-03-28 Videokontroll-einrichtung
DE4009912 1990-03-28

Publications (3)

Publication Number Publication Date
EP0448803A2 true EP0448803A2 (fr) 1991-10-02
EP0448803A3 EP0448803A3 (en) 1992-09-23
EP0448803B1 EP0448803B1 (fr) 1994-03-09

Family

ID=6403218

Family Applications (1)

Application Number Title Priority Date Filing Date
EP90124078A Expired - Lifetime EP0448803B1 (fr) 1990-03-28 1990-12-13 Système de commande d'affichage vidéo

Country Status (3)

Country Link
EP (1) EP0448803B1 (fr)
AT (1) ATE102726T1 (fr)
DE (2) DE4009912A1 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1079351A1 (fr) * 1999-08-27 2001-02-28 Siemens Building Technologies AG Dispositif de surveillance d'un espace
WO2002021473A2 (fr) * 2000-09-08 2002-03-14 Idm Gmbh Infrarot Sensoren Dispositif pour surveiller une zone d'une piece
WO2003018402A1 (fr) * 2001-08-27 2003-03-06 Edouard Menoud Systeme de detection de corps etrangers sur les pistes d'aeroports
EP1345444A1 (fr) * 2002-03-11 2003-09-17 Inventio Ag Systeme de sureillance video en trois dimensions avec une source de rayonnements infrarouges
WO2004084556A1 (fr) * 2003-03-20 2004-09-30 Inventio Ag Surveillance au niveau d'un ascenseur au moyen d'un capteur 3d
WO2006131647A2 (fr) * 2005-06-08 2006-12-14 Sagem Securite Procede d'analyse d'une presence dans un espace
CN107300722A (zh) * 2017-07-18 2017-10-27 孙天宇 一种机场跑道异物检测系统

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4436856C2 (de) * 1994-10-16 1998-07-02 Christian Lutz Zugbremseinrichtung
DE19507812A1 (de) * 1995-03-06 1996-09-12 Marinitsch Waldemar Verfahren und Vorrichtung zum Identifizieren und Lokalisieren eines Objektes
DE19623524A1 (de) * 1996-06-13 1998-01-02 Pintsch Bamag Ag Einrichtung zur Gefahrenraumüberwachung an einem Bahnübergang
DE202007002260U1 (de) * 2007-02-15 2008-06-26 Leuze Electronic Gmbh & Co Kg Optoelektronische Vorrichtung

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0265769A1 (fr) * 1986-10-17 1988-05-04 Hitachi, Ltd. Procédé et appareil de mesure avec une coupe de lumière
FR2606572A1 (fr) * 1986-11-07 1988-05-13 Faiveley Ets Procede et dispositif pour detecter la presence d'un corps dans une zone predeterminee

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0265769A1 (fr) * 1986-10-17 1988-05-04 Hitachi, Ltd. Procédé et appareil de mesure avec une coupe de lumière
FR2606572A1 (fr) * 1986-11-07 1988-05-13 Faiveley Ets Procede et dispositif pour detecter la presence d'un corps dans une zone predeterminee

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1079351A1 (fr) * 1999-08-27 2001-02-28 Siemens Building Technologies AG Dispositif de surveillance d'un espace
WO2002021473A2 (fr) * 2000-09-08 2002-03-14 Idm Gmbh Infrarot Sensoren Dispositif pour surveiller une zone d'une piece
WO2002021473A3 (fr) * 2000-09-08 2002-05-23 Idm Gmbh Infrarot Sensoren Dispositif pour surveiller une zone d'une piece
WO2003018402A1 (fr) * 2001-08-27 2003-03-06 Edouard Menoud Systeme de detection de corps etrangers sur les pistes d'aeroports
SG107640A1 (en) * 2002-03-11 2004-12-29 Inventio Ag Door state monitoring by means of three-dimensional sensor
EP1345444A1 (fr) * 2002-03-11 2003-09-17 Inventio Ag Systeme de sureillance video en trois dimensions avec une source de rayonnements infrarouges
US6973998B2 (en) 2002-03-11 2005-12-13 Inventio Agt Door state monitoring by means of three-dimensional sensor
WO2004084556A1 (fr) * 2003-03-20 2004-09-30 Inventio Ag Surveillance au niveau d'un ascenseur au moyen d'un capteur 3d
US7140469B2 (en) 2003-03-20 2006-11-28 Inventio Ag Three-dimensional monitoring in the area of an elevator by means of a three-dimensional sensor
CN100568959C (zh) * 2003-03-20 2009-12-09 因温特奥股份公司 监视电梯设备的范围的方法和装置
WO2006131647A2 (fr) * 2005-06-08 2006-12-14 Sagem Securite Procede d'analyse d'une presence dans un espace
FR2887061A1 (fr) * 2005-06-08 2006-12-15 Sagem Procede d'analyse d'une presence dans un espace
WO2006131647A3 (fr) * 2005-06-08 2007-02-01 Sagem Defense Securite Procede d'analyse d'une presence dans un espace
US7742175B2 (en) 2005-06-08 2010-06-22 Sagem Securite Method of analyzing a presence in a space
CN107300722A (zh) * 2017-07-18 2017-10-27 孙天宇 一种机场跑道异物检测系统

Also Published As

Publication number Publication date
EP0448803B1 (fr) 1994-03-09
ATE102726T1 (de) 1994-03-15
EP0448803A3 (en) 1992-09-23
DE59004935D1 (de) 1994-04-14
DE4009912A1 (de) 1991-10-02

Similar Documents

Publication Publication Date Title
DE3634628C2 (fr)
DE69815977T2 (de) Gegen globale veränderungen unempfindlicher videobewegungsdetektor
DE602005001627T2 (de) Vorrichtung zur Extraktion von Fussgängern
EP0448803B1 (fr) Système de commande d'affichage vidéo
WO2008061607A1 (fr) Procédé et dispositif de surveillance d'un espace à trois dimensions
EP0853299A2 (fr) Procédé et dispositif de commande d'un aménagement pour porte en réponse à la présence des personnes
WO2004029502A1 (fr) Procede et dispositif pour securiser une zone de risque
EP1346330B1 (fr) Systeme de detection de fumee base sur la video
EP1273516A1 (fr) Dispositif pour la saisie d'information optique
DE19621612A1 (de) Verfahren und Vorrichtung zur optischen Freiraumüberwachung
EP0356734A2 (fr) Dispositif détecteur d'intrusion à caméras vidéo
DE69010062T2 (de) Fernsehbewegungsdetektor mit Falschalarm-Immunität.
DE3842356A1 (de) System zum feststellen einer bewegung bzw. einer veraenderung im ueberwachungsbereich mehrerer fernsehkameras
WO2020048666A1 (fr) Dispositif de surveillance et procédé de détection d'homme à la mer
DE19623524A1 (de) Einrichtung zur Gefahrenraumüberwachung an einem Bahnübergang
DE102007032091B3 (de) Verfahren zum Überwachen eines höhengleichen Bahnübergangs
DE3214254A1 (de) Verfahren zum erkennen von bewegungen in video-kamera-bildern
DE10049366A1 (de) Verfahren zum Überwachen eines Sicherheitsbereichs und entsprechendes System
DE60033210T2 (de) Vorrichtung zur Übertragung von digitalen Videobildern
DE102023003008A1 (de) Ein Verfahren zur Fahrzeug-Brandüberwachung und ein Fahrzeugbrandüberwachungssystem
EP3811091A1 (fr) Procédé et arrangement pour reconnaître des décharges en couronne d'une installation ayant des moyens d'exploitation
WO1997004428A1 (fr) Systeme de surveillance interactif
DE102017207729A1 (de) Verfahren und Vorrichtung zur Detektion eines sich nicht in einem Erfassungsbereich einer Kamera befindlichen Objekts
DE19749136C2 (de) Verfahren und Vorrichtung zum Erfassen von Bewegungen
DE19744694B4 (de) Videobewegungsmeldeeinrichtung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT CH DE DK FR GB IT LI

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT CH DE DK FR GB IT LI

17P Request for examination filed

Effective date: 19921022

17Q First examination report despatched

Effective date: 19930624

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT CH DE DK FR GB IT LI

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED.

Effective date: 19940309

Ref country code: DK

Effective date: 19940309

REF Corresponds to:

Ref document number: 102726

Country of ref document: AT

Date of ref document: 19940315

Kind code of ref document: T

GBT Gb: translation of ep patent filed (gb section 77(6)(a)/1977)

Effective date: 19940314

REF Corresponds to:

Ref document number: 59004935

Country of ref document: DE

Date of ref document: 19940414

ET Fr: translation filed
PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 19941202

Year of fee payment: 5

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 19941220

Year of fee payment: 5

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: AT

Payment date: 19941230

Year of fee payment: 5

Ref country code: FR

Payment date: 19941230

Year of fee payment: 5

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed
REG Reference to a national code

Ref country code: CH

Ref legal event code: PFA

Free format text: GRUNDIG E.M.V. ELEKTRO- MECHANISCHE VERSUCHSANSTALT MAX GRUNDIG GMBH & CO. KG

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Effective date: 19951213

Ref country code: GB

Effective date: 19951213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Effective date: 19951231

Ref country code: LI

Effective date: 19951231

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 19951213

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Effective date: 19960830

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20100216

Year of fee payment: 20

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20101213