EP1287509B1 - Überwachungssystem - Google Patents

Überwachungssystem Download PDF

Info

Publication number
EP1287509B1
EP1287509B1 EP01916017A EP01916017A EP1287509B1 EP 1287509 B1 EP1287509 B1 EP 1287509B1 EP 01916017 A EP01916017 A EP 01916017A EP 01916017 A EP01916017 A EP 01916017A EP 1287509 B1 EP1287509 B1 EP 1287509B1
Authority
EP
European Patent Office
Prior art keywords
coordinate value
marking means
digital representation
monitoring system
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP01916017A
Other languages
English (en)
French (fr)
Other versions
EP1287509A1 (de
Inventor
Karl-Erik Morander
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sequr SA
Original Assignee
Sequr S A
Sequr SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from SE0000925A external-priority patent/SE524332C2/sv
Application filed by Sequr S A, Sequr SA filed Critical Sequr S A
Publication of EP1287509A1 publication Critical patent/EP1287509A1/de
Application granted granted Critical
Publication of EP1287509B1 publication Critical patent/EP1287509B1/de
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19639—Details of the system layout
    • G08B13/19652—Systems using zones in a single scene defined for different treatment, e.g. outer zone gives pre-alarm, inner zone gives alarm
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19697—Arrangements wherein non-video detectors generate an alarm themselves
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00—Fire alarms; Alarms responsive to explosion
    • G08B17/12—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
    • G08B17/125—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke

Definitions

  • the present invention relates to a monitoring system for monitoring at least a fixed but displaceable object in a volume, which object is provided with at least one marking means in form of a light generating or light reflecting device, which system comprises at least one optical recording unit for recording an image of at least a part of the volume comprising said object provided with the marking means, device for transforming said image to a digital representation of the same image, means for comparison of the digital representation with a stored data-set, and device for generating a signal at the presence of a deviation at comparison of the digital representation with the stored information quantity.
  • each object is provided with active or passive sensors, which can alarm when a guarded point is trespassed.
  • active or passive sensors which can alarm when a guarded point is trespassed.
  • the disadvantage of such systems is that damage on an alarmed object cannot be detected immediately, which among others can result in time for manipulation of the alarm sensors.
  • transponders attached to the object to be guarded.
  • the transponders are continuously or periodically in radio communication with a controlling unit, which generates an alarm when a boarder is trespassed or an attempt is made to manipulate the transponder.
  • the drawbacks of such systems are that they are usually expensive, for instance because the transponders, complicated monitoring algorithms for several transponders, they do not detect displacements within the controlled area, the need of frequency band for operation and risk of radio interferences.
  • JP 11 003 474 relates to deciding the changes of the image of a monitored object by means of a reflected laser light from the monitored object and generating an alarm. Accordingly, a pattern corresponded to the incoming image, is compared with a stored pattern.
  • JP 11185175 it is decided whether the image of a marker has been changed or not, whereby an inputted image is compared to a stored image.
  • EP 393 807 relates to image processing, see for instance claim 1. An image of a marker is compared to a stored image and variations in the image edge are registered.
  • EP 984 412 signals from an image, or parts of an image, are continuously compared to a stored reference image, whereby correlation analysis is used. When differences are detected in the correlated signal a warning or alarm is generated.
  • WO 98/56182, US 4,160,998, US 5,880,775, DE 4417128 and DE 38 42 356 relate to image processing, where alarm is generated when frequent differences in the form of the images are detected.
  • the present invention relates to monitoring of a position of a marker, particularly its coordinates in two dimensions, and registering the deviation from a stationary position coordinate.
  • the changes of the form of the marker and the appearance are unimportant, since the coordinates are decided by means of a center of gravity or center point.
  • FR 2759541 mentions the use of coordinates.
  • the system relates to motion analysis, in which the motion of the markers are analyzed and if its motion pattern deviates from a motion-determined pattern, an alarm is generated.
  • the object of the present invention is to provide a system for substantially automatically, contactless and optical monitoring of a volume and/or a number of objects in a volume by means of simple means, substantially in real time without the need for complicated modifications within the volume or the object.
  • Another object of the present invention is to provide a simple but yet efficient thief-proof protection system.
  • Yet, another object of the invention is to provide a smoke detection system.
  • the stored data set comprises at least a two dimensional stationary coordinate value for the initial position of the marking means.
  • the system comprise means for extraction of at least one stationary coordinate value, which is at least a two-dimensional coordinate value, out of the digital representation for the marking means, whereby said comparison means compares said extracted two dimensional coordinate value to the stored stationary coordinate value.
  • a number of objects are provided with said marking means, where the objects are monitored for uncontrolled displacement.
  • each object is provided with a reflecting mark.
  • a part of the object can be used as a marking means.
  • several marking means are arranged on the same object.
  • the digital representation contains coordinate values for the marking means and that the stored data set comprises an initial position for the coordinate values of the marking means.
  • the light intensity of the marking means is measured and the data set stored comprises an initial light intensity.
  • the system comprises a heat detector.
  • the invention also relates to a method for monitoring an object in a volume provided with the steps included in claim 10.
  • the data comprises the value of the light intensity for said marking means.
  • the monitoring system consists of a measuring camera system, for instance such a system that can be used for motion analysis.
  • the system 10 which is shown in Fig. 1, comprises at least one camera 11, for monitoring of a number of objects 12 provided with markers 13.
  • the camera 11 is provided with means, such as a light flash, a lamp or another light source for sending out light, preferably (but not restricted to) infrared light or the like in form of short light flashes. If required, a continuous illumination can be used.
  • the markers 13 comprise a retro reflective tape or a body provided with a reflecting surface, which reflects the light back to the camera.
  • Active or passive markers may comprise illumination devices such as light diodes, which are activated by the camera or another control unit can be used.
  • a computer unit 14 for receiving image data from the camera, which as a rule is arranged with a CCD-unit (CCD: Charge Coupled Device) or another optical sensor.
  • CCD-unit Charge Coupled Device
  • the data from the sensor unit is preferably obtained in form of digital signals. Recording by means of the sensor, and converting the signal to digital or video signals, are assumed to be well known for a man skilled in the art, and will not be described further herein.
  • the computer unit 14 evaluates the image of each marker in the field of vision, substantially in real time (image speed 50-240 images/sec) and calculates the coordinates of the markers, preferably to its center (its center of gravity). Preferably, the coordinates are calculated with regard to an interior coordinate system.
  • the coordinate values can have a resolution of 1/50.000 of the field of vision.
  • the coordinates are continuously transferred, via for instance a serial interface, to a monitoring computer 15.
  • a memory unit 16 in the computer the original positions of the markers are stored. All uncontrolled deviation from the original coordinate value of a marker can initiate an alarm.
  • the original positions are registered, for instance by giving a particular command when the objects and the markers have been located on its correct position. If the position is changed, the new positions can be registered in the computer as new original positions.
  • the number of cameras in the room are chosen so that each marker in the monitored volume is seen by at least one camera.
  • the markers are arranged on objects to be protected and other points of interest in the room (doors, windows, etc).
  • all the coordinates are stored in the memory unit of the computer 16, which then continuously monitors every change of the coordinates.
  • a camera having a field of vision of approx 5 m detects a displacement of approx. 0.1 mm. Since the system is passive and has high resolution, it is not possible to interfere the system. Every attempt to manipulate a marker results in that the coordinate values of the marker are changed, which may lead to an alarm. Theoretically, a marker can be displaced from its location in direction towards the camera without the coordinate value is changed, but in practice, this should not be possible to perform. Moreover, several cameras can see a marker and even then, it is not theoretically possible to displace a mark. Of course, the system can be arranged so that it measures the distance between the camera and the mark, such as described in the Swedish patent No. 9700066-5.
  • the reliability of the system can be improved by providing a protected object in the system with two or more markers 13a-13c, which allows preventing false alarm if one of the markers is hidden, disturbed or is invisible for a camera, the remaining markers can be discovered.
  • the system according to the invention can be made completely self-calibrating and very easy to install.
  • the system can be arranged so that it indicates that if the markers are shown with sufficient intensity in itself.
  • the influence of operation on the measuring values can be easily eliminated in the monitoring computer, since all the markers are moved in the same way.
  • the markers are preferably comprised of recessed or punched parts of self-adhering reflex tape to a low cost. However, the markers can be replaced by reflections 13d from the surfaces of the objects if a fixed or defined illumination is arranged.
  • a tolerance area is defined in the monitoring computer, so that no alarm is generated as long as the object is within the tolerance area.
  • False markers can eventually appear if there are many bright objects in an image, which the camera apprehends as a reflex mark. False markers can be filtrated in most of the cases by means of that the measuring system contains information concerning the shape of each mark. The false markers. which eventually remain after the filtration, are no problem since they are in fact stationary. Varying strong sunlight may cause problem through dazzling the system, but by means of appropriate camera location, such problems can be eliminated.
  • the system also provides possibility for protecting encased objects in, for instance in transparent spaces such as display cabinets or the like, without the need for wire laying in the space etcetera.
  • the camera 21 also measures, in addition to the position of the marker, the light intensity received from the marker 22.
  • a disturbance in the measurement for instance because of a cloud of smoke 26 can be detected by the computer as the light intensity becomes weaker.
  • the clouds of smoke are detected, for instance a fire alarm may be generated.
  • the system can use coordinate values for detecting the marker and calculating its light intensity.
  • the system may also comprise communication means 15, 25, which in alarm mode sends a message to an alarm central or predetermined receivers.
  • the system can also be connected to a network, such as Internet, for remote control and remote monitoring.
  • system according to the invention may be completed with a sensor 30 for heat detection.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Alarm Systems (AREA)
  • Iron Core Of Rotating Electric Machines (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Burglar Alarm Systems (AREA)

Claims (11)

  1. Überwachungssystem (10, 20) zum Überwachen von wenigstens einem festen, aber verschiebbaren Objekt in einem Volumen, wobei das Objekt mit wenigstens einem Kennzeichnungsmittel (13, 13a - 13d, 23) in Form einer Licht erzeugenden oder darstellenden Vorrichtung versehen ist, wobei das System wenigstens eine optische Aufzeichnungseinheit (11, 21) zum Aufzeichnen eines Bilds von wenigstens einem Teil des Volumens, welches das mit dem Kennzeichnungsmittel (13, 13a - 13d, 23) versehene Objekt umfasst, eine Vorrichtung zum Überführen des Bilds in eine digitale Darstellung des selben Bilds, Mittel (14) zum Vergleichen der digitalen Darstellung mit einem gespeicherten Datensatz, und eine Vorrichtung zum Erzeugen eines Signals bei Vorhandensein einer Abweichung beim Vergleich der digitalen Darstellung mit dem gespeicherten Datensatz umfasst, wobei
    der gespeicherte Datensatz durch einen selbstkalibrierenden Prozess erhalten wird, der in einem ersten Schritt das Speichern von einem wenigstens zweidimensionalen stationären Koordinatenwert für die Anfangsposition des Kennzeichnungsmittels (13, 13a - 13d) umfasst, und wobei das System Mittel zum Extrahieren wenigstens eines stationären Koordinatenwerts, der wenigstens ein zweidimensionaler Koordinatenwert ist, aus der digitalen Darstellung des Kennzeichnungsmittels während eines Überwachungsmodus umfasst, wobei das Vergleichsmittel (14) den extrahierten zweidimensionalen Koordinatenwert mit dem gespeicherten stationären Koordinatenwert vergleicht und einen Alarm erzeugt, falls das Vergleichsergebnis abweicht.
  2. Überwachungssystem (10) nach Anspruch 1,
    dadurch gekennzeichnet, dass das Objekt auf eine unkontrollierte Verschiebung hin überwacht wird.
  3. Überwachungssystem (10) nach Anspruch 1 und 2,
    dadurch gekennzeichnet, dass das Objekt mit einer reflektierenden Kennzeichnung versehen ist.
  4. Überwachungssystem (10) nach Anspruch 2 und 3,
    dadurch gekennzeichnet, dass ein Teil des Objekts als Kennzeichnungsmittel verwendet wird.
  5. Überwachungssystem (10) nach Ansprüchen 1 - 4,
    dadurch gekennzeichnet, dass mehrere Kennzeichnungsmittel an dem selben Objekt angeordnet sind.
  6. Überwachungssystem (20) nach Anspruch 1,
    dadurch gekennzeichnet, dass die Lichtintensität des Kennzeichnungsmittels ebenfalls gemessen wird.
  7. Überwachungssystem (20) nach Anspruch 6,
    dadurch gekennzeichnet, dass der gespeicherte Datensatz eine Anfangslichtintensität umfasst.
  8. Überwachungssystem (20) nach Anspruch 6 oder 7,
    dadurch gekennzeichnet, dass das System als Feueralarm gedacht ist.
  9. Überwachungssystem (20) nach einem der vorhergehenden Ansprüche,
    dadurch gekennzeichnet, dass das System zusätzlich einen Wärmemelder umfasst.
  10. Verfahren zum Überwachen eines Objekts in einem Volumen, wobei das Objekt mit wenigstens einem Kennzeichnungsmittel (13, 13a - 13d, 23) in Form einer Licht erzeugenden oder reflektierenden Vorrichtung versehen ist, wobei das Verfahren die Schritte umfasst:
    Anordnen wenigstens einer optischen Sensoreinheit (11, 21) zum Aufzeichnen eines Bilds von mindestens einem Teil des Volumens, das das Kennzeichnungsmittel (13, 13a -13d, 23) umfasst,
    Umwandeln des Bilds in eine digitale Darstellung des selben Bilds,
    Vergleichen der digitalen Darstellung mit einem gespeicherten Datensatz,
    Extrahieren von wenigstens einem Koordinatenwert, der wenigstens ein zweidimensionaler Koordinatenwert ist, aus der digitalen Darstellung des Kennzeichnungsmitteis,
    Vergleichen des extrahierten zweidimensionalen Koordinatenwerts mit einem gespeicherten stationären Koordinatenwert, der durch einen selbstkalibrierenden Prozess erhalten wird, der einen ersten Schritt des Speicherns des stationären Koordinatenwerts für das Kennzeichnungsmittel mittels des Vergleichsmittels (14) umfasst, und
    Erzeugen eines Alarms bei Vorhandensein einer Abweichung beim Vergleich des extrahierten Koordinatenwerts mit dem gespeicherten Koordinatenwert.
  11. Verfahren nach Anspruch 10,
    dadurch gekennzeichnet, dass die Daten auch einen Wert der Lichtintensität für das Kennzeichnungsmittel umfassen.
EP01916017A 2000-03-20 2001-03-20 Überwachungssystem Expired - Lifetime EP1287509B1 (de)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US19067900P 2000-03-20 2000-03-20
SE0000925A SE524332C2 (sv) 2000-03-20 2000-03-20 System och metod för optisk övervakning av en volym
US190679P 2000-03-20
SE0000925 2000-03-20
PCT/SE2001/000587 WO2001071688A1 (en) 2000-03-20 2001-03-20 Monitoring system

Publications (2)

Publication Number Publication Date
EP1287509A1 EP1287509A1 (de) 2003-03-05
EP1287509B1 true EP1287509B1 (de) 2004-10-13

Family

ID=26655028

Family Applications (1)

Application Number Title Priority Date Filing Date
EP01916017A Expired - Lifetime EP1287509B1 (de) 2000-03-20 2001-03-20 Überwachungssystem

Country Status (5)

Country Link
EP (1) EP1287509B1 (de)
AT (1) ATE279762T1 (de)
AU (1) AU2001242960A1 (de)
DE (1) DE60106434T8 (de)
WO (1) WO2001071688A1 (de)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE523456C2 (sv) * 2001-09-28 2004-04-20 Wespot Ab System, anordning och förfarande för inställning av en övervakningsenhet
US7302080B2 (en) * 2001-09-28 2007-11-27 Secumanagement B.V. System for installation
DE102006053546B4 (de) * 2006-11-14 2009-04-02 Leuze Lumiflex Gmbh + Co. Kg Optischer Sensor

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4894716A (en) * 1989-04-20 1990-01-16 Burle Technologies, Inc. T.V. motion detector with false alarm immunity
US5880775A (en) * 1993-08-16 1999-03-09 Videofaxx, Inc. Method and apparatus for detecting changes in a video display
ATE202215T1 (de) * 1994-08-24 2001-06-15 Seisma Ag System und verfahren zur bildauswertung
FR2759541B1 (fr) * 1997-02-18 1999-04-23 Visio Systemes Procede et installation de teledetection automatique de l'activite d'animaux en stabulation libre
NO982640L (no) * 1998-06-08 1999-12-09 Nyfotek As Fremgangsmåte og system for overvåking av et område

Also Published As

Publication number Publication date
DE60106434T8 (de) 2006-03-23
AU2001242960A1 (en) 2001-10-03
EP1287509A1 (de) 2003-03-05
DE60106434T2 (de) 2005-10-13
DE60106434D1 (de) 2004-11-18
WO2001071688A1 (en) 2001-09-27
ATE279762T1 (de) 2004-10-15

Similar Documents

Publication Publication Date Title
US6937743B2 (en) Process and device for detecting fires based on image analysis
EP3671261A1 (de) System zur 3d-überwachung mit lidar und multispektraler bildgebung zur objektklassifizierung
US5966074A (en) Intruder alarm with trajectory display
JP2003515811A (ja) 映像危機管理カーテン
US6469734B1 (en) Video safety detector with shadow elimination
JP6859446B2 (ja) 物体捜索システム、物体捜索装置、及び物体捜索方法
US6829371B1 (en) Auto-setup of a video safety curtain system
US7167575B1 (en) Video safety detector with projected pattern
JP3043925B2 (ja) 移動物体検出判定装置
KR101754407B1 (ko) 주차장 차량 출입 관리시스템
EP3452848B1 (de) Überwachungsverfahren unter verwendung eines kamerasystems mit einer bereichsbewegungsdetektion
KR20010113663A (ko) 물체 인식 및 추적 시스템
RU2268497C2 (ru) Система и способ автоматизированного видеонаблюдения и распознавания объектов и ситуаций
US7768658B2 (en) Anomaly detection system and method
CN110581980B (zh) 安全监控系统的运作方式
JP7128577B2 (ja) 監視装置
WO2006030444A2 (en) Imaging based identification and positioning system
US20030146972A1 (en) Monitoring system
EP1287509B1 (de) Überwachungssystem
KR101046819B1 (ko) 소프트웨어 휀스에 의한 침입감시방법 및 침입감시시스템
JP7176868B2 (ja) 監視装置
KR102630275B1 (ko) 다중카메라 화재감지기
US20240020875A1 (en) Method for determining a camera pose in a multi-camera system, computer program, machine-readable medium and control unit
JPH0962842A (ja) 駐車場管理システム
JP7141842B2 (ja) 監視装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20021018

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

17Q First examination report despatched

Effective date: 20030424

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: MORANDER, KARL-ERIK

RIN1 Information on inventor provided before grant (corrected)

Inventor name: MORANDER, KARL-ERIK

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SEQUR S.A.

RIN1 Information on inventor provided before grant (corrected)

Inventor name: MORANDER, KARL-ERIK

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

Ref country code: CH

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 60106434

Country of ref document: DE

Date of ref document: 20041118

Kind code of ref document: P

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050113

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050113

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050113

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050124

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050320

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20050320

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20050321

LTIE Lt: invalidation of european patent or patent extension

Effective date: 20041013

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20050331

NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20050714

ET Fr: translation filed
REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20050313

REG Reference to a national code

Ref country code: FR

Ref legal event code: TP

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20090820 AND 20090826

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20100323

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20100322

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20100415

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20100323

Year of fee payment: 10

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20110320

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20111130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110331

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111001

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 60106434

Country of ref document: DE

Effective date: 20111001

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110320

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110320