EP1079350B1 - Einrichtung zur Raumüberwachung - Google Patents

Einrichtung zur Raumüberwachung Download PDF

Info

Publication number
EP1079350B1
EP1079350B1 EP99113947A EP99113947A EP1079350B1 EP 1079350 B1 EP1079350 B1 EP 1079350B1 EP 99113947 A EP99113947 A EP 99113947A EP 99113947 A EP99113947 A EP 99113947A EP 1079350 B1 EP1079350 B1 EP 1079350B1
Authority
EP
European Patent Office
Prior art keywords
stable features
image
image sensor
sensor
stable
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP99113947A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP1079350A1 (de
Inventor
Hansjürg Dr. Mahler
Martin Dr. Rechsteiner
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens Building Technologies AG
Original Assignee
Siemens Building Technologies AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Building Technologies AG filed Critical Siemens Building Technologies AG
Priority to ES99113947T priority Critical patent/ES2209291T3/es
Priority to EP99113947A priority patent/EP1079350B1/de
Priority to DK99113947T priority patent/DK1079350T3/da
Priority to AT99113947T priority patent/ATE250260T1/de
Priority to DE59907024T priority patent/DE59907024D1/de
Publication of EP1079350A1 publication Critical patent/EP1079350A1/de
Application granted granted Critical
Publication of EP1079350B1 publication Critical patent/EP1079350B1/de
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19697—Arrangements wherein non-video detectors generate an alarm themselves
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B29/00—Checking or monitoring of signalling or alarm systems; Prevention or correction of operating errors, e.g. preventing unauthorised operation
    • G08B29/18—Prevention or correction of operating errors
    • G08B29/183—Single detectors using dual technologies

Definitions

  • the present invention relates to a device for room surveillance, with at least an image sensor and at least one presence or motion sensor and with one Control and evaluation electronics to which the sensors mentioned are connected.
  • the known anti-mask devices of passive infrared sensors have an infrared transmitter and an infrared receiver and are used to detect the two types of coverage of the detector, that is the cover of the detector in a certain, possibly only small, distance from the detector window, and the immediate coverage of the detector window by, for example, covering with a film or spraying with an infrared-opaque Spray, such as paint spray.
  • the first type of cover is subsequently called the fem cover and the second is referred to as a spray cover, with fem cover a cover a few millimeters away up to a maximum of about 15 cm from the detector window is meant.
  • the sabotage is monitored by: the ultrasonic or microwave transmitter by briefly switching on / off or off / on emits a short pulse, which creates a wide frequency spectrum, which then evaluated in a certain frequency range with regard to amplitude and time course becomes.
  • the parameters mentioned are used for changes in the room in front of the detector typical deviations from mean values or previous measurement results are examined, in particular to such deviations that are necessary for the attachment of a shield or cover are characteristic of the detector.
  • Image sensors or video detectors are not protected against sabotage, although it goes without saying There is also a risk of sabotage with these sensors.
  • a device of the type mentioned at the beginning the at least an image sensor is protected against sabotage.
  • a first preferred embodiment of the device according to the invention is characterized in that that the stable features are checked by the fact that the image of the monitored space is examined for stable features, and the stable found thereby Features with methods of image processing can be compared with the saved ones.
  • a second preferred embodiment of the device according to the invention is characterized in that that means for measuring the brightness in the monitored room are provided, and that an alarm is triggered if there is a difference between the stored and the found stable characteristics.
  • the storage and checking of stable features enables detection partial coverage of the detector or the pretense of wrong scenes by holding a photo in front of the image sensor or by changing the field of view of the detector.
  • the stable features are saved immediately after installation of the facility; while The operation of the picture is then periodically examined for stable ones Features and a comparison of the found with the stored stable features.
  • a third preferred embodiment of the device according to the invention is characterized in that that the stable features by for the space to be monitored and / or the equipment of which characteristic edges and / or curves are formed.
  • a further preferred embodiment of the device according to the invention is thereby characterized in that the storage and verification of a plurality of stable characteristics and that an alarm is triggered when the number of saved with the stable features matching found stable features a threshold below.
  • the stable features are preferably checked when the detector is not armed, or if there is no activity in the monitored room because the processor is underutilized during this time.
  • the decision whether im monitored Room activities take place or not, preferably takes place on the basis of the signal of the presence or motion sensor.
  • the device according to the invention with at least one image sensor and at least one Presence or motion sensor points towards known dual detectors as well significant advantages over pure image sensors. Compared to the dual detectors, at where no or only a very rough spatial resolution is possible, so that a distinction Often it cannot take place between humans and animals Detectors much more robust.
  • the image sensor offers the possibility of classification the objects based on their geometry and movement and thus the intelligent monitoring as well as the verification and storage of events and later accessibility of these.
  • the detector according to the invention has the advantage that it even in poor lighting conditions the performance of a presence or Provides motion detector and is therefore fully functional.
  • the presence or Motion detector the image processing algorithms when interpreting difficult situations support.
  • drawing being a block diagram of a device according to the invention for room monitoring shows.
  • the device for room monitoring shown in Fig. 1 consists essentially of a multi-criteria motion detector 1, hereinafter referred to as a detector, and one hereinafter referred to as electronics control and evaluation electronics 2 with a control stage 3 and a processing stage 4 for the local evaluation of the signals of the detector 1.
  • a detector a multi-criteria motion detector 1
  • electronics control and evaluation electronics 2 with a control stage 3 and a processing stage 4 for the local evaluation of the signals of the detector 1.
  • this representation only shows the individual function blocks and not the specific ones apparatus construction of the facility again. For example, certain are usually Parts of the electronics are present in detector 1. The latter applies in particular if the detector signals are processed or pre-evaluated in detector 1.
  • the detector 1 consists of at least one image sensor 5 and at least one following presence or motion sensor 6, referred to as P / B sensor.
  • the detector points Means 7 for measuring the brightness in the monitored room, which is preferably a component form the image sensor 5.
  • Both the image sensor 5 and the P / B sensor 6 are one Preprocessing stage 8 or 9 downstream, but also in detector 1 or if necessary can be included in processing level 4. From preprocessing stages 8 and 9 the signals arrive in processing stage 4, which is also the brightness signal of the means 7 is supplied for brightness measurement.
  • Processing level 4 is autonomous and enables local decisions and / or display the images recorded by the image sensor 5; preferably it is also for transmission of the images to a spatially distant center 10, where, for example, an additional one Verification can take place.
  • the P / B sensor 6 is a motion or presence detector based on one of the known detection principles Passive infrared, active infrared, microwaves, ultrasound or any Combination of them.
  • CMOS image sensor a so-called APS [APS: active pixel Sensor] used, which is characterized by a very low power consumption and by the possibility of access to individual pixels.
  • APS active pixel Sensor
  • additional application-specific analog or digital functions for example simple Image processing algorithms such as filters or exposure control can be easily integrated.
  • APS the article "A 128 x 128 CMOS Active Pixel Image Sensor for Highly Integrated Imaging Systems "by Sunetra K. Mendis, Sabrina E. Kennedy and Eric R. Fossum, IEDM 93-538 and "128X128 CMOS Photodiode-Type Active Pixel Sensor With On-Chip Timing, Control and Signal Chain Electronics "by R.H. Nixon, S.E. Kemeny, C.O. Staller and E. R. Fossum in SPIE Vol. 2415/117.
  • the image sensor 5 is directed towards the space to be monitored, detects it in terms of image technology, digitizes the image and stores it as a reference image in a memory. If the image sensor 5 forming APS consists of 128 by 128 pixels, for example, would then be used a wide-angle lens at a distance of 15 m in front of the image sensor 5 one pixel of approximately 12 by 12 cm. Such a grid is suitable, human and distinguish animal shapes relatively reliably from each other.
  • the image sensor 5 makes intervals a picture of the monitored room from fractions of a second is saved Images for a certain time and compare them with the reference image and / or with each other.
  • the storage of the images is preferably controlled in such a way that the images sent by the detector 1 immediately preceding and / or immediately following the detected event until saved further and that the remaining images automatically after the specified time to be deleted.
  • the image sensor is 5-on high light sensitivity and a large dynamic range (sufficient recognizability of details with strong light / dark contrast) optimized.
  • the functions integrated on the APS chip allow an automatic electronic Integrate closure with a dynamic of 1: 1000.
  • the P / B sensor 6 essentially serves to identify the potential weaknesses of the image sensor 5 compensate. This includes in particular that the image sensor 5 is below a critical one Illumination provides no image information, and that also a strong change in the image information is often not caused by an intruder compared to the reference image. you think, for example, of abrupt changes in lighting that by switching the street lighting on / off, passing vehicles with the lights on Headlights, thunderstorms or the like can be caused. In these and the like Cases by taking into account the signal of the P / B sensor 6, the robustness of the detector 1 significantly increased. This is taken into account by a combined evaluation the signals of the image sensor 5 and the P / B sensor 6 in the processing stage 4 realized.
  • the preprocessing stages 8 and 9 in the respective sensor 5 or 6 or in processing stage 4 be integrated.
  • the signals of the P / B sensor 6 are combined into one Evaluation converted with the signal of the image sensor 5 suitable format and classified according to their strength. If detector 1 contains a distance meter (not shown), then this becomes corresponding in the presence of a signal from the P / B sensor 6 Starch from processing level 4 activated via control level 3 and delivers to the processing level information about the distance of the event just detected or Object from detector 1. With the help of this distance information, the signal from the image sensor can be used 5 clear conclusions on the size of a detected object and thus on its size Nature, such as humans or animals.
  • the pre-evaluation takes the form of hardware and / or in the form of a processor core integrated on the APS chip.
  • the number of compared the modified image of the reference image, its clustering and characteristics of the pixel cluster certainly.
  • the reference image is constantly updated, whereby Changes are only adopted in the reference image after checking their stability.
  • the reference image tracking can be more stable by including the signals of the P / B sensor 6 be carried out.
  • processing stage 4 At the input of processing stage 4 there is a signal of the P / B classified according to strength Sensor 6, an image signal of the image sensor 5 with information about the number of changes Pixels and the characteristics of the pixel clusters and possibly a signal from the distance meter, the distance of the event triggering the signal of the P / B detector 6 indicates.
  • the processing stage 4 receives from the means 6 for lighting measurement continuous information about the average lighting in the monitored room and weighted the combined evaluation of the signals the signals of the lighting-independent P / B Sensor 6, the weaker the lighting, the more so.
  • the combined evaluation of the signals gives a decision at the output of processing stage 4 Alarm or non-alarm, this decision essentially the image content, the overall lighting, the information from the P / B sensor 6 and the change and / or history of these parameters, hereinafter referred to as global criteria, are taken into account.
  • Plausibility links are very helpful here: if, for example, lighting and change the image content quickly and strongly, but the signal of the P / B sensor 6 is weak, then no alarm is given, but the stability of the new image is checked and in it searched for movements. If the P / B sensor 6 reports no movement and only one Lighting and / or image change took place, then lighting became pretty certain switched on or off so that there is no alarm.
  • the detector 1 is equipped with one device equipped for sabotage monitoring, namely for sabotage of both the P / B sensor 6 as well as the image sensor 5.
  • the device for monitoring sabotage of the P / B sensor is an antimask device of the known type, the specific training of which detection principle implemented in the P / B sensor 6.
  • Antimask devices are based on the patent applications cited in the introduction to the description directed. The following is the device for monitoring sabotage of the image sensor 5 are described.
  • the image sensor 5 contains a memory in which the digitized Image of the monitored room is stored as a reference image. This memory is preferred integrated on the APS chip. Storage is now also carried out for sabotage monitoring of stable features in the reference image, a periodic examination of the Image sensor 5 recorded image for stable features and a check of the found stable characteristics based on a check with the stored. Under stable Features are to be understood as those features of the image that have a certain probability do not change, in particular boundary lines and edges of the room and of doors and windows, straight edges and general curves of larger pieces of furniture, and the same.
  • a straight edge can pass through its Start and end point or a segment of a circle through its start and end point and additionally the radius or the center of the circle can be defined.
  • the picture taken are examined for stable characteristics and the stable characteristics found are included compared the saved. For example, the distance between the Reference edge and a newly found edge can be determined. If this distance one does not exceed the previously defined value, then the edges are evaluated as matching.
  • the presence or absence of activity in the monitored space is checked with the. P / B sensor detected. If there is sufficient brightness (signal from means 7 for brightness measurement) no stable features are found or the stable features found tamper alarm will not be triggered.
  • the former is a Indications that the image sensor 5 or the detector 1 was not completely covered (for example with a cloth or the like), the latter may indicate that the image sensor 5, for example by taking a photo in front of the lens, a wrong scene is faked.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Alarm Systems (AREA)
  • Burglar Alarm Systems (AREA)
  • Maintenance And Inspection Apparatuses For Elevators (AREA)
EP99113947A 1999-07-17 1999-07-17 Einrichtung zur Raumüberwachung Expired - Lifetime EP1079350B1 (de)

Priority Applications (5)

Application Number Priority Date Filing Date Title
ES99113947T ES2209291T3 (es) 1999-07-17 1999-07-17 Dispositivo para la vigilancia de un recinto.
EP99113947A EP1079350B1 (de) 1999-07-17 1999-07-17 Einrichtung zur Raumüberwachung
DK99113947T DK1079350T3 (da) 1999-07-17 1999-07-17 Indretning til rumovervågning
AT99113947T ATE250260T1 (de) 1999-07-17 1999-07-17 Einrichtung zur raumüberwachung
DE59907024T DE59907024D1 (de) 1999-07-17 1999-07-17 Einrichtung zur Raumüberwachung

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP99113947A EP1079350B1 (de) 1999-07-17 1999-07-17 Einrichtung zur Raumüberwachung

Publications (2)

Publication Number Publication Date
EP1079350A1 EP1079350A1 (de) 2001-02-28
EP1079350B1 true EP1079350B1 (de) 2003-09-17

Family

ID=8238613

Family Applications (1)

Application Number Title Priority Date Filing Date
EP99113947A Expired - Lifetime EP1079350B1 (de) 1999-07-17 1999-07-17 Einrichtung zur Raumüberwachung

Country Status (5)

Country Link
EP (1) EP1079350B1 (da)
AT (1) ATE250260T1 (da)
DE (1) DE59907024D1 (da)
DK (1) DK1079350T3 (da)
ES (1) ES2209291T3 (da)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AT501035A1 (de) * 2002-09-16 2006-05-15 Siemens Ag Oesterreich Funktionsüberwachung einer überwachungsanlage
EP1866883B1 (en) * 2005-03-15 2012-08-29 Chubb International Holdings Limited Nuisance alarm filter
US8558889B2 (en) * 2010-04-26 2013-10-15 Sensormatic Electronics, LLC Method and system for security system tampering detection

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1995024702A1 (de) * 1994-03-07 1995-09-14 Sq Services Ag System und verfahren zur bildauswertung
CA2275893C (en) * 1996-12-23 2005-11-29 Esco Electronics Corporation Low false alarm rate video security system using object classification
DE19700811A1 (de) * 1997-01-13 1998-07-16 Heinrich Landert Verfahren und Vorrichtung zur Ansteuerung von Türanlage in Abhängigkeit von der Anwesenheit von Personen
US6130707A (en) * 1997-04-14 2000-10-10 Philips Electronics N.A. Corp. Video motion detector with global insensitivity

Also Published As

Publication number Publication date
DE59907024D1 (de) 2003-10-23
ATE250260T1 (de) 2003-10-15
EP1079350A1 (de) 2001-02-28
DK1079350T3 (da) 2004-02-02
ES2209291T3 (es) 2004-06-16

Similar Documents

Publication Publication Date Title
EP0939387B1 (de) Einrichtung zur Raumüberwachung
EP0973137B1 (de) Bewegungsmelder
DE69815977T2 (de) Gegen globale veränderungen unempfindlicher videobewegungsdetektor
DE10011411C2 (de) Bildgebender Brandmelder
EP0986912B1 (de) Verfahren zum überwachen eines vorgegebenen überwachungsbereiches
DE69933056T2 (de) Überwachungssystem
US5091780A (en) A trainable security system emthod for the same
EP1628260B1 (de) Verfahren und Vorrichtung zur automatischen Waldbranderkennung
JPH0337354B2 (da)
EP3501018B1 (de) Präsenzdetektor unbewegter objekte
EP2235948B1 (de) Überwachungsmodul für ein videoüberwachungssystem, verfahren zur zustandsüberwachung eines überwachungsbereichs sowie computerprogramm
WO2020048666A1 (de) Überwachungsvorrichtung und verfahren zur mann-über-bord-überwachung
EP1071931B1 (de) Sensorvorrichtung und verfahren zum betreiben einer sensorvorrichtung
EP2462534B1 (de) Verfahren zum überwachen eines bereichs
EP1376502A1 (de) Objektschutz-Einrichtung
EP1079350B1 (de) Einrichtung zur Raumüberwachung
EP1079351B1 (de) Einrichtung zur Raumüberwachung
DE102023003008A1 (de) Ein Verfahren zur Fahrzeug-Brandüberwachung und ein Fahrzeugbrandüberwachungssystem
EP2642315B1 (de) Erkennung von Signalstörungen eines optischen Sensors hervorgerufen durch Beschädigungen oder Verdeckungen
DE102019114451A1 (de) Aktivitätsbereiche in Videoinhalten
EP0939386A1 (de) Einrichtung zur Raumüberwachung
DE102009043080B4 (de) Verfahren zur Detektion von Rauch und/oder Flammen und Detektionssystem
EP1865755A2 (de) Vorrichtung zur Beleuchtungssteuerung
DE60204855T2 (de) Verfahren und einrichtung zur erkennung von fasern auf der grundlage von bildanalyse
DE102014208386A1 (de) Verfahren und Vorrichtung zum Überwachen eines immobilen Raumbereichs

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

17P Request for examination filed

Effective date: 20010814

AKX Designation fees paid

Free format text: AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20030917

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20030917

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20030917

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

GBT Gb: translation of ep patent filed (gb section 77(6)(a)/1977)
REF Corresponds to:

Ref document number: 59907024

Country of ref document: DE

Date of ref document: 20031023

Kind code of ref document: P

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: GERMAN

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20031217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20031226

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

REG Reference to a national code

Ref country code: IE

Ref legal event code: FD4D

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2209291

Country of ref document: ES

Kind code of ref document: T3

ET Fr: translation filed
PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20040717

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20040731

26N No opposition filed

Effective date: 20040618

REG Reference to a national code

Ref country code: CH

Ref legal event code: PFA

Owner name: SIEMENS BUILDING TECHNOLOGIES AG C-IPR

Free format text: SIEMENS BUILDING TECHNOLOGIES AG#BELLERIVESTRASSE 36#8034 ZUERICH (CH) -TRANSFER TO- SIEMENS BUILDING TECHNOLOGIES AG C-IPR#GUBELSTRASSE 22#6300 ZUG (CH)

REG Reference to a national code

Ref country code: FR

Ref legal event code: TP

Ref country code: FR

Ref legal event code: CD

REG Reference to a national code

Ref country code: CH

Ref legal event code: PUE

Owner name: SIEMENS AKTIENGESELLSCHAFT

Free format text: SIEMENS BUILDING TECHNOLOGIES AG C-IPR#GUBELSTRASSE 22#6300 ZUG (CH) -TRANSFER TO- SIEMENS AKTIENGESELLSCHAFT#WITTELSBACHERPLATZ 2#80333 MUENCHEN (DE)

Ref country code: CH

Ref legal event code: NV

Representative=s name: SIEMENS SCHWEIZ AG, INTELLECTUAL PROPERTY

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20090514 AND 20090520

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20090709

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: AT

Payment date: 20090605

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: BE

Payment date: 20090731

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20090728

Year of fee payment: 11

BERE Be: lapsed

Owner name: *SIEMENS BUILDING TECHNOLOGIES A.G.

Effective date: 20100731

REG Reference to a national code

Ref country code: NL

Ref legal event code: SD

Effective date: 20110318

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100717

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100717

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100731

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100802

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 18

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 19

REG Reference to a national code

Ref country code: CH

Ref legal event code: PCOW

Free format text: NEW ADDRESS: WERNER-VON-SIEMENS-STRASSE 1, 80333 MUENCHEN (DE)

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20180711

Year of fee payment: 20

Ref country code: DE

Payment date: 20180920

Year of fee payment: 20

Ref country code: FR

Payment date: 20180726

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20180711

Year of fee payment: 20

Ref country code: SE

Payment date: 20180704

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20181024

Year of fee payment: 20

Ref country code: CH

Payment date: 20181005

Year of fee payment: 20

REG Reference to a national code

Ref country code: DE

Ref legal event code: R071

Ref document number: 59907024

Country of ref document: DE

Ref country code: NL

Ref legal event code: MK

Effective date: 20190716

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: GB

Ref legal event code: PE20

Expiry date: 20190716

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20190716

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20200721

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20190718