EP0939387B1 - Room supervision device - Google Patents
Room supervision device Download PDFInfo
- Publication number
- EP0939387B1 EP0939387B1 EP99103260A EP99103260A EP0939387B1 EP 0939387 B1 EP0939387 B1 EP 0939387B1 EP 99103260 A EP99103260 A EP 99103260A EP 99103260 A EP99103260 A EP 99103260A EP 0939387 B1 EP0939387 B1 EP 0939387B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image sensor
- signal
- movement detector
- detector
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
- G08B13/19604—Image analysis to detect motion of the intruder, e.g. by frame subtraction involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19697—Arrangements wherein non-video detectors generate an alarm themselves
Definitions
- the present invention relates to a device for room surveillance, with at least an image sensor and at least one presence or motion detector and with one Control and evaluation electronics to which the at least one image sensor and the at least one presence or motion detector are connected.
- the presence or Motion detector exclusively to reduce the power consumption of the preferred battery powered device by turning on the image sensor when needed. something similar applies to the video surveillance system described in GB-A-2 309 133, whose image sensor connected to a VCR.
- the presence or motion detector enables better utilization of the magnetic tape used for image storage, by turning on the VCR only when needed.
- DE-U-297 18 312 which has an image sensor, a stage for Still image creation and still image storage, a stage for creating difference images and one Contains the stage for image analysis, the analysis result is based on predefined criteria of reportability compared, and if the result is positive, a message is sent to a central station. While this facility allows for intelligent surveillance by checking the signals of the image sensor for tolerance and reporting reliability are carried out automatically, so that a message is only sent to the head office if a positive analysis result is available.
- the invention is now to provide a device of the type mentioned at the outset, which is intelligent surveillance, optimal security against deception and sufficient Robustness guaranteed.
- control and evaluation electronics has a processing stage for local signal evaluation, in which a Combined evaluation of the signals of the at least one image sensor and the at least one A presence or motion detector is used to determine the mean lighting of the monitored room and that in the combined evaluation of the Signals the weighting of the signal of the at least one presence or motion detector (6) depends on the average lighting and with decreasing average lighting increases.
- the device according to the invention is therefore a two- or multi-criteria motion detector at least one image sensor.
- This detector points towards both known dual detectors as well as significant advantages over pure image sensors. Compared to the dual detectors, where no or only a very rough spatial resolution is possible, so that A distinction between humans and animals can often not be made, is the inventive Detectors much more robust.
- the image sensor also offers the option of Classification of objects based on their geometry and movement and thus the intelligent Monitoring and verification and storage of events and later Accessibility from these.
- the detector according to the invention has the advantage that it even in poor lighting conditions the performance of a presence or Provides motion detector and is therefore fully functional.
- the presence or Motion detector the image processing algorithms when interpreting difficult situations support.
- a first preferred embodiment of the device according to the invention is characterized in that that prior to the combined evaluation of the signals, a separate pre-evaluation both the signals of the at least one image sensor and that of the at least one a presence or motion detector.
- a second preferred embodiment of the device according to the invention is thereby characterized in that the at least one image sensor by a CMOS image sensor, preferably an active pixel sensor is formed.
- the formation of the at least one image sensor as a CMOS image sensor has, among other things the advantage of an order of magnitude lower power consumption than CCD cameras and the ability to access individual pixels. The latter allows pictures with reduced resolution or only read out interesting areas of the image, whereas with CCD cameras the pixels only can be read out line by line.
- a third preferred embodiment of the device according to the invention is thereby characterized in that a means of determining the distance of one of the at least a presence or motion detector detected object and that the Distance signal of this means is fed to the processing stage.
- the device for room monitoring shown in Fig. 1 consists essentially of a multi-criteria motion detector 1, hereinafter referred to as a detector, and one hereinafter referred to as electronics control and evaluation electronics 2 with a control stage 3 and a processing stage 4 for the local evaluation of the signals of the detector 1.
- a detector a multi-criteria motion detector 1
- electronics control and evaluation electronics 2 with a control stage 3 and a processing stage 4 for the local evaluation of the signals of the detector 1.
- this representation only shows the individual function blocks and not the specific ones apparatus construction of the facility again. For example, certain are usually Parts of the electronics are present in detector 1. The latter applies in particular if the detector signals are processed or pre-evaluated in detector 1.
- the detector 1 consists of at least one image sensor 5 and at least one following Presence or motion detector 6 referred to as P / B detector.
- the image sensor 5 is included a means for measuring the lighting in the monitored room. Both that Image sensor 5 and the P / B detector 6 are each followed by a preprocessing stage 7 or 8, but also included in detector 1 or, if applicable, in processing level 4 can be.
- the signals reach the processing stage from the preprocessing stage 7 and 8 4, which also the illumination signal of the means for illumination measurement contained in the image sensor 5 is fed.
- the detector 1 can have a distance meter 9 for determining the distance from the P / B detector 6 events included.
- Processing level 4 is autonomous and enables local decisions and / or the display of those recorded by the image sensor 5 Pictures; it is preferably also for transferring the images to a distant one Central 10 equipped, where, for example, additional verification can then take place.
- the P / B detector 6 is a motion or presence detector based on one of the known detection principles Passive infrared, active infrared, microwaves, ultrasound or any Combination of them.
- CMOS image sensor a so-called APS [APS: active pixel Sensor] used, which is characterized by a very low power consumption and by the possibility of access to individual pixels.
- APS active pixel Sensor
- additional application-specific analog or digital functions for example simple Image processing algorithms such as filters or exposure control can be easily integrated.
- APS the article "A 128 x 128 CMOS Active Pixel Image Sensor for Highly Integrated Imaging Systems "by Sunetra K. Mendis, Sabrina E. Kennedy and Eric R. Fossum, IEDM 93-538 and "128X128 CMOS Photodiode-Type Active Pixel Sensor With On-Chip Timing, Control and Signal Chain Electronics "by R.H. Nixon, S.E. Kemeny, C.O. Staller and E. R. Fossum in SPIE Vol. 2415/117.
- the image sensor 5 is directed towards the space to be monitored, detects it in terms of image technology, digitizes the image and stores it as a reference image in a memory. If the image sensor 5 forming APS consists of 128 by 128 pixels, for example, would then be used a wide-angle lens at a distance of 15 m in front of the image sensor 5 one pixel of approximately 12 by 12 cm. Such a grid is suitable, human and distinguish animal shapes relatively reliably from each other.
- the image sensor 5 makes intervals a picture of the monitored room from fractions of a second is saved Images for a certain time and compare them with the reference image and / or with each other.
- the storage of the images is preferably controlled in such a way that the images sent by the detector 1 immediately preceding and / or immediately following the detected event until saved further and that the remaining images automatically after the specified time to be deleted.
- the image sensor 5 is sensitive to light and has a large dynamic range (sufficient recognizability of details with strong light / dark contrast) optimized.
- the functions integrated on the APS chip allow an automatic electronic Integrate closure with a dynamic of 1: 1000.
- the P / B detector 6 essentially serves to detect the potential weaknesses of the image sensor 5 compensate. This includes in particular that the image sensor 5 is below a critical one Illumination provides no image information, and that also a strong change in the image information is often not caused by an intruder compared to the reference image. you think, for example, of abrupt changes in lighting that by switching the street lighting on / off, passing vehicles with the lights on Headlights, thunderstorms or the like can be caused. In these and the like In cases where the signal from the P / B detector 6 is taken into account, the robustness of the Detector 1 increased significantly. This is taken into account by a combined evaluation the signals of the image sensor 5 and the P / B detector 6 in the processing stage 4 realized.
- the signals from the image sensor 5 and the PIB detector 6 to subject the combined evaluation to a separate preliminary evaluation, which in preprocessing stages 7 and 8.
- the preprocessing stages 7 and 8 in the respective sensor / detector 5 or 6 or in the processing stage 4 be integrated.
- the signals from the P / B detector 6 in converted a format suitable for combined evaluation with the signal of the image sensor 5 and classified according to their strength. If the detector 1 contains a distance meter 9, then this becomes corresponding in the presence of a signal from the P / B detector 6 Starch from processing level 4 activated via control level 3 and delivers to the processing level information about the distance of the event just detected or Object from detector 1. With the help of this distance information, the signal from the image sensor can be used 5 clear conclusions on the size of a detected object and thus on its size Nature, such as humans or animals.
- the pre-evaluation is in the form of hardware and / or in the form of a processor core integrated on the APS chip.
- the number of compared the modified image of the reference image, its clustering and characteristics of the pixel cluster certainly.
- the reference image is constantly updated, whereby Changes are only adopted in the reference image after checking their stability.
- the reference image tracking can be done by including the signals of the P / B detector 6 run more stable.
- processing stage 4 At the input of processing stage 4 there is a signal of the P / B classified according to strength Detector 6, an image signal of the image sensor 5 with information about the number of changes Pixels and the characteristics of the pixel clusters and possibly a signal from the distance meter 9, the distance of the event triggering the signal of the P / B detector 6 indicates.
- the processing stage 4 continuously receives information about the image sensor 5 medium lighting in the monitored room and weighted in the combined evaluation the signals the signals of the lighting-independent P / B detector 6 the weaker the more the lighting is.
- the combined evaluation of the signals gives a decision at the output of processing stage 4 Alarm or non-alarm, this decision essentially the image content, the overall lighting, the information from the P / B detector 6 and the change and / or history of these parameters, hereinafter referred to as global criteria, are taken into account.
- Plausibility links are very helpful here: if, for example, lighting and change the image content quickly and strongly, but the signal of the P / B detector 6 is weak, then no alarm is given, but the stability of the new image is checked and in it searched for movements. If the P / B detector 6 reports no movement and only If there was a change in lighting and / or image, it was almost certain to become one Illumination switched on or off so that there is no alarm. Whether it's actually a change of lighting has taken place, can easily be checked based on the stability of the new image become.
- the detailed analysis is carried out both statically and dynamically.
- the cluster areas examined for size, topology and orientation, in the second case regarding the change in size, shape and position of the cluster areas.
- an attempt is made to move or move from the fixed reference image Filter out objects and then assign them a clear, alarm-relevant category.
- the difference between humans and animals is the height / aspect ratio of the frequency range in question, the vertical and the horizontal predominates in animals. From the front there is a distinction between people and Animal very difficult; but you can assume that the detected object is not frontal moved towards the detector 1 but sidesteps and is therefore easier to see.
- FIG. 2 shows a simple example of signal processing in a device for room monitoring without distance meter 9 (Fig. 1).
- the representation assumed that the preprocessing stages 7 and 8 in the processing stage 4 (FIG. 1) are integrated, so that the preprocessing of the signals of the image sensor 5 and the P / B detector 6 not locally in the relevant sensor or detector, but instead takes place in processing stage 4.
- the number of pixels changed compared to the reference image is determined. If this number is zero or very small, then the signal of the P / B detector 6 is compared with a threshold value P 2 with P 2 > P 1 . If the signal of the P / B detector 6 is greater than P 2 , an alarm is triggered, if not, then the processing of the relevant sensor signal is terminated.
- the signals can possibly also be analyzed over a longer time interval.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Closed-Circuit Television Systems (AREA)
- Alarm Systems (AREA)
- Image Processing (AREA)
- Image Analysis (AREA)
Description
Die vorliegende Erfindung betrifft eine Einrichtung zur Raumüberwachung, mit mindestens einem Bildsensor und mindestens einem Präsenz- oder Bewegungsdetektor und mit einer Steuerungs- und Auswerteelektronik, an welche der mindestens eine Bildsensor und der mindestens eine Präsenz- oder Bewegungsdetektor angeschlossen sind.The present invention relates to a device for room surveillance, with at least an image sensor and at least one presence or motion detector and with one Control and evaluation electronics to which the at least one image sensor and the at least one presence or motion detector are connected.
Bei einer in der EP-A-0 772 168 beschriebenen Einrichtung dieser Art dient der Präsenz- oder Bewegungsdetektor ausschliesslich zur Reduktion des Stromverbrauchs der vorzugsweise batteriegespeisten Einrichtung, indem er den Bildsensor im Bedarfsfall einschaltet. Ähnliches gilt für das in der GB-A-2 309 133 beschriebene Video-Überwachungssystem, dessen Bildsensor an einen Videorecorder angeschlossen ist. Hier ermöglicht der Präsenz- oder Bewegungsdetektor eine bessere Ausnutzung des zur Bildspeicherung verwendeten Magnetbandes, indem er den Videorecorder nur im Bedarfsfall einschaltet.In a device of this type described in EP-A-0 772 168, the presence or Motion detector exclusively to reduce the power consumption of the preferred battery powered device by turning on the image sensor when needed. something similar applies to the video surveillance system described in GB-A-2 309 133, whose image sensor connected to a VCR. Here the presence or motion detector enables better utilization of the magnetic tape used for image storage, by turning on the VCR only when needed.
Diese bekannten Einrichtungen stellen also gespeicherte Bildinformation zur Verfügung, die von einer Bedienungsperson ausgewertet werden muss, was bekanntlich ausserordentlich monoton und ermüdend ist. Da keinerlei Unterscheidung der aufgezeichneten Ereignisse nach Tolerierbarkeit und Meldewürdigkeit stattfindet, kann von intelligenter Überwachung nicht gesprochen werden.These known devices therefore provide stored image information that must be evaluated by an operator, which is known to be extraordinary is monotonous and tiring. Since there is no distinction between the recorded events Tolerability and reportability takes place, can not speak of intelligent surveillance become.
Bei einer im DE-U-297 18 312 beschriebenen Einrichtung, die einen Bildsensor, eine Stufe zur Festbilderstellung und Festbildabspeicherung, eine Stufe zur Differenzbilderstellung und eine Stufe zur Bildanalyse enthält, wird das Analyseergebnis mit vorgegebenen Kriterien der Meldewürdigkeit verglichen, wobei bei positivem Ergebnis eine Meldung an eine Zentralstation erfolgt. Diese Einrichtung ermöglicht zwar eine intelligente Überwachung, indem die Überprüfung der Signale des Bildsensors auf Tolerierbarkeit und Meldewürdigkeit automatisch erfolgt, so dass nur dann eine Meldung an die Zentrale geht, wenn ein positives Analyseergebnis vorliegt.In a device described in DE-U-297 18 312, which has an image sensor, a stage for Still image creation and still image storage, a stage for creating difference images and one Contains the stage for image analysis, the analysis result is based on predefined criteria of reportability compared, and if the result is positive, a message is sent to a central station. While this facility allows for intelligent surveillance by checking the signals of the image sensor for tolerance and reporting reliability are carried out automatically, so that a message is only sent to the head office if a positive analysis result is available.
Da aber der Bildsensor auf Beleuchtung im Sichtbaren oder im nahen Infrarot angewiesen ist und daher unterhalb einer bestimmten Minimalbeleuchtung keine auswertbaren Bilder liefern kann, ist es fraglich, ob diese Einrichtung die gewünschte Sicherheit bietet oder, mit anderen Worten, ob sie ausreichend robust ist.But since the image sensor relies on lighting in the visible or in the near infrared and therefore provide no evaluable images below a certain minimum lighting , it is questionable whether this facility offers the desired security or, with others Words whether it is sufficiently robust.
Durch die Erfindung soll nun eine Einrichtung der eingangs genannten Art angegeben werden, die eine intelligente Überwachung, eine optimale Täuschungssicherheit und eine ausreichende Robustheit gewährleistet.The invention is now to provide a device of the type mentioned at the outset, which is intelligent surveillance, optimal security against deception and sufficient Robustness guaranteed.
Diese Aufgabe wird erfindungsgemäss dadurch gelöst, dass die Steuerungs- und Auswerteelektronik eine Verarbeitungsstufe zur lokalen Signalauswertung aufweist, bei welcher eine kombinierte Auswertung der Signale des mindestens einen Bildsensors und des mindestens einen Präsenz- oder Bewegungsdetektors erfolgt, dass eine Bestimmung der mittleren Beleuchtung des überwachten Raumes erfolgt, und dass bei der kombinierten Auswertung der Signale die Gewichtung des Signals des mindestens einen Präsenz- oder Bewegungsdetektors (6) von der mittleren Beleuchtung abhängig ist und mit abnehmender mittlerer Beleuchtung zunimmt.According to the invention, this object is achieved in that the control and evaluation electronics has a processing stage for local signal evaluation, in which a Combined evaluation of the signals of the at least one image sensor and the at least one A presence or motion detector is used to determine the mean lighting of the monitored room and that in the combined evaluation of the Signals the weighting of the signal of the at least one presence or motion detector (6) depends on the average lighting and with decreasing average lighting increases.
Die erfindungsgemässe Einrichtung ist also ein Zwei- oder Mehrkriterienbewegungsmelder mit mindestens einem Bildsensor. Dieser Melder weist sowohl gegenüber bekannten Dual-Meldern als auch gegenüber reinen Bildsensoren wesentliche Vorteile auf. Verglichen mit den Dual-Meldem, bei denen keine oder nur eine sehr grobe räumliche Auflösung möglich ist, so dass eine Unterscheidung zwischen Mensch und Tier oftmals nicht erfolgen kann, ist der erfindungsgemässe Melder wesentlich robuster. Ausserdem bietet der Bildsensor die Möglichkeit der Klassifizierung der Objekte anhand ihrer Geometrie und Bewegung und damit der intelligenten Überwachung sowie der Verifikation und der Speicherung von Ereignissen und der späteren Abrufbarkeit von diesen.The device according to the invention is therefore a two- or multi-criteria motion detector at least one image sensor. This detector points towards both known dual detectors as well as significant advantages over pure image sensors. Compared to the dual detectors, where no or only a very rough spatial resolution is possible, so that A distinction between humans and animals can often not be made, is the inventive Detectors much more robust. The image sensor also offers the option of Classification of objects based on their geometry and movement and thus the intelligent Monitoring and verification and storage of events and later Accessibility from these.
Gegenüber einem reinen Bildsensor hat der erfindungsgemässe Melder den Vorteil, dass er auch bei schlechten Beleuchtungsverhältnissen immer noch die Leistung eines Präsenz- oder Bewegungsdetektors erbringt und damit voll funktionsfähig ist. Zudem kann der Präsenz- oder Bewegungsdetektor die Bildverarbeitungsalgorithmen bei der Interpretation schwieriger Situationen unterstützen.Compared to a pure image sensor, the detector according to the invention has the advantage that it even in poor lighting conditions the performance of a presence or Provides motion detector and is therefore fully functional. In addition, the presence or Motion detector the image processing algorithms when interpreting difficult situations support.
Eine erste bevorzugte Ausführungsform der erfindungsgemässen Einrichtung ist dadurch gekennzeichnet, dass vor der kombinierten Auswertung der Signale eine getrennte Vorauswertung sowohl der Signale des mindestens einen Bildsensors als auch derjenigen des mindestens einen Präsenz- oder Bewegungsdetektors erfolgt.A first preferred embodiment of the device according to the invention is characterized in that that prior to the combined evaluation of the signals, a separate pre-evaluation both the signals of the at least one image sensor and that of the at least one a presence or motion detector.
Eine zweite bevorzugte Ausführungsform der erfindungsgemässen Einrichtung ist dadurch gekennzeichnet, dass der mindestens eine Bildsensor durch einen CMOS-Bildsensor, vorzugsweise einen Aktiv Pixel Sensor, gebildet ist.A second preferred embodiment of the device according to the invention is thereby characterized in that the at least one image sensor by a CMOS image sensor, preferably an active pixel sensor is formed.
Die Ausbildung des mindestens einen Bildsensors als CMOS-Bildsensor hat unter anderem den Vorteil eines gegenüber CCD-Kameras um Grössenordnungen tieferen Stromverbrauchs und der Zugriffsmöglichkeit auf einzelne Pixel. Letzteres erlaubt, Bilder mit reduzierter Auflösung oder nur interessante Bildbereiche auszulesen, wogegen bei CCD-Kameras die Pixel nur zeilenweise ausgelesen werden können.The formation of the at least one image sensor as a CMOS image sensor has, among other things the advantage of an order of magnitude lower power consumption than CCD cameras and the ability to access individual pixels. The latter allows pictures with reduced resolution or only read out interesting areas of the image, whereas with CCD cameras the pixels only can be read out line by line.
Eine dritte bevorzugte Ausführungsform der erfindungsgemässen Einrichtung ist dadurch gekennzeichnet, dass ein Mittel zur Bestimmung der Entfernung eines von dem mindestens einen Präsenz- oder Bewegungsdetektor detektierten Objekts vorgesehen und dass das Distanzsignal dieses Mittels der Verarbeitungsstufe zugeführt ist.A third preferred embodiment of the device according to the invention is thereby characterized in that a means of determining the distance of one of the at least a presence or motion detector detected object and that the Distance signal of this means is fed to the processing stage.
Im folgenden wird die Erfindung anhand eines Ausführungsbeispiels und der Zeichnungen näher erläutert; es zeigt:
- Fig. 1
- ein Blockschema eines erfindungsgemässen Einrichtung zur Raumüberwachung; und
- Fig. 2
- ein Flussdiagramm zur Erläuterung der Signalverarbeitung.
- Fig. 1
- a block diagram of an inventive device for room monitoring; and
- Fig. 2
- a flowchart to explain the signal processing.
Die in Fig. 1 dargestellte Einrichtung zur Raumüberwachung besteht im wesentlichen aus
einem nachfolgend als Melder bezeichneten Mehrkriterienbewegungsmelder 1 und aus einer
nachfolgend als Elektronik bezeichneten Steuerungs- und Auswerteelektronik 2 mit einer Steuerstufe
3 und einer Verarbeitungsstufe 4 zur lokalen Auswertung der Signale des Melders 1.
Selbstverständlich gibt diese Darstellung nur die einzelnen Funktionsblöcke und nicht den konkreten
apparativen Aufbau der Einrichtung wieder. So werden beispielsweise in der Regel bestimmte
Teile der Elektronik im Melder 1 vorhanden sein. Letzteres gilt insbesondere dann,
wenn im Melder 1 eine Aufbereitung oder Vorauswertung der Meldersignale erfolgt.The device for room monitoring shown in Fig. 1 consists essentially of
a multi-criteria motion detector 1, hereinafter referred to as a detector, and one
hereinafter referred to as electronics control and
Der Melder 1 besteht aus mindestens einem Bildsensor 5 und mindestens einem nachfolgend
als P/B Dedektor bezeichneten Präsenz- oder Bewegungsdetektor 6. Der Bildsensor 5 ist mit
einem Mittel zur Messung der Beleuchtung im überwachten Raum ausgerüstet. Sowohl dem
Bildsensor 5 als auch dem P/B Detektor 6 ist je eine Vorverarbeitungsstufe 7 bzw. 8 nachgeschaltet,
die aber auch im Melder 1 oder gegebenenfalls in der Verarbeitungsstufe 4 enthalten
sein kann. Von der Vorverarbeitungsstufe 7 und 8 gelangen die Signale in die Verarbeitungsstufe
4, welcher auch das Beleuchtungssignal der im Bildsensor 5 enthaltenen Mittel zur Beleuchtungsmessung
zugeführt ist.The detector 1 consists of at least one image sensor 5 and at least one following
Presence or
Als Option kann der Melder 1 einen Distanzmesser 9 zur Bestimmung der Entfernung der vom
P/B Detektor 6 registrierten Ereignisse enthalten. Die Verarbeitungsstufe 4 ist autonom und
ermöglicht lokale Entscheidungen und/oder die Anzeige der vom Bildsensor 5 aufgenommenen
Bilder; vorzugsweise ist sie auch zur Übertragung der Bilder an eine räumlich entfernte
Zentrale 10 ausgerüstet, wo dann beispielsweise eine zusätzliche Verifikation erfolgen kann.As an option, the detector 1 can have a
Der P/B Detektor 6 ist ein Bewegungs- oder Präsenzmelder nach einem der bekannten Detektionsprinzipien
Passiv-Infrarot, Aktiv-Infrarot, Mikrowellen, Ultraschall oder einer beliebigen
Kombination davon. Der Bildsensor 5 ist im Bereich des sichtbaren Lichts, im nahen Infrarot
oder im langwelligen Infrarot (Wärmestrahlung) empfindlich; er kann auf einem üblichen bildgebenden
Verfahren (CCD [CCD: charge-coupled device], CID [CID: charge injection device]
oder CMOS [CMOS: complementary metal oxide semiconductor = komplementäre Metall-Oxid-Halbleiter-Struktur])
basieren. The P /
Vorzugsweise wird ein spezieller CMOS-Bildsensor, ein sogenannter APS [APS: Aktiv Pixel Sensor] verwendet, der sich durch einen sehr geringen Stromverbrauch und durch die Möglichkeit des Zugriffs auf einzelne Pixel auszeichnet. Ausserdem können in einem solchen APS zusätzliche applikationsspezifische analoge oder digitale Funktionen, zum Beispiel einfache Bildverarbeitungsalgorithmen wie Filter oder Belichtungssteuerung, einfach integriert werden. Bezüglich APS wird auf die Artikel "A 128 x- 128 CMOS Active Pixel Image Sensor for Highly Integrated Imaging Systems" von Sunetra K. Mendis, Sabrina E. Kennedy und Eric R. Fossum, IEDM 93-538 und "128X128 CMOS Photodiode-Type Active Pixel Sensor With On-Chip Timing, Control and Signal Chain Electronics" von R. H. Nixon, S. E. Kemeny, C. O. Staller und E. R. Fossum in SPIE Vol. 2415 / 117, verwiesen.Preferably, a special CMOS image sensor, a so-called APS [APS: active pixel Sensor] used, which is characterized by a very low power consumption and by the possibility of access to individual pixels. In addition, in such APS additional application-specific analog or digital functions, for example simple Image processing algorithms such as filters or exposure control can be easily integrated. Regarding APS, the article "A 128 x 128 CMOS Active Pixel Image Sensor for Highly Integrated Imaging Systems "by Sunetra K. Mendis, Sabrina E. Kennedy and Eric R. Fossum, IEDM 93-538 and "128X128 CMOS Photodiode-Type Active Pixel Sensor With On-Chip Timing, Control and Signal Chain Electronics "by R.H. Nixon, S.E. Kemeny, C.O. Staller and E. R. Fossum in SPIE Vol. 2415/117.
Der Bildsensor 5 ist auf den zu überwachenden Raum gerichtet, erfasst diesen bildtechnisch, digitalisiert das Bild und legt es als Referenzbild in einem Speicher ab. Wenn der den Bildsensor 5 bildende APS beispielsweise aus 128 mal 128 Pixeln besteht, dann würde bei Verwendung einer Weitwinkeloptik im Abstand von 15 m vor dem Bildsensor 5 einem Pixel eine Fläche von ungefähr 12 mal 12 cm entsprechen. Eine solche Rasterung ist geeignet, menschliche und tierische Gestalten relativ zuverlässig voneinander zu unterscheiden.The image sensor 5 is directed towards the space to be monitored, detects it in terms of image technology, digitizes the image and stores it as a reference image in a memory. If the the image sensor 5 forming APS consists of 128 by 128 pixels, for example, would then be used a wide-angle lens at a distance of 15 m in front of the image sensor 5 one pixel of approximately 12 by 12 cm. Such a grid is suitable, human and distinguish animal shapes relatively reliably from each other.
Die Möglichkeit der Erkennung eines Menschen im Abstand von 15 m ist sehr vorteilhaft, und die Fläche des überwachten Raums in diesem Erkennungsabstand von etwa 15 mal 15 m ist durchaus realistisch. Im aktiven Zustand der Einrichtung macht dann der Bildsensor 5 in Abständen von Sekundenbruchteilen jeweils ein Bild des überwachten Raums, speichert diese Bilder für eine bestimmte Zeit und vergleicht sie mit dem Referenzbild und/oder untereinander. Die Speicherung der Bilder ist vorzugsweise so gesteuert, dass die Bilder, die einem vom Melder 1 festgestellten Ereignis unmittelbar vorausgehen und/oder diesem unmittelbar folgen, bis auf weiteres gespeichert und dass die restlichen Bilder nach Ablauf der genannten Zeit automatisch gelöscht werden.The possibility of recognizing a person at a distance of 15 m is very advantageous, and the area of the monitored room at this detection distance of about 15 by 15 m quite realistic. In the active state of the device, the image sensor 5 then makes intervals a picture of the monitored room from fractions of a second is saved Images for a certain time and compare them with the reference image and / or with each other. The storage of the images is preferably controlled in such a way that the images sent by the detector 1 immediately preceding and / or immediately following the detected event until saved further and that the remaining images automatically after the specified time to be deleted.
Um auch bei schlechten Beleuchtungsverhältnissen noch ein brauchbares Bild machen zu können, ist der Bildsensor 5 auf grosse Lichtempfindlichkeit und einen grossen Dynamikbereich (ausreichende Erkennbarkeit von Einzelheiten bei starkem Hell/ Dunkel-Kontrast) optimiert. Die auf dem APS-Chip integrierten Funktionen erlauben es, einen automatischen elektronischen Verschluss mit einer Dynamik von 1:1000 mitzuintegrieren.To still make a usable picture even in poor lighting conditions , the image sensor 5 is sensitive to light and has a large dynamic range (sufficient recognizability of details with strong light / dark contrast) optimized. The functions integrated on the APS chip allow an automatic electronic Integrate closure with a dynamic of 1: 1000.
Der P/B Detektor 6 dient im wesentlichen dazu, die potentiellen Schwächen des Bildsensors 5
auszugleichen. Dazu gehört insbesondere, dass der Bildsensor 5 unterhalb einer kritischen
Beleuchtung keine Bildinformation liefert, und dass auch eine starke Änderung der Bildinformation
gegenüber dem Referenzbild oftmals nicht von einem Eindringling verursacht ist. Man
denke in diesem Zusammenhang beispielsweise an abrupte Beleuchtungsänderungen, die
durch Ein/Ausschalten der Strassenbeleuchtung, vorbeifahrende Fahrzeuge mit aufgeblendeten
Scheinwerfern, Gewitter oder dergleichen verursacht sein können. In diesen und ähnlichen
Fällen wird durch Mitberücksichtigung des Signals des P/B Detektors 6 die Robustheit des
Melders 1 ganz wesentlich erhöht. Diese Mitberücksichtigung wird durch eine kombinierte Auswertung
der Signale des Bildsensors 5 und des P/B Detektors 6 in der Verarbeitungsstufe 4
realisiert.The P /
Es hat sich gezeigt, dass es vorteilhaft ist, die Signale des Bildsensors 5 und des PIB Detektors
6 vor der kombinierten Auswertung einer getrennten Vorauswertung zu unterziehen, welche
in den Vorverarbeitungsstufen 7 bzw. 8 erfolgt. Wie schon erwähnt wurde, können die Vorverarbeitungsstufen
7 und 8 in den jeweiligen Sensor/Detektor 5 bzw. 6 oder in die Verarbeitungsstufe
4 integriert sein. Bei der Vorauswertung werden die Signale des P/B Detektors 6 in
ein zur kombinierten Auswertung mit dem Signal des Bildsensors 5 geeignetes Format umgewandelt
und nach ihrer Stärke klassiert. Falls der Melder 1 einen Distanzmesser 9 enthält,
dann wird dieser bei Vorhandensein eines Signals des P/B Detektors 6 von entsprechender
Stärke von der Verarbeitungsstufe 4 über die Steuerstufe 3 aktiviert und liefert an die Verarbeitungsstufe
eine Information über die Entfernung des soeben detektierten Ereignisses oder
Objekts vom Melder 1. Mit Hilfe dieser Distanzinformation können aus dem Signal des Bildsensors
5 eindeutige Schlüsse auf die Grösse eines detektierten Objekts und damit auf dessen
Natur, wie beispielsweise Mensch oder Tier, gezogen werden.It has been shown that it is advantageous to use the signals from the image sensor 5 and the
Beim Bildsensor 5 ist die Vorauswertung als Hardware und/oder in Form eines Prozessorkerns
auf dem APS-Chip integriert. Bei der Vorauswertung der Signale werden die Anzahl der gegenüber
dem Referenzbild geänderten Pixel, ihre Häufung (clustering) und Merkmale der Pixelhäufung
bestimmt. Dabei wird das Referenzbild ständig nachgeführt, wobei festgestellte
Änderungen erst nach Überprüfung ihrer Stabilität in das Referenzbild übernommen werden.
Die Referenzbildnachführung kann dabei durch Einbezug der Signale des P/B Detektors 6
stabiler ausgeführt werden.In the case of the image sensor 5, the pre-evaluation is in the form of hardware and / or in the form of a processor core
integrated on the APS chip. When pre-evaluating the signals, the number of compared
the modified image of the reference image, its clustering and characteristics of the pixel cluster
certainly. The reference image is constantly updated, whereby
Changes are only adopted in the reference image after checking their stability.
The reference image tracking can be done by including the signals of the P /
Am Eingang der Verarbeitungsstufe 4 liegt also ein nach Stärke klassiertes Signal des P/B
Detektors 6, ein Bildsignal des Bildsensors 5 mit Informationen über die Anzahl der geänderten
Pixel und über die Merkmale der Pixelhäufungen und gegebenenfalls ein Signal des Distanzmessers
9, das die Entfernung des das Signal des P/B Detektors 6 auslösenden Ereignisses
angibt. Ausserdem erhält die Verarbeitungsstufe 4 vom Bildsensor 5 laufend Angaben über die
mittlere Beleuchtung im überwachten Raum und gewichtet bei der kombinierten Auswertung
der Signale die Signale des beleuchtungsunabhängigen P/B Detektors 6 umso mehr je schwächer
die Beleuchtung ist. At the input of processing stage 4 there is a signal of the P / B classified according to
Die kombinierte Auswertung der Signale ergibt am Ausgang der Verarbeitungsstufe 4 eine Entscheidung
Alarm oder Nicht-Alarm, wobei diese Entscheidung im wesentlichen den Bildinhalt,
die Gesamtbeleuchtung, die Information vom P/B Detektor 6 und die Änderung und/oder Vorgeschichte
dieser nachfolgend als globale Kriterien bezeichneten Parameter berücksichtigt.
Dabei sind Plausibilitätsverknüpfungen sehr hilfreich: Wenn sich beispielsweise Beleuchtung
und Bildinhalt rasch und stark ändern, das Signal des P/B Detektors 6 aber schwach ist, dann
wird kein Alarm gegeben, sondern es wird die Stabilität des neuen Bildes geprüft und in diesem
nach Bewegungen gesucht. Wenn der P/B Detektor 6 keine Bewegung meldet und nur
eine Beleuchtungs- und/oder Bildänderung stattgefunden hat, dann wurde ziemlich sicher eine
Beleuchtung ein- oder ausgeschaltet, so dass kein Alarmfall vorliegt. Ob tatsächlich ein Beleuchtungswechsel
stattgefunden hat, kann anhand der Stabilität des neuen Bildes leicht überprüft
werden.The combined evaluation of the signals gives a decision at the output of processing stage 4
Alarm or non-alarm, this decision essentially the image content,
the overall lighting, the information from the P /
Die Bildänderungen können in drei Kategorien eingeteilt werden:
- Geringe Anzahl geänderter Pixel absolut oder pro Häufungsbereich: Unterkritische Änderung, die nicht für ein Alarmereignis genügt. Es findet keine weitere Auswertung statt.
- Mittlere Anzahl geänderter Pixel absolut oder pro Häufungsbereich: Es findet eine Detailanalyse statt.
- Grosse Anzahl geänderter Pixel absolut oder pro Häufungsbereich: Es erfolgt zuerst eine Überprüfung der globalen Kriterien und sofern diese keine vernünftige Erklärung liefert, anschliessend eine Detailanalyse.
- Small number of changed pixels absolute or per cluster: subcritical change that is not sufficient for an alarm event. There is no further evaluation.
- Average number of changed pixels in absolute terms or per cluster: A detailed analysis takes place.
- Large number of changed pixels in absolute terms or per cluster: First, the global criteria are checked and, if this does not provide a reasonable explanation, then a detailed analysis.
Die Detailanalyse erfolgt sowohl statisch als auch dynamisch. Im ersten Fall werden die Häufungsbereiche bezüglich Grösse, Topologie und Orientierung untersucht, im zweiten Fall bezüglich der Veränderung von Grösse, Form und Position der Häufungsbereiche.The detailed analysis is carried out both statically and dynamically. In the first case, the cluster areas examined for size, topology and orientation, in the second case regarding the change in size, shape and position of the cluster areas.
Im wesentlichen wird also versucht, aus dem festen Referenzbild bewegte oder sich bewegende Objekte herauszufiltem und diesen dann eine eindeutige, alarmrelevante Kategorie zuzuordnen. So wird beispielsweise der Unterschied zwischen Mensch und Tier am Höhen-/Seitenverhältnis des betreffenden Häufigkeitsbereichs erkannt, wobei bei Menschen die Vertikale und bei Tieren die Horizontale überwiegt. Von vorne ist eine Unterscheidung zwischen Mensch und Tier sehr schwierig; aber man kann davon ausgehen, dass sich das erfasste Objekt nicht frontal auf den Melder 1 zubewegt sondern seitlich ausweicht und dadurch besser erkennbar wird. Neben diesen quantitativen Kriterien für die statische Detailanalyse kann man für die dynamische Detailanalyse typische Bewegungsabläufe von Menschen und Tieren analysieren und abspeichern und die vom Bildsensor 5 festgestellten Veränderungen mit diesen Mustern vergleichen. Essentially, an attempt is made to move or move from the fixed reference image Filter out objects and then assign them a clear, alarm-relevant category. For example, the difference between humans and animals is the height / aspect ratio of the frequency range in question, the vertical and the horizontal predominates in animals. From the front there is a distinction between people and Animal very difficult; but you can assume that the detected object is not frontal moved towards the detector 1 but sidesteps and is therefore easier to see. In addition to these quantitative criteria for static detailed analysis, one can use dynamic Detailed analysis of typical movements of humans and animals and save and compare the changes detected by the image sensor 5 with these patterns.
Das Flussdiagramm von Fig. 2 zeigt ein einfaches Beispiel der Signalverarbeitung in einer Einrichtung
zur Raumüberwachung ohne Distanzmesser 9 (Fig. 1). Der Einfachheit halber wird bei
der Darstellung davon ausgegangen, dass die Vorverarbeitungsstufen 7 und 8 in die Verarbeitungsstufe
4 (Fig. 1) integriert sind, so dass die Vorverarbeitung der Signale des Bildsensors 5
und des P/B Detektors 6 nicht lokal im betreffenden Sensor beziehungsweise Detektor sondern
in der Verarbeitungsstufe 4 stattfindet.2 shows a simple example of signal processing in a device
for room monitoring without distance meter 9 (Fig. 1). For simplicity's sake
the representation assumed that the preprocessing stages 7 and 8 in the processing stage
4 (FIG. 1) are integrated, so that the preprocessing of the signals of the image sensor 5
and the P /
Darstellungsgemäss erfolgt im Anschluss an die Vorverarbeitung der Sensorsignale eine Entscheidung,
ob die Raumhelligkeit für den Bildsensor 5 ausreichend ist. Ist dies nicht der Fall, ist
also die Raumhelligkeit sehr gering, dann wird nur das Signal des P/B Detektors 6 untersucht.
Bei dieser Untersuchung wird das letztere Signal mit einem Schwellwert P1 verglichen, dessen
Grösse ungefähr der Alarmschwelle eines P/B Detektors des betreffenden Typs entspricht.
Wenn also der PB Detektor 6 ein Passiv-Infrarot-Detektor ist, dann wird der Schwellwert P1
entsprechend der Alarmschwelle eines solchen Passiv-Infrarot-Detektors gewählt. Wenn das
Signal des P/B Detektors 6 grösser als P1 ist, wird Alarm ausgelöst, wenn nicht, dann wird die
Verarbeitung des betreffenden Sensorsignals abgebrochen und der nächste Verarbeitungszyklus
durchgeführt.As shown, following the preprocessing of the sensor signals, a decision is made as to whether the room brightness is sufficient for the image sensor 5. If this is not the case, ie if the room brightness is very low, then only the signal of the P /
Wenn die Raumhelligkeit für den Bildsensor 5 ausreichend ist, dann wird die Anzahl der gegenüber
dem Referenzbild veränderten Pixel bestimmt. Ist diese Anzahl null oder sehr klein,
dann wird das Signal des P/B Detektors 6 mit einem Schwellwert P2 mit P2 > P1 verglichen.
Wenn das Signal des P/B Detektors 6 grösser als P2 ist, wird Alarm ausgelöst, wenn nicht,
dann wird die Verarbeitung des betreffenden Sensorsignals abgebrochen. Eventuell kann auch
eine Analyse der Signale über ein längeres Zeitintervall erfolgen.If the room brightness is sufficient for the image sensor 5, then the number of pixels changed compared to the reference image is determined. If this number is zero or very small, then the signal of the P /
Wenn die Anzahl der gegenüber dem Referenzbild veränderten Pixel von mittlerer Grösse ist, dann erfolgt eine Detailanalyse mit Berücksichtigung der Beleuchtungssituation mit nachfolgender Untersuchung, ob von beiden Meldern (Bildsensor 5 und P/B Detektor 6) ein Objekt detektiert wurde. Ist dies der Fall, wird Alarm ausgelöst, wenn nicht, dann wird die Verarbeitung des betreffenden Sensorsignals abgebrochen.If the number of pixels changed from the reference image is of medium size, then a detailed analysis with consideration of the lighting situation is carried out with the following Examination whether an object from both detectors (image sensor 5 and P / B detector 6) was detected. If this is the case, an alarm is triggered, if not, then the processing of the relevant sensor signal canceled.
Wenn die Anzahl der gegenüber dem Referenzbild veränderten Pixel gross ist, dann wird untersucht,
ob eine starke Beleuchtungsänderung stattgefunden hat, was anhand der Beleuchtungsmessung
durch den Bildsensor 5 erfolgt, und zusätzlich das Signal des P/B Detektors 6
kleiner ist ein Schwellwert P3, mit P3 « P,. Sind beide Bedingungen erfüllt, wird die Verarbeitung
des betreffenden Sensorsignals abgebrochen. Sind nicht beide Bedingungen erfüllt, dann
erfolgt eine Detailanalyse mit Berücksichtigung der Beleuchtungssituation mit nachfolgender
Untersuchung, ob von beiden Meldern (Bildsensor 5 und P/B Detektor 6) ein Objekt detektiert
wurde. Ist dies der Fall, wird Alarm ausgelöst, wenn nicht, dann wird die Verarbeitung des betreffenden
Sensorsignals abgebrochen.If the number of pixels changed compared to the reference image is large, then it is examined whether there has been a strong change in lighting, which is done on the basis of the lighting measurement by the image sensor 5, and in addition the signal of the P /
Man erreicht auf die beschriebene Weise eine stark verbesserte Unterscheidung zwischen
Menschen und Haustieren und Menschen und Insekten, womit zwei der hauptsächlichsten
Quellen von Täuschungsalarmen beseitigt sind. Selbstverständlich wird diese Unterscheidung
durch das Distanzsignal des Distanzmessers 7 sprunghaft verbessert, weil dann ein eindeutiger
Rückschluss auf die Grösse des detektierten Objekts möglich ist.A much improved distinction between is achieved in the manner described
Humans and pets and humans and insects, making two of the main ones
Sources of false alarms have been eliminated. Of course, this distinction
suddenly improved by the distance signal of the
Claims (15)
- Space monitoring device, comprising at least one image sensor (5) and at least one presence or movement detector (6), and comprising a control and evaluation electronics system (2) to which the at least one image sensor (5) and the at least one presence or movement detector (6) are connected, characterized in that the control and evaluation electronics system (2) comprises a processing stage (4) for local signal evaluation in which a combined evaluation of the signals of the at least one image sensor (5) and of the at least one presence or movement detector (6) is performed, in that the average illumination of the monitored space is determined, and in that, in the combined evaluation of the signals, the weighting of the signal of the at least one presence or movement detector (6) is dependent on the average illumination and increases with decreasing average illumination.
- Device according to claim 1, characterized in that a separate preliminary evaluation (7, 8) of the signals of the at least one image sensor (5) as well as of the signals of the at least one presence or movement detector (6) is performed prior to the combined evaluation of the signals.
- Device according to claim 2, characterized in that the said preliminary evaluation (7, 8) is performed in the respective sensor or detector (5 or 6) or in the processing stage (4).
- Device according to claim 1 or 2, characterized in that the at least one image sensor (5) consists of a CMOS image sensor, preferably an active pixel sensor.
- Device according to one of claims 1 to 4, characterized in that a memory is provided for the images recorded by the image sensor (5), and in that this memory is controlled so that it stores those images that, in combination with the signal of the presence or movement detector (6), have resulted in an alarm decision.
- Device according to claim 5, characterized in that, in addition, the images immediately preceding and/or following the said images are stored.
- Device according to claim 5 or 6, characterized in that an interface is provided for reading out the stored images, and in that the reading-out is preferably performed with a PC.
- Device according to one of claims 5 to 7, characterized in that a means is provided for transferring the said stored images to a terminal that is spatially separated from the monitoring device.
- Device according to one of claims 1 to 8, characterized in that a means (9) is provided for determining the distance of an object detected by the at least one presence or movement detector (6), and in that the distance signal of this means is supplied to the processing stage (4).
- Device according to claim 4, characterized in that, in the preliminary evaluation (7) of the signals of the at least one image sensor (5), the number of changed pixels compared to a reference image and/or their accumulation and/or their distribution over the image is determined.
- Device according to one of claims 1 to 10, characterized in that, if there is insufficient illumination for the operation of the image sensor (5), only the signal of the presence or movement detector (6) is evaluated.
- Device according to claim 11, characterized in that the signal of the presence/movement detector (6) is compared with a first threshold value (P1) whose magnitude corresponds approximately to the alarm threshold of a presence or movement detector of the relevant type.
- Device according to one of claims 1 to 12, characterized in that, if the illumination is sufficient for the operation of the image sensor (5), the signal of the presence or movement detector (6) is compared with threshold values (P2, P3) which are dependent on the number of changed pixels in the image recorded by the image sensor (5), compared to a reference image.
- Device according to claim 13, characterized in that, in the case of only very few changed pixels compared to the reference image, the signal of the presence or movement detector (6) is compared with a second threshold value (P2) lying above the first threshold value (P1), this analysis being able to be performed over a relatively long time interval.
- Device according to claim 13, characterized in that, in the case of many changed pixels compared to the reference image, the signal of the presence or movement detector (6) is compared with a third threshold value (P3) lying significantly below the first threshold value (P1), and in that a further processing of the sensor signals is performed only if the signal of the presence or movement detector (6) does not simultaneously lie below the third threshold value (P3) and a large change in illumination has been recorded by the image sensor (5).
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP99103260A EP0939387B1 (en) | 1998-02-28 | 1999-02-19 | Room supervision device |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP98103542 | 1998-02-28 | ||
EP98103542A EP0939386A1 (en) | 1998-02-28 | 1998-02-28 | Space surveillance device |
CH76798 | 1998-03-31 | ||
CH76798 | 1998-03-31 | ||
EP99103260A EP0939387B1 (en) | 1998-02-28 | 1999-02-19 | Room supervision device |
Publications (2)
Publication Number | Publication Date |
---|---|
EP0939387A1 EP0939387A1 (en) | 1999-09-01 |
EP0939387B1 true EP0939387B1 (en) | 2003-09-17 |
Family
ID=25685622
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP99103260A Expired - Lifetime EP0939387B1 (en) | 1998-02-28 | 1999-02-19 | Room supervision device |
Country Status (5)
Country | Link |
---|---|
US (1) | US6396534B1 (en) |
EP (1) | EP0939387B1 (en) |
DE (1) | DE59906980D1 (en) |
DK (1) | DK0939387T3 (en) |
ES (1) | ES2209257T3 (en) |
Families Citing this family (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2350510A (en) * | 1999-05-27 | 2000-11-29 | Infrared Integrated Syst Ltd | A pyroelectric sensor system having a video camera |
US7330886B2 (en) | 1999-10-27 | 2008-02-12 | American Power Conversion Corporation | Network appliance management |
US6714977B1 (en) * | 1999-10-27 | 2004-03-30 | Netbotz, Inc. | Method and system for monitoring computer networks and equipment |
US7392309B2 (en) * | 1999-10-27 | 2008-06-24 | American Power Conversion Corporation | Network appliance management |
JP4146592B2 (en) * | 1999-11-12 | 2008-09-10 | 株式会社日立製作所 | Adaptive communication method and equipment constituting distributed system |
JP2001272708A (en) * | 2000-03-28 | 2001-10-05 | Fuji Photo Optical Co Ltd | Image pickup device for both of visible ray and ir ray |
US8271626B2 (en) | 2001-01-26 | 2012-09-18 | American Power Conversion Corporation | Methods for displaying physical network topology and environmental status by location, organization, or responsible party |
WO2002060124A2 (en) * | 2001-01-26 | 2002-08-01 | Netbotz, Inc. | Method and system for a set of network appliances which can be connected to provide enhanced collaboration, scalability, and reliability |
TWI258312B (en) * | 2001-03-22 | 2006-07-11 | Kuang-Yao Lo | Monitoring method for comparing image frames |
TW503650B (en) * | 2001-04-13 | 2002-09-21 | Huper Lab Co Ltd | Method using image screen to detect movement of object |
AU2003205842A1 (en) * | 2002-02-02 | 2003-09-02 | Qinetiq Limited | Head position sensor |
US6981876B2 (en) * | 2002-03-01 | 2006-01-03 | Accelerized Golf, Llc | Ergonomic motion and athletic activity monitoring and training system and method |
US20030184672A1 (en) * | 2002-04-02 | 2003-10-02 | Quen-Zong Wu | Digital image monitoring system with functions of motion detection and auto iris |
ATE453157T1 (en) * | 2002-05-03 | 2010-01-15 | American Power Conv Corp | METHOD AND APPARATUS FOR COLLECTING AND DISPLAYING NETWORK DEVICE INFORMATION |
EP1376502A1 (en) * | 2002-06-10 | 2004-01-02 | Siemens Building Technologies AG | Surveillance system |
EP1616235B1 (en) * | 2003-04-14 | 2009-11-25 | American Power Conversion Corporation | Extensible sensor monitoring, alert processing and notification system and method |
EP1616236B1 (en) * | 2003-04-14 | 2016-11-23 | Schneider Electric IT Corporation | Method and system for journaling and accessing sensor and configuration data |
US8566292B2 (en) | 2003-04-14 | 2013-10-22 | Schneider Electric It Corporation | Method and system for journaling and accessing sensor and configuration data |
WO2004090679A2 (en) | 2003-04-14 | 2004-10-21 | Netbotz, Inc. | Environmental monitoring device |
US7627651B2 (en) | 2003-10-27 | 2009-12-01 | American Power Conversion Corporation | System and method for network device communication |
US8184154B2 (en) * | 2006-02-27 | 2012-05-22 | Texas Instruments Incorporated | Video surveillance correlating detected moving objects and RF signals |
CN101755495B (en) | 2007-05-15 | 2013-10-16 | 美国能量变换公司 | Methods and systems for managing facility power and cooling |
US20110133930A1 (en) * | 2009-12-09 | 2011-06-09 | Honeywell International Inc. | Filtering video events in a secured area using loose coupling within a security system |
US8990536B2 (en) | 2011-06-01 | 2015-03-24 | Schneider Electric It Corporation | Systems and methods for journaling and executing device control instructions |
US9965564B2 (en) | 2011-07-26 | 2018-05-08 | Schneider Electric It Corporation | Apparatus and method of displaying hardware status using augmented reality |
AU2011384046A1 (en) | 2011-12-22 | 2014-07-17 | Schneider Electric It Corporation | Analysis of effect of transient events on temperature in a data center |
US9256781B2 (en) | 2012-05-10 | 2016-02-09 | Pointguard Ltd. | System and method for computer vision based tracking of an object |
JP6638194B2 (en) * | 2015-02-27 | 2020-01-29 | セイコーエプソン株式会社 | Three-dimensional image processing system, three-dimensional image processing device, and three-dimensional image processing method |
CN107408328A (en) * | 2015-03-03 | 2017-11-28 | 株式会社技术未来 | Digital following security system, methods and procedures now |
US11523090B2 (en) | 2015-03-23 | 2022-12-06 | The Chamberlain Group Llc | Motion data extraction and vectorization |
IL242928A0 (en) * | 2015-12-03 | 2016-04-21 | Pointgrab Ltd | Method and system for detecting occupancy in a space |
US9965841B2 (en) | 2016-02-29 | 2018-05-08 | Schneider Electric USA, Inc. | Monitoring system based on image analysis of photos |
US10417882B2 (en) | 2017-10-24 | 2019-09-17 | The Chamberlain Group, Inc. | Direction sensitive motion detector camera |
US11222081B2 (en) | 2017-11-27 | 2022-01-11 | Evoqua Water Technologies Llc | Off-line electronic documentation solutions |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2064189A (en) * | 1979-11-09 | 1981-06-10 | Ascotts Ltd | Surveillance System |
JPH027195A (en) * | 1988-06-27 | 1990-01-11 | Mitsui Eng & Shipbuild Co Ltd | Abnormality monitoring system |
US5473368A (en) * | 1988-11-29 | 1995-12-05 | Hart; Frank J. | Interactive surveillance device |
JP3222456B2 (en) * | 1990-07-30 | 2001-10-29 | 株式会社東芝 | Video monitoring system, transmitting device, receiving device, and video monitoring method |
DE4138254C1 (en) * | 1991-11-21 | 1993-06-24 | Grundig E.M.V. Elektro-Mechanische Versuchsanstalt Max Grundig Hollaend. Stiftung & Co Kg, 8510 Fuerth, De | |
US5581297A (en) * | 1992-07-24 | 1996-12-03 | Intelligent Instruments Corporation | Low power video security monitoring system |
DE29607184U1 (en) * | 1995-04-27 | 1996-07-18 | Frauhammer Alfred | Hazard detection system with video surveillance |
US5610580A (en) * | 1995-08-04 | 1997-03-11 | Lai; Joseph M. | Motion detection imaging device and method |
US5825413A (en) | 1995-11-01 | 1998-10-20 | Thomson Consumer Electronics, Inc. | Infrared surveillance system with controlled video recording |
GB2309133A (en) | 1996-01-11 | 1997-07-16 | Richad Thomas Fortescue | Video surveillance system including video recorder timing control device |
US5982418A (en) * | 1996-04-22 | 1999-11-09 | Sensormatic Electronics Corporation | Distributed video data storage in video surveillance system |
DE29718213U1 (en) * | 1997-10-14 | 1997-12-04 | Waldmann, Günter, Dipl.-Ing., 91052 Erlangen | Device for automatic, intelligent monitoring |
-
1999
- 1999-02-19 EP EP99103260A patent/EP0939387B1/en not_active Expired - Lifetime
- 1999-02-19 ES ES99103260T patent/ES2209257T3/en not_active Expired - Lifetime
- 1999-02-19 DK DK99103260T patent/DK0939387T3/en active
- 1999-02-19 DE DE59906980T patent/DE59906980D1/en not_active Expired - Lifetime
- 1999-02-26 US US09/258,731 patent/US6396534B1/en not_active Expired - Lifetime
Also Published As
Publication number | Publication date |
---|---|
DE59906980D1 (en) | 2003-10-23 |
EP0939387A1 (en) | 1999-09-01 |
ES2209257T3 (en) | 2004-06-16 |
DK0939387T3 (en) | 2004-02-02 |
US6396534B1 (en) | 2002-05-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP0939387B1 (en) | Room supervision device | |
EP0973137B1 (en) | Motion detector | |
DE69815977T2 (en) | AGAINST GLOBAL CHANGES IN NON-SENSITIVE VIDEO MOTION DETECTOR | |
DE3634628C2 (en) | ||
DE69921237T2 (en) | Automatic video surveillance system | |
DE3852927T2 (en) | Emergency monitoring system with infrared processing. | |
DE3841387C2 (en) | ||
DE60132622T2 (en) | METHOD AND DEVICE FOR SELECTING THE BEST VIDEO IMAGE FOR TRANSMISSION TO A REMOTE SITE WITHIN A CLOSED TELEVISION SYSTEM FOR RESIDENTIAL AREA SAFETY MONITORING | |
EP1418555A1 (en) | Presence detecor and use thereof | |
DE60213715T2 (en) | Image surveillance apparatus, method and processing program | |
EP0986912B1 (en) | Method for surveying a predetermined surveillance area | |
US5091780A (en) | A trainable security system emthod for the same | |
EP1281166B1 (en) | Imaging fire detector | |
DE60208166T2 (en) | AUTOMATIC SYSTEM FOR MONITORING INDEPENDENT PERSONS NEEDED HELPFULLY HELP | |
DE4222920A1 (en) | IMAGE PROCESSING USING SURVEILLANCE MONITORING SYSTEM | |
EP1346330B1 (en) | Video smoke detection system | |
DE102014203749A1 (en) | Method and device for monitoring at least one interior of a building and assistance system for at least one interior of a building | |
JPH0337354B2 (en) | ||
EP1376502A1 (en) | Surveillance system | |
DE60319346T2 (en) | SENSOR WITH DETECTION OF COVERS | |
EP0817145A1 (en) | Infrared sensor | |
DE102023003008A1 (en) | A vehicle fire monitoring method and a vehicle fire monitoring system | |
EP1079350B1 (en) | Space surveillance device | |
DE10049366A1 (en) | Security area monitoring method involves using two image detection units whose coverage areas overlap establishing monitored security area | |
EP0939386A1 (en) | Space surveillance device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): BE CH DE DK ES FR GB IT LI NL SE |
|
AX | Request for extension of the european patent |
Free format text: AL;LT;LV;MK;RO;SI |
|
RTI1 | Title (correction) |
Free format text: ROOM SUPERVISION DEVICE |
|
17P | Request for examination filed |
Effective date: 20000222 |
|
AKX | Designation fees paid |
Free format text: BE CH DE DK ES FR GB IT LI NL SE |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: SIEMENS BUILDING TECHNOLOGIES AG |
|
17Q | First examination report despatched |
Effective date: 20020710 |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): BE CH DE DK ES FR GB IT LI NL SE |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
GBT | Gb: translation of ep patent filed (gb section 77(6)(a)/1977) | ||
REF | Corresponds to: |
Ref document number: 59906980 Country of ref document: DE Date of ref document: 20031023 Kind code of ref document: P |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: TRGR |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2209257 Country of ref document: ES Kind code of ref document: T3 |
|
ET | Fr: translation filed | ||
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20040618 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PFA Owner name: SIEMENS BUILDING TECHNOLOGIES AG C-IPR Free format text: SIEMENS BUILDING TECHNOLOGIES AG#BELLERIVESTRASSE 36#8034 ZUERICH (CH) -TRANSFER TO- SIEMENS BUILDING TECHNOLOGIES AG C-IPR#GUBELSTRASSE 22#6300 ZUG (CH) |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: TP Ref country code: FR Ref legal event code: CD |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PUE Owner name: SIEMENS AKTIENGESELLSCHAFT Free format text: SIEMENS BUILDING TECHNOLOGIES AG C-IPR#GUBELSTRASSE 22#6300 ZUG (CH) -TRANSFER TO- SIEMENS AKTIENGESELLSCHAFT#WITTELSBACHERPLATZ 2#80333 MUENCHEN (DE) Ref country code: CH Ref legal event code: NV Representative=s name: SIEMENS SCHWEIZ AG, INTELLECTUAL PROPERTY |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20090310 Year of fee payment: 11 Ref country code: DK Payment date: 20090212 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20090213 Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20090514 AND 20090520 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: BE Payment date: 20090218 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SE Payment date: 20090212 Year of fee payment: 11 Ref country code: IT Payment date: 20090225 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20090217 Year of fee payment: 11 Ref country code: CH Payment date: 20090505 Year of fee payment: 11 |
|
BERE | Be: lapsed |
Owner name: *SIEMENS BUILDING TECHNOLOGIES A.G. Effective date: 20100228 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: V1 Effective date: 20100901 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: EBP |
|
EUG | Se: european patent has lapsed | ||
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100228 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100228 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20101029 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100901 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100301 Ref country code: DK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100219 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20110408 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110324 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100220 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100220 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20150420 Year of fee payment: 17 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 59906980 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160901 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20180212 Year of fee payment: 20 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: PE20 Expiry date: 20190218 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION Effective date: 20190218 |