EP2324461B1 - Monitoring system, method and computer program for detecting and/or tracking a monitoring object - Google Patents

Description

State of the art

The invention relates to a monitoring system for detecting and / or tracking at least one moving monitoring object in a surveillance area with a plurality of surveillance sensors, which are spatially distributed and / or distributable in the surveillance area and which are designed to detect the surveillance object and to output captured object information , with an evaluation device, which is designed to detect and / or track the monitored object by comparing acquired object information with an object signature of the monitored object, and with a signature lock with at least two signature sensors, which are designed to detect the surveillance object and to output object signature information and / or are arranged. The invention further relates to a method for detecting and / or tracking a surveillance object and a computer program.

In conventional video surveillance systems, such as those used for monitoring public or private buildings or squares, streets, intersections, railway stations, etc., monitoring areas are recorded by surveillance cameras and the image data streams of the surveillance cameras are usually combined in a monitoring center. The evaluation of the image data streams can be done by monitoring personnel, but often resorted to image processing algorithms to allow an automated evaluation of the image data streams.

A common procedure in automated evaluation via image processing algorithms is to separate moving monitoring objects from (essentially static) scene background of the surveillance area, to track over time and, for example, to trigger alarms for relevant movements. There are also known monitoring systems which use other sensor systems instead of surveillance cameras.

The tracking of surveillance objects is particularly difficult if the surveillance area is very extensive and the surveillance cameras or other sensors only cover partial areas of the surveillance area.

The publication DE 10 138 763 A1 concerns another technical field, namely the right of access for persons to a security area. In this document, it is proposed to use a plurality of biometric sensors to provide biometric data which then define access permissions for locked areas in the security area.

The publication US 7,175,528 , which probably forms the closest prior art, discloses a tracking system, for example, for gambling halls, with sensor devices for recording biometric data of the players being arranged in access areas to individual devices or in individual devices. The biometric data is compared to biometric records in a database to identify the player. If no identification is possible, a new biometric record will be created in the database.

From the US 2004/0117638 A1 a multimedia monitoring system is known, wherein in the multimedia monitoring system, a face recognition is integrated.

Disclosure of the invention

The invention relates to a monitoring system having the features of claim 1, a method for detecting and / or tracking a surveillance object with the features of claim 9 and a computer program having the features of claim 10. Preferred or advantageous embodiments of the invention will become apparent from the subclaims, the following description and the accompanying figures.

In the context of the invention, a monitoring system is proposed, which is suitable and / or designed for detecting and / or tracking at least one moving monitoring object in a monitoring area. The moved monitoring object is preferably designed as a person; in modified embodiments, the moved monitoring object can also be designed as a vehicle, an object moving on its own power and / or as an object moved by external force. Of course, it is possible that the monitoring system simultaneously detects or tracks more than one monitoring object.

The surveillance area may comprise individual open-air areas and / or areas in, on and / or under a building, in particular buildings. The individual areas may be formed integrally or, in alternative embodiments, may also be arranged separately from one another. In a building, for example, it is possible to monitor several floors of the building as a surveillance area.

The monitoring system has a plurality of monitoring sensors, which are spatially distributed and / or distributable in the monitoring area. The monitoring sensors may overlap with the detection areas or at least partially arranged without overlapping.

The monitoring system comprises a signature lock, which in the most general case can be designed as an unlimited lock area. In other embodiments, the lock area is limited by design measures or designed as a lock room or lock device. In the lock area, at least one signature sensor is arranged, which is designed to detect the surveillance object and to output object signature information. The signature sensor can be designed analogously to one of the monitoring sensors. The sensors, that is to say the monitoring and / or signature sensors, are designed to register various object properties of the monitoring object which are suitable and / or usable for monitoring, detection and / or tracking of the surveillance object and which can be output as object information or object signature information.

An evaluation device, which forms part of the monitoring system, is designed to detect and / or track, in particular identify, the monitored object by comparing object information from at least one monitoring sensor with an object signature of the monitored object. The object signature is preferably formed as a collection of object signature information that has been selectively and / or individually created for a single monitoring object.

According to the invention, the signature lock comprises at least two, preferably at least three, and in particular at least four or more signature sensors, wherein the signature lock is designed such that the object signature information of at least two signature sensors are assigned to the monitoring object clearly and / or unmistakably.

An advantage of the monitoring system is that the formation of the object signature by the signature signature information from the signature lock ensures that all object signature information that contributes to the formation of the object signature actually originates from a single monitor object. If one compares the inventive concept, for example, with a concept of a continuous construction of the object signature, wherein uncorrelated monitoring sensors participate in the formation of the object signature, there is always the risk that a confusion of the monitoring objects takes place and incorrect signature data is entered in the object signature. Fully or nearly complete capture of object signature data from a monitoring object at a particular point in time at a particular location or area enables creation of a robust object signature for the monitoring object.

Another advantage of the invention is the fact that after passing through the signature lock for the monitoring object or for each subsequent monitoring object a complete or at least comprehensive individual object signature is formed, which was generated based on the captures preferably all signature sensors in the signature lock. Namely, it is preferably provided that the object signature is completely formed in the signature lock, ie that the signature lock has all those signature sensors which can provide the necessary object signature information for the formation of the object signature.

In a first possible concretization of the invention, at least two signature sensors are designed and / or arranged for spatially overlapping and / or chronologically overlapping detection of the monitored object and / or for temporally and / or spatially correlated detection of the monitored object. For example, the monitoring object is detected simultaneously or simultaneously from all sides with a corresponding selection of signature sensors. In this case, several similar signature sensors can be used. It is particularly preferred if at least two surveillance cameras are provided for the simultaneous or simultaneous detection of different views of the surveillance object. For example a front and a rear view or a side view and a side view of the opposite side of the monitoring object is recorded. In particular, the signature sensors for receiving the object signature are positioned so that they do not interfere with each other.

In another possible embodiment, the signature lock has a separating device for separating the monitored object, wherein the at least two signature sensors are arranged in a separating region in order to detect the separated monitoring object there. In this constructive embodiment, the temporal and / or spatial correlation is achieved by ensuring that only a single monitoring object can be present in a specific area of the signature lock, so that all sensor-specific detections in the singulation area must necessarily belong to the isolated monitoring object ,

It is particularly preferred if the signature lock is arranged at an entrance of the monitoring area. In this embodiment, it is advantageously achieved that the monitoring object is completely detected as an object signature upon entering or entering the surveillance area, so that a detection and / or tracking of the surveillance object in the surveillance area based on the object signature is possible everywhere. It is also possible that a plurality of signature locks are arranged at a plurality of inputs of the surveillance area.

In a particularly preferred embodiment of the invention, the signature lock is formed with an automated activation for detecting the monitored object. Thus, no user intervention by, for example, monitoring personnel or the monitoring object itself is necessary to start the formation of the object signature. For example, the formation of the object signature is started as soon as the monitoring object is at a certain position.

In an alternative embodiment of the invention, the signature lock for manual activation is formed, for example, by the surveillance object or by monitoring personnel. It can be provided, for example, that the monitoring object must perform a specific action in order to start the formation of the object signature. This embodiment may be useful if, for example For reasons of data protection, first an approval of the monitoring object for generating the object signature is obtained.

Optionally, in all embodiments, means may be provided which only open access to the monitoring area when the object signature has been formed.

• Überwachungskameras, vorzugsweise stationäre oder bewegte (z. B. Pan-Tilt-Zoom-Kameras) Überwachungskameras mit verschiedenen Beobachtungswellenlängen (UV, VIS, NIR, IR), insbesondere zur Rundumerfassung der Ansicht des Überwachungsobjektes und/oder zur Vermessung der realen Größe oder der Ausmaße des Überwachungsobjekts;
• Geruchssensoren zur Aufnahme einer olifaktorischen Objekteigenschaft;
• Temperatursensoren zur Aufnahme einer Temperatur des Überwachungsobjektes;
• Waage zur Bestimmung des Gewichts des Überwachungsobjektes;
• Akustische Sensoren, z.B. Mikrofone, zur Aufnahme von typischen Geräuschen, wie z.B. Atmung, Herzschlag, Motorgeräusche etc..
• Sensoren zur Erfassung von elektromagnetischer Strahlung, beispielsweise Terahertzstrahlung; Strahlungsmessung zur Erfassung von Signalen von Computern, Handys, RFID etc.
• Ergänzend können durch Sensoren biometrische Daten, wie zum Beispiel Gesichtsanalysen, Fingerabdrücke und/oder kinematische Daten, wie zum Beispiel Bewegungsmuster, erfasst werden.

According to the invention, the signature sensors and the monitoring sensors comprise one or more of the following types of sensors:

• Surveillance cameras, preferably stationary or moving (eg pan-tilt-zoom cameras) surveillance cameras with different observation wavelengths (UV, VIS, NIR, IR), in particular for all-round detection of the view of the monitored object and / or for measuring the real size or the Dimensions of the surveillance object;
• Odor sensors for receiving an olifaktorischen object property;
• Temperature sensors for receiving a temperature of the monitored object;
• Balance for determining the weight of the monitored object;
• Acoustic sensors, such as microphones, for recording typical noises, such as breathing, heartbeat, engine noises, etc.
• Sensors for detecting electromagnetic radiation, for example terahertz radiation; Radiation measurement for the acquisition of signals from computers, mobile phones, RFID, etc.
• In addition, biometric data, such as facial analyzes, fingerprints and / or kinematic data, such as movement patterns, can be detected by sensors.

The object information or object signature information may include features regarding color, texture, digital image processing features, size, weight, radiation property, temperature, etc.

In an embodiment of the monitoring system according to the invention, it is provided that the entirety of the signature sensors covers all the genera of the monitoring sensors. Again, the idea has been implemented to first provide all signature sensors for a complete object signature for all types or types of monitoring sensors for mounting those monitoring sensors at other locations in the surveillance area that provide the best detection rate for the particular environment.

In terms of signaling, it is preferably provided that the monitoring sensors and / or the signature sensors are arranged and / or interconnected in a sensor network, for example in the form of an LSN bus (LSN: Local Security Network). The sensor network extends within the monitored area formed, for example, in the form of buildings and / or as open terrain.

Another object of the invention relates to a method for detecting and / or tracking a surveillance object in a surveillance area with the features of claim 9. Preferably, the method in the surveillance system according to a preceding claims or as previously described, implemented. In the method, an object signature of the monitoring object based on object signature information is first of all automatically formed by a plurality of signature sensors, wherein means are provided so that the object signature information can be clearly and / or unmistakably assigned to the monitoring object.

A further subject relates to a computer program having the features of claim 10.

Brief description of the drawings

Figur 1

eine schematische Blockdarstellung eines Überwachungssystems als ein erstes Ausführungsbeispiel der Erfindung.

Further features, advantages and effects of the invention will become apparent from the following description of a preferred embodiment of the invention. Showing:

FIG. 1

a schematic block diagram of a monitoring system as a first embodiment of the invention.

Embodiment (s) of the invention

The FIG. 1 shows a schematic block diagram of a monitoring system 1 as an embodiment of the invention. The monitoring system 1 is designed to detect and / or track surveillance objects 4 in the form of passers-by in a surveillance area 2, which is delimited schematically by lines 3.

In the monitoring area 2, a plurality of monitoring sensors 6 are arranged in a building 5, which monitor different partial areas 7 in the surveillance area 2 or in the building 5.

In the FIG. 1 the subregions 7 are distributed so that they are at least sometimes arranged without overlapping side by side. In the case of detection or tracking of the monitoring objects 4, it is now difficult to recognize the monitoring object 4 during a transition from one subarea 7 to the next subarea 7, in order to enable a tracking of the surveillance object 4 over the entire surveillance area 2. Rather, it represents a possible source of error that the monitoring object 4 leaves the one subarea 7 and is included in a next subarea 7 as a new monitoring object 4 in the pursuit. A robust tracking of the monitored object 4 in the monitoring area 2 is made more difficult by this error source.

In order to simplify the detection, identification or tracking of the monitored object 4, the surveillance area 2 in this example has four signature locks 8a, b, c and d, which are arranged in the entrance area of the surveillance area 2. So that a monitoring object 4 can enter the monitoring area 2, it must be one of the signature locks 8a, b, c or d traverse. Of course, it is possible for the monitoring area 2 to have more or fewer signature locks 8a, b, c, d.

Each of the signature locks 8a, b, c, d has in this example four signature sensors 9, which are arranged and / or configured such that from the monitoring object 4 when crossing the signature locks 8a, b, c, or d sensor-specific measurement signals as the basis for Object signature information is recorded, which are summarized below in an evaluation device 10 to an object signature. In this case, the signature sensors 9 are arranged in the signature locks 8a, b, c, d in such a way that a detection of the surveillance object 4, which is in particular spatially and / or temporally correlated, takes place. This correlation ensures that the sensor-specific measurement signals are reliably recorded by one and the same monitoring object 4. The resulting from the sensor-specific measurement signals of the signature sensors 9 object signature thus characterized by the fact that it is formed with certainty on the basis of only one monitoring object 4.

The selection of the signature sensors 9 is such that for each type of monitoring sensor 6 or at least for the majority of all types of monitoring sensors 6 a signature sensor 9 in the same genus or with a compatible sensor-specific measurement signal is provided. In the FIG. 1 is the different Sensorgattungen by triangles, squares, pentagons and hexagons visualized.

One idea of the monitoring system 1 is that for each signature sensor 9 in the signature lock 8a, b, c, d, sensor-specific measurement signals are recorded as a basis for object signature information and stored as an object signature. This approach has the advantage that in the monitoring area 2 only individual monitoring sensors 6 must be arranged, which show, for example, in terms of the current environment, the best detection performance and / or environmental compatibility. Also, the selection of the monitoring sensors 6 may be based on economic considerations. Due to the completeness of the object signature, it is sufficient to place a monitoring sensor 6 per subregion 7 in order to reliably identify or recognize the corresponding surveillance object 4 with its sensor-specific measurement signals on the basis of the stored object signature and thereby enable detection or tracking. Thus, a robust recognition of monitoring objects 4 within the surveillance area 2 is achieved, whereby a complete and comprehensive collection of information about the surveillance object 4 to be tracked is created once in the access area of the surveillance area 2. As monitoring sensors 6 and signature sensors 9, a wide variety of sensors, including very different ones, may be used, such as surveillance cameras, which allow all-round viewing of the surveillance object 4 and allow, for example, the measurement of the real size and dimensions or the volume of the surveillance object 4. As a special version of the surveillance cameras and infrared cameras can be used with a wavelength above 1000 nm, which can register, for example, the temperature and / or the temperature distribution of the monitored object 4. Also odor sensors are possible, which can absorb a specific smell of the monitored object 4. A scale for receiving the weight of the monitored object 4 is also conceivable. Another possibility is the use of an acoustic sensor, for example a microphone, which registers typical noises, such as respiration, heartbeat, but also engine noise or step noise. Other sensors for recording electromagnetic radiation, such as Terrahertzstrahlungen, are within the possibilities.

It is also possible to use a radiation measurement, for example for the detection of computers, mobile phones, RFID and the like, in order to create an object signature or to recognize the monitoring object 4 again. For example, the information content of the radiation, e.g. a cell phone identifier or RFID identification information may be used as the object signature information. This Rundumerfassung of temporally and spatially correlated information on the monitoring object 4 offers the distributed monitoring sensors 6, the data required for them for robust recognition of the monitored object. 4

The signature sensors 9 for receiving the sensor-specific measurement signals for forming the object signature are arranged in the signature locks 8a, b, c, d so that they do not interfere with one another. In the signature locks 8a and b, the signature sensors 9 are arranged so that the monitoring object 4 are detected at the same time from all sides can. It is also possible to use a plurality of similar signature sensors 9 at the same time, for example surveillance cameras for the simultaneous detection of several or all views of the surveillance object 4.

In the signature lock 8c, the signature sensors 9 are arranged in a row one after the other, wherein the detection ranges of the signature sensors can be arranged overlapping or non-overlapping. In order to ensure the spatial or temporal correlation of the sensor signals of the signature sensors 9, the signature lock 8b has a separating device 11, which allows only a single monitoring object 4 to enter the signature lock 8b.

The signature lock 8d is analogous to the signature lock 8 a or b constructed, but in contrast to these, the detection of the monitoring object 4 is not automated, but is activated by operation of a device 12 by the monitoring object. The device 12 may be formed, for example, as a computer terminal and optionally be connected to a locking device 13, which releases access to the building 5 only when the object signature has been formed.

The monitoring sensors 6 in the monitoring area 2 can be connected to each other and to the evaluation device 10 via a safety network LSN 14, for example.

The method for carrying out the detection, recognition or tracking of the monitored object is explained below: In a first step, sensor-specific measuring signals for registering object properties of the monitoring object 4 are recorded in one of the signature locks 8a, b, c, d by the signature sensors 9 and as object signature information via a network 15, which may also form part of the safety network 14, forwarded to the evaluation device 10. In the evaluation device 10, the object signature information is summarized in object signatures 16, for example in the form of data records, wherein each data record is assigned to a monitoring object 4 in an individualized manner. Optionally, the records are supplemented by further information from another database. In alternative embodiments, the measurement signals of the signature sensors 9 on the evaluation device 10 is transmitted and converted there only in object signature information.

If the monitoring object 4 enters the monitoring area 2, it is registered by any of the monitoring sensors 6 in a further step. The sensor-specific measurement signals of the monitoring sensor 6 are forwarded via the safety network 14 to the evaluation device 10 and compared in the original or post-processed form as object information in a comparison module 17 with the object signature 16 created on the basis of the sensor-specific measurement signals of the signature sensors 9. If there is a match or sufficient similarity, the monitoring object 4 is assigned the identity of the monitoring object 4 belonging to the data record 16.

If the monitored object 4 moves from a first of the partial regions 7 into a second partial region 7, the procedure is repeated with the monitoring sensor 6 arranged in the next partial region 7. The entirety of the positions or further sensor data of a monitoring object 4 assigned via the object signature 16 is collected and can then be evaluated in order to detect, identify or track the monitoring object 4 in the monitoring area 2.

Claims (10)

1. Monitoring system (1) for detecting and/or tracking at least one moving monitoring object (4) in a monitoring area (2) having a plurality of sections which are at least partially arranged without an overlap,
   having a plurality of monitoring sensors (6) which are spatially distributed and/or can be spatially distributed in the monitoring area (2) and are designed to capture the monitoring object (4) and to output captured object information, wherein the monitoring sensors (6) comprise a plurality of types of sensors comprising monitoring cameras, odour sensors, temperature sensors, scales, acoustic sensors, sensors for capturing electromagnetic radiation and/or sensors for capturing biometric data,
   having a signature lock (8a, b, c, d) with at least two signature sensors (9) which are designed and/or arranged to capture the monitoring object (4) and to output object signature information, wherein the signature lock (8a, b, c, d) is designed such that the object signature information from the at least two signature sensors (9) is uniquely and/or unmistakably assigned to the monitoring object, wherein all of the signature sensors (9) cover all of the types of monitoring sensors (6), and
   having an evaluation device (10), wherein the evaluation device (10) is designed to combine object signature information in object signatures (16), wherein the evaluation device (10) is designed to form and/or supplement an object signature (16) of the monitoring object (4) on the basis of the object signature information and to detect and/or track the monitoring object (4) by comparing captured object information with the object signature (16) of the monitoring object (4),
   characterized in that
   only a single monitoring sensor (6) is placed for each section, and
   at least one signature sensor (9) is a sensor for measuring electromagnetic radiation in order to create an object signature (16).
2. Monitoring system (1) according to Claim 1, characterized in that the evaluation device (10) is designed to form the object signature (16) solely on the basis of the object signature information captured by the signature sensors (9).
3. Monitoring system (1) according to Claim 1 or 2, characterized in that the at least two signature sensors (9) are arranged and/or designed to capture the monitoring object (4) in a spatially overlapping and/or temporally overlapping manner.
4. Monitoring system (1) according to one of the preceding claims, characterized in that the signature lock (8a, b, c, d) is designed to isolate the monitoring object (4), wherein the at least two signature sensors (9) are arranged in an isolating region for capturing the isolated monitoring object.
5. Monitoring system (1) according to one of the preceding claims, characterized in that the signature lock (8a, b, c, d) is arranged at an entrance to the monitoring area (2).
6. Monitoring system (1) according to one of the preceding claims, characterized in that the signature lock (8a, b, c, d) is designed to automatically activate the capture of the monitoring object (4).
7. Monitoring system (1) according to one of the preceding claims, characterized in that the signature lock (8a, b, c, d) is designed to manually activate the capture of the monitoring object (4).
8. Monitoring system (1) according to one of the preceding claims, characterized in that the monitoring sensors (6) and/or the signature sensors (9) are arranged in a sensor network (14, 15).
9. Method for detecting and/or tracking a monitoring object (4) in the monitoring system (1) according to one of the preceding claims, wherein sensor-specific measurement signals for registering object properties of the monitoring object (4) are recorded in the signature lock (8a, b, c, d) by the signature sensors (9) and are forwarded, as object signature information, to the evaluation device (10) via a network (15), wherein an object signature of the monitoring object (4) is formed on the basis of object signature information from a plurality of signature sensors, wherein the object signature information is uniquely and/or unmistakably assigned to the monitoring object.
10. Computer program having program code means for carrying out all steps of the method according to Claim 9 when the program is executed on a computer and/or a monitoring system according to one of the preceding Claims 1 to 8.

Images