EP2422328B1 - Automated teller machine comprising at least one camera to detect manipulation attempts - Google Patents

Description

The invention relates to a self-service terminal with at least one camera according to the preamble of claim 1. In particular, the invention relates to a self-service terminal, which is designed as an ATM.

In the field of self-service machines, in particular ATMs, criminal acts are often carried out in the form of manipulations with the aim of spying on sensitive data, in particular PINs (Personal Identification Numbers) and / or card numbers, from users of the self-service terminal. In particular, manipulation attempts are known in which so-called skimming devices, such as keyboard superstructures and the like, are installed illegally in the operating area or control panel. Such keyboard superstructures often have their own power supply, as well as a processor, a memory and an operating program, so that an unsuspecting user is spied on entering his PIN or inserting his bank card. The spied data is then transmitted to a remote receiver via a transmitter built into the keyboard superstructure or stored in a data memory located in the keyboard overlay. Many of today's skimming devices are very difficult to distinguish with the human eye from original controls (keyboard, card reader, etc.).

To thwart such attempts at manipulation, monitoring systems are often used which have one or more cameras which are mounted in the area of the location of the self-service terminal and detect the entire control panel and often also the area of residence of the user.

The EP 1 965 361 A2 describes a trained as an ATM self-service terminal in which a camera is mounted above the screen and detects the outdoor area in which the user is located during the operation of the ATM. The ATM has a control panel with multiple elements, in particular with controls such as a card reader with card slot. To detect tampering with these items, at least one camera inside the ATM is installed on the card slot. As there on the basis of Fig. 2-4 is described, the card input hopper is partially made of transparent plastic, so that the at least one camera can detect an inserted cards optically. It is also possible to use two cameras in order, for example, to detect the lower subarea and the upper subarea of the card input funnel. Accordingly, a self-service terminal is known in which at least one camera is provided for monitoring the self-service terminal, wherein for detecting manipulation attempts on the self-service terminal, at least one of the cameras is integrated in one of the elements provided in the control panel and detects a plurality of sub-areas associated with the element.

From the WO 2007/093977 A1 is a self-service terminal with a camera arrangement known equipped with multiple cameras to monitor the self-service terminal is. To detect manipulation attempts on the self-service terminal, which is eg an ATM, several cameras are mounted in the vicinity of the control panel of the ATM. For example, one camera captures the card slot and another camera captures the cash slot. Another camera is aimed at the user of the ATM.

Another solution for detecting tampering is in the DE 201 02 477 U1 described. By means of the local camera monitoring, both the control panel itself and the user's area in front of it can be detected. In order to distinguish whether a person is in the occupied area, a sensor is provided.

Object of the present invention is to propose a solution for a camera surveillance, which allows a secure detection of manipulation attempts without the use of additional sensors.

The problem is solved by a device having the features of claim 1.

Accordingly, a self-service terminal is proposed, in which at least one camera is integrated in one of the elements provided in the control panel for detecting manipulation attempts and detects several sub-areas associated with this element, wherein the sub-areas comprise at least an inner area and an outer area of the element, wherein the camera Partially detected element is a tamper-proof Bedienelemement in the form of a Karteneingabetrichters, wherein the partially detected by the camera element has a lighting. The illumination illuminates one or some of the subregions of the element, and the card input funnel has as a subregion a slot region (I) which the illumination illuminates.

Since the card slot is equipped with lighting, this can also be used for taking pictures of the camera. Also, the illumination which illuminates one or some of the subregions of the card insertion funnel can be designed for optimal illumination of the areas covered by the camera.

The camera can capture part of the interior, the exterior, and an intermediate transition area. Thus, various manipulation attempts can already be detected with a camera and differentiated capture or evaluate. The card entry hopper may preferably have illumination from which the camera also benefits.

Thus, by means of a camera installed directly in an element, such as the card input funnel, various subregions of the element itself and possibly also of its surroundings are detected, whereby the acquired image data can be analyzed separated into subregions. These are, for example, an interior area and an exterior area of the element as well as an intermediate transition area. Partial detection has the advantage that manipulations can be detected very accurately and reliably. When applied to a card entry funnel, this means that, for example, it can be accurately distinguished whether the card entry funnel was completely overbuilt illegally or whether, for example, a foreign body was introduced into the insertion slot.

Preferably, the card input hopper, in particular its slot area is provided with a photoconductive plastic over which a light generated by the illumination is passed. The plastic can be colored to achieve a specific illumination color, which is particularly suitable for image acquisition.

The at least one camera is connected to a data processing unit which processes the generated image data by e.g. segmented and processed according to the subregions. For this purpose, the data processing unit may have a first stage for image processing, in particular for shadow removal, edge detection, vectorization and / or segmentation, which receives the image data. In addition, a downstream second stage for feature extraction, in particular by means of blob analysis, edge position and / or color distribution, can be provided. In addition, a downstream third stage may be provided for classification. Preferably, the data processing unit also includes interfaces for video surveillance systems (20) and / or security systems. The data processing unit may be integrated in the self-service terminal.

These and other particularly advantageous embodiments will become apparent from the dependent claims.

Accordingly, it is also advantageous if the self-service terminal has at least one further camera which is mounted on or in the self-service terminal in the vicinity of the control panel and detects at least one of the elements. The elements provided in the control panel and detected by the cameras may e.g. a cash dispenser, a keyboard, a tray, a card slot and / or a screen.

It can also be provided that an additional camera for an area is provided on the self-service terminal, at which a user, in particular his head, himself while operating the self-service terminal. Thus, if necessary, a portrait of the user can be included.

It is preferably provided that the data processing unit, if it detects a manipulation attempt on one of the elements by means of the processing of the image data and / or detects a manipulation on one of the multiple cameras, triggers an alarm, blocks the self-service terminal and / or triggers the additional camera. It can also be provided that the cameras and / or the data processing unit are or is deactivated during the operation and / or maintenance of the self-service terminal.

In connection with the use of a plurality of cameras, it is preferably provided that the data processing unit combines and evaluates the image data generated by the plurality of cameras in order to detect manipulations on one or more of the cameras. Also, by combining and evaluating the image data, manipulations in the detection range of one or more of the cameras can be detected. In particular, the data processing unit can combine and evaluate the image data in order to detect deviations that relate to the image content, the image structure and / or the image quality, in particular the image illumination and / or brightness.

Also, at least some of the cameras may be mounted in a housing section of the self-service terminal surrounding the control panel, in particular being installed in that housing section of the self-service terminal which delimits the control panel laterally or upwardly. It can also be a single of the cameras at least two of detect elements provided in the control panel, in particular detect two operating elements, such as a cash dispenser and a keyboard. In turn, another camera may be integrated in one of the elements provided in the control panel, in particular integrated in a card input hopper.

Fig. 1

zeigt eine perspektivische Ansicht auf das Bedienfeld eines Selbstbedienungsterminals mit mehreren Kameras;

Fig. 2

gibt den Erfassungsbereich derjenigen Kamera aus Fig. 1 wieder, die das Bedienfeld von der Seite erfasst;

Fig. 3

gibt den Erfassungsbereich derjenigen Kamera aus Fig. 1 wieder, die das Bedienfeld von Oben erfasst; und

Fig. 4a

zeigt die Einbaussituation derjenigen Kamera, die in den Karteneingabetrichter integriert ist;

Fig. 4a

gibt den Erfassungsbereich dieser Kamera aus Fig. 4a wieder; und

Fig. 5

zeigt ein Blockschaltbild für eine mit mehreren der Kameras verbundener Datenverarbeitungseinheit und damit verbundener Videoüberwachungs-Einheit.

The invention and the advantages arising therefrom are described below by means of exemplary embodiments and with reference to the attached schematic drawings, which show the following:

Fig. 1

shows a perspective view of the control panel of a self-service terminal with multiple cameras;

Fig. 2

outputs the detection range of that camera Fig. 1 again, which captures the control panel from the side;

Fig. 3

outputs the detection range of that camera Fig. 1 again, which captures the control panel from above; and

Fig. 4a

shows the installation situation of the camera integrated in the card slot;

Fig. 4a

outputs the detection range of this camera Fig. 4a again; and

Fig. 5

shows a block diagram for a connected to a plurality of cameras data processing unit and associated video surveillance unit.

The Fig. 1 shows in a perspective view of the basic structure of a self-service terminal in the form of an ATM ATM. To the control panel ATM ATM include in particular a cash dispenser 1, also called shutter, and a keyboard 2, ie controls on which preferably manipulation attempts, for example in the form of superstructures, may occur for the purpose of skimming. The ATM ATM is equipped with several cameras for detecting such and similar manipulation attempts, wherein at least one camera (see CAMK in Fig. 3 and 4a ) is integrated directly into one of the controls, namely here in the card entry funnel (see 4 in Fig. 3 and 4a ) of the ATM.

The Fig. 1 shows first the other cameras, which are mounted at different locations, preferably in the vicinity of the control panel. These are a side camera CAMS, a top view camera CAMD and an additional portrait camera CAMO.

The cameras CAMS and CAMD are within a demarcation, framing or the like and are mounted there. Each of these cameras CAMS or CAMD detects in each case from the outside at least one of the elements arranged in the control panel of the ATM, eg the cash dispenser 1 (shutter) and / or the keyboard 2. The lateral camera CAMS preferably detects exactly these two elements 1 and 2; the top view camera CAMD also detects other elements (see also Fig. 3 ). On the other hand, the camera CAMK integrated in the card input hopper 4 also detects the inside of this element. This camera CAMK and its function will be explained later in detail on the basis of Fig. 3 and 4a / b as well Fig. 5 described.

In addition to the camera arranged directly on or in the control panel, the additional camera CAMO is located in the upper housing part of the ATM ATM and is directed to the area in which the user is operating the ATM. In particular, this camera captures CAMO the head or the face of the user and is therefore referred to here as a portrait camera.

The FIG. 2 shows the detection range of the camera CAMS, which is located in a side housing part, which framing the control panel of the ATM ATM or surrounds. In particular, the camera CAMS is equipped with a wide-angle lens in order to capture at least these two elements or partial areas of the control panel. The ATM ATM is designed so that said elements 1 and 2 preferably have the most homogeneous surfaces with these delimiting edges. This simplifies object recognition. By attaching the camera CAMS at this particularly suitable position, the said subareas or elements 1 and 2 can be measured very reliably optical. It can be provided that the camera is focused in particular on certain areas.

Another perspective, namely that of the top view camera CAMD, is based on the FIG. 3 clarified. Here is the detection field of this camera CAMD illustrated, which is installed in the upper part of the ATM ATM (see also Fig. 1 ) and which captures the control panel from above. In addition to the cash dispenser 1 and the keyboard 2 in the detection range of the camera also other elements be provided, such as a shelf near the keyboard, a card input funnel 4, ie the feeding part for the card reader, as well as eg a screen 5 or display. These further mentioned elements 3, 4 and 5 represent potential targets for manipulation attempts.

As the Fig. 4a Based on an installation situation, the camera CAMK is integrated directly into the card input funnel 4. In order to achieve good image illumination for this camera CAMK, the already used illumination L of the card slot can be used. The camera CAMK is mounted laterally by card slot or insertion slot, which is made of a special, light-conducting plastic K. The lighting L is realized by one or more light sources, such as light-emitting diodes, wherein the generated light is guided via the light-conducting plastic K to the actual insertion slot in order to illuminate it. The light can be guided coming from above and below, so that the card slot is illuminated as evenly as possible. The generated light can be optimally adapted in intensity to the requirements. Also, the light can be colored by the use of colored LEDs and / or color filters to be adapted in particular to the requirements of the camera CAMK.

In order to detect manipulations due to foreign interventions, changes and the like, predefinable subregions are detected and optically measured. Deviations from reference values (normal state with regard to image composition, image content, weighting of pixel areas, etc.) can thus be detected quickly and reliably. For this purpose, different image processing methods (algorithms) or image processing steps (Routines) within a later-described data processing unit (s. Fig. 5 ) carried out. The image data processing can take place partially.

The Fig. 4b 1 illustrates the detection area of the camera CAMK segmented into different partial areas, and clearly shows that it is essentially subdivided into three partial areas I, II and III.

The first subarea I primarily detects the inner area of the card input funnel, ie the actual card slot, the subarea III detects the outer area of the card entry funnel and subarea II detects the intermediate transition area. In connection with the Fig. 4a the following advantages of the construction and installation described here are clear:

Due to the internal camera position, in which the camera CAMK is arranged laterally in the card insertion funnel 4 and detects the subregions I to III, various types of skimming modules, superstructures or manipulations can be detected very accurately. Because this method of installation makes it possible to perform an image segmentation according to sub-areas I to III and to measure these individually. The contrast difference between the subregions can be used well for segmenting the image acquisition.

The camera CAMK is here so aligned that with the sub-area III, a person in front of the ATM can be detected (user or attacker). This image data can in particular with those of the portrait camera CAMO (s. Fig. 1 ). The camera CAMK is preferably installed on the same side of the terminal as the camera CAMS, so that the image data of these two cameras can also be compared.

In particular, for the interior I, but also for parts of the transition region II, the lighting L (s. Fig. 4a ) are used to achieve the best possible illumination for the image recordings. A colored illumination in the green area is particularly advantageous because the image sensors or CCD sensors of camera are particularly sensitive to green shades and have the greatest resolution. The lighting L improves the object recognition, especially in low light conditions (location, night time, etc.). In addition, the illumination overcomes possibly by external light (eg solar radiation) occurring reflections on a recognizable superstructure. The already provided lighting L of the card insertion funnel is a reliable light source for the camera CAMK. The actual card slot here has a different color than the card input hopper, so that a larger contrast difference is given, which improves the image analysis.

• einer Bildverarbeitungs-Stufe zur Vorverarbeitung der ankommenden Bilder bzw. Daten (z.B. zwecks Schattenentfernung, kantendetektion, Segmentierung)
• einer Merkmalsextraktions-Stufe (mittels Blobanalyse, Analyse von Kantenposition, Farbverteilung usw.)
• einer Klassifikations-Stufe (zur Bestimmung von Erkennungsmerkmalen für Manipulationen)

In image data processing, various methods are used, in particular a combination of segmentation and edge detection. The data processing unit (s. Fig. 5 ) consists essentially of the following three stages:

• an image processing stage for preprocessing the incoming images or data (eg for the purpose of shadow removal, edge detection, segmentation)
• a feature extraction stage (using blob analysis, edge position analysis, color distribution, etc.)
• a classification level (for determining identification features for manipulations)

The data processing will be later on the basis of Fig. 5 described in more detail and can be realized eg on a PC.

The CAMK camera is designed here as a color camera with a minimum resolution of 400x300 pixels. In the case of saturated illumination, it is thus possible in particular to use a color value distribution-based method for detecting superstructures and the like. The camera CAMK has a wide-angle lens, so that the outdoor area (sub-area III in Fig. 4a ) is detected well.

• Anbringen eines Tastaturüberbaus
• Anbringen eines Komplettüberbaus an der unteren Auflagefläche
• Anbringen eines Überbaus an dem Geldausgabefach (Shutter) und/oder das Anbringen von Gegenständen zur Aufnahme von Sicherheitsinformationen, insbesondere PIN-Nr., wie z.B. Minikameras, Kamerahandys und ähnliche Spähkameras.

In the example described here, at least the cameras mounted in the vicinity of the control panel are CAMS; CAMD and CAMK are connected to the data processing unit 10 (see FIG. 5 ) in order to significantly improve the recognition of manipulations by combining image data. This data processing unit described later makes it possible to optimally evaluate the image data generated by the camera in order to immediately detect a manipulation attempt, such as a superstructure of the keyboard 2 or a manipulation on one of the cameras, and if necessary to trigger alarms and deactivations. By means of the data processing unit described in more detail later, the following manipulations can be reliably detected, among others:

• Attaching a keyboard superstructure
• Attaching a complete superstructure to the lower support surface
• Attaching a superstructure to the cash dispenser (shutter) and / or attaching items for receiving security information, in particular PIN no., Such as miniature cameras, camera phones and similar spy cameras.

For the detection of superstructures within the data processing unit 10 with the aid of the cameras CAMS and CAMD an optical measurement of the detected elements, such as e.g. the keyboard 2, carried out so as to be able to clearly recognize deviations in the case of manipulation. Tests by the applicant have shown that even reference deviations in the millimeter range can be clearly recognized. For example, a combination of edge detection and segmentation can be used for recognition of foreign objects (scouting camera) in order to be able to clearly recognize the contours of foreign objects in the control panel (for example miniature cameras). The required image data processing takes place predominantly in the data processing unit described below.

• Eine erste Stufe 11 zur Bildverarbeitung, eine zweite Stufe 12 zur Merkmalsextraktion und eine dritte Stufe 13 zur Klassifikation der verarbeiteten Daten. Die Stufe 13 wiederum ist mit einer Schnittstelle 14 verbunden, über die verschiedene Alarm- oder Überwachungsvorrichtungen aktiviert bzw. angesprochen werden können. Diese, im weiteren auch AISS genannten, Vorrichtungen umfassen unter anderem eine Bildfälschungs- bzw. Manipulationserkennung (IFD). Die erste Stufe 11 wiederum, welche zur Bildverarbeitung dient, ist auch mit einer zweiten Schnittstelle 15 verbunden, über die eine Verbindung zu der CCTV-Einheit 20 hergestellt wird. Mit Hilfe dieser CCTV-Einheit kann beispielsweise eine Fernüberwachung bzw. Ferndiagnose ausgeführt werden.

The FIG. 5 shows the block diagram of a data processing unit 10 according to the invention, to which the cameras CAMS, CAMD and CAMK are connected, as well as a CCTV unit 20, which is connected to the data processing unit 10. The data processing unit 10 has in particular the following stages or modules:

• A first stage 11 for image processing, a second stage 12 for feature extraction and a third stage 13 for the classification of the processed data. The stage 13 again is connected to an interface 14 via which various alarm or monitoring devices can be activated or addressed. These, also referred to below as AISS, devices include, inter alia, a Bildfälschungs- or manipulation detection (IFD). The first stage 11, which serves for image processing, is also connected to a second interface 15 via which a connection to the CCTV unit 20 is established. With the help of this CCTV unit, for example, a remote monitoring or remote diagnosis can be performed.

For processing the image data D generated by the cameras CAMS, CAMD and CAMK, the data processing unit 10 is initially responsible. The image data D first reaches the first stage 11, which carries out a preprocessing of the incoming image data, in which case, in particular, measures such as shadow removal, edge detection, vectorization and / or segmentation are performed. The downstream second stage 12 serves the feature extraction, which can be carried out for example by means of a so-called Blobanalyse, an edge positioning and / or a color distribution. For example, blob analysis is used to detect contiguous regions in an image and to take measurements on the blobs. A Blob (Binary Large Object) is an area of adjacent pixels with the same logical state. All the pixels in a picture belonging to a blob are in the foreground. All other pixels are in the background. In a binary image, pixels in the background have values that correspond to zero, while every pixel other than zero is part of a binary object.

Subsequently, in the step 13, a classification is made which determines whether or not an enemy manipulation has occurred at the self-service terminal ATM on the basis of the extracted features.

• Abspeichern eines Fotos des Angreifers, wobei sowohl einzelne der Kameras CAMS, CAMD und/oder CAMK wie auch die zusätzliche Portraitkamera CAMO aktiviert werden können
• Alarmieren der laufenden Geldautomatenapplikation und/oder eines zentralen Managementservers und/oder einer Person, z.B. über E-Mail
• Einleitung von Gegenmaßnahmen, die z.B. das Sperren bzw. Herunterfahren des Geldautomatens
• Übermittlung von Daten, insbesondere von Bildern, der erkannten Manipulation, beispielsweise über das Internet über eine Zentrale

The data processing unit 10 can be realized, for example, by means of a personal computer which is connected to the ATM ATM or which is integrated therein. In addition to the cameras CAMS, CAMD and CAMK, which detect the said subregions of the control panel CP, the additional camera CAMO can be mounted on the ATM ATM (s. Fig. 1 ), which is directed to the user or customer and in particular captures his face. This additional, also known as a portrait camera, camera CAMO can be triggered upon detection of a tampering attack to make a picture of the person located at the ATM. For example, once a skimming attack is detected, the described system can perform the following actions:

• Storing a photo of the attacker, whereby both individual CAMS, CAMD and / or CAMK cameras as well as the additional portrait camera CAMO can be activated
• Alert the current ATM application and / or a central management server and / or a person, eg via e-mail
• Initiation of countermeasures, such as the locking or shutdown of the ATM
• Transmission of data, in particular images, the detected manipulation, for example via the Internet via a central office

The size and nature of the actions taken or countermeasures can be configured by the operator of the ATM via the system described here.

As described above, several cameras can be provided directly on the control panel, with the cameras CAMS and CAMD detecting the control panel from the outside and the CAMK camera eg detecting the card input funnel from the inside. In addition, an additional portrait camera can be installed (see CAMO in Fig. 1 ). For the actual manipulation detection the cameras CAMS and CAMD are used on the control panel and the camera CAMK in the card input. For the purpose of documenting a manipulation attempt, the portrait camera CAMO is also used.

Preferably, all cameras have a resolution of at least 2 megapixels. The lenses used have a viewing angle of about 140 degrees and more. In addition, the exposure time of the cameras used in a wide range, for example, 0.25 msec. up to 8,000 msec. freely adjustable. This allows adaptation to a wide variety of lighting conditions. Applicant's experiments have shown that a camera resolution of about 10 pixels per degree can be achieved. Based on a distance of one meter, an accuracy of 1.5 mm per pixel can be achieved. This in turn means that manipulation can be reliably detected from a reference deviation of as little as 2 to 3 mm. The closer the camera lens is to the detected element or object, the more accurate the measurement can be. Thus, in closer areas even an accuracy of less than 1 mm can be achieved.

• Das Erfassen des Geldausgabefachs (Shutter) 1 ermöglicht das Überprüfen von Manipulationen in Form sogenannter Cash-Trapper, d.h. spezieller Überbauten. Das Erfassen des Tastaturfeldes ermöglicht es, dort Manipulationsversuche durch Überbauten oder Veränderungen an Lichtschutzmaßnahmen und dergleichen festzustellen. Das Erfassen der Auflagefläche ermöglicht es insbesondere, Komplettüberbauen zu erkennen. Das Erfassen des Karteneingabetrichters 4, insbesondere durch eine darin integrierte Kamera, ermöglicht es, dortige Manipulationen zu erkennen.

Depending on the area of use of the ATM, eg outdoors or indoors, as well as the given lighting conditions, it may be advantageous to mount the CAMS camera rather in the side housing part of the ATM ATM or in the upper housing area. Also arise depending on the camera position different monitoring options. When monitoring the various elements or subareas, the following is achieved in particular:

• The detection of the cash dispenser (shutter) 1 allows the verification of manipulations in the form of so-called cash trappers, ie special superstructures. The detection of the keypad makes it possible to determine there manipulation attempts by superstructures or changes to light protection measures and the like. The detection of the support surface makes it possible in particular to detect complete overbuilding. The detection of the card input funnel 4, in particular by a camera integrated therein, makes it possible to detect local manipulations.

It has been shown that even deviations of 2 mm can be clearly recognized, especially on the keypad and on the card input hopper. Deviations at the rear outer edge of the support surface can be detected as early as 4 mm. Deviations at the lower edge of the shutter can already be detected from 8 mm.

To detect manipulations, the data processing unit 10 (see FIG. 4 ) in particular a comparison of the recorded image data D with reference data. In particular, a picture of the outdoor area examined for its homogeneity and compared with the image of the exterior of the control panel camera.

• Unterscheidung von künstlicher und natürlicher Verdunklung: Wird eine Kamera abgedeckt, so steht ihr aufgenommenes Bild im Widerspruch zu den Bildern der anderen Kameras. Fällt das natürliche Licht (Tageslicht) oder das künstliche Licht (Raumbeleuchtung) aus, so ist der Effekt an allen Kameras gleich oder zumindest ähnlich. Andernfalls erkennt das System einen Manipulationsversuch.
• Erkennung von Täuschungsangriffen auf die Kamera-Anordnung, z.B. durch vorgeklebte Fotos: Zeigt eine einzelne Kamera ein anderes Bild (Helligkeit, Bewegung, Farben, insbesondere bezüglich des Außenbereichs), so deutet dies auf einen Täuschungsversuch hin.
• Erhöhung der Robustheit, insbesondere bei Abdeckung des Karteneinschubtrichters: Wird dieser verdeckt, so zeigt die darin integrierte Kamera (s. CAMK in Fig. 4a) ein anderes Bild an (insbesondere bezüglich des Außenbereiches) als die übrigen Kameras (s. CAMS, CAMD in Fig. 1).

The image data of the different cameras CAMS, CAMD and / or CAMK are also compared with one another in order to determine, for example, whether manipulation of individual cameras has occurred. If, for example, the CAMD camera has been covered, the result is a discrepancy with the images of the other cameras. In particular, it can be determined very quickly on the basis of the image brightness whether a darkening occurs only on a single camera, so that a manipulation or cover of this camera is to be assumed. The combination and evaluation of several camera signals or image data increases the robustness of the manipulation monitoring and the avoidance of false alarms. Among other things, the image data or information can also be used as follows:

• Distinction between artificial and natural obscuration: If a camera is covered, its recorded image is in conflict with the images of the other cameras. If the natural light (daylight) or the artificial light (room lighting) fails, the effect is the same or at least similar on all cameras. Otherwise, the system detects a tampering attempt.
• Detection of deception attacks on the camera arrangement, eg by pre-glued photos: If a single camera shows a different picture (brightness, movement, colors, especially with regard to the outside area), this indicates an attempt to deceive.
• Increased robustness, especially when the card slot is covered: If it is hidden, the integrated camera (see CAMK in Fig. 4a ) displays another image (especially with respect to the outside area) than the other cameras (see CAMS, CAMD in Fig. 1 ).

• Abfrage eines Bildes, Einstellen der Bildrate, des Farbmodells, der Bildauflösung, Auslösen eines Ereignisses im CCTV-Dienst bei Bereitstellung eines neuen Bildes und/oder eventuell eine visuelle Hervorhebung von erkannten Manipulationen auf einem bereitgestellten Bild.

Furthermore, for example, the surroundings can also be examined for radiation of the illumination for the card input trellis 4. The connection of the system to the Internet via the interface 23 makes it possible to remotely control the camera or the various cameras. The acquired image data can also be transmitted via the Internet connection to a video server. Thus, the respective camera virtually acts as a virtual IP camera. In particular, the CCTV unit 20 described above is used for such a video surveillance facility, wherein the interface 15 to the CCTV unit is designed for the following functions:

• Query an image, adjust frame rate, color model, image resolution, trigger an event in the CCTV service when a new image is provided, and / or possibly visually highlight detected manipulations on a rendered image.

The system is designed so that no false alarms are generated by hands and / or objects in the picture during normal operation (eg withdrawing money, checking account balance, etc.). Therefore, the tamper detection is disabled during the period of normal machine use. Also, in time periods in which, for example, a cleaning or a short-term other use (filing of account statements, interactions before and after the start of a transaction) is not be used for manipulation detection. Essentially, therefore, only rigid and immovable manipulation attempts are preferably analyzed and recognized. The system is designed to work in a wide variety of lighting conditions (day, night, rain, cloudy, etc.). Also, briefly changing light conditions, such as light reflections, shadows and the like, are compensated or ignored during image processing to avoid a false alarm. In addition, technically occurring events, such as the failure of a lighting and the like, are taken into account. These and other special cases are recognized and solved in particular by the third stage for classification.

• Zunächst erfolgt in einem ersten Schritt eine Bildaufnahme (Stufe 11), wobei die Kameraparameter eingestellt werden, um geeignete Aufnahmen zu erzeugen. Dabei wird insbesondere eine Reihe von Bildern bzw. entsprechende Bilddaten D aufgenommen, welche dann als Grundlage bzw. Referenz für die Vorverarbeitung dienen.

The method for manipulation detection performed by the described system has in particular the following sequence (see also FIG Fig. 4 ):

• First, in a first step, an image acquisition (stage 11), wherein the camera parameters are adjusted to produce suitable recordings. In particular, a series of images or corresponding image data D is recorded, which then serves as the basis or reference for the preprocessing.

• Schattenentfernung, Entfernung sich bewegender Objekte, Entfernung von Rauschen und/oder Zusammenfassung verschiedener belichteter Aufnahmen.

This is followed by preprocessing of the image data D (stage 11), these being processed in such a way that they are as suitable as possible for further processing. For this purpose, for example, several images are combined to form a target image and optimized by means of image enhancement algorithms. In particular, the following steps are carried out:

• Shadow removal, removal of moving objects, removal of noise and / or summary of various exposed shots.

The cameras are u.a. set to different exposure times to remove reflections and to collect well-lit areas. Preferably, the images are collected over a predetermined period of time to obtain the best possible output images for manipulation detection. In a third step, a feature extraction is performed (step 12) in which image analysis processes are performed on the preprocessed images to validate them for particular features, such as image analysis. on edge positions or color distributions. For each feature, a number or a value can be specified, which indicates how well the corresponding feature was found again in the viewed image. The values are summarized in a so-called feature vector.

• Learning Classify Systems, Bayes Klassfikatoren, Support Vector Machines (SVM) oder Entscheidungsbäume (CART bzw. C 4.5).

In a further step, a classification is carried out (step 13), ie the feature vector is passed to a classification procedure to make a decision as to whether there is a manipulation or not. It also uses those types of classifiers that can indicate the confidence, ie probability or certainty, of the decision. Classification mechanisms used can be, for example:

• Learning Classify Systems, Bayes Classifiers, Support Vector Machines (SVM) or Decision Trees (CART or C 4.5).

The system described herein is preferably modular in design to allow for different configurations. The actual image processing as well as the CCTV connection are realized in different modules (see FIG. 4 ).

• Abfrage von Kameradaten, wie z.B. Anzahl der Kameras, Bauzustand, Seriennummer, usw., Kamerastammdaten bzw. Einstellen von Kameraparametern und/oder Registrierung für Alarme (Notifikationen).

The system presented here is also suitable for documenting the detected manipulations or digitally archiving them. In the case of a detected manipulation, the recorded images are stored with corresponding meta-information, such as time stamp, type of manipulation, etc., on a hard disk in the system or in a connected PC. For reporting purposes, messages can also be forwarded to a platform, such as error messages, status messages (deactivation, mode change), statistics, suspected manipulation and / or alarm messages. In the event of an alarm, a corresponding message with the respective alarm level can be forwarded to the administration interface or the interface. The following options are also implemented at this interface:

• Query of camera data, such as number of cameras, construction status, serial number, etc., camera master data or setting of camera parameters and / or registration for alarms (notifications).

The invention presented here is particularly suitable for reliably detecting hostile manipulations on a self-service terminal, such as at an ATM. For this purpose, the control panel is continuously and automatically monitored by at least one camera. By means of an image data processing, those of optically measure the elements detected by the camera in order to detect deviations from reference data. It has been shown that even deviations in the millimeter range can be reliably detected. For the detection of foreign objects, a combination of edge detection and segmentation is preferably used, so that contours of left objects can be clearly recognized and marked. In the case of a manipulation attempt countermeasures or actions can be triggered.

By the combination of several cameras proposed here and the intelligent image data processing, the invention significantly increases the reliability with which manipulations can be detected.

• Eine Kamera am Karteneingabetrichter, eine Kamera am Bedienfeld und eine Kamera im oberen Bereich des Geldautomaten zum Aufnehmen von Portraitfotos bzw. -videos. Außerdem sind die Kameras mit der beschriebenen Datenverarbeitungseinheit verbunden. Innerhalb der Datenverarbeitungseinheit werden die von den Kameras gewonnenen Bilddaten bzw. Informationen unter anderem wie folgt genutzt:
  • Erkennung bzw. Unterscheidung von künstlicher und natürlicher Verdunklung: Wird eine Kamera abgedeckt, so widerspricht sich ihr aufgenommenes Bild mit den Bildern aus den Kameras. Fällt natürliches oder künstliches Licht aus, so tritt dieser Effekt bei allen Kameras gleichermaßen auf. Erkennung von Täuschungsangriffen auf das Kamerasystem, z.B. durch vorgeklickte Fotos: Zeigt eine Kamera ein anderes Bild (unterschiedliche Helligkeit, Bewegung, Farben, usw.), so deutet dies auf einen Täuschungsversuch hin. Erhöhung der Robustheit der Abdeckungserkennung am Karteneingabetrichter: Wird der Karteneingabetrichter verdeckt, so zeigt die dort integrierte Kamera CAMK ein anderes Bild des Außenbereichs an, als dies die übrigen Kameras tun.

In a preferred embodiment, the invention has the following camera arrangement:

• A camera on the card slot, a camera on the control panel, and a camera on the top of the ATM for taking portraits or videos. In addition, the cameras are connected to the described data processing unit. Within the data processing unit, the image data or information obtained by the cameras is used, inter alia, as follows:
  • Recognition or distinction of artificial and natural obscuration: If a camera is covered, its captured image contradicts the images from the cameras. If natural or artificial light fails, this effect is equally noticeable on all cameras. Detection of deception attacks on the camera system, eg by previewed photos: If a camera displays a different image (different brightness, movement, colors, etc.), this indicates an attempt to deceive. Increasing the robustness of the cover detection on the card input hopper: If the card slot is hidden, the integrated camera CAMK displays a different image of the outside area than the other cameras do.

Increasing the reliability of detection of tampering attempts also serves to avoid false alarms.

In summary, a self-service terminal is proposed, the various control elements, such as a card insertion funnel (see "4" in Fig. 4a ), wherein for detecting manipulation attempts at the self - service terminal at least one camera (see CAMK in Fig. 4a ) is integrated in this operating element, that is, for example, in the card insertion funnel, and several subregions assigned to this operating element, such as inner, outer and transition regions, are detected (see FIG Fig. 4b ). It is also possible to provide illumination which illuminates one or some of the partial regions, for example the inner region or slot region of the card insertion funnel, as a result of which image acquisition is also improved. In addition, the construction may be provided with a photoconductive plastic over which a light generated by the illumination is conducted and distributed.

The present invention has been described using the example of an ATM, but is not limited thereto, but can be applied to any type of self-service terminals.

LIST OF REFERENCE NUMBERS

1. 1 Geldausgabefach
2. 2 Tastatur
3. 3 Ablagefläche
4. 4 Karteneingabetrichter
5. 5 Bildschirm

• CAMK Kamera, im Karteneingabetrichter montiert
• CAMS Kamera, seitlich des Bedienfeldes montiert
• CAMD Kamera, oberhalb des Bedienfeldes montiert
• CAMO zusätzliche Portrait-Kamera

ATM self-service terminal, designed as an ATM, with a control panel CP, which includes:

1. 1 cash dispenser
2. 2 keyboard
3. 3 shelf space
4. 4 card entry funnels
5. 5 screen

• CAMK camera, mounted in card slot
• CAMS camera, mounted on the side of the control panel
• CAMD camera, mounted above the control panel
• CAMO additional portrait camera

1. I ersten Teilbereich (Innenbereich des Kartenschlitzes)
2. II zweiten Teilbereich (Übergangsbereich)
3. III dritten Teilbereich (Außenbereich)

• 10 Datenverarbeitungseinheit mit:
  • 11 erster Stufe zur Bildverarbeitung
  • 12 zweiter Stufe zur Merkmalsextraktion
  • 13 dritte Stufe zur Klassifikation
  • 14, 15 Schnittstellen zu Videoüberwachung (CCTV) bzw. Bildfälschungserkennung
• 20 Videoüberwachungs- bzw. CCTV-Einheit mit:
  • 21 Stufe für Bildaufnahme
  • 22 Stufe für Komprimierung
  • 23 Schnittstelle zu einen IP-Netz
  • 24 Stufe für Parametrisierung

Detection range of CAMK camera divided into:

1. I first section (inside of the card slot)
2. II second subarea (transitional area)
3. III third section (outdoor area)

• 10 data processing unit with:
  • 11 first level for image processing
  • 12 second stage feature extraction
  • 13 third level for classification
  • 14, 15 interfaces to video surveillance (CCTV) or image counterfeit detection
• 20 Video surveillance or CCTV unit with:
  • 21 level for image recording
  • 22 level for compression
  • 23 Interface to an IP network
  • 24 level for parameterization

Claims (14)

1. Self-service terminal (ATM) that has elements (1, 2, 3, 4, 5) provided in a control panel of the self-service terminal (ATM) that are provided for users of the self-service terminal (ATM), wherein at least one camera is provided for monitoring the self-service terminal (ATM), wherein, for the purpose of identifying manipulation attempts on the self-service terminal (ATM), at least one (CAMK) of the cameras is integrated in one of the elements (4) provided in the control panel (CP) and captures multiple subareas (I, II, III) associated with the element (4), characterized in that
   the subareas comprise at least one inner area (I) and an outer area (III) of the element (4), in that the element (4) captured in subareas by the camera (CAMK) is a user element that is suitable for manipulation in the form of a card insertion shaft (4),
   in that the element (4) captured in subareas by the camera (CAMK) has a lighting system (L),
   in that the lighting system (L) illuminates one or some (I, II) of the subareas of the element (4), and
   in that the card insertion shaft (4) has, as a subarea, a slot area (I) that is illuminated by the lighting system (L).
2. Self-service terminal (ATM) according to Claim 1, characterized in that one of the subareas comprises a transition area (II) between the inner area (I) and the outer area (III) of the element (4).
3. Self-service terminal (ATM) according to Claim 1, characterized in that the slot area (I) is provided with a light-guiding plastic (K) via which a light produced by the lighting system (L) is guided.
4. Self-service terminal (ATM) according to one of the preceding claims, characterized in that the at least one camera (CAMK) is connected to a data processing unit (10) that processes image data (D) produced by the at least one camera (CAMK), particularly segments and processes the image data (D) in accordance with the subareas (I, II, III).
5. Self-service terminal (ATM) according to Claim 4, characterized in that the data processing unit (10) has a first stage (11) for image processing, particularly for shadow removal, edge detection, vectorization and/or segmentation, that receives the image data (D).
6. Self-service terminal (ATM) according to Claim 5, characterized in that the data processing unit (10) has a second stage (12) for feature extraction, particularly by means of blob analysis, edge position and/or colour distribution, that is connected downstream of the first stage (11).
7. Self-service terminal (ATM) according to Claim 6, characterized in that the data processing unit (10) has a third stage (13) for classification that is connected downstream of the second stage (12).
8. Self-service terminal (ATM) according to one of Claims 4 to 7, characterized in that the data processing unit (10) has interfaces (14, 15) for video monitoring systems (20) and/or security systems.
9. Self-service terminal (ATM) according to one of Claims 4 to 8, characterized in that the data processing unit (10) is integrated in the self-service terminal (ATM).
10. Self-service terminal (ATM) according to one of the preceding claims, characterized in that the self-service terminal (ATM) has at least one further camera (CAMS, CAMD) that is mounted on or in the self-service terminal (ATM) in proximity to the control panel (CP) and captures at least one of the elements (1, 2, 3, 4, 5).
11. Self-service terminal (ATM) according to Claim 10, characterized in that the elements provided in the control panel and captured by the cameras (CAMK, CAMS, CAMD) comprise a cash dispensing compartment (1), a keypad (2), a holding area (3), a card insertion shaft (4) and/or a screen (5).
12. Self-service terminal (ATM) according to one of the preceding claims, characterized in that the self-service terminal (ATM) has an additional camera (CAMO) provided for an area over which a user, particularly the head of said user, is located during operation of the self-service terminal (ATM).
13. Self-service terminal (ATM) according to one of Claims 4 to 12, characterized in that the data processing unit (10), when identifying a manipulation attempt on the captured elements (1, 2) from the processing of the image data (D), triggers an alarm, disables the self-service terminal (ATM) and/or triggers the additional camera (CAMO).
14. Self-service terminal (ATM) according to one of Claims 4 to 13, characterized in that the respective camera (CAMS) and/or the data processing unit (10) is deactivated during operation and/or servicing of the self-service terminal (ATM).

Images