EP3782136B1 - Method for the verification of a luminescent-material-based security feature - Google Patents

Method for the verification of a luminescent-material-based security feature Download PDF

Info

Publication number
EP3782136B1
EP3782136B1 EP19722517.0A EP19722517A EP3782136B1 EP 3782136 B1 EP3782136 B1 EP 3782136B1 EP 19722517 A EP19722517 A EP 19722517A EP 3782136 B1 EP3782136 B1 EP 3782136B1
Authority
EP
European Patent Office
Prior art keywords
security feature
phosphor
image
emission
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP19722517.0A
Other languages
German (de)
French (fr)
Other versions
EP3782136A1 (en
Inventor
Lazar KULIKOVSKY
Detlef Starick
Manfred Paeschke
Jörg Fischer
Frank Fritze
Ilya Komarov
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bundesdruckerei GmbH
Original Assignee
Bundesdruckerei GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bundesdruckerei GmbH filed Critical Bundesdruckerei GmbH
Publication of EP3782136A1 publication Critical patent/EP3782136A1/en
Application granted granted Critical
Publication of EP3782136B1 publication Critical patent/EP3782136B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07DHANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
    • G07D7/00Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
    • G07D7/06Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency using wave or particle radiation
    • G07D7/12Visible light, infrared or ultraviolet radiation
    • G07D7/1205Testing spectral properties
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07DHANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
    • G07D7/00Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
    • G07D7/20Testing patterns thereon
    • G07D7/2008Testing patterns thereon using pre-processing, e.g. de-blurring, averaging, normalisation or rotation
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07DHANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
    • G07D7/00Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
    • G07D7/20Testing patterns thereon
    • G07D7/2016Testing patterns thereon using feature extraction, e.g. segmentation, edge detection or Hough-transformation
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07DHANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
    • G07D7/00Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
    • G07D7/20Testing patterns thereon
    • G07D7/202Testing patterns thereon using pattern matching
    • G07D7/205Matching spectral properties

Definitions

  • the present invention relates to a method for verifying a security feature.
  • the photochromic security feature shows a color change and/or a change in shape under the action of a flash light excitation. It is also described that the security feature is based on a retinal protein.
  • the DE 10 2011 082 174 A1 and the WO 2013/034471 A1 describe an apparatus for recognizing a document having a security feature with wavelength conversion properties.
  • a light generating device is provided, which irradiates the security feature with excitation light, and an image recording device, which records the light emitted by the security feature.
  • the WO 2013/034603 A1 describes a method for verifying a security document with a security feature in the form of a fluorescent printing element.
  • the method provides that the printing element is excited by means of a light source and it is thereby exposed to electromagnetic radiation emitted, which is detected in a further step by means of a sensor.
  • the recorded data is evaluated by comparing it with specified data.
  • the verification result is output depending on the result of the comparison.
  • the method is to be carried out with a smartphone, the flash module of the smartphone being used as the excitation source and the photo sensor of the camera of the smartphone being used as the detection unit.
  • the device includes a camera module, a processor unit and a display.
  • RADKE, RJ et al "Image change detection algorithms: a systematic survey”, IEEE TRANSACTIONS ON IMAGE PROCESS, Vol. 14, No. 3, 2005-03-01, pages 294-307, ISSN: 1057-7149 , describes algorithms for detecting image changes when viewing multiple images of the same subject at different points in time. Among other things, the alignment of the images and the determination of the image difference are explained.
  • DE 10 2011 121 566 A1 shows a method for assisting a user in checking the authenticity of a bank note.
  • a portable data processing system with a camera and a screen is used.
  • the data processing system uses a recorded image to check a security feature of the bank note.
  • U.S. 2007/090190 A1 shows a code reader for displaying an image that was recorded by a camera. Furthermore, the code reader is used to extract a code image from the image and to decode a code contained in the code image.
  • the security feature includes physical or logical security elements, which can be excited by energy using a mobile device and can also be detected.
  • the DE 20 2016 002 731 U1 describes a device for a portable smart device with a camera, the device being a case.
  • the case features a slot where the smart device is positioned so that the camera is also aligned.
  • the device also includes a UV and/or blue light illumination unit for illuminating an object to be authenticated.
  • the device also includes a positioning device for positioning the device relative to the object to be authenticated.
  • the emissions originating from the security feature are regularly already high when triggered by a smartphone flash decayed before the picture can be taken with the camera of a smartphone after the end of the excitation.
  • luminescent-based security features are hardly suitable for verification that is easy to carry out under everyday conditions and at the same time meets comparatively high security requirements, since they cannot be verified with inexpensive and widely used devices.
  • Either the well-known security features require very special testing devices that can only be provided by larger units such as banks or passport control offices.
  • the security features that can be checked with generally available devices such as smartphones in particular are easy to forge.
  • the security feature should be able to be detected by means of an image recording unit of a smartphone and also be verifiable with the data processing unit of the smartphone. In particular, not only the presence of an emission but specific properties of the emission should be checked during verification.
  • the object is achieved by a method for verifying a luminescent-based security feature according to appended claim 1.
  • a general solution idea for the stated task, which the invention implements, is that a security feature with a specific phosphor is equipped that circumvents the problems described above.
  • this phosphor must be configured in such a way that it can be excited with a light source of a smartphone or a similar mobile data processing device, ie in particular a flashing LED of a smartphone.
  • the phosphor must have such a luminescence characteristic (luminescence yield, decay time) that it is still possible to reliably detect the decaying luminescence signals even after the end of the flash light excitation.
  • the decay time and the emission occurring during the decay must be distinguishable from other phosphors and, in addition, the decaying luminescence signals should not be visually perceptible to humans.
  • the method according to the invention serves to verify a luminescent-based security feature that can be stimulated to emit and is arranged on a security document.
  • the method can be carried out using a smartphone or a similar mobile device, which is Software, preferably configured and controlled in the manner of an app.
  • a security feature that can be evaluated by the method according to the invention is applied to a security document or introduced into it and includes the above-mentioned phosphor.
  • the phosphor can be excited to luminescence with electromagnetic radiation of a predetermined wavelength, whereupon it emits radiation.
  • the emission of the phosphor has a decay time in the ms range.
  • the decay time is preferably selected in the range between 1 and 100 ms, particularly preferably in the range between 5 and 50 ms, again preferably between 10 and 30 ms.
  • the emission of the phosphor can be detected by means of an image acquisition unit of a smartphone.
  • the security document is positioned in such a way that the security feature is captured by an image recording unit of the smartphone.
  • this is done by manually positioning the security document in front of the image capture unit.
  • a semi-transparent mask or a position frame is preferably shown in the display of the mobile terminal as user support, which serves as a position aid.
  • An identifier which can be visually perceived by a human being and which is positioned within the positioning frame can be attached to the security document.
  • the security feature is then attached in the vicinity of this identifier so that it is within the detection range of the image detection unit.
  • object recognition can be carried out using the image acquisition unit and a data processing unit of the smartphone (mobile terminal device).
  • the object recognition indirectly serves to determine the position of the security feature on the document and/or it supports the positioning of the smartphone over the security document.
  • Object detection can also be used to automatically trigger detection.
  • a recording frame or a recording window is defined, its position being defined using the previously determined position of the security feature and the recording frame being selected such that the security feature is arranged in the area of the recording frame.
  • the security feature is excited to luminescence by means of an illumination unit of the smartphone (mobile terminal device), so that the security feature emits electromagnetic radiation.
  • the lighting unit and image recording unit are controlled by the data processing unit of the smartphone using an app (software application), with a combination of single flash and video recording or single flash and series recording taking place and with the lighting unit being switched off after the phosphor of the security feature has been activated, so that the decaying emission can be recorded by the image recording unit after the flash has ended.
  • An optional method step provides that a reference area is defined, which is located directly adjacent to the security feature.
  • the evaluation of captured images of the security feature and the reference area as well as the differences captured there can be helpful for verifying the document in the case of heavily flickering extraneous light.
  • a series of images or a video of the security feature and optionally of the reference area is recorded using an image recording unit of the smartphone in order to record the emission.
  • the recording preferably takes place in the defined recording area.
  • the emission is recorded after the excitation has ended, ie after the flashlight has been switched off.
  • the recording time of the series of images or the video recorded by the image acquisition unit is preferably selected such that emission of the security feature can no longer be detected in the last image of the series of images or the video, provided the predetermined decay times of the phosphor of the security feature are observed.
  • This last image is recorded as a reference image (B ref ).
  • a start image can also optionally be recorded before the phosphor is excited, which can be included in the verification as a further reference.
  • the captured or recorded series of images or videos are processed by the data processing unit and compared with specification or reference data.
  • reference data are stored in the smartphone, which are compared with the determined emission parameters.
  • the image differences between the captured images and the reference image captured after the emission has decayed are preferably generated ( ⁇ 1R -B 1 -B ref ... ⁇ nR -B n -B ref ), from which the emission values are then calculated as the hue value of the different color channels using an RGB histogram, and then the decay time of the phosphor is calculated the determined data is analyzed.
  • the number of images is preferably between 5 and 15 images.
  • These values can be determined from a histogram of the images or the image difference.
  • the presence of the security feature in the area of the receiving frame can be verified by the comparison and the authenticity of the security document can subsequently be checked.
  • the authenticity and integrity of the security document can be checked by verifying the security feature on the security document.
  • the reference image which is the last image in the series of images, is generated in a predetermined time frame, in particular in the ms range, as a result of which emissions with decay times greater than the ms range are also filtered out.
  • the reference image can be compared with the start image recorded before activation of the excitation radiation.
  • the recording speed when generating the series of images is selected in such a way that fluorescent phosphors or features with short decay times, i.e. in the ps range, are ruled out as non-verifiable, since such short emissions are not recorded with sufficient intensity.
  • fluorescent phosphors or features with short decay times i.e. in the ps range
  • phosphors with long decay times are ruled out as non-verifiable. If one of the two above features indicates a fluorescent or phosphorescent phosphor, then the result of the authenticity of the security feature is output as "false".
  • the external shape of the security feature can also be checked.
  • the authenticity is determined as "false”.
  • the spectral distribution of the radiation emitted by the phosphor and the decay time of the phosphor of the security feature are checked. If the spectral position and the decay time of the phosphor match the stored values, and if the other features are still positive (“genuine"), the verification shows that the security feature is "genuine”.
  • the optional object recognition preferably includes various image processing steps, such as filter applications for noise reduction, contrast adjustment or color channel enhancement, a shape analysis for detecting the security feature.
  • the noise can be reduced, for example, by means of morphological filters such as erosion or dilatation.
  • Template matching can be used for shape analysis.
  • the Fast Fourier Transform (FFT) of the images can also be used.
  • the distance between the security document with the security feature and the image capture unit of the smartphone is selected to be smaller than the distance of the focusing range of the image capture unit. No optical focusing or focus adjustment is required.
  • the distance between the smartphone camera and the security feature when capturing the images can therefore be chosen to be very small, since no sharp images are required for the present method because only the emission and, if necessary, the shape of the security feature are captured.
  • the small distance between the security feature and the camera has the advantage that more energy is available for exciting the phosphor of the security feature, and that the emission of the phosphor is recorded over a wide solid angle.
  • the minimization of the distance between the camera and the security feature is particularly important due to the quadratic dependency of the intensity of the flash light on the distance to the excitation source or the emission on the distance to the detection unit. In this way, a comparatively low emission can also be recorded, which would no longer be detectable when taking a picture in the focussing range. This reduces the false rejection rate (ie a genuine security document is evaluated as false).
  • standard smartphones have a focus range of 60 mm.
  • a distance of between 10 mm and 80 mm between the image capturing unit and the security document with security feature is therefore preferably used for recording the images for the method.
  • the distance between the image capture unit and the security document with the security feature during the image recording is particularly preferably less than 50 mm.
  • Another advantage of using blurred images is to reduce the resolution of the images, thereby speeding up the processing of the images.
  • a reference area is selected next to the area of the security feature, ie next to the area of the phosphor.
  • the two areas Preferably, the two areas have the same visible body color. This can be used to compensate for exposure fluctuations during recording under artificial light (50 Hz flickering).
  • the positions of the phosphor and the reference area are preferably on predefined in the security document (e.g. relative to a prominent character on the document). For the verification, an equal number of pixels in both areas is selected for all captured images and an image difference for these sections is created for each image.
  • An additional verification factor can be used for certain phosphors, in particular silicate garnets. These phosphors show a broad emission spectrum with local maxima in the green and red spectral range, which also have different decay times. As a result, a characteristic color shift is detected in decay measurements over the entire visible spectral range, which can also be used as an authenticity criterion.
  • a further advantage of the method is that the known smartphone, which is available to a large number of users, can be used as a mobile terminal device for verifying the security feature. A quick, internal evaluation and authentication of the fluorescent emissions measured with the smartphone is carried out. It is also advantageous that the distance between the security feature and the image capturing unit can be kept small, since at the same time the security feature is covered from ambient light, such as daylight or room light.
  • the method with its method steps is preferably provided as an application or app for the smartphone.
  • the image frequency of the image sensor used determines a lower limit, which must be reached through the decay behavior of the phosphor.
  • the emission of the security feature should not be detectable by human visual perception.
  • the decay time of the phosphor should be less than 1 s, since after 1 s the phosphor begins to glow, which can be perceived by humans.
  • the phosphor is chosen so that its decay time is in the single-digit or double-digit ms range.
  • the decay time of the phosphor (always considered from the time the excitation source is switched off) of the security feature is preferably in the range from 1 ms to 50 ms.
  • the phosphor of the security feature particularly preferably has a decay time of 10 ms to 30 ms.
  • the phosphor is configured in such a way that it can be excited in the visible spectral range, in particular in the blue spectral range, so that the flash light source of the smartphone can deliver this excitation radiation. Furthermore, the phosphor is configured in such a way that it emits in the visible spectral range, with this emission not being detectable by the user through visual perception due to the short decay time.
  • the white light of the lighting unit of a smartphone is generated by an LED, which consists of an LED semiconductor chip with an emission at around 450 nm and LED conversion phosphors placed above the LED semiconductor chip, the conversion phosphors reflecting the emission of the convert blue LED proportionately into longer-wavelength visible luminescence radiation (broadband emission in the green, yellow and red spectral range) with an emission maximum of around 560 nm, for example.
  • the white light of the LED available as the lighting unit of commercially available smartphones results from the additive color mixture of the individual luminescence components described, with the blue spectral component having the higher intensity.
  • the phosphor that can be used to provide the security feature according to the invention must preferably be configured in such a way that it has a high efficiency of spectral excitability, particularly in the range between 420 nm and 470 nm.
  • the phosphor particularly preferably has an effective excitation wavelength of 450 nm.
  • the smartphone camera is available as an image acquisition unit for detecting the luminescence signals of the phosphor.
  • the image acquisition unit is preferably a CMOS sensor which is equipped with an IR filter, as a result of which there is a spectral sensitivity of up to approximately 750 nm. Single images, series of images or videos can be recorded by means of the image acquisition unit.
  • the method according to the invention can be used in various test devices.
  • Such testing devices can be used as a retrofit module for stationary testing (e.g. in ATMs) or preferably designed as a mobile terminal device.
  • the mobile end device is preferably a smartphone, but can also be a tablet or another similar multifunctional data processing device that includes a camera with an image capture unit and/or a lighting unit and a data processing unit.
  • the data processing unit is preferably a Processor, in particular a microprocessor.
  • the test can also be carried out using stationary terminals or other data processing systems with image acquisition units (e.g. desktop monitors or service terminals).
  • the phosphor is preferably arranged in the security feature in such a way that it forms a pattern.
  • the phosphor in particular the luminescence pigments of the phosphor, are preferably applied to a carrier as a defined pattern.
  • the pattern can be arranged as a shape such as a triangle or a star.
  • the pattern of the security feature formed by the phosphor can contain data and be arranged as a code, for example a QR code.
  • the pigments of the phosphor are printed as a security feature, for example, on a security document or on a layer of a security document.
  • the printing or application of the phosphor on the security document can be carried out using known printing methods such as e.g. B. gravure printing, flexographic printing, offset printing, screen printing or digital printing processes.
  • the phosphor can be applied to the security document by coating processes or lamination processes.
  • the security feature can only be verified by selecting the phosphor with a decay time in the ms range. It has proven to be advantageous that, due to the specially selected phosphor, its emissions can still be reliably measured even after the end of the excitation process. Both the phosphor can be verified via the decay time and the emission spectrum, as well as by the Fluorescent formed patterns as a further safety factor. A high degree of security against counterfeiting can thus be achieved by combining several factors. For secure authentication of a security document with the security feature, this can be arranged, for example, in an area of a further security feature, such as an image.
  • the security feature can be applied to different security documents, for example a bank note, an identity card, a passport, a driver's license, a ticket, a stamp or the like.
  • FIG. 1 shows a security feature 01 according to the invention, which is applied to a document of value, namely a security document 02 in the form of a bank note, which is represented symbolically.
  • the security feature can be used to verify security document 02.
  • the security feature 01 has the shape of a star here. It is positioned below a visible feature 03, here the face value of the banknote.
  • the security feature 01 consists of a phosphor that can be excited to luminesce by means of electromagnetic radiation with a predetermined wavelength, as mentioned above and explained in detail in the applicant's further patent application that is included.
  • the security feature 01 can be verified using a method in which the authenticity of the security feature 01 is checked.
  • FIG. 2 shows a schematic arrangement for verifying the security feature 01, the security feature 01 being excited to luminescence by means of an illumination unit 04 of an image recording unit 06 of a mobile terminal device, in particular a smartphone 07, in that the illumination unit 04 generates excitation light, in particular a flashlight 08.
  • the flashing light 08 of the image recording unit 06 is generated by means of an LED emitting white light.
  • the flashlight 08 has an intensity I A .
  • the phosphor of security feature 01 emits electromagnetic radiation, which occurs for a decay time in the ms range after excitation has ended.
  • the emission I E of the phosphor can be detected with a camera or a detector 09 of the image recording unit 06.
  • the detector 09 detects an impinging on the security feature 01 and the bank note 02 and reflected on them Ambient radiation I 0 of daylight or room light.
  • the ambient radiation I 0 is kept low in the method according to the invention, since a distance d between the security feature 01 and the smartphone 07 can be kept small. Due to the small distance d, which is below the focusing range (focus) of the image recording unit 06, the smartphone 07 shields the ambient radiation I 0 for the most part.
  • FIG. 3 a diagram with the rise and fall behavior of the phosphor used in security feature 01 is shown.
  • An emission curve 11 of the security feature 01 excited to luminescence is shown in the diagram along a time axis t. Furthermore, a flash light excitation curve 12 is plotted along the time axis. If the flash is fired using the smartphone 07 ( 2 ) is generated, the flashlight excitation curve 12 rises steeply, holds its level for a short time and then falls to zero after the flashlight has gone out.
  • the phosphor of the security feature 01 is excited to luminescence by the electromagnetic radiation of the flash light, as a result of which its emission curve 11 rises almost simultaneously with the flash light emission curve 12, regularly with a reduced steepness. After the flash light has gone out, the emission curve 11 drops significantly more slowly than the flash light excitation curve.
  • the decay behavior of the phosphor is in the ms range.
  • Captured images 13 of the security feature 01 are shown.
  • the images 13 show the decaying emission of the security feature 01 as a pattern that becomes weaker over time.
  • you can use another Process step are used.
  • a reference image 14b can be recorded as the last image of the recorded image sequence.
  • an additional reference image 14a can also be recorded before the activation of the excitation radiation (triggering of the flash).
  • An additional check of the security feature is possible, for example, by comparing the reference images 14a and 14b with one another.
  • a positioning step 41 the secure document to be verified is positioned in such a way that it can be securely captured by the smartphone's image capture unit.
  • the start image 14a of the security feature is already generated before the triggering of the flash light excitation of the smartphone.
  • a detection step 43 a single flash is triggered with the help of the image recording unit of the lighting unit of the smartphone and a serial image or video recording is carried out in order to record the luminescence signals of the phosphor used to create the security feature that are present after the end of the flash light excitation and decay in the ms range.
  • an emission analysis step 44 the recorded series of images and the reference recordings are compared using the data processing unit.
  • other image processing methods such as contrast adjustment and histogram analysis of the different color channels are used in order in this way to determine both the spectral emission and the exclusive decay characteristics of the to verify the phosphor used.
  • object recognition can be performed.
  • the authenticity of the checked security document can be confirmed in a release step 45 by comparing the calculated parameters with the authenticity parameters of the security feature that are preferably stored in the data memory of the smartphone.
  • the authenticity and integrity of the security document can be confirmed by the verification of the security feature on the security document.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Inspection Of Paper Currency And Valuable Securities (AREA)
  • Credit Cards Or The Like (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)

Description

Die vorliegende Erfindung betrifft ein Verfahren zur Verifikation eines Sicherheitsmerkmals.The present invention relates to a method for verifying a security feature.

Aus dem Stand der Technik ist es seit langem bekannt Sicherheitsdokumente mit Sicherheitsmerkmalen in Form von lumineszierenden Substanzen zu versehen, um sie fälschungssicher bzw. verifizierbar zu machen. Solche Sicherheitsmerkmale müssen durch geeignete Verfahren verifiziert werden.It has long been known from the prior art to provide security documents with security features in the form of luminescent substances in order to make them forgery-proof or verifiable. Such security features must be verified using suitable procedures.

Aus der WO 2012/083469 A1 ist eine Vorrichtung zur Authentifizierung von mit fotochromen Systemen markierten Dokumenten bekannt. Das fotochrome Sicherheitsmerkmal zeigt unter Einwirkung einer Blitzlichtanregung eine Farbänderung und/oder eine Formänderung. Es wird weiterhin beschrieben, dass das Sicherheitsmerkmal auf Basis eines Retinalproteins ausgebildet ist.From the WO 2012/083469 A1 a device for the authentication of documents marked with photochromic systems is known. The photochromic security feature shows a color change and/or a change in shape under the action of a flash light excitation. It is also described that the security feature is based on a retinal protein.

Die DE 10 2011 082 174 A1 und die WO 2013/034471 A1 beschreiben eine Vorrichtung zum Erkennen eines Dokuments, das ein Sicherheitsmerkmal mit Wellenlängen-Konversionseigenschaften aufweist. Dazu ist eine Lichterzeugungseinrichtung vorgesehen, welche das Sicherheitsmerkmal mit Anregungslicht bestrahlt, sowie eine Bildaufnahmeeinrichtung, welche das vom Sicherheitsmerkmal emittierte Licht aufnimmt.The DE 10 2011 082 174 A1 and the WO 2013/034471 A1 describe an apparatus for recognizing a document having a security feature with wavelength conversion properties. For this purpose, a light generating device is provided, which irradiates the security feature with excitation light, and an image recording device, which records the light emitted by the security feature.

Die WO 2013/034603 A1 beschreibt ein Verfahren zur Verifikation eines Sicherheitsdokuments mit einem Sicherheitsmerkmal in Form eines fluoreszierenden Druckelements. Das Verfahren sieht vor, dass das Druckelement mittels einer Lichtquelle angeregt wird und es dadurch eine elektromagnetische Strahlung emittiert, welche in einem weiteren Schritt mittels eines Sensors erfasst wird. Durch einen Vergleich mit vorgegebenen Daten, werden die erfassten Daten ausgewertet. Das Verifikationsergebnis wird in einem weiteren Schritt in Abhängigkeit vom Ergebnis des Vergleichs ausgegeben. Insbesondere soll das Verfahren mit einem Smartphone ausgeführt werden, wobei das Blitzlichtmodul des Smartphones als Anregungsquelle und der Fotosensor der Kamera des Smartphones als Detektionseinheit zur Anwendung kommen.The WO 2013/034603 A1 describes a method for verifying a security document with a security feature in the form of a fluorescent printing element. The method provides that the printing element is excited by means of a light source and it is thereby exposed to electromagnetic radiation emitted, which is detected in a further step by means of a sensor. The recorded data is evaluated by comparing it with specified data. In a further step, the verification result is output depending on the result of the comparison. In particular, the method is to be carried out with a smartphone, the flash module of the smartphone being used as the excitation source and the photo sensor of the camera of the smartphone being used as the detection unit.

Aus der US 2010/0144387 A1 ist ein multifunktionales transportierbares Gerät bekannt. Das Gerät umfasst ein Kameramodul, eine Prozessoreinheit und ein Display.From the US 2010/0144387 A1 a multifunctional transportable device is known. The device includes a camera module, a processor unit and a display.

RADKE, R J et al: "Image change detection algorithms: a systematic survey", IEEE TRANSACTIONS ON IMAGE PROCESS, Bd. 14, Nr. 3, 2005-03-01, Seiten 294-307, ISSN: 1057-7149 , beschreibt Algorithmen zur Erkennung von Bildänderungen, wobei mehrere Bilder des gleichen Motivs zu unterschiedlichen Zeitpunkten betrachtet werden. Erläutert wird u.a. die Ausrichtung der Bilder und die Ermittlung der Bilddifferenz. RADKE, RJ et al: "Image change detection algorithms: a systematic survey", IEEE TRANSACTIONS ON IMAGE PROCESS, Vol. 14, No. 3, 2005-03-01, pages 294-307, ISSN: 1057-7149 , describes algorithms for detecting image changes when viewing multiple images of the same subject at different points in time. Among other things, the alignment of the images and the determination of the image difference are explained.

DE 10 2011 121 566 A1 zeigt ein Verfahren zur Unterstützung eines Benutzers bei einer Echtheitsüberprüfung einer Banknote. Es kommt ein tragbares Datenverarbeitungssystem mit einer Kamera und einem Bildschirm zum Einsatz. Mittels einem aufgenommenen Bild überprüft das Datenverarbeitungssystem ein Sicherheitsmerkmal der Banknote. DE 10 2011 121 566 A1 shows a method for assisting a user in checking the authenticity of a bank note. A portable data processing system with a camera and a screen is used. The data processing system uses a recorded image to check a security feature of the bank note.

US 2007/090190 A1 zeigt ein Codelesegerät zur Bildanzeige eines Bildes, welches mittels einer Kamera aufgenommen wurde. Weiterhin dient das Codelesegerät der Extraktion eines Codebildes aus dem Bild und der Decodierung eines im Codebild enthaltenen Codes. U.S. 2007/090190 A1 shows a code reader for displaying an image that was recorded by a camera. Furthermore, the code reader is used to extract a code image from the image and to decode a code contained in the code image.

Aus der EP 1 295 263 A1 ist ein Verfahren zur Authentifizierung eines Gegenstandes mit einem Sicherheitsmerkmal bekannt. Das Sicherheitsmerkmal umfasst physische oder logische Sicherheitselemente, welche mittels eines mobilen Gerätes durch Energie anregbar und weiterhin erfassbar sind.From the EP 1 295 263 A1 a method for authenticating an object with a security feature is known. The security feature includes physical or logical security elements, which can be excited by energy using a mobile device and can also be detected.

Die DE 20 2016 002 731 U1 beschreibt eine Vorrichtung für ein portables Smart-Gerät mit Kamera, wobei die Vorrichtung ein Hülle ist. Die Hülle weist eine Aufnahme auf, in der das Smart-Gerät positioniert wird, sodass auch die Kamera ausgerichtet wird. Weiterhin umfasst die Vorrichtung eine UV- und/oder Blaulicht-Beleuchtungseinheit zur Beleuchtung eines zu authentifizierenden Objektes. Ebenso umfasst die Vorrichtung eine Positioniervorrichtung zur Positionierung der Vorrichtung gegenüber dem zu authentifizierenden Objekt.The DE 20 2016 002 731 U1 describes a device for a portable smart device with a camera, the device being a case. The case features a slot where the smart device is positioned so that the camera is also aligned. The device also includes a UV and/or blue light illumination unit for illuminating an object to be authenticated. The device also includes a positioning device for positioning the device relative to the object to be authenticated.

Bei der Verifikation der im vorgenannten Stand der Technik beschriebenen leuchtstoffbasierten Sicherheitsmerkmale haben sich zwei bislang ungelöste Probleme gezeigt. Vorbekannte Leuchtstoffe werden regelmäßig als sogenannte Konversionsleuchtstoffe zur Herstellung weißer LED verwendet, sodass diese Leuchtstoffe auch in den Blitzlicht-LED der Bildaufnahmeeinheiten (Kameras) von Smartphones und ähnlichen Mobilgeräten regelmäßig enthalten sind. Wünscht man für die Überprüfung von Sicherheitsmerkmalen die Verwendung solcher Geräte zur Bereitstellung der Anregungsstrahlung so zeigt die Anregungsquelle dieselben Emissionen, die von dem zu untersuchenden Sicherheitsmerkmal erwartet werden, sodass eine sichere Verifizierung ausgeschlossen ist. Ein zweites Problem resultiert aus dem Umstand, dass die im Stand der Technik genannten Leuchtstoffe sehr kurze Abklingzeiten im ns- bis µs-Bereich zeigen. Da die Kamera eines Mobilgerätes typischerweise eine relativ niedrige Aufnahmegeschwindigkeit hat (moderne Premium-Smartphones bis 240fps), sind bei einer Anregung mit einem Blitzlicht eines Smartphones die vom Sicherheitsmerkmal stammenden Emissionen regelmäßig schon abgeklungen, bevor die Bildaufnahme mit der Kamera eines Smartphones nach Beendigung der Anregung erfolgen kann.In the verification of the luminescent-based security features described in the aforementioned prior art, two hitherto unsolved problems have emerged. Previously known phosphors are regularly used as so-called conversion phosphors for the production of white LEDs, so that these phosphors are also regularly contained in the flashing LEDs of the image recording units (cameras) of smartphones and similar mobile devices. If one wishes to use such devices to provide the excitation radiation for checking security features, then the excitation source shows the same emissions as from the one to be examined Security feature are expected, so that a secure verification is excluded. A second problem results from the fact that the phosphors mentioned in the prior art have very short decay times in the ns to μs range. Since the camera of a mobile device typically has a relatively low recording speed (modern premium smartphones up to 240 fps), the emissions originating from the security feature are regularly already high when triggered by a smartphone flash decayed before the picture can be taken with the camera of a smartphone after the end of the excitation.

Nach dem vor der Erfindung gegebenen Erkenntnisstand ging die Fachwelt davon aus, dass leuchtstoffbasierte Sicherheitsmerkmale für eine unter Alltagsbedingungen einfach durchzuführende Verifikation, die gleichzeitig vergleichsweise hohen Sicherheitsanforderungen genügt, kaum geeignet sind, da sie mit preiswerten und weit verbreiteten Geräten nicht verifizierbar sind. Entweder benötigen die bekannten Sicherheitsmerkmale sehr spezielle Prüfgeräte, die nur von größeren Einheiten, wie Banken oder Passkontrollstellen vorgehalten werden können. Oder die mit allgemein verfügbaren Geräten wie insbesondere Smartphones prüfbaren Sicherheitsmerkmale sind leicht zu fälschen.According to the state of knowledge prior to the invention, experts assumed that luminescent-based security features are hardly suitable for verification that is easy to carry out under everyday conditions and at the same time meets comparatively high security requirements, since they cannot be verified with inexpensive and widely used devices. Either the well-known security features require very special testing devices that can only be provided by larger units such as banks or passport control offices. Or the security features that can be checked with generally available devices such as smartphones in particular are easy to forge.

Eine Aufgabe der vorliegenden Erfindung ist es daher, ein verbessertes Verfahren zur Verifikation eines leuchtstoffbasierten Sicherheitsmerkmals bereitzustellen. Insbesondere soll das Sicherheitsmerkmal mittels einer Bildaufnahmeeinheit eines Smartphones erfassbar sein und mit der Datenverarbeitungseinheit des Smartphones auch verifizierbar sein. Insbesondere sollen bei Verifizierung nicht nur die Anwesenheit einer Emission sondern spezifische Eigenschaften der Emission geprüft werden.It is therefore an object of the present invention to provide an improved method for verifying a luminescent-based security feature. In particular, the security feature should be able to be detected by means of an image recording unit of a smartphone and also be verifiable with the data processing unit of the smartphone. In particular, not only the presence of an emission but specific properties of the emission should be checked during verification.

Erfindungsgemäß erfolgt die Lösung der Aufgabe durch ein Verfahren zur Verifikation eines leuchtstoffbasierten Sicherheitsmerkmals gemäß dem beigefügten Anspruch 1.According to the invention, the object is achieved by a method for verifying a luminescent-based security feature according to appended claim 1.

Ein allgemeiner Lösungsgedanke für die genannte Aufgabenstellung, den die Erfindung umsetzt, besteht zunächst darin, dass ein Sicherheitsmerkmal mit einem spezifischen Leuchtstoff ausgerüstet wird, der die oben beschriebenen Probleme umgeht. Dieser Leuchtstoff muss dazu derart konfiguriert sein, dass er einerseits mit einer Lichtquelle eines Smartphones bzw. eines gleichartigen mobilen Datenverarbeitungsgerätes, also insbesondere einer Blitzlicht-LED eines Smartphones, anregbar ist. Gleichzeitig muss der Leuchtstoff eine solche Lumineszenzcharakteristik (Lumineszenzausbeute, Abklingzeit) aufweisen, die es ermöglicht, die abklingenden Lumineszenzsignale auch nach dem Ende der Blitzlichtanregung noch sicher zu detektieren. Die Abklingzeit und die während des Abklingens erfolgende Emission müssen von anderen Leuchtstoffen unterscheidbar sein, und außerdem sollten die abklingenden Lumineszenzsignale nicht visuell vom Menschen wahrnehmbar sein. Es hat sich gezeigt, dass diese Bedingungen nur von wenigen, spezifisch konfigurierten Leuchtstoffen, die sich in Sicherheitsmerkmalen verwenden lassen, erfüllt werden. Ein solcher Leuchtstoff muss insbesondere eine Abklingzeit im ms-Bereich aufweisen. Ein geeigneter Leuchtstoff ist in der deutschen Patentanmeldung DE 10 2018 109 141.9 mit dem Titel "Smartphone verifizierbares, leuchtstoffbasiertes Sicherheitsmerkmal und Anordnung zur Verifizierung" beschrieben, die von der Anmelderin mit demselben Prioritätstag (17.04.2017) eingereicht wurde. Der Inhalt dieser weiteren Patentanmeldung, insbesondere in Bezug auf die Zusammensetzung und die Herstellung eines hier verwendbaren Leuchtstoffs, wird in die Offenbarung der vorliegenden Erfindung ausdrücklich und vollständig einbezogen.A general solution idea for the stated task, which the invention implements, is that a security feature with a specific phosphor is equipped that circumvents the problems described above. For this purpose, this phosphor must be configured in such a way that it can be excited with a light source of a smartphone or a similar mobile data processing device, ie in particular a flashing LED of a smartphone. At the same time, the phosphor must have such a luminescence characteristic (luminescence yield, decay time) that it is still possible to reliably detect the decaying luminescence signals even after the end of the flash light excitation. The decay time and the emission occurring during the decay must be distinguishable from other phosphors and, in addition, the decaying luminescence signals should not be visually perceptible to humans. It has been shown that these conditions are only met by a few specifically configured phosphors that can be used in security features. Such a phosphor must in particular have a decay time in the ms range. A suitable phosphor is in the German patent application DE 10 2018 109 141.9 entitled "Smartphone verifiable luminescent-based security feature and arrangement for verification" filed by the applicant with the same priority date (04/17/2017). The content of this further patent application, in particular with regard to the composition and the production of a phosphor that can be used here, is expressly and completely included in the disclosure of the present invention.

Das erfindungsgemäße Verfahren dient der Verifikation eines leuchtstoffbasierten zur Emission anregbaren Sicherheitsmerkmals, welches auf einem Sicherheitsdokument angeordnet ist. Das Verfahren ist mithilfe eines Smartphones oder eines gleichartigen mobilen Endgeräts ausführbar, welches durch eine Software, vorzugsweise in der Art einer App entsprechend konfiguriert und gesteuert wird.The method according to the invention serves to verify a luminescent-based security feature that can be stimulated to emit and is arranged on a security document. The method can be carried out using a smartphone or a similar mobile device, which is Software, preferably configured and controlled in the manner of an app.

Ein durch das erfindungsgemäße Verfahren auswertbares Sicherheitsmerkmal ist auf einem Sicherheitsdokument aufgebracht bzw. in dieses eingebracht und umfasst den o.g. Leuchtstoff. Der Leuchtstoff ist mit einer elektromagnetischen Strahlung vorbestimmter Wellenlänge zur Lumineszenz anregbar, woraufhin er eine Strahlung emittiert. Die Emission des Leuchtstoffes weist eine Abklingzeit im ms-Bereich auf. Bevorzugt ist die Abklingzeit im Bereich zwischen 1 bis 100 ms, besonders bevorzugt im Bereich zwischen 5 bis 50 ms, nochmals bevorzugt zwischen 10 und 30 ms gewählt. Weiterhin ist die Emission des Leuchtstoffes mittels einer Bilderfassungseinheit eines Smartphones detektierbar.A security feature that can be evaluated by the method according to the invention is applied to a security document or introduced into it and includes the above-mentioned phosphor. The phosphor can be excited to luminescence with electromagnetic radiation of a predetermined wavelength, whereupon it emits radiation. The emission of the phosphor has a decay time in the ms range. The decay time is preferably selected in the range between 1 and 100 ms, particularly preferably in the range between 5 and 50 ms, again preferably between 10 and 30 ms. Furthermore, the emission of the phosphor can be detected by means of an image acquisition unit of a smartphone.

In einem ersten Verfahrensschritt wird das Sicherheitsdokument so positioniert, dass das Sicherheitsmerkmal von einer Bildaufnahmeeinheit des Smartphones erfasst wird. Im einfachsten Fall erfolgt dies durch manuelle Positionierung des Sicherheitsdokuments vor der Bilderfassungseinheit. Bevorzugt wird als Nutzerunterstützung eine halbtransparente Maske oder ein Positionsrahmen im Display des mobilen Endgerätes dargestellt, der als Positionshilfe dient. Auf dem Sicherheitsdokument kann ein durch einen Menschen visuell wahrnehmbares Kennzeichen angebracht sein, welches innerhalb des Positionsrahmens positioniert wird. Das Sicherheitsmerkmal ist dann in der Nähe dieses Kennzeichens angebracht, sodass es im Erfassungsbereich der Bilderfassungseinheit liegt.In a first method step, the security document is positioned in such a way that the security feature is captured by an image recording unit of the smartphone. In the simplest case, this is done by manually positioning the security document in front of the image capture unit. A semi-transparent mask or a position frame is preferably shown in the display of the mobile terminal as user support, which serves as a position aid. An identifier which can be visually perceived by a human being and which is positioned within the positioning frame can be attached to the security document. The security feature is then attached in the vicinity of this identifier so that it is within the detection range of the image detection unit.

Alternativ kann eine Objekterkennung mittels der Bilderfassungseinheit und einer Datenverarbeitungseinheit des Smartphones (mobilen Endgerätes) durchgeführt werden. Die Objekterkennung dient mittelbar der Bestimmung der Position des Sicherheitsmerkmals auf dem Dokument und/oder sie unterstützt das Positionieren des Smartphones über dem Sicherheitsdokument. Die Objekterkennung kann außerdem für eine automatische Auslösung der Detektion verwendet werden.Alternatively, object recognition can be carried out using the image acquisition unit and a data processing unit of the smartphone (mobile terminal device). The object recognition indirectly serves to determine the position of the security feature on the document and/or it supports the positioning of the smartphone over the security document. Object detection can also be used to automatically trigger detection.

In einem optionalen Verfahrensschritt wird ein Aufnahmerahmen bzw. ein Aufnahmefenster festgelegt, wobei dessen Position anhand der zuvor bestimmten Position des Sicherheitsmerkmals definiert wird und wobei der Aufnahmerahmen so gewählt ist, dass das Sicherheitsmerkmal im Bereich des Aufnahmerahmens angeordnet ist.In an optional method step, a recording frame or a recording window is defined, its position being defined using the previously determined position of the security feature and the recording frame being selected such that the security feature is arranged in the area of the recording frame.

In einem nachfolgenden Verfahrensschritt wird das Sicherheitsmerkmal mittels einer Beleuchtungseinheit des Smartphones (mobilen Endgerätes) zur Lumineszenz angeregt, sodass das Sicherheitsmerkmal eine elektromagnetische Strahlung emittiert. Durch eine App (Software-Applikation) werden Beleuchtungseinheit und Bildaufnahmeeinheit von der Datenverarbeitungseinheit des Smartphones gesteuert, wobei eine Kombination von Einzelblitz und Videoaufnahme oder Einzelblitz und Serienaufnahme erfolgt und wobei die Beleuchtungseinheit nach dem Anregen des Leuchtstoffs des Sicherheitsmerkmals abgeschaltet wird, sodass nach Blitzende die abklingende Emission durch die Bildaufnahmeeinheit aufgenommen werden kann.In a subsequent method step, the security feature is excited to luminescence by means of an illumination unit of the smartphone (mobile terminal device), so that the security feature emits electromagnetic radiation. The lighting unit and image recording unit are controlled by the data processing unit of the smartphone using an app (software application), with a combination of single flash and video recording or single flash and series recording taking place and with the lighting unit being switched off after the phosphor of the security feature has been activated, so that the decaying emission can be recorded by the image recording unit after the flash has ended.

Ein optionaler Verfahrensschritt sieht vor, dass ein Referenzbereich definiert wird, der sich unmittelbar benachbart zu dem Sicherheitsmerkmal befindet. Die Auswertung von erfassten Bildern des Sicherheitsmerkmals und des Referenzbereichs sowie der dort erfassten Unterschiede (Bilddifferenz, Histogramme, Farbtonwerte) kann für eine Verifikation des Dokumentes bei stark flimmerndem Fremdlicht hilfreich sein.An optional method step provides that a reference area is defined, which is located directly adjacent to the security feature. The evaluation of captured images of the security feature and the reference area as well as the differences captured there (image difference, histograms, Hue values) can be helpful for verifying the document in the case of heavily flickering extraneous light.

In einem weiteren Verfahrensschritt wird eine Bildserie oder ein Video des Sicherheitsmerkmals sowie optional vom Referenzbereich mittels einer Bilderfassungseinheit des Smartphones aufgenommen, um die Emission zu erfassen. Vorzugsweise erfolgt die Aufnahme im festgelegten Aufnahmebereich. Das Erfasse der Emission erfolgt nach Abschluss der Anregung, d.h. nach Abschalten des Blitzlichts. Die Aufnahmezeit der durch die Bilderfassungseinheit aufgenommenen Bildserie bzw. des Videos ist vorzugsweise so gewählt, dass im letzten Bild der Bildserie oder des Videos keine Emission des Sicherheitsmerkmals mehr detektierbar ist, sofern die vorbestimmten Abklingzeiten des Leuchtstoffs des Sicherheitsmerkmals eingehalten sind. Dieses letzte Bild wird als Referenzbild (Bref) aufgenommen. Ebenso kann optional vor dem Anregen des Leuchtstoffs ein Startbild aufgenommen werden, welches als weitere Referenz in die Verifikation einbezogen werden kann.In a further method step, a series of images or a video of the security feature and optionally of the reference area is recorded using an image recording unit of the smartphone in order to record the emission. The recording preferably takes place in the defined recording area. The emission is recorded after the excitation has ended, ie after the flashlight has been switched off. The recording time of the series of images or the video recorded by the image acquisition unit is preferably selected such that emission of the security feature can no longer be detected in the last image of the series of images or the video, provided the predetermined decay times of the phosphor of the security feature are observed. This last image is recorded as a reference image (B ref ). A start image can also optionally be recorded before the phosphor is excited, which can be included in the verification as a further reference.

In einem weiteren Verfahrensschritt werden die erfassten bzw. aufgenommenen Bildserien oder Videos mittels der Datenverarbeitungseinheit verarbeitet und mit Vorgabe- bzw. Referenzdaten verglichen. Im einfachsten Fall sind im Smartphone Referenzdaten hinterlegt, die mit den ermittelten Emissionsparametern verglichen werden.In a further method step, the captured or recorded series of images or videos are processed by the data processing unit and compared with specification or reference data. In the simplest case, reference data are stored in the smartphone, which are compared with the determined emission parameters.

Bevorzugt werden die Bilddifferenzen zwischen den erfassten Bildern und dem nach Abklingen der Emission erfassten Referenzbild erzeugt (Δ1R-B1-Bref ... ΔnR-Bn-Bref), woraus anschließend mittels eines RGB Histogramms die Emissionswerte als Farbtonwert der unterschiedlichen Farbkanäle berechnet werden und anschließend die Abklingzeit des Leuchtstoffes aus den ermittelten Daten analysiert wird. Vorzugsweise werden n=10 Bilder für die Berechnung der Bilddifferenz verwendet. Bevorzugt liegt die Bildanzahl zwischen 5 und 15 Bildern.The image differences between the captured images and the reference image captured after the emission has decayed are preferably generated (Δ 1R -B 1 -B ref ... Δ nR -B n -B ref ), from which the emission values are then calculated as the hue value of the different color channels using an RGB histogram, and then the decay time of the phosphor is calculated the determined data is analyzed. Preferably, n=10 images are used to calculate the image difference. The number of images is preferably between 5 and 15 images.

Bei Annahme eines exponentiellen Abklingverhaltens kann die Abklingzeit(τ) durch folgende Gleichung bestimmt werden: τ = Δt / ln E t 1 E t 2 mit E t 1 = E 0 e t 1 τ und E t 2 = E 0 e t 2 τ ;

Figure imgb0001
wobei Δt das Zeitintervall zwischen den Bildern ist und F(t) der Emissionswert zu einem bestimmten Zeitpunkt des Abklingens ist.Assuming an exponential decay behavior, the decay time (τ) can be determined by the following equation: τ = Δt / ln E t 1 E t 2 with E t 1 = E 0 e t 1 τ and E t 2 = E 0 e t 2 τ ;
Figure imgb0001
where Δt is the time interval between the images and F(t) is the emissivity at a particular time of the decay.

Diese Werte können aus einem Histogramm der Bilder bzw. der Bilddifferenz ermittelt werden.These values can be determined from a histogram of the images or the image difference.

Die spektrale Verteilung der Emission des Leuchtstoffes kann aus den Farbkoordinaten für unterschiedliche Bilder ermittelt werden, wobei gilt: K R = R R + G + B und K G = G R + G + B .

Figure imgb0002
The spectral distribution of the emission of the phosphor can be determined from the color coordinates for different images, where: K R = R R + G + B and K G = G R + G + B .
Figure imgb0002

Weiterhin ist ein Vergleich eines vor der Aktivierung der Anregungsstrahlung aufgenommenen zusätzlichen Startbildes mit den Bildern der während der Abklingzeit aufgenommenen Bildserie sowie mit dem letzten Bild (Referenzbild) möglich.Furthermore, a comparison of an additional start image recorded before the activation of the excitation radiation with the images of the image series recorded during the decay time and with the last image (reference image) is possible.

Durch den Vergleich kann das Vorhandensein des Sicherheitsmerkmals im Bereich des Aufnahmerahmens verifiziert und nachfolgend die Echtheit des Sicherheitsdokuments überprüft werden. Insbesondere kann durch die Verifikation des Sicherheitsmerkmals auf dem Sicherheitsdokument die Authentizität und Integrität des Sicherheitsdokuments überprüft werden.The presence of the security feature in the area of the receiving frame can be verified by the comparison and the authenticity of the security document can subsequently be checked. In particular, the authenticity and integrity of the security document can be checked by verifying the security feature on the security document.

Das Referenzbild, welches das letzte Bild der Bildserie ist, wird in einem vorbestimmten Zeitrahmen, insbesondere im ms-Bereich erzeugt, wodurch Emissionen mit Abklingzeiten größer dem ms-Bereich ebenfalls ausgefiltert werden. Dafür kann das Referenzbild mit dem vor der Aktivierung der Anregungsstrahlung aufgenommenen Startbild verglichen werden.The reference image, which is the last image in the series of images, is generated in a predetermined time frame, in particular in the ms range, as a result of which emissions with decay times greater than the ms range are also filtered out. For this purpose, the reference image can be compared with the start image recorded before activation of the excitation radiation.

Die Echtheit des Sicherheitsmerkmals wird in einer Ausführungsform des Verfahrens anhand folgender Merkmale überprüft:

  • Referenzprüfung, Vergleich des letzten Bilds (Referenzbild) aus der Serienaufnahme mit einem vor der Anregung aufgenommenen Startbild;
  • Detektion des Sicherheitsmerkmals und
  • Bestimmung der Emissionseigenschaften (τ, λ) des Sicherheitsmerkmals bzw. dessen Leuchtstoff.
In one embodiment of the method, the authenticity of the security feature is checked using the following features:
  • Reference check, comparison of the last image (reference image) from the series recording with a start image recorded before the excitation;
  • detection of the security feature and
  • Determination of the emission properties ( τ , λ ) of the security feature or its phosphor.

Die Aufnahmegeschwindigkeit beim Erzeugen der Bildserie wird so gewählt, dass fluoreszierende Leuchtstoffe bzw. Merkmale mit kurzen Abklingzeiten, d.h. im ps-Bereich, als nicht verifizierbar ausgeschlossen werden, da solche kurzen Emissionen nicht mit hinreichender Intensität erfasst werden. Mittels einer Referenzprüfung, bei welcher ein Vergleich des letzten Bildes in der Aufnahme mit dem vor Anregung aufgenommenen Startbild erfolgt, werden Leuchtstoffe mit langen Abklingzeiten als nicht verifizierbar ausgeschlossen. Weist eines der beiden vorstehenden Merkmale auf einen fluoreszierenden oder phosphoreszierenden Leuchtstoff hin, so wird das Ergebnis der Echtheit des Sicherheitsmerkmals mit "falsch" ausgegeben.The recording speed when generating the series of images is selected in such a way that fluorescent phosphors or features with short decay times, i.e. in the ps range, are ruled out as non-verifiable, since such short emissions are not recorded with sufficient intensity. By means of a reference test, in which the last image in the recording is compared with the start image recorded before excitation, phosphors with long decay times are ruled out as non-verifiable. If one of the two above features indicates a fluorescent or phosphorescent phosphor, then the result of the authenticity of the security feature is output as "false".

Neben der Anwesenheit des gesuchten Leuchtstoffes im Sicherheitsmerkmal kann auch die äußere Form des Sicherheitsmerkmals überprüft werden. Entsprechen der detektierte Leuchtstoff sowie das Sicherheitsmerkmal nicht den hinterlegten Daten des vorbestimmten Leuchtstoffs bzw. Sicherheitsmerkmals wird die Echtheit als "falsch" bestimmt. Für das Merkmal der Emissionseigenschaften werden die spektrale Verteilung der vom Leuchtstoff emittierten Strahlung sowie die Abklingzeit des Leuchtstoffes des Sicherheitsmerkmals überprüft. Stimmen die Spektrallage sowie die Abklingzeit des Leuchtstoffes mit den hinterlegten Werten überein, und sind weiterhin die anderen Merkmale positiv ("echt") bestätigt, ergibt die Verifikation, dass das Sicherheitsmerkmal "echt" ist.In addition to the presence of the phosphor sought in the security feature, the external shape of the security feature can also be checked. Correspond to the detected phosphor and the security feature does not match the stored data of the predetermined phosphor or security feature, the authenticity is determined as "false". For the emission properties feature, the spectral distribution of the radiation emitted by the phosphor and the decay time of the phosphor of the security feature are checked. If the spectral position and the decay time of the phosphor match the stored values, and if the other features are still positive ("genuine"), the verification shows that the security feature is "genuine".

Die optionale Objekterkennung umfasst vorzugsweise verschiedene Bildverarbeitungsschritte, wie Filteranwendungen zur Rauschreduzierung, Kontrastanpassung oder Farbkanalverstärkung, eine Formanalyse zur Erfassung des Sicherheitsmerkmals. Die Rauschreduzierung kann beispielsweise mittels morphologischer Filter wie Erosion oder Dilatation erfolgen. Für die Formanalyse kann ein Template Matching zum Einsatz kommen. Auch die schnelle Fourier-Transformation (FFT) der Bilder kann verwendet werden.The optional object recognition preferably includes various image processing steps, such as filter applications for noise reduction, contrast adjustment or color channel enhancement, a shape analysis for detecting the security feature. The noise can be reduced, for example, by means of morphological filters such as erosion or dilatation. Template matching can be used for shape analysis. The Fast Fourier Transform (FFT) of the images can also be used.

In einem weiteren Verfahrensschritt, der vor allem bei starkem Umgebungslicht sinnvoll ist, wird der Abstand zwischen dem Sicherheitsdokument mit dem Sicherheitsmerkmal und der Bilderfassungseinheit des Smartphones kleiner dem Abstand des Scharfstellungsbereichs der Bilderfassungseinheit gewählt. Es wird keine optische Scharfstellung bzw. eine Fokuseinstellung benötigt. Der Abstand zwischen der Smartphone-Kamera und dem Sicherheitsmerkmal bei der Erfassung der Bilder kann somit sehr gering gewählt werden, da für das vorliegende Verfahren keine scharfen Bilder benötigt werden, weil lediglich die Emission und bei Bedarf die Form des Sicherheitsmerkmals erfasst werden. Der geringe Abstand zwischen dem Sicherheitsmerkmal und der Kamera bedingt den Vorteil, dass für die Anregung des Leuchtstoffs des Sicherheitsmerkmals mehr Energie zur Verfügung steht, und dass die Emission des Leuchtstoffs über einen breiten Raumwinkel erfasst wird. Die Minimierung des Abstands zwischen Kamera und Sicherheitsmerkmal ist besonders bedeutsam aufgrund der quadratischen Abhängigkeit der Intensität des Blitzlichts vom Abstand zur Anregungsquelle bzw. der Emission vom Abstand zur Detektionseinheit. Damit kann auch eine vergleichsweise geringe Emission erfasst werden, die bei einer Aufnahme im Scharfstellungsbereich nicht mehr detektierbar wäre. Dies reduziert die Falsch-Zurückweisungsrate (d. h. ein echtes Sicherheitsdokument wird als falsches bewertet). Übliche Smartphones weisen beispielsweise einen Scharfstellungsbereich von 60 mm auf. Bevorzugt wird für das Verfahren daher ein Abstand zwischen 10 mm und 80 mm zwischen der Bilderfassungseinheit und dem Sicherheitsdokument mit Sicherheitsmerkmal zur Aufnahme der Bilder verwendet. Besonders bevorzugt beträgt der Abstand während der Bildaufnahme zwischen der Bilderfassungseinheit und dem Sicherheitsdokument mit dem Sicherheitsmerkmal weniger als 50 mm. Ein weiterer Vorteil der Verwendung unscharfer Bilder besteht darin, die Auflösung der Bilder zu reduzieren und damit die Bearbeitung der Bilder zu beschleunigen.In a further method step, which makes sense above all in strong ambient light, the distance between the security document with the security feature and the image capture unit of the smartphone is selected to be smaller than the distance of the focusing range of the image capture unit. No optical focusing or focus adjustment is required. The distance between the smartphone camera and the security feature when capturing the images can therefore be chosen to be very small, since no sharp images are required for the present method because only the emission and, if necessary, the shape of the security feature are captured. The small distance between the security feature and the camera has the advantage that more energy is available for exciting the phosphor of the security feature, and that the emission of the phosphor is recorded over a wide solid angle. The minimization of the distance between the camera and the security feature is particularly important due to the quadratic dependency of the intensity of the flash light on the distance to the excitation source or the emission on the distance to the detection unit. In this way, a comparatively low emission can also be recorded, which would no longer be detectable when taking a picture in the focussing range. This reduces the false rejection rate (ie a genuine security document is evaluated as false). For example, standard smartphones have a focus range of 60 mm. A distance of between 10 mm and 80 mm between the image capturing unit and the security document with security feature is therefore preferably used for recording the images for the method. The distance between the image capture unit and the security document with the security feature during the image recording is particularly preferably less than 50 mm. Another advantage of using blurred images is to reduce the resolution of the images, thereby speeding up the processing of the images.

In einer anderen Ausführungsform des Verfahrens zur Verifikation des Sicherheitsmerkmals wird ein Referenzbereich neben dem Bereich des Sicherheitsmerkmals, also neben dem Bereich des Leuchtstoffes ausgewählt. Vorzugsweise haben die beiden Bereiche die gleiche sichtbare Körperfarbe. Damit kann die Schwankung der Belichtung während der Aufnahme bei Kunstlicht (50 Hz Flackern) kompensiert werden. Vorzugsweise sind die Positionen des Leuchtstoffes und des Referenzbereich auf dem Sicherheitsdokument vordefiniert (z. B. relativ zu einem markanten Zeichen auf dem Dokument). Für die Verifikation wird eine gleiche Pixelanzahl in beiden Bereichen für alle erfassten Bilder ausgewählt und für jedes Bild wird eine Bilderdifferenz für diese Ausschnitte erstellt.In another embodiment of the method for verifying the security feature, a reference area is selected next to the area of the security feature, ie next to the area of the phosphor. Preferably, the two areas have the same visible body color. This can be used to compensate for exposure fluctuations during recording under artificial light (50 Hz flickering). The positions of the phosphor and the reference area are preferably on predefined in the security document (e.g. relative to a prominent character on the document). For the verification, an equal number of pixels in both areas is selected for all captured images and an image difference for these sections is created for each image.

Für bestimmte Leuchtstoffe, insbesondere Silicat-Granate kann ein zusätzlicher Verifikationsfaktor verwendet werden. Diese Leuchtstoffe zeigen ein breites Emissionsspektrum mit lokalen Maxima im grünen und roten Spektralbereich, die darüber hinaus unterschiedliche Abklingzeiten aufweisen. Daraus ergibt sich, dass bei Abklingmessungen über den gesamten sichtbaren Spektralbereich ein charakteristischer Farbshift festgestellt wird, der ebenfalls als Echtheitskriterium verwendet werden kann.An additional verification factor can be used for certain phosphors, in particular silicate garnets. These phosphors show a broad emission spectrum with local maxima in the green and red spectral range, which also have different decay times. As a result, a characteristic color shift is detected in decay measurements over the entire visible spectral range, which can also be used as an authenticity criterion.

Ein weiterer Vorteil des Verfahrens ist, dass das bekannte und bei einer Vielzahl der Anwender vorhandene Smartphone als mobiles Endgerät zur Verifikation des Sicherheitsmerkmals verwendet werden kann. Es wird eine schnelle, interne Auswertung und Authentifizierung der mit dem Smartphone gemessenen Leuchtstoffemissionen durchgeführt. Es ist weiterhin vorteilhaft, dass der Abstand zwischen dem Sicherheitsmerkmal und der Bilderfassungseinheit gering gehalten werden kann, da gleichzeitig ein Abdecken des Sicherheitsmerkmals gegen Umgebungslicht, wie Tageslicht oder Raumlicht, erfolgt.A further advantage of the method is that the known smartphone, which is available to a large number of users, can be used as a mobile terminal device for verifying the security feature. A quick, internal evaluation and authentication of the fluorescent emissions measured with the smartphone is carried out. It is also advantageous that the distance between the security feature and the image capturing unit can be kept small, since at the same time the security feature is covered from ambient light, such as daylight or room light.

Das Verfahren mit seinen Verfahrensschritten wird bevorzugt als Applikation bzw. App für das Smartphone bereitgestellt.The method with its method steps is preferably provided as an application or app for the smartphone.

Die Bildfrequenz des eingesetzten Bildsensors (insbesondere Smartphone-Kamera) bestimmt eine untere Grenze, welche durch das Abklingverhalten des Leuchtstoffes erreicht werden muss.The image frequency of the image sensor used (in particular a smartphone camera) determines a lower limit, which must be reached through the decay behavior of the phosphor.

Eine obere Grenze ist durch die physiologischen Eigenschaften des menschlichen Sehvermögens vorgegeben, insbesondere durch die visuelle Wahrnehmung, also die Aufnahme und Verarbeitung optischer Reize durch das Auge und das Gehirn. Um den im Sicherheitsmerkmal verwendeten Leuchtstoff einer hohen Sicherheitsstufe zuordnen zu können, soll die Emission des Sicherheitsmerkmals nicht durch visuelle Wahrnehmung vom Menschen erfassbar sein. Insbesondere soll die Abklingzeit des Leuchtstoffes kleiner 1 s sein, da ab 1 s ein Nachleuchten des Leuchtstoffes erfolgt, welches durch den Menschen wahrnehmbar ist. Der Leuchtstoff ist so gewählt, dass seine Abklingzeit im einstelligen oder zweistelligen ms-Bereich liegt. Bevorzugt liegt die Abklingzeit des Leuchtstoffes (immer betrachtet ab dem Abschalten der Anregungsquelle) des Sicherheitsmerkmals im Bereich von 1 ms bis 50 ms. Besonders bevorzugt weist der Leuchtstoff des Sicherheitsmerkmals eine Abklingzeit von 10 ms bis 30 ms auf.An upper limit is given by the physiological properties of human vision, in particular by visual perception, ie the reception and processing of optical stimuli by the eye and the brain. In order to be able to assign the phosphor used in the security feature to a high security level, the emission of the security feature should not be detectable by human visual perception. In particular, the decay time of the phosphor should be less than 1 s, since after 1 s the phosphor begins to glow, which can be perceived by humans. The phosphor is chosen so that its decay time is in the single-digit or double-digit ms range. The decay time of the phosphor (always considered from the time the excitation source is switched off) of the security feature is preferably in the range from 1 ms to 50 ms. The phosphor of the security feature particularly preferably has a decay time of 10 ms to 30 ms.

Damit das Sicherheitsmerkmal allein mittels eines mobilen Endgerätes (insbesondere Smartphone) erfassbar ist, ist der Leuchtstoff so konfiguriert, dass er im sichtbaren Spektralbereich, insbesondere im blauen Spektralbereich anregbar ist, damit die Blitzlichtquelle des Smartphones diese Anregungsstrahlung liefern kann. Weiterhin ist der Leuchtstoff so konfiguriert, dass er im sichtbaren Spektralbereich emittiert, wobei diese Emission aufgrund der kurzen Abklingzeit nicht vom Benutzer durch visuelle Wahrnehmung erfassbar ist.So that the security feature can be detected solely by means of a mobile device (especially a smartphone), the phosphor is configured in such a way that it can be excited in the visible spectral range, in particular in the blue spectral range, so that the flash light source of the smartphone can deliver this excitation radiation. Furthermore, the phosphor is configured in such a way that it emits in the visible spectral range, with this emission not being detectable by the user through visual perception due to the short decay time.

Das weiße Licht der Beleuchtungseinheit eines Smartphones, wird durch eine LED erzeugt, welche aus einem LED-Halbleiterchip mit einer Emission bei etwa 450 nm und oberhalb des LED-Halbleiterchip platzierten LED-Konversionsleuchtstoffen besteht, wobei die Konversionsleuchtstoffe die Emission der blauen LED anteilig in langwelligere sichtbare Lumineszenzstrahlung (breitbandige Emission im grünen, gelben und roten Spektralbereich) mit einem Emissionsmaximum von beispielsweise etwa 560 nm umwandeln. Das weiße Licht der als Beleuchtungseinheit handelsüblicher Smartphones bereitstehenden LED resultiert aus der additiven Farbmischung der beschriebenen einzelnen Lumineszenzkomponenten, wobei der blaue Spektralanteil die höhere Intensität aufweist. Das bedeutet, dass der für die Bereitstellung des erfindungsgemäßen Sicherheitsmerkmals verwendbare Leuchtstoff vorzugsweise so konfiguriert sein muss, dass er insbesondere im Bereich zwischen 420 nm bis 470 nm eine hohe Effizienz der spektralen Anregbarkeit aufweist. Besonders bevorzugt besitzt der Leuchtstoff eine effektive Anregungswellenlänge von 450 nm.The white light of the lighting unit of a smartphone is generated by an LED, which consists of an LED semiconductor chip with an emission at around 450 nm and LED conversion phosphors placed above the LED semiconductor chip, the conversion phosphors reflecting the emission of the convert blue LED proportionately into longer-wavelength visible luminescence radiation (broadband emission in the green, yellow and red spectral range) with an emission maximum of around 560 nm, for example. The white light of the LED available as the lighting unit of commercially available smartphones results from the additive color mixture of the individual luminescence components described, with the blue spectral component having the higher intensity. This means that the phosphor that can be used to provide the security feature according to the invention must preferably be configured in such a way that it has a high efficiency of spectral excitability, particularly in the range between 420 nm and 470 nm. The phosphor particularly preferably has an effective excitation wavelength of 450 nm.

Zur Detektion der Lumineszenzsignale des Leuchtstoffes steht als Bilderfassungseinheit die Smartphone-Kamera zur Verfügung. Bevorzugt ist die Bilderfassungseinheit ein CMOS-Sensor, der mit einem IR-Filter ausgestattet ist, wodurch eine spektrale Empfindlichkeit bis etwa 750 nm besteht. Mittels der Bilderfassungseinheit können Einzelbilder, Bildserien oder Videos aufgezeichnet werden.The smartphone camera is available as an image acquisition unit for detecting the luminescence signals of the phosphor. The image acquisition unit is preferably a CMOS sensor which is equipped with an IR filter, as a result of which there is a spectral sensitivity of up to approximately 750 nm. Single images, series of images or videos can be recorded by means of the image acquisition unit.

Das erfindungsgemäße Verfahren kann grundsätzlich in verschiedenen Prüfgeräten angewendet werden. Solche Prüfgeräte können als Nachrüstmodul für die stationäre Prüfung verwendet werden (z. B. in Geldautomaten) oder bevorzugt als ein mobiles Endgerät gestaltet sein. Das mobile Endgerät ist bevorzugt ein Smartphone, kann aber auch ein Tablet oder ein anderes ähnliches multifunktionales Datenverarbeitungsgerät sein, welches eine Kamera mit Bilderfassungseinheit und/oder Beleuchtungseinheit sowie eine Datenverarbeitungseinheit umfasst. Bevorzugt ist die Datenverarbeitungseinheit ein Prozessor, insbesondere ein Mikroprozessor. Die Prüfung kann auch mit stationären Endgeräten, bzw. anderen Datenverarbeitungssystemen mit Bilderfassungseinheiten (z. B. Desktop-Monitore oder Service-Terminals) erfolgen.In principle, the method according to the invention can be used in various test devices. Such testing devices can be used as a retrofit module for stationary testing (e.g. in ATMs) or preferably designed as a mobile terminal device. The mobile end device is preferably a smartphone, but can also be a tablet or another similar multifunctional data processing device that includes a camera with an image capture unit and/or a lighting unit and a data processing unit. The data processing unit is preferably a Processor, in particular a microprocessor. The test can also be carried out using stationary terminals or other data processing systems with image acquisition units (e.g. desktop monitors or service terminals).

Bevorzugt ist der Leuchtstoff im Sicherheitsmerkmal so angeordnet, dass er ein Muster bildet. Der Leuchtstoff, insbesondere die Lumineszenzpigmente des Leuchtstoffes sind bevorzugt als ein definiertes Muster auf einem Träger aufgebracht. Das Muster kann als eine Form, beispielsweise ein Dreieck oder ein Stern angeordnet sein. Alternativ kann das durch den Leuchtstoff gebildete Muster des Sicherheitsmerkmals Daten enthalten und als ein Code, beispielsweise eine QR-Code, angeordnet sein.The phosphor is preferably arranged in the security feature in such a way that it forms a pattern. The phosphor, in particular the luminescence pigments of the phosphor, are preferably applied to a carrier as a defined pattern. The pattern can be arranged as a shape such as a triangle or a star. Alternatively, the pattern of the security feature formed by the phosphor can contain data and be arranged as a code, for example a QR code.

Die Pigmente des Leuchtstoffes sind als Sicherheitsmerkmal beispielsweise auf ein Sicherheitsdokument oder auf eine Schicht eines Sicherheitsdokumentes aufgedruckt. Das Aufdrucken oder Applizieren des Leuchtstoffes auf das Sicherheitsdokument kann mit bekannten Druckverfahren wie z. B. Tiefdruck, Flexodruck, Offsetdruck, Siebdruck oder auch Digitaldruckverfahren erfolgen. Weiterhin kann der Leuchtstoff durch Beschichtungsverfahren oder Laminierungsverfahren auf das Sicherheitsdokument aufgebracht werden.The pigments of the phosphor are printed as a security feature, for example, on a security document or on a layer of a security document. The printing or application of the phosphor on the security document can be carried out using known printing methods such as e.g. B. gravure printing, flexographic printing, offset printing, screen printing or digital printing processes. Furthermore, the phosphor can be applied to the security document by coating processes or lamination processes.

Es kann eine Authentizitätsprüfung und/oder Integritätsprüfung erfolgen. Die Verifizierung des Sicherheitsmerkmals ist erst durch die Wahl des Leuchtstoffes mit Abklingzeiten im ms-Bereich möglich. Es hat sich als vorteilhaft erwiesen, dass durch den speziell gewählten Leuchtstoff dessen Emissionen auch nach Beendigung des Anregungsprozesses noch sicher messbar sind. Verifizierbar sind sowohl der Leuchtstoff über die Abklingzeit und das Emissionsspektrum, als auch das durch den Leuchtstoff gebildete Muster als weiterer Sicherheitsfaktor. Damit ist eine hohe Sicherheit gegen Fälschung durch die Kombination mehrerer Faktoren erreichbar. Zur sicheren Authentifizierung eines Sicherheitsdokuments mit dem Sicherheitsmerkmal kann dieses beispielsweise in einem Bereich eines weiteren Sicherheitsmerkmals, wie einer Abbildung, angeordnet werden.An authenticity check and/or integrity check can be carried out. The security feature can only be verified by selecting the phosphor with a decay time in the ms range. It has proven to be advantageous that, due to the specially selected phosphor, its emissions can still be reliably measured even after the end of the excitation process. Both the phosphor can be verified via the decay time and the emission spectrum, as well as by the Fluorescent formed patterns as a further safety factor. A high degree of security against counterfeiting can thus be achieved by combining several factors. For secure authentication of a security document with the security feature, this can be arranged, for example, in an area of a further security feature, such as an image.

Das Sicherheitsmerkmal ist auf unterschiedlichen Sicherheitsdokumenten aufbringbar, beispielsweise einer Banknote, einem Ausweis, einem Reisepass, einem Führerschein, einem Ticket, einer Briefmarke oder ähnlichem.The security feature can be applied to different security documents, for example a bank note, an identity card, a passport, a driver's license, a ticket, a stamp or the like.

Weitere Einzelheiten, Vorteile und Weiterbildungen der Erfindung ergeben sich aus der nachfolgenden Beschreibung bevorzugter Ausführungsformen der Erfindung, unter Bezugnahme auf die Zeichnung. Es zeigen:

Fig. 1
eine Ausführungsform eines erfindungsgemäßen Sicherheitsmerkmals auf einem Geldschein;
Fig. 2
eine schematische Darstellung von Komponenten einer erfindungsgemäßen Anordnung zur Verifikation des Sicherheitsmerkmals;
Fig. 3
ein Diagramm mit dem An- und Abklingverhalten eines Leuchtstoffes des Sicherheitsmerkmals bei Blitzlichtanregung;
Fig. 4
ein Ablaufplan zur Durchführung der Verifikation des Sicherheitsmerkmals mit der erfindungsgemäßen Anordnung.
Further details, advantages and developments of the invention result from the following description of preferred embodiments of the invention, with reference to the drawing. Show it:
1
an embodiment of a security feature according to the invention on a bank note;
2
a schematic representation of components of an inventive arrangement for verification of the security feature;
3
a diagram with the rise and fall behavior of a phosphor of the security feature when excited by a flash light;
4
a flow chart for carrying out the verification of the security feature with the arrangement according to the invention.

Fig. 1 zeigt ein erfindungsgemäßes Sicherheitsmerkmal 01, welches auf einem Wertdokument, nämlich einem symbolisiert dargestellten Sicherheitsdokument 02 in Form eines Geldscheins aufgebracht ist. Das Sicherheitsmerkmal ist für die Verifikation des Sicherheitsdokuments 02 verwendbar. Das Sicherheitsmerkmal 01 weist hier eine Sternform auf. Es ist unterhalb eines sichtbaren Merkmals 03, hier der Nominalwert des Geldscheins, positioniert. Das Sicherheitsmerkmal 01 besteht aus einem mittels einer elektromagnetischen Strahlung mit vorbestimmter Wellenlänge zur Lumineszenz anregbaren Leuchtstoff, wie er oben erwähnt ist und im Detail in der einbezogenen weiteren Patentanmeldung der Anmelderin erläutert ist. 1 shows a security feature 01 according to the invention, which is applied to a document of value, namely a security document 02 in the form of a bank note, which is represented symbolically. The security feature can be used to verify security document 02. The security feature 01 has the shape of a star here. It is positioned below a visible feature 03, here the face value of the banknote. The security feature 01 consists of a phosphor that can be excited to luminesce by means of electromagnetic radiation with a predetermined wavelength, as mentioned above and explained in detail in the applicant's further patent application that is included.

Das Sicherheitsmerkmal 01 kann mittels eines Verfahrens verifiziert werden, wobei die Echtheit des Sicherheitsmerkmals 01 überprüft wird.The security feature 01 can be verified using a method in which the authenticity of the security feature 01 is checked.

Fig. 2 zeigt eine schematische Anordnung zur Verifikation des Sicherheitsmerkmals 01, wobei das Sicherheitsmerkmal 01 mittels einer Beleuchtungseinheit 04 einer Bildaufnahmeeinheit 06 eines mobilen Endgerätes, insbesondere eines Smartphones 07, zur Lumineszenz angeregt wird, indem die Beleuchtungseinheit 04 Anregungslicht, insbesondere ein Blitzlicht 08 erzeugt. Das Blitzlicht 08 der Bildaufnahmeeinheit 06 wird mittels einer weißes Licht emittierenden LED erzeugt. Das Blitzlicht 08 besitzt eine Intensität IA. Nach Anregung emittiert der Leuchtstoff des Sicherheitsmerkmals 01 eine elektromagnetische Strahlung, welche nach Ende der Anregung für eine Abklingzeit im ms-Bereich auftritt. Die Emission IE des Leuchtstoffes ist mit einer Kamera bzw. einem Detektor 09 der Bildaufnahmeeinheit 06 detektierbar. Weiterhin detektiert der Detektor 09 eine auf das Sicherheitsmerkmal 01 und den Geldschein 02 auftreffende und an diesen reflektierte Umgebungsstrahlung I0 des Tages- oder Raumlichtes. Die Umgebungsstrahlung I0 wird beim erfindungsgemäßen Verfahren gering gehalten, da ein Abstand d zwischen dem Sicherheitsmerkmal 01 und dem Smartphone 07 gering gehalten werden kann. Durch den geringen Abstand d, der unterhalb des Scharfstellungsbereichs (Fokus) der Bildaufnahmeeinheit 06 liegt, schirmt das Smartphone 07 die Umgebungsstrahlung I0 größtenteils ab. 2 shows a schematic arrangement for verifying the security feature 01, the security feature 01 being excited to luminescence by means of an illumination unit 04 of an image recording unit 06 of a mobile terminal device, in particular a smartphone 07, in that the illumination unit 04 generates excitation light, in particular a flashlight 08. The flashing light 08 of the image recording unit 06 is generated by means of an LED emitting white light. The flashlight 08 has an intensity I A . After excitation, the phosphor of security feature 01 emits electromagnetic radiation, which occurs for a decay time in the ms range after excitation has ended. The emission I E of the phosphor can be detected with a camera or a detector 09 of the image recording unit 06. Furthermore, the detector 09 detects an impinging on the security feature 01 and the bank note 02 and reflected on them Ambient radiation I 0 of daylight or room light. The ambient radiation I 0 is kept low in the method according to the invention, since a distance d between the security feature 01 and the smartphone 07 can be kept small. Due to the small distance d, which is below the focusing range (focus) of the image recording unit 06, the smartphone 07 shields the ambient radiation I 0 for the most part.

In Fig. 3 ist ein Diagramm mit dem An- und Abklingverhalten des Leuchtstoffes, der im Sicherheitsmerkmal 01 verwendet wird, dargestellt. Im Diagramm ist eine Emissionskurve 11 des zur Lumineszenz angeregten Sicherheitsmerkmals 01 entlang einer Zeitachse t dargestellt. Weiterhin ist eine Blitzlicht-Anregungskurve 12 entlang der Zeitachse aufgetragen. Wird der Blitz mittels des Smartphones 07 (Fig. 2) erzeugt, steigt die Blitzlicht-Anregungskurve 12 steil an, hält ihr Niveau für kurze Zeit und sinkt auf Null, nachdem das Blitzlicht erloschen ist. Durch die elektromagnetische Strahlung des Blitzlichtes wird der Leuchtstoff des Sicherheitsmerkmals 01 zur Lumineszenz angeregt, wodurch dessen Emissionskurve 11 nahezu zeitgleich mit der Blitzlichtemissionskurve 12 steigt, regelmäßig mit reduzierter Steilheit. Die Emissionskurve 11 fällt nach dem Erlöschen des Blitzlichtes deutlich langsamer als de Blitzlicht-Anregungskurve ab. Das Abklingverhalten des Leuchtstoffes liegt erfindungsgemäß im ms-Bereich.In 3 a diagram with the rise and fall behavior of the phosphor used in security feature 01 is shown. An emission curve 11 of the security feature 01 excited to luminescence is shown in the diagram along a time axis t. Furthermore, a flash light excitation curve 12 is plotted along the time axis. If the flash is fired using the smartphone 07 ( 2 ) is generated, the flashlight excitation curve 12 rises steeply, holds its level for a short time and then falls to zero after the flashlight has gone out. The phosphor of the security feature 01 is excited to luminescence by the electromagnetic radiation of the flash light, as a result of which its emission curve 11 rises almost simultaneously with the flash light emission curve 12, regularly with a reduced steepness. After the flash light has gone out, the emission curve 11 drops significantly more slowly than the flash light excitation curve. According to the invention, the decay behavior of the phosphor is in the ms range.

Unterhalb der Zeitachse sind in Fig. 3 einzelne durch den Detektor 09 des Smartphones 07 (Fig. 2)erfasste Bilder 13 des Sicherheitsmerkmals 01 dargestellt. Die Bildaufnahmen 13 zeigen die abklingende Emission des Sicherheitsmerkmals 01 als mit der Zeit schwächer werdendes Muster. Sie können für die Verifikation des Sicherheitsdokuments 02 in einem weiteren Verfahrensschritt verwendet werden. Nach im wesentlichen vollständigen Abklingen der Emission kann als letztes Bild der aufgenommenen Bildfolge ein Referenzbild 14b erfasst werden. Je nach Auswerteverfahren kann ein zusätzliches Referenzbild 14a auch vor der Aktivierung der Anregungsstrahlung (Auslösen des Blitzes) aufgenommen werden. Eine zusätzliche Kontrolle des Sicherheitsmerkmals ist beispielsweise möglich, indem die Referenzbilder 14a und 14b miteinander verglichen werden.Below the timeline are in 3 individual through the detector 09 of the smartphone 07 ( 2 ) Captured images 13 of the security feature 01 are shown. The images 13 show the decaying emission of the security feature 01 as a pattern that becomes weaker over time. For the verification of the security document 02 you can use another Process step are used. After the emission has essentially decayed completely, a reference image 14b can be recorded as the last image of the recorded image sequence. Depending on the evaluation method, an additional reference image 14a can also be recorded before the activation of the excitation radiation (triggering of the flash). An additional check of the security feature is possible, for example, by comparing the reference images 14a and 14b with one another.

Fig. 4 zeigt in vereinfachter Form den prinzipiellen Ablauf der Verifikation des Sicherheitsmerkmals 01 unter Anwendung der in Fig. 3 dargestellten Anordnung. In einem Positionierungs-Schritt 41 wird das zu verifizierende Sicherdokument so positioniert, dass es von der Bilderfassungseinheit des Smartphones sicher erfasst werden kann. In einem optionalen Referenzprüfungs-Schritt 42 wird bereits vor dem Auslösen der Blitzlichtanregung des Smartphones das Startbild 14a des Sicherheitsmerkmals erzeugt. In einem Detektions-Schritt 43 wird mit Hilfe der Bildaufnahmeeinheit der Beleuchtungseinheit des Smartphones ein Einzelblitz ausgelöst und eine Serienbild- bzw. Videoaufnahmen ausgeführt, um die nach dem Ende der Blitzlichtanregung vorhandenen und im ms-Bereich abklingenden Lumineszenzsignale des für die Erstellung des Sicherheitsmerkmals verwendeten Leuchtstoffes aufzuzeichnen. Schließlich werden in einem Emissions-AnalyseSchritt 44 die aufgenommenen Bildserien sowie die Referenzaufnahmen mittels der Datenverarbeitungseinheit verglichen. Neben der Berechnung der Bilddifferenzen und ihrer Analyse, werden dabei weitere Methoden der Bildverarbeitung wie beispielsweise die Kontrastanpassung und die Histogrammanalyse der unterschiedlichen Farbkanäle zur Anwendung gebracht, um auf diese Weise sowohl die spektrale Emissions- als auch die exklusive Abklingcharakteristik des erfindungsgemäß verwendeten Leuchtstoffes zu verifizieren. In einem optionalen Extraktions-Schritt kann eine Objekterkennung ausgeführt werden. Durch den Vergleich der berechneten Parameter mit den vorzugsweise im Datenspeicher des Smartphones hinterlegten Echtheitsparametern des Sicherheitsmerkmals kann die Echtheit des geprüften Sicherheitsdokuments in einem Freigabe-Schritt 45 bestätigt werden. Insbesondere kann durch die Verifikation des Sicherheitsmerkmals auf dem Sicherheitsdokument die Authentizität und Integrität des Sicherheitsdokuments bestätigt werden. 4 shows in a simplified form the basic process of verifying the security feature 01 using the in 3 arrangement shown. In a positioning step 41, the secure document to be verified is positioned in such a way that it can be securely captured by the smartphone's image capture unit. In an optional reference check step 42, the start image 14a of the security feature is already generated before the triggering of the flash light excitation of the smartphone. In a detection step 43, a single flash is triggered with the help of the image recording unit of the lighting unit of the smartphone and a serial image or video recording is carried out in order to record the luminescence signals of the phosphor used to create the security feature that are present after the end of the flash light excitation and decay in the ms range. Finally, in an emission analysis step 44, the recorded series of images and the reference recordings are compared using the data processing unit. In addition to the calculation of the image differences and their analysis, other image processing methods such as contrast adjustment and histogram analysis of the different color channels are used in order in this way to determine both the spectral emission and the exclusive decay characteristics of the to verify the phosphor used. In an optional extraction step, object recognition can be performed. The authenticity of the checked security document can be confirmed in a release step 45 by comparing the calculated parameters with the authenticity parameters of the security feature that are preferably stored in the data memory of the smartphone. In particular, the authenticity and integrity of the security document can be confirmed by the verification of the security feature on the security document.

BezugszeichenlisteReference List

0101
Sicherheitsmerkmalsecurity feature
0202
Sicherheitsdokument / Geldschein / BanknoteSecurity document / bill / banknote
0303
Nominalwertface value
0404
Beleuchtungseinheitlighting unit
0505
--
0606
Bildaufnahmeeinheitimage acquisition unit
0707
Smartphonesmartphone
0808
Blitzlichtflashlight
0909
Detektor / Kameradetector / camera
1010
--
1111
Emissionskurveemission curve
1212
Blitzlichtanregungskurveflash excitation curve
1313
Bildaufnahme des Sicherheitsmerkmals 01Image recording of the security feature 01
14a14a
Startbildsplash screen
14b14b
Referenzbildreference image
41 - 4541 - 45
Verfahrensschritteprocess steps

Claims (8)

  1. A method for verifying, by means of a smartphone, a phosphor-based security feature containing a phosphor that can be excited to emission and that has a decay time in the ms range, comprising the steps:
    - exciting the phosphor of the security feature to emission by means of an illumination unit of the smartphone;
    - capturing the emission upon completion of the excitation during a predetermined decay time through capture of a series of images or of a video recording with an image capture unit of the smartphone;
    - evaluating the series of images or video recording by means of a data processing unit of the smartphone, wherein the emission captured during the decay time is compared with stored reference data in order to verify the authenticity of the security feature;
    characterized in that the distance between the security feature and the image capture unit of the smartphone during the excitation of the phosphor and the capture of the emission is selected to be less than the range of focus of the image capture unit.
  2. The method according to claim 1, characterized in that, for the evaluation of the series of images, the emission properties decay time (τ), wavelength (A) and/or colour shift are determined and compared with the reference data.
  3. The method according to claim 1 or 2, characterized in that, for the capture of the emission, the image differences between the images captured during the decay time and the reference image captured after the emission has decayed are generated (Δ1R=B1 -Bref ... ΔnR=Bn -Bref) and in that the emission values are subsequently calculated in the form of a hue value of the different colour channels by means of an RGB histogram and the decay time of the phosphor is determined on this basis.
  4. The method according to claims 1 to 3, characterized in that the following steps are carried out prior to the excitation of the phosphor:
    - implementation of an object detection by means of the image capture unit and the data processing unit of the smartphone to determine the position of the security feature on the security document or positioning the smartphone over the security document according to a predetermined position frame displayed in a display of the smartphone and using a position feature of the security document over which the position frame is arranged;
    - definition of a capture frame using the determined position of the security feature, wherein the security feature is arranged in the area of the capture frame;
    - defining a reference area arranged indirectly adjacent to the capture frame;
    and in that, upon completion of the excitation, the series of images is captured in the area of the capture frame as well as in the reference area.
  5. The method according to claim 4, characterized in that the series of images captured in the capture frame is compared with the series of images captured in the reference area by means of the data processing unit.
  6. The method according to one of claims 1 to 5, characterized in that the capture time is selected so that the last image of the series of images is captured after the decay time has ended, and in that the security feature is only verified as genuine when no emission of the phosphor is detectable in this last image.
  7. The method according to claim 6, characterized in that one or more images from the series of images of the position frame is compared with the last image of the series of images by means of the data processing unit of the smartphone in the following sub-steps:
    - emission detection, wherein an image difference between the captured images and the reference image is respectively determined, an RGB histogram is generated, the hue value of the different colour channels is determined, and the decay time of the phosphor is determined; and
    - object determination, wherein a shape analysis of the security feature is carried out.
  8. The method according to one of claims 1 to 7, characterized in that an application (app) is installed on the mobile end device, which application controls the illumination unit, the image capture unit and the data processing unit in order to execute the method.
EP19722517.0A 2018-04-17 2019-04-15 Method for the verification of a luminescent-material-based security feature Active EP3782136B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102018109142.7A DE102018109142A1 (en) 2018-04-17 2018-04-17 Method for verifying a fluorescent-based security feature
PCT/EP2019/059635 WO2019201839A1 (en) 2018-04-17 2019-04-15 Method for the verification of a luminescent-material-based security feature

Publications (2)

Publication Number Publication Date
EP3782136A1 EP3782136A1 (en) 2021-02-24
EP3782136B1 true EP3782136B1 (en) 2023-07-26

Family

ID=66439991

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19722517.0A Active EP3782136B1 (en) 2018-04-17 2019-04-15 Method for the verification of a luminescent-material-based security feature

Country Status (4)

Country Link
EP (1) EP3782136B1 (en)
CN (1) CN111989721B (en)
DE (1) DE102018109142A1 (en)
WO (1) WO2019201839A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102020104115A1 (en) * 2020-02-17 2021-08-19 Bundesdruckerei Gmbh Method for checking a smartphone-verifiable security feature, smartphone-verifiable security feature and value or security document
DE102020120567B4 (en) 2020-08-04 2022-07-14 Bundesdruckerei Gmbh PROCEDURE FOR VERIFICATION OF THE AUTHENTICITY OF A FLUORESCENT SECURITY FEATURE USING A MOBILE DEVICE AND MOBILE DEVICE

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1295263B1 (en) * 2000-06-28 2011-01-19 Sicpa Holding Sa Use of communication equipment and method for authenticating an item, unit and system for authenticating items, and authenticating device

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1389822A (en) * 2001-06-01 2003-01-08 郑州华鑫科贸有限公司 Laser code-varying marking and telephone inquiry anti-fake system
JP4569441B2 (en) * 2005-10-26 2010-10-27 カシオ計算機株式会社 Code reader and program
CN2888545Y (en) * 2005-11-11 2007-04-11 黄子志 Micrographic inspection mobile phone
US20080116392A1 (en) * 2006-11-20 2008-05-22 Celloptic, Inc. Method and system for wide-field multi-photon microscopy having a confocal excitation plane
CN101751714A (en) * 2008-12-05 2010-06-23 深圳富泰宏精密工业有限公司 Multifunctional portable electronic device
US9418282B2 (en) 2010-12-22 2016-08-16 U-Nica Technology Ag Method and device for authenticating documents marked with photochromic systems
WO2013034603A1 (en) 2011-09-06 2013-03-14 Bundesdruckerei Gmbh Method and arrangement for verifying a security document having a security feature in the form of a fluorescent printing element and use of such an arrangement
DE102011082174A1 (en) * 2011-09-06 2013-03-07 Bundesdruckerei Gmbh Device for mobile recognition of a document
DE102011121566A1 (en) * 2011-12-20 2013-06-20 Giesecke & Devrient Gmbh Method for assisting user during authenticity verification of banknote, involves showing banknote containing superimposed image representation on screen of data-processing system based on identified denomination of banknote
US8759794B2 (en) * 2012-07-20 2014-06-24 Honeywell International Inc. Articles, methods of validating the same, and validation systems employing decay constant modulation
GB2507575B (en) * 2012-11-06 2017-04-12 Filtrona C&Sp Ltd An authentication device
CN105934779B (en) * 2013-12-02 2019-03-26 雷恩哈德库兹基金两合公司 For verifying the method for safety element and the safety element of optically-variable
CN204439554U (en) * 2015-03-27 2015-07-01 华南师范大学 Smart mobile phone wide field fluoroscope imager
EP3076332B1 (en) * 2015-03-30 2020-06-24 Cabro S.p.A. Method to check the authenticity of articles, each provided with at least one optical reading marking
DE102015005304B3 (en) * 2015-04-27 2016-08-18 Sensor Instruments Entwicklungs- Und Vertriebs Gmbh Device for a portable smart device
EP3317624B1 (en) * 2015-07-05 2019-08-07 The Whollysee Ltd. Optical identification and characterization system and tags
US20170039794A1 (en) * 2015-08-04 2017-02-09 Spectra Systems Corp. Photoluminescent authentication devices, systems, and methods
CN205283677U (en) * 2015-10-27 2016-06-01 东莞市美光达光学科技有限公司 Flash light lighting module and camera device with ligh -ranging function closely
TWI742100B (en) * 2016-07-06 2021-10-11 瑞士商西克帕控股有限公司 Method for authenticating a security marking utilizing long afterglow emission, and security marking comprising one or more afterglow compound
CN106599758A (en) * 2016-11-29 2017-04-26 努比亚技术有限公司 Image quality processing method and terminal
US9922224B1 (en) * 2017-02-21 2018-03-20 Narayan Nambudiri Method and system for identifying and authenticating an object
CN107423796A (en) * 2017-07-28 2017-12-01 广州中国科学院先进技术研究所 A kind of multispectral invisible anti-counterfeit mark and its detection means, detection method

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1295263B1 (en) * 2000-06-28 2011-01-19 Sicpa Holding Sa Use of communication equipment and method for authenticating an item, unit and system for authenticating items, and authenticating device

Also Published As

Publication number Publication date
WO2019201839A1 (en) 2019-10-24
DE102018109142A1 (en) 2019-10-17
EP3782136A1 (en) 2021-02-24
CN111989721B (en) 2023-07-14
CN111989721A (en) 2020-11-24

Similar Documents

Publication Publication Date Title
EP2656325B1 (en) Method and device for authenticating documents marked with photochromic systems
EP2718911B1 (en) Method for verifying a security document having a security feature in the form of a fluorescent printing element and use of such a corresponding arrangement
EP3781408B1 (en) Smartphone-verifiable, luminescent-material-based security feature and assembly for verification
EP2879919B1 (en) Detection of rain drops on a plate by means of a camera and illumination
EP3746992B1 (en) Method for checking the authenticity and/or integrity of a security document having a printed security feature, security feature and arrangement for verification
EP3782136B1 (en) Method for the verification of a luminescent-material-based security feature
EP3400583B1 (en) Checking the authenticity of value documents
EP3400584B1 (en) Completeness check of a value document
EP3131070B1 (en) Device for testing a coating of a document
DE102017108983B4 (en) Optical product inspection system
EP2915146B1 (en) Method and device for checking a security element
DE102020120567B4 (en) PROCEDURE FOR VERIFICATION OF THE AUTHENTICITY OF A FLUORESCENT SECURITY FEATURE USING A MOBILE DEVICE AND MOBILE DEVICE
DE102008041113A1 (en) Method of verifying the authenticity of a document, computer program product, testing device and data processing system
EP4000050B1 (en) Photoluminescence sensor device for detecting a security feature of an object moving relative to the sensor device
DE102012108316A1 (en) Rain recognizing device for use in vehicle, has camera including image sensor, and camera and illumination source formed and arranged in such manner that camera detects signal of monochrome light, with which disk illuminates source
EP4000049B1 (en) Photo luminescence sensor device for verifying a security feature of an object and method for calibrating a photoluminescence sensor device
EP2195610B1 (en) Method and device for detecting a surface or a surface section of a body
DE102016004662A1 (en) Apparatus and method for high resolution monitoring of color security features
EP3866126A1 (en) Method for verifying a smartphone-verifiable security feature, smartphone-verifiable security feature and valuable or security document
DE102019111914A1 (en) Procedure for evaluating an infrared signature
DE102016120979A1 (en) Method for checking the authenticity of a security feature and arrangement for checking the authenticity of a security document with a security feature
AT514659A1 (en) Method for testing an article for authenticity

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201111

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20230321

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230526

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502019008658

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20230726

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231027

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231126

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231127

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231026

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231126

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231027

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502019008658

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20240429

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240423

Year of fee payment: 6

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240418

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240423

Year of fee payment: 6