EP2956915B1 - Method for authenticating an identification document - Google Patents

Method for authenticating an identification document Download PDF

Info

Publication number
EP2956915B1
EP2956915B1 EP14704155.2A EP14704155A EP2956915B1 EP 2956915 B1 EP2956915 B1 EP 2956915B1 EP 14704155 A EP14704155 A EP 14704155A EP 2956915 B1 EP2956915 B1 EP 2956915B1
Authority
EP
European Patent Office
Prior art keywords
image
identification document
spatial position
features
determined
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP14704155.2A
Other languages
German (de)
French (fr)
Other versions
EP2956915A1 (en
Inventor
Olaf Dressel
Olga Kulikovska
André LEOPOLD
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bundesdruckerei GmbH
Original Assignee
Bundesdruckerei GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=50097695&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=EP2956915(B1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Bundesdruckerei GmbH filed Critical Bundesdruckerei GmbH
Publication of EP2956915A1 publication Critical patent/EP2956915A1/en
Application granted granted Critical
Publication of EP2956915B1 publication Critical patent/EP2956915B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07D—HANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
    • G07D7/00—Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
    • G07D7/20—Testing patterns thereon
    • G07D7/2008—Testing patterns thereon using pre-processing, e.g. de-blurring, averaging, normalisation or rotation
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07D—HANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
    • G07D7/00—Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
    • G07D7/003—Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency using security elements
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07D—HANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
    • G07D7/00—Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
    • G07D7/20—Testing patterns thereon
    • G07D7/202—Testing patterns thereon using pattern matching
    • G07D7/206—Matching template patterns

Definitions

  • the present invention relates to the field of checking the authenticity of an identification document.
  • the publication US 2005/1292821 shows a method for verifying a hologram.
  • the publication WO 92/01975 A1 shows a method for identifying a hologram.
  • the publication EP 2 320 390 A1 shows a method and system for reading and validating identification documents.
  • the publication US 2008/267514 A1 Fig. 15 shows a method of determining whether or not a test object is an authentic object.
  • Modern identification documents usually have optical security features which enable verification of the authenticity of an identification document.
  • Known optical security features are for example holograms, engraved gravure features or security features that include fluorescent colors.
  • a static image of the security feature is usually recorded, which is compared with a likewise static reference image.
  • the authenticity of an identification document can be determined on the basis of a similarity of the recorded image with the reference image.
  • a mobile recording of a Identification document is also a dynamic overall process, which can affect a focusing error and a motion blur.
  • the invention is based on the finding that the above object can be achieved by exploiting viewing angle-dependent representations of a security feature of an identification document.
  • viewing angle-dependent representations is to be understood as meaning identical or different representations of the security feature as a function of a viewing, viewing angle and / or illumination angle on the security feature, such as, for example, a hologram.
  • a movement dynamics of a mobile reading device can be utilized to record a plurality of images of an identification document or of a security feature from different perspectives perspectives. This results in a sequence of image-dependent shots of the security feature. This image sequence can be compared with a reference image sequence. In this way, it is possible to dispense with the observance of predefined static space conditions when receiving an identification document or a security feature.
  • the identification document it is required to bring the identification document with respect to the recording camera in different spatial positions, which can be described by a motion vector.
  • This makes efficient use of the dynamics of motion in a mobile recording. If the reference image sequence depicts different spatial position views of the identification document or of the security feature in accordance with the motion vector, it is possible for the detected image sequence to match the motion vector Reference image sequence are assumed. In this comparison, for example, characteristic security features in the image sequence can be compared with reference features.
  • the invention relates to a method for checking the authenticity of an identification document which has a security feature with viewing angle-dependent representations, with capturing a first image of the identification document with the security feature in a first spatial position of the identification document, and capturing a second image of the identification document with the security feature in a second spatial position of the identification document in order to obtain an image sequence with different spatial positions of the identification document, and comparing image features of the acquired image sequence with reference features in order to verify the authenticity of the identification document.
  • the spatial position of the identification document arises, for example, by a tilting of the identification document with respect to a receiving device or with respect to a previous spatial position of the identification document.
  • the identification document and / or a recording device is moved in space to obtain the image sequence.
  • characteristic, in particular predetermined image features of the acquired image sequence can be taken into account. If these image features are, for example, corner points of a quadrilateral, a different arrangement of the characteristic vertices with respect to each other arises due to a perspective distortion in the respective spatial positions. This arrangement can be defined, for example, an extension or a compression of an imaginary quadrilateral indicated by the corner points.
  • the reference features or their position in different spatial positions or views can be from a geometric, possibly multi-dimensional, point model that as Reference model serves to be determined by a rotation, compression and / or extension.
  • the security feature can be, for example, a hologram or an embossing with viewing angle-dependent representations or properties or an application of paint, which can be iridescent.
  • the first spatial position of the identification document is determined in the step of capturing the first image, and in the step of capturing the second image, the second spatial position of the identification document is determined.
  • properties of the identification document in particular geometric properties, such as edge run, can be used to detect the respective spatial position.
  • the image sequence is detected by means of a recording device, and the respective spatial position is determined relative to a recording device.
  • the respective spatial position arises for example by a rotation or by a tilting of the identification document with respect to the receiving device, in particular with respect to an arrangement, i. a spatial position, the receiving device.
  • the respective spatial position is determined on the basis of a perspective distortion of an edge image of the identification document.
  • the perspective distortion can be, for example, that due to a change in a spatial position of the identification document from a predetermined by the edges of the identification document rectangle a trapezoid with two longer and two shorter legs is displayed.
  • the image features of the image sequence are extracted from at least one captured image, in particular digitally extracted.
  • the image features, in particular characteristic image features, which may be previously known, can be specified.
  • the characteristic image features can be extracted on the basis of image pattern recognition. According to one implementation, it can be assumed that the image features of the security feature are predetermined and therefore can be extracted.
  • the reference features are determined by a reference model, and the reference model is processed to obtain reference features according to the spatial position as first reference features, and to obtain the reference features according to the second spatial position as second reference features.
  • the reference model can be defined, for example, by a function which describes a change of an arrangement of image features as a function of a spatial position and / or independence from an arrangement of a luminous source which was used to record the reference image or the reference image sequence.
  • the reference model may represent the change of an arrangement of the reference features relative to each other in response to a motion vector.
  • the motion vector can correspond to the motion vector which arises when the identification document is brought from the first spatial position into the second spatial position.
  • the reference model may represent a sequence of arrays of reference features in different spatial locations.
  • a motion vector for a transition from the first spatial position to the second spatial position is determined, and the reference model is processed according to the determined motion vector, in particular perspective distorted. If the arrangement of the reference features is predetermined, for example, by a grid, the motion factor specifies how this arrangement is to be moved in space, for example, to be rotated.
  • the reference model is a digital model of the security feature.
  • the digital model may specify the reference features in the form of digital values.
  • the reference features are determined by a reference model, wherein the reference model is given by a reference function which determines an array of reference features depending on a spatial position or a perspective view, or wherein the reference model is a digital multidimensional model of the security feature, in particular a grid model or is a point model. Due to the reference function, the arrangement of Reference features determined in dependence on a perspective view of the reference model or the identification document.
  • the image features are extracted from the first image as first image features and from the second image as second image features.
  • a digital pattern recognition can be performed.
  • the identification document in the step of acquiring the first image and in the step of acquiring the second image, is illuminated by means of a luminous source arranged at a spatial position with respect to the identification document, and the first reference image and the second reference image are the arrangement of a luminous source at the Room position assigned.
  • the position of the light source can be detected, which angle-dependent image is detected.
  • the position of the light source can thus be a further parameter in the examination of the identification document for authenticity, according to one embodiment.
  • the spatial position of the light source relative to the identification document is determined.
  • the position of the light source can thereby be determined by means of an optical sensor.
  • the position of the light source corresponds to the position of the receiving device. This is true, for example, when the light source is a flash of a mobile phone, such as a smartphone, and the receiving device is the camera of the smartphone.
  • the spatial position of the light source relative to the identification document is determined.
  • the image features are compared at different spatial positions with reference features, which are assigned to different spatial positions and / or motion vectors of the identification document and / or different spatial positions of a light source.
  • reference features which are assigned to different spatial positions and / or motion vectors of the identification document and / or different spatial positions of a light source.
  • the reference features are extracted security features of a reference image sequence of the security feature in different spatial positions.
  • the method is carried out by means of a recording device, in particular a smartphone, with a display, and a desired spatial position of the identification feature is displayed with respect to the recording device on the display.
  • the invention relates to an identification document with a security feature, wherein the security feature comprises at least one of the following structures with viewing angle-dependent representations: at least one embossment, which comprises different viewing angle-dependent optical properties, in particular reflection properties or absorption properties or emission properties, an application of paint viewing angle-dependent reflection properties, an optical element, in particular a lens or a hologram or a reflective film.
  • the security feature comprises at least one of the following structures with viewing angle-dependent representations: at least one embossment, which comprises different viewing angle-dependent optical properties, in particular reflection properties or absorption properties or emission properties, an application of paint viewing angle-dependent reflection properties, an optical element, in particular a lens or a hologram or a reflective film.
  • the identification document is, for example, an identification document, a passport, a means of payment, for example a bank card or a credit card, a driver's license, a company ID card, a bill of lading or an authorization card.
  • the identification document can also be any other document whose identity and authenticity is to be confirmed.
  • a recording device 101 which may be a mobile reading device or a smartphone and may comprise a recording camera, which allows optical recording of the identification document 103.
  • the identification document 103 is brought into different spatial positions 103-1 and 103-2 with respect to the receiving device 101.
  • the transition between the spatial positions 103-1, 103-2 is in Fig. 1 represented by an arrow which symbolizes a motion vector.
  • the motion vector describes the transition of the identification document 103 from the first spatial position 103-1 to the second spatial position 103-2.
  • the motion vector can be described by means of coordinates in a multi-dimensional space.
  • the recording device 101 is designed to record at least one image of the identification document 103 or the security feature 104 per spatial position.
  • the security feature 104 for example a hologram, characterized viewing angle-dependent properties or representations, the recordings of the security feature 104 in the different spatial positions 103-1, 103-2 are different. This results in an image sequence which can be compared with a reference image sequence, which includes reference images of the security feature in corresponding spatial positions relative to a reference recording device.
  • the receiving device 101 for example, stationary, so that the identification document 103 is transferred into the different spatial positions by moving the identification document 103 with respect to the receiving device.
  • Fig. 2 shows an embodiment in which the identification document 103 is mounted stationary and in which the receiving device 101 is brought into different spatial positions 101-1 and 101-2, for example by tilting or twisting, with respect to the identification document 103.
  • the spatial position of the identification document 104 also changes relative to the receiving device 101 in the different spatial positions of the receiving device 101.
  • the recording device when shooting the images of the security feature 104, a position of one in the Fig. 1 and 2 not shown, which illuminates the security feature 104.
  • the light source can be arranged at any point in space. According to one embodiment, however, the recording device itself may comprise a light source, for example a flash of a smartphone.
  • the recorded image sequence can be compared with a reference image sequence which comprises images of reference images with a reference light source whose position corresponds to the position of the light source with respect to the security feature 104.
  • the respective images of the image sequence can be compared with the images of the reference image sequence.
  • image features may be compared to reference features.
  • the image features can be, for example, predetermined features and / or characteristic features in the respective image, for example corner points.
  • the respective spatial position of the identification document 103 with respect to the receiving device 101 can be determined.
  • an edge reduction can be performed.
  • the perspective distortion of a contour of the identification document 103 in different spatial positions of the identification document 103 with respect to the receiving device 101 can be determined.
  • the identification document 103 is located in a first spatial position in which, for example, a surface of the identification document 103 is arranged parallel to a surface of the receiving device 101, for example of a mobile radio device.
  • the image recorded by the recording device 101 changes, so that now a second image B is recorded, which may differ from the first image A.
  • the image sequence is A, B, so that image features of the images of the image sequence can be compared with reference features.
  • the security feature 104 for example, a hologram, so the spatial position of the light source 301 together with the respective spatial position of the identification document 103 affects the recordable, ie from the view of the receiving device 101 visible image according to one embodiment.
  • the spatial position of the light source with respect to the receiving device or with respect to the security feature in the choice of the reference image sequence is taken into account.
  • the location of the light source can be assumed to be known according to one embodiment.
  • the position of the luminous source with respect to the receiving device or with respect to the identification document can be determined.
  • a test image can be generated in advance.
  • the position of the luminous source can also be determined on the basis of the recorded image sequence.
  • certain images of the security feature 104 can only be recorded in certain positions of the light source 301 with respect to the identification document.
  • Fig. 5 illustrates the inventive concept based on an imaginary hemisphere 401, in the center of the identification document 103 is arranged with the feature 104.
  • an imaginary solder 403 On the feature 104, for example, there is centrally located an imaginary solder 403, the length of which may correspond to a radius of a spherical imaging surface.
  • the positions of the receiving device 101 on the spatial positions 1a and 1b relative to the identification document 103 can be assumed to be mathematically known or calculable at a distance and / or angle.
  • the optical imaging plane of the feature 103 on the identification document 104 is represented by the dashed contours 2a and 2b and lies, for example, tangentially to the surface of the hemisphere 401.
  • a first image 2a is generated by the impingement of illumination from the direction 3a, 3b, this can be recognized as a known feature.
  • the type, in particular image, and the conditions for the formation of the image in particular the position of the light source to the identification document 103th or the security feature 104, as well as the location of the resulting image known.
  • the imaging surface of a camera lens system 1a, 1b of the recording device 101 is plane-parallel to the imaging planes 2a, 2b of the security feature 104, there are no translatory between the camera lens system 1a and 2a or between the imaging planes 1b and 2b or other corrections necessary, which could arise, for example, by turning, tilting or tilting.
  • a targeted positioning of the receiving device 101 on the spatial position 1b take place so that the expected image 2b can be found there.
  • the two found positions may be related to a definition of a behavior of the feature, i. For example, the viewing angle dependent properties of the feature to be compared.
  • Fig. 6 shows a diagram of a method for verifying the authenticity of an identification document having a security feature with viewing angle-dependent representations.
  • the method comprises the step of capturing 601 a first image of the identification document with the security feature in a first spatial position of the identification document and capturing 603 of a second image of the identification document with the security feature in a second spatial position of the identification document, to an image sequence in different spatial positions of the identification document receive.
  • the spatial positions of the identification document for example, relative spatial positions of the identification document 103 with respect to the receiving device 101, as for example in the Fig. 1 and 2 is shown.
  • the method further comprises comparing 605 image features in the captured image sequence with reference features to verify the authenticity of the identification document.
  • the reference features can be taken, for example, a memory which is either arranged in the receiving device or can be reached by the receiving device, for example via a communication network.
  • the method may further comprise determining the respective spatial position of the identification document, for example on the basis of an edge detection.
  • the detection 601, 603 can be performed, for example, by taking optical images of the first image and the second image.
  • the method comprises determining a test object, i. a referencing.
  • the method further comprises determining the spatial position of the entire identification document with respect to the receiving device.
  • the method comprises extracting the first, for example random, test pattern of the security feature at a specific position from reference and position information.
  • the reference and position information can be determined for example from a device-internal sensors or additional optical information such as horizon position.
  • the successive picks i. Detection steps of the images of the image sequence, for example, can be carried out at short intervals, whereby the so-called videographing can be realized.
  • the distances may be longer than in videographing, so that a multi-shot recording method can be realized thereby.
  • the method further comprises determining a positional change between the images and a derivative of one or more motion vectors and, optionally, solid angles.
  • the method further comprises comparing the image sequence with a reference image sequence or with a reference model of a security feature, for example a hologram.
  • the method may include a comparison with a known image sequence depending on the angular direction.
  • the recorded images of a security feature in particular a hologram, must appear in different spatial positions in the same sequence and with the same content as determinable on the basis of the reference model.
  • the reference model may be a 3D reference model that may derive or represent an array of reference features at different angles of view.
  • the method may further comprise a comparison with a generic reference model describing a 3D space, so that the recordable recordable images for the respective spatial position can be derived.
  • the illumination or the spatial position of the light source remains as a further parameter for an example holographic appearance of the security feature.
  • this can be extracted because an entry into the three-dimensional reference model of the security feature can take place at a first known or matching position.
  • the method begins at a first known spatial position of the identification document with respect to the receiving device and at a predetermined spatial position of a luminous source.
  • an integrated flash in the receiving device, for example in a smartphone, since its spatial arrangement, ie spatial position, is determined with respect to the receiving device or with respect to its camera and the identification document.
  • a deliberate change of the spatial position in a direction favorable to the test also makes it possible to test the identification document for authenticity.
  • the goal is to obtain a further representation of the security feature known in execution and position dependency.
  • This can be realized according to an embodiment by an augmented reality interface.
  • a desired spatial position of the identification document with respect to the receiving device or an indication of the spatial position can be displayed on a display of the receiving device become.
  • information about a previously known position of a lighting source with respect to the identification document or the security feature can be utilized.
  • previously known reflection or reflection properties of the identification document or its surface at predetermined positions of a lighting source can be used to determine or estimate the actual position.

Description

Die vorliegende Erfindung betrifft das Gebiet der Prüfung der Echtheit eines Identifikationsdokumentes.The present invention relates to the field of checking the authenticity of an identification document.

Die Offenlegungsschrift US 2009/154813 A1 zeigt ein Verfahren und eine Vorrichtung zum Validieren eines Hologramms.The publication US 2009/154813 A1 shows a method and apparatus for validating a hologram.

Die Offenlegungsschrift US 2005/1292821 zeigt ein Verfahren zur Verifikation eines Hologramms.The publication US 2005/1292821 shows a method for verifying a hologram.

Die Offenlegungsschrift WO 92/01975 A1 zeigt ein Verfahren zur Identifizierung eines Hologramms.The publication WO 92/01975 A1 shows a method for identifying a hologram.

Die Patentschrift US 7,778,540 B2 beschreibt, wie in Bild eines Objekts unter verschiedenen optischen Bedingungen durchleuchtet wird, wobei das Bild sich ändert abhängig von der optischen Bedingung.The patent US 7,778,540 B2 describes how to transilluminate an image of an object under different optical conditions, where the image changes depending on the optical condition.

Die Offenlegungsschrift US 2012/163666 A1 zeigt ein Verfahren, in welchem ein Objekt unter verschiedenen Aufnahmepunkten mittels einer Kameravorrichtung aufgenommen wird.The publication US 2012/163666 A1 shows a method in which an object is recorded at different pickup points by means of a camera device.

Die Offenlegungsschrift EP 2 320 390 A1 zeigt ein Verfahren und ein System zum Lesen und Validieren von Identifikationsdokumenten.The publication EP 2 320 390 A1 shows a method and system for reading and validating identification documents.

Die Offenlegungsschrift US 2008/267514 A1 zeigt ein Verfahren zum Ermitteln, ob ein Testobjekt ein authentisches Objekt ist oder nicht.The publication US 2008/267514 A1 Fig. 15 shows a method of determining whether or not a test object is an authentic object.

Moderne Identifikationsdokumente verfügen üblicherweise über optische Sicherheitsmerkmale, welche eine Überprüfung der Echtheit eines Identifikationsdokumentes ermöglichen. Bekannte optische Sicherheitsmerkmale sind beispielsweise Hologramme, Stich-Tiefdruckmerkmale oder Sicherheitsmerkmale, welche fluoreszierende Farben umfassen.Modern identification documents usually have optical security features which enable verification of the authenticity of an identification document. Known optical security features are for example holograms, engraved gravure features or security features that include fluorescent colors.

Zur Überprüfung der Echtheit eines Identifikationsdokumentes auf der Basis von optischen Sicherheitsmerkmalen werden diese beispielsweise mittels einer Aufnahmekamera eines stationären oder mobilen Lesegerätes erfasst.To verify the authenticity of an identification document on the basis of optical security features, these are detected, for example, by means of a recording camera of a stationary or mobile reading device.

Bei der optischen Erfassung eines Sicherheitsmerkmals wird üblicherweise ein statisches Bild des Sicherheitsmerkmals aufgenommen, das mit einem ebenfalls statischen Referenzbild verglichen wird. Die Echtheit eines Identifikationsdokumentes kann auf der Basis einer Ähnlichkeit des aufgenommenen Bildes mit dem Referenzbild festgestellt werden.In the optical detection of a security feature, a static image of the security feature is usually recorded, which is compared with a likewise static reference image. The authenticity of an identification document can be determined on the basis of a similarity of the recorded image with the reference image.

Nachteilig wirken sich hierbei jedoch perspektivische Verzerrungen aus, welche von einer Raumlage eines Identifikationsdokumentes bezüglich einer Aufnahmekamera abhängen. Unterscheidet sich die Raumlage des zu prüfenden Identifikationsdokumentes von einer Raumlage eines Referenz-Identifikationsdokumentes, das für die Aufnahme eines Referenzbildes diente, so entsteht eine perspektivische Abweichung bei den zu vergleichenden Bildern, welche eine Erkennung der Echtheit eines Identifikationsdokumentes erschwert. Aus diesem Grund ist es notwendig, während der Bildaufnahmen definierte Raumlage- bzw. Lichtbedingungen einzuhalten.However, disadvantageous here are perspective distortions, which depend on a spatial position of an identification document with respect to a recording camera. If the spatial position of the identification document to be examined differs from a spatial position of a reference identification document which was used to record a reference image, a perspective deviation arises in the images to be compared, which makes it difficult to recognize the authenticity of an identification document. For this reason, it is necessary to comply with defined Raumlage- or lighting conditions during the images.

Bei einer Aufnahme eines Bildes eines Identifikationsdokumentes mittels eines mobilen Lesegerätes, beispielsweise eines Mobiltelefons, ist die Einhaltung definierter Raumlage- bzw. Lichtbedingungen ohne Hilfsmittel jedoch sehr schwer. Eine mobile Aufnahme eines Identifikationsdokumentes ist zudem ein bewegungsdynamischer Gesamtprozess, welcher sich in einem Fokussierungsfehler sowie in einer Bewegungsunschärfe auswirken kann.When recording an image of an identification document by means of a mobile reading device, such as a mobile phone, compliance with defined Raumlage- or lighting conditions without tools but is very difficult. A mobile recording of a Identification document is also a dynamic overall process, which can affect a focusing error and a motion blur.

Es ist daher die Aufgabe der vorliegenden Erfindung, ein effizientes Konzept zum Überprüfen der Echtheit eines Identifikationsdokumentes mittels eines mobilen Lesegerätes zu schaffen.It is therefore the object of the present invention to provide an efficient concept for checking the authenticity of an identification document by means of a mobile reading device.

Diese Aufgabe wird durch die Sicherheitsmerkmale der unabhängigen Ansprüche gelöst. Vorteilhafte Weiterbildungsformen sind Gegenstand der abhängigen Patentansprüche, der Beschreibung sowie der Zeichnungen.This object is achieved by the security features of the independent claims. Advantageous forms of further development are the subject of the dependent claims, the description and the drawings.

Die Erfindung basiert auf der Erkenntnis, dass die obige Aufgabe durch eine Ausnutzung von blickwinkelabhängigen Darstellungen eines Sicherheitsmerkmals eines Identifikationsdokumentes gelöst werden kann. Unter dem Begriff "blickwinkelabhängige Darstellungen" sind gleiche oder unterschiedliche Darstellungen des Sicherheitsmerkmals in Abhängigkeit von einem Blick-, Betrachtungswinkel und/oder Beleuchtungswinkel auf das Sicherheitsmerkmal, wie beispielsweise bei einem Hologramm, zu verstehen. Dadurch kann eine Bewegungsdynamik eines mobilen Lesegerätes dazu ausgenutzt werden, eine Mehrzahl von Bildern eines Identifikationsdokuments bzw. eines Sicherheitsmerkmals aus unterschiedlichen Blickwinkelperspektiven aufzunehmen. Dadurch entsteht eine Bildfolge von blickwinkelabhängigen Aufnahmen des Sicherheitsmerkmals. Diese Bildfolge kann mit einer Referenzbildfolge verglichen werden. Auf diese Weise kann auf die Einhaltung von vordefinierten statischen Raumlagebedingungen bei der Aufnahme eines Identifikationsdokumentes bzw. eines Sicherheitsmerkmals verzichtet werden.The invention is based on the finding that the above object can be achieved by exploiting viewing angle-dependent representations of a security feature of an identification document. The term "viewing angle-dependent representations" is to be understood as meaning identical or different representations of the security feature as a function of a viewing, viewing angle and / or illumination angle on the security feature, such as, for example, a hologram. As a result, a movement dynamics of a mobile reading device can be utilized to record a plurality of images of an identification document or of a security feature from different perspectives perspectives. This results in a sequence of image-dependent shots of the security feature. This image sequence can be compared with a reference image sequence. In this way, it is possible to dispense with the observance of predefined static space conditions when receiving an identification document or a security feature.

Erfindungsgemäß wird gefordert, das Identifikationsdokument bezüglich der Aufnahmekamera in unterschiedliche Raumlagen zu bringen, was durch einen Bewegungsvektor beschrieben werden kann. Dadurch wird die Bewegungsdynamik bei einer mobilen Aufnahme effizient ausgenutzt. Bildet die Referenzbildfolge unterschiedliche Raumlagenansichten des Identifikationsdokumentes bzw. des Sicherheitsmerkmals gemäß dem Bewegungsvektor ab, so kann von einer Übereinstimmung der erfassten Bildfolge mit der dem Bewegungsvektor zugeordneten Referenzbildfolge ausgegangen werden. Bei diesem Vergleich können beispielsweise charakteristische Sicherheitsmerkmale in der Bildfolge mit Referenzmerkmalen verglichen werden.According to the invention, it is required to bring the identification document with respect to the recording camera in different spatial positions, which can be described by a motion vector. This makes efficient use of the dynamics of motion in a mobile recording. If the reference image sequence depicts different spatial position views of the identification document or of the security feature in accordance with the motion vector, it is possible for the detected image sequence to match the motion vector Reference image sequence are assumed. In this comparison, for example, characteristic security features in the image sequence can be compared with reference features.

Gemäß einem Aspekt betrifft die Erfindung ein Verfahren zum Überprüfen der Echtheit eines Identifikationsdokumentes, das ein Sicherheitsmerkmal mit blickwinkelabhängigen Darstellungen aufweist, mit Erfassen eines ersten Bildes des Identifikationsdokumentes mit dem Sicherheitsmerkmal bei einer ersten Raumlage des Identifikationsdokumentes, und Erfassen eines zweiten Bildes des Identifikationsdokumentes mit dem Sicherheitsmerkmal bei einer zweiten Raumlage des Identifikationsdokumentes, um eine Bildfolge bei unterschiedlichen Raumlagen des Identifikationsdokumentes zu erhalten, und Vergleichen von Bildmerkmalen der erfassten Bildfolge mit Referenzmerkmalen, um die Echtheit des Identifikationsdokumentes zu überprüfen.According to one aspect, the invention relates to a method for checking the authenticity of an identification document which has a security feature with viewing angle-dependent representations, with capturing a first image of the identification document with the security feature in a first spatial position of the identification document, and capturing a second image of the identification document with the security feature in a second spatial position of the identification document in order to obtain an image sequence with different spatial positions of the identification document, and comparing image features of the acquired image sequence with reference features in order to verify the authenticity of the identification document.

Durch die jeweilige Raumlage wird gemäß einer Ausführungsform eine jeweils unterschiedliche perspektivische Ansicht auf die Bildmerkmale bzw. auf die Referenzmerkmale erhalten.Due to the respective spatial position, a respective different perspective view of the image features or the reference features is obtained according to an embodiment.

Die Raumlage des Identifikationsdokumentes entsteht beispielsweise durch eine Verkippung des Identifikationsdokumentes gegenüber einer Aufnahmeeinrichtung oder bezüglich einer vorherigen Raumlage des Identifikationsdokumentes. Mit anderen Worten ausgedrückt wird das Identifikationsdokument und/oder eine Aufnahmeeinrichtung im Raum bewegt, um die Bildfolge zu erhalten. Hierbei können beispielsweise charakteristische, insbesondere vorgegebene Bildmerkmale der erfassten Bildfolge berücksichtigt werden. Handelt es sich bei diesen Bildmerkmalen beispielsweise um Eckpunkte eines Vierecks, so entsteht aufgrund einer perspektivischen Verzerrung in den jeweiligen Raumlagen jeweils eine unterschiedliche Anordnung der charakteristischen Eckpunkte bezüglich einander. Diese Anordnung kann beispielsweise eine Streckung oder eine Stauchung eines durch die Eckpunkte angedeuteten imaginären Viereckes definiert werden.The spatial position of the identification document arises, for example, by a tilting of the identification document with respect to a receiving device or with respect to a previous spatial position of the identification document. In other words, the identification document and / or a recording device is moved in space to obtain the image sequence. In this case, for example, characteristic, in particular predetermined image features of the acquired image sequence can be taken into account. If these image features are, for example, corner points of a quadrilateral, a different arrangement of the characteristic vertices with respect to each other arises due to a perspective distortion in the respective spatial positions. This arrangement can be defined, for example, an extension or a compression of an imaginary quadrilateral indicated by the corner points.

Die Referenzmerkmale bzw. deren Lage in unterschiedlichen Raumlagen bzw. Ansichten können aus einem geometrischen, ggf. mehrdimensionalen, Punktemodell das als Referenzmodell dient, durch eine Drehung, Stauchung und/oder Streckung bestimmt werden.The reference features or their position in different spatial positions or views can be from a geometric, possibly multi-dimensional, point model that as Reference model serves to be determined by a rotation, compression and / or extension.

Das Sicherheitsmerkmal kann beispielsweise ein Hologramm sein oder eine Prägung mit blickwinkelabhängigen Darstellungen bzw. Eigenschaften oder ein Farbauftrag, welcher changierend sein kann, sein.The security feature can be, for example, a hologram or an embossing with viewing angle-dependent representations or properties or an application of paint, which can be iridescent.

Erfindungsgemäß wird im Schritt des Erfassens des ersten Bildes die erste Raumlage des Identifikationsdokumentes bestimmt, und im Schritt des Erfassens des zweiten Bildes wird die zweite Raumlage des Identifikationsdokumentes bestimmt. Hierbei können beispielsweise Eigenschaften des Identifikationsdokumentes, insbesondere geometrische Eigenschaften, wie Kantenlauf, herangezogen werden, um die jeweilige Raumlage zu erfassen.According to the invention, the first spatial position of the identification document is determined in the step of capturing the first image, and in the step of capturing the second image, the second spatial position of the identification document is determined. In this case, for example, properties of the identification document, in particular geometric properties, such as edge run, can be used to detect the respective spatial position.

Erfindungsgemäß wird die Bildfolge mittels einer Aufnahmeeinrichtung erfasst, und die jeweilige Raumlage wird relativ zu einer Aufnahmeeinrichtung bestimmt. Die jeweilige Raumlage entsteht beispielsweise durch eine Drehung oder durch eine Verkippung des Identifikationsdokumentes bezüglich der Aufnahmeeinrichtung, insbesondere bezüglich einer Anordnung, d.h. einer Raumlage, der Aufnahmeeinrichtung. Gemäß einer Ausführungsform wird die jeweilige Raumlage auf der Basis einer perspektivischen Verzerrung eines Kantenbildes des Identifikationsdokumentes bestimmt. Die perspektivische Verzerrung kann beispielsweise darin bestehen, dass aufgrund einer Änderung einer Raumlage des Identifikationsdokumentes aus einem durch die Kanten des Identifikationsdokumentes vorgegebenen Rechteck ein Trapez mit zwei längeren und zwei kürzeren Schenkeln abgebildet wird.According to the invention, the image sequence is detected by means of a recording device, and the respective spatial position is determined relative to a recording device. The respective spatial position arises for example by a rotation or by a tilting of the identification document with respect to the receiving device, in particular with respect to an arrangement, i. a spatial position, the receiving device. According to one embodiment, the respective spatial position is determined on the basis of a perspective distortion of an edge image of the identification document. The perspective distortion can be, for example, that due to a change in a spatial position of the identification document from a predetermined by the edges of the identification document rectangle a trapezoid with two longer and two shorter legs is displayed.

Gemäß einer Ausführungsform werden die Bildmerkmale der Bildfolge aus zumindest einem erfassten Bild extrahiert, insbesondere digital extrahiert. Hierbei können die Bildmerkmale, insbesondere charakteristische Bildmerkmale, welche vorbekannt sein können, vorgegeben werden. Die charakteristischen Bildmerkmale können auf der Basis einer Bildmustererkennung extrahiert werden. Gemäß einer Implementierungsform kann davon ausgegangen werden, dass die Bildmerkmale des Sicherheitsmerkmals vorbestimmt sind und daher extrahiert werden können.According to one embodiment, the image features of the image sequence are extracted from at least one captured image, in particular digitally extracted. Here, the image features, in particular characteristic image features, which may be previously known, can be specified. The characteristic image features can be extracted on the basis of image pattern recognition. According to one implementation, it can be assumed that the image features of the security feature are predetermined and therefore can be extracted.

Erfindungsgemäß sind die Referenzmerkmale durch ein Referenzmodell bestimmt, und das Referenzmodell wird verarbeitet, um Referenzmerkmale gemäß der Raumlage als erste Referenzmerkmale zu erhalten, und um die Referenzmerkmale gemäß der zweiten Raumlage als zweite Referenzmerkmale zu erhalten. Das Referenzmodell kann beispielsweise durch eine Funktion definiert werden, welche eine Änderung einer Anordnung von Bildmerkmalen in Abhängigkeit von einer Raumlage und/oder in Unabhängigkeit von einer Anordnung einer Leuchtquelle, welche zur Aufnahme des Referenzbildes bzw. der Referenzbildfolge verwendet worden ist, beschreibt. Das Referenzmodell kann beispielsweise die Änderung einer Anordnung der Referenzmerkmale bezüglich einander in Abhängigkeit von einem Bewegungsvektor wiedergeben. Der Bewegungsvektor kann beispielsweise dem Bewegungsvektor entsprechen, welcher entsteht, wenn man das Identifikationsdokument von der ersten Raumlage in die zweite Raumlage bringt. Das Referenzmodell kann jedoch eine Abfolge von Anordnungen von Referenzmerkmalen bei unterschiedlichen Raumlagen wiedergeben.According to the invention, the reference features are determined by a reference model, and the reference model is processed to obtain reference features according to the spatial position as first reference features, and to obtain the reference features according to the second spatial position as second reference features. The reference model can be defined, for example, by a function which describes a change of an arrangement of image features as a function of a spatial position and / or independence from an arrangement of a luminous source which was used to record the reference image or the reference image sequence. For example, the reference model may represent the change of an arrangement of the reference features relative to each other in response to a motion vector. By way of example, the motion vector can correspond to the motion vector which arises when the identification document is brought from the first spatial position into the second spatial position. However, the reference model may represent a sequence of arrays of reference features in different spatial locations.

Gemäß einer Ausführungsform wird ein Bewegungsvektor für einen Übergang von der ersten Raumlage in die zweite Raumlage bestimmt, und das Referenzmodell wird gemäß dem bestimmten Bewegungsvektor verarbeitet, insbesondere perspektivisch verzerrt. Ist die Anordnung der Referenzmerkmale beispielsweise durch ein Gitter vorgegeben, so gibt der Bewegungsfaktor vor, wie diese Anordnung im Raum zu bewegen, beispielsweise zu drehen ist.According to one embodiment, a motion vector for a transition from the first spatial position to the second spatial position is determined, and the reference model is processed according to the determined motion vector, in particular perspective distorted. If the arrangement of the reference features is predetermined, for example, by a grid, the motion factor specifies how this arrangement is to be moved in space, for example, to be rotated.

Gemäß einer Ausführungsform ist das Referenzmodell ein digitales Modell des Sicherheitsmerkmals. Das digitale Modell kann beispielsweise die Referenzmerkmale in der Gestalt von digitalen Werten angeben.According to one embodiment, the reference model is a digital model of the security feature. For example, the digital model may specify the reference features in the form of digital values.

Gemäß einer Ausführungsform sind die Referenzmerkmale durch ein Referenzmodell bestimmt, wobei das Referenzmodell durch eine Referenzfunktion gegeben ist, welche eine Anordnung von Referenzmerkmalen in Abhängigkeit von einer Raumlage oder einer perspektivischen Ansicht bestimmt oder wobei das Referenzmodell ein digitales mehrdimensionales Modell des Sicherheitsmerkmals, insbesondere ein Gittermodell oder ein Punktemodell ist. Durch die Referenzfunktion wird die Anordnung der Referenzmerkmale in Abhängigkeit von einer perspektivischen Ansicht des Referenzmodells bzw. des Identifikationsdokumentes bestimmt.According to one embodiment, the reference features are determined by a reference model, wherein the reference model is given by a reference function which determines an array of reference features depending on a spatial position or a perspective view, or wherein the reference model is a digital multidimensional model of the security feature, in particular a grid model or is a point model. Due to the reference function, the arrangement of Reference features determined in dependence on a perspective view of the reference model or the identification document.

Gemäß einer Ausführungsform werden die Bildmerkmale aus dem ersten Bild als erste Bildmerkmale und aus dem zweiten Bild als zweite Bildmerkmale extrahiert. Hierbei kann beispielsweise eine digitale Mustererkennung durchgeführt werden.According to one embodiment, the image features are extracted from the first image as first image features and from the second image as second image features. In this case, for example, a digital pattern recognition can be performed.

Gemäß einer Ausführungsform wird in dem Schritt des Erfassens des ersten Bildes und in dem Schritt des Erfassens des zweiten Bildes das Identifikationsdokument mittels einer an einer Raumposition bezüglich des Identifikationsdokumentes angeordneten Leuchtquelle beleuchtet, und das erste Referenzbild und das zweite Referenzbild sind der Anordnung einer Leuchtquelle an der Raumposition zugeordnet. Durch die Lage der Leuchtquelle kann erfasst werden, welches blickwinkelabhängige Bild erfasst wird. Die Lage der Leuchtquelle kann gemäß einer Ausführungsform somit ein weiterer Parameter bei der Prüfung des Identifikationsdokumentes auf die Echtheit sein.According to an embodiment, in the step of acquiring the first image and in the step of acquiring the second image, the identification document is illuminated by means of a luminous source arranged at a spatial position with respect to the identification document, and the first reference image and the second reference image are the arrangement of a luminous source at the Room position assigned. By the position of the light source can be detected, which angle-dependent image is detected. The position of the light source can thus be a further parameter in the examination of the identification document for authenticity, according to one embodiment.

Gemäß einer Ausführungsform wird die Raumlage der Leuchtquelle relativ zu dem Identifikationsdokument bestimmt. Hierbei kann beispielsweise anhand der erfassten Bildfolge sowie anhand der erfassten Raumlage auf die Lage der Leuchtquelle bei bekannten Eigenschaften eines Sicherheitsmerkmals geschlossen werden. Die Lage der Leuchtquelle kann hierdurch auch mittels eines optischen Sensors bestimmt werden.According to one embodiment, the spatial position of the light source relative to the identification document is determined. In this case, it is possible, for example, to deduce the position of the luminous source with known properties of a security feature on the basis of the acquired image sequence and on the basis of the detected spatial position. The position of the light source can thereby be determined by means of an optical sensor.

Gemäß einer Ausführungsform entspricht die Lage der Leuchtquelle der Lage der Aufnahmeeinrichtung. Dies trifft beispielsweise dann zu, wenn die Leuchtquelle ein Blitz eines Mobiltelefons, beispielsweise eines Smartphones, ist und die Aufnahmeeinrichtung die Aufnahmekamera des Smartphones ist.According to one embodiment, the position of the light source corresponds to the position of the receiving device. This is true, for example, when the light source is a flash of a mobile phone, such as a smartphone, and the receiving device is the camera of the smartphone.

Gemäß einer Ausführungsform wird die Raumlage der Leuchtquelle relativ zu dem Identifikationsdokument bestimmt.According to one embodiment, the spatial position of the light source relative to the identification document is determined.

Gemäß einer Ausführungsform werden im Schritt des Vergleichens die Bildmerkmale bei unterschiedlichen Raumlagen mit Referenzmerkmalen, welche unterschiedlichen Raumlagen und/oder Bewegungsvektoren des Identifikationsdokumentes und/oder unterschiedlichen Raumlagen einer Leuchtquelle zugeordnet sind, verglichen. Dadurch wird ein mehrdimensionaler, beispielsweise ein dreidimensionaler Abgleich durchgeführt. Die Dimensionen sind bestimmt durch die Lage der Leuchtquelle, durch die Raumlagen sowie durch die Bewegungsvektoren.According to one embodiment, in the step of comparing, the image features are compared at different spatial positions with reference features, which are assigned to different spatial positions and / or motion vectors of the identification document and / or different spatial positions of a light source. Thereby a multi-dimensional, for example, a three-dimensional adjustment is performed. The dimensions are determined by the position of the light source, by the spatial positions and by the motion vectors.

Gemäß einer Ausführungsform sind die Referenzmerkmale extrahierte Sicherheitsmerkmale einer Referenzbildfolge des Sicherheitsmerkmals bei unterschiedlichen Raumlagen.According to one embodiment, the reference features are extracted security features of a reference image sequence of the security feature in different spatial positions.

Gemäß einem weiteren Aspekt wird das Verfahren mittels einer Aufnahmeeinrichtung, insbesondere eines Smartphones, mit einer Anzeige durchgeführt, und eine Soll-Raumlage des Identifikationsmerkmals wird bezüglich der Aufnahmeeinrichtung auf der Anzeige angezeigt.According to a further aspect, the method is carried out by means of a recording device, in particular a smartphone, with a display, and a desired spatial position of the identification feature is displayed with respect to the recording device on the display.

Gemäß einem weiteren nicht beanspruchten Aspekt betrifft die Erfindung ein Identifikationsdokument mit einem Sicherheitsmerkmal, wobei das Sicherheitsmerkmal zumindest eine der folgenden Strukturen mit blickwinkelabhängigen Darstellungen umfasst: zumindest eine Prägung, welche unterschiedliche blickwinkelabhängige optische Eigenschaften, insbesondere Reflexionseigenschaften oder Absorptionseigenschaften oder Abstrahleigenschaften, umfasst, einen Farbauftrag mit blickwinkelabhängigen Reflexionseigenschaften, ein optisches Element, insbesondere eine Linse oder ein Hologramm oder einen reflektierenden Film.According to a further unclaimed aspect, the invention relates to an identification document with a security feature, wherein the security feature comprises at least one of the following structures with viewing angle-dependent representations: at least one embossment, which comprises different viewing angle-dependent optical properties, in particular reflection properties or absorption properties or emission properties, an application of paint viewing angle-dependent reflection properties, an optical element, in particular a lens or a hologram or a reflective film.

Das Identifikationsdokument ist beispielsweise ein Ausweisdokument, ein Reisepass, ein Zahlungsmittel, beispielsweise eine Bankkarte oder eine Kreditkarte, ein Führerschein, ein Unternehmensausweis, ein Frachtbrief oder ein Berechtigungsausweis. Im Allgemeinen kann das Identifikationsdokument auch jedes andere Dokument sein, dessen Identität und Echtheit bestätigt werden soll.The identification document is, for example, an identification document, a passport, a means of payment, for example a bank card or a credit card, a driver's license, a company ID card, a bill of lading or an authorization card. In general, the identification document can also be any other document whose identity and authenticity is to be confirmed.

Weitere Ausführungsbeispiele werden Bezug nehmend auf die beiliegenden Zeichnungen erläutert. Es zeigen:

Fig. 1
ein Verfahren zum Überprüfen der Echtheit eines Identifikationsdokuments gemäß einer Ausführungsform;
Fig. 2
ein Verfahren zum Überprüfen der Echtheit eines Identifikationsdokuments gemäß einer Ausführungsform;
Fig. 3
ein Verfahren zum Überprüfen der Echtheit eines Identifikationsdokuments gemäß einer Ausführungsform;
Fig. 4
ein Verfahren zum Überprüfen der Echtheit eines Identifikationsdokuments gemäß einer Ausführungsform;
Fig. 5
ein Verfahren zum Überprüfen der Echtheit eines Identifikationsdokuments gemäß einer Ausführungsform; und
Fig. 6
ein Verfahren zum Überprüfen der Echtheit eines Identifikationsdokumentes gemäß einer Ausführungsform.
Further embodiments will be explained with reference to the accompanying drawings. Show it:
Fig. 1
a method of verifying the authenticity of an identification document according to an embodiment;
Fig. 2
a method of verifying the authenticity of an identification document according to an embodiment;
Fig. 3
a method of verifying the authenticity of an identification document according to an embodiment;
Fig. 4
a method of verifying the authenticity of an identification document according to an embodiment;
Fig. 5
a method of verifying the authenticity of an identification document according to an embodiment; and
Fig. 6
a method for verifying the authenticity of an identification document according to an embodiment.

In den Fig. 1 und 2 ist das erfindungsgemäße Konzept zum Überprüfen der Echtheit eines Identifikationsdokumentes verdeutlicht. Zur Bilderfassung wird eine Aufnahmeeinrichtung 101 eingesetzt, welche ein mobiles Lesegerät oder ein Smartphone sein kann und eine Aufnahmekamera umfassen kann, welche eine optische Aufnahme des Identifikationsdokumentes 103 ermöglicht.In the Fig. 1 and 2 the concept according to the invention for verifying the authenticity of an identification document is clarified. For image capture, a recording device 101 is used, which may be a mobile reading device or a smartphone and may comprise a recording camera, which allows optical recording of the identification document 103.

Zum Überprüfen der Echtheit des Identifikationsdokumentes 103 wird das Identifikationsdokument 103 bezüglich der Aufnahmeeinrichtung 101 in unterschiedliche Raumlagen 103-1 und 103-2 gebracht. Der Übergang zwischen den Raumlagen 103-1, 103-2 ist in Fig. 1 durch einen Pfeil dargestellt, welcher einen Bewegungsvektor symbolisiert. Der Bewegungsvektor beschreibt den Übergang des Identifikationsdokumentes 103 von der ersten Raumlage 103-1 zu der zweiten Raumlage 103-2. Der Bewegungsvektor kann mittels Koordinatenangaben in einem mehrdimensionalen Raum beschrieben sein.For checking the authenticity of the identification document 103, the identification document 103 is brought into different spatial positions 103-1 and 103-2 with respect to the receiving device 101. The transition between the spatial positions 103-1, 103-2 is in Fig. 1 represented by an arrow which symbolizes a motion vector. The motion vector describes the transition of the identification document 103 from the first spatial position 103-1 to the second spatial position 103-2. The motion vector can be described by means of coordinates in a multi-dimensional space.

Die Aufnahmeeinrichtung 101 ist ausgebildet, pro Raumlage zumindest ein Bild des Identifikationsdokumentes 103 bzw. des Sicherheitsmerkmals 104 aufzunehmen. Zeichnet sich das Sicherheitsmerkmal 104, beispielsweise ein Hologramm, durch blickwinkelabhängige Eigenschaften bzw. Darstellungen aus, so sind die Aufnahmen des Sicherheitsmerkmals 104 in den unterschiedlichen Raumlagen 103-1, 103-2 unterschiedlich. Dadurch entsteht eine Bildfolge, welche mit einer Referenzbildfolge, welche Referenzbilder des Sicherheitsmerkmals in korrespondierenden Raumlagen bezüglich einer Referenzaufnahmeeinrichtung umfasst, verglichen werden kann.The recording device 101 is designed to record at least one image of the identification document 103 or the security feature 104 per spatial position. Is the security feature 104, for example a hologram, characterized viewing angle-dependent properties or representations, the recordings of the security feature 104 in the different spatial positions 103-1, 103-2 are different. This results in an image sequence which can be compared with a reference image sequence, which includes reference images of the security feature in corresponding spatial positions relative to a reference recording device.

In dem in Fig. 1 dargestellten Ausführungsbeispiel ist die Aufnahmeeinrichtung 101 beispielsweise stationär, so dass das Identifikationsdokument 103 in die unterschiedlichen Raumlagen durch Bewegung des Identifikationsdokumentes 103 bezüglich der Aufnahmeeinrichtung überführt wird.In the in Fig. 1 illustrated embodiment, the receiving device 101, for example, stationary, so that the identification document 103 is transferred into the different spatial positions by moving the identification document 103 with respect to the receiving device.

Fig. 2 zeigt ein Ausführungsbeispiel, bei dem das Identifikationsdokument 103 stationär gelagert ist und bei dem die Aufnahmeeinrichtung 101 in unterschiedliche Raumlagen 101-1 und 101-2, beispielsweise durch Verkippen oder Verdrehen, bezüglich des Identifikationsdokumentes 103 gebracht wird. Auf diese Weise ändert sich ebenfalls die Raumlage des Identifikationsdokumentes 104 relativ zu der Aufnahmeeinrichtung 101 in den unterschiedlichen Raumlagen der Aufnahmeeinrichtung 101. Fig. 2 shows an embodiment in which the identification document 103 is mounted stationary and in which the receiving device 101 is brought into different spatial positions 101-1 and 101-2, for example by tilting or twisting, with respect to the identification document 103. In this way, the spatial position of the identification document 104 also changes relative to the receiving device 101 in the different spatial positions of the receiving device 101.

Gemäß einer Ausführungsform können die in den Fig. 1 und 2 dargestellten Ausführungsbeispiele kombiniert werden.According to one embodiment, the in the Fig. 1 and 2 illustrated embodiments are combined.

Gemäß einer Ausführungsform kann bei den Aufnahmen der Bilder des Sicherheitsmerkmals 104 auch eine Lage einer in den Fig. 1 und 2 nicht dargestellten Leuchtquelle berücksichtigt werden, welche das Sicherheitsmerkmal 104 beleuchtet. Die Leuchtquelle kann an einem beliebigen Raumpunkt angeordnet sein. Gemäß einer Ausführungsform kann jedoch die Aufnahmeeinrichtung selbst eine Leuchtquelle, beispielsweise einen Blitz eines Smartphones, umfassen.According to one embodiment, when shooting the images of the security feature 104, a position of one in the Fig. 1 and 2 not shown, which illuminates the security feature 104. The light source can be arranged at any point in space. According to one embodiment, however, the recording device itself may comprise a light source, for example a flash of a smartphone.

Wird gemäß einer Ausführungsform neben der Bildfolge auch die Lage der Leuchtquelle berücksichtigt, so kann die aufgenommene Bildfolge mit einer Referenzbildfolge verglichen werden, welche Aufnahmen von Referenzbildern mit einer Referenz-Leuchtquelle umfasst, deren Lage der Lage der Leuchtquelle bezüglich des Sicherheitsmerkmals 104 entspricht.If, in one embodiment, the position of the light source is taken into account in addition to the image sequence, the recorded image sequence can be compared with a reference image sequence which comprises images of reference images with a reference light source whose position corresponds to the position of the light source with respect to the security feature 104.

Bei dem Vergleich der Bildfolge mit der Referenzbildfolge können die jeweiligen Bilder der Bildfolge mit den Bildern der Referenzbildfolge verglichen werden. Gemäß einer weiteren Ausführungsform können jedoch Bildmerkmale mit Referenzmerkmalen verglichen werden. Bei den Bildmerkmalen kann es sich um beispielsweise vorbestimmte Merkmale und/oder um charakteristische Merkmale in dem jeweiligen Bild handeln, beispielsweise Eckpunkte.When comparing the image sequence with the reference image sequence, the respective images of the image sequence can be compared with the images of the reference image sequence. However, according to another embodiment, image features may be compared to reference features. The image features can be, for example, predetermined features and / or characteristic features in the respective image, for example corner points.

Gemäß einer Ausführungsform kann die jeweilige Raumlage des Identifikationsdokumentes 103 bezüglich der Aufnahmeeinrichtung 101 bestimmt werden. Hierzu kann beispielsweise eine Kantenreduktion durchgeführt werden. Hierbei kann beispielsweise ausgehend von der Annahme, dass das Sicherheitsdokument rechteckig ist, die perspektivische Verzerrung einer Kontur des Identifikationsdokumentes 103 in unterschiedlichen Raumlagen des Identifikationsdokumentes 103 bezüglich der Aufnahmeeinrichtung 101 bestimmt werden.According to one embodiment, the respective spatial position of the identification document 103 with respect to the receiving device 101 can be determined. For this purpose, for example, an edge reduction can be performed. In this case, for example, based on the assumption that the security document is rectangular, the perspective distortion of a contour of the identification document 103 in different spatial positions of the identification document 103 with respect to the receiving device 101 can be determined.

In den Fig. 3 und 4 ist der Einfluss einer Leuchtquelle 301 auf das resultierende blickwinkelabhängige Bild dargestellt.In the 3 and 4 the influence of a light source 301 on the resulting viewing angle-dependent image is shown.

In Fig. 3 befindet sich das Identifikationsdokument 103 in einer ersten Raumlage, bei der beispielsweise eine Oberfläche des Identifikationsdokumentes 103 parallel zu einer Oberfläche der Aufnahmeeinrichtung 101, beispielsweise eines Mobilfunkgerätes, angeordnet ist.In Fig. 3 the identification document 103 is located in a first spatial position in which, for example, a surface of the identification document 103 is arranged parallel to a surface of the receiving device 101, for example of a mobile radio device.

Beleuchtet die Leuchtquelle 301 das Sicherheitsmerkmal 104 in der in Fig. 3 dargestellten Raumlage des Identifikationsdokumentes 103 bezüglich der Aufnahmeeinrichtung 101, so wird ein erstes Bild A aufgenommen, das beispielsweise auf einer Anzeige 303 der Identifikationseinrichtung dargestellt werden kann.Illuminates the light source 301, the security feature 104 in the in Fig. 3 illustrated spatial position of the identification document 103 with respect to the receiving device 101, so a first image A is recorded, which can be displayed for example on a display 303 of the identification device.

Wird das Identifikationsdokument 103 in eine in Fig. 4 dargestellte zweite Raumlage überführt, ändert sich aufgrund der blickwinkelabhängigen Eigenschaften des Sicherheitsmerkmals 104 das durch die Aufnahmeeinrichtung 101 aufnehmbare Bild, so dass nunmehr ein zweites Bild B aufgenommen wird, das sich von dem ersten Bild A unterscheiden kann. Die Bildfolge lautet A, B, so dass Bildmerkmale der Bilder der Bildfolge mit Referenzmerkmalen verglichen werden können. Ist das Sicherheitsmerkmal 104 beispielsweise ein Hologramm, so beeinflusst die Raumlage der Leuchtquelle 301 zusammen mit der jeweiligen Raumlage des Identifikationsdokumentes 103 das aufnehmbare, d.h. aus der Sicht der Aufnahmeeinrichtung 101 sichtbare Bild gemäß einer Ausführungsform. In diesem Fall ist die Raumlage der Leuchtquelle bezüglich der Aufnahmeeinrichtung bzw. bezüglich des Sicherheitsmerkmals bei der Wahl der Referenzbildfolge zu berücksichtigen. Die Lage der Leuchtquelle kann gemäß einer Ausführungsform als bekannt angenommen werden.If the identification document 103 in a in Fig. 4 Due to the viewing angle-dependent properties of the security feature 104, the image recorded by the recording device 101 changes, so that now a second image B is recorded, which may differ from the first image A. The image sequence is A, B, so that image features of the images of the image sequence can be compared with reference features. Is the security feature 104, for example, a hologram, so the spatial position of the light source 301 together with the respective spatial position of the identification document 103 affects the recordable, ie from the view of the receiving device 101 visible image according to one embodiment. In this case, the spatial position of the light source with respect to the receiving device or with respect to the security feature in the choice of the reference image sequence is taken into account. The location of the light source can be assumed to be known according to one embodiment.

Gemäß einer weiteren Ausführungsform kann die Lage der Leuchtquelle bezüglich der Aufnahmeeinrichtung oder bezüglich des Identifikationsdokumentes bestimmt werden. Hierzu kann beispielsweise vorab ein Testbild erzeugt werden.According to a further embodiment, the position of the luminous source with respect to the receiving device or with respect to the identification document can be determined. For this purpose, for example, a test image can be generated in advance.

Gemäß einer Ausführungsform kann die Lage der Leuchtquelle jedoch auch anhand der aufgenommenen Bildfolge bestimmt werden. Hierbei kann beispielsweise ausgenutzt werden, dass bestimmte Abbildungen des Sicherheitsmerkmals 104 nur bei bestimmten Lagen der Leuchtquelle 301 bezüglich des Identifikationsdokumentes aufgenommen werden können.However, according to one embodiment, the position of the luminous source can also be determined on the basis of the recorded image sequence. In this case, it can be exploited, for example, that certain images of the security feature 104 can only be recorded in certain positions of the light source 301 with respect to the identification document.

Fig. 5 verdeutlicht das erfindungsgemäße Konzept anhand einer gedachten Halbkugel 401, in deren Zentrum das Identifikationsdokument 103 mit dem Merkmal 104 angeordnet ist. Auf dem Merkmal 104 befindet sich beispielsweise mittig ein imaginäres Lot 403, dessen Länge einem Radius einer sphärischen Abbildungsfläche entsprechen kann. Fig. 5 illustrates the inventive concept based on an imaginary hemisphere 401, in the center of the identification document 103 is arranged with the feature 104. On the feature 104, for example, there is centrally located an imaginary solder 403, the length of which may correspond to a radius of a spherical imaging surface.

Die Lagen der Aufnahmeeinrichtung 101 an den Raumlagen 1a und 1b gegenüber dem Identifikationsdokument 103 können in Abstand und/oder Winkel als mathematisch bekannt oder berechenbar angenommen werden. Die optische Abbildungsebene des Merkmals 103 auf dem Identifikationsdokument 104 ist durch die gestrichelten Konturen 2a und 2b dargestellt und liegt beispielsweise tangential zur Oberfläche der Halbkugel 401.The positions of the receiving device 101 on the spatial positions 1a and 1b relative to the identification document 103 can be assumed to be mathematically known or calculable at a distance and / or angle. The optical imaging plane of the feature 103 on the identification document 104 is represented by the dashed contours 2a and 2b and lies, for example, tangentially to the surface of the hemisphere 401.

Wird ein erstes Bild 2a durch Auftreffen einer Beleuchtung aus der Richtung 3a, 3b erzeugt, so kann dieses als bekanntes Merkmal erkannt werden. Zu diesem Merkmal sind beispielsweise die Art, insbesondere Abbildung, und die Bedingungen zur Entstehung der Abbildung, insbesondere die Lage der Leuchtquelle zum Identifikationsdokument 103 bzw. zum Sicherheitsmerkmal 104, sowie der Ort des entstehenden Bildes bekannt. Unter der beispielhaften Voraussetzung, dass die Abbildungsfläche eines Kamera-Linsensystems 1a, 1b der Aufnahmeeinrichtung 101 planparallel zu den Abbildungsebenen 2a, 2b des Sicherheitsmerkmals 104 liegt, sind zwischen dem Kamera-Linsensystem 1a und 2a bzw. zwischen den Abbildungsebenen 1 b und 2b keine translatorischen oder anderweitigen Korrekturen notwendig, welche beispielsweise durch Drehen, Verkanten oder Kippen entstehen könnten.If a first image 2a is generated by the impingement of illumination from the direction 3a, 3b, this can be recognized as a known feature. To this feature, for example, the type, in particular image, and the conditions for the formation of the image, in particular the position of the light source to the identification document 103th or the security feature 104, as well as the location of the resulting image known. Under the exemplary assumption that the imaging surface of a camera lens system 1a, 1b of the recording device 101 is plane-parallel to the imaging planes 2a, 2b of the security feature 104, there are no translatory between the camera lens system 1a and 2a or between the imaging planes 1b and 2b or other corrections necessary, which could arise, for example, by turning, tilting or tilting.

Gemäß einer Ausführungsform kann im ersten Fall eine gezielte Positionierung der Aufnahmeeinrichtung 101 an der Raumlage 1b erfolgen, so dass dort das erwartete Bild 2b aufzufinden ist. Im zweiten Fall kann gemäß einer Ausführungsform darauf gewartet werden, dass es in der Bewegungssequenz eine Position gibt, in der das Bild 2b wahrnehmbar ist. Die beiden gefundenen Positionen können in Bezug auf eine Definition eines Verhaltens des Merkmals, d.h. beispielsweise der blickwinkelabhängigen Eigenschaften des Merkmals, verglichen werden.According to one embodiment, in the first case, a targeted positioning of the receiving device 101 on the spatial position 1b take place so that the expected image 2b can be found there. In the second case, according to one embodiment, it can be expected that there will be a position in the motion sequence in which the image 2b is perceptible. The two found positions may be related to a definition of a behavior of the feature, i. For example, the viewing angle dependent properties of the feature to be compared.

Fig. 6 zeigt ein Diagramm eines Verfahrens zum Überprüfen der Echtheit eines Identifikationsdokumentes, das ein Sicherheitsmerkmal mit blickwinkelabhängigen Darstellungen aufweist. Das Verfahren umfasst den Schritt des Erfassens 601 eines ersten Bildes des Identifikationsdokumentes mit dem Sicherheitsmerkmal bei einer ersten Raumlage des Identifikationsdokumentes und das Erfassen 603 eines zweiten Bildes des Identifikationsdokumentes mit dem Sicherheitsmerkmal bei einer zweiten Raumlage des Identifikationsdokumentes, um eine Bildfolge bei unterschiedlichen Raumlagen des Identifikationsdokumentes zu erhalten. Die Raumlagen des Identifikationsdokumentes sind beispielsweise relative Raumlagen des Identifikationsdokumentes 103 bezüglich der Aufnahmeeinrichtung 101, wie es beispielsweise in den Fig. 1 und 2 dargestellt ist. Fig. 6 shows a diagram of a method for verifying the authenticity of an identification document having a security feature with viewing angle-dependent representations. The method comprises the step of capturing 601 a first image of the identification document with the security feature in a first spatial position of the identification document and capturing 603 of a second image of the identification document with the security feature in a second spatial position of the identification document, to an image sequence in different spatial positions of the identification document receive. The spatial positions of the identification document, for example, relative spatial positions of the identification document 103 with respect to the receiving device 101, as for example in the Fig. 1 and 2 is shown.

Das Verfahren umfasst ferner das Vergleichen 605 von Bildmerkmalen in der erfassten Bildfolge mit Referenzmerkmalen, um die Echtheit des Identifikationsdokumentes zu überprüfen.The method further comprises comparing 605 image features in the captured image sequence with reference features to verify the authenticity of the identification document.

Die Referenzmerkmale können beispielsweise einem Speicher entnommen werden, der entweder in der Aufnahmeeinrichtung angeordnet ist oder durch die Aufnahmeeinrichtung beispielsweise über ein Kommunikationsnetzwerk erreichbar ist.The reference features can be taken, for example, a memory which is either arranged in the receiving device or can be reached by the receiving device, for example via a communication network.

Das Verfahren kann ferner das Bestimmen der jeweiligen Raumlage des Identifikationsdokumentes, beispielsweise auf der Basis einer Kantendetektion, umfassen.The method may further comprise determining the respective spatial position of the identification document, for example on the basis of an edge detection.

Das Erfassen 601, 603 kann beispielsweise durch optische Aufnahmen des ersten Bildes und des zweiten Bildes durchgeführt werden.The detection 601, 603 can be performed, for example, by taking optical images of the first image and the second image.

Gemäß einer Ausführungsform umfasst das Verfahren nach dem Erfassen 601 des ersten Bildes das Bestimmen eines Prüfobjektes, d.h. eine Referenzierung. Das Verfahren umfasst ferner das Ermitteln der Raumlage des gesamten Identifikationsdokumentes bezüglich der Aufnahmeeinrichtung. Ferner umfasst das Verfahren das Extrahieren des ersten, beispielsweise zufälligen Prüfbildes des Sicherheitsmerkmals an einer bestimmten Position aus Referenz- und Lageinformationen. Die Referenz- und Lageinformationen können beispielsweise aus einer geräteinternen Sensorik oder optischen Zusatzinformationen wie Horizontlage bestimmt werden.According to one embodiment, after detecting 601 the first image, the method comprises determining a test object, i. a referencing. The method further comprises determining the spatial position of the entire identification document with respect to the receiving device. Furthermore, the method comprises extracting the first, for example random, test pattern of the security feature at a specific position from reference and position information. The reference and position information can be determined for example from a device-internal sensors or additional optical information such as horizon position.

Die aufeinander folgenden Aufnahmevorgänge, d.h. Erfassungsschritte der Bilder der Bildfolge, können beispielsweise in kurzen Abständen durchgeführt werden, wodurch das so genannte Videographing realisiert werden kann. Gemäß einer Ausführungsform können die Abstände länger als bei Videographing sein, so dass hierdurch ein Multi-Shot-Aufnahmeverfahren realisiert werden kann.The successive picks, i. Detection steps of the images of the image sequence, for example, can be carried out at short intervals, whereby the so-called videographing can be realized. According to an embodiment, the distances may be longer than in videographing, so that a multi-shot recording method can be realized thereby.

Gemäß einer Ausführungsform umfasst das Verfahren ferner das Bestimmen einer Lageänderung zwischen den Bildern und eine Ableitung eines oder mehrerer Bewegungsvektoren und, optional, Raumwinkel. Das Verfahren umfasst ferner das Vergleichen der Bildfolge mit einer Referenzbildfolge oder mit einem Referenzmodell eines Sicherheitsmerkmals, beispielsweise eines Hologramms. Hierbei kann das Verfahren einen Vergleich mit einer bekannten Bildfolge je nach Winkelrichtung umfassen. Um die Echtheit des Identifikationsdokumentes festzustellen, müssen die aufgenommenen Bilder eines Sicherheitsmerkmals, insbesondere eines Hologramms, in unterschiedlichen Raumlagen in gleicher Reihenfolge und mit dem gleichen Inhalt, wie anhand des Referenzmodells bestimmbar, erscheinen. Das Referenzmodell kann beispielsweise ein 3D-Referenzmodell sein, das eine Anordnung von Referenzmerkmalen bei unterschiedlichen Blickwinkeln ableiten oder darstellen kann.According to one embodiment, the method further comprises determining a positional change between the images and a derivative of one or more motion vectors and, optionally, solid angles. The method further comprises comparing the image sequence with a reference image sequence or with a reference model of a security feature, for example a hologram. In this case, the method may include a comparison with a known image sequence depending on the angular direction. To ascertain the authenticity of the identification document, the recorded images of a security feature, in particular a hologram, must appear in different spatial positions in the same sequence and with the same content as determinable on the basis of the reference model. For example, the reference model may be a 3D reference model that may derive or represent an array of reference features at different angles of view.

Das Verfahren kann ferner einen Vergleich mit einem generischen, einen 3D-Raum beschreibenden Referenzmodell umfassen, so dass die für die jeweilige Raumlage möglichen aufnehmbaren Bilder hergeleitet werden können.The method may further comprise a comparison with a generic reference model describing a 3D space, so that the recordable recordable images for the respective spatial position can be derived.

Durch eine Bestimmung einer Raumlage des Identifikationsdokumentes bezüglich der Aufnahmeeinrichtung, insbesondere bezüglich einer Kamera der Aufnahmeeinrichtung, verbleibt gemäß einer Ausführungsform beispielsweise die Beleuchtung bzw. die Raumlage der Leuchtquelle als weiterer Parameter für ein beispielsweise holographisches Erscheinungsbild des Sicherheitsmerkmals. Dies kann gemäß einer Ausführungsform jedoch extrahiert werden, weil ein Einstieg in das dreidimensionale Referenzmodell des Sicherheitsmerkmals an einer ersten bekannten bzw. übereinstimmenden Position erfolgen kann. Mit anderen Worten ausgedrückt, beginnt das Verfahren gemäß einer Ausführungsform bei einer ersten bekannten Raumlage des Identifikationsdokumentes bezüglich der Aufnahmeeinrichtung sowie bei einer vorbestimmten Raumlage einer Leuchtquelle.By determining a spatial position of the identification document with respect to the receiving device, in particular with respect to a camera of the receiving device, according to one embodiment, for example, the illumination or the spatial position of the light source remains as a further parameter for an example holographic appearance of the security feature. However, according to one embodiment, this can be extracted because an entry into the three-dimensional reference model of the security feature can take place at a first known or matching position. In other words, according to an embodiment, the method begins at a first known spatial position of the identification document with respect to the receiving device and at a predetermined spatial position of a luminous source.

Ist diese erste vorbestimmte Raumlage gefunden, so können alle weiteren Bilder von dem Sicherheitsmerkmal durch die Bewegungsvektoren des Identifikationsdokumentes bezüglich der Aufnahmeeinrichtung und der daraus resultierenden Raumlagebestimmung dem Referenzmodell zugeordnet werden.If this first predetermined spatial position is found, all further images of the security feature can be assigned to the reference model by the motion vectors of the identification document with respect to the recording device and the resulting spatial position determination.

Gemäß einer Ausführungsform ist auch eine Nutzung eines integrierten Blitzes in der Aufnahmeeinrichtung, beispielsweise in einem Smartphone, möglich, da dessen räumliche Anordnung, also Raumlage, in Bezug auf die Aufnahmeeinrichtung bzw. in Bezug auf deren Kamera und das Identifikationsdokument bestimmt ist.According to one embodiment, it is also possible to use an integrated flash in the receiving device, for example in a smartphone, since its spatial arrangement, ie spatial position, is determined with respect to the receiving device or with respect to its camera and the identification document.

Eine bewusste Änderung der Raumlage in eine der Prüfung zuträglichen Richtung ermöglicht ebenfalls eine Prüfung des Identifikationsdokumentes auf Echtheit. Hierbei ist das Ziel, eine weitere in Ausführung und Lageabhängigkeit bekannte Darstellung des Sicherheitsmerkmals zu erhalten. Dies kann gemäß einer Ausführungsform durch ein Augmented Reality Interface realisiert werden. Hierbei kann beispielsweise auf einer Anzeige der Aufnahmeeinrichtung eine Soll-Raumlage des Identifikationsdokumentes bezüglich der Aufnahmeeinrichtung bzw. ein Hinweis auf die Raumlage angezeigt werden. Zur Bestimmung bzw. zur Schätzung der Ist-Lage kann beispielsweise eine Information über eine vorbekannte Lage einer Beleuchtungsquelle bezüglich des Identifikationsdokumentes oder des Sicherheitsmerkmals ausgenutzt werden. So können beispielsweise vorbekannte Spiegelungs- oder Reflexionseigenschaften des Identifikationsdokumentes bzw. dessen Oberfläche bei vorbestimmten Lagen einer Beleuchtungsquelle zur Bestimmung oder Schätzung der Ist-Position ausgenutzt werden.A deliberate change of the spatial position in a direction favorable to the test also makes it possible to test the identification document for authenticity. In this case, the goal is to obtain a further representation of the security feature known in execution and position dependency. This can be realized according to an embodiment by an augmented reality interface. In this case, for example, a desired spatial position of the identification document with respect to the receiving device or an indication of the spatial position can be displayed on a display of the receiving device become. For determining or estimating the actual position, for example, information about a previously known position of a lighting source with respect to the identification document or the security feature can be utilized. Thus, for example, previously known reflection or reflection properties of the identification document or its surface at predetermined positions of a lighting source can be used to determine or estimate the actual position.

BezugszeichenlisteLIST OF REFERENCE NUMBERS

101101
Aufnahmeeinrichtungrecording device
103103
Identifikationsdokumentidentification document
103-1103-1
Raumlageroom location
103-2103-2
Raumlageroom location
104104
Sicherheitsmerkmalsafety feature
301301
Leuchtquellelight source
303303
Anzeigedisplay
401401
Halbkugelhemisphere
403403
Lotsolder
601601
ErfassenTo capture
603603
ErfassenTo capture
605605
Vergleichento compare
AA
erstes Bildfirst picture
BB
zweites Bildsecond picture
1a1a
Raumlageroom location
1b1b
Raumlageroom location
2a2a
Bildimage
2b2 B
Bildimage
3a3a
Richtungdirection
3b3b
Richtungdirection

Claims (11)

  1. Method for checking the authenticity of an identification document that has a security feature with depictions that depend on the viewing angle, which method comprises:
    capturing (601) a first image of the identification document having the security feature, with the identification document in a first spatial position, and capturing (603) a second image of the identification document having the security feature, with the identification document in a second spatial position, in order to obtain an image sequence with the identification document in different spatial positions; and
    comparing (605) image features of the captured image sequence with reference features in order to check the authenticity of the identification document, characterized in that the reference features are determined by a reference model, and wherein the reference model is processed in order to obtain the reference features according to the first spatial position as first reference features and in order to obtain the reference features according to the second spatial position as second reference features, wherein the first spatial position of the identification document is determined in the step of capturing (601) the first image, and wherein the second spatial position of the identification document is determined in the step of capturing (603) the second image, wherein the image sequence is captured by means of a picture-taking device (101), and wherein the respective spatial position relative to the picture-taking device (101) is determined.
  2. Method according to claim 1, wherein the respective spatial position is determined on the basis of a perspective distortion of an edge image of the identification document.
  3. Method according to one of the preceding claims, wherein the image features of the image sequence are extracted, in particular digitally extracted, from at least one captured image.
  4. Method according to one of the preceding claims, wherein a motion vector is determined for a transition from the first spatial position to the second spatial position, and wherein the reference model is processed according to the determined motion vector.
  5. Method according to one of the preceding claims, wherein the reference model is given by a reference function which determines an arrangement of reference features as a function of a spatial position or a perspective view, or wherein the reference model is a digital multidimensional model of the security feature.
  6. Method according to one of the preceding claims, wherein the image features are extracted from the first image as first image features and from the second image as second image features.
  7. Method according to one of the preceding claims, wherein, in the step of capturing the first image and in the step of capturing the second image, the identification document is illuminated by means of a light source arranged at a spatial position relative to the identification document, and wherein a first reference image and a second reference image are assigned to the arrangement of a light source at the spatial position.
  8. Method according to claim 7, wherein the spatial position of the light source relative to the identification document is determined.
  9. Method according to one of the preceding claims, wherein, in the comparison step, the image features in different spatial positions are compared with reference features which are assigned to different spatial positions and/or motion vectors of the identification document and/or to different spatial positions of a light source.
  10. Method according to one of the preceding claims, wherein the reference features are security features extracted from a reference image sequence of the security features in different spatial positions.
  11. Method according to one of the preceding claims, wherein the method is carried out by means of a picture-taking device having a display, and wherein a desired spatial position of the identification feature relative to the picture-taking device is displayed on the display.
EP14704155.2A 2013-02-18 2014-02-13 Method for authenticating an identification document Active EP2956915B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102013101587.5A DE102013101587A1 (en) 2013-02-18 2013-02-18 METHOD FOR CHECKING THE AUTHENTICITY OF AN IDENTIFICATION DOCUMENT
PCT/EP2014/052818 WO2014125022A1 (en) 2013-02-18 2014-02-13 Method for checking the authenticity of an identification document

Publications (2)

Publication Number Publication Date
EP2956915A1 EP2956915A1 (en) 2015-12-23
EP2956915B1 true EP2956915B1 (en) 2018-12-26

Family

ID=50097695

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14704155.2A Active EP2956915B1 (en) 2013-02-18 2014-02-13 Method for authenticating an identification document

Country Status (3)

Country Link
EP (1) EP2956915B1 (en)
DE (1) DE102013101587A1 (en)
WO (1) WO2014125022A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4156119A1 (en) * 2021-09-24 2023-03-29 FUJIFILM Business Innovation Corp. Collation device, program, and collation method
EP4171051A1 (en) * 2021-10-20 2023-04-26 FUJIFILM Business Innovation Corp. Collation device, program, and collation method

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102013110785A1 (en) * 2013-09-30 2015-04-02 Bundesdruckerei Gmbh POSITIONING METHOD FOR POSITIONING A MOBILE DEVICE RELATIVE TO A SECURITY FEATURE OF A DOCUMENT
DE102014108492A1 (en) * 2014-06-17 2015-12-17 Bundesdruckerei Gmbh Method for detecting a viewing-angle-dependent feature of a document
WO2016147813A1 (en) * 2015-03-19 2016-09-22 凸版印刷株式会社 Identification device, identification method, identification program, and computer-readable medium containing identification program
DE102015006008A1 (en) * 2015-05-13 2016-11-17 Wolfgang Beyer Method for checking the authenticity of security features on value objects
DE102015116708A1 (en) * 2015-10-01 2017-04-06 Bundesdruckerei Gmbh Document and method for verifying a document
CN108292457B (en) * 2015-11-26 2021-06-11 凸版印刷株式会社 Identification device, identification method, identification program, and computer-readable medium containing identification program
CN108780595B (en) * 2016-03-14 2021-03-09 凸版印刷株式会社 Identification device, identification method, identification program, and computer-readable medium containing identification program
DE102016207909A1 (en) * 2016-05-09 2017-11-09 Robert Bosch Gmbh Device and method for validating an identity document
FR3053501B1 (en) 2016-06-29 2018-11-09 Safran Identity & Security METHOD OF AUTHENTICATING DOCUMENTS USING A MOBILE TELECOMMUNICATION TERMINAL
RU2644513C1 (en) 2017-02-27 2018-02-12 Общество с ограниченной ответственностью "СМАРТ ЭНДЖИНС СЕРВИС" Method of detecting holographic elements in video stream
FR3064782B1 (en) * 2017-03-30 2019-04-05 Idemia Identity And Security METHOD FOR ANALYZING A STRUCTURAL DOCUMENT THAT CAN BE DEFORMED
CN110678907B (en) 2017-05-26 2022-09-30 凸版印刷株式会社 Recognition device, recognition method, and recognition program
FR3076924A3 (en) 2018-01-16 2019-07-19 Franck Guigan METHOD OF AUTHENTICATING A THREE-DIMENSIONAL SIGNATURE
DE102018106181A1 (en) * 2018-03-16 2019-09-19 Bundesdruckerei Gmbh An image capture device and method for capturing an image capture of a document and use
WO2021038298A2 (en) 2019-08-29 2021-03-04 PXL Vision AG Id verification with a mobile device
CH716082A1 (en) * 2019-12-20 2020-10-15 Ti&M Products Ag Procedure for user identification.
US20220139143A1 (en) * 2020-11-03 2022-05-05 Au10Tix Ltd. System, method and computer program product for ascertaining document liveness

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1992001975A1 (en) 1990-07-16 1992-02-06 D.A.H.T. Foundation Method of identifying a hologram and device for carrying out said method
WO2001054077A1 (en) 2000-01-21 2001-07-26 Flex Products, Inc. Automated verification systems and methods for use with optical interference devices
WO2004097716A1 (en) 2003-04-29 2004-11-11 Sicpa Holding S.A. Method and device for the authentication of documents and goods
US20050129282A1 (en) 2003-12-11 2005-06-16 O'doherty Phelim A. Method and apparatus for verifying a hologram and a credit card
US20080267453A1 (en) 2007-04-26 2008-10-30 Ioimage Ltd. Method for estimating the pose of a ptz camera
US20080267514A1 (en) 2007-04-25 2008-10-30 Alasia Alfred V Object Authentication Using a Portable Digital Image Acquisition Device
US20090154813A1 (en) 2007-12-12 2009-06-18 Xerox Corporation Method and apparatus for validating holograms
US7778540B2 (en) 2006-04-28 2010-08-17 Kabushiki Kaisha Toshiba Verification apparatus and verification method for recording media
EP2320390A1 (en) 2009-11-10 2011-05-11 Icar Vision Systems, SL Method and system for reading and validation of identity documents
US20120163666A1 (en) 2006-01-23 2012-06-28 Rhoads Geoffrey B Object Processing Employing Movement
FR2973911A3 (en) * 2011-04-05 2012-10-12 Franck Andre Marie Guigan Authentication method for verifying authenticity of e.g. document, involves carrying out determination of three-dimensional position of acquisition unit and acquisition of image to establish subsequent description of authentication device
US20120269402A1 (en) 2009-10-15 2012-10-25 Hologram Industries Method and device for checking a secured document
US20120281880A1 (en) 2006-01-23 2012-11-08 Rhoads Geoffrey B Sensing Data from Physical Objects

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1992001975A1 (en) 1990-07-16 1992-02-06 D.A.H.T. Foundation Method of identifying a hologram and device for carrying out said method
WO2001054077A1 (en) 2000-01-21 2001-07-26 Flex Products, Inc. Automated verification systems and methods for use with optical interference devices
WO2004097716A1 (en) 2003-04-29 2004-11-11 Sicpa Holding S.A. Method and device for the authentication of documents and goods
US20050129282A1 (en) 2003-12-11 2005-06-16 O'doherty Phelim A. Method and apparatus for verifying a hologram and a credit card
US20120163666A1 (en) 2006-01-23 2012-06-28 Rhoads Geoffrey B Object Processing Employing Movement
US20120281880A1 (en) 2006-01-23 2012-11-08 Rhoads Geoffrey B Sensing Data from Physical Objects
US7778540B2 (en) 2006-04-28 2010-08-17 Kabushiki Kaisha Toshiba Verification apparatus and verification method for recording media
US20080267514A1 (en) 2007-04-25 2008-10-30 Alasia Alfred V Object Authentication Using a Portable Digital Image Acquisition Device
US20080267453A1 (en) 2007-04-26 2008-10-30 Ioimage Ltd. Method for estimating the pose of a ptz camera
US20090154813A1 (en) 2007-12-12 2009-06-18 Xerox Corporation Method and apparatus for validating holograms
US20120269402A1 (en) 2009-10-15 2012-10-25 Hologram Industries Method and device for checking a secured document
EP2320390A1 (en) 2009-11-10 2011-05-11 Icar Vision Systems, SL Method and system for reading and validation of identity documents
FR2973911A3 (en) * 2011-04-05 2012-10-12 Franck Andre Marie Guigan Authentication method for verifying authenticity of e.g. document, involves carrying out determination of three-dimensional position of acquisition unit and acquisition of image to establish subsequent description of authentication device

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
DENIS OBERKAMPF ET AL.: "Iterative Pose Estimation Using Coplanar Feature Points", COMPUTER VISION AND IMAGE UNDERSTANDING, vol. 63, no. 3, May 1996 (1996-05-01), pages 495 - 511, XP000597554
P. WLCZEK ET AL.: "Pose Estimation of Three- Dimensional Objects from Single Camera Images", DIGITAL SIGNAL PROCESSING, vol. 5, 1995, pages 176 - 183, XP002318297
ROBERT M. HARALICK: "Determining camera parameters from the perspective projection of a rectangle", PATTERN RECOGNITION, vol. 22, no. 3, 1989, pages 225 - 230, XP000847614
WILLIAM L. WOLFE: "Optical Engineer's Desk Reference", 2003, OPTICAL SOCIETY OF AMERICA, Washington, DC, ISBN: 1-55752-757-1, article A.S. MARATHAY: "Diffraction", pages: 3pp, 120 - 121, XP055635561

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4156119A1 (en) * 2021-09-24 2023-03-29 FUJIFILM Business Innovation Corp. Collation device, program, and collation method
EP4171051A1 (en) * 2021-10-20 2023-04-26 FUJIFILM Business Innovation Corp. Collation device, program, and collation method

Also Published As

Publication number Publication date
DE102013101587A1 (en) 2014-08-21
EP2956915A1 (en) 2015-12-23
WO2014125022A1 (en) 2014-08-21

Similar Documents

Publication Publication Date Title
EP2956915B1 (en) Method for authenticating an identification document
EP2573709A2 (en) Method and apparatus for identifying motor vehicles for monitoring traffic
DE69921559T2 (en) digital cameras
EP3025200A1 (en) Method and device for verifying diffractive elements
DE112010004767T5 (en) Point cloud data processing device, point cloud data processing method and point cloud data processing program
DE102011078631A1 (en) Arrangement and method for determining an imaging deviation of a camera
EP3053098A1 (en) Positioning method for positioning a mobile device in relation to a security feature of a document
DE102012023623A1 (en) Method for assembling sub-housings of surface of static object, involves determining homologous image points of partial images of surface of object, and assembling images using homologous image points to form overall housing
EP3357043B1 (en) Document and process for verifying a document
EP3158543A1 (en) Method for detecting a viewing-angle-dependent feature of a document
EP3286690B1 (en) Identification document, identification device and corresponding methods
EP3659113A1 (en) Detection system, working method and training method for generating a 3d model with reference data
DE102012003241B4 (en) Device and method for the automatic testing of security and / or security documents
DE10202383A1 (en) Method for recognizing an embossed image of a coin in a coin machine
EP2984636A1 (en) Image-capturing system for capturing images of features of an identification document
DE102012109351A1 (en) Evaluation unit, evaluation method, surveying facility for a crash vehicle survey and a method for carrying out a crash vehicle survey
WO2017060438A1 (en) Authentication method for article identifiers
EP3540507A1 (en) Imaging apparatus and method for taking an image of a document and use thereof
DE102018208604A1 (en) Determining a recording behavior of a recording unit
EP2645331A1 (en) Method for verifying the alignment of a traffic monitoring device
DE102017221853A1 (en) Arrangement and method for the three-dimensional optical measurement of an object
DE102009047437A1 (en) Method and device for adapting image information of an optical system
EP2926323B1 (en) Method and device for testing a laser marking produced in accordance with an angle on a document surface
DE102007021107A1 (en) Camera system main point determining system for driver assistance system, has comparing device comparing imaged position with calculated position of calibration mark and providing error measure of main point depending on comparison result
EP3082103A1 (en) Method for calibration of the alignment of cameras of a camera system

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20150917

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20170222

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20180813

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1082483

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190115

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502014010454

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190326

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190326

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20181226

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190327

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190426

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190426

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

REG Reference to a national code

Ref country code: DE

Ref legal event code: R026

Ref document number: 502014010454

Country of ref document: DE

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBI Opposition filed

Free format text: ORIGINAL CODE: 0009260

PLAX Notice of opposition and request to file observation + time limit sent

Free format text: ORIGINAL CODE: EPIDOSNOBS2

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190213

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

26 Opposition filed

Opponent name: SICPA HOLDING SA

Effective date: 20190926

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190228

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190213

PLBB Reply of patent proprietor to notice(s) of opposition received

Free format text: ORIGINAL CODE: EPIDOSNOBS3

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 1082483

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

PLCK Communication despatched that opposition was rejected

Free format text: ORIGINAL CODE: EPIDOSNREJ1

APBM Appeal reference recorded

Free format text: ORIGINAL CODE: EPIDOSNREFNO

APBP Date of receipt of notice of appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNNOA2O

APAH Appeal reference modified

Free format text: ORIGINAL CODE: EPIDOSCREFNO

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

APBQ Date of receipt of statement of grounds of appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNNOA3O

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20140213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230217

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230221

Year of fee payment: 10

Ref country code: DE

Payment date: 20230216

Year of fee payment: 10

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230526

APBU Appeal procedure closed

Free format text: ORIGINAL CODE: EPIDOSNNOA9O

REG Reference to a national code

Ref country code: DE

Ref legal event code: R100

Ref document number: 502014010454

Country of ref document: DE

PLBN Opposition rejected

Free format text: ORIGINAL CODE: 0009273

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: OPPOSITION REJECTED