EP2095341B1 - Procédé de détection des encrassements et/ou l'usure de l'encre dans la zone des transitions de couleur sur des documents de valeur et moyens en vue de mettre en oeuvre le procédé - Google Patents

Procédé de détection des encrassements et/ou l'usure de l'encre dans la zone des transitions de couleur sur des documents de valeur et moyens en vue de mettre en oeuvre le procédé Download PDF

Info

Publication number
EP2095341B1
EP2095341B1 EP07846608.3A EP07846608A EP2095341B1 EP 2095341 B1 EP2095341 B1 EP 2095341B1 EP 07846608 A EP07846608 A EP 07846608A EP 2095341 B1 EP2095341 B1 EP 2095341B1
Authority
EP
European Patent Office
Prior art keywords
color
value
document
predetermined
coordinate values
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP07846608.3A
Other languages
German (de)
English (en)
Other versions
EP2095341A1 (fr
Inventor
Norbert Holl
Shanchuan Su
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Giesecke and Devrient Currency Technology GmbH
Original Assignee
Giesecke and Devrient Currency Technology GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Giesecke and Devrient Currency Technology GmbH filed Critical Giesecke and Devrient Currency Technology GmbH
Publication of EP2095341A1 publication Critical patent/EP2095341A1/fr
Application granted granted Critical
Publication of EP2095341B1 publication Critical patent/EP2095341B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07D—HANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
    • G07D7/00—Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
    • G07D7/06—Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency using wave or particle radiation
    • G07D7/12—Visible light, infrared or ultraviolet radiation
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07D—HANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
    • G07D7/00—Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
    • G07D7/181—Testing mechanical properties or condition, e.g. wear or tear
    • G07D7/187—Detecting defacement or contamination, e.g. dirt

Definitions

  • the present invention relates to a method for detecting soiling and / or color wear in the region of color transitions in at least one section of a value document, a device for carrying out the method, a computer program for carrying out the method and a data carrier with the computer program.
  • value documents are understood in the context of the invention card or sheet-shaped objects that represent, for example, a monetary value or an authorization and therefore should not be arbitrarily produced by unauthorized persons. They therefore have features which are not easy to manufacture, in particular to be copied, whose presence is an indication of the authenticity, i. the manufacture by an authorized agency. Important examples of such value documents are chip cards, coupons, vouchers, checks, stocks and in particular banknotes.
  • Value documents are typically provided with color design, for example more or less complex color patterns and / or color illustrations and / or characters and / or character combinations, for reasons of design, distinctness and protection against simple forgeries.
  • a contamination is understood to mean, in particular, a change in the color design of the value document caused by the introduction or introduction of substances onto or in value documents or by irradiation of the value documents with electromagnetic radiation.
  • value documents can be considered as soiling Spots, for example, caused by the intentional or unintentional application of colored or color-changing liquids, or have colored markings.
  • color abrasions can occur.
  • color changes are understood in particular to mean color changes due to fading, removal of printing ink and / or washing out of paint by means of water or other solvents for colors of the value document.
  • Such color abrasions can occur, in particular with banknotes with polymer substrates, if printing inks with which the banknotes are printed do not adhere with sufficient stability to the polymer substrates.
  • US 6,798,900 B1 US 4,848,160 A are descriptive of a paper sheet identification method and apparatus that statistically process information, represent characteristics of a bill, compact it into a smaller number of characteristics, and determine the authenticity of the bill using those characteristics.
  • the paper sheet identifying method comprises separately performing (a) a detecting step and (b) a processing step, which will be described below, for a genuine paper sheet and a paper sheet to be inspected, determining reference data based on the detecting step and the processing step for the true paper sheet and the determination of the authenticity of the paper sheet by comparing the data obtained with the reference data.
  • the paper sheet identifying device includes signal generating units that generate a plurality of pattern signals to be checked for a plurality of physical characteristics representing a pattern printed in a predetermined area on the paper sheet. It further comprises a computing unit, a reference data storage unit a determination unit.
  • EP 0 718 808 A2 A system for authenticating documents, such as banknotes, checks, or the like, is described, in which a document to be inspected is transported past a sensor station which provides a digital color image of the document, which is stored in a memory and in the form of several digital images was obtained by illuminating the document with light of different colors.
  • the stored color image is processed using, for example, template matching to determine the type and orientation of the document.
  • the type and orientation information is used to select a plurality of regions of the digital color image for color intensity analysis. For example, a statistical test method may be used that uses stored values derived from the processing of real documents. Documents of different types are processed in a uniform way.
  • a device for classifying a pattern, in particular a banknote or a coin, in terms of value and authenticity.
  • the apparatus comprises a recording system for metrological detection of vectors of a specimen, a preprocessing system for transforming the measured vectors into local feature vectors, and a learning classification system for performing a plurality of tests.
  • a first activity compares each of the local feature vectors with a vectorial setpoint in a first test. Only when the first check succeeds does the first activity associate the local feature vectors to global row feature vectors using first estimates stored in a database.
  • a third activity compares the global row feature vectors with corresponding target sizes and, if the second check is successful, calculates a single global area vector, of which a fourth activity in a third check is its distance to Mahalanobis to an estimated area Vector compares to a setpoint. The examinee is safely classified if all three exams are successful.
  • a monitoring system in particular for use with document sorting machines, comprising a sensor array having a sensor for detecting a respective feature of an article and generating a corresponding first output signal and having a detector controller for applying at least one algorithm of a given set of Algorithms to the first output signal of the sensor in connection with the detector controller supplied data to produce one or more second output.
  • a detector processor common to the sensor arrays, provides the data and algorithm selection information to the detector controllers to control which of the algorithms of the set of algorithms is applied by the detector controller and in response to the or each second output signal and reference data to produce a third output representative of the feature of the article to be monitored.
  • a banknote validator controlled by a microprocessor.
  • This contains a transport for moving an inserted note longitudinally past an optical scanning station. Infrared and visible color reflectance readings and opacity readings are acquired along multiple longitudinal tracks on the note.
  • the microprocessor normalizes the reflectance readings to account for variations in fouling, and compares the normalized reflectance readings and the opacity readings to stored acceptance tape data, with a correction for pattern shift, if necessary.
  • the length of the note is also checked and a validation signal is given if the note passes the optical tests and the length test.
  • the microprocessor automatically adjusts the optical circuits to compensate for drift and dirt build-up.
  • the microprocessor also provides a visual indication of detected malfunctions.
  • the apparatus includes a profile processor adapted to collect a plurality of data profiles from suspect documents, a comparator adapted to compare the plurality of data profiles to a set of envelopes of a library document, and to determine that the document it is true that, when the plurality of profiles are in compliance with the amount of envelopes, and a pressure lock, which locks a cassette, which records authenticated documents, to a body of the device for checking the authenticity of the document.
  • the object is achieved by a method for detecting soiling and / or color wear in the area of color transitions in at least one section of a value document of a predetermined value document type on the basis of processing data, the color coordinate values of picture elements in a color space depending on the position of the respective picture elements reproduce corresponding areas in the portion of the value document, and reference data representing a color reference distribution of color coordinate values in the color space depending on reference locations on a value document type value document predetermined for a type of value documents, wherein it is determined for each of the picture elements whether the Picture element associated color coordinate values in the color space of the color reference distribution.
  • the color reference distribution is given by at least one predetermined, closed reference surface in the color space, which is given by at least one predetermined for the value document type linear distance and a predetermined distance of the points of the reference surface of the at least one linear distance.
  • the positions of the picture elements whose color coordinate values were determined to be corresponding to the reference distribution are compared with predetermined reference positions on the value document, and depending on the As a result of the comparison, a presence or absence of staining and / or color deterioration in the area of a color transition is detected.
  • a device for detecting soiling and / or color wear in the region of color transitions in at least one section of a value document of a predetermined value document type having at least one interface for acquiring processing data, the color coordinate values of picture elements in a color space as a function of the position of represent respective areas corresponding to the picture elements in the portion of the value document, and having an evaluation means arranged on the basis of processing data acquired via the at least one interface and reference data representing a color reference distribution of color coordinate values prescribed for a type of value documents Play color space as a function of reference locations on a value document of the value document type to perform the inventive method.
  • the evaluation device may be configured to check for each of the picture elements whether the color coordinate values associated with the picture element correspond to the color space of the color reference distribution, the color reference distribution being given by at least one predetermined closed reference area in the color space defined by at least one for the value document type given predetermined linear distance and a predetermined distance of the points of the reference surface of the at least one linear distance. Furthermore, it is then designed to compare the positions of the picture elements whose color coordinate values were determined to be corresponding to the reference distribution with predetermined reference positions on the value document, and depending on the result of the comparison, a presence or absence of one Identify contamination and / or color deterioration in the area of a color transition caused by soiling.
  • processing data are used according to the invention which reproduce or describe properties of picture elements which, combined according to their position, yield an image of the section.
  • the processing data represents the color coordinate values in a predetermined color space for picture elements in the predetermined portion of the document of value depending on the position of the picture elements corresponding to the area sections on the document of value.
  • the method it is sufficient for the method to examine only a predefined section of a value document, but preferably several sections or the entire value document are examined.
  • the section basically only needs to be one-dimensional or strip-shaped, so that the picture elements form only one row or column. Preferably, however, a two-dimensional image of a sheet portion is detected.
  • the color coordinate values can be generated in any manner.
  • images can be acquired simultaneously or sequentially in a plurality of spectral ranges, preferably as a function of the color space used.
  • the images can be captured simultaneously for the entire section.
  • the color coordinate values can be obtained either directly or after transformation of other acquired image data by using suitable detection means.
  • color coordinate values and position can take place in very different ways and in particular also depending on the way in which the color coordinate values are acquired.
  • the color coordinate values and the position of the pixel on the value document representing position coordinate values in a suitable coordinate system can be used as processing data for each picture element.
  • pictures whose picture elements are detected in rows and columns in matrix form, for example, and linearly stored according to their order in passing successive lines or columns it is also possible only the position in the order of data for the color coordinate values indicating the position on the page Value document to use. Further possibilities for the assignment are known to the person skilled in the art.
  • Color transitions and, in particular, color-related or color-wear-related color transitions are detected in the method by comparing the color coordinate values or the corresponding processing data with the color reference distribution.
  • the color reference distribution as well as the corresponding reference positions are specified for a specific value document type.
  • the type can be predetermined, for example, by the type of currency and the denomination of the banknote.
  • the value document to be examined possesses a given value document type, which, however, need not necessarily be known before the examination. The examination can then be done with color reference distributions for different value document types.
  • the type of the document of value to be examined is determined beforehand, for example using methods known to those skilled in the art, so that only a comparison with the color reference distribution of the identified document of value type needs to be made.
  • the color reference distribution is based on value documents of the given type. However, it does not necessarily require the state of a value document of the given type when new, i. to reproduce accurately after manufacture and before use; Rather, it may also take into account tolerances caused by commonly occurring contaminants and / or color abrasions that are not considered annoying. Only a color reference distribution is then used that allows for certain deviations from an ideal state. However, it is also possible to consider the occurrence of permissible stains and / or color abrasions by the criterion when color coordinate values correspond to the color reference distribution.
  • a distribution of color coordinate values can be understood in particular to mean that the color coordinate values can lie within a predetermined volume of the color space that defines the distribution.
  • the color reference distribution is given by at least one predetermined closed reference surface in the color space, which is given by at least one predetermined for the value document type linear distance in the color space and a predetermined distance of the points of the reference surface of at least one linear distance is.
  • the reference surface therefore encloses a region of the color space in which color coordinate values of picture elements corresponding to a color transition, which on one as still acceptable or not considered dirty value document occurs in the examined section.
  • the reference surface can be given by only a linear distance. However, it is also possible that the reference surface is given by a plurality of distances whose distance from each other may be greater or preferably smaller than the predetermined distance.
  • the reference surface may be defined by a polygon in conjunction with the predetermined distance, so that even complicated, predetermined for a value document type color transitions, for example, between three colors, can be reproduced and recognized.
  • the advantage of this type of comparison and in particular the representation of the reference surface has the advantage that a check as to whether a color value coordinate values correspond to the color reference distribution can be carried out very quickly and easily, since the geometric structure in the color space is very simple.
  • the method can in particular be carried out automatically by means of a corresponding device.
  • the evaluation device can be designed as any analog, mixed analog-digital or purely digital circuit. It is also possible that this alone comprises a so-called "field programmable gate array" (FPGA), which has the advantage that corresponding components can be adapted solely by preprogramming for the method to be performed, but in the implementation operate as a digital circuit , In this way, the production costs can be kept low for small batches.
  • FPGA field programmable gate array
  • the evaluation device has at least one processor and a memory in which an inventive computer program executable by the processor or a program or computer program for carrying out the method according to the invention is stored.
  • a computer program for detecting soiling and / or color wear in the region of color transitions in at least one section of a value document of a predetermined value document type with instructions for at least one processor, in the execution of which the processor executes the method according to the invention and in particular the basis of processing data representing color coordinate values of picture elements in a color space depending on the position of the respective portions corresponding to the picture elements in the portion of the value document, and reference data representing a color reference distribution of color coordinate values in the color space in dependence on a type of value documents of reference documents on a value document of the value document type, determines for each of the picture elements whether the color coordinate values associated with the picture element are in the color space of the color reference distribution speak, wherein the color reference distribution is given by a predetermined closed reference surface in the color space, which by at least one given for the value document type linear distance and a predetermined distance of the points of the reference surface of the at least one linear distance is, the positions of the pixels whose color coordinate values were determined according to the color
  • Such a computer program may in particular be stored in the memory of the device.
  • Another object of the invention is a disk on which a computer program according to the invention is stored.
  • a data carrier are in particular optical media such as CD or DVD, magneto-optical media, magnetic media such as hard disks and semiconductor memory, such as EEPROMs or flash memory into consideration, the content can be accessed by a corresponding device of a computer.
  • processor in the context of the invention means any processor, for example a microcontroller or a general-purpose processor or a digital signal processor, or a combination with a general-purpose processor and / or a signal processor and / or a microcontroller and / or an FPGA.
  • the computer program is then designed according to the existing processor.
  • the Evaluation have at least one FPGA, which is programmed so that at least parts of the method according to the invention by the FPGA can be performed.
  • the execution speed of the computer program can be increased, since an FPGA may possibly have a higher execution speed for certain operations than a general purpose or signal processor.
  • the use of a programmable evaluation device has the advantage that the device can be easily adapted to new types of value documents.
  • the check as to whether the color coordinate values for the picture elements correspond to the color reference distribution can, in principle, be done in any desired manner. In the method, however, it is preferable that, for checking whether color coordinate values for a picture element correspond to the color reference distribution, it is checked whether a point corresponding to the color coordinate values in the color space is inside or outside the reference surface.
  • the instructions are preferably such that, when executed, the processor checks to see whether color coordinate values for a picture element correspond to the color reference distribution, checks whether a point corresponding to the color coordinate values lies in the color space inside or outside the reference surface. Only one of the alternatives need be checked, since the fact that the point lies within the reference surface, which is also understood to lie on the reference surface, implies that it is not outside and vice versa. Such an examination can be carried out very quickly.
  • the reference surface can be specified in any desired manner, for example by interpolation points or an approximation by one- or multi-dimensional splines or a sum of orthogonal functions.
  • a value is determined which determines the distance of the point corresponding to the color coordinate values from the color coordinates at least one route plays.
  • the instructions are then preferably given in such a way that the processor determines a value when it is executed to check whether a point corresponding to the color coordinate values lies inside or outside the reference surface, or if the color coordinate values associated with the respective pixel correspond to the color reference distribution, which represents the distance of the point corresponding to the color coordinate values from the at least one path.
  • a determination can be made very quickly.
  • only a small amount of memory space is required to display the color reference distribution or the reference area.
  • the distance in the metric of the color space can be used as the distance, preferably the Euclidean distance.
  • the determined value only needs to reproduce the distance; Namely, the determination of the distance usually requires complicated or slow operations such as dragging a root, so that when using, for example, the distance square as a value representing the distance, the execution of the program can be greatly accelerated.
  • the criteria for color coordinate values for a picture element of the color reference distribution of at least one of the lines may be a distance smaller than the predetermined distance.
  • a criterion for the maximum permissible distance can then be decided for the respective color space point, whether he is the Reference distribution corresponds. It can then be marked or saved accordingly.
  • any color spaces can be used in the method.
  • color spaces with at least three dimensions are used, but it is also possible to use even higher-dimensional color spaces.
  • a color space specific to the sensor device used to acquire the processing data may be used.
  • the color space can also be understood as any other space in which points are assigned by a bijective transformation respectively corresponding points in another color space.
  • the color space used can be, for example, the RGB or the HSI color space.
  • a device-independently defined color space is used as the color space.
  • the instructions are then preferably given in such a way that the processor uses a device-independently defined color space as its color space when executed.
  • a normalized color space such as the CIE XYZ color space can be used as color space, for example.
  • a color space which is linearized with respect to the perception of color differences by humans is preferably used as the color space.
  • the instructions are then preferred in such a way that when executed as a color space, the processor uses a color space that is linearized with respect to the perception of color differences by humans.
  • the coordinates of the color space are chosen so that visual perceived by human observer distances between colors are approximately proportional to the distances between the colors in the color space.
  • the color space used may be, for example, a color space such as the CIE L * a * b color space in one of the known variants, the Hunter Lab color space or the CIE L * u * v color space.
  • a color space such as the CIE L * a * b color space in one of the known variants, the Hunter Lab color space or the CIE L * u * v color space.
  • the given distance be given as a function of a minimum distance of two color coordinate values in the color space for colors from a given viewer under given viewing conditions can still be recognized as different.
  • the instructions are given so that in their execution by the processor the distance is given as a function of a minimum distance of two color coordinate values in the color space for colors that can be recognized as different by a given viewer under predetermined viewing conditions .
  • a fictive observer may in particular be considered whose perception is given by an average value via the perception properties of a plurality of real people is.
  • the color reference distribution and the above criterion may be selected such that color coordinate values for a picture element are considered corresponding to the color reference distribution when the distance in the color space is from the at least one of the distances at least one of a plurality of distances is less than a value that is the sum of the predetermined distance and a value ⁇ E that is between 1 and 2, depending on the severity of the required distinction. If color deviations due to production fluctuations are also to be taken into account, the value can also be selected larger.
  • the same predetermined distance can be used for different value document types.
  • the distance is predetermined as a function of the value document type.
  • the instructions are preferably given in such a way that, when executed by the processor, the distance is predetermined as a function of the value-document type.
  • This embodiment has the advantage that for different value document types respectively different criteria for the permissible contamination and / or color wear can be defined, whereby the assessment of the state of the value documents can be improved.
  • the type of value document to be examined can be entered manually into the device or automatically determined by a machine with which the device is coupled.
  • image data which has been directly detected and possibly transformed into the color space used can be used as processing data in the method.
  • the formation the processing data are used image data of pixels of a captured image of the portion from which the color coordinate values and the positions can be determined, and the processing data for a picture element are detected using low-pass filtering of the image data.
  • the instructions are then preferably such that the processor, when executing it to form the processing data, uses image data of pixels of a captured image of the portion from which the color coordinate values and the locations are determinable and the processing data for a pixel using a Low pass filtering of the image data determined.
  • This embodiment has for many types of value documents with very fine patterns, especially banknotes, the advantage that due to the fine patterning color transitions need not be taken into account in the investigation, which the detection of dirt and / or Farbab makeupen, which is usually a large area , in particular on an area greater than 0.5 mm 2 , occur, relieved.
  • the spatial resolution ie the number of pixels per mapped area, reduced.
  • the device may preferably be combined with a sensor for acquiring image data from pixels.
  • the invention therefore also provides an examination device with a sensor for acquiring image data of pixels which correspond to regions in a section of a value document, and a detection device according to the invention which is connected to the sensor for transmitting the image data.
  • image data of pixels of a captured image of the portion from which the color coordinate values and the positions can be obtained can be used and the processing data for one pixel are formed by using the image data of at least two pixels.
  • the instructions may be such that the processor, when executing it to form the processing data, uses image data of pixels of a captured image of the portion from which the color coordinate values and the locations are determinable and the processing data for a pixel using the Forms image data of at least two pixels.
  • the image data of the at least two pixels corresponding to the same area of the value document as the pixel may be used for local low-pass filtering, for example to form an optionally weighted average.
  • Such a local low-pass filtering can often be carried out much faster than a non-local low-pass filtering, as it can be carried out, for example, in the spatial frequency space.
  • more than two pixels are used, more preferably at least the next adjacent pixels.
  • the color coordinate values or picture elements corresponding to the color reference distribution are determined, their position, which can be more accurately understood as the position of the area section corresponding to the picture elements on the banknote, is compared with reference positions for them. As a result, it can be determined whether the recognized color transition is at a predetermined location.
  • the position of a document of value examined can vary in general relative to the sensor used to acquire the image data, before or during the comparison of the layers, a transformation of the layers of the picture elements or of the reference layers can take place, so that a better matching of the layers with the reference layers is achieved becomes.
  • the reference positions can be given for example by corresponding position coordinate values. In this case, it can be checked for comparison whether the positions determined lie within a predetermined distance from these reference positions.
  • the reference layers are given by a, preferably two-dimensional, area. For comparison, it then only needs to be determined whether the layers of the picture elements lie within the area.
  • the result of the comparison may be that the picture elements whose color coordinates correspond to the reference distribution and whose positions correspond to the reference distribution are determined.
  • the method determines whether presence or absence of fouling and / or color degradation in the area of the color transition is detected. In principle, any criteria can be used for this purpose.
  • the criterion for a permissible state of the value document is a criterion which is dependent on the number of picture elements which have been determined to correspond to the predetermined color transition and / or the number of picture elements which were not correspondingly determined for this color transition. For example, a maximum number of picture elements may be specified which do not correspond to the predetermined color transition.
  • the criterion, in particular also the number, can be predetermined depending on the value document type.
  • Another object of the invention is a device for processing documents of value with an examination device according to the invention.
  • the subject matter of the invention is a method for determining a reference surface for a method according to the invention for detecting soiling and / or color wear, in which for a given number of value documents of a predetermined value document type respectively associated processing data, the color coordinate values of picture elements in a color space in dependence from the position of the areas corresponding in each case to the picture elements in the section of the value document, in which averages over the color coordinates reproducing first components and correlations between the color coordinates representing components of a matrix in the color space or another color space are determined from the processing data; in which directional data, which determine the eigenvectors associated with the two largest eigenvalues of the matrix, are determined, in the case of the data defining the linear distance from the directional data be determined so that the center of the route is determined by the average values, the direction of the route by the direction of the first eigenvector, and in which the length of the route and the predetermined distance from the route in dependence on the largest eigenvalue or the second largest Eigenvalue or
  • This method makes it possible to easily determine the reference area or the data defining it.
  • value documents of a given type can be specified. Further, at least the portion of the value documents is specified, which later in the recognition of soiling and / or paint wear is also used.
  • the components of the correlation matrix can be determined and used.
  • the detected color coordinate values can be used as processing data or part of the processing data for the determination of the eigenvalues.
  • processing data used to determine the averaging components and correlations between color coordinate reproducing components may be color coordinates in a Lab color space.
  • the data defining the reference surface can basically be stored for the color space used to determine it.
  • the data defining the reference surface is stored transformed into values valid for the color space, which is later also used for the detection of soiling and / or color wear.
  • the color space can also be at least one dimension for non-visible optical radiation, for example IR radiation in a predetermined wavelength range, and then, for example, be four-dimensional.
  • Fig. 1 shows a device 10 for determining a state of documents of value, in the example a banknote processing device, which serves among other things for determining the state of value documents 12 in the form of banknotes.
  • the device 10 has an input pocket 14 for input of value documents 12 to be processed, a singulator 16, which can access value documents 12 in the input tray 14, a transport device 18 with a switch 20, and after the switch 20 an output tray 26 and a Shredder 28 for the destruction of banknotes.
  • a sensor assembly 24 is disposed in front of the switch 20 and after the singler 16, which serves to detect characteristics of individually supplied value documents 12 and formation of the characteristics reproducing sensor signals.
  • a control and evaluation device 30 is connected at least to the sensor arrangement 24 and the switch 20 via signal connections and is used to evaluate sensor signals of the sensor arrangement 24 and control at least the switch 20 as a function of the result of the evaluation of the sensor signals.
  • the sensor arrangement 24 comprises at least one sensor for this purpose;
  • three sensors are provided, namely a first sensor 32, in the example an optical sensor for detecting color properties, which detects optical radiation reflected from the value document second sensor 34, in the example also an optical sensor for detecting special spectral security features of the value documents, which also detects the optical document remitted optical radiation, and a third sensor 36, in the example an acoustic sensor, more precisely an ultrasonic sensor, which originates from the document of value, in particular detected by a value document transmitted, ultrasonic signals detected.
  • the sensors 32, 34 and 36 acquire, according to their function, properties of scanning ranges determined by the relative position of the sensors to the value document on the value document, wherein the corresponding sensor signals are formed.
  • Each of the sensors can have a different spatial resolution, i. the size and distribution of the detected scan areas on the value document may vary depending on the particular sensor and the transport speed used.
  • Each of the scanning areas is assigned a location which reproduces the position of the scanning areas for the respective sensor relative to one another and / or relative to the value document.
  • At least one characteristic of at least one scanning region and / or at least one value document characteristic are determined by the control alignment 30 in a sensor signal evaluation, which are relevant for checking the bank notes with respect to their state , Preferably, several of these properties are determined. Furthermore, the authenticity of the value documents is checked by means of the signals of the sensor 34.
  • the value document properties characterize the state of the value documents, in this example the state of the banknotes with regard to the marketability or fitness for circulation, ie the suitability continues to be used as a means of payment to be able to.
  • Corresponding value-document properties in this example are, in particular, the presence of soiling and / or color abrasions or stains and the presence of cracks, adhesive strips, dog-ears and / or holes, and / or the absence of components of the value documents. These value-document properties can be determined as a function of sensor signals of only one of the sensors 32 or 34 or at least two of the sensors.
  • control and evaluation device 30 has, in addition to corresponding interfaces for the sensors, a processor 38 and a memory 40 connected to the processor 38 in which at least one computer program with program code is stored, in the execution of which the processor 38 controls the device or the sensor signals, in particular for determining a total state of a tested value document, evaluates and corresponding to the evaluation, the transport device 18 controls.
  • control and evaluation device 30, or more precisely the processor 38 therein after determining the value document properties, can check a criterion for the overall state of the value document into which at least one of the value document properties is received or which depends on at least one of the value document properties.
  • further reference data for determining a still permissible state of the value document which are predefined and stored in the memory 40, can enter into the criterion.
  • the overall state can be given for example by two categories "still fit for use” or "marketable” or "to be destroyed”.
  • the control and evaluation device 30 in particular the processor 38 therein the transport means 18, more precisely the switch 20, so that the tested Value document according to its determined overall state for storage in the output tray 26 or for destruction to the shredder 28 is transported.
  • For processing documents of value 12 are separated from the singler 16 in the input tray 14 as a stack or individually inserted value documents 12 and occasionally the transport device 18 which supplies the isolated value documents 12 of the sensor assembly 24. This detects at least one property of the value documents 12, wherein sensor signals are formed, which reflect the property of the value document.
  • the control and evaluation device 30 detects the sensor signals, determined in dependence on these a state and the authenticity of the respective value document and controls depending on the result, the switch 20 so that, for example, still usable value documents the output tray 26 and shredded documents of value to the shredder 28 are fed to destruction.
  • Adhesive strips on the value documents 12 can be detected, for example, by means of the sensor 36.
  • the control and evaluation device 30 can determine, for example, the number of adhesive strips or the total length or total area of the adhesive strips from the sensor signals of the sensor 36.
  • the control and evaluation device 30 uses the criterion already mentioned, into which at least one of the properties can enter.
  • the individual values can be linked, for example, in a criterion, for example by means of a linear combination.
  • the control and evaluation device 30 compares the linear combination to determine the overall state of the banknotes the properties characterizing the state of the banknotes with a predetermined value and, for example, decides whether the state of the banknotes is good or bad, ie whether they are fit or not.
  • the sensor 32 which serves for the spatially resolved detection of colors of the value documents 12, is in the FIGS. 2 and 3 shown in more detail. It is described only briefly below, a detailed description can be found in the filed by the Applicant patent application WO2006 / 018283 , the contents of which are hereby incorporated by reference into the description.
  • the sensor 32 is designed as a line sensor to which a document of value is transported at a constant speed in order to acquire an image. During the pre-transport, the sensor 32 acquires line images that, when combined in accordance with the acquisition order, yield a two-dimensional image of the value document.
  • the sensor 32 has a light source 42 for illuminating a value document 12 with optical radiation 44 in the visible wavelength range, preferably white light.
  • optical radiation 44 in the visible wavelength range, preferably white light.
  • an optional condenser optics (not shown in the figures) for bundling the emitted illumination radiation 44 is arranged.
  • a color detection device 46 is provided for detecting the optical radiation remitted by the value document 12, also referred to below as detection radiation.
  • the color detection device 46 has along a detection beam path provided for limiting the field of view, an entrance slit forming aperture 48 and a field of self-focusing lenses 50, from the in Fig. 2 by way of example only one row is shown, of which in turn only the outermost lens can be seen.
  • the self-focusing lenses 50 direct the detection radiation onto a spatially spectral dispersing device 52, which decomposes the optical radiation into spectral components which propagate along different spatial directions according to their spectral composition.
  • a detection optics (not shown in the figures for clarity) focuses the spectral components on a spatially resolving detection device 54 having a plurality of lines 56, 58 and 60 of detection elements aligned parallel to the direction of the entrance slit and corresponding to the number of colors to be detected are referred to as detector lines which detect the intensity of the spectral components along a respective line and form corresponding detection signals.
  • the aperture 48 arranged in the vicinity of the document of value 12 to be tested preferably forms an entrance slit with a gap width between 0.1 and 0.2 mm and a typical length corresponding to an expected width of the value documents, in the example of banknotes between 10 and 200 mm, preferably at about 100 mm.
  • Self-focusing lenses 50 are generally cylindrical optical elements made of a material having a refractive index that parabolically decreases from the optical axis of the cylinder toward the cladding thereof. By the use of such lenses 50 is independent of the distance between value document and image and achieved adjustment-free 1: 1 mapping of the examined portion of the value document 12 to the dispersing device 52.
  • the dispersing means 52 for example, a diffractive element such as an optical grating may be used. In this embodiment, however, a prism made of crown glass with a prism angle of about 60 ° is used.
  • the dispersing means 52 is arranged so that the spectral components are parallel to a plane that is, to a good approximation, orthogonal to the direction of the entrance slit.
  • the detection device 54 For detection of the spectral components, which is spatially resolved along a line, the detection device 54, which is used to generate image data which serves the colors of a document of value examined, is used with a color evaluation device 62, i. a device for the detection of dirt and / or Farbab makeupen in the range of color transitions according to a first preferred embodiment of the invention, connected, which is integrated in this example in the control and evaluation device 30, but this is not necessary.
  • the detection element lines 56, 58 and 60 are on a common, for the sake of clarity only in Fig. 3 shown carrier 63 attached.
  • the extents of the detection element lines 56, 58 and 60 are constant.
  • the width of the detection elements of a line, ie the extension in the direction of the line, and their distance in the direction of the line are in each case the same and predetermined by the required resolution, in the example about 0.2 mm for a resolution of 125 dpi.
  • the detector lines 56, 58 and 60 differ in the height h of the detection elements of the respective line, ie their extent orthogonal to the direction of the line (cf. Fig. 3 ).
  • the detection elements of different lines receive different width spectral ranges according to their height, so that the sensitivity spectrum of the detection device 54 is influenced accordingly.
  • the distances d of the detector lines 56, 58 and 60 can differ from one another.
  • the heights of the detection elements and the distances of the detector lines in the direction of the spatial fanning of the spectral components, ie transversely to the direction of the lines are chosen so that a detection is at least approximately close to that of the color perception of man or that the detected spectrum at least approximately adapted to the color perception of the human eye.
  • the individual detector rows can be based on silicon, for example.
  • the detector lines 56, 58 and 60 must have a comparatively high level for approximating the color perception of the human eye to detect spectral components from the "blue” and “infrared” spectral regions, since silicon is less sensitive to these wavelength ranges than to other wavelength ranges ,
  • Further approximation to human color perception can be achieved by weighting the detected spectral components depending on or independently of the geometry of the detector lines 56, 58 and 60 in the color evaluator 62.
  • the spectral components can in particular be weighted individually depending on their intensities by means of multiplicative weighting factors, the weighting factors being dependent of the spectrum that should be approximated. In this case, for example, it is found in a silicon detector that the spectral component in the "red" spectral range has an overall intensity value list, but the value should be I soll . Then, for calibration, the weighting factor is initially set to convert a detected intensity value to a calibrated value using the weighting factor. This adjustment is made for all spectral components to be detected in the calibration of the overall device.
  • the color evaluator 62 can generate from the detection signals of the detector lines 56, 58 and 60, image data which can be used to a good approximation as color coordinates in the standard CIE XYZ color space.
  • intensity data are recorded at constant time intervals with the detection element lines 56, 58 and 60 with spatial and color resolution.
  • the intensity data represents image data describing the properties of pixels of a line image representing the line-shaped area of the value document 12 detected by the color detector 46.
  • the device 62 which, as already explained, is integrated in the control and evaluation device 30.
  • the device 62 To detect color transitions in the memory 40 is a computer program stored in the execution by the processor 38, the below-described, in Fig. 7 illustrated method is performed.
  • the processor 38 forms, with a corresponding software module of the computer program, an interface for the acquisition of processing data, which is not explicitly shown in the figures.
  • banknote 64 has an image area 65 that has areas of different colors.
  • a section 66 on which there is a color transition from a first color, a deep purple, to a second color, a bright yellow, is located on the genuine banknote 64 of a given type of banknotes assumed to be fresh in print.
  • Fig. 5 Part of the color transition is shown again in using black dots to illustrate the deep purple proportions.
  • each of the picture elements can have color coordinate values or a color point represented by them in a color space, in this example the CIE L * a * b color space color space defined as device-independent, which is linearized in relation to the perception of color differences by humans, and a corresponding location or a corresponding position on the value document 12 are assigned.
  • the color points are in a very good approximation on a path 70 that connects two endpoints T 1 and T 2 that correspond to the colors between which the transition occurs.
  • a feature portion of the color space may be indicated by the distance 70, more precisely its endpoints, and a smallest distance ⁇ e chosen such that the distance of the predetermined points from the distance is not greater than the smallest distance.
  • the distance and the smallest distance ⁇ e define a closed area in the color space.
  • the detected color points will not lie within the area and in particular exactly on the route 70, but have a certain distance from the same. If the distance is only small, a human being will observe no or only a very small deviation from a fresh banknote when viewing the banknote.
  • the criterion can be used that a detected color point does not represent a relevant deviation in the color space if its distance from the distance 70 is less than a predetermined maximum distance ⁇ E, in the example a maximum distance of 2.
  • the maximum distance is smaller than ⁇ e, which in this embodiment need not be calculated in the recognition, but plays only a role for the choice of ⁇ E.
  • the maximum distance ⁇ E can also be determined as the sum of ⁇ e and a further value which describes a minimum distance of two color points in the color space, which the observer just recognizes as being different.
  • a color reference distribution for the color points or the corresponding color coordinate values of the given section is defined for a fresh printing document or a freshly printed banknote of a given type. This is given by a closed reference surface 72, which may be given by the maximum distance and the distance, for example by the end points and whose points in particular have exactly the maximum distance from the distance 70. Color points lying within or on the reference surface 72 correspond to the color reference distribution, others not.
  • the picture elements corresponding to the color dots corresponding to the color reference distribution are also distributed in the section of the banknote corresponding to reference positions predetermined for the given banknote type.
  • the distance of the color point from the distance to be used is the smaller of the two distances of the color point from the end points T 1 and T 2 of the distance.
  • ⁇ E denotes the maximum distance
  • a color point corresponds to the color reference distribution if the criterion for the maximum permissible distance D 2 ⁇ ( ⁇ E) 2 is fulfilled.
  • step S10 first, an image of the portion of the value document is acquired.
  • the value document is moved past the color detection device 46, in particular the detection device 54, with a transport speed constant in the example; during this movement image data are recorded in dependence on the transport speed at predetermined time intervals by means of the detector lines or detection element lines 56, 58 and 60, which reproduce colors of pixels corresponding to the respective detector line, which, when arranged in the order of their acquisition, form an image of the examined section of the image Play the value document.
  • the image data for a pixel thus comprise the color values, in the example the color coordinate values in the CIE-XYZ color space, as well as the location or the position of the pixel on the banknote.
  • This image data is then subjected to low-pass filtering in step S12.
  • the values of each of the color coordinates are replaced by the average of the values of the respective color coordinates over the selected pixel and pixels at a predetermined averaging distance.
  • the values of each of the color coordinates may be replaced by the average of the values of the respective color coordinate over the pixels in a square centered on the selected pixel.
  • the side length of the square is set in units of the length of the pixel edges and is in the example at least 5 pixels.
  • step S14 the low pass filtered image data of the pixels in processing data from the pixels, i. identical areas of the image, corresponding pixels are transformed by the color coordinate values are transformed in the image data according to known formulas in the color space CIE L * a * b.
  • these color coordinate values correspond to a color point in the color space.
  • the CIE L * a * b color space is characterized by the fact that distances between color points in this color space at least approximately reflect human-perceived, quantified differences between colors.
  • the processing data further includes the location of the pixel on the bill.
  • a type of the examined value document is determined based on the image data of the pixels by known methods; an example of such a procedure is in DE 100 45 360 A1 described. This determined type is used to specify the color reference distribution and the reference positions.
  • the memory 40 of the control and evaluation device 30 is a list of banknote types comprising different denominations for at least one currency area, with data on corresponding color reference distributions given by the color coordinate values of endpoints of links in the CIE-L * a * b color space and the maximum distance .DELTA.E, and corresponding reference positions are stored.
  • step S18 it is checked for which picture elements located in the predetermined section the color coordinate values in the processing data and the corresponding color points of the color reference distribution respectively correspond to the banknote type determined in step S16.
  • the squares of the distances of the color dots from the respective distance are determined and compared with the square of the maximum distance. If a color point or the corresponding picture element is smaller than the square of the maximum distance, it is correspondingly marked as corresponding to the color reference distribution.
  • step S20 it is checked whether the picture elements corresponding to the color reference distribution are at locations on the banknote or in the section corresponding to a spatial distribution predetermined by the color reference distribution, given by reference positions.
  • the example examines in more detail which of the locations lie within a given range. Pixels corresponding to the color reference distribution whose locations do not correspond to the location distribution and pixels not corresponding to the color reference distribution are then marked as color deviations.
  • the reference positions are given by position coordinates in the section.
  • a position of a picture element corresponds to one of the reference positions if its Euclidean distance is smaller than a predetermined maximum distance in the position space, which can be selected, for example, as a function of the expected accuracy of the orientation of the color detection device to the value document.
  • step S22 it is decided on the basis of a predetermined criterion for the picture elements not corresponding to the color reference distribution whether or not the value document is to be classified as unsoiled.
  • a predetermined criterion for the picture elements not corresponding to the color reference distribution whether or not the value document is to be classified as unsoiled.
  • the number of picture elements marked as color deviation is compared with a maximum number N given for the value document type.
  • control and evaluation device 36 controls the switch 20 so that the value document is fed to the shredder 26. Otherwise, the control and evaluation device 36 controls the switch 20 so that the value document is transported to the tray 26.
  • the RGB color space is chosen as the color space instead of the CIE-L * a * b color space.
  • Fig. 8 is the distribution of the color space points in Fig. 6 shown color transition shown. As can easily be seen, this results in a very good approximation by a straight line or a stretch.
  • a third preferred embodiment differs from the first embodiment only in that more complicated color transitions can be checked.
  • FIG. 9 An example of such a complicated color reference distribution for a more complicated color transition, here between three colors, is in Fig. 9 illustrated.
  • the color transition corresponds to a color reference distribution that can be represented by a reference surface 74.
  • the reference surface can itself be represented by two distances 76 and 76 'and a maximum distance ⁇ E.
  • the color points of the reference surface are given by all color points whose distance from the two distances calculated by the above-described method is smaller than the maximum distance.
  • the corresponding method differs from the method of the first embodiment only in that in step S18 now the last-mentioned distance determination is performed.
  • not every pixel is assigned a picture element, so that the local resolution is reduced in the course of the low-pass filtering becomes.
  • the reduction can be made so that only half as many picture elements are formed as pixels are present.
  • color detection means are used, as for example in the WO2006 / 018283 are described.
  • conventional color sensors with color filters can also be used.
  • the image data can be obtained by relative movement of color detection device and value document, that is, for example, by movement of the color detection device.
  • inventions may differ from the above-described embodiments in that the value document type, in the example the currency and denomination of a banknote being examined, is determined by detecting geometric dimensions of the banknote and comparing with predetermined dimensions.
  • the value document type in the example the currency and denomination of a banknote being examined
  • the value document type is determined by detecting geometric dimensions of the banknote and comparing with predetermined dimensions.
  • any other method is suitable.
  • control and evaluation device 30 is designed to read in data representing the value document type in step S16. This is useful, for example, if only value documents of a given value document type are processed.
  • the determination of the value document type can be completely omitted if the value-document processing device is designed or used for processing value documents of only one type.
  • the reference area or the data defining this can be determined as follows by means of a correspondingly programmed data processing device, which or its processor carries out the calculation steps.
  • the largest possible number of value documents of the same value document type in this example banknotes of the same denomination but different degree of soiling and / or color depreciation, are specified.
  • the degree of soiling or color wear thereby preferably varies between "new" that is to say fresh from the press and without dirt and heavily soiled and / or worn, ie. a level of fouling or color deterioration which is considered just acceptable, for example by the institute examining the value documents in circulation, such as a central bank.
  • the steps S10 to S14 are performed for the predetermined value documents and stored the predetermined portion of a respective value document.
  • color space coordinates are to be understood as simplifying the description of the method as coordinates of a three-dimensional vector.
  • a mean vector is then determined as the mean value of the vectors and stored. From the vectors corresponding to the processing data, the mean vector is subtracted so that the resulting shifted vectors have the zero vector as an average.
  • the correlation matrix for the shifted processing data is determined, which is a 3x3 matrix according to the dimension of the vectors.
  • the two largest eigenvalues and their respective orthogonal eigenvectors of this matrix are determined.
  • the coordinates of the distance determining the reference surface are determined by first of all bringing the eigenvector to the largest eigenvalue by multiplication by a corresponding scalar factor, which is determined by the largest eigenvalue.
  • the scalar factor is determined so that the square of the length is twice the largest eigenvalue.
  • the resulting vector is shifted so that the shift performed prior to the formation of the correlation matrix is canceled.
  • the coordinates of the start and end points of the resulting vector are then the coordinates of the endpoints of the searched route.
  • the square of the distance in the direction orthogonal to the distance is given by the second largest eigenvalue.
  • Another variant of the method differs from the method just described in that instead of the correlation matrix, the covariance matrix is used. The eigenvalues must then be scaled accordingly.
  • the determination of the eigenvalues and eigenvectors can be obtained, for example, by means of a singular value decomposition.
  • NIPALS Networkar Iterative Partial Least Squares
  • the determination of the length of the distance and of the predetermined distance can then be carried out in each case in a space which corresponds to the straight line through the path or to a subarray orthogonal to the straight line which has one dimension less than the color space.
  • Another embodiment differs from the first embodiment in that the color space now includes a further dimension for the intensity of non-visible optical radiation in a predetermined wavelength range, in the example in the infrared.
  • the color space therefore includes the usual CIE XYZ dimensions and another IR dimension.
  • Each picture element is therefore assigned not only the three coordinates for the (visible) colors, but also an additional coordinate for the intensity of the IR radiation in the given area.
  • the described methods are now carried out in the four-dimensional space.
  • the described transformations of the subspace for the (visible) colors can also be carried out according to the transformations of the color space in the first embodiment, wherein the additional dimension or the corresponding additional coordinate can be left invariant.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Image Analysis (AREA)
  • Inspection Of Paper Currency And Valuable Securities (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Spectrometry And Color Measurement (AREA)
  • Color Image Communication Systems (AREA)

Claims (17)

  1. Procédé de reconnaissance de salissures et/ou d'usures des couleurs dans la zone de transitions de couleurs dans au moins une section d'un document de valeur (12) d'un type prédéterminé de documents de valeur sur la base de données de traitement qui représentent des valeurs de coordonnées de couleurs d'éléments d'image (66) dans un espace colorimétrique en fonction de l'emplacement des zones correspondant respectivement aux éléments d'image (66) dans la section du document de valeur (12), et de données de référence qui représentent une répartition de référence des couleurs, prédéterminée pour un type de documents de valeur (12), de valeurs de coordonnées de couleurs dans l'espace colorimétrique en fonction d'emplacements de référence sur un document de valeur (12) du type de documents de valeur,
    dans lequel, pour chacun des éléments d'image (68), il est établi si les valeurs de coordonnées de couleurs affectées à l'élément d'image dans l'espace colorimétrique correspondent à la répartition de référence des couleurs, cependant que la répartition de référence des couleurs est donnée par au moins une surface de référence (72) fermée prédéterminée, laquelle est donnée par au moins une trajectoire (70) linéaire prédéterminée pour le type de documents de valeur et par un espacement prédéterminé des points de la surface de référence (72) par rapport à la au moins une trajectoire linéaire,
    dans lequel les emplacements des éléments d'image (68) dont les valeurs de coordonnées de couleurs ont été établies comme étant correspondantes à la répartition de référence sont comparés avec des emplacements de référence prédéterminés sur le document de valeur, et
    dans lequel, en fonction du résultat de la comparaison, une présence ou une absence d'une salissure et/ou d'une usure des couleurs dans la zone d'une transition de couleurs est constatée.
  2. Procédé selon la revendication 1, dans lequel, pour examiner si des valeurs de coordonnées de couleurs pour un élément d'image (66) correspondent à la répartition de référence des couleurs, il est examiné si un point correspondant aux valeurs de coordonnées de couleurs se trouve l'intérieur ou à l'extérieur de la surface de référence (72).
  3. Procédé selon la revendication 1 ou 2, dans lequel, pour examiner si les valeurs de coordonnées de couleurs affectées à l'élément d'image (66) respectif correspondent à la répartition de référence des couleurs, une valeur est établie, laquelle représente l'espacement du point correspondant aux valeurs de coordonnées de couleurs par rapport à la au moins une trajectoire (70).
  4. Procédé selon une des revendications précédentes, dans lequel, comme espace colorimétrique, un espace colorimétrique défini indépendamment de l'appareil est utilisé.
  5. Procédé selon une des revendications précédentes, dans lequel l'espacement est donné en fonction d'un espacement minimum de deux valeurs de coordonnées de couleurs dans l'espace colorimétrique pour des couleurs qui peuvent être encore reconnues comme différentes par un observateur prédéterminé sous des conditions d'observation prédéterminées.
  6. Procédé selon une des revendications précédentes, dans lequel l'espacement est donné en fonction du type de documents de valeur.
  7. Procédé selon une des revendications précédentes, dans lequel, pour la constitution des données de traitement, des données d'image de pixels d'une image saisie de la section (66) sont utilisées, à partir desquelles les valeurs de coordonnées de couleurs et les emplacements peuvent être établis, et dans lequel les données de traitement pour un élément d'image (68) sont établies en utilisant un filtrage passe-bas des données d'image.
  8. Procédé selon une des revendications précédentes, dans lequel, pour la constitution des données de traitement, des données d'image de pixels d'une image saisie de la section (66) sont utilisées, à partir desquelles les valeurs de coordonnées de couleurs et les emplacements peuvent être établis, et dans lequel les données de traitement pour un élément d'image (68) sont constituées en utilisant les données d'image d'au moins deux pixels.
  9. Procédé selon une des revendications précédentes, dans lequel l'espace colorimétrique comporte, outre des dimensions pour les couleurs visibles, une autre dimension pour du rayonnement optique non visible dans une plage de longueur d'onde prédéterminée, les éléments d'image comprennent des données relatives au rayonnement optique non visible dans la plage de longueur d'onde prédéterminée, et la surface de référence est donnée par au moins une trajectoire linéaire prédéterminée pour le type de documents de valeur et par un espacement prédéterminé des points de la surface de référence par rapport à la au moins une trajectoire linéaire.
  10. Dispositif de reconnaissance de salissures et/ou d'usures des couleurs dans la zone de transitions de couleurs dans au moins une section (66) d'un document de valeur (12) d'un type prédéterminé de documents de valeur, ayant
    au moins une interface pour la saisie de données de traitement qui représentent des valeurs de coordonnées de couleurs d'éléments d'image (68) dans un espace colorimétrique en fonction de l'emplacement des zones correspondant respectivement aux éléments d'image (68) dans la section (66) du document de valeur (12), et ayant un équipement d'évaluation (62) conçu pour, sur la base de données de traitement saisies par l'intermédiaire de la au moins une interface et de données de référence qui représentent une répartition de référence des couleurs, prédéterminée pour un type de documents de valeur (12), de valeurs de coordonnées de couleurs dans l'espace colorimétrique en fonction d'emplacements de référence sur un document de valeur (12) du type de documents de valeur, effectuer un procédé selon une des revendications précédentes, et en particulier pour établir pour chacun des éléments d'image (68) si les valeurs de coordonnées de couleurs affectées à l'élément d'image (68) dans l'espace colorimétrique correspondent à la répartition de référence des couleurs, cependant que la répartition de référence des couleurs est donnée par une surface de référence (72) fermée prédéterminée dans l'espace colorimétrique, laquelle est donnée par au moins une trajectoire (70) linéaire prédéterminée pour le type de documents de valeur et par un espacement prédéterminé des points de la surface de référence (72) par rapport à la au moins une trajectoire linéaire,
    pour comparer, avec des emplacements de référence prédéterminés sur le document de valeur (12), les emplacements des éléments d'image (68) dont les valeurs de coordonnées de couleurs ont été établies comme étant correspondantes à la répartition de référence, et
    pour, en fonction du résultat de la comparaison, constater une présence ou une absence d'une salissure et/ou d'une usure des couleurs dans la zone d'une transition de couleurs.
  11. Dispositif selon la revendication 10, dans lequel l'équipement d'évaluation (62) comprend au moins un processeur (38) et une mémoire (40) dans laquelle un programme d'ordinateur selon la revendication 12 exécutable avec le processeur (48) ou un autre programme pour effectuer un procédé selon une des revendications de 1 à 9 est mémorisé.
  12. Programme d'ordinateur destiné à la reconnaissance de salissures et/ou d'usures des couleurs dans la zone de transitions de couleurs dans au moins une section d'un document de valeur (12) d'un type prédéterminé de documents de valeur, ayant des instructions pour au moins un processeur (38), lors de l'exécution desquelles le processeur (38) exécute le procédé selon une des revendications de 1 à 9.
  13. Procédé d'établissement d'une surface de référence pour un procédé selon une des revendications de 1 à 9, dans lequel, pour un nombre prédéterminé de documents de valeur d'un type prédéterminé de documents de valeur, des données de traitement qui sont respectivement affectées à ces derniers et qui représentent des valeurs de coordonnées de couleurs d'éléments d'image (66) dans un espace colorimétrique en fonction de l'emplacement des zones correspondant respectivement aux éléments d'image (66) dans la section (66) du document de valeur (12) sont établies,
    dans lequel des valeurs moyennes portant sur des premiers composants qui représentent les coordonnées des couleurs et sur des composants qui représentent des corrélations entre les coordonnées des couleurs, d'une matrice dans l'espace colorimétrique ou dans un autre espace colorimétrique, sont établies à partir des données de traitement,
    dans lequel des données de direction qui déterminent les vecteurs propres appartenant aux deux plus grandes valeurs propres de la matrice sont établies,
    dans lequel, à partir des données de direction, des données définissant la trajectoire linéaire sont établies de telle façon que le milieu de la trajectoire est déterminé par les valeurs moyennes, que la direction de la trajectoire est déterminée par la direction du premier vecteur propre, et
    dans lequel la longueur de la trajectoire et l'espacement prédéterminé par rapport à la trajectoire est établi en fonction de valeur propre la plus grande ou de la valeur propre dont la grandeur vient en deuxième position ou en fonction d'une grandeur représentant la corrélation le long de la trajectoire et de la corrélation la plus grande dans un sous-espace orthogonalement à la trajectoire.
  14. Procédé selon la revendication 13, dans lequel, comme composants de la matrice, les composants de la matrice de corrélation sont établis.
  15. Procédé selon la revendication 13, dans lequel, comme composants de la matrice, les composants de la matrice de covariance sont établis.
  16. Procédé selon une des revendications de 13 à 15, dans lequel les données de traitement utilisées pour l'établissement des composants représentant les valeurs moyennes et des composants représentant des corrélations entre des coordonnées des couleurs sont des coordonnées des couleurs dans un espace colorimétrique LAB.
  17. Procédé selon une des revendications de 13 à 15, dans lequel l'espace colorimétrique comporte, outre des dimensions pour les couleurs visibles, une autre dimension pour du rayonnement optique non visible dans une plage de longueur d'onde prédéterminée, les éléments d'image comprennent des données relatives au rayonnement optique non visible dans la plage de longueur d'onde prédéterminée, et la surface de référence est donnée par au moins une trajectoire linéaire prédéterminée pour le type de documents de valeur et par un espacement prédéterminé des points de la surface de référence par rapport à la au moins une trajectoire linéaire.
EP07846608.3A 2006-11-15 2007-11-15 Procédé de détection des encrassements et/ou l'usure de l'encre dans la zone des transitions de couleur sur des documents de valeur et moyens en vue de mettre en oeuvre le procédé Active EP2095341B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102006053788A DE102006053788A1 (de) 2006-11-15 2006-11-15 Verfahren zur Erkennung von Verschmutzungen im Bereich von Farbübergängen auf Wertdokumenten und Mittel zur Durchführung des Verfahrens
PCT/EP2007/009893 WO2008058742A1 (fr) 2006-11-15 2007-11-15 Procédé de détection des encrassements et/ou l'usure de l'encre dans la zone des transitions de couleur sur des documents de valeur et moyens en vue de mettre en œuvre le procédé

Publications (2)

Publication Number Publication Date
EP2095341A1 EP2095341A1 (fr) 2009-09-02
EP2095341B1 true EP2095341B1 (fr) 2019-09-04

Family

ID=39144340

Family Applications (1)

Application Number Title Priority Date Filing Date
EP07846608.3A Active EP2095341B1 (fr) 2006-11-15 2007-11-15 Procédé de détection des encrassements et/ou l'usure de l'encre dans la zone des transitions de couleur sur des documents de valeur et moyens en vue de mettre en oeuvre le procédé

Country Status (6)

Country Link
US (1) US8588477B2 (fr)
EP (1) EP2095341B1 (fr)
CN (1) CN101583979B (fr)
DE (1) DE102006053788A1 (fr)
RU (1) RU2451340C2 (fr)
WO (1) WO2008058742A1 (fr)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100889026B1 (ko) 2008-07-22 2009-03-17 김정태 이미지를 이용한 검색 시스템
GB0820882D0 (en) * 2008-11-14 2008-12-24 Rue De Int Ltd Document of value and method for detecting soil level
DE102009048002A1 (de) * 2009-10-02 2011-04-07 Beb Industrie-Elektronik Ag Verfahren und Vorrichtung zur Überprüfung des Verschmutzungsgrades von Banknoten
DE102009058438A1 (de) * 2009-12-16 2011-06-22 Giesecke & Devrient GmbH, 81677 Verfahren zur Prüfung von Wertdokumenten
DE102009058439A1 (de) * 2009-12-16 2011-06-22 Giesecke & Devrient GmbH, 81677 Verfahren zur Prüfung von Wertdokumenten
WO2011153343A1 (fr) * 2010-06-03 2011-12-08 Spectra Systems Corporation Détection de condition et d'usure de devise à l'aide de détection infrarouge modulée en température
DE102010047948A1 (de) * 2010-10-08 2012-04-12 Giesecke & Devrient Gmbh Verfahren zum Prüfen eines optischen Sicherheitsmerkmals eines Wertdokuments
DE102010055427A1 (de) * 2010-12-21 2012-06-21 Giesecke & Devrient Gmbh Verfahren und Vorrichtung zur Untersuchung des optischen Zustandes von Wertdokumenten
DE102011077895A1 (de) * 2011-06-21 2012-12-27 Bundesdruckerei Gmbh Verfahren und Vorrichtung zum Erstellen eines Dokumentenreferenzdatensatzes anhand eines Dokumentes
FR2978580B1 (fr) 2011-07-28 2013-08-16 Arjowiggins Security Procede de controle de l'etat physique d'un document
DE102011114410A1 (de) 2011-09-26 2013-03-28 Giesecke & Devrient Gmbh Verfahren zum Prüfen der Herstellungsqualität eines optischen Sicherheitsmerkmals eines Wertdokuments
DE102011121877A1 (de) * 2011-12-21 2013-06-27 Giesecke & Devrient Gmbh Verfahren und Vorrichtung zur Bestimmung von Klassifizierungsparametern für die Klassifizierung von Banknoten
DE102011121911A1 (de) * 2011-12-21 2013-06-27 Giesecke & Devrient Gmbh Verfahren und Vorrichtung zur Prüfung eines Sicherheitsmerkmals eines Wertdokuments
US20150379321A1 (en) 2012-03-01 2015-12-31 Sys-Tech Solutions, Inc. Methods and a system for verifying the authenticity of a mark
CN104303192B (zh) 2012-03-01 2016-11-23 系统科技解决方案公司 来自标记的特征的唯一识别信息
US20150169928A1 (en) 2012-03-01 2015-06-18 Sys-Tech Solutions, Inc. Methods and a system for verifying the identity of a printed item
DE102012016828A1 (de) * 2012-08-24 2014-02-27 Giesecke & Devrient Gmbh Verfahren und Vorrichtung zur Prüfung von Wertdokumenten
CN104464078B (zh) * 2014-12-08 2017-06-30 深圳怡化电脑股份有限公司 通过光变油墨识别损伤钞的方法及系统
ES2915025T3 (es) 2015-06-16 2022-06-20 Sys Tech Solutions Inc Métodos y un dispositivo informático para determinar si una marca es genuina
JP2017107291A (ja) * 2015-12-07 2017-06-15 株式会社東芝 紙葉類検査装置および紙葉類処理装置
WO2017160715A1 (fr) 2016-03-14 2017-09-21 Sys-Tech Solutions, Inc. Procédés et dispositif informatique de détermination d'authenticité d'une marque
DE102016011417A1 (de) * 2016-09-22 2018-03-22 Giesecke+Devrient Currency Technology Gmbh Verfahren und Vorrichtung zur Erkennung von Farbabnutzungen an einem Wertdokument, insbesondere einer Banknote, sowie Wertdokumentbearbeitungssystem
CN107610320A (zh) * 2017-09-06 2018-01-19 深圳怡化电脑股份有限公司 一种票据识别方法和装置
WO2019116542A1 (fr) * 2017-12-15 2019-06-20 グローリー株式会社 Dispositif d'évaluation de salissure de feuille de papier et procédé d'évaluation de salissure de feuille de papier
CN112447002B (zh) * 2019-09-03 2024-02-02 深圳怡化电脑股份有限公司 票据鉴别方法、票据鉴别设备、存储介质及计算机设备
CN111122447B (zh) * 2019-11-25 2022-03-25 北华航天工业学院 一种无人机多光谱波段纠正方法
US20210174627A1 (en) * 2019-12-10 2021-06-10 Jcm American Corporation Methods to Reduce Jamming in a Drum Style Bill Handler and Recycler
DE102021002672A1 (de) 2021-05-21 2022-11-24 Giesecke+Devrient Currency Technology Gmbh Verfahren und Vorrichtung zum Prüfen von Wertdokumenten und Verfahren und Vorrichtung zum Erzeugen von Prüfparameter für das Prüfverfahren
CN115131910B (zh) * 2022-05-30 2024-02-13 华中科技大学同济医学院附属协和医院 一种基于大数据的票据检验系统

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5615760A (en) * 1991-04-18 1997-04-01 Mars Incorporated Method and apparatus for validating money

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5939687B2 (ja) * 1973-07-06 1984-09-26 工業技術院長 光のスペクトラム分布を用いた柄出しのための色分解法および装置
DE2932962C2 (de) * 1979-08-14 1982-04-08 GAO Gesellschaft für Automation und Organisation mbH, 8000 München Verfahren zur Prüfung des Verschmutzungsgrades von Aufzeichnungsträgern, insbesondere von Banknoten
US4587434A (en) * 1981-10-22 1986-05-06 Cubic Western Data Currency note validator
CH653353A5 (de) 1983-05-09 1985-12-31 Ciba Geigy Ag Chromogene 3,3-bisindolyl-4-azaphthalide.
US4618257A (en) * 1984-01-06 1986-10-21 Standard Change-Makers, Inc. Color-sensitive currency verifier
GB8704269D0 (en) * 1987-02-24 1987-04-01 Rue Systems De Monitoring system
US4754532A (en) 1987-02-24 1988-07-05 Thomson Richard E Adjustable quick release magnetic holding assembly
CH684222A5 (de) 1992-03-10 1994-07-29 Mars Inc Einrichtung zur Klassifizierung eines Musters, insbesondere von einer Banknote oder von einer Münze.
GB9424971D0 (en) 1994-12-10 1995-02-08 At & T Global Inf Solution Document authentication system
DE19516354A1 (de) * 1995-05-04 1996-11-07 Heidelberger Druckmasch Ag Verfahren zur Bildinspektion und Farbführung an Druckprodukten einer Druckmaschine
DE19517194A1 (de) * 1995-05-11 1996-11-14 Giesecke & Devrient Gmbh Vorrichtung und Verfahren zur Prüfung von Blattgut, wie z.B. Banknoten oder Wertpapiere
JPH11213201A (ja) * 1997-11-10 1999-08-06 Laurel Bank Mach Co Ltd シート判別装置
EP0947964A1 (fr) 1998-03-30 1999-10-06 Ascom Autelca Ag Méthode pour contrÔler les papiers de valeur
JP2001126107A (ja) * 1999-10-29 2001-05-11 Nippon Conlux Co Ltd 紙葉類の識別方法および装置
GB0001561D0 (en) * 2000-01-24 2000-03-15 Rue De Int Ltd Document momitoring system and method
ES2280179T3 (es) * 2000-12-15 2007-09-16 Mei, Inc. Dispositivo para la validacion de dinero.
GB0106817D0 (en) * 2001-03-19 2001-05-09 Rue De Int Ltd Monitoring method
KR20020083122A (ko) * 2001-04-25 2002-11-01 가부시키가이샤 월드 테크노 지폐의 진위 식별방법 및 그 장치
US6913260B2 (en) * 2002-03-06 2005-07-05 Cummins-Allison Corp. Currency processing system with fitness detection
RU2233483C2 (ru) * 2002-03-29 2004-07-27 Общество с ограниченной ответственностью Фирма "Дата-Центр" Способ контроля мятости и ветхости банкнот
JP4555078B2 (ja) * 2002-06-19 2010-09-29 エムイーアイ インコーポレーテッド 貨幣評価装置
US7222712B2 (en) * 2003-03-24 2007-05-29 Valtech International, Llc Document validator with locking cassette
US20050100204A1 (en) * 2003-11-06 2005-05-12 Spectra Systems Corporation Method and apparatus for detecting fluorescent particles contained in a substrate

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5615760A (en) * 1991-04-18 1997-04-01 Mars Incorporated Method and apparatus for validating money

Also Published As

Publication number Publication date
WO2008058742A1 (fr) 2008-05-22
US20090245590A1 (en) 2009-10-01
RU2009122506A (ru) 2010-12-20
CN101583979B (zh) 2012-10-03
US8588477B2 (en) 2013-11-19
RU2451340C2 (ru) 2012-05-20
EP2095341A1 (fr) 2009-09-02
DE102006053788A1 (de) 2008-05-21
CN101583979A (zh) 2009-11-18

Similar Documents

Publication Publication Date Title
EP2095341B1 (fr) Procédé de détection des encrassements et/ou l'usure de l'encre dans la zone des transitions de couleur sur des documents de valeur et moyens en vue de mettre en oeuvre le procédé
EP1625936A2 (fr) Procédé d'évaluation qualitative d'un matériau portant au moins une caractéristique d'identification
WO2012045472A2 (fr) Procédé pour contrôler un signe de sécurité optique d'un document de valeur
EP2795589B1 (fr) Procédé et dispositif de contrôle d'un élément de sécurité d'un document de valeur
EP2761604B1 (fr) Procédé de contrôle de la qualité de fabrication d'une caractéristique de sécurité d'un document de valeur
EP2656328A1 (fr) Procédé et dispositif de détermination d'un ensemble de données de référence de classe, pour la classification de documents de valeur
WO2001061654A2 (fr) Procede et dispositifs pour le controle d'authenticite d'objets imprimes
WO2011082792A1 (fr) Procédé pour vérifier des documents de valeur
WO2017178111A1 (fr) Dispositif et procédé de vérification de documents de valeur, en particulier des billets de banque, et système de traitement de documents de valeur
EP3050032B1 (fr) PROCÉDÉ DE TEST DES DOCUMENTS DE VALEUR EN POLYMÈRE AVEC FENÊTRE TRANSPARENTE
ET DISPOSITIF METTANT EN OEUVRE DU PROCEDE
WO2013091841A1 (fr) Procédé et dispositif pour déterminer des paramètres de classement pour le classement de billets de banque
EP2394250B1 (fr) Procédé et dispositif pour vérifier des documents par utilisation d'une transformation en ondelettes
EP2724323B1 (fr) Procédé et dispositif de création d'un ensemble de données de référence d'un document à partir d'un document
EP2695146B1 (fr) Procédé de contrôle de documents de valeur
WO2011082793A1 (fr) Procédé pour vérifier des documents de valeur
WO2014029476A1 (fr) Procédé et dispositif de contrôle de documents fiduciaires
DE102020004284A1 (de) Verfahren und Vorrichtung zum Prüfen von Wertdokumenten und Verfahren und Vorrichtung zum Erzeugen von Prüfparametern zur Verwendung bei einem Verfahren zum Prüfen von Wertdokumenten
EP4256538A1 (fr) Capteur et procédé pour vérifier des documents de valeurs

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20090615

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20110214

APBK Appeal reference recorded

Free format text: ORIGINAL CODE: EPIDOSNREFNE

APBN Date of receipt of notice of appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNNOA2E

APBR Date of receipt of statement of grounds of appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNNOA3E

APAF Appeal reference modified

Free format text: ORIGINAL CODE: EPIDOSCREFNE

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: GIESECKE+DEVRIENT CURRENCY TECHNOLOGY GMBH

APBX Invitation to file observations in appeal sent

Free format text: ORIGINAL CODE: EPIDOSNOBA2E

APBZ Receipt of observations in appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNOBA4E

APBT Appeal procedure closed

Free format text: ORIGINAL CODE: EPIDOSNNOA9E

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20190405

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1176463

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190915

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502007016768

Country of ref document: DE

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191204

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200106

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200224

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502007016768

Country of ref document: DE

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG2D Information on lapse in contracting state deleted

Ref country code: IS

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191130

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191130

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191115

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200105

26N No opposition filed

Effective date: 20200605

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20191130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191130

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191115

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20071115

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230520

REG Reference to a national code

Ref country code: DE

Ref legal event code: R084

Ref document number: 502007016768

Country of ref document: DE

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20231122

Year of fee payment: 17

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231123

Year of fee payment: 17

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20231130

Year of fee payment: 17

Ref country code: DE

Payment date: 20231130

Year of fee payment: 17

Ref country code: AT

Payment date: 20231117

Year of fee payment: 17