EP3810432B1 - Procédé pour délivrer à un objet une marque unique - Google Patents
Procédé pour délivrer à un objet une marque unique Download PDFInfo
- Publication number
- EP3810432B1 EP3810432B1 EP19752554.6A EP19752554A EP3810432B1 EP 3810432 B1 EP3810432 B1 EP 3810432B1 EP 19752554 A EP19752554 A EP 19752554A EP 3810432 B1 EP3810432 B1 EP 3810432B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- particles
- marking
- incrustation
- glitter
- digital
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 124
- 239000002245 particle Substances 0.000 claims description 230
- 239000012530 fluid Substances 0.000 claims description 53
- 230000008569 process Effects 0.000 claims description 48
- 239000000463 material Substances 0.000 claims description 30
- 238000007639 printing Methods 0.000 claims description 27
- 229910052751 metal Inorganic materials 0.000 claims description 24
- 239000002184 metal Substances 0.000 claims description 24
- 230000000739 chaotic effect Effects 0.000 claims description 21
- 239000010432 diamond Substances 0.000 claims description 17
- 229910003460 diamond Inorganic materials 0.000 claims description 17
- 230000008021 deposition Effects 0.000 claims description 12
- 238000001514 detection method Methods 0.000 claims description 11
- 239000011347 resin Substances 0.000 claims description 11
- 229920005989 resin Polymers 0.000 claims description 11
- 230000000007 visual effect Effects 0.000 claims description 11
- KDLHZDBZIXYQEI-UHFFFAOYSA-N Palladium Chemical compound [Pd] KDLHZDBZIXYQEI-UHFFFAOYSA-N 0.000 claims description 10
- BASFCYQUMIYNBI-UHFFFAOYSA-N platinum Chemical compound [Pt] BASFCYQUMIYNBI-UHFFFAOYSA-N 0.000 claims description 10
- 229920000642 polymer Polymers 0.000 claims description 10
- 239000010970 precious metal Substances 0.000 claims description 10
- 239000002923 metal particle Substances 0.000 claims description 9
- 239000003292 glue Substances 0.000 claims description 8
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 claims description 8
- 229910052737 gold Inorganic materials 0.000 claims description 8
- 239000010931 gold Substances 0.000 claims description 8
- 239000002904 solvent Substances 0.000 claims description 8
- BQCADISMDOOEFD-UHFFFAOYSA-N Silver Chemical compound [Ag] BQCADISMDOOEFD-UHFFFAOYSA-N 0.000 claims description 6
- 230000011218 segmentation Effects 0.000 claims description 6
- 229910052709 silver Inorganic materials 0.000 claims description 6
- 239000004332 silver Substances 0.000 claims description 6
- 230000004308 accommodation Effects 0.000 claims description 5
- 230000000877 morphologic effect Effects 0.000 claims description 5
- 229910052763 palladium Inorganic materials 0.000 claims description 5
- 229910052697 platinum Inorganic materials 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 5
- 230000009466 transformation Effects 0.000 claims description 5
- 239000002966 varnish Substances 0.000 claims description 5
- 238000004519 manufacturing process Methods 0.000 claims description 4
- 238000002156 mixing Methods 0.000 claims description 4
- 239000000203 mixture Substances 0.000 claims description 4
- 230000000694 effects Effects 0.000 claims description 3
- 238000007647 flexography Methods 0.000 claims description 3
- 230000001537 neural effect Effects 0.000 claims description 3
- 239000004417 polycarbonate Substances 0.000 claims description 3
- 229920000515 polycarbonate Polymers 0.000 claims description 3
- 239000004800 polyvinyl chloride Substances 0.000 claims description 3
- 239000002023 wood Substances 0.000 claims description 3
- 235000006679 Mentha X verticillata Nutrition 0.000 claims description 2
- 235000002899 Mentha suaveolens Nutrition 0.000 claims description 2
- 235000001636 Mentha x rotundifolia Nutrition 0.000 claims description 2
- 229920002678 cellulose Polymers 0.000 claims description 2
- 239000001913 cellulose Substances 0.000 claims description 2
- 238000010017 direct printing Methods 0.000 claims description 2
- 230000004807 localization Effects 0.000 claims description 2
- 239000000123 paper Substances 0.000 claims description 2
- 238000003860 storage Methods 0.000 claims description 2
- 238000007645 offset printing Methods 0.000 claims 1
- 239000000976 ink Substances 0.000 description 8
- 238000013527 convolutional neural network Methods 0.000 description 7
- 238000010200 validation analysis Methods 0.000 description 7
- 238000012795 verification Methods 0.000 description 6
- 239000012876 carrier material Substances 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000002788 crimping Methods 0.000 description 4
- 239000000758 substrate Substances 0.000 description 4
- 239000010437 gem Substances 0.000 description 3
- 229910001751 gemstone Inorganic materials 0.000 description 3
- 230000008520 organization Effects 0.000 description 3
- 239000000126 substance Substances 0.000 description 3
- 239000000654 additive Substances 0.000 description 2
- 230000000996 additive effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 238000003556 assay Methods 0.000 description 2
- 238000012512 characterization method Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 239000006185 dispersion Substances 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 235000013305 food Nutrition 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000003973 paint Substances 0.000 description 2
- 238000004080 punching Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- 241000562569 Riodinidae Species 0.000 description 1
- NIXOWILDQLNWCW-UHFFFAOYSA-N acrylic acid group Chemical group C(C=C)(=O)O NIXOWILDQLNWCW-UHFFFAOYSA-N 0.000 description 1
- 238000005054 agglomeration Methods 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 229910052799 carbon Inorganic materials 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000003708 edge detection Methods 0.000 description 1
- 229920001971 elastomer Polymers 0.000 description 1
- 239000000806 elastomer Substances 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 238000007373 indentation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 150000002739 metals Chemical class 0.000 description 1
- 230000003278 mimic effect Effects 0.000 description 1
- 238000010422 painting Methods 0.000 description 1
- 239000000049 pigment Substances 0.000 description 1
- 230000010287 polarization Effects 0.000 description 1
- 229920000915 polyvinyl chloride Polymers 0.000 description 1
- 239000000843 powder Substances 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000035939 shock Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000007592 spray painting technique Methods 0.000 description 1
- 239000010421 standard material Substances 0.000 description 1
- 230000008685 targeting Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 239000012815 thermoplastic material Substances 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41M—PRINTING, DUPLICATING, MARKING, OR COPYING PROCESSES; COLOUR PRINTING
- B41M7/00—After-treatment of prints, e.g. heating, irradiating, setting of the ink, protection of the printed stock
- B41M7/0081—After-treatment of prints, e.g. heating, irradiating, setting of the ink, protection of the printed stock using electromagnetic radiation or waves, e.g. ultraviolet radiation, electron beams
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41M—PRINTING, DUPLICATING, MARKING, OR COPYING PROCESSES; COLOUR PRINTING
- B41M3/00—Printing processes to produce particular kinds of printed work, e.g. patterns
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41M—PRINTING, DUPLICATING, MARKING, OR COPYING PROCESSES; COLOUR PRINTING
- B41M3/00—Printing processes to produce particular kinds of printed work, e.g. patterns
- B41M3/14—Security printing
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41M—PRINTING, DUPLICATING, MARKING, OR COPYING PROCESSES; COLOUR PRINTING
- B41M5/00—Duplicating or marking methods; Sheet materials for use therein
- B41M5/26—Thermography ; Marking by high energetic means, e.g. laser otherwise than by burning, and characterised by the material used
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41M—PRINTING, DUPLICATING, MARKING, OR COPYING PROCESSES; COLOUR PRINTING
- B41M7/00—After-treatment of prints, e.g. heating, irradiating, setting of the ink, protection of the printed stock
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B44—DECORATIVE ARTS
- B44F—SPECIAL DESIGNS OR PICTURES
- B44F1/00—Designs or pictures characterised by special or unusual light effects
- B44F1/02—Designs or pictures characterised by special or unusual light effects produced by reflected light, e.g. matt surfaces, lustrous surfaces
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B44—DECORATIVE ARTS
- B44F—SPECIAL DESIGNS OR PICTURES
- B44F5/00—Designs characterised by irregular areas, e.g. mottled patterns
Definitions
- the present invention is enclosed in the area of unique marking of objects, for instance authenticity in assay or uniquely identifying and tracking an object.
- Document DE 10 2008 015466 discloses a security marking for objects, comprising particles randomly distributed on or at the surface or, in the case of a material transparent to optical radiation, in the volume of an object, wherein the particles reflect light depending on an angle and change a phase or polarization or spectral formation of the light.
- the particles have a disk-shaped geometry, preferably with a layer thickness of 0.1 to 10 ⁇ m and an extent of 1 to 1000 ⁇ m. It is also disclosed a device for identifying an object and a method for identifying an object.
- a method for marking an article which includes providing an article including a substrate, the substrate including a surface and a surface material, and forming a design on the surface of the substrate by applying a marking material to the surface wherein applying the marking material includes an additive manufacturing technique.
- a second method for marking an article is disclosed, further including the surface having a first surface and second surface, the second surface defining a depression relative to the first surface, and forming a design on the surface of the substrate by applying a marking material to the second surface, the marking material forming a marking surface which is substantially flush with the first surface.
- the marked article formed by the methods includes a microstructure derived from the additive manufacturing technique.
- Document US 2018/029304 refers to a method for preparing a composite body comprising a support body and at least one decorative element, preferably a gemstone, the support body comprising a thermoplastic material, the method being characterized by the steps of: arranging the decorative element on the support body, heating the support body, pressing the decorative element into the support body by using a stamp consisting of an elastically deformable material, the material of the stamp being selected from the group of elastomers.
- the object In the area of assurance of authenticity, the object is typically a valuable object, the marking providing assurance of authenticity of the object by visual analysis, indicating that the object contains a certain degree of purity (in the case of gemstones and precious metals) or which has a certain provenance (in the case of food products, such as wine bottles).
- provenance or guarantee authenticity consist of security documents (for identification, such as passports, national citizens' cards, driving licenses, visas, residence documents, etc.), certificates of authenticity (diplomas, certificates of formal qualifications, official stamps, etc.) and certificates of authenticity of products or trademarks (products of protected origin, trade marks, or others).
- the marking is applied by punching the object.
- a guarantee seal with certain visual characteristics is applied, typically further comprising a numbering.
- the marking that is intended to be unique is recognizable and the security against copy of the marking is dependent on access to the puncture and associated equipment or the equipment producing the said seals, or the ability to reproduce them.
- marking solutions are also known, such as codes with n-dimensions (bar codes, QR code, or others) or solutions with electronic components, such as RFID or other electronic-based solutions of greater constructive complexity.
- the present invention aims to address all of these problems by providing a solution that guarantees authenticity to an object and also allows validation, identification and tracking of the object, by introducing intrinsically unique techniques in the object marking process and consequently in the object itself.
- the portion of the object consists of a incrustation portion made of a material with hardness and ductility which provide accommodation of incrusted particles, in particular the material consisting of a metal, a polymer or a resin, said physical chaotic marking process specifically consisting of i) incrustation of particles in the incrustation portion, such incrustation being performed by a) puncturing or b) application of a laser beam, on the surface of the incrustation portion, said particles being deposited on the surface prior to incrustation and therein incrusted after incrustation.
- Incrustation of particles are more efficiently performed a) by puncturing (with a punch) of the particles into the object, which in the present case is a metal object, or b) by applying a laser beam on the surface of the incrustation portion, thereby fusing such area and providing incrustation of the particles into the surface.
- the incrustation portion material consists of a metal, thus providing a metal portion.
- the incrustation portion material consists of a polymer, such polymer consists of acrylic.
- the physical chaotic marking process specifically consists of ii) printing with a bondable fluid enriched with glitter particles, where said printing being performed by one of the following methods: serigraphy, flexography, rotogravure, carving, typography, offset, spray painting or direct printing with a brush embedded in said bondable fluid.
- Printing of a bondable fluid enriched with glitter particles are efficiently performed on the surface of the portion of the object by one of the described methods.
- Such unique marking being provided in the object, which consists of a stamp or the object to be marked itself.
- Such machine therefore uniquely marks objects, due to the chaotic/random properties of the means it comprises, therefore providing the advantages of the method for providing an object with a unique marking of the present invention.
- Another object of the present invention is a method for capturing a marking, such marking being obtained by the method for providing an object with a unique marking of the present invention or being present in the object with a marking of the present invention, the method for capturing the marking comprising the following steps:
- Such method for capturing a marking therefore provides an efficient way to capture and obtain relevant information from an object with a marking as obtained from the method for providing an object with a unique marking of the present invention, or an object obtained from such method for providing an object with a unique marking.
- a computational apparatus comprising digital image acquiring means, preferably a digital camera or microscope, configured to implement the method for capturing a marking of the present invention, and a computer-readable non-transitory storage media comprising program instructions executable to carry out the method for capturing a marking of the present invention are also objects of the present invention.
- incrustation of particles is specifically performed by a) puncturing on the surface of the incrustation portion by means of a metal punch over said pre-deposited particles on the surface.
- incrustation of particles is specifically performed by b) application of a laser beam on the surface of the incrustation portion and, prior to such incrustation, particles being pre-crimped on said surface. Therefore, a random organisation of particles is provided as in alternative process a), of puncturing, although particles are not truly incrusted but only partially fixed to the surface. It is the application of a laser beam that incrusts the particles, already randomly organised by the pre-crimping.
- the particles consist of diamond particles, approximately spherical, therefore providing resistance to the impact of puncturing or the effect of laser, and also providing evenness of particles, with a generally spherical form.
- Said particles of have an average area of 0.7-3.2 % of the area of the incrustation portion, the particles having a diameter between 50-100 pm and the surface of the incrustation portion having an area of 1-4 mm 2 , the surface of the incrustation portion consisting of a square with 1-2 mm sides.
- Such relation between areas provides for a good visual organization of particles in the metal, thereby enhancing optical or visual reading methods.
- the particles have a high contrast with the incrustation portion, preferably having a colour which provides high contrast with such incrustation portion.
- the incrustation portion comprises or consists of a precious metal, preferably one or more of the following: gold, silver, platinum or palladium. It is - although in no way necessary - that the whole object is made of the same material or materials as the incrustation portion.
- Variables consist of:
- Process described as a) comprises placement of the particles, by deposition on the metal surface, and crimping the particles by puncturing using a metal punch, over the pre-deposition of particles.
- Process described as b) comprises placement of the particles, by deposition on the metal surface, and particle crimping by incidence of a laser beam, with or without pre-crimping of the particles for initial fixation.
- the bondable fluid enriched with glitter particles is obtained by mixing glitter particles into a bondable fluid, prior to printing. Such mixing enhances the random organisation of glitter particles within the bondable fluid.
- Printing is specifically performed by serigraphy with a net, the net being such it provides passing of the glitter particles through it.
- the glitter particles have a diameter between 50-100 pm and consist of metal particles non solvent in the bondable fluid, such particles being spherical or discoidal.
- the bondable fluid consists of ink, glue, a resin or varnish.
- said glitter particles are such that have high contrast with said bondable fluid, the bondable fluid said bondable fluid preferably having transparency. More preferably, the fluid is transparent. Thus, the glitter particles will be even more visible, in their contrast with the bondable fluid.
- Variables consist of:
- the process comprises placement of the particles, by mixing the powder particles with the bondable glue, such as ink, to be applied, and printing using screen print technique with a net wide enough to allow the passage of glitter particles, other printing processes also being suitable.
- the bondable glue such as ink
- Contrast existence of high visual contrast between the particles and the carrier material where the marking is created.
- the colour of the glitter particles be differentiated from the colour of the paint and / or colour of the carrier material (paper, polymer, PVC, polycarbonate, wood, among other carrier materials) when applied with inks or transparent glues or with a high transparency index.
- the colour of the particles be differentiated from the colour of the metal.
- Particle resistance high particle resistance in terms of physical and chemical integrity to the process of marking creation.
- the particles suffer a physical shock that fractures or destroys them partially or completely.
- the particle be of a material resistant to the physical process.
- one of the most suitable materials for the marking process is the diamond (carbon element), given its high physical strength.
- the particles maintain their physical integrity and chemical composition, and be stable throughout the life cycle of the marking.
- one of the suitable materials is non-soluble metal particles in the solvents, glues, resins and paints where they will be mixed.
- Density existence of low density and non-high amount of particles along the marking.
- the amount of particles range from 10 to 1000 along the making for a common label, although it is desirable that the number of particles be between 30 and 200. A higher or lower particle value does not compromise the marking, but reduces the ability of a system to identify it.
- density it is desirable that there be no particle agglomeration, for this purpose the use of a low density dispersion is desirable.
- the method for capturing a marking further comprises rectifying the digital image, prior to particle segmentation, such rectifying comprising:
- Such rectification provides a more suitable image to analyse, i.e., to in which particles and further details are detected.
- the particle segmentation of the method for capturing a marking also further comprises implementing a convolutional neuronal network on the image, such network having been trained over the image and a mask containing already identified particles.
- the method for capturing a marking also further comprises associating a digital descriptor with additional information and storing both the digital descriptor and additional information in a relational database, thereby registering such digital descriptor where no corresponding digital descriptor from the plurality of digital descriptors in a database was identified, the additional information comprising one or more of the following: date, time, localisation, owner reference, manufacturer reference, information on each sale / transition of ownership of the piece, information on remodelling or any procedure implemented on the piece.
- the most suitable reading system would most suitably have a magnification capability for the particles to be individually detected.
- This system could be a microscope (with enlargements of IOOx, 200x or higher) or a conventional chamber of great magnification.
- Another suitable reading system is the camera of a smartphone or tablet with a lens attached.
- the image acquisition process should be optimized to collect one or more images under predefined lighting, positioning and magnification conditions.
- the equipment should be capable of capturing 5 megapixel images in the case of magnifications greater than 200x and 12 megapixels in case the equipment is a smartphone or tablet, with or without magnifying accessory lenses, and the marking must be completely visible, without occlusions or cuts.
- Figure 1 illustrates two examples of markings captured with a microscope. These resolution values are indicative of solutions with high robustness, however, the reading system has a lower resolution, which does not compromise the robustness of the solution in most cases.
- the reading system could be a conventional camera or the camera of a mobile device, or even a microscope, but it is not usually necessary to use the latter.
- the image acquisition process must be able to capture all the particles of a marking.
- the acquisition equipment is a mobile phone with a common camera attached.
- the capture is done preferably, but not exclusively, with resolution equal to or greater than 1080p. Since the interaction of the particles with light differs according to the direction of incidence of the latter and from the point of view of the acquisition, it is preferable to capture more than one image and to identify the particles in all of them and subsequently to compose the description of the marking (as described in Section 3: Image Descriptor).
- Figure 2 shows a glitter marking captured with the camera of a mobile phone.
- a digital descriptor that combines visual aspects, geometric characteristics and/or morphological characteristics is used.
- the function of a digital descriptor is to enable the marking validation operation, without recourse to the original image, which is available or not at the time of validation and, consequently, to improve the speed of obtaining a validation result.
- the visual aspects of a marking are described through image characterization methods, such as: descriptors of local characteristics, textures, hue, minutiae, among others.
- Two images of the same marking are compared through local (pixel-by-pixel) or global (general structure from image) relationships. In order to better perform a local comparison it is necessary to perform a correct alignment between two images captured from the same mark, through rectification.
- corner and edge detection algorithms such as ORB [Oriented Features from Accelerated Segment Test (FAST) and Rooted BRIEF (Binary Robust Independent Elementary Features)], among other possible methods. These methods allow to detect and compare small sections (typically 5x5 pixels) in order to find matches.
- LBP Local Binary Markings
- the gathering of information of hue is relevant, since it allows to identify the type of material on which the marking is applied.
- By analysing the RGB channels of the image it is possible to identify the type of metal being analysed, or the type of pigment in which the glitter is immersed.
- Minutiae detection refers to implemented mechanisms capable of identifying and characterizing imperfections or indentations created by the marking on the surface on which the marking was applied or created by the particles themselves that make up the marking.
- the elements in the marking consist of particles that are detected, their relative and absolute positions in the marking and their shape being known, it is possible to characterize the marking also on the basis of this information. From the mask identifying the particles (Fig. Be)), characteristics describing their morphology are calculated namely, size, circularity, aspect ratio, particle density, distance to the centre of the marking, between others. Once these characteristics are calculated, their distribution in a histogram is studied and values are collected at specific frequencies of the histogram which then constitute the morphological aspects of the marking in question.
- the geometric aspects of a marking are described by histograms of characteristics associated with the sequence or sets of particles (a marking is composed of several particles). Among these aspects, we firstly use the distance between sets (the order of points does not matter) of two particles and the angle formed by the sequence (points chosen in a specific order) of three particles ( Fig. 3d )).
- Such a histogram consists of a vector of integers that account for the occurrence of value ranges of a given characteristic among all sets / sequences of points associated with the particles.
- Figure 3d illustrates the calculation of the distance between two pairs of points, as well as the angle formed by a sequence of three other points.
- rectification a marking is photographed at different distances and from different points of view.
- a marking visual, morphological and geometric
- Marking image detection aims at extracting the region of interest for further processing.
- the extraction of the zone of interest allows the system to operate only on a part of the image, reducing the computational effort required, as well as increase the chances of success with particle detection and segmentation.
- it also allows a more efficient management of the information that is stored in the database, due to the smaller size of the image that needs to be retained.
- the process of marking detection is achieved at the expense of the implementation of a convolutional neural network (CNN), called U-Net.
- CNN convolutional neural network
- U-Net This neural network is an algorithm capable of recognizing which zones of the image that contain the marking that is the zone of interest.
- This network is trained on a set of data acquired during the system building process and is updated and re-trained as the amount of information available in the database increases.
- a possible algorithm is based on the use of a U-Net convolutional neural network (CNN), trained directly on the image and its mask with the identified particles. For each marking used in the training of this network, the image of the marking is presented, the true segmentation of the particles (carried out manually).
- CNN convolutional neural network
- the database record contains, in addition to the original captured image, its geometric and visual descriptors as well as other additional information (namely: date, time, location, observations, owner, manufacturer).
- additional information namely: date, time, location, observations, owner, manufacturer.
- validation of a marking it is performed by two different operations, with different objectives and purposes: verification and identification.
- a set of characteristics of this marking are determined (targeting masks, particle position, random marking descriptors, etc.), which are evaluated by the model in the sense of identifying which marking which is sufficiently similar to the standard presented, in the case of identification.
- This validation process called identification, is a 1-to-many search.
- the validation process is performed as a verification process. In the case of verification, this set of characteristics is compared only with the characteristics of the marking whose identity is known or suggested, becoming, therefore, a 1-to-1 search.
- Fig. 6 shows an example of the complete registration process in a database of a diamond-on-metal particle dispersion marking.
- the processing ( Fig. 7 (a) to (d) ) generally includes the following operations: marking detection, identification of the carrier material, identification of the standard material, rectification and standardization of the marking for standard scale and orientation, detection of the particles forming the randomness and the calculation of the digital descriptors that characterize it, as above described.
- the descriptor of the marking to be checked will be purchased with the descriptor of the marking with which the comparison is intended, stored in database.
- the two marks are subjected to the same standardization operations described above ( Fig. 7 e) ). If this comparison, measured by a sufficiently effective likelihood measurement model, returning a sufficiently high score, then the marking is validated as being the same marking stored.
- FIG. 8 (a) to (d) generally includes the following operations: marking detection, identification of the carrier material, identification of the material constituting the standard, rectification and standardization of the marking for standard scale and orientation, detection of the particles forming the random marking and calculation of the descriptors that characterize it, as described above (Fig. 8 a) to d)).
- the descriptor of the marking to be identified After the descriptor of the marking to be identified has been calculated, it will be compared to the descriptors stored in the database, which contains all the marking to be searched.
- the research process is not simple and its complexity depends on the size of the database, among other factors.
- the comparison is made using a cost metric between descriptors, producing a comparison value.
- the process is accelerated through an indexed search and hypothesis elimination system (Fig. 8 e). From this comparison will appear a list of the candidate markings, that is, those whose descriptors are more similar to the marking under verification.
- the identification process includes several passages through this process of successively reducing the number of candidate markings until a comparison with a degree of confidence sufficient to generate a final response appears.
- the identification process is structured at several levels, so that when one level generates more than one candidate marking, then the next level will initiate a new identification process with this list of candidate markings. New descriptors relating to this level should be calculated from this list.
- Some of the operations that are used for the second level of research include processes of image alignment by homography techniques, comparison of marking geometry, and measurement of similarity of descriptors. If one of these comparisons returns a sufficiently high score, the marking identity is confirmed.
Landscapes
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Electromagnetism (AREA)
- General Health & Medical Sciences (AREA)
- Toxicology (AREA)
- Optics & Photonics (AREA)
- Powder Metallurgy (AREA)
- Thermal Transfer Or Thermal Recording In General (AREA)
Claims (19)
- Procédé pour la fourniture d'un objet avec un marquage unique caractérisé en ce qu'il comprend le marquage de cet objet avec un processus de marquage physique chaotique sur la surface d'une partie dudit objet, ce processus de marquage physique chaotique étant constitué d'uni) dépôt aléatoire de particules sur la surface et d'une incrustation ultérieure, dans lequel ladite partie de l'objet est constituée d'une partie d'incrustation faite d'un matériau dont la dureté et la ductilité fournissent un logement aux particules incrustées, le matériau étant constitué d'un métal, d'un polymère ou d'un résine, ledit processus de marquage physique chaotique étant constitué d'une incrustation de particules dans la partie d'incrustation, cette incrustation étant réalisée par a) perforation ou b) application d'un faisceau laser, sur la surface de la partie d'incrustation, lesdites particules étant déposées sur la surface avant l'incrustation et s'y incrustent après l'incrustation, et dans lequel de telles particules sont constituées de particules de diamant, approximativement sphériques, et dans lequel lesdites particules couvrent une superficie moyenne de 0,7 à 3,2 % de la superficie de la partie d'incrustation, les particules ayant un diamètre compris entre 50 et 100 µm et la surface de la partie d'incrustation ayant une superficie de 1 à 4 mm2, cette surface de la partie d'incrustation étant constituée d'un carré de 1 à 2 mm de côté ;
ouii) l'impression avec un fluide collable enrichi avec des particules scintillantes, fournissant ainsi un marquage sur cette surface, dans lequel ledit fluide collable est constitué d'encre, de colle, d'une résine ou d'un vernis, dans lequel les particules scintillantes ont un diamètre compris entre 50 et 100 µm, dans lequel les particules scintillantes sont constituées de particules métalliques non solvantes dans le fluide collable, ces particules étant sphériques ou discoïdales ;dans lequel ces particules scintillantes sont organisées de manière aléatoire dans le fluide collable, et les particules scintillantes sont dispersées en une faible densité le long du marquage et la quantité de particules scintillantes varie de 10 à 1000 particules scintillantes le long du marquage pour une étiquette commune. - Procédé selon la revendication précédente dans lequel l'incrustation des particules est spécifiquement réalisée par a) perforation sur la surface de la partie d'incrustation au moyen d'un poinçon métallique sur lesdites particules pré-déposées sur la surface.
- Procédé selon la revendication 1, dans lequel l'incrustation des particules est spécifiquement réalisée par b) application d'un faisceau laser sur la surface de la partie d'incrustation et, avant cette incrustation, les particules étant pré-serties sur ladite surface.
- Procédé selon l'une quelconque des revendications précédentes, dans lequel lesdites particules présentent un contraste élevé avec la partie d'incrustation, ayant de préférence une couleur qui fournit un contraste élevé avec cette partie d'incrustation.
- Procédé selon l'une quelconque des revendications 1 à 4, dans lequel ladite partie d'incrustation comprend ou est constituée d'un métal précieux, de préférence un ou plusieurs parmi les éléments suivants : or, argent, platine ou palladium.
- Procédé selon l'une quelconque la revendication 1, dans lequel ledit processus de marquage physique chaotique est constitué spécifiquement de ii) l'impression avec un fluide collable enrichi en particules scintillantes, ladite impression étant réalisée par l'un des procédés suivants : sérigraphie, flexographie, héliogravure, gravure, typographie, impression offset ou directe avec un pinceau plongé dans ledit fluide collable.
- Procédé selon l'une quelconque des revendications 1 ou 6, dans lequel un fluide collable enrichi en particules scintillantes est obtenu par le mélange des particules scintillantes dans un fluide collable, avant l'impression.
- Procédé selon l'une quelconque des revendications 6 à 7, dans lequel ladite impression est spécifiquement réalisée par sérigraphie avec un filet, le filet étant tel qu'il fournit le passage des particules scintillantes à travers lui.
- Procédé selon l'une quelconque des revendications 1 ou 6 à 8, dans lequel lesdites particules scintillantes sont telles qu'elles présentent un contraste élevé avec ledit fluide collable, le fluide collable, ledit fluide collable présentant de préférence une transparence.
- Objet caractérisé en ce qu'il est obtenu à partir du procédé selon l'une quelconque des revendications précédentes, cet objet comprenant :- une partie d'incrustation, le processus de marquage physique chaotique étant appliqué par i) incrustation de particules sur la surface de cette partie d'incrustation, selon l'une quelconque des revendications 1 à 5 ; dans lequel la partie d'incrustation est faite d'un matériau dont la dureté et la ductilité fournissent un logement des particules incrustées, dans lequel ledit matériau est constitué d'un métal, d'un polymère ou d'une résine ;et dans lequel ces particules sont constituées de particules de diamant, approximativement sphériques, et dans lequel lesdites particules couvrent une superficie moyenne de 0,7 à 3,2 % de la superficie de la partie d'incrustation et ces particules ont un diamètre compris entre 50 et 100 µm ;et la surface de la partie d'incrustation a une superficie de 1 à 4 mm2, cette surface de la partie d'incrustation étant constituée d'un carré avec des côtés de 1 à 2 mm ;
ou- une partie, le processus de marquage physique chaotique étant appliqué par ii) impression avec un fluide collable enrichi avec des particules scintillantes sur la surface de cette partie, selon l'une quelconque des revendications 1 ou 6 à 9, et fournissant ainsi un marquage sur la surface de la partie de l'objet ;dans lequel ledit fluide collable est constitué d'encre, de colle, d'une résine ou d'un vernis ; dans lequel les particules scintillantes ont un diamètre compris entre 50 et 100 µm ; dans lequel les particules scintillantes sont constituées de particules métalliques non solvantes dans le fluide collable, ces particules étant sphériques ou discoïdales ; dans lequel les particules scintillantes sont organisées de manière aléatoire dans le fluide collable, et les particules scintillantes sont dispersées en une faible densité le long du marquage et la quantité de particules scintillantes varie de 10 à 1000 particules scintillantes le long du marquage pour une étiquette commune. - Objet selon la revendication précédente dans lequel il est constitué de :- une pièce métallique, de préférence en métal précieux tel que l'or, l'argent, le platine ou le palladium, constituée ainsi d'une pièce précieuse, et le marquage unique étant constitué d'une marque d'atelier, la partie d'incrustation étant constituée d'une partie de cette pièce métallique, et le processus de marquage physique chaotique étant appliqué par i) incrustation de particules, ou- une pièce à base de cellulose ou de polymère, de préférence en polycarbonate (PC), en chlorure de polyvinyle (PVC), en bois ou en papier, la partie constituée d'une partie de la surface de cette pièce, et le processus de marquage physique chaotique étant appliqué par ii) impression la surface avec un fluide collable enrichi avec des particules scintillantes.
- Une utilisation de particules selon un procédé pour la fourniture d'un objet avec un marquage unique selon l'une quelconque des revendications 1 à 9, dans lequel lesdites particules sont constituées de :- particules de diamant, approximativement sphériques, dans lesquelles lesdites particules de diamant couvrent une superficie moyenne de 0,7 à 3,2 % de la surface de la partie d'incrustation et ces particules de diamant ont un diamètre compris entre 50 et 100 µm ; ou- des particules scintillantes, de préférence d'un mélange d'un fluide collable avec ces particules scintillantes, fournissant ainsi un fluide collable enrichi avec des particules scintillantes, pour la fourniture d'une marque unique par dépôt aléatoire de ces particules ; dans lequel les particules scintillantes ayant un diamètre compris entre 50 et 100 µm, dans lequel les particules scintillantes sont constituées de particules métalliques non solvantes dans le fluide collable, ces particules étant sphériques ou discoïdales ; dans lequel les particules scintillantes sont dispersées en une faible densité le long du marquage et la quantité de particules scintillantes varie de 10 à 1000 particules scintillantes le long du marquage pour une étiquette commune.
- Machine pour la fabrication d'un objet avec un marquage unique, configurée pour mettre en oeuvre le procédé selon l'une quelconque des revendications 1 à 9 et comprenant :- i) des moyens pour le dépôt aléatoire des particules de diamant sur la surface d'un objet et l'incrustation ultérieure de ces particules dans la surface ou- ii) des moyens pour l'impression d'une surface d'un objet avec un fluide collable enrichi avec des particules scintillantes, fournissant ainsi un marquage sur cette surface de l'objet.
- Un procédé pour la capture d'un marquage, ce marquage étant obtenu par le procédé selon l'une quelconque des revendications 1 à 9 ou étant présent dans l'objet selon l'une quelconque des revendications 10 à 11, caractérisé en ce qu'il comprend les étapes suivantes :- l'obtention d'au moins une image numérique du marquage, de préférence par le biais d'un appareil photo numérique ou d'un microscope,- la segmentation des particules sur ladite image numérique au moyen d'un traitement d'image,- déterminer un descripteur numérique sur base des particules identifiées, le descripteur numérique comprenant des informations sur les aspects visuels, géométriques et/ou morphologiques des particules dans le marquage, et- comparer ce descripteur numérique avec une pluralité de descripteurs numériques dans une base de données, et l'obtention ainsi des informations supplémentaires associées avec un descripteur numérique correspondant dans la base de données.
- Procédé selon la revendication précédente dans lequel il comprend en outre la rectification de l'image numérique, avant la segmentation des particules, cette rectification comprenant :- la détection d'une zone contenant un marquage dans l'image, par recherche et identification de caractéristiques, la détection de cette zone comprenant de préférence :∘ la mise en oeuvre d'un réseau neuronal convolutif sur la zone de l'image, ce réseau ayant été formé sur des données pré-acquises relatives à d'autres marquages,- l'application d'une transformation dans cette zone, cette transformation comprenant la suppression des effets de perspective et/ou une orientation souhaitée.
- Procédé selon l'une quelconque des revendications 14 à 15, dans lequel la segmentation des particules comprend la mise en oeuvre d'un réseau neuronal convolutifsur l'image, de préférence sur ladite zone de l'image, ce réseau ayant été formé sur l'image et un masque contenant des particules déjà identifiées.
- Procédé selon l'une quelconque des revendications 14 à 16, dans lequel il comprend en outre l'association d'un descripteur numérique avec des informations supplémentaires et le stockage à la fois du descripteur numérique et des informations supplémentaires dans une base de données relationnelle, enregistrant ainsi ce descripteur numérique, de préférence où aucun descripteur numérique correspondant parmi la pluralité de descripteurs numériques dans une base de données n'a été identifié, de préférence les informations supplémentaires comprenant un ou plusieurs parmi les éléments suivants : date, heure, localisation, référence du propriétaire, référence du fabricant.
- Appareil informatique comprenant des moyens d'acquisition d'images numériques, de préférence un appareil photo numérique ou un microscope, et un processeur configuré pour mettre en oeuvre le procédé selon l'une quelconque des revendications 14 à 17.
- Support de stockage non transitoire lisible par ordinateur comprenant des instructions de programme qui, lorsqu'elles sont exécutées par un ordinateur, amènent l'ordinateur à exécuter le procédé selon l'une quelconque des revendications 14 à 17.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
RS20240065A RS65087B1 (sr) | 2018-06-22 | 2019-06-19 | Postupak za opremanje objekta jedinstvenom oznakom |
HRP20240083TT HRP20240083T1 (hr) | 2018-06-22 | 2019-06-19 | Postupak za dobivanje predmeta s jedinstvenim znakom |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PT11079818 | 2018-06-22 | ||
PCT/IB2019/055177 WO2019244081A1 (fr) | 2018-06-22 | 2019-06-19 | Procédé pour délivrer à un objet une marque unique |
Publications (3)
Publication Number | Publication Date |
---|---|
EP3810432A1 EP3810432A1 (fr) | 2021-04-28 |
EP3810432C0 EP3810432C0 (fr) | 2023-10-18 |
EP3810432B1 true EP3810432B1 (fr) | 2023-10-18 |
Family
ID=67587903
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19752554.6A Active EP3810432B1 (fr) | 2018-06-22 | 2019-06-19 | Procédé pour délivrer à un objet une marque unique |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP3810432B1 (fr) |
HU (1) | HUE064941T2 (fr) |
PL (1) | PL3810432T3 (fr) |
RS (1) | RS65087B1 (fr) |
WO (1) | WO2019244081A1 (fr) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
RU2739059C1 (ru) * | 2020-06-30 | 2020-12-21 | Анатолий Сергеевич Гавердовский | Способ проверки подлинности маркировки |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102008015466A1 (de) * | 2008-03-22 | 2009-09-24 | Informium Ag | Sicherheitskennzeichnung |
EP3056331A1 (fr) * | 2015-02-16 | 2016-08-17 | Swarovski Aktiengesellschaft | Corps composite présente un corps décoratif |
US9771629B2 (en) * | 2015-06-25 | 2017-09-26 | General Electric Company | Methods for marking and marked articles using additive manufacturing technique |
-
2019
- 2019-06-19 EP EP19752554.6A patent/EP3810432B1/fr active Active
- 2019-06-19 WO PCT/IB2019/055177 patent/WO2019244081A1/fr active Application Filing
- 2019-06-19 RS RS20240065A patent/RS65087B1/sr unknown
- 2019-06-19 HU HUE19752554A patent/HUE064941T2/hu unknown
- 2019-06-19 PL PL19752554.6T patent/PL3810432T3/pl unknown
Also Published As
Publication number | Publication date |
---|---|
EP3810432A1 (fr) | 2021-04-28 |
EP3810432C0 (fr) | 2023-10-18 |
HUE064941T2 (hu) | 2024-05-28 |
RS65087B1 (sr) | 2024-02-29 |
PL3810432T3 (pl) | 2024-04-02 |
WO2019244081A1 (fr) | 2019-12-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10614302B2 (en) | Controlled authentication of physical objects | |
EP2024899B1 (fr) | Moyen permettant d'utiliser une microstructure de surface de materiaux comme identificateur unique | |
JP6455679B2 (ja) | 識別システム、識別方法、照合装置及びプログラム | |
WO2016035774A1 (fr) | Procédé de détermination, système de détermination, dispositif de détermination, et programme associé | |
CN102099844B (zh) | 通过光学设备要被存储的意义单一的标签、生产该标签的方法及其在产品防伪和产品识别中的应用 | |
DE102018108741A1 (de) | Verfahren für optische Produktauthentifizierung | |
DE10155780A1 (de) | Verfahren und Anordnung zur Sicherung von Gegenständen gegen Fälschung und/oder Nachahmung, optional in Verbindung mit der Identifikation der ungefälschten Gegenstände | |
US11288471B2 (en) | Method for article authentication | |
EP3810432B1 (fr) | Procédé pour délivrer à un objet une marque unique | |
CN110533704B (zh) | 油墨标签的识别验伪方法、装置、设备及介质 | |
Chadha et al. | License plate recognition system using OpenCV & PyTesseract | |
CN108921006B (zh) | 手写签名图像真伪鉴别模型建立方法及真伪鉴别方法 | |
CN107808443A (zh) | 一种用于硬币或纪念章上的微结构防伪识别方法 | |
Rajkumar et al. | Digital image forgery detection using SIFT feature | |
CN111680549A (zh) | 一种纸纹识别方法 | |
Pollard et al. | Authentication of 3D printed parts using 3D physical signatures | |
EP4420017A1 (fr) | Authentification d'identifiants par diffusion de lumière | |
CN114663118B (zh) | 基于镭射随机组合图像的防伪方法 | |
Deb et al. | Automatic vehicle identification by plate recognition for intelligent transportation system applications | |
Khuspe et al. | Robust image forgery localization and recognition in copy-move using bag of features and SVM | |
US20230377115A1 (en) | Anti-tamper protection using dendrites | |
ES2968651T3 (es) | Un método para proporcionar a un objeto una marca única | |
KR102326254B1 (ko) | 패턴인식 기반 도장날인 유사도 판별 방법 및 시스템 | |
DE112021000421T5 (de) | Mechanisch eingepresste unverwechselbare merkmale zur echtheits- und herkunftsverfolgung | |
Hasan et al. | An Application of SURF Algorithm on JAKIM’s Halal Logo Detection |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
REG | Reference to a national code |
Ref country code: HR Ref legal event code: TUEP Ref document number: P20240083T Country of ref document: HR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20210114 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: MENDONCA DA SILVA GONCALVES, NUNO MIGUEL Inventor name: SANTOS PATRAO, BRUNO ANDRE Inventor name: MORAES VALLE CRUZ, LEANDRO Inventor name: DIAS BARATA, RICARDO JORGE Inventor name: DE ALMEIDA BARRETO, JOAO PEDRO Inventor name: FREIRE DUARTE, JOAO PEDRO Inventor name: PAULO MONTEIRO, RENATO Inventor name: FERREIRA SARAIVA DA MOUTA DIAS, JOAO PAULO Inventor name: CAVALEIRO RODRIGUES DE CARVALHO, ALBANO AUGUSTO |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20220131 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20230519 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: CAVALEIRO RODRIGUES DE CARVALHO, ALBANO AUGUSTO Inventor name: FERREIRA SARAIVA DA MOUTA DIAS, JOAO PAULO Inventor name: PAULO MONTEIRO, RENATO Inventor name: FREIRE DUARTE, JOAO PEDRO Inventor name: DE ALMEIDA BARRETO, JOAO PEDRO Inventor name: DIAS BARATA, RICARDO JORGE Inventor name: MORAES VALLE CRUZ, LEANDRO Inventor name: SANTOS PATRAO, BRUNO ANDRE Inventor name: MENDONCA DA SILVA GONCALVES, NUNO MIGUEL |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602019039625 Country of ref document: DE |
|
U01 | Request for unitary effect filed |
Effective date: 20231110 |
|
U07 | Unitary effect registered |
Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT SE SI Effective date: 20231124 |
|
REG | Reference to a national code |
Ref country code: NO Ref legal event code: T2 Effective date: 20231018 |
|
REG | Reference to a national code |
Ref country code: SK Ref legal event code: T3 Ref document number: E 43386 Country of ref document: SK |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240218 |
|
REG | Reference to a national code |
Ref country code: HR Ref legal event code: T1PR Ref document number: P20240083 Country of ref document: HR |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240218 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2968651 Country of ref document: ES Kind code of ref document: T3 Effective date: 20240513 |
|
REG | Reference to a national code |
Ref country code: HU Ref legal event code: AG4A Ref document number: E064941 Country of ref document: HU |
|
U20 | Renewal fee paid [unitary effect] |
Year of fee payment: 6 Effective date: 20240513 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IE Payment date: 20240619 Year of fee payment: 6 |
|
REG | Reference to a national code |
Ref country code: HR Ref legal event code: ODRP Ref document number: P20240083 Country of ref document: HR Payment date: 20240606 Year of fee payment: 6 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240621 Year of fee payment: 6 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: HR Payment date: 20240606 Year of fee payment: 6 Ref country code: RS Payment date: 20240611 Year of fee payment: 6 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602019039625 Country of ref document: DE |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CZ Payment date: 20240611 Year of fee payment: 6 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SK Payment date: 20240610 Year of fee payment: 6 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231018 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231018 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NO Payment date: 20240621 Year of fee payment: 6 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: PL Payment date: 20240607 Year of fee payment: 6 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: HU Payment date: 20240621 Year of fee payment: 6 |