EP3882032B1 - Contrôle de feuilles par ajustement global de la luminosité - Google Patents

Contrôle de feuilles par ajustement global de la luminosité Download PDF

Info

Publication number
EP3882032B1
EP3882032B1 EP20164387.1A EP20164387A EP3882032B1 EP 3882032 B1 EP3882032 B1 EP 3882032B1 EP 20164387 A EP20164387 A EP 20164387A EP 3882032 B1 EP3882032 B1 EP 3882032B1
Authority
EP
European Patent Office
Prior art keywords
image
paper white
printed
computer
digital
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP20164387.1A
Other languages
German (de)
English (en)
Other versions
EP3882032A1 (fr
Inventor
Bennet Carstensen
Peter Eisele
Jan Krieger
Hendrik Schmedt
Frank Schumann
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Heidelberger Druckmaschinen AG
Original Assignee
Heidelberger Druckmaschinen AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Heidelberger Druckmaschinen AG filed Critical Heidelberger Druckmaschinen AG
Priority to EP20164387.1A priority Critical patent/EP3882032B1/fr
Priority to CN202110302366.4A priority patent/CN113492580B/zh
Publication of EP3882032A1 publication Critical patent/EP3882032A1/fr
Application granted granted Critical
Publication of EP3882032B1 publication Critical patent/EP3882032B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
    • B41F—PRINTING MACHINES OR PRESSES
    • B41F33/00—Indicating, counting, warning, control or safety devices
    • B41F33/0036—Devices for scanning or checking the printed matter for quality control

Definitions

  • the present invention relates to a method for image inspection of printed products with automated brightness compensation.
  • the invention lies in the technical field of print quality control.
  • inline means that the image acquisition system, more precisely the camera of the image acquisition system, is installed in the printing press. It is usually installed after the last printing unit or, if present, after a further post-processing station, such as a varnishing unit, and records the printed products produced by the printing press. It can be a camera or a camera system with multiple cameras. The use of other image sensors is also possible. For the sake of simplicity, however, the term "camera” is used below. The digital print images generated in this way by means of the camera are then compared in an image processing computer with corresponding good images of the print subject.
  • the image acquisition system depends on the transported print substrate being transported past the camera of the image acquisition system as smoothly and evenly as possible. This is particularly challenging with sheetfed presses. Because air turbulence and other effects during sheet transport can lead to small deformations on the printing cylinder of the printing press during image recording. These deformations become noticeable through the changing distance from the surface of the sheet to the camera, both through geometric distortions and through fluctuations in brightness. Since these deviations are of course not present in the digital reference, they are classified as printing errors when the captured, recorded print image is compared with the digital reference.
  • German patent application 10 2019 204551.0 discloses a method for image inspection of printed products of a machine processing printing materials using a computer, with the printed products produced being recorded and digitized by means of at least one image sensor as part of the image inspection by an image acquisition system , the recorded, digital print images created in this way are compared by the computer with a digital reference image and, in the event of deviations in the recorded, digital print images from the digital reference image, the printed products that have been recognized as incorrect are ejected, which is characterized in that the computer reads the digital print and Divides reference images into sub-images and compensates for differences in brightness between the sub-images.
  • This problem is solved by a method for image inspection of printed products in a machine processing printing materials using a computer, with the printed products produced being recorded and digitized by means of at least one image sensor as part of the image inspection by an image recording system, and the digital print images that are recorded in this way are recorded by the computer are compared with a digital reference image and, in the event of discrepancies between the recorded digital print images and the digital reference image, the incorrectly recognized printed products are ejected, which is characterized in that the computer separates areas with paper white for print and reference images and determines their color values and based on the differences between these two color values, compensates for differences in brightness between print and reference images. Color values here mean the color value of the respective paper white.
  • the paper white is already known from the pre-press stage, since the print substrate to be used is part of the print job data. By determining a corresponding value for the real paper white of the printed image and comparing it with the target value, a corresponding difference in brightness can be determined and compensated for.
  • the target value for the paper white logically corresponds to the paper white of the reference image with which the recorded print image is compared as part of the image inspection. This target value is therefore identical to the paper white known from prepress, since the reference image was created either as a good image from the prepress data.
  • the good image can also be taught from actually printed print images, with only print images generated without printing errors and with paper white that is as realistic as possible being used during the teach-in process. In In this case, the paper white of the reference image may deviate slightly from the paper white of the prepress data.
  • a preferred further development of the method according to the invention is that the brightness of the print or the reference image is adjusted to compensate for the differences in brightness between the print and reference images. It is of secondary importance whether the brightness of the printed image or the reference image is adjusted, as long as the difference in brightness is compensated for before the two images are compared.
  • a decision criterion could e.g. B. that one always brightens the respective darker image or vice versa darkens the brighter image. Or you can simplify the algorithm by specifying a corresponding image, print or reference image, as the image to be adjusted from the outset.
  • a further preferred development of the method according to the invention is that the computer checks the standard deviation in the paper white in the recorded print image in order to rule out color spatters in the paper white inadmissibly changing the color value of the paper white. Paint splashes would falsify the determined color value of the respective area with paper white and thus lead to an incorrect brightness value, which in turn negatively influences the method according to the invention with regard to the adjustment of the brightness difference or even makes it completely unusable. It must therefore be ruled out that there are ink spatters in the paper white, and this is done by checking the standard deviation in the paper white in the printed image accordingly.
  • a further preferred development of the method according to the invention is that the computer determines the color value of the paper white by calculating the mean value or the median of all separated paper white areas.
  • the easiest way to proceed is to simply calculate the mean value of the color values of all separated paper white areas and for each captured digitized print image and the Compare reference or good image with each other.
  • the median value if e.g. B. too many splashes of color in the paper white area in the recorded print image would change the mean value.
  • Other calculation approaches for the paper white are also conceivable, such as B. to always accept the darkest or the lightest value in the separated paper white area.
  • a further preferred development of the method according to the invention is that the comparison of the recorded, digital print images with a digital reference image takes place by the computer for image inspection by creating and evaluating a difference image between the respective recorded, digital print image with the digital reference image.
  • Several approaches are possible for comparing the recorded print images with the digital reference/good image. However, since procedures such as For example, if the adjustment from pixel to pixel is relatively laborious and expensive, the method using the formation of a difference image is preferred. Ideally, if both images are identical, this difference image is simply black, i.e. the color values are zero.
  • the difference image also has the advantage that it can be formed relatively easily from the recorded print image and reference image using a matrix operation.
  • a further preferred development of the method according to the invention is that the separation of the paper white is carried out by the computer using a threshold value method, with all areas in the image that are darker than the paper white being masked out. After this operation, the corresponding image only has color values in areas that correspond to the white of the paper or are lighter. All other areas are black or have the color value zero.
  • a further preferred development of the method according to the invention is that a predetermined paper white value from the prepress stage is used as the threshold value for the paper white.
  • a predetermined paper white value from the prepress stage is used as the threshold value for the paper white.
  • the predefined threshold value can also be lower than the paper white value to be expected. In the case of creation by teach-in, the default value should be at least similar.
  • a further preferred development of the method according to the invention is that the threshold value method is applied to the digital reference image, as a result of which a digital mask is created with which the paper white areas of the respective recorded digital print image are separated. i.e. one applies the thresholding method to the digital reference image and then obtains an image in which only the white areas of the paper have color values above zero, while the rest is correspondingly zero. If you place this image, which corresponds to a bit mask or a digital mask, over the captured digital print image or multiplies it with it, all areas of the print image that are not in the paper white area are hidden in the captured digital print image or set to zero set.
  • a further preferred development of the method according to the invention is that the paper white is separated and its color values are determined by the computer by declaring a predetermined area of the printed product to be inspected as the paper white area, in which the color values of the paper white are then determined. If, for any reason, the process of separating the white areas of the paper using a threshold value and a mask created in this way from the reference image is not possible or is too complex, the reference or good image can also be analyzed in the preliminary stage and the area can thus be determined directly from the print image data and used for the method according to the invention. It is even easier if the paper white area is known without analysis. For example, if the existing print image data of the print job contains an area that always remains unprinted, e.g. B. at the edge of the print substrate. This fixed and clearly defined area can then be used to determine the respective paper white value.
  • a further preferred development of the method according to the invention is that before the separation of the paper white for the recorded, digital print images, these are digitally corrected by the computer.
  • a number of algorithms are known from the prior art, with which distortions or deformations of the recorded digital printed image can be compensated. The additional use of these algorithms naturally facilitates the method according to the invention, since not all deformations of the sheet can be covered, recognized and treated by means of the brightness compensation. Furthermore, these algorithms or methods for rectifying the print image usually cannot completely correct the rectification either, so that the method according to the invention becomes even more efficient in combination with these known methods.
  • figure 1 shows an example of an image acquisition system 2 which uses the method according to the invention. It consists of at least one image sensor 5, usually a camera 5, which is integrated into the sheet-fed printing press 4. The at least one camera 5 records the print images generated by the printing machine 4 and sends the data to a computer 3, 6 for evaluation.
  • This computer 3, 6 can be its own separate computer 6, for example one or more specialized image processing computers 6, or it can be identical to the control computer 3 of the printing press 4.
  • At least the control computer 3 of the printing machine 4 has a display 7 on which the results of the image inspection are shown.
  • the process according to the invention itself is shown schematically in terms of its sequence in figure 1 shown in a preferred embodiment.
  • the computer compares a reference image from prepress and a print image recorded by a camera.
  • the method presented here provides for the brightness of the entire sheet to be adjusted in such a way that it optimally matches the reference image and camera image.
  • a mean value for brightness is formed over all paper white areas of the recorded sheet and the reference image. If both mean values deviate from each other, the brightness of the reference image should be changed in such a way that the mean value of the white areas of the paper is the same.
  • An important point is the reliable identification of paper white areas.
  • all printed areas in the reference image are identified using a threshold value method. All areas in the image that are darker than paper white do not belong to paper white. A mask is created in this way, which is also placed over the camera image after the rectification of the camera image. The areas that remain are then logically paper white.
  • Air turbulence and other effects can lead to small sheet deformations on the impression cylinder of the printing machine during image recording. These deformations go through both geometric distortions and Brightness fluctuations noticeable, as exemplified in figure 2 shown in the oval obscuration in the center of the image.
  • the aim of the new method is to align the global brightness values of the reference image and the camera image in order to avoid pseudo errors caused by small arc deformations.
  • the paper white values must be determined in the reference image and in the camera image and then the brightness values must be adjusted.
  • the paper white of the reference image is always set to a defined value in prepress.
  • the value 243 Ie the paper white mean value in the reference image is 243. All values ⁇ 243 form the subject and can be removed from the reference image using a threshold value method. The resulting image shows in the form of a digital mask figure 6 .

Claims (10)

  1. Procédé d'inspection d'image de produits imprimés dans une machine de traitement de supports d'impression au moyen d'un ordinateur, pour lequel, dans le cadre de l'inspection d'image par un système d'enregistrement d'image, les produits imprimés produits sont enregistrés et numérisés au moyen d'au moins un capteur d'image, les images d'impression numériques enregistrées ainsi obtenues sont comparées par l'ordinateur à une image de référence numérique et, en cas de divergences des images d'impression numériques enregistrées par rapport à l'image de référence numérique, les produits d'impression détectés défectueux sont éliminés,
    caractérisé en ce
    que l'ordinateur sépare respectivement, pour les images d'impression et de référence, des zones avec du blanc de papier et en détermine les valeurs de couleur et, sur la base des différences entre ces deux valeurs de couleur, compense les différences de luminosité entre les images d'impression et de référence.
  2. Procédé selon la revendication 1,
    caractérisé en ce
    que, pour la compensation des différences de luminosité entre les images d'impression et les images de référence, la luminosité de l'image d'impression ou de l'image de référence est adaptée.
  3. Procédé selon l'une des revendications précédentes,
    caractérisé en ce
    que l'ordinateur vérifie l'écart type dans le blanc du papier dans l'image d'impression enregistrée, afin d'exclure que des éclaboussures d'encre dans le blanc du papier ne modifient de manière inadmissible la valeur de couleur du blanc du papier.
  4. Procédé selon l'une des revendications précédentes,
    caractérisé en ce
    que l'ordinateur détermine la valeur de couleur du blanc du papier en calculant la valeur moyenne ou la moyenne de toutes les zones de blanc du papier séparées.
  5. Procédé selon l'une des revendications précédentes,
    caractérisé en ce
    que la comparaison des images d'impression numériques enregistrées avec une image de référence numérique est effectuée par l'ordinateur pour l'inspection d'image par création et évaluation d'une image différentielle entre l'image d'impression numérique respective enregistrée et l'image de référence numérique.
  6. Procédé selon l'une des revendications précédentes,
    caractérisé en ce
    que la séparation du blanc du papier est effectuée par l'ordinateur selon un procédé basé sur des valeurs seuils, toutes les zones de l'image qui sont plus sombres que le blanc du papier étant masquées.
  7. Procédé selon la revendication 6,
    caractérisé en ce
    que l'on utilise comme valeur seuil pour le blanc du papier une valeur de blanc du papier prédéfinie, provenant du prépresse.
  8. Procédé selon la revendication 6 ou la revendication 7,
    caractérisé en ce
    que le procédé basé sur des valeurs seuils est appliqué à l'image numérique de référence, ce qui permet d'obtenir un masque numérique avec lequel les zones de blanc du papier de l'image d'impression numérique respective détectée sont séparées.
  9. Procédé selon l'une des revendications précédentes 1 à 5,
    caractérisé en ce
    que la séparation du blanc de papier et la détermination de ses valeurs de couleur sont effectuées par l'ordinateur, en déclarant une zone prédéfinie du produit imprimé à inspecter comme zone de blanc de papier, dans laquelle les valeurs de couleur du blanc de papier sont ensuite déterminées.
  10. Procédé selon l'une des revendications précédentes,
    caractérisé en ce
    qu'avant la séparation du blanc de papier pour les images d'impression numériques enregistrées, celles-ci sont rectifiées numériquement par l'ordinateur.
EP20164387.1A 2020-03-20 2020-03-20 Contrôle de feuilles par ajustement global de la luminosité Active EP3882032B1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP20164387.1A EP3882032B1 (fr) 2020-03-20 2020-03-20 Contrôle de feuilles par ajustement global de la luminosité
CN202110302366.4A CN113492580B (zh) 2020-03-20 2021-03-22 采用全局亮度适配方式的页张检查方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP20164387.1A EP3882032B1 (fr) 2020-03-20 2020-03-20 Contrôle de feuilles par ajustement global de la luminosité

Publications (2)

Publication Number Publication Date
EP3882032A1 EP3882032A1 (fr) 2021-09-22
EP3882032B1 true EP3882032B1 (fr) 2022-03-30

Family

ID=69941165

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20164387.1A Active EP3882032B1 (fr) 2020-03-20 2020-03-20 Contrôle de feuilles par ajustement global de la luminosité

Country Status (2)

Country Link
EP (1) EP3882032B1 (fr)
CN (1) CN113492580B (fr)

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003270164A (ja) * 2002-03-19 2003-09-25 Dainippon Printing Co Ltd 印刷物色調監視装置
DE102004021601B4 (de) * 2004-05-03 2020-10-22 Heidelberger Druckmaschinen Ag Inline-Messung und Regelung bei Druckmaschinen
DE102007052785A1 (de) * 2007-11-06 2009-05-07 Manroland Ag Verfahren zum Messen der Farbgebung eines bedruckten Bedruckstoffs innerhalb einer Druckmaschine
DE102010031533B4 (de) * 2010-07-19 2012-05-10 Tobias Huneke Verfahren zur Überprüfung der Druckresultate eines Druckers
DE102016224307A1 (de) * 2015-12-15 2017-06-22 Heidelberger Druckmaschinen Ag Verfahren zur Überprüfung eines Bildinspektionssystems
JP2018054462A (ja) * 2016-09-29 2018-04-05 セイコーエプソン株式会社 測定装置、及び測定方法
JP6797716B2 (ja) * 2017-02-28 2020-12-09 キヤノン株式会社 画像処理装置および画像処理方法
DE102018201794B3 (de) 2018-02-06 2019-04-11 Heidelberger Druckmaschinen Ag Adaptive Bildglättung
CN110293753B (zh) * 2018-03-22 2021-07-23 海德堡印刷机械股份公司 借助计算机对印刷产品进行图像检测的方法

Also Published As

Publication number Publication date
CN113492580A (zh) 2021-10-12
EP3882032A1 (fr) 2021-09-22
CN113492580B (zh) 2023-01-24

Similar Documents

Publication Publication Date Title
DE102018201794B3 (de) Adaptive Bildglättung
EP1728380B1 (fr) Procede d'identification precoce d'un ecart dans des images imprimees produites en continu par une presse d'impression
DE102006056858B4 (de) Verfahren zum Überprüfen der Druckqualität
DE112015003903B4 (de) Gerät zum Prüfen von Druckerzeugnissen, Verfahren zum Prüfen von Druckerzeugnissen und Programm
WO2005104034A1 (fr) Procede pour evaluer la qualite d'un imprime produit par une machine d'impression
DE102019202290A1 (de) Bildinspektion mit lokaler Bildentzerrung
DE102017216260A1 (de) Bildinspektion von Druckerzeugnissen mit Fehlerklassen
DE102016203392B3 (de) Bildinspektionsverfahren mit mehreren Kameras
EP3878653A1 (fr) Inspection comprenant une classification d'erreurs
EP3656561B1 (fr) Correction d'image rapide pour l'inspection d'image
AT501210B1 (de) Verfahren zur qualitätskontrolle an oberflächenvariablen drucksachen
DE112017007226T5 (de) Steuervorrichtung und inspektionsvorrichtung
EP3680106B1 (fr) Détection de moyenne en nombre mn dans l'image d'impression
EP3882032B1 (fr) Contrôle de feuilles par ajustement global de la luminosité
EP1727679A2 (fr) Procede d'identification d'un exemplaire individuel a image imprimee de qualite defectueuse sur une matiere imprimee comportant plusieurs exemplaires
DE102019208257A1 (de) Druckqualitätsanalyse mit neuronalen Netzen
DE102018220524A1 (de) Verfahren zur Detektion ausgefallener Druckdüsen in einer Inkjet-Druckmaschine
EP3871892B1 (fr) Détection pour minimiser les déchets
EP3628489B1 (fr) Mesure de registre sans marque
EP3715126B1 (fr) Compensation de couleurs dans l'impression offset
DE102018201785B3 (de) Gestauchtes Druckbild
EP0522301A1 (fr) Procédé de surveillance et de réglage du processus d'impression, en particulier dans les machines à imprimer en offset
DE102018217476A1 (de) Variable Druckdüsentestmuster
EP3516634B1 (fr) Procédé et dispositif de détection dégradations de couleurs sur un billet de banque, ainsi que système de traitement de documents de valeur
EP3865304B1 (fr) Vérification d'image déterministe

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200916

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: B41F 33/00 20060101AFI20211027BHEP

INTG Intention to grant announced

Effective date: 20211119

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1478824

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220415

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502020000855

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220630

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220630

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20220330

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220701

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220801

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220730

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502020000855

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20230103

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230322

Year of fee payment: 4

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230427

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220330

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20230331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230320

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230320

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240331

Year of fee payment: 5

Ref country code: GB

Payment date: 20240320

Year of fee payment: 5

Ref country code: GB

Payment date: 20240320

Year of fee payment: 4