EP2358601B1 - Verfahren zum ausrichten eines behälters und computerprogramm - Google Patents

Verfahren zum ausrichten eines behälters und computerprogramm Download PDF

Info

Publication number
EP2358601B1
EP2358601B1 EP09763831A EP09763831A EP2358601B1 EP 2358601 B1 EP2358601 B1 EP 2358601B1 EP 09763831 A EP09763831 A EP 09763831A EP 09763831 A EP09763831 A EP 09763831A EP 2358601 B1 EP2358601 B1 EP 2358601B1
Authority
EP
European Patent Office
Prior art keywords
container
image data
geometric
feature
search
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP09763831A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP2358601A1 (de
Inventor
Jürgen Hermann
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
KHS GmbH
Original Assignee
KHS GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by KHS GmbH filed Critical KHS GmbH
Priority to PL09763831T priority Critical patent/PL2358601T3/pl
Publication of EP2358601A1 publication Critical patent/EP2358601A1/de
Application granted granted Critical
Publication of EP2358601B1 publication Critical patent/EP2358601B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B65CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65CLABELLING OR TAGGING MACHINES, APPARATUS, OR PROCESSES
    • B65C9/00Details of labelling machines or apparatus
    • B65C9/06Devices for presenting articles in predetermined attitude or position at labelling station
    • B65C9/067Devices for presenting articles in predetermined attitude or position at labelling station for orienting articles having irregularities, e.g. holes, spots or markings, e.g. labels or imprints, the irregularities or markings being detected

Definitions

  • the present invention relates to a method for aligning a container. Furthermore, the present invention relates to a computer program for carrying out the method according to the invention. Such a procedure is over DE 20 2005 014456U1 or off IT M 120 072 267 A1 known.
  • the published patent application DE 10 2005 050 902 A1 a device for aligning containers with respect to at least one geometric container feature, comprising a conveyor with container receptacles for a respective container and along a transport path formed by the conveyor conveyor cameras of an image recognition system, wherein the image recognition system by comparison of the actual delivered by the cameras Image data with stored in an evaluation and control electronics target image data or characteristics causes the alignment of the container.
  • the containers are aligned by means of a geometric feature, for example by means of an embossment on the surface of the container.
  • an image is taken in the desired position of the bottle and then a respective distortion of this geometric feature is calculated for the cases in which the container is rotated by a certain angle from this desired position.
  • the images or image data thus generated are then stored as target image data and used.
  • an image of the container or of the bottle is then taken by means of a camera and the thus generated actual image is compared with the stored desired image data by means of an algorithm. It is determined with which image of the target image data is the highest match. Based on the rotation of the container or bottle deposited in the target image data for this image, it can then be rotated by the corresponding angle into the desired position.
  • a plurality of stages of such alignment processes may be provided in order to successively bring about the desired orientation or position of the container or the bottle.
  • a plurality of cameras at the same time take a picture of the bottle, which is then compared with the desired image data, wherein the alignment process is then carried out based on the best match.
  • a neural network is used, which has been taught beforehand in a learning process, what the geometric container feature used to align a container looks like in the different orientations of the container, and the one above it is able to recognize that in a search area the geometric container feature to be searched, the so-called search instance, does not exist.
  • an alignment process controlling control electronics is able to classify any other geometric container features or images in the search area to the effect that they do not represent the search instance by these so-called exclude instances are taught as such in advance.
  • control electronics in the context of the pattern identifier is able to discard certain recordings of the search area from the outset, since they do not contain the search instance.
  • pattern recognition takes place in that the control electronics classifies the actual image data on the basis of target image data as to whether they contain the geometric container feature.
  • the target image data in this case comprise the learned geometric container feature as a search entity and the further described above and also trained exclude instances.
  • the learning of the target image data takes place by first looking for the one located on a sample bottle geometric container feature, the search instance, recorded and stored.
  • the geometric container feature is then identified by a user, in particular based on its contour.
  • This training of the search entity can basically be done at the site of the procedure, ie. H. with the actually constructed filling and labeling, or off it, for example, in a laboratory.
  • the container or the bottle is rotated around itself in front of an image pickup device, with particular images of the container or the bottle being made in certain degree steps.
  • the multitude of degree steps depends in particular on how exactly the alignment should be performed during operation. If, for example, you want to align with 1 °, it is advisable to take the pictures in 1 ° increments, better in 0.5 ° increments.
  • the search instance is now cut out, if it is still found in the searched area, which can happen automatically, since the search instance has already been trained and the neural network is known.
  • the actual image data recorded by the image acquisition device is compared with the instances stored in the target image data and it is determined whether the search region contains an exclude entity or the search entity.
  • search area contains only one Exclude instance, this is displayed and the corresponding image is not used to calculate the actual position of the bottle.
  • the actual position of the container or its orientation is calculated on the basis of a perspective distortion of the geometric container feature, a known distance of the image recording device to the container during the recording and a known diameter of the container. From the difference between the actual position of the container to the desired desired position of the container, the degree and the direction in which the container is to be rotated can now be determined.
  • the present description also covers a computer program with program code to perform all the steps of a method according to the invention, when the program is executed on a computer or a corresponding computing unit.
  • the computer program may be stored on a computer-readable medium.
  • FIG. 1 shows a schematic view of an embodiment of a device according to the invention, on which the inventive method can be performed.
  • FIG. 1 shows a device 1, on which the method according to the invention can be carried out.
  • the device comprises a carousel 5, are transported into the container 2 via an inlet 3 and transported beyond a spout 4. From the labeling station 7, the containers 2 are aligned in the desired orientation for applying a label.
  • the first stage comprising the image pickup devices 8 and 9, the second stage the image pickup device 10, and the third stage the image pickup device 11.
  • Background elements 13, 14, 15 are provided for capturing high quality images. which can also be lit.
  • the alignment operation is controlled by an electronic control unit 12 which receives actual image data from the image pickup devices 8, 9, 10, 11 and can output control instructions to container receptacles 6 on which the containers 2 are arranged.
  • a learning process For commissioning and for the preparation of the alignment process, a learning process has to be carried out, in which first a search instance, ie a geometrical container feature used to align a container, is determined from a first image of a sample container identified a user and the search instance is so trained a neural network of the control electronics 12.
  • a search instance ie a geometrical container feature used to align a container
  • the corresponding target image data record can be called up by an operator. This is followed by a slow inlet of a first container or a first bottle, wherein the image recording devices 8, 9, 10, 11 are aligned so that they detect the possible positions of the search instance as accurately as possible.
  • a narrow optical evaluation range is a narrow optical evaluation range.
EP09763831A 2008-11-20 2009-11-11 Verfahren zum ausrichten eines behälters und computerprogramm Active EP2358601B1 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PL09763831T PL2358601T3 (pl) 2008-11-20 2009-11-11 Sposób ustawiania pojemnika i program komputerowy

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102008059229A DE102008059229A1 (de) 2008-11-20 2008-11-20 Verfahren zum Ausrichten eines Behälters
PCT/EP2009/008025 WO2010057592A1 (de) 2008-11-20 2009-11-11 Verfahren zum ausrichten eines behälters

Publications (2)

Publication Number Publication Date
EP2358601A1 EP2358601A1 (de) 2011-08-24
EP2358601B1 true EP2358601B1 (de) 2012-09-05

Family

ID=41682749

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09763831A Active EP2358601B1 (de) 2008-11-20 2009-11-11 Verfahren zum ausrichten eines behälters und computerprogramm

Country Status (6)

Country Link
EP (1) EP2358601B1 (pt)
CN (1) CN102216161B (pt)
BR (1) BRPI0916040B1 (pt)
DE (1) DE102008059229A1 (pt)
PL (1) PL2358601T3 (pt)
WO (1) WO2010057592A1 (pt)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2850559B1 (en) 2012-05-14 2021-02-24 Gauss Surgical, Inc. System and method for estimating a quantity of a blood component in a fluid canister
DE102013109384A1 (de) * 2013-08-29 2015-03-05 Krones Ag Vorrichtung und Verfahren zum Transport von Behältern in einer Getränkeabfüllanlage
CN107229291B (zh) * 2017-06-14 2020-09-15 苏州西斯派克检测科技有限公司 一种在线视觉定位系统的同步方法
DE102020112191A1 (de) 2020-05-06 2021-11-11 Krones Aktiengesellschaft Behälterbehandlungsmaschine und Verfahren zum Ausrichten eines Behälters in einer Behälteraufnahme einer Behälterbehandlungsmaschine
DE102021112479A1 (de) * 2021-05-12 2022-11-17 Espera-Werke Gmbh Verfahren zum Betrieb eines Etikettiersystems

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0624424A (ja) * 1992-07-02 1994-02-01 Kuwabara Yasunaga 容器向き位置合わせ方法
US6484478B1 (en) * 2000-01-24 2002-11-26 Illinois Tool Works Inc. System and method for packaging oriented containers
ITBO20020806A1 (it) * 2002-12-20 2004-06-21 Azionaria Costruzioni Acma Spa Macchina etichettatrice e/o marcatrice
DE102005041497A1 (de) * 2005-09-01 2007-03-08 Stratec Control-Systems Gmbh Verfahren und Vorrichtung zur Erkennung der Drehausrichtung von Behältern
DE202005014456U1 (de) * 2005-09-12 2007-02-01 Krones Ag Vorrichtung zum Ausrichten von Behältern
DE102005050902A1 (de) 2005-10-21 2007-05-03 Khs Ag Vorrichtung zum Ausrichten von Behältern sowie Etikettiermaschine mit einer solchen Vorrichtung
DE102006026618A1 (de) * 2006-09-02 2008-03-13 Khs Ag Verfahren zum lagegenauen Aufbringen von Etiketten sowie Etikettiermaschine
ITBO20060847A1 (it) * 2006-12-12 2008-06-13 Adriano Fusco Sistema per rilevare e ottimizzare il posizionamento angolare di contenitori in transito continuo
ITMI20072267A1 (it) * 2007-12-03 2009-06-04 Sidel Holdings & Technology Sa Sistema di rilevazione e orientamento angolare di contenitori in macchine etichettatrici

Also Published As

Publication number Publication date
PL2358601T3 (pl) 2013-02-28
BRPI0916040A2 (pt) 2015-11-10
DE102008059229A1 (de) 2010-06-02
EP2358601A1 (de) 2011-08-24
CN102216161A (zh) 2011-10-12
BRPI0916040B1 (pt) 2019-10-22
WO2010057592A1 (de) 2010-05-27
CN102216161B (zh) 2015-02-25

Similar Documents

Publication Publication Date Title
EP1777163B1 (de) Vorrichtung zum Ausrichten von Behältern
DE102012110376B4 (de) Verfahren und Vorrichtung zum Ordnen von Codekandidaten in einem Bild für Dekodierversuche
EP1717573B1 (de) Verfahren zur automatischen Fehlererkennung in Prüfteilen mittels einer Röntgenprüfanlage
EP2358601B1 (de) Verfahren zum ausrichten eines behälters und computerprogramm
DE102018212531B4 (de) Artikeltransfervorrichtung
WO2019007632A1 (de) Bildauswertung mit zielgerichteter vorverarbeitung
DE3212432A1 (de) Inspektions- und sortiereinrichtung und -verfahren
DE102006017337A1 (de) Verfahren zur optischen Erfassung von bewegten Objekten und Vorrichtung
DE112020003158T5 (de) Trainingsverfahren für ein Zielerfassungsmodell, Verfahren und Vorrichtung zur Kennzeichnung der Daten
DE202005017180U1 (de) Vorrichtung zum Ausrichten von Behältern sowie Etikettiermaschine mit einer solchen Vorrichtung
EP2787485B1 (de) Verfahren und Vorrichtung zur automatischen Fehlerstellenerkennung bei biegeschlaffen Körpern
WO2019238477A1 (de) Verfahren zum untersuchen von übereinstimmenden prüfobjekten
DE102019211672A1 (de) Trainingsverfahren für ein künstliches neuronales Netzwerk
EP4147101A1 (de) Behälterbehandlungsmaschine und verfahren zum ausrichten eines behälters in einer behälteraufnahme einer behälterbehandlungsmaschine
WO2022069702A1 (de) Verfahren, computerprogrammprodukt, und vorrichtung mit einem solchen produkt zum aufzeigen des einflusses von schneidparametern auf eine schnittkante
DE102021203559A1 (de) Verfahren zur Erkennung einer Identifikationsnummer
EP1139285B1 (de) Verfahren und Vorrichtung zur Prüfung bzw. Untersuchung von Gegenständen
DE10024559B4 (de) Verfahren zur Erkennung von Objekten
DE102013209800A1 (de) Verfahren zur Parametrierung eines Bildverarbeitungssystems für die Überwachung einer Werkzeugmaschine
DE102012211734A1 (de) Verfahren und Vorrichtung zum Erfassen der Lage eines Objekts in einer Werkzeugmaschine
AT511399B1 (de) Verfahren zur automatisierten klassifikation von einschlüssen
EP3678868B1 (de) Direktdruckvorrichtung zum aufbringen eines umlaufenden druckbildes
EP4141805A1 (de) Verfahren zum erzeugen, automatisierten annotieren und bereitstellen von trainings-bilddaten
EP4350539A1 (de) Verfahren und system zum automatischen bildbasierten erkennen einer identifikationsinformation an einem objekt
DE102011078286A1 (de) Verfahren und Vorrichtung zur mechanischen Bearbeitung von reihenförmig angeordneten Objekten

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20110620

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 573996

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120915

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502009004642

Country of ref document: DE

Effective date: 20121031

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20120905

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121205

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

Effective date: 20120905

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121206

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

REG Reference to a national code

Ref country code: PL

Ref legal event code: T3

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130105

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

BERE Be: lapsed

Owner name: KHS G.M.B.H.

Effective date: 20121130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130107

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121205

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

26N No opposition filed

Effective date: 20130606

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121130

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502009004642

Country of ref document: DE

Effective date: 20130606

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121216

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121130

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121111

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20131130

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20131130

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20091111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120905

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PL

Payment date: 20171023

Year of fee payment: 9

Ref country code: AT

Payment date: 20171121

Year of fee payment: 9

Ref country code: GB

Payment date: 20171123

Year of fee payment: 9

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 573996

Country of ref document: AT

Kind code of ref document: T

Effective date: 20181111

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20181111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181111

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20231124

Year of fee payment: 15

Ref country code: FR

Payment date: 20231120

Year of fee payment: 15

Ref country code: DE

Payment date: 20231121

Year of fee payment: 15