EP2610781A2 - Système de reconnaissance de cylindre - Google Patents

Système de reconnaissance de cylindre Download PDF

Info

Publication number
EP2610781A2
EP2610781A2 EP12199372.9A EP12199372A EP2610781A2 EP 2610781 A2 EP2610781 A2 EP 2610781A2 EP 12199372 A EP12199372 A EP 12199372A EP 2610781 A2 EP2610781 A2 EP 2610781A2
Authority
EP
European Patent Office
Prior art keywords
cylinder
cylinders
filling
conveyed
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP12199372.9A
Other languages
German (de)
English (en)
Other versions
EP2610781B1 (fr
EP2610781A3 (fr
Inventor
Ali Kizilkaya
Emrah Isbilen
Onur Azak
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aygaz AS
Original Assignee
Aygaz AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aygaz AS filed Critical Aygaz AS
Publication of EP2610781A2 publication Critical patent/EP2610781A2/fr
Publication of EP2610781A3 publication Critical patent/EP2610781A3/fr
Application granted granted Critical
Publication of EP2610781B1 publication Critical patent/EP2610781B1/fr
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B07—SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07C—POSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00—Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/04—Sorting according to size
    • B07C5/12—Sorting according to size characterised by the application to particular articles, not otherwise provided for
    • B07C5/122—Sorting according to size characterised by the application to particular articles, not otherwise provided for for bottles, ampoules, jars and other glassware
    • B07C5/126—Sorting according to size characterised by the application to particular articles, not otherwise provided for for bottles, ampoules, jars and other glassware by means of photo-electric sensors, e.g. according to colour
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B07—SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07C—POSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00—Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/34—Sorting according to other particular properties
    • B07C5/3404—Sorting according to other particular properties according to properties of containers or receptacles, e.g. rigidity, leaks, fill-level
    • B07C5/3408—Sorting according to other particular properties according to properties of containers or receptacles, e.g. rigidity, leaks, fill-level for bottles, jars or other glassware
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B07—SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07C—POSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00—Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/34—Sorting according to other particular properties
    • B07C5/3412—Sorting according to other particular properties according to a code applied to the object which indicates a property of the object, e.g. quality class, contents or incorrect indication
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17—STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17C—VESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2205/00—Vessel construction, in particular mounting arrangements, attachments or identifications means
    • F17C2205/05—Vessel or content identifications, e.g. labels
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17—STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17C—VESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2221/00—Handled fluid, in particular type of fluid
    • F17C2221/03—Mixtures
    • F17C2221/032—Hydrocarbons
    • F17C2221/035—Propane butane, e.g. LPG, GPL
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17—STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17C—VESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2223/00—Handled fluid before transfer, i.e. state of fluid when stored in the vessel or before transfer from the vessel
    • F17C2223/01—Handled fluid before transfer, i.e. state of fluid when stored in the vessel or before transfer from the vessel characterised by the phase
    • F17C2223/0146—Two-phase
    • F17C2223/0153—Liquefied gas, e.g. LPG, GPL
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17—STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17C—VESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2223/00—Handled fluid before transfer, i.e. state of fluid when stored in the vessel or before transfer from the vessel
    • F17C2223/03—Handled fluid before transfer, i.e. state of fluid when stored in the vessel or before transfer from the vessel characterised by the pressure level
    • F17C2223/033—Small pressure, e.g. for liquefied gas
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17—STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17C—VESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2250/00—Accessories; Control means; Indicating, measuring or monitoring of parameters
    • F17C2250/03—Control means
    • F17C2250/032—Control means using computers
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17—STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17C—VESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2250/00—Accessories; Control means; Indicating, measuring or monitoring of parameters
    • F17C2250/03—Control means
    • F17C2250/038—Control means using cameras
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17—STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17C—VESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2270/00—Applications
    • F17C2270/07—Applications for household use
    • F17C2270/0745—Gas bottles

Definitions

  • This invention relates to a cylinder recognition system, identifying the type of a cylinder prior to a filling process by means of a camera using artificial vision technology and allowing conveying a single type of cylinder to a filling line.
  • a cylinder filling process in LPG filling stations is performed by authorized personnel by manually adjusting a filling balance according to the tare of a cylinder to be filled.
  • Cylinders designed in various shapes, e.g. with narrow or wide grips, with long or short collars, with wide or narrow lower circles, according to the need of clients, are identified visually by authorized personnel and the tare of the respective type of cylinder is determined accordingly.
  • the German patent document DE19816881 discloses classifying materials on a line by scanning the materials using a line laser light source. Said invention primarily analyses the light returned from objects on a line by means of spectroscopy (different wavelengths in returned light are detected) and differentiates the objects accordingly.
  • the cylinder recognition system according to the present invention operates by analysing a 2 dimensional image of objects, as a result of capturing an image of a field, in place of scanning a one dimensional line. Additionally, by making use of the differences in contrast and color in the image captured by a camera, the sizes of figures in the image are defined based on pixels, so that the cylinders (objects) are identified by comparing the areas of the figures in the image to the size of previously determined figures. By virtue of this method, devices such as a multi-anode photon multiplier and a toroidal mirror in said patent are not required.
  • the UK patent document GB 1354993 refers to an invention used for identifying certain figures, i.e. numbers or letters, by means of a photoelectric converter. Even if there is a general similarity between that document and the aim of the cylinder recognition system according to the present invention, e.g. identifying some figures, the technique used by these two methods to achieve this object is quite different.
  • a cylinder recognition system the image of a cylinder is captured by a camera in an entirely digital medium, and then the process is proceeded through this image to determine the compliance of a cylinder of which the image is captured.
  • the image captured by the camera is subjected to digital image processing, the contrast difference in the image is determined, the pixel areas occupied by the physical shape of the cylinder in the captured image is established and finally the type of the cylinder is identified.
  • no method is used for capturing images in a digital medium and for processing the same; said invention is based completely on analog signals.
  • the photoelectric converter, electron beam, focusing coils used to enlarge the image, electrical analog logic circuits etc. used in that patent are not used in the cylinder recognition system according to the present invention.
  • the operation logic of said patent comprises the scanning of a field, enlarging any figures detected during the scanning process and focusing on these points, and then identifying these figures by means of electrical signals.
  • the object of this invention is to provide a cylinder recognition system capable of preventing in advance any operator faults in the classification of cylinders to be filled.
  • Another object of this invention is to provide a cylinder recognition system capable of identifying a cylinder type using a pixel area on a camera image.
  • Figure 1 is a schematic illustration of a cylinder recognition system.
  • a cylinder recognition system (1) according to the present invention comprises
  • All cylinders to be filled are checked by the operator and classified according to their types prior to filling. If an operator fault is made during this check made around every 2 seconds as the line is proceeding, overfilled or underfilled LPG cylinders are delivered to the clients, this in turn leads to additional labor and product costs, customer dissatisfaction, and most significantly, the problems associated with the delivery of overfilled cylinders.
  • the system (1) is designed to be assembled on a conveyor line and is adapted to the conditions of explosive-inflammable environments. Cylinders which are successively conveyed on the conveyor line are first stopped by the primary stopper (3).
  • the stopper (3) is kept open by means of the primary photocell (2) placed in front of the stopper (3) during a time interval in which only a single cylinder can be passed, such that the cylinders are entered into the recognition cabin one by one.
  • a cylinder entering into the storage cabin (4) illuminated by an illuminator (8) is detected by means of a secondary photocell (5) when it comes below the camera (7), and is stopped by means of a specifically-designed cylinder centering stopper (6) just below the camera (7).
  • the image of the cylinder is captured by the camera (7); and the upper ring diameter and the collar size of the cylinder are determined by the control unit (13). If the cylinder conveyed to filling is not of the type determined by the operator, the control unit (13) does not allow the cylinder to be conveyed to filling and deflects the cylinder from the line by means of the deflecting piston (10).
  • the operator display (14) allows both to select the type of cylinder and displays the whole process, the number of cylinders deflected and conveyed to filling.
  • the image of cylinders captured by the camera (7) is necessary to identify the type of cylinders, so when the camera is absent, the cylinder recognition system (1) will not work.
  • the numbers of cylinders deflected and conveyed to filling and the selection of the type of cylinder intended for filling by the user is checked on the operator display (14). If this display is removed from the system (1), another method must be used to select the type of cylinders.
  • the control unit (13) comprises a PLC control system which enables to deflect the cylinders which are not intended for filling from the filling line. When the control unit (13) is lacking, these cylinders cannot be deflected from the line.
  • the cylinder deflecting piston (10) enables to deflect a cylinder not to be filled from the line with a command received from the control unit. If it is lacking, the cylinders cannot be deflected from the line. Since the stoppers (3, 6) and photocells (2, 5, 9) control the flow and order of the cylinders on the line, their absence will cause an error in the system.
  • the identification of cylinders is entirely performed by the camera (7), and it is not dependent on a data to be received from a human or from a barcode or label applied to the cylinder.
  • all types of cylinders of which the sizes are entered to the control unit (13), can be detected, such that only those cylinders intended for filling are filled. Additionally, extra costs and labor of a label or barcode applied to cylinders will be avoided.
  • the system (1) is PLC controlled, it allows to monitor the deflected cylinders and to keep statistical data electronically on the filling process.
  • the system (1) is designed to identify cylinders of differing designs.
  • a cylinder to be filled is first selected by the operator on the operator display (14).
  • the operator display (14) is taken into a panel with keypads in order to comply with the conditions of inflammable and explosive environments.
  • Cylinders proceeded successively to filling on the conveyor line are detected by photocells (2, 5, 9).
  • the control unit (13) warned by the photocells (2, 5, 9) - that a cylinder is conveyed to a filling unit, opens the primary stopper (3) and lets one cylinder to pass.
  • the control unit (13) closes the stopper (3) so that the cylinders are entered to the storage cabin (4) one by one.
  • the entrance of cylinder to the storage cabin (4) which is aimed to isolate the camera (7) therein from external lights is detected by the secondary photocell (5).
  • the control unit (13) transmits an electrical signal to close the centering stopper (6) which normally is open.
  • the centering stopper (6) disposed on both sides of the conveyor are provided semilunar metal plates specifically produced according to the form of cylinders. When the centering stopper (6) is closed, the respective cylinder is stopped just below the camera (7) for a short time.
  • control unit (13) When the control unit (13) detects that the cylinder is below the camera (7), it signalizes the camera (7) and illuminator (8) so that the image of the cylinder is captured. Meanwhile, the centering stopper (6) plates surrounding the cylinder make up a fixed background for the image to be taken by the camera (7).
  • the control unit (13) makes use of color and contrast differences within the image captured by the camera (7) and calculates the cylinder diameter, the collar size, and the pixel area occupied by the upper ring (grip). This area is compared to the pixel area occupied by different type of cylinders previously introduced to the control unit (13). The type of cylinders is determined as a result of this comparison.
  • the control unit (13) compares the type of the cylinder previously entered by the operator to the operator display (14) and the type identified by the camera (7), and according to the result of this comparison, the cylinder is conveyed either to the filling line (11) or to the deflected cylinder line (12).
  • a warning is transmitted to the deflecting piston (10) so that the cylinder is guided to the deflected cylinder line (12).
  • the control unit (13) incorporates a PLC unit managing the cylinder identifying process, solenoid valves used for controlling the piston movements, pressure switches, and photocell amplifiers.

Landscapes

  • Filling Or Discharging Of Gas Storage Vessels (AREA)
  • Length Measuring Devices By Optical Means (AREA)
EP12199372.9A 2011-12-28 2012-12-25 Système de reconnaissance de cylindre Not-in-force EP2610781B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TR201113152 2011-12-28

Publications (3)

Publication Number Publication Date
EP2610781A2 true EP2610781A2 (fr) 2013-07-03
EP2610781A3 EP2610781A3 (fr) 2014-08-27
EP2610781B1 EP2610781B1 (fr) 2015-08-05

Family

ID=47469796

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12199372.9A Not-in-force EP2610781B1 (fr) 2011-12-28 2012-12-25 Système de reconnaissance de cylindre

Country Status (2)

Country Link
EP (1) EP2610781B1 (fr)
DK (1) DK2610781T3 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1354993A (en) 1971-07-15 1974-06-05 Tokyo Shibaura Electric Co Pattern processing apparatus
DE19816881A1 (de) 1998-04-17 1999-10-21 Krieg Gunther Verfahren und Vorrichtung zur Detektion und Unterscheidung zwischen Kontaminationen und Gutstoffen sowie zwischen verschiedenen Farben in Feststoffpartikeln

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4305559A1 (de) * 1993-02-24 1994-08-25 Hans Schiesl Anordnung und Verfahren zur Konturerkennung von Gegenständen
FR2750689B1 (fr) * 1996-07-05 1998-11-06 Provencale D Automation Et De Simplification aux installations de remplissage de bouteilles par du gpl
DE102007008619A1 (de) * 2007-02-22 2008-08-28 Recop Elektronic Gmbh Vorrichtung zur gleichzeitigen Betrachtung des vollständigen Umfangs eines Gebindes, insbesondere einer Flasche
TR200703661A2 (tr) * 2007-05-28 2008-12-22 Aygaz A.�. Bir otomasyon sistemi
TR200803303A2 (tr) * 2008-05-09 2009-11-23 Aygaz Anon�M ��Rket� Bir kontrol sistemi.
TR200809620A2 (tr) * 2008-12-18 2010-07-21 Aygaz Anon�M ��Rket� LPG tüpleri için bir kaçak kontrol mekanizması

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1354993A (en) 1971-07-15 1974-06-05 Tokyo Shibaura Electric Co Pattern processing apparatus
DE19816881A1 (de) 1998-04-17 1999-10-21 Krieg Gunther Verfahren und Vorrichtung zur Detektion und Unterscheidung zwischen Kontaminationen und Gutstoffen sowie zwischen verschiedenen Farben in Feststoffpartikeln

Also Published As

Publication number Publication date
EP2610781B1 (fr) 2015-08-05
DK2610781T3 (en) 2015-11-09
EP2610781A3 (fr) 2014-08-27

Similar Documents

Publication Publication Date Title
CA2803514C (fr) Comptoir de caisse
US9036894B2 (en) Dispensary embossed character container labeling
US20020039183A1 (en) Integrated soft bag inspection system
EP1600764B1 (fr) Procédé et dispositif d'inspection d'objets transparents
JP2019196964A (ja) 分類器の学習支援システム、学習データの収集方法、検査システム
CN103203324A (zh) 带有监控系统的用于输送盖的设备
CN111652541B (zh) 工业生产监测方法、系统以及计算机可读存储介质
CN111683227A (zh) 一种基于视频异常监测的皮带操作智能辅助方法和系统
US20190145904A1 (en) Method and system of checking a facility for the optical inspection of glass containers
EP3474004A1 (fr) Dispositif d'inspection d'aspect, système de traitement de surface, procédé d'inspection d'aspect, programme et procédé de détermination de remplacement de matériau de projection
EP2610781A2 (fr) Système de reconnaissance de cylindre
US7209575B2 (en) Method for visual inspection of printed matter on moving lids
KR101535804B1 (ko) 작업자의 동작인식을 이용한 생산 자동화 시스템
US10515501B2 (en) Testing device for testing coin blanks
WO2012005661A1 (fr) Caisse de sortie
EP4230313A1 (fr) Procédé et système de contrôle pour contrôler des récipients et installation de remplissage comprenant un tel système de contrôle
US20220175617A1 (en) System and method for applying patterns on articles and inspection thereof
KR100449240B1 (ko) 병마개용 품질 검사 장치 및 방법
WO2017216536A1 (fr) Système de vérification de produit
EP2128829B1 (fr) Reconnaissance de logo de fûts de bouteilles consignées
CN116087217B (zh) 基于机器视觉的工业流水线动态质量检测模块及方法
US20230237636A1 (en) Vision inspection system for defect detection
CN112770998B (zh) 用于提供分类的止动元件的设备和方法
CN107607539A (zh) 一种连杆胀断面质量视觉检测装置和检测方法
CN112014410A (zh) 电子部件处理设备用检查装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: G06K 9/00 20060101AFI20140721BHEP

Ipc: F17C 5/00 20060101ALI20140721BHEP

Ipc: B07C 5/34 20060101ALI20140721BHEP

Ipc: B07C 5/12 20060101ALI20140721BHEP

17P Request for examination filed

Effective date: 20140926

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150325

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 741077

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150815

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602012009296

Country of ref document: DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 4

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20151102

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 741077

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150805

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151105

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151106

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151207

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151205

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602012009296

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151231

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20160509

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151225

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151231

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151225

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20121225

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20161225

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161225

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20181220

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20191210

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20191227

Year of fee payment: 8

Ref country code: FR

Payment date: 20191220

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191225

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602012009296

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20201231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210701

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201231