EP2610781A2 - A cylinder recognition system - Google Patents

A cylinder recognition system Download PDF

Info

Publication number
EP2610781A2
EP2610781A2 EP12199372.9A EP12199372A EP2610781A2 EP 2610781 A2 EP2610781 A2 EP 2610781A2 EP 12199372 A EP12199372 A EP 12199372A EP 2610781 A2 EP2610781 A2 EP 2610781A2
Authority
EP
European Patent Office
Prior art keywords
cylinder
cylinders
filling
conveyed
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP12199372.9A
Other languages
German (de)
French (fr)
Other versions
EP2610781A3 (en
EP2610781B1 (en
Inventor
Ali Kizilkaya
Emrah Isbilen
Onur Azak
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aygaz AS
Original Assignee
Aygaz AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aygaz AS filed Critical Aygaz AS
Publication of EP2610781A2 publication Critical patent/EP2610781A2/en
Publication of EP2610781A3 publication Critical patent/EP2610781A3/en
Application granted granted Critical
Publication of EP2610781B1 publication Critical patent/EP2610781B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B07SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07CPOSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/04Sorting according to size
    • B07C5/12Sorting according to size characterised by the application to particular articles, not otherwise provided for
    • B07C5/122Sorting according to size characterised by the application to particular articles, not otherwise provided for for bottles, ampoules, jars and other glassware
    • B07C5/126Sorting according to size characterised by the application to particular articles, not otherwise provided for for bottles, ampoules, jars and other glassware by means of photo-electric sensors, e.g. according to colour
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B07SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07CPOSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/34Sorting according to other particular properties
    • B07C5/3404Sorting according to other particular properties according to properties of containers or receptacles, e.g. rigidity, leaks, fill-level
    • B07C5/3408Sorting according to other particular properties according to properties of containers or receptacles, e.g. rigidity, leaks, fill-level for bottles, jars or other glassware
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B07SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07CPOSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/34Sorting according to other particular properties
    • B07C5/3412Sorting according to other particular properties according to a code applied to the object which indicates a property of the object, e.g. quality class, contents or incorrect indication
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2205/00Vessel construction, in particular mounting arrangements, attachments or identifications means
    • F17C2205/05Vessel or content identifications, e.g. labels
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2221/00Handled fluid, in particular type of fluid
    • F17C2221/03Mixtures
    • F17C2221/032Hydrocarbons
    • F17C2221/035Propane butane, e.g. LPG, GPL
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2223/00Handled fluid before transfer, i.e. state of fluid when stored in the vessel or before transfer from the vessel
    • F17C2223/01Handled fluid before transfer, i.e. state of fluid when stored in the vessel or before transfer from the vessel characterised by the phase
    • F17C2223/0146Two-phase
    • F17C2223/0153Liquefied gas, e.g. LPG, GPL
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2223/00Handled fluid before transfer, i.e. state of fluid when stored in the vessel or before transfer from the vessel
    • F17C2223/03Handled fluid before transfer, i.e. state of fluid when stored in the vessel or before transfer from the vessel characterised by the pressure level
    • F17C2223/033Small pressure, e.g. for liquefied gas
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2250/00Accessories; Control means; Indicating, measuring or monitoring of parameters
    • F17C2250/03Control means
    • F17C2250/032Control means using computers
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2250/00Accessories; Control means; Indicating, measuring or monitoring of parameters
    • F17C2250/03Control means
    • F17C2250/038Control means using cameras
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2270/00Applications
    • F17C2270/07Applications for household use
    • F17C2270/0745Gas bottles

Definitions

  • This invention relates to a cylinder recognition system, identifying the type of a cylinder prior to a filling process by means of a camera using artificial vision technology and allowing conveying a single type of cylinder to a filling line.
  • a cylinder filling process in LPG filling stations is performed by authorized personnel by manually adjusting a filling balance according to the tare of a cylinder to be filled.
  • Cylinders designed in various shapes, e.g. with narrow or wide grips, with long or short collars, with wide or narrow lower circles, according to the need of clients, are identified visually by authorized personnel and the tare of the respective type of cylinder is determined accordingly.
  • the German patent document DE19816881 discloses classifying materials on a line by scanning the materials using a line laser light source. Said invention primarily analyses the light returned from objects on a line by means of spectroscopy (different wavelengths in returned light are detected) and differentiates the objects accordingly.
  • the cylinder recognition system according to the present invention operates by analysing a 2 dimensional image of objects, as a result of capturing an image of a field, in place of scanning a one dimensional line. Additionally, by making use of the differences in contrast and color in the image captured by a camera, the sizes of figures in the image are defined based on pixels, so that the cylinders (objects) are identified by comparing the areas of the figures in the image to the size of previously determined figures. By virtue of this method, devices such as a multi-anode photon multiplier and a toroidal mirror in said patent are not required.
  • the UK patent document GB 1354993 refers to an invention used for identifying certain figures, i.e. numbers or letters, by means of a photoelectric converter. Even if there is a general similarity between that document and the aim of the cylinder recognition system according to the present invention, e.g. identifying some figures, the technique used by these two methods to achieve this object is quite different.
  • a cylinder recognition system the image of a cylinder is captured by a camera in an entirely digital medium, and then the process is proceeded through this image to determine the compliance of a cylinder of which the image is captured.
  • the image captured by the camera is subjected to digital image processing, the contrast difference in the image is determined, the pixel areas occupied by the physical shape of the cylinder in the captured image is established and finally the type of the cylinder is identified.
  • no method is used for capturing images in a digital medium and for processing the same; said invention is based completely on analog signals.
  • the photoelectric converter, electron beam, focusing coils used to enlarge the image, electrical analog logic circuits etc. used in that patent are not used in the cylinder recognition system according to the present invention.
  • the operation logic of said patent comprises the scanning of a field, enlarging any figures detected during the scanning process and focusing on these points, and then identifying these figures by means of electrical signals.
  • the object of this invention is to provide a cylinder recognition system capable of preventing in advance any operator faults in the classification of cylinders to be filled.
  • Another object of this invention is to provide a cylinder recognition system capable of identifying a cylinder type using a pixel area on a camera image.
  • Figure 1 is a schematic illustration of a cylinder recognition system.
  • a cylinder recognition system (1) according to the present invention comprises
  • All cylinders to be filled are checked by the operator and classified according to their types prior to filling. If an operator fault is made during this check made around every 2 seconds as the line is proceeding, overfilled or underfilled LPG cylinders are delivered to the clients, this in turn leads to additional labor and product costs, customer dissatisfaction, and most significantly, the problems associated with the delivery of overfilled cylinders.
  • the system (1) is designed to be assembled on a conveyor line and is adapted to the conditions of explosive-inflammable environments. Cylinders which are successively conveyed on the conveyor line are first stopped by the primary stopper (3).
  • the stopper (3) is kept open by means of the primary photocell (2) placed in front of the stopper (3) during a time interval in which only a single cylinder can be passed, such that the cylinders are entered into the recognition cabin one by one.
  • a cylinder entering into the storage cabin (4) illuminated by an illuminator (8) is detected by means of a secondary photocell (5) when it comes below the camera (7), and is stopped by means of a specifically-designed cylinder centering stopper (6) just below the camera (7).
  • the image of the cylinder is captured by the camera (7); and the upper ring diameter and the collar size of the cylinder are determined by the control unit (13). If the cylinder conveyed to filling is not of the type determined by the operator, the control unit (13) does not allow the cylinder to be conveyed to filling and deflects the cylinder from the line by means of the deflecting piston (10).
  • the operator display (14) allows both to select the type of cylinder and displays the whole process, the number of cylinders deflected and conveyed to filling.
  • the image of cylinders captured by the camera (7) is necessary to identify the type of cylinders, so when the camera is absent, the cylinder recognition system (1) will not work.
  • the numbers of cylinders deflected and conveyed to filling and the selection of the type of cylinder intended for filling by the user is checked on the operator display (14). If this display is removed from the system (1), another method must be used to select the type of cylinders.
  • the control unit (13) comprises a PLC control system which enables to deflect the cylinders which are not intended for filling from the filling line. When the control unit (13) is lacking, these cylinders cannot be deflected from the line.
  • the cylinder deflecting piston (10) enables to deflect a cylinder not to be filled from the line with a command received from the control unit. If it is lacking, the cylinders cannot be deflected from the line. Since the stoppers (3, 6) and photocells (2, 5, 9) control the flow and order of the cylinders on the line, their absence will cause an error in the system.
  • the identification of cylinders is entirely performed by the camera (7), and it is not dependent on a data to be received from a human or from a barcode or label applied to the cylinder.
  • all types of cylinders of which the sizes are entered to the control unit (13), can be detected, such that only those cylinders intended for filling are filled. Additionally, extra costs and labor of a label or barcode applied to cylinders will be avoided.
  • the system (1) is PLC controlled, it allows to monitor the deflected cylinders and to keep statistical data electronically on the filling process.
  • the system (1) is designed to identify cylinders of differing designs.
  • a cylinder to be filled is first selected by the operator on the operator display (14).
  • the operator display (14) is taken into a panel with keypads in order to comply with the conditions of inflammable and explosive environments.
  • Cylinders proceeded successively to filling on the conveyor line are detected by photocells (2, 5, 9).
  • the control unit (13) warned by the photocells (2, 5, 9) - that a cylinder is conveyed to a filling unit, opens the primary stopper (3) and lets one cylinder to pass.
  • the control unit (13) closes the stopper (3) so that the cylinders are entered to the storage cabin (4) one by one.
  • the entrance of cylinder to the storage cabin (4) which is aimed to isolate the camera (7) therein from external lights is detected by the secondary photocell (5).
  • the control unit (13) transmits an electrical signal to close the centering stopper (6) which normally is open.
  • the centering stopper (6) disposed on both sides of the conveyor are provided semilunar metal plates specifically produced according to the form of cylinders. When the centering stopper (6) is closed, the respective cylinder is stopped just below the camera (7) for a short time.
  • control unit (13) When the control unit (13) detects that the cylinder is below the camera (7), it signalizes the camera (7) and illuminator (8) so that the image of the cylinder is captured. Meanwhile, the centering stopper (6) plates surrounding the cylinder make up a fixed background for the image to be taken by the camera (7).
  • the control unit (13) makes use of color and contrast differences within the image captured by the camera (7) and calculates the cylinder diameter, the collar size, and the pixel area occupied by the upper ring (grip). This area is compared to the pixel area occupied by different type of cylinders previously introduced to the control unit (13). The type of cylinders is determined as a result of this comparison.
  • the control unit (13) compares the type of the cylinder previously entered by the operator to the operator display (14) and the type identified by the camera (7), and according to the result of this comparison, the cylinder is conveyed either to the filling line (11) or to the deflected cylinder line (12).
  • a warning is transmitted to the deflecting piston (10) so that the cylinder is guided to the deflected cylinder line (12).
  • the control unit (13) incorporates a PLC unit managing the cylinder identifying process, solenoid valves used for controlling the piston movements, pressure switches, and photocell amplifiers.

Landscapes

  • Filling Or Discharging Of Gas Storage Vessels (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

This invention relates to a cylinder recognition system, identifying the type of a cylinder prior to a filling process by means of a camera using artificial vision technology and allowing conveying a single type of cylinder to a filling line. It comprises at least one illuminator (8) providing the illumination of cylinders conveyed on a conveyor line to a filling unit in a storage cabin (4); at least one camera (7) generating an image providing the classification of cylinders conveyed to a filling unit; at least one storage cabin (4) in which cylinders conveyed to a filling unit are stopped, their images taken by the camera (7) and the type of cylinder is determined accordingly; at least one control unit (13) in which electric signals from photocells (2, 5, 9) and camera (7) are processed, and accordingly, electronic signals are transmitted to the deflecting piston (10) to classify the cylinders; and at least one operator display (14) by which the type of cylinder is selected and the number of cylinders deflected or conveyed to a filling unit is monitored by the user.

Description

    Field of Invention:
  • This invention relates to a cylinder recognition system, identifying the type of a cylinder prior to a filling process by means of a camera using artificial vision technology and allowing conveying a single type of cylinder to a filling line.
  • Prior Art:
  • A cylinder filling process in LPG filling stations is performed by authorized personnel by manually adjusting a filling balance according to the tare of a cylinder to be filled. Cylinders designed in various shapes, e.g. with narrow or wide grips, with long or short collars, with wide or narrow lower circles, according to the need of clients, are identified visually by authorized personnel and the tare of the respective type of cylinder is determined accordingly.
  • As a result of the similarities emerging between the designs of cylinder, the differentiation of cylinders prior to filling has become difficult and susceptible to operator faults. Thus, when a different type of cylinder is mistakenly entered to a filling line during a filling process of cylinders, a problem emerges in that the filling is made either over or below the required level. Another point increasing the importance of the problem is the lack of a safety valve in some cylinders, such that serious hazards may occur when an LPG cylinder is overfilled.
  • On the other hand, since the method of identifying the tare by an operator in a visual manner is susceptible to errors, a system was developed which identifies the type of a cylinder prior to a filling process by means of a camera using artificial vision technology and allows conveying a single type of cylinder to a filling line. This system is designed to recognize at least four different types of cylinders prior to filling and to allow only the type of cylinder which is planned for filling to proceed on a line, and thus to deflect the remaining 3 types of cylinders from the line. In order to differentiate the cylinders from each other, the diameter differences in the upper ring (grip) and the collar size are used. Thus, depending on the type of cylinder of which the filling is intended, only that type of cylinder is conveyed to the filling process and other types of cylinders are prevented from entering the filling process.
  • The German patent document DE19816881 discloses classifying materials on a line by scanning the materials using a line laser light source. Said invention primarily analyses the light returned from objects on a line by means of spectroscopy (different wavelengths in returned light are detected) and differentiates the objects accordingly. The cylinder recognition system according to the present invention, in turn, operates by analysing a 2 dimensional image of objects, as a result of capturing an image of a field, in place of scanning a one dimensional line. Additionally, by making use of the differences in contrast and color in the image captured by a camera, the sizes of figures in the image are defined based on pixels, so that the cylinders (objects) are identified by comparing the areas of the figures in the image to the size of previously determined figures. By virtue of this method, devices such as a multi-anode photon multiplier and a toroidal mirror in said patent are not required.
  • The UK patent document GB 1354993 refers to an invention used for identifying certain figures, i.e. numbers or letters, by means of a photoelectric converter. Even if there is a general similarity between that document and the aim of the cylinder recognition system according to the present invention, e.g. identifying some figures, the technique used by these two methods to achieve this object is quite different. In a cylinder recognition system, the image of a cylinder is captured by a camera in an entirely digital medium, and then the process is proceeded through this image to determine the compliance of a cylinder of which the image is captured. In the determination process, the image captured by the camera is subjected to digital image processing, the contrast difference in the image is determined, the pixel areas occupied by the physical shape of the cylinder in the captured image is established and finally the type of the cylinder is identified. In said patent document, on the other hand, no method is used for capturing images in a digital medium and for processing the same; said invention is based completely on analog signals. The photoelectric converter, electron beam, focusing coils used to enlarge the image, electrical analog logic circuits etc. used in that patent are not used in the cylinder recognition system according to the present invention. Additionally, the operation logic of said patent comprises the scanning of a field, enlarging any figures detected during the scanning process and focusing on these points, and then identifying these figures by means of electrical signals. In the logic of the cylinder recognition system according to the present invention, in turn, in place of a sequential operation as specified above, an image on a fixed plane is captured, the image is digitally processed, the figures in the image are differentiated based on contrast differences, and accordingly the figures are identified; no point on an image captured is examined upon being enlarged and focused, but the image is processed as a whole.
  • Brief Description of Invention:
  • The object of this invention is to provide a cylinder recognition system capable of preventing in advance any operator faults in the classification of cylinders to be filled.
  • Another object of this invention is to provide a cylinder recognition system capable of identifying a cylinder type using a pixel area on a camera image.
  • Detailed Description of Invention:
  • A cylinder recognition system developed to achieve the object of the present invention is illustrated in an accompanying figure, briefly described hereunder.
  • Figure 1 is a schematic illustration of a cylinder recognition system.
  • The parts in the figure are individually enumerated as following.
    • 1. Cylinder recognition system
    • 2. Primary photocell
    • 3. Primary stopper
    • 4. Storage cabin
    • 4a. Storage cabin (top view)
    • 5. Secondary photocell
    • 6. Cylinder centering stopper
    • 6a. Cylinder centering stopper (top view)
    • 7. Camera
    • 8. Illuminator
    • 9. Tertiary photocell
    • 10. Cylinder deflecting piston
    • 11. Filling line
    • 12. Deflected cylinder line
    • 13. Control unit
    • 14. Operator display
    • 15. Secondary stopper
  • A cylinder recognition system (1) according to the present invention comprises
    • at least one illuminator (8) providing the illumination of cylinders conveyed on a line to a filling unit in a storage cabin (4),
    • at least one camera (7) generating an image providing the classification of cylinders conveyed to a filling unit,
    • at least one storage cabin (4) in which cylinders conveyed to a filling unit are stopped, their images are taken by a camera (7) and the type of cylinder is determined accordingly,
    • at least one primary photocell (2) detecting a cylinder conveyed to a filling unit and enabling it to enter to the storage cabin (4),
    • at least one primary stopper (3) which, when there is a cylinder present in the storage cabin (4), keeps the next cylinder on the line until the cabin is emptied,
    • at least one secondary photocell (5) detecting the entrance of a cylinder conveyed to a filling unit into the cabin (4),
    • at least one cylinder centering stopper (6) which stops a cylinder entered into the storage cabin (4) when it just comes to the center of the cabin,
    • at least one cylinder deflecting piston (10) differentiating the type of cylinders which are to be conveyed to a filling unit from those which are not to be conveyed, based on a warning received from a control unit (13),
    • at least one secondary stopper (15) stopping those cylinders which are intended to be guided by the cylinder deflecting piston (10) for some time,
    • at least one third photocell (9) detecting the cylinders leaving the storage cabin (4) and activating the cylinder deflecting piston (10) to guide a cylinder leaving the cabin (4),
    • at least one filling line (11) by which the type of cylinders classified by the control unit (13) and intended to be filled are conveyed to a filling unit,
    • at least one deflected cylinder line (12) by which the type of cylinders classified by the control unit (13) and not intended to be filled are deflected from the filling line (11) and proceeded thereon,
    • at least one control unit (13) in which electric signals from the photocells (2, 5, 9) and the camera (7) are processed, and accordingly, electronic signals are transmitted to the deflecting piston (10) to classify the cylinders, and at least one operator display (14)
    through which the number of cylinders deflected or filled can be visually monitored and through which the type of cylinders is selected by an operator.
  • All cylinders to be filled are checked by the operator and classified according to their types prior to filling. If an operator fault is made during this check made around every 2 seconds as the line is proceeding, overfilled or underfilled LPG cylinders are delivered to the clients, this in turn leads to additional labor and product costs, customer dissatisfaction, and most significantly, the problems associated with the delivery of overfilled cylinders.
  • The system (1) is designed to be assembled on a conveyor line and is adapted to the conditions of explosive-inflammable environments. Cylinders which are successively conveyed on the conveyor line are first stopped by the primary stopper (3). The stopper (3), is kept open by means of the primary photocell (2) placed in front of the stopper (3) during a time interval in which only a single cylinder can be passed, such that the cylinders are entered into the recognition cabin one by one. A cylinder entering into the storage cabin (4) illuminated by an illuminator (8) is detected by means of a secondary photocell (5) when it comes below the camera (7), and is stopped by means of a specifically-designed cylinder centering stopper (6) just below the camera (7).
  • The image of the cylinder is captured by the camera (7); and the upper ring diameter and the collar size of the cylinder are determined by the control unit (13). If the cylinder conveyed to filling is not of the type determined by the operator, the control unit (13) does not allow the cylinder to be conveyed to filling and deflects the cylinder from the line by means of the deflecting piston (10). The operator display (14) allows both to select the type of cylinder and displays the whole process, the number of cylinders deflected and conveyed to filling.
  • The image of cylinders captured by the camera (7) is necessary to identify the type of cylinders, so when the camera is absent, the cylinder recognition system (1) will not work. The numbers of cylinders deflected and conveyed to filling and the selection of the type of cylinder intended for filling by the user is checked on the operator display (14). If this display is removed from the system (1), another method must be used to select the type of cylinders.
  • Since the camera (7) may capture an incorrect image when a cylinder does not come below the center of the camera, the cylinder centering stopper (6) is essential for the system. The control unit (13) comprises a PLC control system which enables to deflect the cylinders which are not intended for filling from the filling line. When the control unit (13) is lacking, these cylinders cannot be deflected from the line.
  • The cylinder deflecting piston (10) enables to deflect a cylinder not to be filled from the line with a command received from the control unit. If it is lacking, the cylinders cannot be deflected from the line.
    Since the stoppers (3, 6) and photocells (2, 5, 9) control the flow and order of the cylinders on the line, their absence will cause an error in the system.
  • Firstly, the identification of cylinders is entirely performed by the camera (7), and it is not dependent on a data to be received from a human or from a barcode or label applied to the cylinder. Thus, all types of cylinders, of which the sizes are entered to the control unit (13), can be detected, such that only those cylinders intended for filling are filled. Additionally, extra costs and labor of a label or barcode applied to cylinders will be avoided. Since the system (1) is PLC controlled, it allows to monitor the deflected cylinders and to keep statistical data electronically on the filling process. The system (1) is designed to identify cylinders of differing designs.
  • A cylinder to be filled is first selected by the operator on the operator display (14). The operator display (14) is taken into a panel with keypads in order to comply with the conditions of inflammable and explosive environments.
  • Cylinders proceeded successively to filling on the conveyor line are detected by photocells (2, 5, 9). The control unit (13), warned by the photocells (2, 5, 9) - that a cylinder is conveyed to a filling unit, opens the primary stopper (3) and lets one cylinder to pass. When the primary photocell (2) detects another cylinder, the control unit (13) closes the stopper (3) so that the cylinders are entered to the storage cabin (4) one by one.
  • The entrance of cylinder to the storage cabin (4) which is aimed to isolate the camera (7) therein from external lights is detected by the secondary photocell (5). When the photocell (5) detects the cylinder which is moved below the camera (7), the control unit (13) transmits an electrical signal to close the centering stopper (6) which normally is open. On the centering stopper (6) disposed on both sides of the conveyor are provided semilunar metal plates specifically produced according to the form of cylinders. When the centering stopper (6) is closed, the respective cylinder is stopped just below the camera (7) for a short time.
  • When the control unit (13) detects that the cylinder is below the camera (7), it signalizes the camera (7) and illuminator (8) so that the image of the cylinder is captured. Meanwhile, the centering stopper (6) plates surrounding the cylinder make up a fixed background for the image to be taken by the camera (7).
  • The control unit (13) makes use of color and contrast differences within the image captured by the camera (7) and calculates the cylinder diameter, the collar size, and the pixel area occupied by the upper ring (grip). This area is compared to the pixel area occupied by different type of cylinders previously introduced to the control unit (13). The type of cylinders is determined as a result of this comparison.
  • The control unit (13) compares the type of the cylinder previously entered by the operator to the operator display (14) and the type identified by the camera (7), and according to the result of this comparison, the cylinder is conveyed either to the filling line (11) or to the deflected cylinder line (12).
    When a cylinder decided to be deflected by the control unit (13) is detected by the photocell (9), a warning is transmitted to the deflecting piston (10) so that the cylinder is guided to the deflected cylinder line (12).
  • The number of cylinders conveyed to filling or deflected is monitored on the operator display (14).
    The control unit (13) incorporates a PLC unit managing the cylinder identifying process, solenoid valves used for controlling the piston movements, pressure switches, and photocell amplifiers.
  • According to this basic principle, it is possible to develop many different embodiments of the cylinder recognition system (1) according to the present invention; therefore, the present invention is not to be restricted to the examples disclosed above and is basically defined in the claims.

Claims (8)

  1. A cylinder recognition system (1), comprising
    - at least one illuminator (8) providing the illumination of cylinders conveyed on a conveyor line to a filling unit in a storage cabin (4),
    - at least one camera (7) generating an image providing the classification of cylinders conveyed to a filling unit,
    - at least one primary photocell (2) detecting a cylinder conveyed to a filling unit and enabling it to enter into the storage cabin (4),
    - at least one primary stopper (3), which, when there is a cylinder present in the storage cabin (4), keeps the next cylinder on the line until the cabin is emptied,
    - at least one secondary photocell (5) detecting the entrance of a cylinder conveyed to a filling unit into the cabin (4),
    - at least one operator display (14) by which the number of cylinders conveyed to a filling unit and the number of cylinders deflected are monitored and the type of cylinder is selected,
    - at least one cylinder centering stopper (6) which stops a cylinder entered into the storage cabin (4) when it just comes to the center of the cabin,
    - at least one cylinder deflecting piston (10) differentiating the type of cylinders which are to be conveyed for filling from those which are not,
    - at least one secondary stopper (15) stopping those cylinders which are to be guided by the cylinder deflecting piston (10) for some time,
    - at least one third photocell (9) detecting the cylinders leaving the storage cabin (4) and activating the cylinder deflecting piston (10) to guide a cylinder leaving the cabin (4),
    - at least one filling line (11) by which the type of cylinders classified by the control unit (13) so as to be filled are conveyed for filling,
    - at least one deflected cylinder line (12) by which the type of cylinders classified by the control unit (13) and not to be filled are deflected from the filling line (11) and proceeded thereon, characterized by
    - at least one storage cabin (4) in which cylinders conveyed to a filling unit are stopped, their images are taken by a camera (7) and the type of cylinder is determined accordingly,
    - at least one control unit (13) making use of the color and contrast differences within the image captured by the camera (7) and calculating the cylinder diameter, the collar size, and the pixel area occupied by the upper ring (grip).
  2. A cylinder recognition system (1) according to Claim 1, characterized by at least one control unit (13) in which electric signals from the photocells (2, 5, 9) and the camera (7) are processed, and accordingly, electronic signals are transmitted to the deflecting piston (10) to provide the classification of cylinders.
  3. A cylinder recognition system (1) according to claim 1 or 2, characterized by at least one storage cabin (4) in which cylinders conveyed to a filling unit are stopped, their images are taken by the camera (7) and the type of cylinder is determined accordingly.
  4. A cylinder recognition system (1) according to any of the preceding claims, characterized by at least one control unit (13) providing the classification of cylinders by comparing the pixel areas occupied by defined cylinders of various types.
  5. A cylinder recognition system (1) according to any of the preceding claims, characterized by at least one control unit (13) comparing the type of the cylinder entered by the operator to the operator display (14) and the type of cylinder identified by the camera (7), and according to the result of this comparison, conveying the cylinder either to the filling line (11) or to the deflected cylinder line (12).
  6. A cylinder recognition system (1) according to any of the preceding claims, characterized by at least one operator display (14) both allowing to select the type of cylinder and showing the number of cylinders deflected from the line and conveyed for filling.
  7. A cylinder recognition system (1) according to any of the preceding claims, characterized by a centering stopper (6) stopping a cylinder on the conveyor line for a short time, when it just comes below the camera (7).
  8. A cylinder recognition system (1) according to any of the preceding claims, characterized by a control unit (13) closing the primary stopper (3) when the primary photocell (2) detects another cylinder on the conveyor line.
EP12199372.9A 2011-12-28 2012-12-25 A cylinder recognition system Not-in-force EP2610781B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TR201113152 2011-12-28

Publications (3)

Publication Number Publication Date
EP2610781A2 true EP2610781A2 (en) 2013-07-03
EP2610781A3 EP2610781A3 (en) 2014-08-27
EP2610781B1 EP2610781B1 (en) 2015-08-05

Family

ID=47469796

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12199372.9A Not-in-force EP2610781B1 (en) 2011-12-28 2012-12-25 A cylinder recognition system

Country Status (2)

Country Link
EP (1) EP2610781B1 (en)
DK (1) DK2610781T3 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1354993A (en) 1971-07-15 1974-06-05 Tokyo Shibaura Electric Co Pattern processing apparatus
DE19816881A1 (en) 1998-04-17 1999-10-21 Krieg Gunther Differentiating materials, colors and contaminants in granulated plastic scrap

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4305559A1 (en) * 1993-02-24 1994-08-25 Hans Schiesl Arrangement and method for detecting the contours of objects
FR2750689B1 (en) * 1996-07-05 1998-11-06 Provencale D Automation Et De SIMPLIFICATION TO LPG FILLING PLANTS
DE102007008619A1 (en) * 2007-02-22 2008-08-28 Recop Elektronic Gmbh Device for simultaneous view of complete periphery of container, particularly bottle, has camera with convex lens arranged in path of rays of camera
TR200703661A2 (en) * 2007-05-28 2008-12-22 Aygaz A.�. An automation system
TR200803303A2 (en) * 2008-05-09 2009-11-23 Aygaz Anon�M ��Rket� A control system.
TR200809620A2 (en) * 2008-12-18 2010-07-21 Aygaz Anon�M ��Rket� A leak control mechanism for LPG cylinders

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1354993A (en) 1971-07-15 1974-06-05 Tokyo Shibaura Electric Co Pattern processing apparatus
DE19816881A1 (en) 1998-04-17 1999-10-21 Krieg Gunther Differentiating materials, colors and contaminants in granulated plastic scrap

Also Published As

Publication number Publication date
EP2610781A3 (en) 2014-08-27
DK2610781T3 (en) 2015-11-09
EP2610781B1 (en) 2015-08-05

Similar Documents

Publication Publication Date Title
CA2803510C (en) A checkout counter
US9036894B2 (en) Dispensary embossed character container labeling
US20020039183A1 (en) Integrated soft bag inspection system
EP1600764B1 (en) Method and device for inspecting transparent objects
CN101014850A (en) System and method for inspecting electrical circuits utilizing reflective and fluorescent imagery
WO2004036198A1 (en) Method and device for preparing reference image in glass bottle inspection device
JP2019196964A (en) Learning support system of sorter, learning data collection method and inspection system
CN103203324A (en) Device equipped with monitoring system used for conveying cap
CN111683227A (en) Belt operation intelligent auxiliary method and system based on video anomaly monitoring
US11295436B2 (en) Vision inspection system and method of inspecting parts
US10585047B2 (en) Method and system of checking a facility for the optical inspection of glass containers
EP3474004A1 (en) Appearance inspection device, surface processing system, appearance inspection method, program, and projection material replacement determination method
EP2610781A2 (en) A cylinder recognition system
US9304510B2 (en) Method and process of verifying physical connections within a material handling system
CN111652541B (en) Industrial production monitoring method, system and computer readable storage medium
EP3110701B1 (en) Container inspection device
KR101535804B1 (en) Automation Production System using sensing the motion of operator
WO2012005661A1 (en) A checkout counter
EP4230313A1 (en) Method and test system for testing containers, and filling installation having a test system of this type
US20180225902A1 (en) Testing device for testing coin blanks
US20220175617A1 (en) System and method for applying patterns on articles and inspection thereof
KR100449240B1 (en) Apparatus for inspecting the quality of a bottle cap
WO2017216536A1 (en) Product verification system
EP2128829B1 (en) Logo recognition of empty containers
CN116087217B (en) Industrial assembly line dynamic quality detection module and method based on machine vision

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: G06K 9/00 20060101AFI20140721BHEP

Ipc: F17C 5/00 20060101ALI20140721BHEP

Ipc: B07C 5/34 20060101ALI20140721BHEP

Ipc: B07C 5/12 20060101ALI20140721BHEP

17P Request for examination filed

Effective date: 20140926

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150325

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 741077

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150815

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602012009296

Country of ref document: DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 4

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20151102

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 741077

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150805

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151105

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151106

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151207

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151205

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602012009296

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151231

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20160509

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151225

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151231

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151225

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20121225

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20161225

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161225

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20181220

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20191210

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20191227

Year of fee payment: 8

Ref country code: FR

Payment date: 20191220

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191225

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602012009296

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20201231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210701

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201231