EP2610781B1 - A cylinder recognition system - Google Patents

A cylinder recognition system Download PDF

Info

Publication number
EP2610781B1
EP2610781B1 EP12199372.9A EP12199372A EP2610781B1 EP 2610781 B1 EP2610781 B1 EP 2610781B1 EP 12199372 A EP12199372 A EP 12199372A EP 2610781 B1 EP2610781 B1 EP 2610781B1
Authority
EP
European Patent Office
Prior art keywords
cylinder
cylinders
filling
conveyed
type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP12199372.9A
Other languages
German (de)
French (fr)
Other versions
EP2610781A3 (en
EP2610781A2 (en
Inventor
Ali Kizilkaya
Emrah Isbilen
Onur Azak
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aygaz AS
Original Assignee
Aygaz AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aygaz AS filed Critical Aygaz AS
Publication of EP2610781A2 publication Critical patent/EP2610781A2/en
Publication of EP2610781A3 publication Critical patent/EP2610781A3/en
Application granted granted Critical
Publication of EP2610781B1 publication Critical patent/EP2610781B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B07SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07CPOSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/04Sorting according to size
    • B07C5/12Sorting according to size characterised by the application to particular articles, not otherwise provided for
    • B07C5/122Sorting according to size characterised by the application to particular articles, not otherwise provided for for bottles, ampoules, jars and other glassware
    • B07C5/126Sorting according to size characterised by the application to particular articles, not otherwise provided for for bottles, ampoules, jars and other glassware by means of photo-electric sensors, e.g. according to colour
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B07SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07CPOSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/34Sorting according to other particular properties
    • B07C5/3404Sorting according to other particular properties according to properties of containers or receptacles, e.g. rigidity, leaks, fill-level
    • B07C5/3408Sorting according to other particular properties according to properties of containers or receptacles, e.g. rigidity, leaks, fill-level for bottles, jars or other glassware
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B07SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07CPOSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/34Sorting according to other particular properties
    • B07C5/3412Sorting according to other particular properties according to a code applied to the object which indicates a property of the object, e.g. quality class, contents or incorrect indication
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2205/00Vessel construction, in particular mounting arrangements, attachments or identifications means
    • F17C2205/05Vessel or content identifications, e.g. labels
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2221/00Handled fluid, in particular type of fluid
    • F17C2221/03Mixtures
    • F17C2221/032Hydrocarbons
    • F17C2221/035Propane butane, e.g. LPG, GPL
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2223/00Handled fluid before transfer, i.e. state of fluid when stored in the vessel or before transfer from the vessel
    • F17C2223/01Handled fluid before transfer, i.e. state of fluid when stored in the vessel or before transfer from the vessel characterised by the phase
    • F17C2223/0146Two-phase
    • F17C2223/0153Liquefied gas, e.g. LPG, GPL
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2223/00Handled fluid before transfer, i.e. state of fluid when stored in the vessel or before transfer from the vessel
    • F17C2223/03Handled fluid before transfer, i.e. state of fluid when stored in the vessel or before transfer from the vessel characterised by the pressure level
    • F17C2223/033Small pressure, e.g. for liquefied gas
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2250/00Accessories; Control means; Indicating, measuring or monitoring of parameters
    • F17C2250/03Control means
    • F17C2250/032Control means using computers
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2250/00Accessories; Control means; Indicating, measuring or monitoring of parameters
    • F17C2250/03Control means
    • F17C2250/038Control means using cameras
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F17STORING OR DISTRIBUTING GASES OR LIQUIDS
    • F17CVESSELS FOR CONTAINING OR STORING COMPRESSED, LIQUEFIED OR SOLIDIFIED GASES; FIXED-CAPACITY GAS-HOLDERS; FILLING VESSELS WITH, OR DISCHARGING FROM VESSELS, COMPRESSED, LIQUEFIED, OR SOLIDIFIED GASES
    • F17C2270/00Applications
    • F17C2270/07Applications for household use
    • F17C2270/0745Gas bottles

Definitions

  • This invention relates to a cylinder recognition system, identifying the type of a cylinder prior to a filling process by means of a camera using artificial vision technology and allowing conveying a single type of cylinder to a filling line.
  • a cylinder filling process in LPG filling stations is performed by authorized personnel by manually adjusting a filling balance according to the tare of a cylinder to be filled.
  • Cylinders designed in various shapes, e.g. with narrow or wide grips, with long or short collars, with wide or narrow lower circles, according to the need of clients, are identified visually by authorized personnel and the tare of the respective type of cylinder is determined accordingly.
  • the German patent document DE19816881 discloses classifying materials on a line by scanning the materials using a line laser light source. Said invention primarily analyses the light returned from objects on a line by means of spectroscopy (different wavelengths in returned light are detected) and differentiates the objects accordingly.
  • the cylinder recognition system according to the present invention operates by analysing a 2 dimensional image of objects, as a result of capturing an image of a field, in place of scanning a one dimensional line. Additionally, by making use of the differences in contrast and color in the image captured by a camera, the sizes of figures in the image are defined based on pixels, so that the cylinders (objects) are identified by comparing the areas of the figures in the image to the size of previously determined figures. By virtue of this method, devices such as a multi-anode photon multiplier and a toroidal mirror in said patent are not required.
  • the UK patent document GB 1354993 refers to an invention used for identifying certain figures, i.e. numbers or letters, by means of a photoelectric converter. Even if there is a general similarity between that document and the aim of the cylinder recognition system according to the present invention, e.g. identifying some figures, the technique used by these two methods to achieve this object is quite different.
  • a cylinder recognition system the image of a cylinder is captured by a camera in an entirely digital medium, and then the process is proceeded through this image to determine the compliance of a cylinder of which the image is captured.
  • the image captured by the camera is subjected to digital image processing, the contrast difference in the image is determined, the pixel areas occupied by the physical shape of the cylinder in the captured image is established and finally the type of the cylinder is identified.
  • no method is used for capturing images in a digital medium and for processing the same; said invention is based completely on analog signals.
  • the photoelectric converter, electron beam, focusing coils used to enlarge the image, electrical analog logic circuits etc. used in that patent are not used in the cylinder recognition system according to the present invention.
  • the operation logic of said patent comprises the scanning of a field, enlarging any figures detected during the scanning process and focusing on these points, and then identifying these figures by means of electrical signals.
  • Patent document no WO2009136380A1 discloses a control system in order to determine the compliance of the gas cylinders with the deformation and paint standards during production of the gas cylinders.
  • a control station in which the deformation and paint tests of the gas cylinders are performed
  • the control station comprises a rotation mechanism for rotating the gas cylinder on the line, a laser for forming a gas cylinder profile and obtaining an accurate image during rotation of the gas cylinder for determining the deformations, a deformation camera which records images for deciding the deformation condition and a paint camera which records images for deciding the paint condition. Thanks to the system the errors caused by operators during controlling of the deformation and paint conditions of the gas cylinders are reduced.
  • Patent document no EP1998100A1 discloses an automation system that performs reading the cylinder information cards located on gas cylinders by using a camera system, transmitting the information of the cylinder to the filling scale through electronic software which performs the filling under the control of a computer and removing cylinders that don't have an information card thereon from the conveyor line before arriving at the gas filling station.
  • the automation system is not able to detect the shapes of the cylinders to remove the inappropriate shaped cylinders from the production line.
  • Patent document no EP2199655A1 discloses a leakage control mechanism which is able to detect a certain amount of leakage from valves and bodies of gas cylinders and automatically remove the gas cylinders that has a leakage from the production line. This leakage control mechanism reduces the production of gas cylinders with leakage problems however said control system does not provide a solution for identifying the type of the cylinder prior to a filling process.
  • Patent document no FR2750689A1 discloses a filling system for gas cylinders which comprises an evacuation station and a filling station.
  • the diverting mechanism moves the cylinders coming from the conveyor to the evacuation station, where the fluids and residues are detected by a sensor and removed from the cylinders. Then said cylinders arrive the filling station, where the filling of the cylinders are carried out by using the data collected from a mass flowmeter.
  • the filling system operates automatically and detects residues in cylinders however, does not identify the type of the cylinder before filling process.
  • a contour detecting system comprising an optical scanning device for bottles that are moving on a conveyor belt.
  • Said scanning device comprises a group of light barriers located at different height levels and their optical paths are parallel to the conveyor.
  • At least one light emitter emits a light and a light receiver receives the light coming from the light emitter.
  • the presence of the bottle is understood according to the data coming from the light receiver by comparing the output data with a threshold value.
  • identification of the type of a cylinder (or a bottle) before filling process is not disclosed in this document.
  • Another patent document no DE102007008619A1 discloses a sorting system comprising a convex lens which is placed in the beam path of a camera placed in the center line above a container for simultaneously viewing the neck and the complete circumference of said container and recording the image during the motion of the container on a conveyor line and sorting of said containers.
  • the sorting system seems similar to the present invention of cylinder recognition system, the sorting system does not identify the type of a cylinder before filling in order to eliminate the filling of the wrong type cylinder.
  • the object of this invention is to provide a cylinder recognition system capable of preventing in advance any operator faults in the classification of cylinders to be filled.
  • Another object of this invention is to provide a cylinder recognition system capable of identifying a cylinder type using a pixel area on a camera image.
  • Figure 1 is a schematic illustration of a cylinder recognition system.
  • a cylinder recognition system (1) according to the present invention comprises
  • All cylinders to be filled are checked by the operator and classified according to their types prior to filling. If an operator fault is made during this check made around every 2 seconds as the line is proceeding, overfilled or underfilled LPG cylinders are delivered to the clients, this in turn leads to additional labor and product costs, customer dissatisfaction, and most significantly, the problems associated with the delivery of overfilled cylinders.
  • the system (1) is designed to be assembled on a conveyor line and is adapted to the conditions of explosive-inflammable environments. Cylinders which are successively conveyed on the conveyor line are first stopped by the primary stopper (3).
  • the stopper (3) is kept open by means of the primary photocell (2) placed in front of the stopper (3) during a time interval in which only a single cylinder can be passed, such that the cylinders are entered into the recognition cabin one by one.
  • a cylinder entering into the storage cabin (4) illuminated by an illuminator (8) is detected by means of a secondary photocell (5) when it comes below the camera (7), and is stopped by means of a specifically-designed cylinder centering stopper (6) just below the camera (7).
  • the image of the cylinder is captured by the camera (7); and the upper ring diameter and the collar size of the cylinder are determined by the control unit (13). If the cylinder conveyed to filling is not of the type determined by the operator, the control unit (13) does not allow the cylinder to be conveyed to filling and deflects the cylinder from the line by means of the deflecting piston (10).
  • the operator display (14) allows both to select the type of cylinder and displays the whole process, the number of cylinders deflected and conveyed to filling.
  • the image of cylinders captured by the camera (7) is necessary to identify the type of cylinders, so when the camera is absent, the cylinder recognition system (1) will not work.
  • the numbers of cylinders deflected and conveyed to filling and the selection of the type of cylinder intended for filling by the user is checked on the operator display (14). If this display is removed from the system (1), another method must be used to select the type of cylinders.
  • the control unit (13) comprises a PLC control system which enables to deflect the cylinders which are not intended for filling from the filling line. When the control unit (13) is lacking, these cylinders cannot be deflected from the line.
  • the cylinder deflecting piston (10) enables to deflect a cylinder not to be filled from the line with a command received from the control unit. If it is lacking, the cylinders cannot be deflected from the line.
  • stoppers (3, 6) and photocells (2, 5, 9) control the flow and order of the cylinders on the line, their absence will cause an error in the system.
  • the identification of cylinders is entirely performed by the camera (7), and it is not dependent on a data to be received from a human or from a barcode or label applied to the cylinder.
  • all types of cylinders of which the sizes are entered to the control unit (13), can be detected, such that only those cylinders intended for filling are filled. Additionally, extra costs and labor of a label or barcode applied to cylinders will be avoided.
  • the system (1) is PLC controlled, it allows to monitor the deflected cylinders and to keep statistical data electronically on the filling process.
  • the system (1) is designed to identify cylinders of differing designs.
  • a cylinder to be filled is first selected by the operator on the operator display (14).
  • the operator display (14) is taken into a panel with keypads in order to comply with the conditions of inflammable and explosive environments.
  • Cylinders proceeded successively to filling on the conveyor line are detected by photocells (2, 5, 9).
  • the control unit (13) warned by the photocells (2, 5, 9) - that a cylinder is conveyed to a filling unit, opens the primary stopper (3) and lets one cylinder to pass.
  • the control unit (13) closes the stopper (3) so that the cylinders are entered to the storage cabin (4) one by one.
  • the entrance of cylinder to the storage cabin (4) which is aimed to isolate the camera (7) therein from external lights is detected by the secondary photocell (5).
  • the control unit (13) transmits an electrical signal to close the centering stopper (6) which normally is open.
  • the centering stopper (6) disposed on both sides of the conveyor are provided semilunar metal plates specifically produced according to the form of cylinders. When the centering stopper (6) is closed, the respective cylinder is stopped just below the camera (7) for a short time.
  • control unit (13) When the control unit (13) detects that the cylinder is below the camera (7), it signalizes the camera (7) and illuminator (8) so that the image of the cylinder is captured. Meanwhile, the centering stopper (6) plates surrounding the cylinder make up a fixed background for the image to be taken by the camera (7).
  • the control unit (13) makes use of color and contrast differences within the image captured by the camera (7) and calculates the cylinder diameter, the collar size, and the pixel area occupied by the upper ring (grip). This area is compared to the pixel area occupied by different type of cylinders previously introduced to the control unit (13). The type of cylinders is determined as a result of this comparison.
  • the control unit (13) compares the type of the cylinder previously entered by the operator to the operator display (14) and the type identified by the camera (7), and according to the result of this comparison, the cylinder is conveyed either to the filling line (11) or to the deflected cylinder line (12).
  • the number of cylinders conveyed to filling or deflected is monitored on the operator display (14).
  • the control unit (13) incorporates a PLC unit managing the cylinder identifying process, solenoid valves used for controlling the piston movements, pressure switches, and photocell amplifiers.

Landscapes

  • Filling Or Discharging Of Gas Storage Vessels (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Description

    Field of Invention:
  • This invention relates to a cylinder recognition system, identifying the type of a cylinder prior to a filling process by means of a camera using artificial vision technology and allowing conveying a single type of cylinder to a filling line.
  • Prior Art:
  • A cylinder filling process in LPG filling stations is performed by authorized personnel by manually adjusting a filling balance according to the tare of a cylinder to be filled. Cylinders designed in various shapes, e.g. with narrow or wide grips, with long or short collars, with wide or narrow lower circles, according to the need of clients, are identified visually by authorized personnel and the tare of the respective type of cylinder is determined accordingly.
  • As a result of the similarities emerging between the designs of cylinder, the differentiation of cylinders prior to filling has become difficult and susceptible to operator faults. Thus, when a different type of cylinder is mistakenly entered to a filling line during a filling process of cylinders, a problem emerges in that the filling is made either over or below the required level. Another point increasing the importance of the problem is the lack of a safety valve in some cylinders, such that serious hazards may occur when an LPG cylinder is overfilled.
  • On the other hand, since the method of identifying the tare by an operator in a visual manner is susceptible to errors, a system was developed which identifies the type of a cylinder prior to a filling process by means of a camera using artificial vision technology and allows conveying a single type of cylinder to a filling line. This system is designed to recognize at least four different types of cylinders prior to filling and to allow only the type of cylinder which is planned for filling to proceed on a line, and thus to deflect the remaining 3 types of cylinders from the line. In order to differentiate the cylinders from each other, the diameter differences in the upper ring (grip) and the collar size are used. Thus, depending on the type of cylinder of which the filling is intended, only that type of cylinder is conveyed to the filling process and other types of cylinders are prevented from entering the filling process.
  • The German patent document DE19816881 discloses classifying materials on a line by scanning the materials using a line laser light source. Said invention primarily analyses the light returned from objects on a line by means of spectroscopy (different wavelengths in returned light are detected) and differentiates the objects accordingly. The cylinder recognition system according to the present invention, in turn, operates by analysing a 2 dimensional image of objects, as a result of capturing an image of a field, in place of scanning a one dimensional line. Additionally, by making use of the differences in contrast and color in the image captured by a camera, the sizes of figures in the image are defined based on pixels, so that the cylinders (objects) are identified by comparing the areas of the figures in the image to the size of previously determined figures. By virtue of this method, devices such as a multi-anode photon multiplier and a toroidal mirror in said patent are not required.
  • The UK patent document GB 1354993 refers to an invention used for identifying certain figures, i.e. numbers or letters, by means of a photoelectric converter. Even if there is a general similarity between that document and the aim of the cylinder recognition system according to the present invention, e.g. identifying some figures, the technique used by these two methods to achieve this object is quite different. In a cylinder recognition system, the image of a cylinder is captured by a camera in an entirely digital medium, and then the process is proceeded through this image to determine the compliance of a cylinder of which the image is captured. In the determination process, the image captured by the camera is subjected to digital image processing, the contrast difference in the image is determined, the pixel areas occupied by the physical shape of the cylinder in the captured image is established and finally the type of the cylinder is identified. In said patent document, on the other hand, no method is used for capturing images in a digital medium and for processing the same; said invention is based completely on analog signals. The photoelectric converter, electron beam, focusing coils used to enlarge the image, electrical analog logic circuits etc. used in that patent are not used in the cylinder recognition system according to the present invention. Additionally, the operation logic of said patent comprises the scanning of a field, enlarging any figures detected during the scanning process and focusing on these points, and then identifying these figures by means of electrical signals. In the logic of the cylinder recognition system according to the present invention, in turn, in place of a sequential operation as specified above, an image on a fixed plane is captured, the image is digitally processed, the figures in the image are differentiated based on contrast differences, and accordingly the figures are identified; no point on an image captured is examined upon being enlarged and focused, but the image is processed as a whole.
  • Patent document no WO2009136380A1 discloses a control system in order to determine the compliance of the gas cylinders with the deformation and paint standards during production of the gas cylinders. In the system, there is provided a control station in which the deformation and paint tests of the gas cylinders are performed The control station comprises a rotation mechanism for rotating the gas cylinder on the line, a laser for forming a gas cylinder profile and obtaining an accurate image during rotation of the gas cylinder for determining the deformations, a deformation camera which records images for deciding the deformation condition and a paint camera which records images for deciding the paint condition. Thanks to the system the errors caused by operators during controlling of the deformation and paint conditions of the gas cylinders are reduced.
  • Patent document no EP1998100A1 discloses an automation system that performs reading the cylinder information cards located on gas cylinders by using a camera system, transmitting the information of the cylinder to the filling scale through electronic software which performs the filling under the control of a computer and removing cylinders that don't have an information card thereon from the conveyor line before arriving at the gas filling station. However, the automation system is not able to detect the shapes of the cylinders to remove the inappropriate shaped cylinders from the production line.
  • Patent document no EP2199655A1 discloses a leakage control mechanism which is able to detect a certain amount of leakage from valves and bodies of gas cylinders and automatically remove the gas cylinders that has a leakage from the production line. This leakage control mechanism reduces the production of gas cylinders with leakage problems however said control system does not provide a solution for identifying the type of the cylinder prior to a filling process.
  • Patent document no FR2750689A1 discloses a filling system for gas cylinders which comprises an evacuation station and a filling station. The diverting mechanism moves the cylinders coming from the conveyor to the evacuation station, where the fluids and residues are detected by a sensor and removed from the cylinders. Then said cylinders arrive the filling station, where the filling of the cylinders are carried out by using the data collected from a mass flowmeter. The filling system operates automatically and detects residues in cylinders however, does not identify the type of the cylinder before filling process.
  • In the patent document no DE4305559A1 a contour detecting system comprising an optical scanning device for bottles that are moving on a conveyor belt is disclosed. Said scanning device comprises a group of light barriers located at different height levels and their optical paths are parallel to the conveyor. At least one light emitter emits a light and a light receiver receives the light coming from the light emitter. The presence of the bottle is understood according to the data coming from the light receiver by comparing the output data with a threshold value. However identification of the type of a cylinder (or a bottle) before filling process is not disclosed in this document.
  • Another patent document no DE102007008619A1 discloses a sorting system comprising a convex lens which is placed in the beam path of a camera placed in the center line above a container for simultaneously viewing the neck and the complete circumference of said container and recording the image during the motion of the container on a conveyor line and sorting of said containers. Although the sorting system seems similar to the present invention of cylinder recognition system, the sorting system does not identify the type of a cylinder before filling in order to eliminate the filling of the wrong type cylinder.
  • Brief Description of Invention:
  • The object of this invention is to provide a cylinder recognition system capable of preventing in advance any operator faults in the classification of cylinders to be filled.
  • Another object of this invention is to provide a cylinder recognition system capable of identifying a cylinder type using a pixel area on a camera image.
  • Detailed Description of Invention:
  • A cylinder recognition system developed to achieve the object of the present invention is illustrated in an accompanying figure, briefly described hereunder.
  • Figure 1 is a schematic illustration of a cylinder recognition system.
  • The parts in the figure are individually enumerated as following.
  • 1.
    Cylinder recognition system
    2.
    Primary photocell
    3.
    Primary stopper
    4.
    Storage cabin
    4a.
    Storage cabin (top view)
    5.
    Secondary photocell
    6.
    Cylinder centering stopper
    6a.
    Cylinder centering stopper (top view)
    7.
    Camera
    8.
    Illuminator
    9.
    Tertiary photocell
    10.
    Cylinder deflecting piston
    11.
    Filling line
    12.
    Deflected cylinder line
    13.
    Control unit
    14.
    Operator display
    15.
    Secondary stopper
  • A cylinder recognition system (1) according to the present invention comprises
    • at least one illuminator (8) providing the illumination of cylinders conveyed on a line to a filling unit in a storage cabin (4),
    • at least one camera (7) generating an image providing the classification of cylinders conveyed to a filling unit,
    • at least one storage cabin (4) in which cylinders conveyed to a filling unit are stopped, their images are taken by a camera (7) and the type of cylinder is determined accordingly,
    • at least one primary photocell (2) detecting a cylinder conveyed to a filling unit and enabling it to enter to the storage cabin (4),
    • at least one primary stopper (3) which, when there is a cylinder present in the storage cabin (4), keeps the next cylinder on the line until the cabin is emptied,
    • at least one secondary photocell (5) detecting the entrance of a cylinder conveyed to a filling unit into the cabin (4),
    • at least one cylinder centering stopper (6) which stops a cylinder entered into the storage cabin (4) when it just comes to the center of the cabin,
    • at least one cylinder deflecting piston (10) differentiating the type of cylinders which are to be conveyed to a filling unit from those which are not to be conveyed, based on a warning received from a control unit (13),
    • at least one secondary stopper (15) stopping those cylinders which are intended to be guided by the cylinder deflecting piston (10) for some time,
    • at least one third photocell (9) detecting the cylinders leaving the storage cabin (4) and activating the cylinder deflecting piston (10) to guide a cylinder leaving the cabin (4),
    • at least one filling line (11) by which the type of cylinders classified by the control unit (13) and intended to be filled are conveyed to a filling unit,
    • at least one deflected cylinder line (12) by which the type of cylinders classified by the control unit (13) and not intended to be filled are deflected from the filling line (11) and proceeded thereon,
    • at least one control unit (13) in which electric signals from the photocells (2, 5, 9) and the camera (7) are processed, and accordingly, electronic signals are transmitted to the deflecting piston (10) to classify the cylinders, and at least one operator display (14) through which the number of cylinders deflected or filled can be visually monitored and through which the type of cylinders is selected by an operator.
  • All cylinders to be filled are checked by the operator and classified according to their types prior to filling. If an operator fault is made during this check made around every 2 seconds as the line is proceeding, overfilled or underfilled LPG cylinders are delivered to the clients, this in turn leads to additional labor and product costs, customer dissatisfaction, and most significantly, the problems associated with the delivery of overfilled cylinders.
  • The system (1) is designed to be assembled on a conveyor line and is adapted to the conditions of explosive-inflammable environments. Cylinders which are successively conveyed on the conveyor line are first stopped by the primary stopper (3). The stopper (3), is kept open by means of the primary photocell (2) placed in front of the stopper (3) during a time interval in which only a single cylinder can be passed, such that the cylinders are entered into the recognition cabin one by one. A cylinder entering into the storage cabin (4) illuminated by an illuminator (8) is detected by means of a secondary photocell (5) when it comes below the camera (7), and is stopped by means of a specifically-designed cylinder centering stopper (6) just below the camera (7).
  • The image of the cylinder is captured by the camera (7); and the upper ring diameter and the collar size of the cylinder are determined by the control unit (13). If the cylinder conveyed to filling is not of the type determined by the operator, the control unit (13) does not allow the cylinder to be conveyed to filling and deflects the cylinder from the line by means of the deflecting piston (10). The operator display (14) allows both to select the type of cylinder and displays the whole process, the number of cylinders deflected and conveyed to filling.
  • The image of cylinders captured by the camera (7) is necessary to identify the type of cylinders, so when the camera is absent, the cylinder recognition system (1) will not work. The numbers of cylinders deflected and conveyed to filling and the selection of the type of cylinder intended for filling by the user is checked on the operator display (14). If this display is removed from the system (1), another method must be used to select the type of cylinders.
  • Since the camera (7) may capture an incorrect image when a cylinder does not come below the center of the camera, the cylinder centering stopper (6) is essential for the system. The control unit (13) comprises a PLC control system which enables to deflect the cylinders which are not intended for filling from the filling line. When the control unit (13) is lacking, these cylinders cannot be deflected from the line.
  • The cylinder deflecting piston (10) enables to deflect a cylinder not to be filled from the line with a command received from the control unit. If it is lacking, the cylinders cannot be deflected from the line.
  • Since the stoppers (3, 6) and photocells (2, 5, 9) control the flow and order of the cylinders on the line, their absence will cause an error in the system.
  • Firstly, the identification of cylinders is entirely performed by the camera (7), and it is not dependent on a data to be received from a human or from a barcode or label applied to the cylinder. Thus, all types of cylinders, of which the sizes are entered to the control unit (13), can be detected, such that only those cylinders intended for filling are filled. Additionally, extra costs and labor of a label or barcode applied to cylinders will be avoided. Since the system (1) is PLC controlled, it allows to monitor the deflected cylinders and to keep statistical data electronically on the filling process. The system (1) is designed to identify cylinders of differing designs.
  • A cylinder to be filled is first selected by the operator on the operator display (14). The operator display (14) is taken into a panel with keypads in order to comply with the conditions of inflammable and explosive environments.
  • Cylinders proceeded successively to filling on the conveyor line are detected by photocells (2, 5, 9). The control unit (13), warned by the photocells (2, 5, 9) - that a cylinder is conveyed to a filling unit, opens the primary stopper (3) and lets one cylinder to pass. When the primary photocell (2) detects another cylinder, the control unit (13) closes the stopper (3) so that the cylinders are entered to the storage cabin (4) one by one.
  • The entrance of cylinder to the storage cabin (4) which is aimed to isolate the camera (7) therein from external lights is detected by the secondary photocell (5). When the photocell (5) detects the cylinder which is moved below the camera (7), the control unit (13) transmits an electrical signal to close the centering stopper (6) which normally is open. On the centering stopper (6) disposed on both sides of the conveyor are provided semilunar metal plates specifically produced according to the form of cylinders. When the centering stopper (6) is closed, the respective cylinder is stopped just below the camera (7) for a short time.
  • When the control unit (13) detects that the cylinder is below the camera (7), it signalizes the camera (7) and illuminator (8) so that the image of the cylinder is captured. Meanwhile, the centering stopper (6) plates surrounding the cylinder make up a fixed background for the image to be taken by the camera (7).
  • The control unit (13) makes use of color and contrast differences within the image captured by the camera (7) and calculates the cylinder diameter, the collar size, and the pixel area occupied by the upper ring (grip). This area is compared to the pixel area occupied by different type of cylinders previously introduced to the control unit (13). The type of cylinders is determined as a result of this comparison.
  • The control unit (13) compares the type of the cylinder previously entered by the operator to the operator display (14) and the type identified by the camera (7), and according to the result of this comparison, the cylinder is conveyed either to the filling line (11) or to the deflected cylinder line (12).
  • When a cylinder decided to be deflected by the control unit (13) is detected by the photocell (9), a warning is transmitted to the deflecting piston (10) so that the cylinder is guided to the deflected cylinder line (12).
  • The number of cylinders conveyed to filling or deflected is monitored on the operator display (14).
  • The control unit (13) incorporates a PLC unit managing the cylinder identifying process, solenoid valves used for controlling the piston movements, pressure switches, and photocell amplifiers.
  • According to this basic principle, it is possible to develop many different embodiments of the cylinder recognition system (1) according to the present invention; therefore, the present invention is not to be restricted to the examples disclosed above and is basically defined in the claims.

Claims (8)

  1. A cylinder recognition system (1), comprising
    - at least one illuminator (8) providing the illumination of cylinders conveyed on a conveyor line to a filling unit in a storage cabin (4),
    - at least one camera (7) generating an image providing the classification of cylinders conveyed to a filling unit,
    - at least one primary photocell (2) detecting a cylinder conveyed to a filling unit and enabling it to enter into the storage cabin (4),
    - at least one primary stopper (3), which, when there is a cylinder present in the storage cabin (4), keeps the next cylinder on the line until the cabin is emptied,
    - at least one secondary photocell (5) detecting the entrance of a cylinder conveyed to a filling unit into the cabin (4),
    - at least one operator display (14) by which the number of cylinders conveyed to a filling unit and the number of cylinders deflected are monitored and the type of cylinder is selected,
    - at least one cylinder centering stopper (6) which stops a cylinder entered into the storage cabin (4) when it just comes to the center of the cabin,
    - at least one cylinder deflecting piston (10) differentiating the type of cylinders which are to be conveyed for filling from those which are not,
    - at least one secondary stopper (15) stopping those cylinders which are to be guided by the cylinder deflecting piston (10) for some time,
    - at least one third photocell (9) detecting the cylinders leaving the storage cabin (4) and activating the cylinder deflecting piston (10) to guide a cylinder leaving the cabin (4),
    - at least one filling line (11) by which the type of cylinders classified by the control unit (13) so as to be filled are conveyed for filling,
    - at least one deflected cylinder line (12) by which the type of cylinders classified by the control unit (13) and not to be filled are deflected from the filling line (11) and proceeded thereon, characterized by
    - at least one storage cabin (4) in which cylinders conveyed to a filling unit are stopped, their images are taken by a camera (7) and the type of cylinder is determined accordingly,
    - at least one control unit (13) making use of the color and contrast differences within the image captured by the camera (7) and calculating the cylinder diameter, the collar size, and the pixel area occupied by the upper ring (grip).
  2. A cylinder recognition system (1) according to Claim 1, characterized by at least one control unit (13) in which electric signals from the photocells (2, 5, 9) and the camera (7) are processed, and accordingly, electronic signals are transmitted to the deflecting piston (10) to provide the classification of cylinders.
  3. A cylinder recognition system (1) according to claim 1 or 2, characterized by at least one storage cabin (4) in which cylinders conveyed to a filling unit are stopped, their images are taken by the camera (7) and the type of cylinder is determined accordingly.
  4. A cylinder recognition system (1) according to any of the preceding claims, characterized by at least one control unit (13) providing the classification of cylinders by comparing the pixel areas occupied by defined cylinders of various types.
  5. A cylinder recognition system (1) according to any of the preceding claims, characterized by at least one control unit (13) comparing the type of the cylinder entered by the operator to the operator display (14) and the type of cylinder identified by the camera (7), and according to the result of this comparison, conveying the cylinder either to the filling line (11) or to the deflected cylinder line (12).
  6. A cylinder recognition system (1) according to any of the preceding claims, characterized by at least one operator display (14) both allowing to select the type of cylinder and showing the number of cylinders deflected from the line and conveyed for filling.
  7. A cylinder recognition system (1) according to any of the preceding claims, characterized by a centering stopper (6) stopping a cylinder on the conveyor line for a short time, when it just comes below the camera (7).
  8. A cylinder recognition system (1) according to any of the preceding claims, characterized by a control unit (13) closing the primary stopper (3) when the primary photocell (2) detects another cylinder on the conveyor line.
EP12199372.9A 2011-12-28 2012-12-25 A cylinder recognition system Not-in-force EP2610781B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TR201113152 2011-12-28

Publications (3)

Publication Number Publication Date
EP2610781A2 EP2610781A2 (en) 2013-07-03
EP2610781A3 EP2610781A3 (en) 2014-08-27
EP2610781B1 true EP2610781B1 (en) 2015-08-05

Family

ID=47469796

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12199372.9A Not-in-force EP2610781B1 (en) 2011-12-28 2012-12-25 A cylinder recognition system

Country Status (2)

Country Link
EP (1) EP2610781B1 (en)
DK (1) DK2610781T3 (en)

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3794761A (en) 1971-07-15 1974-02-26 Tokyo Shibaura Electric Co Pattern processing apparatus
DE4305559A1 (en) * 1993-02-24 1994-08-25 Hans Schiesl Arrangement and method for detecting the contours of objects
FR2750689B1 (en) * 1996-07-05 1998-11-06 Provencale D Automation Et De SIMPLIFICATION TO LPG FILLING PLANTS
DE19816881B4 (en) 1998-04-17 2012-01-05 Gunther Krieg Method and device for detecting and distinguishing between contaminations and acceptances as well as between different colors in solid particles
DE102007008619A1 (en) * 2007-02-22 2008-08-28 Recop Elektronic Gmbh Device for simultaneous view of complete periphery of container, particularly bottle, has camera with convex lens arranged in path of rays of camera
TR200703661A2 (en) * 2007-05-28 2008-12-22 Aygaz A.�. An automation system
TR200803303A2 (en) * 2008-05-09 2009-11-23 Aygaz Anon�M ��Rket� A control system.
TR200809620A2 (en) * 2008-12-18 2010-07-21 Aygaz Anon�M ��Rket� A leak control mechanism for LPG cylinders

Also Published As

Publication number Publication date
EP2610781A3 (en) 2014-08-27
DK2610781T3 (en) 2015-11-09
EP2610781A2 (en) 2013-07-03

Similar Documents

Publication Publication Date Title
US6473169B1 (en) Integrated leak and vision inspection system
CA2803514C (en) A checkout counter
US20020039183A1 (en) Integrated soft bag inspection system
US6473170B2 (en) Linear optical sensor for a closure
US5499718A (en) System and method for seeking and presenting an area for reading with a vision system
US6172748B1 (en) Machine vision system and method for non-contact container inspection
US20130176421A1 (en) Gob inspection system for glass product
US10309908B2 (en) Light field illumination container inspection system
WO2004036198A1 (en) Method and device for preparing reference image in glass bottle inspection device
KR20140076648A (en) Inspection and recycling of containers
EP1446656B1 (en) Method and apparatus for generating a robust reference image of a container and for selecting of a container
CN111652541B (en) Industrial production monitoring method, system and computer readable storage medium
CN109313144B (en) Method and system for inspecting an apparatus for optical inspection of glass containers
US7009697B2 (en) Method of monitoring closures on containers
EP2610781B1 (en) A cylinder recognition system
US7209575B2 (en) Method for visual inspection of printed matter on moving lids
EP3809108A1 (en) Leak tester
CN111570313A (en) Condom packaging box code detection system and detection method based on machine vision
WO2012005661A1 (en) A checkout counter
WO2017216536A1 (en) Product verification system
US20200130948A1 (en) Enhanced monitoring method in a drug containers handling line and drug containers handling line thereof
CN219785667U (en) Beverage filling quality detection device
US20230005127A1 (en) Method and device for detecting containers which have fallen over and/or are damaged in a container mass flow
US20230237636A1 (en) Vision inspection system for defect detection
US20220002129A1 (en) Device and method for providing sorted stopper elements

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: G06K 9/00 20060101AFI20140721BHEP

Ipc: F17C 5/00 20060101ALI20140721BHEP

Ipc: B07C 5/34 20060101ALI20140721BHEP

Ipc: B07C 5/12 20060101ALI20140721BHEP

17P Request for examination filed

Effective date: 20140926

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150325

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 741077

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150815

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602012009296

Country of ref document: DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 4

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20151102

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 741077

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150805

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151105

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151106

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151207

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151205

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602012009296

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151231

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20160509

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151225

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151231

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151225

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20121225

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20161225

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161225

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150805

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20181220

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20191210

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20191227

Year of fee payment: 8

Ref country code: FR

Payment date: 20191220

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191225

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602012009296

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20201231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210701

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201231