EP2207721B1 - Picking line and method for inserting products into a packaging container - Google Patents
Picking line and method for inserting products into a packaging container Download PDFInfo
- Publication number
- EP2207721B1 EP2207721B1 EP08804490A EP08804490A EP2207721B1 EP 2207721 B1 EP2207721 B1 EP 2207721B1 EP 08804490 A EP08804490 A EP 08804490A EP 08804490 A EP08804490 A EP 08804490A EP 2207721 B1 EP2207721 B1 EP 2207721B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- picker
- products
- image processing
- processing system
- quality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Not-in-force
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65B—MACHINES, APPARATUS OR DEVICES FOR, OR METHODS OF, PACKAGING ARTICLES OR MATERIALS; UNPACKING
- B65B35/00—Supplying, feeding, arranging or orientating articles to be packaged
- B65B35/10—Feeding, e.g. conveying, single articles
- B65B35/16—Feeding, e.g. conveying, single articles by grippers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65B—MACHINES, APPARATUS OR DEVICES FOR, OR METHODS OF, PACKAGING ARTICLES OR MATERIALS; UNPACKING
- B65B57/00—Automatic control, checking, warning, or safety devices
- B65B57/10—Automatic control, checking, warning, or safety devices responsive to absence, presence, abnormal feed, or misplacement of articles or materials to be packaged
- B65B57/14—Automatic control, checking, warning, or safety devices responsive to absence, presence, abnormal feed, or misplacement of articles or materials to be packaged and operating to control, or stop, the feed of articles or material to be packaged
Definitions
- the invention relates to a method according to the preamble of claim 1.
- Picker lines with an image processing system for detecting the positions of randomly oriented on a moving conveyor belt products are, for example US-A-5 040 056 and US-A-6,122,895 known.
- image processing systems for verifying predetermined quality characteristics, such as e.g. Color and shape of a product.
- the quality inspection of the products to be packaged such as e.g. Biscuits and the like small bakery products, usually by visual inspection of products delivered on a conveyor belt. Products that do not meet the quality specifications are sorted out manually.
- the invention has the object of providing a picker road of the type mentioned in such a way that only products are picked that meet predetermined quality requirements.
- Another object of the invention is the acquisition of quality data in a central system.
- Another object of the invention is to visualize the quality defects of the non-picked products.
- At least two pickers are arranged one behind the other in the transport direction, each picker being provided to the subsequent picker for transmitting the quality information serving as the control command for grasping or not grasping the products and the position data for the products not grasped by this picker ,
- Each picker passes the quality information obtained and the position data acquired by its position-image processing system to the next picker, with the quality data determined by the quality image processing system passing through all the pickers.
- each picker assumes the position data acquired by the preceding picker, i. the system is redundant.
- the picker preceding the failed picker transmits the quality information used as the control command for grasping or not grasping the products, and communicates the position data for the products not picked up by that picker to the picker following the failed picker.
- this picker is thus circulating, i. the quality information and the position data are transferred from the previous picker directly to the following picker.
- the products are displayed on a screen and the quality features captured by the quality image processing system for the products are visualized. Expediently, the products detected by the position image processing system are marked separately.
- the inventive pick & place system it is ensured that only products are picked that meet the specified quality requirements.
- the features are detected by a quality image processing system and classified the products according to their shape, color, structure or the presence of certain properties, such as seasoning mixture and the like ... This information is communicated to the individual pickers in the picker system.
- Each picker has its own position image processing system, as the products can shift over time.
- the quality information acquired by the quality image processing system is assigned to the products detected in the position image processing system with more exact coordinates. Unpicked products must be handed over to the picker with the general quality information "good” or "bad” in the direction of transport, the absence of only one of the quality information leading to the qualifier "poor” for the control of the picker.
- Bad products ie products which do not satisfy the quality requirements in at least one point, are not picked by any picker and leave the plant at their end.
- To locate the quality defects underlying causes are all a product associated quality information to the monitoring system explained below.
- a user interface usually a screen, available on the good and bad products and the type of error can be seen, so that it can be distinguished, whether products were not picked due to a lack of quality, or if there are other reasons that a product is not packed, eg in case of overload of the system or in case of insufficient adjustment of the system. It should also be recognized whether the pickers were able to assign the quality information to the products or whether the positional tolerance between the quality image processing system and the position image processing system was too great. The indication of the type of defect directly suggests problems in the manufacturing process of the products (e.g., wrong baking temperature, problems with applying a spice mixture, etc.) so that they can be remedied. Furthermore, the system should allow the continued operation of the line even in the event of failure of individual pickers and image processing systems.
- An in Fig. 1 Picker 10 shown has a revolving conveyor belt 12 for the transport of products to be packaged 14 in a transport direction x.
- a transport direction x Along the conveyor belt 12 are in the transport direction x three characterized by their work area pickers 18 1.1 , 18 1.2 , 18 1.3 and 18 2.1 , 18 2.2 , 18 2.3 arranged one behind the other in two parallel lines so that overlap the work areas and thus the Cover conveyor belt 12 over its entire width.
- each picker 18 1.1 , 18 1.2 , 18 1.3 and 18 2.1 , 18 2.2 , 18 2.3 extends each one of the respective picker associated position image processing system 20 1.1 , 20 1.2 , 20 1.3 and 20 2.1 , 20 2.2 , 20 2.3 transversely to the transport direction x over the region of the conveyor belt 12 covered by the respectively associated picker in such a way that each two position image processing systems cover the entire width of the conveyor belt.
- a quality image processing system 16 extends across the entire width of the conveyor belt 12. Errors and product characteristics that may be detected by the quality image processing system 16 include, for example, shape, damage, ink, imprints, etc.
- the picker line 10 comprises only two parallel rows, each with three pickers 18. However, fewer or more than three pickers 10 may be arranged in only one or more than two rows.
- a picker line 10 consists of a plurality of pickers 18 arranged one behind the other, which are arranged in one or more parallel rows. From the quality image processing system 16, all product data is sent to the first picker 18. In systems with several rows of pickers 18 arranged in parallel, each section of the product data corresponding to its working area, including an overlapping area, is transmitted to each first picker 18.
- Fig. 3 are the products 14 recognized and classified by the quality image processing system 16 and traveling on the conveyor belt 12 in the transport direction x on a screen 22 with their position on the conveyor belt in the form of rectangles in light shade as "good” (14g) or with one the type of error corresponding hatching as “bad” (14s) shown.
- Products (z) associated with the position imaging system 20 are shown in a darker hue.
- the current state of the product carpet on the conveyor belt 12 can be seen at any time. In particular, it can also be seen for which reason products 14 leave the plant unpacked, eg because of a recognized quality defect, an excessive position tolerance (data of the quality image processing system 16 and the position image processing system 20 could not be matched), or due to Overload of the system.
- a position-imaging system 16 fails, it is detected and the picker 18 affected by the failure receives the image processing data from the upstream picker 18 so that production can be maintained.
- the failure of a Picker waiveung can be detected, so that the data are communicated past the failed picker to the next operational picker. Only the failure of the quality image processing system 16 leads to the shutdown of the line.
- the positional deviation between communicated and locally detected data is displayed on screen 22 as a dash from the center of the locally detected product. If you only see one point there, the data is stable. This feature helps to adjust the offsets between multiple camera systems. Furthermore, the running of the tape, encoder synchronization problems and similar undesirable effects can be diagnosed.
- Each system sends its product data to the subsequent system as soon as the corresponding product has left the picker's work area. Correctly sent product data 14v are marked in a separate color.
- the visualization system is implemented on the local picker controls and shows there a section of the own work area as well as the work areas of the adjacent pickers.
- the system can also be implemented across plants and show the condition of the entire system.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Image Processing (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Image Analysis (AREA)
Abstract
Description
Die Erfindung betrifft ein Verfahren nach dem Oberbegriff des Anspruchs 1.The invention relates to a method according to the preamble of claim 1.
Pickerstrassen mit einem zum Bildverarbeitungssystem zum Erfassen der Positionen von in zufälliger Orientierung auf einem sich bewegenden Transportband angeordneten Produkten sind beispielsweise aus
Bekannt sind auch Bildverarbeitungssysteme zum Überprüfen von vorgegebenen Qualitätsmerkmalen, wie z.B. Farbe und Form eines Produktes.Also known are image processing systems for verifying predetermined quality characteristics, such as e.g. Color and shape of a product.
Bei Pickerstrassen zum Verpacken von Produkten nach dem Pick & Place System erfolgt die Qualitätsüberprüfung der zu verpackenden Produkte, wie z.B. Biskuits und dergleichen Kleinbackwaren, üblicherweise durch visuelle Prüfung der auf einem Transportband angelieferten Produkte. Produkte, die den Qualitätsvorgaben nicht entsprechen, werden manuell aussortiert.In picker lines for packaging products according to the pick & place system, the quality inspection of the products to be packaged, such as e.g. Biscuits and the like small bakery products, usually by visual inspection of products delivered on a conveyor belt. Products that do not meet the quality specifications are sorted out manually.
Grundsätzlich ist auch denkbar, die Qualität der auf einem Transportband angelieferten Produkte vor deren Verpackung in einer Pickerlinie mittels bekannter Bildverarbeitungssysteme zu überprüfen und nicht den geforderten Qualitätsstandards entsprechende Produkte z.B. nach dem in
Ein Verfahren der eingangs genannten Art ist aus
Der Erfindung liegt die Aufgabe zugrunde, eine Pickerstrasse der eingangs genannten Art so weiterzubilden, dass nur Produkte gepickt werden, die vorgegebenen Qualitätsanforderungen entsprechen.The invention has the object of providing a picker road of the type mentioned in such a way that only products are picked that meet predetermined quality requirements.
Ein anderes Ziel der Erfindung ist die Erfassung der Qualitätsdaten in einem zentralen System.Another object of the invention is the acquisition of quality data in a central system.
Ein weiteres Ziel der Erfindung ist eine Visualisierung der Qualitätsmängel der nicht gepickten Produkte.Another object of the invention is to visualize the quality defects of the non-picked products.
Zur efindungsgemässen Lösung der Aufgabe führt ein Verfahren mit den Merkmalen des Anspruchs 1.For efindungsgemässen solution of the problem leads a method having the features of claim 1.
Um auch höchsten Sicherheitsansprüchen zu genügen, können auch zwei Systeme redundant angelegt werden.In order to meet the highest security requirements, two systems can also be created redundantly.
Es sind wenigstens zwei mit je einem Positions-Bildverarbeitungssystem ausgestattete Picker in Transportrichtung hintereinander angeordnet, wobei jeder Picker zur Übermittlung der als Steuerbefehl zum Ergreifen oder Nichtergreifen der Produkte dienenden Qualitätsinformationen und der Positionsdaten für die von diesem Picker nicht ergriffenen Produkte an den nachfolgenden Picker vorgesehen ist.At least two pickers, each equipped with one position-processing system, are arranged one behind the other in the transport direction, each picker being provided to the subsequent picker for transmitting the quality information serving as the control command for grasping or not grasping the products and the position data for the products not grasped by this picker ,
Jeder Picker gibt die erhaltenen Qualitätsinformationen und die von seinem Positions-Bildverarbeitungssystem erfassten Positionsdaten jeweils an den nächsten Picker weiter, wobei die vom Qualitäts-Bildverarbeitungssystem ermittelten Qualitätsdaten bei allen Pickern durchlaufen. Bei Ausfall seines eigenen Positions-Bildverarbeitungssystems übemimmt jeder Picker die vom vorangehenden Picker erfassten Positionsdaten, d.h. das System ist redundant ausgelegt.Each picker passes the quality information obtained and the position data acquired by its position-image processing system to the next picker, with the quality data determined by the quality image processing system passing through all the pickers. In the event of failure of its own position imaging system, each picker assumes the position data acquired by the preceding picker, i. the system is redundant.
Bei Ausfall eines Bildverarbeitungssystem oder eines Pickers werden die als Steuerbefehl zum Ergreifen oder Nichtergreifen der Produkte dienenden Qualitätsinformationen und die Positionsdaten für die von diesem Picker nicht ergriffenen Produkte an den nächsten Picker übermitteltIn case of failure of an image processing system or a picker that are as a control command for the grasping or non-grasping of the products serving quality information and the position data for the products not picked up by this picker products to the next picker
Bei einem Ausfall eines Pickers übermittelt der dem ausgefallenen Picker vorangehende Picker die als Steuerbefehl zum Ergreifen oder Nichtergreifen der Produkte dienenden Qualitätsinfortnationen und die Positionsdaten für die von diesem Picker nicht ergriffenen Produkte an den dem ausgefallenen Picker nachfolgenden Picker übermittelt. Bei einem Totalausfall eines Pickers wird dieser Picker somit umlaufen, d.h. die Qualitätsinformationen und die Positionsdaten gehen vom vorangehenden Picker direkt auf den nachfolgenden Picker über.In the event of failure of a picker, the picker preceding the failed picker transmits the quality information used as the control command for grasping or not grasping the products, and communicates the position data for the products not picked up by that picker to the picker following the failed picker. In a total failure of a picker this picker is thus circulating, i. the quality information and the position data are transferred from the previous picker directly to the following picker.
Als Qualitätskriterien werden bevorzugt Form und Farbe der Produkte und das Vorhandensein bildlicher Merkmale auf den Produkten ausgewertet.As quality criteria, preference is given to the shape and color of the products and the presence of pictorial features on the products.
Bei einem bevorzugten Verfahren werden die Produkte an einem Bildschirm dargestellt und die vom Qualitäts-Bildverarbeitungssystem für die Produkte erfassten Qualitätsmerkmale visualisiert. Zweckmässigerweise werden dabei die vom Positions-Bildverarbeitungssystem erfassten Produkte gesondert markiert.In a preferred method, the products are displayed on a screen and the quality features captured by the quality image processing system for the products are visualized. Expediently, the products detected by the position image processing system are marked separately.
Mit dem erfindungsgemässen Pick & Place System ist sichergestellt, dass nur Produkte gepickt werden, die vorgegebenen Qualitätsanforderungen entsprechen. Die Merkmale werden dabei von einem Qualitäts-Bildverarbeitungssystem erfasst und die Produkte entsprechend ihrer Form, Farbe, Struktur oder dem Vorhandensein bestimmter Eigenschaften, wie Würzmischung und dgl., klassiert. Diese Informationen werden in der Pickeranlage an die einzelnen Picker kommuniziert. Dabei hat jeder Picker ein eigenes Positions-Bildverarbeitungssystem, da sich die Produkte im Laufe der Zeit verschieben können. Die vom Qualitäts-Bildverarbeitungssystem erfassten Qualitätsinformationen werden den im Positions-Bildverarbeitungssystem mit exakteren Koordinaten erfassten Produkten zugeordnet. Nicht gepickte Produkte müssen dem in Transportrichtung nachfolgenden Picker mit der generellen Qualitätsinformation "gut" bzw. "schlecht" übergeben werden, wobei das Fehlen nur einer der Qualitätsinformationen zu der für die Steuerung des Pickers massgeblichen Qualifikation "schlecht" führt. Schlechte, d.h. den Qualitätsanforderungen in mindestens einem Punkt nicht genügende Produkte, werden von keinem Picker gepickt und verlassen die Anlage an ihrem Ende. Zur Ortung der den auftretenden Qualitätsmängeln zugrunde liegenden Ursachen werden alle einem Produkt zugehörigen Qualitätsinformationen an das nachfolgend erläuterte Überwachungssystem weitergegeben.With the inventive pick & place system it is ensured that only products are picked that meet the specified quality requirements. The features are detected by a quality image processing system and classified the products according to their shape, color, structure or the presence of certain properties, such as seasoning mixture and the like .. This information is communicated to the individual pickers in the picker system. Each picker has its own position image processing system, as the products can shift over time. The quality information acquired by the quality image processing system is assigned to the products detected in the position image processing system with more exact coordinates. Unpicked products must be handed over to the picker with the general quality information "good" or "bad" in the direction of transport, the absence of only one of the quality information leading to the qualifier "poor" for the control of the picker. Bad products, ie products which do not satisfy the quality requirements in at least one point, are not picked by any picker and leave the plant at their end. To locate the quality defects underlying causes are all a product associated quality information to the monitoring system explained below.
Zur Überwachung der Pickerlinie ist zweckmässigerweise ein User Interface, üblicherweise ein Bildschirm, vorhanden, auf dem gute und schlechte Produkte sowie die Fehlerart zu erkennen sind, so dass unterschieden werden kann, ob Produkte aufgrund eines Qualitätsmangels nicht gepickt wurden, oder ob andere Gründe vorliegen, dass ein Produkt nicht verpackt wird, z.B. bei Überlast der Anlage oder bei mangelhafter Justierung der Anlage. Weiter soll zu erkennen sein ob die Picker die Qualitätsinformation den Produkten zuordnen konnten oder ob die Positionstoleranz zwischen Qualitäts-Bildverarbeitungssystem und Positions-Bildverarbeitungssystem zu gross war. Die Anzeige der Fehlerart lässt direkt auf Probleme im Herstellungsprozess der Produkte (z.B. falsche Backtemperatur, Probleme mit dem Aufbringen einer Gewürzmischung etc.) schliessen, so dass diese behoben werden können. Weiter soll das System das Weiterbetreiben der Linie auch beim Ausfall einzelner Picker und Bildverarbeitungssystemen erlauben.To monitor the picker line is conveniently a user interface, usually a screen, available on the good and bad products and the type of error can be seen, so that it can be distinguished, whether products were not picked due to a lack of quality, or if there are other reasons that a product is not packed, eg in case of overload of the system or in case of insufficient adjustment of the system. It should also be recognized whether the pickers were able to assign the quality information to the products or whether the positional tolerance between the quality image processing system and the position image processing system was too great. The indication of the type of defect directly suggests problems in the manufacturing process of the products (e.g., wrong baking temperature, problems with applying a spice mixture, etc.) so that they can be remedied. Furthermore, the system should allow the continued operation of the line even in the event of failure of individual pickers and image processing systems.
Das vorgeschlagene System mit dem erfindungsgemässen Verfahren beinhaltet u.a. die folgenden Vorteile:
- Das Qualitäts-Bildverarbeitungssystem ist unabhängig vom Positions- Bildverarbeitungssystem. Dabei ist die Lokalisierung durch Positions- Bildverarbeitungssysteme für alle Arten von Produkten Standard, das Qualitäts-Bildverarbeitungssystem wird jeweils projektspezifisch angepasst.
- Es gibt nur ein Qualitäts-Bildverarbeitungssystem, was eine einfache Handhabung ermöglicht und zu einer Kostenersparnis führt.
- Der Grund für nicht gepickte Produkte ist sofort ersichtlich, z.B. mangelhafte Qualität der Produkte und welches Qualitätsproblem konkret vorliegt, so dass in den Prozessanlagen korrigiert werden kann, oder Probleme bei der Zuordnung der Produkte im Positions-Bildverarbeitungssystem wegen zu grosser Toleranz zwischen Qualitäts- und Positions- Bildverarbeitungssystem, Überlast der Picker etc.
- Da gute und schlechte Produkte unterschiedlich visualisiert werden, ergeben sich intuitiv Leamings über das Systernverhalten. Z.B. erkennt man bei mehrbahnigen Linien sehr schnell, auf welcher Bahn quer zur Bandlaufrichtung die meisten Problem auftreten. Dies erlaubt Rückschlüsse auf den Ort einer möglichen Prozessoptimierung.
- Hohe Fehlertoleranz beim Ausfall einzelner Picker oder Vision Systeme.
- The quality image processing system is independent of the position image processing system. Localization by means of positional image processing systems is standard for all types of products, and the quality image processing system is adapted to each project.
- There is only one quality image processing system, which allows easy handling and saves money.
- The reason for non-pickled products is immediately apparent, eg poor quality of the products and what quality problem exists concretely, so that can be corrected in the process equipment, or problems in the allocation of products in the position-image processing system because of too great a tolerance between quality and position - Image processing system, overload of the picker etc.
- Since good and bad products are visualized differently, there are intuitive leamings about the system behavior. For example, one recognizes in multi-lane Lines very fast, on which web transverse to the tape direction the most problem occur. This allows conclusions about the location of a possible process optimization.
- High fault tolerance in case of failure of individual picker or vision systems.
Weitere Vorteile, Merkmale und Einzelheiten der Erfindung ergeben sich aus der nachfolgenden Beschreibung bevorzugter Ausführungsbeispiele sowie anhand der Zeichnung; diese zeigt schematisch in
- Fig. 1:
- eine Draufsicht auf eine Pickerstrasse;
- Fig. 2:
- das Erkennen eines von einem Qualitäts-Bildverarbeitungssystem charakterisierten Produktes durch ein einem Picker zugeordneten Positions- Bildverarbeitungssystem;
- Fig. 3:
- auf einem Bildschirm dargestellte Produkte mit visualisierten Quali- tätsmerkmalen.
- Fig. 1:
- a plan view of a picker road;
- Fig. 2:
- recognizing a product characterized by a quality image processing system by a position image processing system associated with a picker;
- 3:
- Products displayed on a screen with visualized quality features.
Eine in
Im gezeigten Ausführungsbeispiel umfasst die Pickerstrasse 10 nur zwei parallele Reihen mit je drei Pickern 18. Es können jedoch auch weniger oder mehr als drei Picker 10 in nur einer oder in mehr als zwei Reihen angeordnet sein. Allgemein besteht eine Pickerstrasse 10 aus mehreren, hintereinander angeordneten Pickern 18, die in einer oder mehreren parallelen Reihen angeordnet sind. Vom Qualitäts-Bildverarbeitungssystem 16 werden alle Produktdaten an den ersten Picker 18 gesendet. Bei Anlagen mit mehreren parallel angeordneten Reihen von Pickern 18 wird an jeden ersten Picker 18 der seinem Arbeitsbereich einschliesslich eines Überlappungsbereiches entsprechende Ausschnitt aus den Produktdaten übermittelt.In the exemplary embodiment shown, the
Die zu verpackenden Produkt 14 - z.B. von einem Backofen verpackungsfertig zur Pickerstrasse 10 überführte Kleinbackwaren - werden in Transportrichtung x stromauf des Qualitäts-Bildverarbeitungssystems 16 regellos über die ganze Breite des Transportbandes 12 verteilt der Pickerstrasse 10 übergeben. Beim Durchlaufen der Produkte 14 unter dem Qualitäts-Bildverarbeitungssystem 16 werden von jedem Produkt 14 neben seiner Position auf dem Transportband 12 vorbestimmte Qualitätsmerkmale wie Form, Farbe und dgl. am fertigen Produkt 14 erkennbare, zur Bestimmung der Produktqualität geeignete Eigenschaften registriert und an die in Transportrichtung x stromab des Qualitäts-Bildverarbeitungssystems 16 angeordneten ersten Picker 18 übermittelt. Beim Durchlaufen der Produkte 14 unter dem Positions-Bildverarbeitungssystem 20 der ersten Picker 18 werden die exakten Koordinaten der Produkte 14 auf dem Transportband 12 erfasst und mit den im Qualitäts-Bildverarbeitungssystem 16 registrierten Daten verglichen, wobei wegen der weniger genauen Positionsermittlung durch das Qualitäts-Bildverarbeitungssystem 16 die Zuordnung der von diesem System stammenden Daten durch das Positions-Bildverarbeitungssystem 20 über ein Toleranzfenster 24 erfolgt (
- P1:
- Lokale, vom Positions-Bildverarbeitungssystem 20 des Pickers 18 erfasste Position
- P2:
- vom Qualitäts-
Bildverarbeitungssystem 16 erfasste, innerhalb des Toleranzfensters 24 liegende Position - P3:
- vom Qualitäts-
Bildverarbeitungssystem 16 erfasste, ausserhalb des Toleranzfensters 24 liegende Position - x, y:
- Positionskoordinaten, für P1 der Lage des Toleranzfensters, für P2 und P3 der Orientierung des Transportbandes 12 entsprechend
- P1:
- Local position detected by the position image processing system 20 of the picker 18
- P2:
- detected by the quality
image processing system 16, within thetolerance window 24 lying position - P3:
- detected by the quality
image processing system 16, outside thetolerance window 24 lying position - x, y:
- Position coordinates, for P1 the position of the tolerance window, for P2 and P3 the orientation of the
conveyor belt 12 accordingly
Nur ein Produkt 14, dessen vom Qualitäts-Bildverarbeitungssystem 16 erfasste Position P2 innerhalb des Toleranzfensters 24 liegt, wird vom Picker 18 gepickt, sofern die Qualitätsanforderungen für dieses Produkt erfüllt sind. Das Produkt 14 mit ausserhalb des Toleranzfensters 24 liegender Position P3 wird - ungeachtet der Qualität - nicht gepickt.Only a
In
Am Bildschirm 22 ist jederzeit der aktuelle Zustand des Produktteppichs auf dem Transportband 12 zu sehen. Insbesondere ist auch zu erkennen, aus welchem Grund Produkte 14 die Anlage unverpackt verlassen, also z.B. wegen einem erkannten Qualitätsmangel, einer zu grosse Positionstoleranz (Daten des Qualitäts-Bildverarbeitungssystems 16 und des Positions-Bildverarbeitungssystems 20 konnten nicht in Übereinstimmung gebracht werden), oder wegen Überlast der Anlage.On the
Fällt ein Positions-Bildverarbeitungssystem 16 aus, wird dies erkannt, und dem vom Ausfall betroffenen Picker 18 werden die Bildverarbeitungsdaten des vorgelagerten Pickers 18 übermittelt, so dass die Produktion aufrechterhalten werden kann. Auch der Ausfall einer Pickersteuerung kann erkannt werden, so dass die Daten am ausgefallenen Picker vorbei an den nächsten einsatzfähigen Picker kommuniziert werden. Lediglich der Ausfall des Qualitäts-Bildverarbeitungssystems 16 führt zum Abschalten der Linie.If a position-
Die Positionsabweichung zwischen kommunizierten und lokal detektierten Daten wird auf dem Bildschirm 22 als Strich aus dem Zentrum des lokal detektierten Produkts dargestellt. Sieht man dort nur einen Punkt sind die Daten stabil. Diese Funktion hilft beim Einjustieren der Offsets zwischen mehreren Kamerasystemen. Weiterhin können das Ablaufen des Bandes, Encoder- Synchronisationsprobleme und ähnliche unerwünschte Effekte diagnostiziert werden.The positional deviation between communicated and locally detected data is displayed on
Am Bildschirm 22 wird für jedes lokal detektierte Teil (= Teil, das vom Qualitäts-Bildverarbeitungssystem erkannt und vom Positions-Bildverarbeitungssystem des Pickers erfasst wurde) mit der Position P1 dargestellt, ob es ein passendes Remote Teil (=Teil, das vom Qualitäts-Bildverarbeitungssystem erkannt und vom Positions-Bildverarbeitungssystem nicht erfasst wurde) mit einer innerhalb des Toleranzfensters 24 liegenden Position P2 gibt. Hierbei sind die folgenden Zustände zu unterscheiden:
- Für eine lokal detektiertes Teil ist ein passendes Remote Teil vorhanden: Das lokal detektierte Teil kann mit einer Qualitätsinformation verknüpft werden. Falls die Qualität den Anforderungen entspricht, wird das Produkt an die Picker-Warteschlange kommuniziert.
- Für ein lokal detektiertes Teil ist kein passendes Remote Teil vorhanden: Das Produkt wird nicht an die Picker-Warteschlange kommuniziert.
- Es ist ein Remote Teil vorhanden, aber es wird kein entsprechendes Teil lokal detektiert: Vermutlich wurde das Teil bereits von einem vorhergehenden Picker verpackt. Es erfolgt keine Datenübermittlung an die Picker-Warteschlange.
- For a locally detected part there is a suitable remote part: The locally detected part can be linked with a quality information. If the quality meets the requirements, the product is communicated to the picker queue.
- There is no matching remote part for a locally detected part: the product is not communicated to the picker queue.
- There is a remote part, but no corresponding part is detected locally: Presumably the part was already packed by a previous picker. There is no data transmission to the picker queue.
Jedes System versendet seine Produktdaten an das nachfolgende System, sobald das entsprechende Produkt aus dem Arbeitsbereich des Pickers herausgelaufen ist. Korrekt versendete Produktdaten 14v werden in einer eigenen Farbe markiert.Each system sends its product data to the subsequent system as soon as the corresponding product has left the picker's work area. Correctly sent
Im gezeigten Beispiel ist das Visualisierungssystem auf den lokalen Pickersteuerungen implementiert und zeigt dort jeweils einen Ausschnitt aus dem eigenen Arbeitsbereich sowie den Arbeitsbereichen der angrenzenden Pickern. Das System kann jedoch auch anlageübergreifend implementiert werden und den Zustand der Gesamtanlage zeigen.In the example shown, the visualization system is implemented on the local picker controls and shows there a section of the own work area as well as the work areas of the adjacent pickers. However, the system can also be implemented across plants and show the condition of the entire system.
Claims (4)
- Method for inserting products into a packaging container using a picking line with a conveyor belt (12) for delivering and transporting the products (14) in a direction of transport (x) and with at least one picker (18) which is assigned to the conveyor belt and is provided with a position image processing system (20) for determining the position of the products (14) on the conveyor belt (12), a quality image processing system (16) which is arranged upstream of the at least one picker (18) in the direction of transport (x) being used to check the products (14) running past the quality image processing system (16) on the conveyor belt (12) in the direction of transport (x) for predefined quality features, and an item of quality information which is to be transmitted to the picker (18) adjoining the quality image processing system (16) downstream in the direction of transport (x) and is used as a control command for grabbing or not grabbing the products (14) being assigned to the products (14),
characterized in that
at least two pickers (18) which are each provided with a position image processing system (20) are arranged behind one another in the direction of transport (x), each picker (18) transmitting the quality information, which is used as a control command for grabbing or not grabbing the products (14), and the position data for the products (14) which have not been grabbed by this picker (18) to the downstream picker (18), and(a) if an image processing system (16, 20) or a picker (18) fails, the quality information, which is used as a control command for grabbing or not grabbing the products (14), and the position data for the products (14) which have not been grabbed by this picker (18) are transmitted to the next picker (18), or(b) if a picker (18) fails, the picker (18) preceding the failed picker (18) transmits the quality information, which is used as a control command for grabbing or not grabbing the products (14), and the position data for the products (14) which have not been grabbed by this picker (18) to the picker (18) following the failed picker (18). - Method according to Claim 1, characterized in that the shape and colour of the products (14) and the presence of graphical features on the products (14) are evaluated as quality criteria.
- Method according to Claim 1 or 2, characterized in that the products (14) are displayed on a screen (22) and the quality features detected by the quality image processing system (16) for the products (14) are visualized.
- Method according to Claim 3, characterized in that the products (14) detected by the position image processing system (20) are marked separately.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102007049702A DE102007049702A1 (en) | 2007-10-17 | 2007-10-17 | picking line |
PCT/EP2008/062561 WO2009049990A1 (en) | 2007-10-17 | 2008-09-19 | Picking line and method for inserting products into a packaging container |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2207721A1 EP2207721A1 (en) | 2010-07-21 |
EP2207721B1 true EP2207721B1 (en) | 2011-06-01 |
Family
ID=40130633
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP08804490A Not-in-force EP2207721B1 (en) | 2007-10-17 | 2008-09-19 | Picking line and method for inserting products into a packaging container |
Country Status (7)
Country | Link |
---|---|
US (1) | US8387342B2 (en) |
EP (1) | EP2207721B1 (en) |
JP (1) | JP5415431B2 (en) |
AT (1) | ATE511476T1 (en) |
DE (1) | DE102007049702A1 (en) |
ES (1) | ES2367090T3 (en) |
WO (1) | WO2009049990A1 (en) |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2939769B1 (en) * | 2008-12-11 | 2010-12-31 | Ballina Freres De | METHOD AND INSTALLATION FOR DISTRIBUTING PRODUCTS FOR THEIR PACKAGING |
EP2236424B1 (en) * | 2009-03-30 | 2016-02-24 | Veltru AG | Method and device for inserting individual products into containers in a robot street |
US9818070B2 (en) | 2011-07-22 | 2017-11-14 | Packsize Llc | Tiling production of packaging materials |
TW201422401A (en) * | 2012-12-03 | 2014-06-16 | Hon Hai Prec Ind Co Ltd | Detecting system and method for finished goods of taking out |
US10922637B2 (en) | 2013-01-18 | 2021-02-16 | Packsize Llc | Tiling production of packaging materials |
CN105229681B (en) | 2013-01-18 | 2020-12-29 | 派克赛泽有限责任公司 | Splicing production of packaging materials |
CN107073718B (en) * | 2014-11-06 | 2020-06-12 | 株式会社富士 | Component supply device |
EP3288751A4 (en) | 2015-04-29 | 2019-01-23 | Packsize LLC | Tiling production of packaging materials |
CN106697435A (en) * | 2016-11-23 | 2017-05-24 | 河池学院 | Quality inspection robot for carton production line |
CN106586131A (en) * | 2016-11-23 | 2017-04-26 | 河池学院 | Fruit packaging assembly line quality-inspection robot |
US11092946B2 (en) | 2016-12-01 | 2021-08-17 | Packsize Llc | Identifying and managing equipment within an operational environment |
CN106628421B (en) * | 2017-02-15 | 2022-05-03 | 常州汇拓科技有限公司 | Cap arranging and picking device of gun cap and cap arranging and picking method thereof |
EP3647235B1 (en) * | 2017-06-30 | 2023-09-20 | Panasonic Intellectual Property Management Co., Ltd. | Projection indication device, parcel sorting system, and projection indication method |
DE102019202008A1 (en) * | 2019-02-14 | 2020-08-20 | Krones Aktiengesellschaft | Method for controlling and / or regulating a shrink tunnel and device for shrinking thermoplastic packaging material onto articles |
CN114275236B (en) * | 2022-01-13 | 2023-02-28 | 上海柠喆机械科技有限公司 | Method for controlling a device for handling pallets containing products of approximately circular or elliptical shape |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5040056A (en) | 1990-01-29 | 1991-08-13 | Technistar Corporation | Automated system for locating and transferring objects on a conveyor belt |
US5041907A (en) * | 1990-01-29 | 1991-08-20 | Technistar Corporation | Automated assembly and packaging system |
JPH05265535A (en) * | 1992-03-18 | 1993-10-15 | Tokico Ltd | Robot controller |
FR2725640B1 (en) * | 1994-10-12 | 1997-01-10 | Pellenc Sa | MACHINE AND METHOD FOR SORTING VARIOUS OBJECTS USING AT LEAST ONE ROBOTIZED ARM |
JP3216033B2 (en) * | 1995-04-20 | 2001-10-09 | オムロン株式会社 | Inspection result output device, inspection result output method, substrate inspection system using this inspection result output device, and substrate inspection method using this inspection result output method |
JPH09218158A (en) * | 1996-02-08 | 1997-08-19 | Nireco Corp | Method for evaluating apperarance of object |
JP3089337B2 (en) * | 1996-10-18 | 2000-09-18 | 株式会社フジキカイ | Method and apparatus for sorting conveyed articles |
DE19651717A1 (en) * | 1996-12-12 | 1998-06-18 | Schubert Gerhard Gmbh | Product scanner |
DE29701564U1 (en) | 1997-01-30 | 1997-03-27 | Gerhard Schubert GmbH, 74564 Crailsheim | Picker line with opposite tray transport |
JP3673414B2 (en) * | 1998-11-24 | 2005-07-20 | 株式会社ニレコ | Saijo visual inspection equipment |
JP2000219317A (en) * | 1999-01-29 | 2000-08-08 | Hitachi Zosen Corp | Cargo handling/sorting device |
CH693710A5 (en) * | 1999-07-02 | 2003-12-31 | Sig Pack Systems Ag | A method for picking and placing of packaged goods. |
JP2002037441A (en) * | 2000-07-19 | 2002-02-06 | Kawasaki Heavy Ind Ltd | Aligning method and aligning apparatus for random work |
GB2356699A (en) * | 1999-11-23 | 2001-05-30 | Robotic Technology Systems Plc | Providing information of moving objects |
JP2002116810A (en) * | 2000-10-06 | 2002-04-19 | Seiko Instruments Inc | Tracking system |
JP3551188B2 (en) * | 2002-01-10 | 2004-08-04 | オムロン株式会社 | Surface condition inspection method and substrate inspection device |
ATE371617T1 (en) | 2002-08-26 | 2007-09-15 | Abb Ab | AUTOMATED PRODUCTION SYSTEM FOR OBJECT IDENTIFICATION, SELECTION AND TRANSPORT |
JP2005111607A (en) * | 2003-10-07 | 2005-04-28 | Fanuc Ltd | Material flow tracking device using robot |
ITMI20040787A1 (en) * | 2004-04-22 | 2004-07-22 | Vortex Systems Srl | SYSTEM OF TRANSFER OF FOOD PRODUCTS THROUGH COLLECTORS |
WO2005119774A1 (en) * | 2004-06-01 | 2005-12-15 | Manufacturing Integration Technology Ltd | Method and apparatus for precise marking and placement of an object |
JP4864363B2 (en) * | 2005-07-07 | 2012-02-01 | 東芝機械株式会社 | Handling device, working device, and program |
-
2007
- 2007-10-17 DE DE102007049702A patent/DE102007049702A1/en not_active Withdrawn
-
2008
- 2008-09-19 WO PCT/EP2008/062561 patent/WO2009049990A1/en active Application Filing
- 2008-09-19 ES ES08804490T patent/ES2367090T3/en active Active
- 2008-09-19 EP EP08804490A patent/EP2207721B1/en not_active Not-in-force
- 2008-09-19 US US12/738,424 patent/US8387342B2/en not_active Expired - Fee Related
- 2008-09-19 JP JP2010529321A patent/JP5415431B2/en not_active Expired - Fee Related
- 2008-09-19 AT AT08804490T patent/ATE511476T1/en active
Also Published As
Publication number | Publication date |
---|---|
ES2367090T3 (en) | 2011-10-28 |
ATE511476T1 (en) | 2011-06-15 |
JP2011500464A (en) | 2011-01-06 |
EP2207721A1 (en) | 2010-07-21 |
US20100223883A1 (en) | 2010-09-09 |
US8387342B2 (en) | 2013-03-05 |
JP5415431B2 (en) | 2014-02-12 |
WO2009049990A1 (en) | 2009-04-23 |
DE102007049702A1 (en) | 2009-04-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2207721B1 (en) | Picking line and method for inserting products into a packaging container | |
EP2679356B1 (en) | Method and apparatus for handling portions | |
EP2678745B1 (en) | Method for setting up a conveying device | |
DE19643997A1 (en) | Process for monitoring a conveyor belt and system for carrying out the process | |
DE102010005267A1 (en) | Conveying device for use with attachment device for packaged goods distribution system for packaged goods, has conveying head which has receiving area for manual placing of packaged goods | |
EP2910476B2 (en) | Process for product formatting of food products on a conveyor | |
DE4122037A1 (en) | DEVICE AND METHOD FOR CONTROLLING A LINE PRODUCTION | |
DE102014102092A1 (en) | Method and station for picking articles according to the goods-to-man principle | |
WO2009021650A1 (en) | Method and device for separating bulk material | |
EP1346911A1 (en) | Freight loading system for a freight deck of an aircraft | |
EP0613732B1 (en) | Method and device for testing the working capacity of inspection units in bottle inspecting machines | |
DE102017110861A1 (en) | Apparatus and method for controlling a flow of material at a material flow node | |
EP3744665B1 (en) | Conveyor system and method for monitoring and / or maintaining a conveyor system | |
DE69800375T2 (en) | Above-ground system for transporting, storing, classifying and checking light products | |
DE102005026683A1 (en) | Multiple sheet feed detection apparatus, sorter and multiple sheet feed detection method | |
DE102017120730A1 (en) | Device and method for aligning containers | |
EP2509903B1 (en) | Control device, computer program product and method for controlling a printed-product processing system | |
CH693710A5 (en) | A method for picking and placing of packaged goods. | |
DE2831843A1 (en) | CONVEYOR | |
DE102019135620B4 (en) | Optical teaching of camera-recorded routes | |
DE102019119356B4 (en) | Window conveyor technology, order picking system and manual order picking process | |
EP2818254A1 (en) | Device for singulating piece goods | |
EP3216530B1 (en) | Sorting system | |
DE102021113060A1 (en) | Device and method for handling and/or grouping piece goods | |
DE102012201965B4 (en) | Method and device for dividing a disordered mass flow of articles or containers |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20100517 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA MK RS |
|
DAX | Request for extension of the european patent (deleted) | ||
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502008003749 Country of ref document: DE Effective date: 20110714 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: T3 |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: TRGR |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2367090 Country of ref document: ES Kind code of ref document: T3 Effective date: 20111028 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110901 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110902 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FD4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111003 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111001 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 |
|
BERE | Be: lapsed |
Owner name: ROBERT BOSCH G.M.B.H. Effective date: 20110930 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110930 |
|
26N | No opposition filed |
Effective date: 20120302 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502008003749 Country of ref document: DE Effective date: 20120302 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110919 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110901 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110601 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 511476 Country of ref document: AT Kind code of ref document: T Effective date: 20130919 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130919 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20190917 Year of fee payment: 12 Ref country code: DE Payment date: 20190903 Year of fee payment: 12 Ref country code: SE Payment date: 20190910 Year of fee payment: 12 Ref country code: FR Payment date: 20190913 Year of fee payment: 12 Ref country code: NL Payment date: 20190912 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20190919 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20190925 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20191001 Year of fee payment: 12 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 502008003749 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MM Effective date: 20201001 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20200919 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201001 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200930 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210401 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200930 Ref country code: SE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200920 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200930 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200919 |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: EUG |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200919 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20220118 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200920 |