EP3763448B1 - Verfahren und vorrichtung zum erzeugen und aufrechterhalten einer zuordnung von gegenstandsdaten und position eines gegenstands - Google Patents

Verfahren und vorrichtung zum erzeugen und aufrechterhalten einer zuordnung von gegenstandsdaten und position eines gegenstands Download PDF

Info

Publication number
EP3763448B1
EP3763448B1 EP19185901.6A EP19185901A EP3763448B1 EP 3763448 B1 EP3763448 B1 EP 3763448B1 EP 19185901 A EP19185901 A EP 19185901A EP 3763448 B1 EP3763448 B1 EP 3763448B1
Authority
EP
European Patent Office
Prior art keywords
data
object data
optical
transfer point
delivery path
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP19185901.6A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP3763448A1 (de
Inventor
Jan BEHLING
Jan Josef Jesper
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beumer Group GmbH and Co KG
Fraunhofer Gesellschaft zur Foerderung der Angewandten Forschung eV
Original Assignee
Beumer Group GmbH and Co KG
Fraunhofer Gesellschaft zur Foerderung der Angewandten Forschung eV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beumer Group GmbH and Co KG, Fraunhofer Gesellschaft zur Foerderung der Angewandten Forschung eV filed Critical Beumer Group GmbH and Co KG
Priority to EP19185901.6A priority Critical patent/EP3763448B1/de
Priority to PL19185901.6T priority patent/PL3763448T3/pl
Priority to JP2020119076A priority patent/JP7426910B2/ja
Priority to US16/925,566 priority patent/US11583898B2/en
Publication of EP3763448A1 publication Critical patent/EP3763448A1/de
Application granted granted Critical
Publication of EP3763448B1 publication Critical patent/EP3763448B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B07—SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07C—POSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00—Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/04—Sorting according to size
    • B07C5/10—Sorting according to size measured by light-responsive means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B07—SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07C—POSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C3/00—Sorting according to destination
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B07—SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07C—POSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00—Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/04—Sorting according to size
    • B07C5/12—Sorting according to size characterised by the application to particular articles, not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B07—SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07C—POSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00—Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/36—Sorting apparatus characterised by the means used for distribution
    • B07C5/361—Processing or control devices therefor, e.g. escort memory
    • B07C5/362—Separating or distributor mechanisms

Definitions

  • the invention relates to a method and a device for generating and maintaining an association of item data of an item with a changing physical position of the item in a sorting device which has at least one input for feeding items to the sorting device and a multiplicity of transfer points at which selected Objects can be ejected from the sorting device.
  • the sorting data available via the sorting conveyor control system for the objects on the sorting conveyor can be accessed, in which case, for example, an image comparison or a comparison of other identification features such as barcodes, etc. can be done.
  • a sorting system e.g. a sorting conveyor
  • the sorting data available via the sorting conveyor control system for the objects on the sorting conveyor can be accessed, in which case, for example, an image comparison or a comparison of other identification features such as barcodes, etc. can be done.
  • Such an assignment is complex.
  • the unambiguous association between the object and the position is usually lost because objects overtake one another or slide over one another.
  • the object of the present invention is, in a sorting device, in the simplest possible way, to never lose the association between an ejected object and its position during a course of movement of the object subsequent to the ejection process, and furthermore, should the association ever be lost, restore them without significant effort.
  • the item data of a specific item preferably includes at least identity data of the item, which can be stored in a higher-level controller of the sorting device.
  • the identity data can correspond to an identity feature of the object or can be derived from it.
  • further data is recorded as object data and expediently also stored, in particular the optical object data and at least one current position of the object in the form of position data.
  • Sorting data from which a sorting target for a specific object can be derived or which directly describes the sorting target can, for example, be recorded optically, for example using a barcode on the object, or can already be stored in the controller and assigned to the identity data, so that use the identity data to find the sorting data.
  • the sorting data can also be stored as part of the item data of a respective item.
  • the sorting device can be any device, installation or system that is suitable for sorting objects, with at least one entrance and several transfer points for ejecting selected objects being present.
  • it can be a continuous conveyor, for example a ring sorter, with conveyor units that are equipped with tilting trays, drop flaps or cross-belt conveyor elements.
  • intermittent technologies are also included, such as a sorting system with driverless transport vehicles (FTF).
  • FFF driverless transport vehicles
  • the transfer points can be ejection devices of one type or a continuous conveyor, which is followed by a delivery path, for example in the form of a conveyor, a chute, a roller conveyor and/or a container into which the objects are dropped or thrown.
  • the combination of a transfer point, e.g. an ejection device of a sorting conveyor, with an adjoining discharge path, which extends to a removal point and can be formed, for example, by a removal conveyor is also referred to as a terminal.
  • a discharge device can have, for example, a push-off device, a pusher or a flipper.
  • the optical object data of the objects can be recorded using at least one camera and/or at least one scanner, in particular a laser scanner.
  • the tracking includes successive position determinations at time intervals, which can either be permanently specified, for example time intervals between 0.1 ms and 10 s, or result from other parameters and are not directly specified.
  • one or more dimensions of the object are recorded, for example optical recording processes can be carried out in one, two or all three coordinate directions, for example using at least one measuring camera, a laser measuring device or using light barrier arrangements. Additionally or alternatively, one or more images of the object can be recorded and the weight of the object can be recorded, for example by means of a weighing device integrated in the area of a feed belt.
  • the recorded data relating to dimensions, images and/or weight are preferably stored as part of the item data associated with the item.
  • the position determinations repeated at short intervals as part of the tracking are expediently carried out by means of optical detection of the object, in particular by one or more cameras or scanners, with image or optical tracking data being generated, and by comparing this data with the previously recorded and stored optical object data .
  • This comparison can be carried out with each position determination, after a number of position determinations, e.g. every second, fifth, tenth or 100th, at predetermined time intervals or at least at the latest when the object is removed, in order to establish a link or association between the previously recorded optical object data and/or other object data of the object with the object data, in particular image data, recorded as part of the tracking, so that the object is clearly identified at the latest when it is removed or at least its recipient data can be assigned.
  • One and the same camera or scanner device is expediently provided both for capturing the optical object data and for the repeated optical capturing of the object as part of the tracking.
  • a removal position and/or a removal time of the ejected object from the removal path is recorded and preferably also stored, in particular as a further part of the object data of the object.
  • the optical object data can be recorded at a specified point in time, as an alternative to the recording at a specified position, or when the object has been discharged from the sorting device at the transfer point.
  • the assignment of the object data to the physical position of the object at a position along the delivery route may be lost, for example because the object was transported by one or several other objects are temporarily completely or partially hidden from the view of an image capture device or camera used for tracking, or because an object is removed from the delivery path, for example falls off the delivery path or is removed manually and then manually placed back on the delivery path, in such a case it is provided that after the loss of the assignment as soon as possible, ie in particular as soon as the object is no longer covered from the view of the image acquisition device, or has been covered, the tracking is fixed, in particular by further optical Object data and expediently also the physical position of the object are recorded and compared with the optical object data, and if the optical object data match the other optical object data within a specified tolerance range, the tracking is continued on the basis of the optical object data recorded earlier, with the tracking successively repeated position determinations of the object along the delivery path at time
  • Error information can be added to the object data if the further optical object data deviates from the optical object data outside of a predefined tolerance range.
  • the object data of all objects that are simultaneously on a delivery path of a transfer point and have not yet been removed are assigned to the transfer point as a subset of all object data present in the sorting device and the optical object data when comparing the further optical object data with the optical object data of the subset of item data associated with the handover point.
  • the invention expediently provides that the identity or object data of an object removed from the delivery path and/or information derived therefrom are transmitted to a person or removal device removing the object.
  • Derived information can be, for example, the position of an object in the order of a delivery trip by a driver of a parcel vehicle, with knowledge of which the vehicle can be better loaded. An exact deposit position in the parcel vehicle can also be transmitted.
  • the invention thus advantageously makes it possible for the person or removal device removing an object not to repeat the Must determine the identity of the object, but has the identity data already recorded due to the position tracking of the object immediately available, and possibly other information.
  • 1 shows a detail of a sorting device in the form of a sorting conveyor 2, which comprises at least one input in the form of an infeed device 4, on which the objects 20 to be sorted can be fed individually to the sorting conveyor 2 and from which in 1 only a foremost end section abutting on the sorting conveyor 2 is shown with an object 20 just to be introduced.
  • 1 12 also shows a detection device 6, for example in the form of a camera, a scanner or a combination thereof, with which the first image data and identity features of each individual item 20 can be recorded as item data on the sorting conveyor 2.
  • the detection device 6 is also set up to detect the dimensions of the objects and to determine the weight.
  • the sorting conveyor 2 comprises a number of transport units 8a that are moved in a conveying direction 8, each of which is provided with a cross-belt conveyor element that can be driven transversely to the conveying direction 8, on which an object is received, transported and transported to a specific transfer point or to a specific terminal can be given.
  • the transfer point 10 is formed here by an ejection device known per se.
  • a central controller of the sorting system to which the item data or the first image data and identity features of each individual item that is introduced is transmitted, also has sorting data for each individual item, from which it can be inferred at which transfer point or to which end point each individual item on the sorting conveyor 2 located object is to be ejected.
  • the controller continuously receives logical and/or physical position data of each individual item on the sorting conveyor, or can determine this based on the speed of the sorting conveyor, i.e. logical position data in relation to an assignment of an object to the transport unit of the sorting conveyor carrying it, and/or physical position data.
  • the controller Since the controller knows the sorting destination of each item based on the sorting data mentioned, and thus the transfer point at which the item is to be ejected, the controller can tell the sorting conveyor or the transport unit carrying a specific item when or shortly before reaching the specific transfer point transmit an ejection signal, whereupon the cross-belt conveyor element is put into operation and ejects the object at the specific transfer point 10 .
  • a plurality of induction devices can be provided for feeding articles onto the sorting conveyor, and a detection device can be provided on one or more induction devices, either as in 1 shown downstream of the infeed device on the sorting conveyor, or directly on the infeed device for capturing specific item data of the items during or immediately before infeed, e.g. identity data, image data, general optical object data and/or dimensions or weight.
  • an image acquisition device in the form of a camera 12, with which optical object data such as image data of each object to be ejected or ejected at the transfer point 10 is recorded, if these have not previously been recorded.
  • the camera or image capturing device is connected to the controller and transmits the optical object data to it, or these data can be queried by the controller from the image capturing device.
  • the controller Before, during or after the ejection of an object at the transfer point assigned to it, in this example the ejection device, the controller registers the ejected object as an object that is located at or subsequent to the specific transfer point, with the object data being assigned to such a specific transfer point Items can be stored as a subset of all item data present in the sorting device. In the example of 2 four objects have been ejected at the transfer point 10, so that the subset of object data includes the object data such as image or optical object data and identity data of these four objects in connection with or association with the transfer point 10.
  • Each ejected object is tracked by tracking from the transfer point 10 with regard to its position along the delivery path up to its final removal at a removal point 14 .
  • This tracking is carried out in a manner known per se in that the camera 12 captures an image of the object at short time intervals, which can be less than 1 ms or less than 10 ms, for example, and in each case with an image taken shortly beforehand is adjusted, from which a current position of the object is determined.
  • Each item's current position is stored as part of the item's item data, so that at any point in time there is an association between the item's item data and the position.
  • the object is tracked by said tracking until it is removed from the delivery path, in particular up to a removal point 14, which can be set up in such a way that every object discharged at the transfer point 10 is regularly removed there. Alternatively, it is possible for an object to be removed from it at any point along the delivery path.
  • the assignment of the item data to the physical position of the item may be lost during its movement along the delivery path, e.g. if the item is briefly covered by other items and is not or not completely visible to the camera.
  • either the additional optical object data can be taken as a basis and stored, for example as an additional part of the object data, or the tracking can be continued on the basis of the optical object data recorded earlier.
  • this information can be used when an object is removed from the terminal or the delivery route or removal point, for example to transport several objects belonging to a sorting destination together or to store, or to remove objects belonging to different sorting destinations from one and the same delivery path or removal point, and to assign them to individual, different sorting destinations using the sorting information known for each object and to transport them further in different ways. This makes it possible for one and assign several sorting destinations to the same transfer point and thereby save transfer points or use them more than once.

Landscapes

  • Sorting Of Articles (AREA)
  • Discharge Of Articles From Conveyors (AREA)
  • Warehouses Or Storage Devices (AREA)
EP19185901.6A 2019-07-12 2019-07-12 Verfahren und vorrichtung zum erzeugen und aufrechterhalten einer zuordnung von gegenstandsdaten und position eines gegenstands Active EP3763448B1 (de)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP19185901.6A EP3763448B1 (de) 2019-07-12 2019-07-12 Verfahren und vorrichtung zum erzeugen und aufrechterhalten einer zuordnung von gegenstandsdaten und position eines gegenstands
PL19185901.6T PL3763448T3 (pl) 2019-07-12 2019-07-12 Sposób i urządzenie do wytwarzania i utrzymywania przyporządkowania danych o przedmiocie oraz położeniu przedmiotu
JP2020119076A JP7426910B2 (ja) 2019-07-12 2020-07-10 物品データと物品の位置との対応付けを生成および維持する方法および装置
US16/925,566 US11583898B2 (en) 2019-07-12 2020-07-10 Method and device for producing and maintaining an assignment of object data and the position of an object

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP19185901.6A EP3763448B1 (de) 2019-07-12 2019-07-12 Verfahren und vorrichtung zum erzeugen und aufrechterhalten einer zuordnung von gegenstandsdaten und position eines gegenstands

Publications (2)

Publication Number Publication Date
EP3763448A1 EP3763448A1 (de) 2021-01-13
EP3763448B1 true EP3763448B1 (de) 2022-05-11

Family

ID=67262103

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19185901.6A Active EP3763448B1 (de) 2019-07-12 2019-07-12 Verfahren und vorrichtung zum erzeugen und aufrechterhalten einer zuordnung von gegenstandsdaten und position eines gegenstands

Country Status (4)

Country Link
US (1) US11583898B2 (pl)
EP (1) EP3763448B1 (pl)
JP (1) JP7426910B2 (pl)
PL (1) PL3763448T3 (pl)

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6567116B1 (en) * 1998-11-20 2003-05-20 James A. Aman Multiple object tracking system
US7063256B2 (en) * 2003-03-04 2006-06-20 United Parcel Service Of America Item tracking and processing systems and methods
US7816617B2 (en) * 2007-05-21 2010-10-19 Lockheed Martin Corporation Configurable intelligent conveyor system and method
DE102007040367B4 (de) * 2007-08-17 2022-11-17 Ssi Schäfer Automation Gmbh Materialflusssteuerung zur Kollisionsvermeidung in einer Förderanlage
US8825200B2 (en) * 2007-11-07 2014-09-02 Siemens Industry, Inc. Method and system for tracking of items
US8608068B2 (en) * 2007-12-05 2013-12-17 Siemens Industry, Inc. Mail processing tracking system and method
JP5977544B2 (ja) * 2012-03-09 2016-08-24 キヤノン株式会社 情報処理装置、情報処理方法
CA2841721C (en) * 2013-02-07 2021-02-09 Kirk Serjeantson Package vision sort system and method
WO2015032402A1 (en) * 2013-09-06 2015-03-12 Crisplant A/S Method for inducting and singulating items to a sorter
FR3019068B1 (fr) * 2014-03-25 2017-10-20 Solystic Machine de tri postal avec des bras de manutention robotises
FR3032365B1 (fr) * 2015-02-10 2017-02-03 Veolia Environnement-VE Procedure de tri selectif
CN107683183A (zh) * 2015-03-16 2018-02-09 纳诺皮克集成软件解决方案私人有限公司 具有轨迹跟踪传感器网络的新型智能分级机及其方法
ES2920479T3 (es) * 2015-07-16 2022-08-04 Sortera Alloys Inc Sistema de clasificación de materiales
US9731328B2 (en) * 2015-08-03 2017-08-15 Linear Group Services, LLC Inspection and sorting machine
JP6730061B2 (ja) 2016-04-01 2020-07-29 株式会社東芝 配達支援装置、配達支援システム、及び配達支援プログラム
JP6679442B2 (ja) 2016-07-29 2020-04-15 パナソニックｉ−ＰＲＯセンシングソリューションズ株式会社 荷物追跡システム、荷物追跡方法及び荷物追跡プログラム
US10773897B2 (en) * 2017-05-05 2020-09-15 Fives Intralogistics Corp Off-loading, typing and item separation system
MX2019014605A (es) * 2017-06-06 2020-08-20 Mat Handling Systems Inc Sistema y metodo para identificar y transferir paquetes desde un primer transportador a un segundo transportador.
WO2019178738A1 (zh) * 2018-03-20 2019-09-26 深圳前海达闼云端智能科技有限公司 物品定位方法及系统
US10766711B2 (en) * 2019-02-08 2020-09-08 Advanced Technology & Research Corp. Modular package sorting system

Also Published As

Publication number Publication date
US20210008599A1 (en) 2021-01-14
EP3763448A1 (de) 2021-01-13
US11583898B2 (en) 2023-02-21
JP7426910B2 (ja) 2024-02-02
PL3763448T3 (pl) 2022-11-21
JP2021014365A (ja) 2021-02-12

Similar Documents

Publication Publication Date Title
DE102017214634B4 (de) Werkstücksortiersystem und Verfahren
EP3601118B1 (de) Produktionssystem mit ftf zum automatisch abgeben von behältern an entnahmeregalen
EP1185473B1 (de) Vorrichtung zum handhaben von stückgütern
EP3254893B1 (de) Zustellfahrzeug und verfahren zur zustellung von sendungen an unterschiedlichen orten einer zustellroute
EP2741867B1 (de) Sortieranlage und sortierverfahren zum gemeinsamen sortieren von verschiedenartigen gegenständen
EP0119402B1 (de) Verfahren zur Erkennung und Identifikation von Gegenständen
EP2106376B1 (de) Intelligente stauförderbahn
DE102015117241B4 (de) Ansteuerung einer Förderanlage
DE102017113818B4 (de) Artikel-fördervorrichtung mit einem abschnitt zur vorübergehenden platzierung
DE102007038834A1 (de) Verfahren und Vorrichtung zur Vereinzelung von Stückgut
DE102018116611A1 (de) Verfahren und System zur Steuerung des Materialflusses von Objekten in einem realen Lager
EP2855282A1 (de) Verfahren und vorrichtung zum transport von gegenständen aus abgebenden stationen in aufnehmende stationen
EP2456696A1 (de) Verfahren zur beladung eines ladungsträgers mit ladeeinheiten
DE102019117349A1 (de) Vorrichtung und Verfahren zum Umgang mit in mindestens einer Reihe nacheinander bewegten Stückgütern
DE102006003270A1 (de) Vorrichtung und Verfahren zum Sortieren von ungeordneten Behältern in einem Kommissioniersystem
EP2818254B1 (de) Vorrichtung zum Vereinzeln von Stückgutteilen
EP4288252B1 (de) System zur vereinzelung und identifizierung von artikeln
EP3857523B1 (de) Anordnung und verfahren zur bearbeitung von wertdokumenten
WO2022268366A1 (de) Beladen von transportbehältern einer förderanlage, insbesondere einer flughafen-gepäckförderanlage, mit stückgütern variabler grösse
EP3763448A1 (de) Verfahren und vorrichtung zum erzeugen und aufrechterhalten einer zuordnung von gegenstandsdaten und position eines gegenstands
EP3678792B1 (de) Vorrichtung und verfahren zum ausschleusen von in einer direktdruckmaschine fehlerhaft bedruckten behältern
WO2013030337A1 (de) Verfahren und vorrichtung zum sortieren von identifikationsgegenständen
EP4194110B1 (de) Verfahren zum entfernen eines stückgutes von einem fördermittel, abblaseinrichtung und sortiersystem
DE102017222566B4 (de) Robotersystem und Produktionssystem
EP2105215B1 (de) Verfahren und Anordnung zum Synchronisieren der Verteilinformation eines Sortiergutes mit der Information über ein mit diesem Sortiergut bestücktes Sorterelement

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210121

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20211216

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

GRAF Information related to payment of grant fee modified

Free format text: ORIGINAL CODE: EPIDOSCIGR3

RAP3 Party data changed (applicant data changed or rights of an application transferred)

Owner name: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.

Owner name: BEUMER GROUP GMBH & CO. KG

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1490934

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220515

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502019004324

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220912

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220811

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220812

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220811

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220911

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502019004324

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20220731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

26N No opposition filed

Effective date: 20230214

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220712

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220731

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220731

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230411

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220712

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20190712

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20250723

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250722

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PL

Payment date: 20250701

Year of fee payment: 7

Ref country code: IT

Payment date: 20250731

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20250724

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20250723

Year of fee payment: 7

Ref country code: AT

Payment date: 20250721

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220511