EP2618948A1 - Postsortierverfahren mit erfassung von benutzerverarbeitungsinformationen zwischen sortierschritten - Google Patents

Postsortierverfahren mit erfassung von benutzerverarbeitungsinformationen zwischen sortierschritten

Info

Publication number
EP2618948A1
EP2618948A1 EP11735487.8A EP11735487A EP2618948A1 EP 2618948 A1 EP2618948 A1 EP 2618948A1 EP 11735487 A EP11735487 A EP 11735487A EP 2618948 A1 EP2618948 A1 EP 2618948A1
Authority
EP
European Patent Office
Prior art keywords
sorting
mail
processing information
user processing
machine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP11735487.8A
Other languages
English (en)
French (fr)
Other versions
EP2618948B1 (de
Inventor
Olivier Desprez
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Solystic SAS
Original Assignee
Solystic SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Solystic SAS filed Critical Solystic SAS
Publication of EP2618948A1 publication Critical patent/EP2618948A1/de
Application granted granted Critical
Publication of EP2618948B1 publication Critical patent/EP2618948B1/de
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B07SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07CPOSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C3/00Sorting according to destination
    • B07C3/10Apparatus characterised by the means used for detection ofthe destination
    • B07C3/14Apparatus characterised by the means used for detection ofthe destination using light-responsive detecting means

Definitions

  • the invention relates to a postal sorting method in which mail items perform at least two sorting passes in a machine to be sorted into sorting outlets of the machine and user processing information is available in the machine at a time.
  • first sorting pass in relation to at least one mail item.
  • the context of the invention is more particularly that of the sorting of bulk mail items from the same sender.
  • the machine operator can be brought to previously frame the position of the block of mail.
  • recipient address (called "user frame” in postal terminology) in images of these mail items through a graphical interface so as to force OCR address recognition processing to work on a predetermined pixel area in pictures of mail items.
  • This assistance of the machine operator makes it possible, among other things, to reduce the rate of recognition failure.
  • the machine operator may also be required to enter other user processing information useful for the automatic processing of mail items, for example the spatial position in the image of the pixel area corresponding to the address block of the mailer. sender.
  • the machine operator can also enter as user processing information, the fact that the mail items have a particular tracking rule to avoid a return to the sender, etc.
  • Information describing the physical structure of the mail items, namely whether they are plastic envelope mail items, or open mail items or magazine type mail items, etc., can also be entered into the postal sorting machine by the machine operator to optimize the operation of data processing and mechanical processing.
  • This user processing information can also be previously stored in a machine file and thus retrieved automatically instead of being entered manually by the machine operator.
  • Other user processing information relating to physical characteristics of the mail items may still be produced by the machine peripherals during the sorting of mail items such as weight, thickness or other physical quantities.
  • the frame encompassing the area of the destination address block may also be determined by the processing of the sorting machine itself after a reliability step, i.e. when this position information of the address block has become statistically reliable, the level of confidence in the result of OCR address recognition may be a measure of this reliability.
  • All this user processing information which is related to the processing of homogeneous mail items in that they originate in particular from the same sender and have a very similar graphical appearance can therefore be used for the configuration or adjustment of the machine to contribute to the processing. optimization of its operation in the different sorting passes.
  • the invention is based on the observation that this user processing information is unused after the first sorting pass of the mail items because the batch groupings of mail items homogeneous, which exist in the first sorting pass, disappear after the first sorting pass.
  • the object of the invention is therefore to make this user processing information, introduced by a machine operator or already previously recorded in a machine or produced in the first sorting pass by the data processing of the machine, available in the sorting passes. subsequently to exploit them in association with the mail items concerned.
  • the invention therefore relates to a postal sorting method according to which mail items perform at least two sorting passes in a machine to be ordered in sorting outlets of the machine and user processing information is available in the machine when of a first sorting pass in relation to at least one mail item, characterized in that it comprises the steps of associating in memory these user processing information to a graphic signature of the representative mail item of an image of the mail article and to recover, during the second pass of sorting said mail item, said user processing information associated with it from a pairing of graphic signatures according to a certain criterion of resemblance.
  • the descriptor of these graphic signatures is preferably invariant to the rotation of the digital images of the mail items to allow indexing and search graphics signatures that are robust during successive sorting passes.
  • This descriptor can be based on local and global characteristics of the pixel images of mail items in multi-level of gray or in binary format according to a multi-scale partitioning, for example luminance statistics.
  • Such a descriptor is for example described in patent document EP 1 519 796. In this document, it corresponds to the image component of a unique virtual identifier of mail item.
  • the criterion of resemblance For example, a graphic between two graphic signatures may be a normalized correlation coefficient.
  • graphical signatures associated with user processing information are filtered to dynamically create a dictionary of graphical signature classes and detects a pairing between a graphical class and a graphical signature of a mail item calculated during the second sorting pass to recover the user processing information associated with that mail item.
  • the graphic signatures generated for mail items stored in the receptacle and related to user processing information are grouped and classified according to this user processing information to dynamically create a dictionary of graphical signature classes whose context is located at the sort output output port. question.
  • the method according to the invention also makes it possible to recover user processing information for mail items processed in the second sorting pass but which did not have user processing information in the first sorting pass.
  • the method according to the invention makes it possible to recover user processing information for the mail items forming part of the second batch of mail items.
  • Each graphic class of the dictionary is therefore representative of one or more similar graphic signatures.
  • each graphical class has a descriptor which can be an average value of descriptors of several similar graphic signatures.
  • the similarity threshold between a graphical signature and a graphical class for matching can be adjusted, if necessary, to allow recovery of user processing information for mail items from different senders which have a strong graphical similarity.
  • the principle of creating a dynamic dictionary of graphical classes consists in presenting to a current graphic class dictionary each new graphic signature of mail article linked to user processing information to be recovered in a subsequent sorting pass.
  • the descriptor of the graphical class in question is updated by consolidation with the descriptor of the new graphic signature (the update consists in calculating an average value of the descriptors) . If not, a new graphical class is created in the dictionary with the descriptor as the new graphic signature.
  • This type of dynamic grouping of graphic signatures avoids the management and exchange of large databases between postal sorting machines or postal sorting sites. These directories or dictionaries of graphic signature classes can be part of a database organized and segmented by sort output receptacle. Dynamic grouping of graphic signatures also provides a limited search context for matching graphical signatures.
  • the invention can be applied to a postal sorting architecture exploiting unique virtual identifiers of mail items according to the technology of the company "Solystic" called "V-ld®" described in the patent document EP 1 519 796 mentioned above. In this case, the user processing information is conveyed through the successive sorting passes in connection with these virtual mail article identifiers. Recovering this user processing information strengthens the robustness of indexing and searching memory for unique virtual mail item identifiers.
  • the process according to the invention may have the following particularities:
  • the user processing information may include spatial position information of the recipient address block. As indicated above, the recovery of this type of user processing information makes it possible to reinforce the robustness of the OCR recognition processing of the recipient addresses or the robustness of the computation of the components of a unique virtual item identifier of mail .
  • the user processing information may include spatial position information of the sender address block.
  • Said user processing information may include information indicative of a physical characteristic common to several mail items.
  • the recovery of this information through the successive sorting passes can contribute, for example, to optimizing the filling of the sorting outlet receptacles.
  • Figure 1 schematically illustrates a postal sorting machine with sorting outlets provided with receptacles for storing sorted mail items.
  • FIG. 2 illustrates the course of the sorting process during a first sorting pass according to the invention in the machine of FIG. 1.
  • FIG. 3 illustrates the course of the sorting process during a second sorting pass according to the invention in the machine of FIG. 1.
  • the postal sorting machine 1 comprises a sorting conveyor 2 provided with a plurality of sorting outlets of which only five S1 to S5 are shown.
  • the sorting machine 1 also comprises a control / command system 3 (a data processing unit including a memory) capable of performing OCR address recognition processing to control the actuators of the sorting conveyor so as to direct each mail item to one of the sorting outlets that corresponds to the recognized recipient address on the mail item.
  • a control / command system 3 a data processing unit including a memory
  • the reference 4 designates a receptacle or tray associated with a sorting outlet and in which are stored and accumulated mail items directed to this sorting outlet.
  • the postal sorting machine 1 may be part of a larger postal sorting equipment which may include several postal sorting machines located in different postal sorting sites.
  • the control / command systems 3 of these postal sorting machines can be interconnected through a communication network 5 to enable exchange or transfer of data.
  • the mail items P can be sorted into several sorting passes so as to be ordered by destination address (for example for distribution by the factor), in particular in at least two sorting passes, either on the same postal sorting machine or on two or more different postal sorting machines during the successive sorting passes.
  • the sorting on the destination of a mail item requires a first pass of this mail item machine in a sorting center called sorting center "departure”, followed by a second machine passage of this article mail in a sorting center called "arrival" sorting center.
  • the invention therefore applies to a postal sorting according to which mail items P are presented in stack at the entrance of a postal sorting machine, are sorted according to a first sorting plane (first sorting pass) so as to be arranged in sorting output receptacles 4 of the sorting machine, and then sorted and stored items P in each sorting output receptacle 4 are recycled to the input of the sorting machine (or other sorting machine). to be sorted again according to a second sorting plane (second sorting pass) so as to be sorted again in sort output receptacles 4, and so on for the subsequent sorting passes until a suitable order is obtained to a distribution by the factor.
  • first sorting plane first sorting pass
  • second sorting pass so as to be sorted again in sort output receptacles 4 of the sorting machine
  • this user processing information PF is the spatial coordinates of the recipient address block in the images of the mailpieces P of the spinneret, but the invention can be applied to other types of mailpieces.
  • user processing information whether machine-entered by an operator or still generated by a data processing machine.
  • FIG. 2 now illustrates an example of implementation of the postal sorting process according to the invention during a first sorting pass of mail items P.
  • user processing information PF is entered in machine by the machine operator, for example using a man / machine interface including a display screen 6 (see FIG. 1) and a pointing member 7 on the display screen according to a technique known as "Clipping" which consists of defining a frame 8 around the recipient address block in a typical image 9 of a mail item of the runner.
  • step 21 a first mail piece P of the line is popped and is moved in the sorting conveyor 2.
  • the digital image of a face of this first piece of mail P is captured by a camera or the like. this is well known and is temporarily stored in memory of the system 3.
  • a graphic signature or image profile is then derived from the digital image of the mail article P.
  • This graphic signature has a numerical descriptor calculated for example from the luminance values of the pixels of the image as indicated above.
  • the registration of this Sig graphic signature is associated in memory with the applicable PF processing information for this mail item.
  • the association in memory can be obtained conventionally by a logical address link between the registration of the graphic signature and the location where these PF information are recorded or by filling a field of the registration of the graphic signature with the user processing information.
  • the graphic signatures can be stored in a database as represented here by the database BD internal to the system 3 but which can also be distant from the postal sorting machine 1.
  • the database BD is symbolically illustrated in the form of a table whose lines correspond to records of different graphic signatures indicated by Sig1, Sig2, etc.
  • Each graphic signature such as Sig1 is associated to user processing information, indicated by PF for the Sig1 signature.
  • step 23 the process continues with destination address OCR recognition processing which is applied more particularly in the image area of the mail item defined by this user processing information PF. Note that steps 22 and 23 could be reversed without departing from the scope of the invention.
  • the recipient address is uniquely recognized by OCR recognition processing and in step 23 the mail item is thus directed through the sorting conveyor 2 to a sorting outlet, for example the output S1, corresponding to this address recognized to be stored in a corresponding sorting output receptacle 4.
  • a sorting outlet for example the output S1
  • a logical identifier IdBac is assigned to each sort output receptacle 4 of the machine and therefore this identifier IdBac can be associated in memory at step 22 in the database BD to the recording.
  • Sig1 signature calculated for the corresponding mail item.
  • Steps 21 to 23 are repeated for each subsequent mailpiece P.
  • system 3 has in memory a set of graphic signatures which are respectively linked to user processing information PF and to sort output receptacle identifiers.
  • other user processing information may be entered manually or generated automatically in the first sorting pass for others.
  • the method according to the invention can also operate without sort output receptacle identifiers, the tray identifiers used here to limit the search space for the pairing of graphic signatures in the second sorting pass.
  • a dictionary of classes of graphic signatures is dynamically created associated with this receptacle (or a segment of the database BD which can be seen as a directory or local dictionary) in which each graphical class Sig M oy en of the dictionary is representative of the graphic signatures associated with the mail items stored in the receptacle and which are generally part of the same line and whose images are graphically similar.
  • the descriptor of each graphic class corresponds to a consolidated value calculated from the descriptors of the corresponding graphic signatures, for example corresponds to the average value of these descriptors.
  • FIG. 3 now illustrates the sorting process for a second sorting pass of mail items P. It is assumed at this stage of the sorting process that mail items stored in a sort output receptacle 4 are recycled to the input of the same postal sorting machine 1.
  • a mail item receptacle is brought to the input of the sorting machine and its IdBac identification number is recognized by the machine.
  • a segment or the entire database BD is then loaded in memory of the sorting machine so that a small dictionary of graphical classes is made available in memory of the machine.
  • step 31 a first article of mail P recycled in the second sorting pass is thus depilated and moved in the sorting conveyor 2 of the machine. An image of the face of this mail piece is then formed again and a current Signant graphic signature is again computed on the basis of this image.
  • step 31 the dictionary in the database BD is scanned to detect a pairing, based on a graphical similarity criterion based for example on a normalized correlation coefficient, between one of the graphical classes Sig M oy en of the dictionary and the current signature Signant- If a pairing is detected in step 32, the user processing information PF associated with the graphic class identified in the dictionary is retrieved by association in memory and the process continues to step 33 by a new recipient address OCR recognition process which is applied more particularly in the image area of the mail item which is defined by the user processing information PF. This new treatment therefore benefits from the input of user processing information PF introduced in the first sorting pass. This recovery of user processing information in the second sorting pass contributes, for example, to reinforcing the robustness of address recognition on mail items.
  • step 34 the postal sorting process continues in step 34 by a conventional OCR recognition process without any particular setting. Then the mail sorting process continues in step 35 by transferring the mail item to a sorting outlet and returns to step 30 for a new mail item.
  • Steps 31 to 35 are repeated for the subsequent mail items to be sorted in the second sorting pass on the sorting machine.
  • the principle of recovering the user processing information between the sorting passes according to the invention also applies to the sorting passes subsequent to the second sorting pass.

Landscapes

  • Sorting Of Articles (AREA)
EP11735487.8A 2010-09-23 2011-06-14 Postsortierverfahren mit verwendung von behandlungsspezifischen informationen zwischen den sortierläufen Not-in-force EP2618948B1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1057658A FR2965193B1 (fr) 2010-09-23 2010-09-23 Procede de tri postal avec un recouvrement des informations de traitement usager entre les passes de tri
PCT/FR2011/051340 WO2012038626A1 (fr) 2010-09-23 2011-06-14 Procédé de tri postal avec un recouvrement des informations de traitement usager entre les passes de tri

Publications (2)

Publication Number Publication Date
EP2618948A1 true EP2618948A1 (de) 2013-07-31
EP2618948B1 EP2618948B1 (de) 2014-11-19

Family

ID=43798326

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11735487.8A Not-in-force EP2618948B1 (de) 2010-09-23 2011-06-14 Postsortierverfahren mit verwendung von behandlungsspezifischen informationen zwischen den sortierläufen

Country Status (10)

Country Link
US (1) US9144827B2 (de)
EP (1) EP2618948B1 (de)
JP (1) JP5944394B2 (de)
CN (1) CN103153489B (de)
CA (1) CA2811391C (de)
DK (1) DK2618948T3 (de)
ES (1) ES2526780T3 (de)
FR (1) FR2965193B1 (de)
PT (1) PT2618948E (de)
WO (1) WO2012038626A1 (de)

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100286163B1 (ko) * 1994-08-08 2001-04-16 가네꼬 히사시 주소인식방법, 주소인식장치 및 지엽류 자동처리 시스템
US6316741B1 (en) * 1999-06-04 2001-11-13 Lockheed Martin Corporation Object sortation for delivery sequencing
DE19947259C1 (de) * 1999-09-30 2000-09-28 Siemens Ag Verfahren und Vorrichtung zum Sortieren von Sendungen
US6613998B2 (en) * 2001-03-23 2003-09-02 Opex Corporation Method and apparatus for processing outgoing bulk mail
FR2841673B1 (fr) 2002-06-26 2004-12-03 Solystic Chronomarquage d'objets postaux par signature d'image et machine de tri associee
EP1389493A1 (de) * 2002-08-12 2004-02-18 MIT Management intelligenter Technologien GmbH Verfahren und Vorrichtungen zur automatischen Adressblockmarkierung
JP2004171122A (ja) * 2002-11-18 2004-06-17 Toshiba Corp 紙葉類処理装置及び紙葉類処理方法
FR2881663B1 (fr) * 2005-02-08 2007-03-16 Solystic Sa Procede de traitement d'envois postaux avec une detection des occurences d'attributs ocr
JP2007000698A (ja) * 2005-06-21 2007-01-11 Toshiba Corp 宛先読取装置、郵便物処理装置、および宛先読取方法
JP2007268466A (ja) * 2006-03-31 2007-10-18 Toshiba Corp 郵便物処理装置、および郵便物処理方法
EP1927407A1 (de) * 2006-11-28 2008-06-04 Intelmail Explorenet Pty Ltd. Verfahren und System zur Objektüberprüfung
FR2916661B1 (fr) 2007-05-30 2009-07-03 Solystic Sas Procede de traitement d'envois incluant une classification graphique des signatures associees aux envois
FR2927827B1 (fr) * 2008-02-26 2011-04-01 Solystic Procede pour le tri d'envois postaux incluant une gestion optimisee de l'espace d'exploration des signatures d'envois
US8085980B2 (en) * 2008-08-13 2011-12-27 Lockheed Martin Corporation Mail piece identification using bin independent attributes

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2012038626A1 *

Also Published As

Publication number Publication date
DK2618948T3 (da) 2014-12-15
CN103153489A (zh) 2013-06-12
FR2965193A1 (fr) 2012-03-30
CA2811391C (fr) 2017-02-28
CN103153489B (zh) 2014-11-05
JP2013542065A (ja) 2013-11-21
ES2526780T3 (es) 2015-01-15
JP5944394B2 (ja) 2016-07-05
FR2965193B1 (fr) 2012-08-31
EP2618948B1 (de) 2014-11-19
CA2811391A1 (fr) 2012-03-29
WO2012038626A1 (fr) 2012-03-29
PT2618948E (pt) 2015-02-05
US20120173015A1 (en) 2012-07-05
US9144827B2 (en) 2015-09-29

Similar Documents

Publication Publication Date Title
EP1866105B1 (de) Verfahren zur bearbeitung von postsendungen umfassend die verwendung eines digitalen abbildes
EP1718423B1 (de) Verfahren zum sortieren von postgut mittels mehrerer sortierdurchläufe
EP2155406B1 (de) Verfahren zur handhabung von übertragungen einschliesslich einer grafischen klassifizierung der zu den übertragungen gehörenden signaturen
EP1519796B2 (de) Identifikationsmarkieren von poststücken durch bildsignatur und zugehörige postbearbeitungsmaschine
EP2190594B1 (de) Verfahren zur verarbeitung von postpaketen mittels mit digitalen abbildern verbundener kundencodes
CA2914678C (fr) Procede pour trier des objets postaux au casier avec affichage d'une pile virtuelle d'images d'objet
WO2009106778A1 (fr) Procédé pour le tri d'envois postaux incluant une gestion optimisée de l'espace d'exploration des signatures d'envois
EP2300175A1 (de) Verfahren zur sortierung mehrerer objekte mit datenanalyse
FR2800303A1 (fr) Procede de tri postal incluant une recuperation des erreurs de lecture de codes apposes sur les articles de courrier
EP2618948B1 (de) Postsortierverfahren mit verwendung von behandlungsspezifischen informationen zwischen den sortierläufen
EP3903230B1 (de) Struktureller bildabgleich durch hashing von deskriptoren von singularitäten des gradienten
FR3093295A1 (fr) Tri d’objets par des trieurs en parallele avec des passes croisees divisees
EP3205412A1 (de) Verfahren zum sortieren von vorsortierten postartikeln
EP2133845A1 (de) Frankiersystem, dass die Verarbeitung von Postartikeln nach verschiedenen Zielorten erlaubt

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20130423

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SOLYSTIC

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20140829

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

RIN1 Information on inventor provided before grant (corrected)

Inventor name: DESPREZ, OLIVIER

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20141212

Ref country code: AT

Ref legal event code: REF

Ref document number: 696678

Country of ref document: AT

Kind code of ref document: T

Effective date: 20141215

Ref country code: CH

Ref legal event code: NV

Representative=s name: SPIERENBURG AND PARTNER AG, PATENT- UND MARKEN, CH

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: FRENCH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602011011550

Country of ref document: DE

Effective date: 20141231

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2526780

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20150115

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: NL

Ref legal event code: T3

REG Reference to a national code

Ref country code: PT

Ref legal event code: SC4A

Free format text: AVAILABILITY OF NATIONAL TRANSLATION

Effective date: 20150120

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150319

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

REG Reference to a national code

Ref country code: NO

Ref legal event code: T2

Effective date: 20141119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150220

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602011011550

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20150820

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150614

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NO

Payment date: 20160623

Year of fee payment: 6

Ref country code: CH

Payment date: 20160620

Year of fee payment: 6

Ref country code: IE

Payment date: 20160621

Year of fee payment: 6

REG Reference to a national code

Ref country code: AT

Ref legal event code: UEP

Ref document number: 696678

Country of ref document: AT

Kind code of ref document: T

Effective date: 20141119

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: BE

Payment date: 20160620

Year of fee payment: 6

Ref country code: DK

Payment date: 20160620

Year of fee payment: 6

Ref country code: AT

Payment date: 20160621

Year of fee payment: 6

Ref country code: PT

Payment date: 20160614

Year of fee payment: 6

Ref country code: NL

Payment date: 20160620

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20110614

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20170630

Ref country code: NO

Ref legal event code: MMEP

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: NL

Ref legal event code: MM

Effective date: 20170701

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 696678

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170614

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171214

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170701

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170630

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170630

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170614

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170614

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20170630

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141119

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20200618

Year of fee payment: 10

Ref country code: FI

Payment date: 20200622

Year of fee payment: 10

Ref country code: FR

Payment date: 20200622

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20200625

Year of fee payment: 10

Ref country code: GB

Payment date: 20200625

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20200825

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20200625

Year of fee payment: 10

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602011011550

Country of ref document: DE

REG Reference to a national code

Ref country code: FI

Ref legal event code: MAE

REG Reference to a national code

Ref country code: SE

Ref legal event code: EUG

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210614

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20210614

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210614

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210615

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210614

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20220901

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210615