EP3487638A1 - Method for providing sorting information for postal sorting items - Google Patents

Method for providing sorting information for postal sorting items

Info

Publication number
EP3487638A1
EP3487638A1 EP17734676.4A EP17734676A EP3487638A1 EP 3487638 A1 EP3487638 A1 EP 3487638A1 EP 17734676 A EP17734676 A EP 17734676A EP 3487638 A1 EP3487638 A1 EP 3487638A1
Authority
EP
European Patent Office
Prior art keywords
postal
camera
stack
item
items
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP17734676.4A
Other languages
German (de)
French (fr)
Other versions
EP3487638B1 (en
Inventor
Luciano GIUGNO
Zhe Li
Samuel X. RICHARDSON
Eberhard RÖHM
Abdul Hamid Salemizadeh
Jürgen Schad
Matthias Schulte-Austum
Stanley W. Sipe
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Original Assignee
Siemens AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG filed Critical Siemens AG
Publication of EP3487638A1 publication Critical patent/EP3487638A1/en
Application granted granted Critical
Publication of EP3487638B1 publication Critical patent/EP3487638B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B07—SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07C—POSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C7/00—Sorting by hand only e.g. of mail
    • B07C7/005—Computer assisted manual sorting, e.g. for mail

Definitions

  • the present invention relates to a method for providing sorting information for postal items, such as letters, brochures, parcels and the like, each comprising an address information.
  • Postal processing applications require reading and recognition of the address of the postal items being processed, in order to pre ⁇ pare the items for delivery. For example, all of the postal items that will be delivered on the same delivery route would be separat- ed from all of the other postal items, so that they can be loaded into a delivery vehicle in preparation for the delivery route.
  • Manual methods of reading and recognition of postal items during pro ⁇ cessing requires a great deal of labor and expertise. Fully auto ⁇ matic methods of processing postal items can be large, inflexible, and can require significant volume of postal items to justify their cost. When space and volume of postal items are limited, the ideal system is small, flexible, adds productivity to manual processing steps, and reduces the expertise required to perform the pro ⁇ cessing.
  • the present invention therefore has the objective to provide a method for providing sorting information for postal sorting items allowing postal sorting centers to reduce manual labor and scheme knowledge throughout its networks, including but not limited to last mile delivery optimization.
  • the invention shall further allow sortation of mail items to final destination or next destination via non-schemed trained personnel at very high throughputs from many different physical streams. This will represent a significant decrease in direct labor cost as well as training.
  • the sorting information may comprise an optical and/or acoustical indication where to sort the current postal item. Just by occlusion and the re-appearance of the optical mark the image recognition is triggered to recognize the address infor ⁇ mation of the next postal item present on the top of the stack.
  • this process is more reliable as compared to prior art processes where low contrasts images of subsequent postal items have to be compared in order identify the presence of the subse ⁇ quent postal item on top of the stack.
  • just high contrast images taken from the optical mark have to be compared.
  • a preferred embodiment provides for an optical mark being in form of a symbol, such as a cross, an X or the like, having high con- trast as compared to the surrounding area.
  • a symbol such as a letter or a cross, printed in black on a white paper or white underlay are a suitable pair of high contrast for the recog ⁇ nition of the occlusion and the re-appearance of the optical mark.
  • the address information is provided in form of hand- and/or typewriting and/or fluorescent bar code being readable on one surface of the postal item.
  • Preferred embodiments of the present invention are hereinafter ex- plained more detailed with respect to the attached drawing that de ⁇ picts schematically the method for providing sorting information 6 for postal items 2, such as letters, brochures, newspapers, maga ⁇ zines and the like, each comprising an address information 4.
  • the drawing shows an overhead positioned camera 8 having a field of view 10 illustrated by dotted lines 12. This camera 8 is used to take images of the postal items 2.
  • the images taken by the camera 8 are processed by an image recognition module 14.
  • the processing of the image recognition module 14 lead to the extraction of the ad ⁇ dress information 4 which is part of the video image taken by the camera 8.
  • the address information 4 can be handwritten or machine- written but may also comprise a bar code 16 printed onto the postal item 2a in a preceding sorting process.
  • the image recognition module 14 forms logically a part of a process control module 16 which is enabled to assign the sorting infor ⁇ mation 6 to the postal item 2 in response to the extracted address information 4.
  • the sorting information 6 is contained in a database 18.
  • the sorting process now works as fol ⁇ lows :
  • a stack 20 of postal items 2a, 2b, etc. is formed wherein the postal items 2a, 2b, etc. are oriented to allow reading the re- spective address information 4 from the overhead positioned camera 8 wherein the stack 20 of postal items 2a, 2b, etc. is positioned on a board 22 within the determined area 24 which corresponds to the area of view 10 with respect to the camera 8.
  • the determined area 24 is defined by marks 26 which help an operator (here not shown) to position the stack 20 accordingly.
  • three optical marks 28, here three crossed circular boxes, are disposed adjacent to the determined area 24 on the board 22. These optical marks have (28) a high contrast as compared to the board 22.
  • the camera 8 take continuously images form these opti- cal marks 28 and the image recognition module 14 determines for every image whether the optical marks 28 are present.
  • the sorting in- formation 6 is assigned to the postal item 2a.
  • the sorting infor ⁇ mation 6 in this example is materialized in terms of a lamp 30 be ⁇ ing illuminated in order to indicate to the operator the exact po ⁇ sition for the postal item 2a in a sorting register 32. While now removing the postal item 2a on top of the stack 20 for sorting the postal item 2a into the indicated position in the sorting register 32, the optical marks 28 are temporarily occluded during the move ⁇ ment for removing the postal item 2a which shall be indicated by arrow 34.
  • the image recognition module 14 detects that the optical marks 28 have been disappeared temporarily during the removal move ⁇ ment of the postal item 2a by an evaluation of the images taken by the camera 8. In response to the detection, the re-appearance of the optical marks 28 in the images taken by the camera 8 for the specific area which domiciles the optical marks 28 leads to the de ⁇ duction that the successive postal item 2b is now present on the top of the stack 20. Now, the camera 8 takes a new image (or a num ⁇ ber of images) of the stack 20 and in particular of the postal item 2b now present on the top of the stack 20. The address information 4 for this postal item 2b is then extracted and the respective sorting information 6 is assigned to the successive postal item 2b. Consequently, a lamp 30 is illuminated thereby indicating the cor ⁇ rect sorting position for the postal item 2b when being removed from the stack 20 and sorted into the sorting register 32.
  • This removal movement triggers then again a capture of a new image taken from the postal item 2c now on top of the stack 20. This pro ⁇ cess can repeated until all postal items 2 contained in the stack 20 are sorted into the sorting register 32.
  • the sorting register 32 is only one possible recipient for the postal items 2.
  • the post ⁇ al items 2 can be sorted into all kind of suitable containers and the like according to the sorting logic applied by the process con- trol module 16.
  • the present invention therefore utilizes a novel approach to de ⁇ tecting that the postal item being scanned has been changed.
  • the components involved in this method are mobile allowing it to be used in more than one location and operation.
  • Flexible destination sortation to cases, bins, trays or tubs based upon the postal oper ⁇ ation requirements and the respective sorting logic is easily achievable.
  • the method can easily be integrated into postal opera- tions both physically and through IT networks.
  • the destination sortation is programmable or can be supplied by the customer (visu ⁇ al point to light, graphic screens, Heads Up Displays and overlays, voice, etc) based upon customer specific requirements. This can be in the form of carrier designation, physical address location, geo- coordinates and a variety of other schemes such as What3Words.
  • the present invention therefore provides a self-contained scanning system with camera and lighting. It further provides for adjustable lighting for different environments (natural light, florescent, etc) . It also provides height adjustment of the board 22 to accom ⁇ modate the operator stature.
  • the system and the method are adjusta ⁇ ble with respect to the field of view 10 and the image resolution.
  • the image recog ⁇ nition module 14 can provide a method of automatically selecting the best image of each postal item 2 which is visible in the field of view 10 for further processing.
  • the sorting items 2 can be fed individually or - as shown - can be fed as a stack 20.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Sorting Of Articles (AREA)
  • Character Discrimination (AREA)

Abstract

The present invention discloses a method for providing sorting information (6) for postal items (2), such as letters, brochures, parcels and the like, each postal item (2, 2a, 2b, 2c) comprising an address information (4), comprising the steps of: a) providing an overhead positioned camera (8); said camera (8) being capable of taking images of the postal items (2, 2a, 2b); b) providing an image recognition means (14) in order to extract the address information (4) from the postal item (2, 2a, 2b); c) providing a process control (16) being enabled to assign the sorting information (6) to the postal item (2, 2a, 2b) in response to the extracted address information (4); d) forming a stack (20) of postal items (2, 2a, 2b) wherein the postal items (2, 2a, 2b) are oriented to allow reading the respective address information (4) from the overhead positioned camera (8) wherein the stack (20) of postal items (2, 2a, 2b) is positioned in a determined area of view (24) with respect to the camera (8); e) disposing at least one optical mark (28) adjacent to the determined area of view (24); f) removing the postal item (2a) on top of the stack (20) and occlude the at least one optical mark (28) temporarily for the camera (8) during the movement for removing; g) detecting that the at least one optical mark (28) has been occluded temporarily by an evaluation of the images taken by the cam- era (8); and h) in response to the detection deducting that the successive postal item (2b) is now present on the top of the stack (20), taking a newimage of the successive postal item (2b) and extracting the address information (4) from this new image and assigning the respective sorting information (6) to the successive postal item (2b).

Description

Method for providing sorting information for postal sorting items
The present invention relates to a method for providing sorting information for postal items, such as letters, brochures, parcels and the like, each comprising an address information.
Currently, postal sorting centers around the world use manual labor and highly trained personal to sort mail items which are rejected by automation or not able to be run on automated machines.
Postal processing applications require reading and recognition of the address of the postal items being processed, in order to pre¬ pare the items for delivery. For example, all of the postal items that will be delivered on the same delivery route would be separat- ed from all of the other postal items, so that they can be loaded into a delivery vehicle in preparation for the delivery route. Manual methods of reading and recognition of postal items during pro¬ cessing requires a great deal of labor and expertise. Fully auto¬ matic methods of processing postal items can be large, inflexible, and can require significant volume of postal items to justify their cost. When space and volume of postal items are limited, the ideal system is small, flexible, adds productivity to manual processing steps, and reduces the expertise required to perform the pro¬ cessing. Automatic scanning and recognition equipment can be ap- plied to postal processing in these situations. The scanning equip¬ ment captures an image of a postal item, automatic recognition software extracts and derives relevant processing information, and the information is provided in the form of simple instructions to the operator regarding processing of that postal item. An example for this postal processing is given in the European Patent Applica¬ tion EP 2 906 367 Al . Traditional methods of manually scanning postal items for automatic reading have required complex methods and systems to determine when a new item requires scanning, repre¬ senting a signal to the automatic recognition software to extract and derive new processing information to be presented as instruc¬ tions to the operator. The solution disclosed in EP 2 906 367 Al exactly suffers the same problem. The present invention therefore has the objective to provide a method for providing sorting information for postal sorting items allowing postal sorting centers to reduce manual labor and scheme knowledge throughout its networks, including but not limited to last mile delivery optimization. The invention shall further allow sortation of mail items to final destination or next destination via non-schemed trained personnel at very high throughputs from many different physical streams. This will represent a significant decrease in direct labor cost as well as training.
This objective is achieved according to the present invention by a method for providing sorting information for postal items, such as letters, brochures, parcels and the like, each postal item compris¬ ing an address information, comprising the steps of:
a) providing an overhead positioned camera; said camera being capa¬ ble of taking images of the postal items;
b) providing an image recognition means in order to extract the address information from the postal item;
c) providing a process control being enabled to assign the sorting information to the postal item in response to the extracted address information;
d) forming a stack of postal items wherein the postal items are oriented to allow reading the respective address information from the overhead positioned camera wherein the stack of postal items is positioned in a determined area of view with respect to the camera; e) disposing at least one optical mark next to the determined area of view;
f) removing the postal item on top of the stack and covering the at least one optical mark temporarily during the movement for remov- ing;
g) detecting that the at least one optical mask has been disap¬ peared temporarily by an evaluation of the images taken by the camera; and
h) in response to the detection deducting that the successive post- al item is now present on the top of the stack, taking a new image of the successive postal item and extracting the address infor¬ mation from this new image and assigning the respective sorting information to the successive postal item. This method allow the unanimous recognition of the address infor¬ mation of the next postal item once the topmost postal item has been removed for being further processed according to the sorting information. The sorting information thereby may comprise an optical and/or acoustical indication where to sort the current postal item. Just by occlusion and the re-appearance of the optical mark the image recognition is triggered to recognize the address infor¬ mation of the next postal item present on the top of the stack. Therefore, this process is more reliable as compared to prior art processes where low contrasts images of subsequent postal items have to be compared in order identify the presence of the subse¬ quent postal item on top of the stack. In the present invention, just high contrast images taken from the optical mark have to be compared.
In order to sort more postal items, it is recommended to repeat the steps f) to h) a number of times in order to reduce the number of postal items present in the stack. Usually, one stack is sorted completely prior to loading the next stack into the predetermined area .
A preferred embodiment provides for an optical mark being in form of a symbol, such as a cross, an X or the like, having high con- trast as compared to the surrounding area. Typically, a symbol, such as a letter or a cross, printed in black on a white paper or white underlay are a suitable pair of high contrast for the recog¬ nition of the occlusion and the re-appearance of the optical mark. Typically, the address information is provided in form of hand- and/or typewriting and/or fluorescent bar code being readable on one surface of the postal item.
Preferred embodiments of the present invention are hereinafter ex- plained more detailed with respect to the attached drawing that de¬ picts schematically the method for providing sorting information 6 for postal items 2, such as letters, brochures, newspapers, maga¬ zines and the like, each comprising an address information 4. The drawing shows an overhead positioned camera 8 having a field of view 10 illustrated by dotted lines 12. This camera 8 is used to take images of the postal items 2. The images taken by the camera 8 are processed by an image recognition module 14. The processing of the image recognition module 14 lead to the extraction of the ad¬ dress information 4 which is part of the video image taken by the camera 8. The address information 4 can be handwritten or machine- written but may also comprise a bar code 16 printed onto the postal item 2a in a preceding sorting process.
The image recognition module 14 forms logically a part of a process control module 16 which is enabled to assign the sorting infor¬ mation 6 to the postal item 2 in response to the extracted address information 4. In the present example, the sorting information 6 is contained in a database 18. The sorting process now works as fol¬ lows :
Firstly, a stack 20 of postal items 2a, 2b, etc. is formed wherein the postal items 2a, 2b, etc. are oriented to allow reading the re- spective address information 4 from the overhead positioned camera 8 wherein the stack 20 of postal items 2a, 2b, etc. is positioned on a board 22 within the determined area 24 which corresponds to the area of view 10 with respect to the camera 8. The determined area 24 is defined by marks 26 which help an operator (here not shown) to position the stack 20 accordingly. Further, three optical marks 28, here three crossed circular boxes, are disposed adjacent to the determined area 24 on the board 22. These optical marks have (28) a high contrast as compared to the board 22. During the sort¬ ing process, the camera 8 take continuously images form these opti- cal marks 28 and the image recognition module 14 determines for every image whether the optical marks 28 are present.
Once the address information 4 is extracted from the image taken from the postal item 2a on the top of the stack 20, the sorting in- formation 6 is assigned to the postal item 2a. The sorting infor¬ mation 6 in this example is materialized in terms of a lamp 30 be¬ ing illuminated in order to indicate to the operator the exact po¬ sition for the postal item 2a in a sorting register 32. While now removing the postal item 2a on top of the stack 20 for sorting the postal item 2a into the indicated position in the sorting register 32, the optical marks 28 are temporarily occluded during the move¬ ment for removing the postal item 2a which shall be indicated by arrow 34. The image recognition module 14 detects that the optical marks 28 have been disappeared temporarily during the removal move¬ ment of the postal item 2a by an evaluation of the images taken by the camera 8. In response to the detection, the re-appearance of the optical marks 28 in the images taken by the camera 8 for the specific area which domiciles the optical marks 28 leads to the de¬ duction that the successive postal item 2b is now present on the top of the stack 20. Now, the camera 8 takes a new image (or a num¬ ber of images) of the stack 20 and in particular of the postal item 2b now present on the top of the stack 20. The address information 4 for this postal item 2b is then extracted and the respective sorting information 6 is assigned to the successive postal item 2b. Consequently, a lamp 30 is illuminated thereby indicating the cor¬ rect sorting position for the postal item 2b when being removed from the stack 20 and sorted into the sorting register 32.
This removal movement triggers then again a capture of a new image taken from the postal item 2c now on top of the stack 20. This pro¬ cess can repeated until all postal items 2 contained in the stack 20 are sorted into the sorting register 32.
It has to be mentioned that the sorting register 32 is only one possible recipient for the postal items 2. Alternatively, the post¬ al items 2 can be sorted into all kind of suitable containers and the like according to the sorting logic applied by the process con- trol module 16.
The present invention therefore utilizes a novel approach to de¬ tecting that the postal item being scanned has been changed. The components involved in this method are mobile allowing it to be used in more than one location and operation. Flexible destination sortation to cases, bins, trays or tubs based upon the postal oper¬ ation requirements and the respective sorting logic is easily achievable. The method can easily be integrated into postal opera- tions both physically and through IT networks. The destination sortation is programmable or can be supplied by the customer (visu¬ al point to light, graphic screens, Heads Up Displays and overlays, voice, etc) based upon customer specific requirements. This can be in the form of carrier designation, physical address location, geo- coordinates and a variety of other schemes such as What3Words.
The present invention therefore provides a self-contained scanning system with camera and lighting. It further provides for adjustable lighting for different environments (natural light, florescent, etc) . It also provides height adjustment of the board 22 to accom¬ modate the operator stature. The system and the method are adjusta¬ ble with respect to the field of view 10 and the image resolution. One can provide a designed background pattern for the scanning cam- era 8. It allows the camera 8 to continuously scanning the surface of the board 22 with a certain frame rate and provides a mechanism for automatic brightness regulation of the camera. The image recog¬ nition module 14 can provide a method of automatically selecting the best image of each postal item 2 which is visible in the field of view 10 for further processing. The sorting items 2 can be fed individually or - as shown - can be fed as a stack 20.

Claims

Patent Claims
1. A method for providing sorting information (6) for postal items (2), such as letters, brochures, parcels and the like, each postal item (2, 2a, 2b, 2c) comprising an address information (4), said method comprising the steps of:
a) providing an overhead positioned camera (8); said camera (8) be¬ ing capable of taking images of the postal items (2, 2a, 2b);
b) providing an image recognition means (14) in order to extract the address information (4) from the postal item (2, 2a, 2b);
c) providing a process control (16) being enabled to assign the sorting information (6) to the postal item (2, 2a, 2b) in response to the extracted address information (4);
d) forming a stack (20) of postal items (2, 2a, 2b) wherein the postal items (2, 2a, 2b) are oriented to allow reading the respec¬ tive address information (4) from the overhead positioned camera (8) wherein the stack (20) of postal items (2, 2a, 2b) is posi¬ tioned in a determined area of view (24) with respect to the camera (8) ;
e) disposing at least one optical mark (28) adjacent to the deter¬ mined area of view (24);
f) removing the postal item (2a) on top of the stack (20) and oc¬ clude the at least one optical mark (28) temporarily for the camera (8) during the movement for removing;
g) detecting that the at least one optical mark (28) has been oc¬ cluded temporarily by an evaluation of the images taken by the camera ( 8 ) ; and
h) in response to the detection deducting that the successive post¬ al item (2b) is now present on the top of the stack (20), taking a new image of the successive postal item (2b) and extracting the ad¬ dress information (4) from this new image and assigning the respective sorting information (6) to the successive postal item (2b) .
2. The method according to claim 1, wherein the steps f) to h) are repeated a number of times in order to reduce the number of postal items (2) present in the stack (20) .
3. The method according to claim 1 or 2, wherein the optical mark (28) is provided in form of a symbol, such as a cross, an X or the like, having high contrast as compared to the surrounding area.
4. The method according to any of the preceding claims wherein the address information (4) is provided in form of hand- and/or type¬ writing and/or fluorescent bar code (16) .
EP17734676.4A 2016-07-21 2017-06-21 Method for providing sorting information for postal sorting items Active EP3487638B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP16180628.6A EP3272430A1 (en) 2016-07-21 2016-07-21 Method for providing sorting information for postal sorting items
PCT/EP2017/065272 WO2018015097A1 (en) 2016-07-21 2017-06-21 Method for providing sorting information for postal sorting items

Publications (2)

Publication Number Publication Date
EP3487638A1 true EP3487638A1 (en) 2019-05-29
EP3487638B1 EP3487638B1 (en) 2020-05-27

Family

ID=56511381

Family Applications (2)

Application Number Title Priority Date Filing Date
EP16180628.6A Withdrawn EP3272430A1 (en) 2016-07-21 2016-07-21 Method for providing sorting information for postal sorting items
EP17734676.4A Active EP3487638B1 (en) 2016-07-21 2017-06-21 Method for providing sorting information for postal sorting items

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP16180628.6A Withdrawn EP3272430A1 (en) 2016-07-21 2016-07-21 Method for providing sorting information for postal sorting items

Country Status (2)

Country Link
EP (2) EP3272430A1 (en)
WO (1) WO2018015097A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116629761A (en) * 2023-07-24 2023-08-22 北京京东乾石科技有限公司 Article sorting method, device and system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5794789A (en) * 1995-12-13 1998-08-18 Payson; William H. Semi-automated integrated sort system
US6748294B1 (en) * 2000-10-23 2004-06-08 Bowe Bell + Howell Postal Systems Company Flats bundle collator
DE102009024746A1 (en) * 2009-06-12 2010-12-16 Siemens Aktiengesellschaft Apparatus and method for controlling the transport of an item to a receiving unit
FR2996789B1 (en) * 2012-10-11 2015-12-04 Solystic METHOD AND DEVICE FOR HELPING SORT OBJECTS IN A SORT BIN

Also Published As

Publication number Publication date
WO2018015097A1 (en) 2018-01-25
EP3272430A1 (en) 2018-01-24
EP3487638B1 (en) 2020-05-27

Similar Documents

Publication Publication Date Title
US6768810B2 (en) System and method for detecting address fields on mail items
US8442266B2 (en) Device and method for identifying mail items
US9192965B2 (en) Package vision sort system and method
JP3124296B2 (en) How to detect the position and direction of the fiducial mark
JP3207419B2 (en) Parcel distribution method
US20120070086A1 (en) Information reading apparatus and storage medium
EP2851846B1 (en) Sorting device and sorting method
US6665422B1 (en) Method and device for recognizing distribution data on postal packets
AU2013328516B2 (en) Method and device for assisting in the sorting of objects in a sorting box
KR100536509B1 (en) Method and device for recognition of delivery data on mail matter
US10118202B2 (en) Method of sorting postal articles into a sorting frame with the sorted articles being counted automatically
JPH0397086A (en) Character recognizing method
US20090285486A1 (en) Method for identifying postal mailings
JP6487565B2 (en) Mail image pairing using gradient field singularity descriptors
EP3487638B1 (en) Method for providing sorting information for postal sorting items
US9421579B2 (en) Method of merging a postal article into sorted mail, the method including assistance via visual designation of the location at which the postal article is to be inserted
DE102009060515A1 (en) Method and device for sorting articles of different format classes
DE69629859T2 (en) Video coding apparatus and method
US20140222192A1 (en) Method of merging non-machine-sortable postal articles with machine-sorted mail pieces
JP7143488B2 (en) Delivery processing device, delivery processing method, and delivery processing program
US20060087542A1 (en) Method and system for efficiently printing and sorting multiple orders of transaction cards
EP3258420A1 (en) Delivery handling apparatus, delivery handling method, and delivery handling program
CN106733680B (en) Chemical fiber paper tube classification Transmission system based on image recognition
CN112990209A (en) Label detection device and label detection method
JP2004148238A (en) Apparatus and method for sorting mail

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20181207

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20200221

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1274015

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200615

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602017017354

Country of ref document: DE

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200927

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200827

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200828

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200928

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200527

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200827

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1274015

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200527

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602017017354

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200621

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20200630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200621

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200630

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200630

26N No opposition filed

Effective date: 20210302

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200630

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20210621

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210621

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200527

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 602017017354

Country of ref document: DE

Owner name: KOERBER SUPPLY CHAIN LLC, DFW AIRPORT, US

Free format text: FORMER OWNER: SIEMENS AKTIENGESELLSCHAFT, 80333 MUENCHEN, DE

Ref country code: DE

Ref legal event code: R081

Ref document number: 602017017354

Country of ref document: DE

Owner name: KOERBER SUPPLY CHAIN LOGISTICS GMBH, DE

Free format text: FORMER OWNER: SIEMENS AKTIENGESELLSCHAFT, 80333 MUENCHEN, DE

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 602017017354

Country of ref document: DE

Representative=s name: MUELLER SCHUPFNER & PARTNER PATENT- UND RECHTS, DE

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 602017017354

Country of ref document: DE

Owner name: KOERBER SUPPLY CHAIN LOGISTICS GMBH, DE

Free format text: FORMER OWNER: KOERBER SUPPLY CHAIN LOGISTICS GMBH, 78467 KONSTANZ, DE

Ref country code: DE

Ref legal event code: R081

Ref document number: 602017017354

Country of ref document: DE

Owner name: KOERBER SUPPLY CHAIN LLC, DFW AIRPORT, US

Free format text: FORMER OWNER: KOERBER SUPPLY CHAIN LOGISTICS GMBH, 78467 KONSTANZ, DE

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230523

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240409

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240624

Year of fee payment: 8