CA2300664A1 - Human-machine interface for a robotic containerization system - Google Patents

Human-machine interface for a robotic containerization system Download PDF

Info

Publication number
CA2300664A1
CA2300664A1 CA002300664A CA2300664A CA2300664A1 CA 2300664 A1 CA2300664 A1 CA 2300664A1 CA 002300664 A CA002300664 A CA 002300664A CA 2300664 A CA2300664 A CA 2300664A CA 2300664 A1 CA2300664 A1 CA 2300664A1
Authority
CA
Canada
Prior art keywords
robotic system
screen
interface
bay
container
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA002300664A
Other languages
French (fr)
Inventor
Christopher D. Tallis
Harold M. Mcgee
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ABB Flexible Automation Inc
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2300664A1 publication Critical patent/CA2300664A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Warehouses Or Storage Devices (AREA)

Abstract

A human-machine interface ("HMI") for a robotic containerization system.
The interface includes a graphical representation of a work cell chat has a plurality of virtual bays. Each virtual bay represents an actual bay that is configured to accept at least one type of container. Each virtual bay includes graphical indicia as to whether a container is present in the bay, the destination of the container, and the status of the container, such as whether the container is empty, partially full, or full.
The graphical representation also includes an operation bar depicting information regarding the operating state of the robotic system, the fault status of the robotic system, and the most recent sort scheme far the robotic system. The HMI also provides an interface for controlling various aspects of the robotic system and for generating reports reflecting the activity of the robotic system.

Description

MAR-13-00 18:31 P.04 8-711 Job-104 Mar-13-00. 05:29pm From-MICHAEL BEST T-885 P.04/39 F-672 Docket No. 10323-9007 HUMAN MACH.QVh: INTI=R1;AC8 FOR A ROBOTIC CONTAINERIZATION
SYSTEM
This application claims the benefit of U.S. Provisional Application No.
60/IZ4,427, filed March 15, 199SI_ BACKGROUND OF TriE INV>NTION
The present inventi4n relates to robotic systems. More particularly, the present invention relates to a robotic control system and interface for a robotic containerization system I;"RCS")..
Robotic systems .are used for a variety of different tasLs. Typically, industrial robots are used in welding, painting, arid material handling applications.
Before a robotic system is put in use, it is programmed to perform desired tasks. Once a system is placed online, the operation of the robotic system is monitored and controhed, as necessary, by a human operator.
In the past, robotic systems were controlled arid programmed using command-line or similar interfaces, where specialized command codes were input into the systems line-by-line to ac:complis~h proframming and other control functions.
Graphical interfaces have; been developed more recently. The interfaces are often I5 referred to as human-machine interfaces ("HMIs"). An HMI provides a graphical interface that permits a non-expert to program, control, and monitor the status of a robotic system. One exemplary IIMI is produced by A13)3 Robotics, Inc. and is disclosed in U_S. Patent ~i,675,22~1 (the "'229 patent"). The HMI shown in the '229 patent allows an "uneducated" technician to control the system without knowledge of the system's programming language. The HMl also allows the technician to direct the robot where and how to apply a weld. While this system is useful, it does not provide an appropriate interface fir ocher types of robotic systems. Newer rubotic systems are used in applications outside of industrial manufacturing. These applications include Ioatding mail and ocher parcels into trays and onto pallets {a process generically ?5 referred io as "containeril~aiion"). These relatively new applications for robotic MAR-13-00 18:31 P.05 R-711 Job-104 Mfr-13-00~ 05:29pm From-MICHAEL BEST T-885 P.05/39 F-672 Doclei No. 10323-9007 systems reqetire HMIs with different and enhanced features tiom HMIs used in the past.
SUMMARY OF THE INVENTION
Accordingly, the present invention provides an HMI for a robotic S containerization system ("RCS"). The HMI provides the operator of the RCS
with a variety of information regarding the RCS and allows the operator to create sort schemes that conuol hov~r items arc loaded into containers- The HMI is divided into several screens and includes a main screen with a graphical representation of a work ceh having a plurality of virtual hays. The virtual bays represent actual bays in the RCS that are configured to accept containers. Each virtual bay includes graphical indicia as to whether a container i.s present in the actual bay, the destination of the container, and the status .of the container; such as whether the container is empty, partially full, or full- Thc: HMI provides addition information about the RCS
through an operation bar that depicts the operating state oFthe RCS, the fault status of the RCS, and the most recent. sort scheme for the RCS.
Various other features of the RGS are depicted in other virtual representations.
The HMI may include a ~aphical representation of a perimeter barrier around the work cell arid indicate the; condition of closable access ways in the perimeter barrier.
The HMI may also include a reprEaentation of a conveyor system- The HMl may ?0 include one or more pull down menus with links io other screens.
Thz other screens in the HMI include a startup screen that provides a visual representation of conditions neczssary to place the robotic system into an automatic operation mode. A destination screen permits the combination and modification of destination codes for trays. A scheme screen permits the modification and assignment 2S of destinations to each bay. A manual functions screen permits manual operation of at least some of the functions of the robotic system. A reports screen permits monitoring of the performance of the robotic system. An alarm screen displays alarms, faults, or both thal: have occurred in the robotic system. An Il0 screen displays the name and stal:us of a predetermined number of inputs and outputs of the
-2-MAR-1:'-00 18:31 P.O6 R-711 Job-104 Mar-13-00. 05:29pm From-MICHAEL BEST T-885 P.06/39 F-672 I,~ocket No. 10323-9007 rabotic system. Finally, a maintenance screen permits the setting of passwords and other maintenance items; for the ItCS. The HMI may also provide a selection to allow programming of a soft F"LC running within the system controller.
These are just some of the features and advantages of the present invention_ S Others will become apparent by a review of the drawings and details described below.
BRIEF DESCRIPTION OF TFil=! DRAWINGS
Fig. 1 is a partially exploded, perspective view of a robotic containeri2ation system.
Fig_ 2A is a schematic, top view of the robotic containerization system 1 Q configured to load pallets.
Fig. 2B is a schetnatic, top view of the robotic cont2tinerization system configured to load carts.
Fig. 3 is a schematic diagi~m, illustrating the architecture of the control system used in the robotic containeri2ation system.
15 Fig. 4 is an exemplary illustration of a main screen of the hum$n machine interface.
Fig. 5 is an exemplary illustration of a startup screen of the human machine interface.
Fig. 6 is an exemplary illustration Qf a destination screen of the human ?0 machine interface.
Fig. 7 is an exemplary illustration of a scheme screen of the human machine interface.
Fig. 8 is an exemplary illustration of a manual functions screen of the human machine interface.
-3-MAR-13-00 18:31 P.07 R-711 Job-104 Mar-13-00. 05:29pm From-MICHAEL BEST T-885 P.07/39 F-672 Docket No_ 10323-9007 Fig. 9 is an exemplary illustration of a report screen of the human machine interface.
Fig_ 10 is an exemplary illusir-anon of an alarm screen of the human machine interface.
Fig. 11 is an ~exetnpla~ry illustration of an input/output screen of the human machine ~terface.
Fig. 12 is an illustration of the main screen shown in Fig. 4, with the pull-down file menu selected.
Fig. 13 is an exemplary illustration of a password screen of the human machine interface.
Before one embodiment of the invention is explained in full detail, it is to be understood that the invention is not limited in its application to the details of construction and the arrangement of components set forth in the following description or illustrated in the followving drawings. The invention is capable of other 1 S embodiments and of being practised or of being carried out in various ways. Also, it is to be understood that fhe phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of "including"
and "comprising" and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereo!' as well as additional items.
DETAILED DESCRffTION
A robotic control system and interface 30 {schematically shown in Fig. 3) of the invention can be used with various mbotic systems. One exemplary use of the robotic control system ar,~d interface 30 is in an RCS 3S as shown in Figs. 1, 2A, and 2B. The RCS 35 is an automated system for loading pallets 40 and carts 4S with mail trays SO and tubs 55 based on a sort scheme. The mail trays SO and tubs 55 (collectively referred to as "trays") contain mail (not shown). Each tray includes an identifier or destination code (which rnay be implemented as a bar code) that provides information for sorting the trays. In the embodiment disclosed, the destination code MAR-.13-00 18:31 P.OB R-711 Job-104 Mar-1.3-00, 05:30am From-MICHAEL BEST T-885 P.08/39 F-672 Docket No. 10323-900'7 may include a ZIP code, a content identification number or C1N code, a day of delivery or DOD code, turd/or a automation identification number or (AIN) code.
?'lte RCS 35 includes two cells C1 and C2, each equipped with a gantry or overhead-type robot 60 .and 65_ Each cell C1 and C2 includes an open frame 70 and 75 that is secured to a hitrd surface such as a concrete floor 80. The space around the frame members may be enclosed with a perimeter fence 85, mesh, wall, or similar matzrial. ~ or more access ways, doors, or gates 90 may be prpvided to permit access to the interior of each cell. The gates include gate interlocks 93 (schematically shown in Fig. 3) that sense whether the gates are closed and locked, closed and unlopkcxl, or open and unlocked. The s:alas of the gates is communicated to a 5yacem controller 96.
Each cell C1 and. C2 has a plurality ofplaces 98. One or morn places 98 form bays 130. The bays 130 provide an area for pallets 40, carts 45, or similar containers (generically referred to as "containers"). Depending on the size of the container, one 1 S or more places 98 may lie combined to form onz larger bay 13U. In the example illustrated, a cart 4S is placed in a bay having one place (as schematically shown in Fig. 2B) and a pallet 4U is placed in a bay having two places (as schematically shown in Fig. 2A). Typically, carts 45 and pallet$ 44 are placed together in cells C1 and C2_ l3ay sensors 135 (schematically shown in Fig. 3) sense the presence or absence of cpntainers 40 and 4S in a bay and that information is communicated to the system controller 96. The containers 40 and 4S may be moved into and out of the cells and C2 by non-robotic means through the access gates 90 or doors.
Fach cell is divided into two zones, ZI and 22. An operator (not shown) may access each zone through one of the doors 90_ Each bay 130 is assigned a location identifier (e.g., 1-24 in F'ig. 2B ox 101-123 in Fig. 2A). The location identifiers provide an exact "destination" or "address" far each bay. For example, as shown in Fig. 2A, zone ZI of cell C1 has locations 7, $, 9, 10, 1 l, and 12, zone Z2 of cell C1 has locations 1, 2, 3, 4, 5~, and 6, zone Z1 of cell C2 has locations 19, 20, 21, 22, 23, and 24, and zAne 22 of cell C2 has locarions 13, 14, 15, 16, I7, and 18.

MAR-13-00 18:31 P.09 R-711 Job-104 Mar-13-00, 05:30pm From-MICHAEL BEST T-885 P.09/39 F-672 Iaocket No. 10323-9007 As shown in Fig.. 1, trays are brought info the cells Cl and C2 along paths Pn and P8 by a conveyor system 14(? and are directed to pick-up points 145. In the embodiment shown, twcr parallel conveyors 150 and 155 are positioned to move items from one end of the cello to the other. Conveyor sensors 160 (schematically shown in P'ig. 3) are positioned along the conveyors 150 and 1 SS in order to detect the location and presence of trays 50 and 55 on the conveyors 150 acrd 155. Information from the conveyor sensors 160 is cammur~icated to the system controller 9b.
The robots in each cell C 1 and C2 are mounted on a plurality of beams 170 spanning the cells C1 anal C2. Each robot 60 and 65 is movable along respective beams 170 and the bca<rrs 170 are movable on rc~pcctiva tracks 175. Each robot is movable along a substantially horizontal plane over the respective cells Cl or C2 arid is capable of raising and lowering a tray within the cell C1 or C?. )?ach robot is controlled by its own robot controher 180 or 185_ Qrre type of robot controller suitable for use in the present invention is an S4C robot controller available through A88 Flexible Automation, lnc. The robot controller 180 and 185 includes software that controls the movement of the respective robot 60 or 65. As shown in Fig.
3, the robot controller 180 interfaces with the system controller 96 and receives commands from the system controller depending on the status of the system. Of course, it should be understood that while: two separate control systems are described herein, a single control system combining the functions of the robot and system controllers could be implemented.
The system controllCr 96, which is schematically shown in Fig. 3, controls the ACS 35. The system controller 96 may be implemented using a server, a personal computer, or similar device (generally referred to as a computer). The system controller 96 includes a microprocessor 190 and internal memory 200 and internal storage 202. The internal memory 200 allows for storage of data, acid the internal storage 202 contains sofllvare for controlling the RCS 3S. The software includes programming for providing a human machine uiterface [HMI) in the form of a graphical-user interface I;GiJI).

MAR-13-00 18:31 P.10 R-T11 Job-lOb Mar-13-00. 05:30am From-MICHAEL BEST T-885 P.10/39 F-672 Docket No. 10323-9007 The system controller ftuther includes communication ports 210 for connections to input devices, communication pons 215 for connections to output devices, and communication pons 220 for connections to input/output devices.
The input devices include th~~ conveyor sensoss 160, the bay sensors 135, the gate S interlock sensors 93, a keyboard 220, a mouse 22S and/or similar devices_ The output devices include a visual display _'?27 and a printer 229. The inputJoutput device$
include the conveyor system 140, the robot controllers 1 HO and 1$5, and other computers 235 such as a plant computer (not shown). The cpnnection between the system controller 9b and the other computers 23S is throu~t a network that allows for two-way communications. In general, the system controller 9b receives signals from input units and lnputloutput devices, processes the inputs in the microprocessor, and transmits signals to the output units and input/output devices.
Mail trays 50, tubs 55, and other ite;ns are placed on the conveyer system 140.
Once inside the cells C 1 and C2, the trays are directed to the pict;-up points 145. At the pick up point, the robots grasp the trays and move them to the appropriate container 40 or 45, based or4 a currently running sort scheme. The operator (not shown), through the use of the HMI, creates the sort scheme used by the RCS.
The son scheme provides a set of instructions that determines the location to which a tray is sent. In the embodim~.nt described, the determination of the correct location is based on the destination code.
The HMI application software of the system controller 96 prpvides a graphical user interface (GUl) or'°front end" for the operation of the RCS 3S.
The HMI
provides a convenient method to operate and view status information of the RCS
35.
The HMI also allows the; operator to conuol the robots 60 and bS in order to perform 35 service operations on the: robots b0 and 55. It should be noted that with Figs. 4-13 and the description below, one of ordinary skill in the art could readily create thz programming code to carry out the functions described. The I~MI illustrated was developed for a Windows NT environment using a variety of commonly available Windows tools, including Microsoft Visual Basic and Microsoft Data Report Designer. Of course, Zlte: invention is not limited io HMIs implemented for Windows MAR-.13-00 18:31 P.11 R-T11 Job-104 Mar-13-00. 05:30Pm From-MICHAEL BEST T-885 P.11/39 F-6T2 Docket No. tU323~9007 environments, as those of ordinary skill in the art could readily implement the invention in other envirotunents.
A main screen 4tlU for the HMi is shown in Fig. 4. The main screen 400 provides the user with a braphical representation of the cells G1 and C? as viewed from the top of the RCS 35. Of course, the graphical representation of the ceps will change depending on thr configuration of the RCS 35_ The main screen 35 provides an initial starting paint for the operator to interact with the control unit 96 and provides the current status information for the system. The main screen also displays the current sorting scheme {discussed below) according to which the incoming trays are sorted (or loaded into containers}.
8ach of the bays 130 of the RCS 35 are represented in the main screen 400 by a virtual bay 405. The maximum number of bays 40S within the main screen 400 corresponds to the maximum number of bays 130 possible within the RCS. For the embodiment described herein, the maximum number of bays 405 is twenty-four-1 S However, if one or more: containers 40 occupies two or more places 98, then the number of bays 405 will decrease-The virtual layQUt ofthe cells G1 and C2 developed using the FiMI can be output to the printer 229 to create a hard copy printout. The printout can bz used by technicians to position containers in appropriate bays 130 and places 98.
30 As was describeti above, each bay is assigned a location or identifier.
l=ach respective virtual bay 405 includes the location for each bay 130. The numbering scheme of the location identifiers is as follows. Starting from the left of cell C 1, zone Z2 as viewed on the main screen, each place 98 is numbered from 1-6. Starting from the left of cell Cl, zone Z2 as viewed on the main screen, each place 98 is numbered ?S from 7-12_ The places ~~8 of cell C2 are numbered similarly except that they contain an offset {in this case 1'?) that is added to each location number. If all the bays 130 contain a container that occupies only one place 98, then each bay is assigned the location numbar of the respective place. However, if a bay 130 contains a container chat includes more than one placz 98, them the bay is assigned the odd place number _g_ MAR-.1:'-00 18:31 P.12 R-711 Job-104 Mar-13-00. 05:31Pm From-MICHAEL BEST T-885 P.12/39 F-672 Docket No. 10323-9007 and an offset of 100 is added. For example, in cell C1, zone Z1, places 9 and contain a pallet 40. The corresponding bay 130 is assigned the odd place number 9, plus an offset of 100 or a number of 109. By having the offset of 100, the control systzm and the operator know thf~ bay includes more than one place.
in addition to hawing a location identifier, each virtual bay 405 includes a destination. For example, in the embodiment shown, the carts placed in location S are going to Dest_S. Each destination represents a real world locale. For example, pest 5 may represent Milwaukee, Wisconsin. As described below, the destination is input by an operator along with the destination codes into the control sya'tern-Each virtual bay 405 also includes the number of trays within a particular container within the bay, and the status of the container (e.g., whether the container is empty, partially full, completely full, or missing). Each virutal bay 405 may also provide graphical infornzation through the use of colors. For example, if the container is full, the virtual bay is displayed in blue. If the containZr is partially full, empty or missing, the virtual bay 405 is orange, white, or gray, respectively. ay providing the status of the container, the HMI informs the operator when and what container needs to be replaced. Thus, the main screen of the HMl provides a simplified representation of the RCS during opemtioiz.
if the information for a particular container is not known, then default ?0 information may be presented. 1=or example, the information far cell C 1, zone Z2, place 2 is not known, arui thus, default infprmation is displayed within that virtual bay. Default information occurs when a place has not been programmed during creation of the sort scheme (as described below).
The main screen 400 provides a graphical representation of thz conveyor belts and a graphical representation of the trays moving on the conveyor belts. In addition.
the main screen 400 provides a representation of the respective ZIP, CIN, DQh, and AI1V codes on each tray at the pick-up points. For example, the tray at pick-up point 410 has a destination code of 3002322211. if the destination code is unknown, then the destination code is represented on the main screen by a series of Question marks.

MAR-13-00 18:31 P.13 R-T11 Job-104 Mar-1~3-00. 05:31Pm From-MICHAEL BEST T-885 P-13/39 F-672 Docket No. 10323-9007 The main screen 400 also provides a graphical representarion of the perimeter barrier and of gate interlock status information from the gate interlock sensors 93.
The graphical representati4n may include colors for representing different states. The main screen 400 includes a graphical representation of the fence 85 and providas information about whether the gates 90 are open and unsecured, closed and unsecured, or closed and, secured. Depending on the state of the gale 90, a different color is displayed. For example, red may represent the open and unsecured state, yellow may represent the: closed ;and unsecured state, and green may represent a closed and secured state.
The again screen 400 provides virtual buttons 420, 425, 430, 435, and 445 to select a sort scheme, to r:nable a selected sort scheme, to disable a selected sort scheme, to purge stations holding Left-over half trays, and to allow the user to silence an alarm if a fault occurs. The main screen also provides virtual buttons 450 and 455 to start and stop a loading or sorting cycle.
As shown in Figh. 4-13, each screen of the HMI contains common information. 'This information is available at the top of each screen in a display area or display bar 460. The information includes the current operatirl<g state of the system 465, an active fault indication 470, a description of the most recent fault 475, the date 480, the time 485, the currently active son scheme 490, the name of the operator that is logged into the system 493, and a log off button 495. Color can be used for the background of the texiu~~l description for each box 465-495 to provide more information to the operator. For example, if the RCS 35 is performing a sort and no errors have occurred, th~:n the operating state 465 may be highlighted by a green background and the active fault 4?0 may also be highlighted by a green background.
Alternatively, if the RC!3 is performing a sort and an error has occurred, then the background of the operating state 4b5 may still be highlighted in green, while the background of the active fault 470 may be highlighted in yellow. If the fault is a critical fault, them the control system may stop the sort, change the text of the operating state 465, and change the respective background to red. Of course, othzr graphical representation through colors can be added to provide additional information.

MAR-13-00 18:31 P.14 R-711 Job-104 Mar-13-00 05:31Pm From-MICHAEL BEST T-685 P.14/39 F-612 pocket No. 10323-9007 As best seen in Fig. 12, each screen contains a pull-down file menu 497, which contains several auxiliary functions- A first section allows the user tc~ select an option to program a soft PLC for controlling the robotic system. This selection starts the software necessary to prograrn the soft PLC that is running on the system controller 96. A second function allows the operator to go to a password maintenance screen {Fig. 13). A thirdl function allows the operator to print the current screen to the attached printer 229. As. notzd, an operator can use the printout to organize the cells as graphically represented on the hardcopy printout. The file menu also has selections for exiting the application, and shutting down the system controller 96.
1 O A start-up screen. 500 of the HMI is shown in Fig. 5. The start-up screen provides a visual rapresc:ntaeion to the operator of the conditions necessary to place the RCS 35 into automatic operation. If a particular condition is required, then the desired state indicator fc~r the condition is lit in a pariieular color such as green. if the action is nQt desired, then the desired state indicator is lit in another color such as red.
In a similar fashion, if the actual state is satisfactory, then the state indicator is green.
If the actual state is unsatisfactory, then the state indicator is red. The RCS 35 is able to perform a specific acAAn when the required system conditions, as illustrated by the desired state indicators are matched by the actual conditions, as illustrated by the actual state indicators. 'fhe internal memory 300 of the system controller 9b includes a start-up configuration 'that initializes the status of the desired state indicators for the start-up screen 500.
A destination screen 600 of the HMI is shown in Fig. 6. The destination screen 600 allows the operator to assign ZIP, CIN, pOI7, and AIN codes or combinations of codes to destinations. Combinations of codes contain one or more destination codes and make creating sort schemes easier (as described below)-The destination Screen includes a destination list window 605 that provides a list of existing destinations. T:he existing destinations each include a destination name.
The destination screen includes a destination data window fil0 that allows the operator or user to create a new destination or edit an existing destination.
The destination screzn also includes virtual buttons 615, 620, b25, 630, and 635 to create a MAR-13-00 19:31 P.15 R-T11 Job-104 Mar-13-OO 05:32am From-MICHAEL BEST T-885 P.15/39 F-672 Docket No. 10323-9007 new destination, combine at least twn existing destinations into a new destination, rename an existing desii:nation, add destination data to an existing destination, and delete an existing destination.
To create a new destination, the operator activates the create new destination virtual button 615. The operator then enters the name of the destination, a brief description (e.b-, the natne of the locale or city) for the destination, and the ZIP, C1N, DOLL, and AIN cedes for the destination. Combining multiple ziP, CIN, DOX3, and AIN codes into the destination makes it easier for sending non-contiguous ranges of mat! to the same destination. Ail trays Having the ZIP, CFN, DOD and A1N codes specified in the destination are sorted Into the container assigned io that destination.
The operator can use symbols or "wild-cards" far simplifying the data entered into the destination. For example, the second entry of Dest 2 specifies that all trays having the ZIP code 48094 will. be sorted into the container assigned to Dest_2. Once the operator finishes creating the destination, the crested destination is added to the destination list of the de~stina~ioru list box 605. The user can then edit, combine, rename, and delete destinations listed within the destination list box 605.
A scheme screen 700 of the HMl is shown in Fig. 7. The scherxte screen 740 is used to create sort schemes. T be sort scheme determines which location within the cells a tray of mail will be delivered to. The scheme screen provides a graphical ?0 representation of the bays 98 of the RCS using a plurality of virtual hays 705. finch virtual bay 705 contains the name of the destination assigned to a bay, whether the bay contains a cart or pallet, the type of tray (e.g., mail tray or tub) that will be delivered to the bay, and the location identifier assigned to the bay.
The scheme screen 700 also includes an icon window 714. The icon window 710 includes each created destination and an associated icon 712. The user can "drag and drop" Qne of the icons 7I2 from the icon window 710 into one of the virtual bays 705 in order to assign the bay a destination for sorting. 'thus, when the sort scheme is created each location is. told what destination is assigned to that location, if the items in that location will be mail trays 50 or tubs SS, and if the bay will contain a pallet 40 or a cart 45.
-12~

MAR-13-00 18:31 P.16 R-T11 Job-104 Mar-13-00 05:32Pm From-MICHAEL BEST T-885 P.16/39 F-672 Docket No. 10323-9007 The scheme screen 700 also include virtual entry buttons 715, 720, 725, 730, and 735 to create a new ,port scheme, save a sort scheme, edit a sort scheme, delete a son scheme, open a sort scheme, and rename a sort scheme- 4ncz a sort scheme is created, it can be later recalled in. order to perform a sort.
A manual functions screen 800 of the 1~MI is shown in Fig. 8_ The manual functions screen 800 include virtual entry buttons 802-812 that can be activated by the operator to initiate software far performing selected manual operations on the system.
Operations include sendinb one car both of the robots to the home or service positions, bypassing one of the ral=Dais, releasing the tray that is ready for pickup, and purging 1 O selected sections of the conveyor system. Each of these futsetians is assigned to a selecizd security level to prevent unauthorized personnel from performing these operations. The manual function screen 800 also allows an operator to select and control various system and robot controls. Mode eoniroi~ 81a-8?0 pernlit thz user to select automatic operation, to select manual operati4n, to start a cycle, and to slop a cycle, respectively- The: manual function screen 800 also provides an operator interface to control the conveyor system and robot end effector. The manual functions screen includes a first purge main conveyor button 822 for the first cell C1 in the RCS, a purge main conveyor button 824 for the second cell C2, a purge recirculating conveyor button 8?6 for the first cell Cl, and a purge recirculating conveyor button 828 for the second cell C1. The manual functions screen may be configured to include a purge infeed conveyor button 830, a release tray control button 832 for the first r-obot. and a second release tray control button 83~
for the second robot.
A reports screen 900 of the HMI is shown in Fig. 9. The reports screen includes virtual entry buttons that can be activated by the operator to generate reports.
By generating reports, the operator can monitor the performance and throughput of the RCS 35. The reporl~s screen 900 also includes a preset time select button 905 and a manual times select bu;ton 910. These buttons initiatz software to generate reports based on pre-selected tours or shins, or based on manually selected time periods.
Through control buttons 912-926, the HMI allows reports to be created and printed for detailed volume incoming, detailed volume outgoing, maintenance, summary MAR-13-00 18:31 P.17 R-711 Job-104 Mar-13-Da 05:32am From-MICHAEL BEST T-885 P.17/39 F-672 Docket No. 103?3-9007 volume, sort scheme, routing, availability, and failure logs. A detailed volume incoming report shows every tray that is placed into one of the robots. The detailed volume outgoing report shows every tray that leaves the system, either by leaving in a full container or being rE jected. The maintenance report displays all errors that occurrzd in the system. The summary volume report shows the total volume that was placed into each location. The sort scheme report shows which ZIP, CtN, DOD, and A1N codes are assigned to each location. The availability report calculates the up time, down time, and blocked tinne of the system. The routing report displays all the detailed information behind the destinations that have been -entered into the system.
The failure log report sorts the errors that have occurred in the system and displays the errors ranked by how often they occurred.
An alarm screen 1000 of the HMI is shown in Fig_ 10. The alarm screen 1000 includes a window 100-'i Thai displays alarms ar faults that have occurred during the operation of the system.. The window 1005 includes an alarm message, the time of occurrence, and the time for acknowledgement. The alarms are sorted such that the mast recent alarm is placed at the top of the display. The alarm screen includes a virtual button 1010 for initiating software that allows the operator to acknowledge the alarm and, if possible, continue operation. Depending on the type of alarm, the RCS
may continue sorting trays. The: alarm screen 1000 provides a record of the alarms far ?0 performing maintenance to the RCS_ An input/output screen 1100 of the HMI is shown in Fig. 11. The inpuVoutput screen displays the narrve and status of selected inputs and outputs of the RCS 35. The screen assists the operator in debugging the R.CS 35 when an alarm occurs.
A password screen 1200 of the HMI is shown in Fig. 13. The password screen 1200 creates op,_rator names and passwords that are required for the security of the sy$tem 35. The password screen 1200 includes virtual buttons 1205, 1210, and 1215 to add a new user, delete a user, and edit the status of a user. The password screen 1200 also includes a dialogue box for selecting the level of sGCUrity an opzrator is granted. The password screen 1200 also includes a tour configuration window 3C1 1220 for creating the start and ~d times of a tour or shift.

MAR-13-00 16:31 P.18 R-711 Job-104 Mar-13-00 05:32am From-MICHAEL BEST T-885 P.18/39 F-6T2 pocket No. 10323-9007 The operation of the HMx for the RCS should be apparent from the description and drawings herein and additional details are trot provided. Many possible forms of the invention may be constructed based on the teachinbs set forth herein.
Thereforz, while the present invention has been described in reference to particular embodiments and examples, it should be undei~tood that the invention is not confined to the particular construction and arrangement of the components illustrated and described, but embraces all forms Encompassed by the following claims.
_IS_

Claims (53)

What is claimed is:
1. A human machine interface for a robotic system, the interface comprising:
a graphical representation of a work cell having a plurality of bays, each bay including graphical indicia as to whether a container is present in the bay, the destination of the container and the status of the container;
an operation bar depicting information regarding the operating state of the robotic system, the fault status of the robotic system, and the most recent sort scheme for the robotic system.
2. An interface as claimed in claim 1, further comprising:
a graphical representation of a second work cell.
3. An interface as claimed in claim 2, further comprising:
a graphical representation of a perimeter barrier around the first and second work cells, and wherein; the graphical representation of the each of the two work cells is divided into two zones and the perimeter barrier includes closable access ways into each zone.
4. An interface as claimed in claim 3, further comprising a graphical representation of a conveyor in each cell.
5. An interface as claimed in claim 3, further comprising a pull-down menu.
6. An interface as maimed in claim 1, wherein each bay includes graphical information indicating the capacity of a container.
7. An interface as claimed in claim 5, wherein the pull-down menu includes a link to a screw.
8. An human machine interface for a robotic system, the interface comprising:
a status bar for displaying operating state information of the robotic system;

a main screen that includes a graphical representation of a work cell, a graphical representation of a mix of container types positioned within the work cell, an indication of the load status of each container displayed, and destination information for each container displayed;
a startup screen that provides a visual representation of conditions necessary to glare the robotic system into an automatic operation mode;
a destination screen that permits the combination and modification of destination codes for trays;
a scheme screen that permits the modification and assignment of destinations to each bay;
a manual functions screen that permits manual operation of at least some of the functions of the robotic system;
a reports screen that permits monitoring of the performance of the robotic system; and an alarm screen that displays alarms, faults, or both that have occurred in the robotic system.
9. An interface as claimed in claim 8, further comprising:
an input/output screen that displays the name and status of a predetermined number of inputs and outputs of the robotic system.
10. An interface as claimed in claim 8, further comprising:
a file menu.
11. An interface as claimed in claim 8, further comprising:
a password maintenance screen with a tour times option.
12. An interface as claimed in claim 8, wherein the scheme screen permits the modification and assignment of a tray type to each container.
13. An interface as claimed in claim 8, wherein the manual functions screen provides a mechanism for instructing a robot to move to a home position.
14. An interface as claimed in claim 8, wherein the manual functions screen provides a mechanism for instructing a robot to move to a service position.
15. An interface as claimed in claim 8, wherein the manual functions screen provides a mechanism for bypassing a robot.
16. An interface as claimed in 8, wherein the manual functions screen provides a mechanism for releasing a tray in the grasp of a robot.
17. An interface as claimed in claim 8, wherein the manual functions screen includes multiple security levels.
18. An interface as claimed in claim 8, wherein the reports screen includes inputs for adjusting reports according to predetermined time periods.
19. An interface as claimed in claim 8, wherein the reports screen includes a selection that generate reports based on volume.
20. An interface as claimed in claim 8, wherein the reports screen includes a selection that generate reports based on sort scheme.
31. An interface as claimed in claim 8, wherein the reports screen includes a selection that generate reports based on errors in the robotic system.
22. An interface as claimed in claim 8, wherein the reports screen includes a selection that generate reports based on down time of the system.
23. An interface as claimed in claim 8, wherein the reports screen includes a selection that generate reports based on destinations entered into the robotic system.
24. A robotic system for containerizing a plurality of items, the system comprising:
a work cell having a plurality of bays;
a robot to deliver items to the plurality of bays;
a visual display: and a controller connected to the robot and the visual display, the controller operable to instruct the robot to deliver the items to the bays according to a sort scheme, and operable to provide an interface to an operator on the visual display, the interface comprising:
a first screen comprising a graphical representation of the work cell including each bay, and status information for each bay of the work cell.
25. A robotic system as claimed in claim 24, wherein the first screen further comprises an operations area that depicts information regarding a most recent sort scheme of the robotic system
26. A robotic system as claimed in claim 24, wherein the status information of each bay includes a destination for the bay.
27. A robotic system as claimed in claim 24, wherein the status information for each bay includes the number of items within the bay.
28. A robotic system as claimed in claim 24, wherein the status information far each bay includes a location identifier.
29. A robotic system as claimed in claim 24, wherein the first screen includes a display bar that depicts information regarding the operating state of the system.
30. A robotic system as claimed in claim 29, wherein the display bar depicts information regarding the fault status of the system.
31. A robotic system as claimed in claim 29, wherein the display bar depicts information regarding the most current fault of the system.
32. A robotic system as claimed in claim 29, wherein the first screen includes a mechanism to select a new sort scheme.
33. A robotic system as claimed in claim 24, wherein the first screen further comprises a graphical representation of a perimeter barrier.
34. A robotic system as claimed in claim 24, wherein the interface further comprises a second screen having a visual representation of conditions necessary to have the controller operate the robotic system in an automatic operations mode.
35. A robotic system as claimed in claim 24, wherein the interface further comprises a second screen that permits creation and modification of destinations.
36. A robotic system as claimed in claim 35, wherein the second screen comprises a destination list area that depicts all of the created destinations.
37. A robotic system as claimed in claim 24, wherein the interface further comprises a second screen that permits the assignment of destination codes to each bay of the work cell.
38. A robotic system as claimed in claim 37, wherein the second screen permits the modification and assignment of a tray type to each bay.
39. A robotic system as claimed in claim 24, wherein the interface further comprises a second screen that permits manual operation of at least some functions of the robotic system.
40. A robotic system as claimed in claim 24, wherein the interface further comprises a second screen that permits the generation of reports.
41. A robotic system as claimed in claim 40, wherein the second screen includes inputs for adjusting the reports according to predetermined time periods.
42. A robotic system as claimed in claim 40, wherein the second screen includes selections that generate the reports based on volume.
43. A robotic system as claimed in claim 40, wherein the second screen includes selections that generate reports based on sort scheme.
44. A robotic system as claimed in claim 40, wherein the second screen includes selections that generate reports based on errors in the robotic system.
45. A robotic system as claimed in claim 40, wherein the second screen includes selections that generate reports based on down time of the system.
46. A robotic system as claimed in claim 40, wherein the second screen includes selections that generate reports based on destinations entered into the robotic system.
47. A method of sorting a plurality of items wish a robotic system, the method comprising;
generating a virtual representation of the robotic system, the representation including a plurality of virtual bays, each virtual bay including status information for that bay; and generating an operations bar depicting information regarding a sort scheme for the robotic system.
48. The method as claimed in claim 47,further comprising:
generating a fault status of the robotic system can the visual representation.
49. The method as claimed in claim 47, wherein the status information includes a destination of a container, a number of items in the container, a location identifier for the container, and the capacity of the container.
50. The method as claimed in claim 47, wherein the representation of the robotic system includes a perimeter barrier.
51. The method as claimed in claim 47, wherein the status information includes color graphics indicating whether the container is empty, partially full, or full.
53. A method of setting-up a work cell for a robotic sorting system, the method comprising:
creating a sort scheme;
graphically representing a desired work cell on a visual display unit;
printing the desired work cell on paper; and arranging the work cell of the robotic system to mimic the desired work cell printed on paper.
53. A method of creating a sort scheme for a robotic system, the method comprising:
providing a visual representation of a work cell having a plurality of bays;
providing an icon window adjacent to the visual representation of a work cell, the icon window having a plurality if icons each with an associated destination;
dragging and dropping at least one of the icons into one of the bays.
CA002300664A 1999-03-15 2000-03-14 Human-machine interface for a robotic containerization system Abandoned CA2300664A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US60/124,427 1999-03-15
US12442799 1999-03-15

Publications (1)

Publication Number Publication Date
CA2300664A1 true CA2300664A1 (en) 2000-09-15

Family

ID=22414823

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002300664A Abandoned CA2300664A1 (en) 1999-03-15 2000-03-14 Human-machine interface for a robotic containerization system

Country Status (1)

Country Link
CA (1) CA2300664A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111389739A (en) * 2020-03-18 2020-07-10 晁志兵 Working method of sorting device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111389739A (en) * 2020-03-18 2020-07-10 晁志兵 Working method of sorting device
CN111389739B (en) * 2020-03-18 2022-01-11 深圳市君安宏图技术有限公司 Working method of sorting device

Similar Documents

Publication Publication Date Title
EP2353052B1 (en) Safety controller and method for controlling an automated installation
DE102010022258B4 (en) A robot control arrangement provided in a processing arrangement comprising a robot and a machine tool
US5249131A (en) Apparatus for controlling the loading of workpieces onto a pallet
CN102292680B (en) Method and device for creating a user program for a security control
US20070192707A1 (en) Numerical controller
CN100454192C (en) Safe PLC, sequence program creation support software, and sequence program judgment method
EP2098924B1 (en) Method and device for programming and/or configuring a safety controller
EP2098925A1 (en) Method and device for programming and/or configuring a safety controller
EP1136192A2 (en) Human-machine interface for a robotic containerization system
US5475797A (en) Menu driven system for controlling automated assembly of palletized elements
KR20200054066A (en) System for flexible manufacturing line
DE60313014T2 (en) COOPERATIVE INTELLIGENT MANUFACTURING UNITS
JP5254968B2 (en) Control device
CN101329561B (en) Automatic dock equipment operation control system and method with emergency handling function
CA2300664A1 (en) Human-machine interface for a robotic containerization system
EP1040893B1 (en) Manipulator control system
JP5964797B2 (en) Operation device for packaging machine
EP0741346B1 (en) Control device for controlling machines, especially controlling a welder
Yao Design and implementation of Web-based diagnosis and management system for an FMS
JPH05127734A (en) Operation display device for manipulator
Yu et al. Design considerations for teleoperation systems operating in gas-tight argon cells
Kotze Modular control of a reconfigurable conveyor system
Bonasso Issues in providing adjustable autonomy in the 3T architecture
Ranky Program prospectus for the simulation, design and implementation of a flexible assembly and inspection cell
WO2021161831A1 (en) Display control system

Legal Events

Date Code Title Description
FZDE Dead