US20170337506A1 - System and Method Using Robots to Assist Humans in Order Fulfillment - Google Patents
System and Method Using Robots to Assist Humans in Order Fulfillment Download PDFInfo
- Publication number
- US20170337506A1 US20170337506A1 US15/512,058 US201615512058A US2017337506A1 US 20170337506 A1 US20170337506 A1 US 20170337506A1 US 201615512058 A US201615512058 A US 201615512058A US 2017337506 A1 US2017337506 A1 US 2017337506A1
- Authority
- US
- United States
- Prior art keywords
- order
- human
- robot
- receiving
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims description 75
- 230000036541 health Effects 0.000 claims description 13
- 238000001514 detection method Methods 0.000 claims description 10
- 230000000007 visual effect Effects 0.000 claims description 9
- 230000036760 body temperature Effects 0.000 claims description 4
- 238000005286 illumination Methods 0.000 claims description 4
- 238000005259 measurement Methods 0.000 claims description 4
- 238000012790 confirmation Methods 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 claims 2
- 230000005540 biological transmission Effects 0.000 claims 1
- 241000282412 Homo Species 0.000 description 29
- 230000008569 process Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 230000003466 anti-cipated effect Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 239000003999 initiator Substances 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
- B65G1/00—Storing articles, individually or in orderly arrangement, in warehouses or magazines
- B65G1/02—Storage devices
- B65G1/04—Storage devices mechanical
- B65G1/137—Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
- B65G1/1373—Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed for fulfilling orders in warehouses
- B65G1/1378—Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed for fulfilling orders in warehouses the orders being assembled on fixed commissioning areas remote from the storage areas
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
- B65G1/00—Storing articles, individually or in orderly arrangement, in warehouses or magazines
- B65G1/02—Storage devices
- B65G1/04—Storage devices mechanical
- B65G1/137—Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
- B65G1/1373—Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed for fulfilling orders in warehouses
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
- B65G61/00—Use of pick-up or transfer devices or of manipulators for stacking or de-stacking articles not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
- B65G67/00—Loading or unloading vehicles
- B65G67/02—Loading or unloading land vehicles
- B65G67/04—Loading land vehicles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/50—Machine tool, machine tool null till machine tool work handling
- G05B2219/50391—Robot
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F7/00—Methods or arrangements for processing data by operating upon the order or content of the data handled
Definitions
- Embodiments of this invention relate in general to inventory management and order fulfillment systems, and more particularly to a system and method using robots to assist humans in order fulfillment.
- a system using one or more robots to assist a human in order fulfillment includes: a server configured to receive an order comprising an order item; inventory storage operably connected to the server, the inventory storage comprising inventory items; an order robot operably connected to the server, the order robot configured to assist a human to pick an order item from the inventory items; and a human-operated device operably connected to one or more of the server, the inventory storage, and the order robot, the human-operated device configured to assist the human to pick the order item.
- a method using one or more robots to assist a human in order fulfillment includes: receiving, by an order robot, a selection of the order robot by the human; receiving, by the order robot, from a server, an order comprising an order item; receiving, by the order robot, from the server, a direction to assist the human to pick the order item; receiving, by the order robot, an assist trigger configured to trigger the order robot to assist the human to pick the order item; assisting the human, by the order robot, to pick the order item; receiving, by the order robot, from the server, an instruction to carry the order item to a final destination; and carrying the order item to the final destination.
- a method using one or more robots to assist a human in order fulfillment includes: receiving, by a server, an order comprising an order item; receiving, by the server, a selection by the human of the order robot; sending the order, by the server, to one or more of the order robot and a human-operated device available to the human; sending, by the server, to the order robot, a direction to assist the human to pick the order item; determining, by the server, that the order is nearly complete; determining, by the server, that an order robot replacement suitable for fulfilling a next order has not yet been sent; sending a dispatch instruction, by the server, to the order robot replacement instructing its dispatch; determining, by the server, that the order is complete; and instructing the order robot, by the server, to carry the order item to a final destination.
- FIGS. 1A-1K are a set of drawings that depict a sequence of events in a system using robots to assist humans in order fulfillment in which an order robot follows one or more humans as they pick one or more order items.
- FIGS. 2A-2D are a set of drawings that depict a sequence of events in a system using robots to assist humans in order fulfillment which an order robot leads one or more humans as they pick one or more order items.
- FIG. 3 is a drawing of a system using robots to assist humans in order fulfillment showing that the following behavior of the order robot may be initiated by a hit such as by lightly kicking a hit detection device comprised in the order robot.
- FIG. 4 is a drawing of a system using robots to assist humans in order fulfillment illustrating that the order robot can autonomously give the human cues as to one or more of what to pick, where to pick, and the like.
- FIG. 5 is a flowchart of a method 500 for order fulfillment using robots to assist humans.
- FIG. 6 is a flowchart of a method 600 for order fulfillment using robots to assist humans.
- Embodiments of the invention relate in general to inventory management and order fulfillment systems, and more particularly to a system and method using robots to assist humans in order fulfillment to assist the selection of stock items to fulfill orders. More specifically, embodiments of the invention relate to a system and method using robots to assist humans in order fulfillment to assist humans picking stock items. More specifically, embodiments of the invention relate to a system and method using robots to assist humans in order fulfillment comprising a mobile base to assist humans picking stock items. More specifically, embodiments of the invention relate to a system and method using robots to assist humans in order fulfillment comprising an order robot to assist humans picking stock items.
- an order robot is used to transport items that a human is picking from inventory storage.
- the order robot is used to transport stock items that a human is picking from inventory storage to fulfill an order.
- Inventory storage may comprise one or more of a fixed shelf, a non-fixed shelf, a rack, and another inventory storage.
- the order robot makes one or more information captures using one or more information capture devices, with one or more of the one or more information captures being used to perform one or more of detecting a human location and tracking motion of one or more humans.
- the information capture device can comprise one or more of a depth camera, a Red Green Blue (RGB) camera, another type of photographic camera, a videocamera, a laser, a wireless receiver, a fiducial, a scanner, and another information capture device.
- the information capture device comprises a laser scanner.
- the information capture device comprises a scanning laser rangefinder.
- the information capture can comprise one or more of a camera image, a video, a depth image, a laser measurement, and another information capture.
- the system comprises a human-operated device.
- the human-operated device may be one or more of carried by the human, carried in clothing of the human, and placed near the human.
- the human-operated device may be carried in a pocket comprised in one or more of a shirt worn by the human and pants worn by the human.
- the human-operated device comprises one or more of a heads-up display, a smart watch, a tablet, a scanner, a mobile computer, a wireless human-operated device, a headset, and another human-operated device.
- the human controls the human-operated device.
- the server may send the order to the human-operated device, and the human-operated device may receive the order, so that the order is made available to the human.
- the order robot positions itself at an approximate distance from a human.
- the approximate distance may be predetermined by a user.
- the order robot positions itself at an approximate position.
- the order robot positions itself at an approximate robot position relative to a human.
- the robot position may be predetermined by a user.
- the robot position comprises a point approximately located on the circumference of a circle centered at a human location of a human.
- the robot position comprises a point approximately located on the circumference of a circle centered at a human location of a human and with a radius that is predetermined by a user.
- the robot position comprises a point that is approximately nearest to a human of points located on the circumference of a circle centered at the human location of the human and with a radius that is predetermined by a user.
- the server can dispatch robots to one or more previously designated waiting spots.
- the one or more previously designated waiting spots can be near the inventory to be picked. Alternatively, or additionally, the one or more previously designated waiting spots may be located near a central staging area for robots.
- the order robots are configured to engage in following behavior.
- the order robots are configured to move from the previously designated waiting stop to a stop made by a human to pick inventory.
- the order robots are further configured to move from a stop made by a human to pick inventory to another stop made by a human to pick inventory.
- the mobile base may not be constrained to the plane and may fly using one or more propellers.
- the order robot may move using actuated legs.
- the order robot may move itself by balancing on a ball.
- an order robot waiting spot is located near a charging station, thereby allowing the order robot to recharge its battery while waiting for the human to arrive.
- the charging station may be a wireless charging station.
- the charging station may be a wired charging station.
- the order robot may be configured to provide data to a server.
- the order robot may be configured to provide logging data to the server.
- the order robot may be configured to provide logging data to a central server.
- the order robot may be configured to provide logging data to the central server located within an inventory storage.
- the order robot may be configured to provide the logging data to the central server that is connected to the warehouse via a network connection.
- the data may comprise an order item pick time, an order item pick location, an image, a point cloud, two-dimensional data, three-dimensional data, a metric, and other data.
- the system may comprise an information capture device.
- the order robot may comprise the information capture device.
- the server may comprise the information capture device.
- the information capture device may be a fixed installation operably connected to the server.
- the information capture device may capture an image of one or more pick lists.
- the one or more pick lists comprise one or more order items to be picked.
- the pick lists may comprise one or more of paper pick lists, electronic pick lists and other pick lists.
- the human presents the one or more pick lists to the order robot, which then decodes one or more order items to be picked comprised in the one or more pick lists.
- the order robot then correlates one or more of the items to be picked with a database of product locations.
- the order robot leads the human through the warehouse, using one or more of the aforementioned methods of communication to tell the human what to pick.
- the order robot sends to the server one or more of a coded pick list and a decoded pick list.
- the server is connected wirelessly to a network.
- the server is connected via a wired connection to the network.
- the server comprises a wired server.
- the server comprises the database of product locations.
- the server then returns to the order robot one or more of a location and a quantity of items to be picked.
- the server spreads the pick list among more than one order robot, thereby allowing a pick list to be spread across several humans.
- FIGS. 1A-1K are a set of drawings that depict a sequence of events in a system 100 using robots 110 to assist humans 120 in order fulfillment in which an order robot 110 follows a human 120 as the human picks one or more order items.
- the system 100 comprises a warehouse 100 .
- the order robot 110 comprises a mobile order robot 110 .
- the order robot 110 comprises a mobile order robot base 110 .
- a server 125 operably connected with the order robot 110 receives an order.
- the server 125 sends the order to one or more of a human-operated device 127 and the order robot 110 .
- the server 125 sends the new order to the human-operated device 127 so as to be available to the human 120 .
- the human-operated device 127 receives the order from the server 125 .
- the human-operated device 127 is held by the human 120 .
- the human-operated device 127 comprises one or more of a heads-up display 127 , a smart watch 127 , a tablet 127 , a scanner 127 , a mobile computer 127 , a wireless human-operated device 127 , a headset 127 , and another human-operated device 127 .
- the scanner 127 may comprise one or more of a radio frequency (RF) scanner 127 and a radio frequency identification (RFID) reader 127 .
- RF radio frequency
- RFID radio frequency identification
- the human-operated device 127 is controlled by the human 120 .
- the human 120 may be equipped with a headset 127 configured to communicate with the order robot 110 without picking up one or more of ambient noise and robot noise.
- the headset 127 may be operably connected to the order robot 110 .
- the headset 127 may be operably connected to the server 125 .
- the headset 127 may be wirelessly connected to the order robot 110 .
- the headset 127 may be wirelessly connected to the server.
- the order robot 110 follows the human 120 as the human 120 , guided by the human-operated device 127 , picks from an inventory storage 130 one or more order items 140 A- 140 H to fulfill an order.
- Picking the order item 140 A- 140 H comprises one or more of locating the order item 140 A- 140 H, grasping the order item 140 A- 140 H, and placing the order item 140 A- 140 H so as to be accessible to the order robot 110 .
- grasping can occur without the human 120 exerting any effort to retain the order item 140 A- 140 H.
- grasping can comprise allowing the order item 140 A- 140 H to rest on the human 120 .
- the human-operated device 127 displays one or more of the order items 140 A- 140 H to be picked.
- the order robot 110 comprises order storage 150 .
- Order storage 150 comprises one or more of an order bin, an order shelf, and an order box.
- the order storage 150 comprises three order shelves, a first order shelf 160 A, a second order shelf 160 B, and a third order shelf 160 C.
- the first order shelf 160 A comprises a first order shelf order item 170 .
- the third order shelf 160 C comprises a third order shelf order item 175 .
- first order shelf 160 A may hold an arbitrary number of first order shelf order items 170
- second order shelf 160 B may hold an arbitrary number of second order shelf order items (not pictured)
- third order shelf 160 C may hold an arbitrary number of third order shelf order items 175 .
- the order robot 110 receives a selection of the order robot 110 by the human 120 .
- the order robot 110 comprises an information capture device 180 that receives the selection of the order robot 110 by the human 120 .
- the information capture device 180 can comprise one or more of a depth camera, a Red Green Blue (RGB) camera, another type of photographic camera, a videocamera, a laser, a wireless receiver, a fiducial, a scanner, and another information capture device.
- the information capture device 180 comprises one or more of a radio frequency (RF) scanner 180 and a radio frequency identification (RFID) reader 180 .
- the information capture device 180 comprises a laser scanner 180 .
- the laser scanner 180 comprises a scanning laser rangefinder 180 .
- the human 120 presses a button on the human-operated device 127 to select the order robot 110 and the human-operated device 127 transmits the selection to the order robot 110 .
- the order robot 110 receives the selection via a button comprised in the order robot 110 that is pressed by the human 120 .
- the human 120 designates a map location using a user interface comprised in the human-operated device 127 and the device transmits the selection to the order robot 110 .
- the server 125 receives the selection from the human-operated device 127 and then the server 125 transmits the selection to the order robot 110 .
- the selected order robot 110 transmits the selection to the server 125 using the information capture device 180 .
- the human-operated device 127 transmits the selection of the order robot 110 to the server 125 .
- the server 125 transmits the task to the selected order robot 110 through the information capture device 180 .
- the order robot 110 assists the human 120 in fulfilling the order. As depicted, the order robot 110 follows the human 120 .
- the assisting behavior of the order robot 110 may be initiated by one or more of a hit, a command, a microphone, a speech recognition system, a command from the server 125 , a command from the human-operated device 127 , and another assist trigger configured to trigger the order robot 110 to assist the human 120 to pick the order item.
- the command may comprise a spoken command.
- the command may comprise a spoken command from the human 120 .
- the order robot 110 may comprise one or more of the microphone (not pictured) and the speech recognition system (not pictured).
- the order robot 110 may use the information capture device 180 to make an information capture to perform one or more of detecting a human location and tracking a motion of the human 120 .
- the information capture device 180 generates a sensor plane 181 .
- the sensor plane 181 illuminates legs 182 of the human 120 at a human location 183 . Accordingly, the order robot 110 thereby performs an information capture that detects the human location 183 of the human 120 .
- the information capture enables the order robot 110 to avoid one or more of colliding with the human 120 and losing track of the human 120 .
- the information capture comprises one or more of a camera image, a video, a depth image, a laser measurement, and another information capture.
- the order robot 110 uses the information obtained by the information capture device 180 in the information capture, adjusts its robot position relative to the human 120 . As depicted in FIG. 1F , using the information capture, the order robot 110 moves toward the human 120 .
- the order robot 110 positions itself at an approximate robot position 186 relative to the human 120 .
- the robot position 186 may be predetermined by a user.
- the robot position 186 comprises a point 186 that is approximately located on the circumference of a circle 187 having a radius 190 and centered at the human location 183 of the human 120 .
- the circle 187 has a radius 190 that is predetermined by a user. That is, the radius 190 comprises an approximate desired distance 190 of the order robot 110 from the human 120 .
- the robot position 186 comprises a point 186 that is approximately nearest to the human 120 of points located on the circumference of the circle 187 centered at the human location 183 of the human 120 and with a radius 190 that is predetermined by a user.
- the order robot 110 positions itself at the approximate desired distance 190 from the human 120 .
- a control program can send commands to an actuator of the order robot 110 .
- the actuator may comprise one or more of one or more wheels and a non-wheeled actuator.
- the system may be configured so that the order robot 110 moves in the correct direction so as to maintain one or more of a substantially constant distance 190 from the human and a substantially constant orientation to the human.
- the desired distance 190 may be predetermined by a user.
- the desired distance 190 may be calculated by the server 125 .
- the order robot 110 positions itself at an approximate robot position 186 .
- the robot position 186 is predetermined by a user.
- the robot position 186 is calculated by the server 125 .
- the order robot 110 is configured to provide data to the server 125 .
- the order robot 110 is configured to provide logging data to the server 125 .
- the data may comprise one or more of an order item pick time, an order item pick location, an image, a point cloud, two-dimensional data, three-dimensional data, a metric, and other data.
- a metric may comprise one or more of a human moving speed, a human picking speed, and human health data.
- the order robot 110 may use the information capture device 180 to monitor the health of the human. For example, the order robot 110 may use the information capture device 180 to monitor one or more of human exhaustion, elevated human body temperature, and another human health indicator. If a human is having a medical issue, the order robot 110 may alert a supervisor through one or more of wireless communications and wired communications.
- the human 120 picks up the fourth order item 140 D from the inventory storage 130 .
- the human-operated device 127 is carried in clothing of the human 120 .
- the human-operated device 127 is carried in a pocket comprised in pants worn by the human 120 .
- the human 120 carries the fourth order item 140 D toward the second order shelf 160 B.
- the human 120 positions the fourth order item 140 D on the second order shelf 160 B. That is, the human 120 places the fourth order item 140 D directly onto the order robot 110 so as to be accessible to the order robot 110 .
- the order robot 110 sends an order fulfillment confirmation to the server 125 .
- the human-operated device 127 sends the order fulfillment confirmation to the server 125 .
- the server 125 determines whether the order is nearly complete. Nearly complete may be defined based on a fixed number of order items 140 A- 140 H remaining to be picked. For example, an order may be defined as nearly complete if three or fewer items 140 A- 140 H remain to be picked in the order. Alternatively, or additionally, nearly complete may be defined based on a typical time required to pick remaining order items 140 A- 140 H. For example, nearly complete may be defined based on the typical time required to pick the remaining order items 140 A- 140 H using a pick metric. For example, the pick metric comprises an average transit time between the current inventory storage 130 and an anticipated next inventory storage 130 . For example, the pick metric comprises a distance remaining to be traveled computed using a location of one or more order items 140 A- 140 H to be picked.
- the server 125 determines that the order is not nearly complete, the server 125 transmits an order to one or more of the order robot 110 and the human-operated device 127 to order the picking of another order item 140 A- 140 H.
- the server 125 determines that the order is nearly complete, the server queries if an order robot replacement 110 A that is suitable for use for fulfilling a next order has yet been sent. Sending the order robot replacement 110 A may be desirable to minimize delays in fulfilling the next order. If no order robot replacement 110 A has been sent yet, the server 125 sends an order to the order robot replacement 110 A ordering its dispatch. The order robot replacement 110 A moves per the order it received from the server 125 .
- the server 125 determines whether the order is complete. If an order robot replacement 110 A has already been sent, the server 125 determines whether the order is complete.
- the server 125 determines that the order is complete, as depicted, the server 125 instructs the order robot 110 to carry the order items 140 A- 140 H to a final destination 195 .
- the order robot 110 then heads off to the final destination 195 for offloading of the order items 140 A- 140 H.
- Replacing robot may navigate to and follow current robot 110 that is following human 120 .
- FIGS. 2A-2D are a set of drawings that depict a sequence of events in a system using robots to assist humans in order fulfillment in which an order robot 110 leads one or more humans 120 as they pick one or more order items 140 A- 140 H.
- the order robot 110 may lead the human, rather than following the human as shown in FIGS. 1A-1K .
- the control device is configured to determine one or more of the order item 140 A- 140 H to pick and a location of the order item 140 A- 140 H.
- the order robot 110 can navigate its way through the inventory storage 130 to the desired position. For example, the order robot 110 can automatically navigate its way through the inventory storage 130 to the desired position.
- FIGS. 2A-2D depict a system 200 using robots to assist humans in order fulfillment in which the order robot 110 leads the human 120 as the human 120 picks one or more order items to fulfill an order.
- the system 200 functions in a similar way to the system 100 .
- the system 200 comprises a warehouse 200 .
- the order robot 110 may lead the human 120 as the human 120 picks one or more order items.
- FIGS. 2A-2D also depict the inventory storage 130 comprising the first through eighth inventory items 140 A- 140 H.
- the order robot 110 comprises a mobile order robot 110 .
- the order robot 110 may be present.
- any number of humans 120 may be present.
- the order robot 110 comprises order storage 150 .
- Order storage 150 comprises one or more of an order bin, an order shelf, and an order box.
- the order storage 150 comprises three order shelves, a first order shelf 160 A, a second order shelf 160 B, and a third order shelf 160 C.
- the first order shelf 160 A comprises a first order shelf order item 170 .
- the third order shelf 160 C comprises a third order shelf order item 175 .
- first order shelf 160 A may hold an arbitrary number of first order shelf order items 170
- second order shelf 160 B may hold an arbitrary number of second order shelf order items (not pictured)
- third order shelf 160 C may hold an arbitrary number of third order shelf order items 175 .
- the order robot 110 further comprises an information capture device 180 .
- the human 120 picks up the fifth order item 140 E from the inventory storage 130 .
- the human 120 carries the fifth order item 140 E toward the second order shelf 160 B.
- the human positions the fifth order item 140 E on the second order shelf 160 B.
- FIG. 3 is a drawing of a system 300 using robots to assist humans in order fulfillment showing that the following behavior of the order robot 110 may be initiated by a hit such as by lightly kicking a hit detection device comprised in the order robot 110 .
- the following behavior of the order robot may be initiated by a human 120 lightly kicking the order robot 110 on a designated panel.
- the order robot 110 comprises a hit detection device.
- the hit detection device may comprise one or more of a designated panel, a gyro, an accelerometer, an inertial measurement unit (IMU), and another hit detection device.
- IMU inertial measurement unit
- sensor fusion between the information capture device 180 and the IMU can facilitate hit detection.
- the assisting behavior of the order robot 110 may be initiated by one or more of a hit, a command, a microphone, a speech recognition system, a command from the server 125 , a command from the human-operated device 127 , and another assist trigger configured to trigger the order robot 110 to assist the human 120 to pick the order item.
- the following behavior of the order robot 110 may be initiated by one or more of a hit, a heads-up display, a smart watch, a tablet, a command, a wireless device, a headset, a microphone, a speech recognition system, and another following behavior initiator.
- a smart watch, a tablet, and the like may also be used to display one or more of the items to be picked.
- the command may comprise a spoken command.
- the command may comprise a spoken command from a human.
- the order robot 110 may comprise one or more of a microphone and a speech recognition system.
- the human may be equipped with a headset configured to communicate with the order robot 110 without picking up one or more of ambient noise and robot noise.
- the headset may be operably connected to the order robot 110 .
- the headset may be operably connected to the server 125 .
- the headset may be wirelessly connected to the order robot 110 .
- the headset may be wirelessly connected to the server 125 .
- the following behavior of the order robot 110 may be initiated by a heads-up display 127 .
- FIG. 4 is a drawing of a system 400 using robots to assist humans in order fulfillment illustrating that the order robot 110 can autonomously give the human 120 cues as to one or more of what to pick, where to pick, and the like.
- the human 120 guided by the human-operated device 127 , picks from an inventory storage 130 one or more order items 140 A- 140 H to fulfill an order.
- the order robot 110 may use a projector 410 to project the cues onto one or more of the floor and another surface.
- the projector 410 is indicating item 140 B to be picked from the inventory storage 130 by the human 120 , guided by the human-operated device 127 .
- the projector 410 comprises a pick-to-light illumination device.
- the projector 410 comprises another projector 410 other than a pick-to-light illumination device.
- the order robot 110 is the leader of the human 120 , as depicted in FIGS. 2A-2D .
- the order robot 110 may suggest where the human 120 should go.
- the order robot 110 may comprise lights (not shown) configured to show in which direction the order robot 110 will be heading.
- the order robot 110 may adjust its pace to approximately match the pace of the human 120 .
- the order robot 110 may automatically adjust its pace to approximately match the pace of the human 120 .
- the order robot 110 may adjust its pace to approximately match the pace of the human 120 if the human 120 falls behind the order robot 110 .
- the order robot 110 may adjust its pace to approximately match the pace of the human 120 if the human 120 keeps up with the order robot 110 .
- the order robot 110 may comprise a cuing device.
- the cuing device may comprise one or more of a visual cuing device and an audio cuing device.
- the visual cuing device may comprise one or more of an onboard projector, a camera system, an augmented reality system, a laser pointer, a light-emitting diode (LED) light, and another visual cuing device that can show the human what to pick.
- the visual cuing device is configured to display one or more visual cues to the human regarding one or more order items to pick.
- the visual cuing device may also be configured to record evidence of one or more of the picking of the one or more order items and the placement of the one or more order items so as to be accessible to the order robot 110 .
- the audio cuing device is configured to specify the task to the human.
- the audio cuing device may comprise one or more of an on-robot speaker and a headset.
- the headset may, for example, be wirelessly connected to the order robot 110 .
- a wired connection may connect the headset and the order robot 110 .
- the order robot 110 can wirelessly communicate with the server, and the server can wirelessly communicate with the headset.
- FIG. 5 is a flowchart of a method 500 for order fulfillment using robots to assist humans.
- the order of the steps in the method 500 is not constrained to that shown in FIG. 5 or described in the following discussion. Several of the steps could occur in a different order without affecting the final result.
- step 510 an order robot receives a selection of the order robot by a human. Block 510 then transfers control to block 520 .
- step 520 the order robot receives, from a server, an order comprising an order item.
- Block 520 then transfers control to block 530 .
- step 530 the order robot receives from the server a direction to assist the human to pick the order item.
- Block 530 then transfers control to block 540 .
- step 540 the order robot receives an assist trigger configured to trigger the order robot to assist the human to pick the order item.
- Block 540 then transfers control to block 550 .
- step 550 the order robot receives from the server an instruction to carry the order item to a final destination. Block 550 then transfers control to block 560 .
- step 560 the order robot assists the human to pick the order item.
- Block 560 then transfers control to block 570 .
- step 570 the order robot carries the order item to the final destination. Block 570 then terminates the process.
- FIG. 6 is a flowchart of a method 600 for order fulfillment using robots to assist humans.
- the order of the steps in the method 600 is not constrained to that shown in FIG. 6 or described in the following discussion. Several of the steps could occur in a different order without affecting the final result.
- a server receives an order comprising an order item. Block 610 then transfers control to block 620 .
- step 620 the server receives a selection by the human of the order robot. Block 620 then transfers control to block 630 .
- step 630 the server sends the order to one or more of the order robot and a human-operated device available to the human. Block 630 then transfers control to block 640 .
- step 640 the server sends to the order robot a direction to assist the human to pick the order item.
- Block 640 then transfers control to block 650 .
- step 650 the server determines if the order is nearly complete. If the order is determined to be nearly complete, block 650 then transfers control to block 660 . If the order is not nearly complete, the process reverts to block 640 .
- step 660 the server determines if an order robot replacement suitable for fulfilling a next order has yet been sent. If the order robot replacement has not yet been sent, block 660 then transfers control to block 670 . If the order robot replacement has already been sent, block 660 then transfers control to block 680 .
- step 670 the server sends a dispatch instruction to the order robot replacement instructing its dispatch.
- Block 670 then transfers control to block 680 .
- step 680 the server determines if the order is complete. If the order is complete, block 680 then transfers control to block 690 . If the order is not complete, the process reverts to block 640 .
- step 690 the server instructs the order robot to carry the order item to a final destination. Block 690 then terminates the process.
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Economics (AREA)
- Quality & Reliability (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Tourism & Hospitality (AREA)
- Theoretical Computer Science (AREA)
- Operations Research (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Development Economics (AREA)
- General Business, Economics & Management (AREA)
- Finance (AREA)
- Marketing (AREA)
- Accounting & Taxation (AREA)
- Manufacturing & Machinery (AREA)
- Automation & Control Theory (AREA)
- General Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Manipulator (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Warehouses Or Storage Devices (AREA)
Abstract
Description
- The present application claims the priority benefit of U.S. provisional patent application No. 62/115,440 filed Feb. 12, 2015 and entitled “System and Method for Order Fulfillment and Inventory Management Using Robots,” and of U.S. provisional patent application No. 62/117,457 filed Feb. 18, 2015 and entitled “System and Method for Order Fulfillment Using Robots to Assist in Selecting Stock Items,” the disclosures of which are incorporated herein by reference.
- This application contains subject matter that is related to the subject matter of the following applications, which are assigned to the same assignee as this application. The below-listed applications are hereby incorporated herein by reference in its entirety:
- “SYSTEM AND METHOD FOR ORDER FULFILLMENT USING ROBOTS,” by Wise, et al., co-filed herewith.
- Embodiments of this invention relate in general to inventory management and order fulfillment systems, and more particularly to a system and method using robots to assist humans in order fulfillment.
- A system using one or more robots to assist a human in order fulfillment includes: a server configured to receive an order comprising an order item; inventory storage operably connected to the server, the inventory storage comprising inventory items; an order robot operably connected to the server, the order robot configured to assist a human to pick an order item from the inventory items; and a human-operated device operably connected to one or more of the server, the inventory storage, and the order robot, the human-operated device configured to assist the human to pick the order item.
- A method using one or more robots to assist a human in order fulfillment includes: receiving, by an order robot, a selection of the order robot by the human; receiving, by the order robot, from a server, an order comprising an order item; receiving, by the order robot, from the server, a direction to assist the human to pick the order item; receiving, by the order robot, an assist trigger configured to trigger the order robot to assist the human to pick the order item; assisting the human, by the order robot, to pick the order item; receiving, by the order robot, from the server, an instruction to carry the order item to a final destination; and carrying the order item to the final destination.
- A method using one or more robots to assist a human in order fulfillment includes: receiving, by a server, an order comprising an order item; receiving, by the server, a selection by the human of the order robot; sending the order, by the server, to one or more of the order robot and a human-operated device available to the human; sending, by the server, to the order robot, a direction to assist the human to pick the order item; determining, by the server, that the order is nearly complete; determining, by the server, that an order robot replacement suitable for fulfilling a next order has not yet been sent; sending a dispatch instruction, by the server, to the order robot replacement instructing its dispatch; determining, by the server, that the order is complete; and instructing the order robot, by the server, to carry the order item to a final destination.
-
FIGS. 1A-1K are a set of drawings that depict a sequence of events in a system using robots to assist humans in order fulfillment in which an order robot follows one or more humans as they pick one or more order items. -
FIGS. 2A-2D are a set of drawings that depict a sequence of events in a system using robots to assist humans in order fulfillment which an order robot leads one or more humans as they pick one or more order items. -
FIG. 3 is a drawing of a system using robots to assist humans in order fulfillment showing that the following behavior of the order robot may be initiated by a hit such as by lightly kicking a hit detection device comprised in the order robot. -
FIG. 4 is a drawing of a system using robots to assist humans in order fulfillment illustrating that the order robot can autonomously give the human cues as to one or more of what to pick, where to pick, and the like. -
FIG. 5 is a flowchart of amethod 500 for order fulfillment using robots to assist humans. -
FIG. 6 is a flowchart of amethod 600 for order fulfillment using robots to assist humans. - Embodiments of the invention relate in general to inventory management and order fulfillment systems, and more particularly to a system and method using robots to assist humans in order fulfillment to assist the selection of stock items to fulfill orders. More specifically, embodiments of the invention relate to a system and method using robots to assist humans in order fulfillment to assist humans picking stock items. More specifically, embodiments of the invention relate to a system and method using robots to assist humans in order fulfillment comprising a mobile base to assist humans picking stock items. More specifically, embodiments of the invention relate to a system and method using robots to assist humans in order fulfillment comprising an order robot to assist humans picking stock items.
- According to embodiments of the invention, an order robot is used to transport items that a human is picking from inventory storage. For example, the order robot is used to transport stock items that a human is picking from inventory storage to fulfill an order. Inventory storage may comprise one or more of a fixed shelf, a non-fixed shelf, a rack, and another inventory storage.
- For example, the order robot makes one or more information captures using one or more information capture devices, with one or more of the one or more information captures being used to perform one or more of detecting a human location and tracking motion of one or more humans. For example, the information capture device can comprise one or more of a depth camera, a Red Green Blue (RGB) camera, another type of photographic camera, a videocamera, a laser, a wireless receiver, a fiducial, a scanner, and another information capture device. For example, the information capture device comprises a laser scanner. For example, the information capture device comprises a scanning laser rangefinder. For example, the information capture can comprise one or more of a camera image, a video, a depth image, a laser measurement, and another information capture.
- According to other embodiments of the invention, the system comprises a human-operated device. The human-operated device may be one or more of carried by the human, carried in clothing of the human, and placed near the human. For example, the human-operated device may be carried in a pocket comprised in one or more of a shirt worn by the human and pants worn by the human. The human-operated device comprises one or more of a heads-up display, a smart watch, a tablet, a scanner, a mobile computer, a wireless human-operated device, a headset, and another human-operated device. Preferably, although not necessarily, the human controls the human-operated device. The server may send the order to the human-operated device, and the human-operated device may receive the order, so that the order is made available to the human.
- According to further embodiments of the invention, following the information capture, the order robot positions itself at an approximate distance from a human. For example, the approximate distance may be predetermined by a user. Alternatively, or additionally, following the information capture, the order robot positions itself at an approximate position. For example, following the information capture, the order robot positions itself at an approximate robot position relative to a human. For example, the robot position may be predetermined by a user. For example, the robot position comprises a point approximately located on the circumference of a circle centered at a human location of a human. For example, the robot position comprises a point approximately located on the circumference of a circle centered at a human location of a human and with a radius that is predetermined by a user. For example, the robot position comprises a point that is approximately nearest to a human of points located on the circumference of a circle centered at the human location of the human and with a radius that is predetermined by a user.
- In the case where the order robot is following a human, the server can dispatch robots to one or more previously designated waiting spots. The one or more previously designated waiting spots can be near the inventory to be picked. Alternatively, or additionally, the one or more previously designated waiting spots may be located near a central staging area for robots. The order robots are configured to engage in following behavior. The order robots are configured to move from the previously designated waiting stop to a stop made by a human to pick inventory. The order robots are further configured to move from a stop made by a human to pick inventory to another stop made by a human to pick inventory.
- According to an alternative set of embodiments, the mobile base may not be constrained to the plane and may fly using one or more propellers. According to another alternative set of embodiments, the order robot may move using actuated legs. According to yet another set of embodiments, the order robot may move itself by balancing on a ball.
- According to a further set of embodiments, an order robot waiting spot is located near a charging station, thereby allowing the order robot to recharge its battery while waiting for the human to arrive. For example, the charging station may be a wireless charging station. For example, the charging station may be a wired charging station.
- According to further embodiments of the invention, the order robot may be configured to provide data to a server. For example, the order robot may be configured to provide logging data to the server. For example, the order robot may be configured to provide logging data to a central server. For example, the order robot may be configured to provide logging data to the central server located within an inventory storage. For example, the order robot may be configured to provide the logging data to the central server that is connected to the warehouse via a network connection. The data may comprise an order item pick time, an order item pick location, an image, a point cloud, two-dimensional data, three-dimensional data, a metric, and other data.
- According to another set of embodiments, the system may comprise an information capture device. For example, the order robot may comprise the information capture device. As another example, alternatively, or additionally, the server may comprise the information capture device. As yet another example, alternatively or additionally, the information capture device may be a fixed installation operably connected to the server.
- For example, the information capture device may capture an image of one or more pick lists. For example, the one or more pick lists comprise one or more order items to be picked. For example, the pick lists may comprise one or more of paper pick lists, electronic pick lists and other pick lists. For example, the human presents the one or more pick lists to the order robot, which then decodes one or more order items to be picked comprised in the one or more pick lists. For example, the order robot then correlates one or more of the items to be picked with a database of product locations.
- For example, the order robot leads the human through the warehouse, using one or more of the aforementioned methods of communication to tell the human what to pick. In another set of embodiments, the order robot sends to the server one or more of a coded pick list and a decoded pick list. For example, the server is connected wirelessly to a network. For example, the server is connected via a wired connection to the network. For example, the server comprises a wired server. For example, the server comprises the database of product locations. For example, the server then returns to the order robot one or more of a location and a quantity of items to be picked. For example, the server spreads the pick list among more than one order robot, thereby allowing a pick list to be spread across several humans.
-
FIGS. 1A-1K are a set of drawings that depict a sequence of events in asystem 100 usingrobots 110 to assisthumans 120 in order fulfillment in which anorder robot 110 follows a human 120 as the human picks one or more order items. For example, thesystem 100 comprises awarehouse 100. Preferably, although not necessarily, theorder robot 110 comprises amobile order robot 110. Preferably, although not necessarily, theorder robot 110 comprises a mobileorder robot base 110. - A
server 125 operably connected with theorder robot 110 receives an order. Theserver 125 sends the order to one or more of a human-operateddevice 127 and theorder robot 110. As shown inFIG. 1A , theserver 125 sends the new order to the human-operateddevice 127 so as to be available to the human 120. The human-operateddevice 127 receives the order from theserver 125. As depicted inFIG. 1A , the human-operateddevice 127 is held by the human 120. - The human-operated
device 127 comprises one or more of a heads-updisplay 127, asmart watch 127, atablet 127, ascanner 127, amobile computer 127, a wireless human-operateddevice 127, aheadset 127, and another human-operateddevice 127. For example, thescanner 127 may comprise one or more of a radio frequency (RF)scanner 127 and a radio frequency identification (RFID)reader 127. Preferably, although not necessarily, the human-operateddevice 127 is controlled by the human 120. - For example, the human 120 may be equipped with a
headset 127 configured to communicate with theorder robot 110 without picking up one or more of ambient noise and robot noise. For example, theheadset 127 may be operably connected to theorder robot 110. For example, theheadset 127 may be operably connected to theserver 125. For example, theheadset 127 may be wirelessly connected to theorder robot 110. For example, theheadset 127 may be wirelessly connected to the server. - The
order robot 110 follows the human 120 as the human 120, guided by the human-operateddevice 127, picks from aninventory storage 130 one ormore order items 140A-140H to fulfill an order. Picking theorder item 140A-140H comprises one or more of locating theorder item 140A-140H, grasping theorder item 140A-140H, and placing theorder item 140A-140H so as to be accessible to theorder robot 110. It is not intended that the terms locating, grasping, and placing be limiting. For example, grasping can occur without the human 120 exerting any effort to retain theorder item 140A-140H. For example, grasping can comprise allowing theorder item 140A-140H to rest on the human 120. For example, the human-operateddevice 127 displays one or more of theorder items 140A-140H to be picked. - Those of skill in the art will recognize that any number of
order robots 110 may be present according to embodiments of the invention. Similarly, those of skill in the art will recognize that any number ofhumans 120 may be present. - As depicted, the
order robot 110 comprisesorder storage 150.Order storage 150 comprises one or more of an order bin, an order shelf, and an order box. As depicted, theorder storage 150 comprises three order shelves, afirst order shelf 160A, asecond order shelf 160B, and athird order shelf 160C. As depicted, thefirst order shelf 160A comprises a first ordershelf order item 170. As depicted, thethird order shelf 160C comprises a third ordershelf order item 175. - Those of skill in the art will further recognize that the
first order shelf 160A may hold an arbitrary number of first ordershelf order items 170, thesecond order shelf 160B may hold an arbitrary number of second order shelf order items (not pictured), and thethird order shelf 160C may hold an arbitrary number of third ordershelf order items 175. - In
FIG. 1B , theorder robot 110 receives a selection of theorder robot 110 by the human 120. As depicted, theorder robot 110 comprises aninformation capture device 180 that receives the selection of theorder robot 110 by the human 120. Theinformation capture device 180 can comprise one or more of a depth camera, a Red Green Blue (RGB) camera, another type of photographic camera, a videocamera, a laser, a wireless receiver, a fiducial, a scanner, and another information capture device. For example, theinformation capture device 180 comprises one or more of a radio frequency (RF)scanner 180 and a radio frequency identification (RFID)reader 180. As depicted, theinformation capture device 180 comprises alaser scanner 180. For example, thelaser scanner 180 comprises ascanning laser rangefinder 180. The human 120 presses a button on the human-operateddevice 127 to select theorder robot 110 and the human-operateddevice 127 transmits the selection to theorder robot 110. - Alternatively, the
order robot 110 receives the selection via a button comprised in theorder robot 110 that is pressed by the human 120. Alternatively, the human 120 designates a map location using a user interface comprised in the human-operateddevice 127 and the device transmits the selection to theorder robot 110. Alternatively, theserver 125 receives the selection from the human-operateddevice 127 and then theserver 125 transmits the selection to theorder robot 110. - In
FIG. 1C , as depicted, the selectedorder robot 110 transmits the selection to theserver 125 using theinformation capture device 180. Alternatively, or additionally, the human-operateddevice 127 transmits the selection of theorder robot 110 to theserver 125. - In
FIG. 1D , theserver 125 transmits the task to the selectedorder robot 110 through theinformation capture device 180. - In
FIG. 1E , theorder robot 110 assists the human 120 in fulfilling the order. As depicted, theorder robot 110 follows the human 120. - The assisting behavior of the
order robot 110 may be initiated by one or more of a hit, a command, a microphone, a speech recognition system, a command from theserver 125, a command from the human-operateddevice 127, and another assist trigger configured to trigger theorder robot 110 to assist the human 120 to pick the order item. - For example, the command may comprise a spoken command. For example, the command may comprise a spoken command from the human 120. For example, the
order robot 110 may comprise one or more of the microphone (not pictured) and the speech recognition system (not pictured). - As shown in
FIG. 1E , theorder robot 110 may use theinformation capture device 180 to make an information capture to perform one or more of detecting a human location and tracking a motion of the human 120. Theinformation capture device 180 generates asensor plane 181. As depicted, thesensor plane 181 illuminateslegs 182 of the human 120 at ahuman location 183. Accordingly, theorder robot 110 thereby performs an information capture that detects thehuman location 183 of the human 120. - For example, the information capture enables the
order robot 110 to avoid one or more of colliding with the human 120 and losing track of the human 120. The information capture comprises one or more of a camera image, a video, a depth image, a laser measurement, and another information capture. - As shown in
FIG. 1F , theorder robot 110, using the information obtained by theinformation capture device 180 in the information capture, adjusts its robot position relative to the human 120. As depicted inFIG. 1F , using the information capture, theorder robot 110 moves toward the human 120. - Using the information capture, the
order robot 110 positions itself at anapproximate robot position 186 relative to the human 120. For example, therobot position 186 may be predetermined by a user. For example, therobot position 186 comprises apoint 186 that is approximately located on the circumference of acircle 187 having aradius 190 and centered at thehuman location 183 of the human 120. For example, thecircle 187 has aradius 190 that is predetermined by a user. That is, theradius 190 comprises an approximate desireddistance 190 of theorder robot 110 from the human 120. As depicted, therobot position 186 comprises apoint 186 that is approximately nearest to the human 120 of points located on the circumference of thecircle 187 centered at thehuman location 183 of the human 120 and with aradius 190 that is predetermined by a user. - As shown in
FIG. 1F , theorder robot 110 positions itself at the approximate desireddistance 190 from the human 120. Once a human 120 has been detected, a control program can send commands to an actuator of theorder robot 110. The actuator may comprise one or more of one or more wheels and a non-wheeled actuator. For example, the system may be configured so that theorder robot 110 moves in the correct direction so as to maintain one or more of a substantiallyconstant distance 190 from the human and a substantially constant orientation to the human. - For example, the desired
distance 190 may be predetermined by a user. For example, the desireddistance 190 may be calculated by theserver 125. Alternatively, or additionally, following the information capture, theorder robot 110 positions itself at anapproximate robot position 186. For example, therobot position 186 is predetermined by a user. For example, therobot position 186 is calculated by theserver 125. - The
order robot 110 is configured to provide data to theserver 125. For example, theorder robot 110 is configured to provide logging data to theserver 125. The data may comprise one or more of an order item pick time, an order item pick location, an image, a point cloud, two-dimensional data, three-dimensional data, a metric, and other data. - A metric may comprise one or more of a human moving speed, a human picking speed, and human health data. The
order robot 110 may use theinformation capture device 180 to monitor the health of the human. For example, theorder robot 110 may use theinformation capture device 180 to monitor one or more of human exhaustion, elevated human body temperature, and another human health indicator. If a human is having a medical issue, theorder robot 110 may alert a supervisor through one or more of wireless communications and wired communications. - In
FIG. 1G , the human 120 picks up thefourth order item 140D from theinventory storage 130. As depicted inFIG. 1G , the human-operateddevice 127 is carried in clothing of the human 120. As depicted, the human-operateddevice 127 is carried in a pocket comprised in pants worn by the human 120. - In
FIG. 1H , the human 120 carries thefourth order item 140D toward thesecond order shelf 160B. - In
FIG. 1I , the human 120 positions thefourth order item 140D on thesecond order shelf 160B. That is, the human 120 places thefourth order item 140D directly onto theorder robot 110 so as to be accessible to theorder robot 110. - In
FIG. 1J , theorder robot 110 sends an order fulfillment confirmation to theserver 125. Alternatively, the human-operateddevice 127 sends the order fulfillment confirmation to theserver 125. - In
FIG. 1K , theserver 125 determines whether the order is nearly complete. Nearly complete may be defined based on a fixed number oforder items 140A-140H remaining to be picked. For example, an order may be defined as nearly complete if three orfewer items 140A-140H remain to be picked in the order. Alternatively, or additionally, nearly complete may be defined based on a typical time required to pick remainingorder items 140A-140H. For example, nearly complete may be defined based on the typical time required to pick the remainingorder items 140A-140H using a pick metric. For example, the pick metric comprises an average transit time between thecurrent inventory storage 130 and an anticipatednext inventory storage 130. For example, the pick metric comprises a distance remaining to be traveled computed using a location of one ormore order items 140A-140H to be picked. - If the
server 125 determines that the order is not nearly complete, theserver 125 transmits an order to one or more of theorder robot 110 and the human-operateddevice 127 to order the picking of anotherorder item 140A-140H. - If the
server 125 determines that the order is nearly complete, the server queries if an order robot replacement 110A that is suitable for use for fulfilling a next order has yet been sent. Sending the order robot replacement 110A may be desirable to minimize delays in fulfilling the next order. If no order robot replacement 110A has been sent yet, theserver 125 sends an order to the order robot replacement 110A ordering its dispatch. The order robot replacement 110A moves per the order it received from theserver 125. - Then the
server 125 determines whether the order is complete. If an order robot replacement 110A has already been sent, theserver 125 determines whether the order is complete. - If the
server 125 determines that the order is complete, as depicted, theserver 125 instructs theorder robot 110 to carry theorder items 140A-140H to afinal destination 195. Theorder robot 110 then heads off to thefinal destination 195 for offloading of theorder items 140A-140H. - Process terminates or restarts using replacing robot 1106. Replacing robot may navigate to and follow
current robot 110 that is following human 120. -
FIGS. 2A-2D are a set of drawings that depict a sequence of events in a system using robots to assist humans in order fulfillment in which anorder robot 110 leads one ormore humans 120 as they pick one ormore order items 140A-140H. As shown inFIGS. 2A-2D , according to alternative embodiments, theorder robot 110 may lead the human, rather than following the human as shown inFIGS. 1A-1K . The control device is configured to determine one or more of theorder item 140A-140H to pick and a location of theorder item 140A-140H. Theorder robot 110 can navigate its way through theinventory storage 130 to the desired position. For example, theorder robot 110 can automatically navigate its way through theinventory storage 130 to the desired position. -
FIGS. 2A-2D depict asystem 200 using robots to assist humans in order fulfillment in which theorder robot 110 leads the human 120 as the human 120 picks one or more order items to fulfill an order. Other than the fact that theorder robots 110 leads the human 120 inFIGS. 2A-2D , rather than following the human 120 as inFIGS. 1A-1K , thesystem 200 functions in a similar way to thesystem 100. For example, thesystem 200 comprises awarehouse 200. Theorder robot 110 may lead the human 120 as the human 120 picks one or more order items. -
FIGS. 2A-2D also depict theinventory storage 130 comprising the first througheighth inventory items 140A-140H. Preferably, although not necessarily, theorder robot 110 comprises amobile order robot 110. Those of skill in the art will recognize that any number oforder robots 110 may be present. Similarly, those of skill in the art will recognize that any number ofhumans 120 may be present. - For example, as depicted in
FIG. 2A , theorder robot 110 comprisesorder storage 150.Order storage 150 comprises one or more of an order bin, an order shelf, and an order box. As depicted, theorder storage 150 comprises three order shelves, afirst order shelf 160A, asecond order shelf 160B, and athird order shelf 160C. As depicted, thefirst order shelf 160A comprises a first ordershelf order item 170. As depicted, thethird order shelf 160C comprises a third ordershelf order item 175. - Those of skill in the art will further recognize that the
first order shelf 160A may hold an arbitrary number of first ordershelf order items 170, thesecond order shelf 160B may hold an arbitrary number of second order shelf order items (not pictured), and thethird order shelf 160C may hold an arbitrary number of third ordershelf order items 175. - As depicted in
FIG. 2A , theorder robot 110 further comprises aninformation capture device 180. - In
FIG. 2B , the human 120 picks up thefifth order item 140E from theinventory storage 130. - In
FIG. 2C , the human 120 carries thefifth order item 140E toward thesecond order shelf 160B. - In
FIG. 2D , the human positions thefifth order item 140E on thesecond order shelf 160B. -
FIG. 3 is a drawing of asystem 300 using robots to assist humans in order fulfillment showing that the following behavior of theorder robot 110 may be initiated by a hit such as by lightly kicking a hit detection device comprised in theorder robot 110. For example, the following behavior of the order robot may be initiated by a human 120 lightly kicking theorder robot 110 on a designated panel. In this set of embodiments, theorder robot 110 comprises a hit detection device. For example the hit detection device may comprise one or more of a designated panel, a gyro, an accelerometer, an inertial measurement unit (IMU), and another hit detection device. For example, sensor fusion between theinformation capture device 180 and the IMU can facilitate hit detection. - The assisting behavior of the
order robot 110 may be initiated by one or more of a hit, a command, a microphone, a speech recognition system, a command from theserver 125, a command from the human-operateddevice 127, and another assist trigger configured to trigger theorder robot 110 to assist the human 120 to pick the order item. - The following behavior of the
order robot 110 may be initiated by one or more of a hit, a heads-up display, a smart watch, a tablet, a command, a wireless device, a headset, a microphone, a speech recognition system, and another following behavior initiator. For example, one or more of a smart watch, a tablet, and the like may also be used to display one or more of the items to be picked. - For example, the command may comprise a spoken command. For example, the command may comprise a spoken command from a human. For example, the
order robot 110 may comprise one or more of a microphone and a speech recognition system. For example, the human may be equipped with a headset configured to communicate with theorder robot 110 without picking up one or more of ambient noise and robot noise. For example, the headset may be operably connected to theorder robot 110. For example, the headset may be operably connected to theserver 125. For example, the headset may be wirelessly connected to theorder robot 110. For example, the headset may be wirelessly connected to theserver 125. - As another example, the following behavior of the
order robot 110 may be initiated by a heads-updisplay 127. -
FIG. 4 is a drawing of asystem 400 using robots to assist humans in order fulfillment illustrating that theorder robot 110 can autonomously give the human 120 cues as to one or more of what to pick, where to pick, and the like. The human 120, guided by the human-operateddevice 127, picks from aninventory storage 130 one ormore order items 140A-140H to fulfill an order. - The
order robot 110 may use aprojector 410 to project the cues onto one or more of the floor and another surface. As depicted, theprojector 410 is indicatingitem 140B to be picked from theinventory storage 130 by the human 120, guided by the human-operateddevice 127. For example, theprojector 410 comprises a pick-to-light illumination device. For example, theprojector 410 comprises anotherprojector 410 other than a pick-to-light illumination device. - According to these embodiments, the
order robot 110 is the leader of the human 120, as depicted inFIGS. 2A-2D . Theorder robot 110 may suggest where the human 120 should go. For example, theorder robot 110 may comprise lights (not shown) configured to show in which direction theorder robot 110 will be heading. - The
order robot 110 may adjust its pace to approximately match the pace of the human 120. For example, theorder robot 110 may automatically adjust its pace to approximately match the pace of the human 120. For example, theorder robot 110 may adjust its pace to approximately match the pace of the human 120 if the human 120 falls behind theorder robot 110. For example, theorder robot 110 may adjust its pace to approximately match the pace of the human 120 if the human 120 keeps up with theorder robot 110. - According to further embodiments of the invention, the
order robot 110 may comprise a cuing device. The cuing device may comprise one or more of a visual cuing device and an audio cuing device. The visual cuing device may comprise one or more of an onboard projector, a camera system, an augmented reality system, a laser pointer, a light-emitting diode (LED) light, and another visual cuing device that can show the human what to pick. The visual cuing device is configured to display one or more visual cues to the human regarding one or more order items to pick. The visual cuing device may also be configured to record evidence of one or more of the picking of the one or more order items and the placement of the one or more order items so as to be accessible to theorder robot 110. The audio cuing device is configured to specify the task to the human. The audio cuing device may comprise one or more of an on-robot speaker and a headset. The headset may, for example, be wirelessly connected to theorder robot 110. Alternatively, a wired connection may connect the headset and theorder robot 110. As another alternative, theorder robot 110 can wirelessly communicate with the server, and the server can wirelessly communicate with the headset. -
FIG. 5 is a flowchart of amethod 500 for order fulfillment using robots to assist humans. The order of the steps in themethod 500 is not constrained to that shown inFIG. 5 or described in the following discussion. Several of the steps could occur in a different order without affecting the final result. - In
step 510, an order robot receives a selection of the order robot by a human.Block 510 then transfers control to block 520. - In
step 520, the order robot receives, from a server, an order comprising an order item.Block 520 then transfers control to block 530. - In
step 530, the order robot receives from the server a direction to assist the human to pick the order item.Block 530 then transfers control to block 540. - In
step 540, the order robot receives an assist trigger configured to trigger the order robot to assist the human to pick the order item.Block 540 then transfers control to block 550. - In
step 550, the order robot receives from the server an instruction to carry the order item to a final destination.Block 550 then transfers control to block 560. - In
step 560, the order robot assists the human to pick the order item.Block 560 then transfers control to block 570. - In
step 570, the order robot carries the order item to the final destination.Block 570 then terminates the process. -
FIG. 6 is a flowchart of amethod 600 for order fulfillment using robots to assist humans. The order of the steps in themethod 600 is not constrained to that shown inFIG. 6 or described in the following discussion. Several of the steps could occur in a different order without affecting the final result. - In
step 610, a server receives an order comprising an order item.Block 610 then transfers control to block 620. - In
step 620, the server receives a selection by the human of the order robot.Block 620 then transfers control to block 630. - In
step 630, the server sends the order to one or more of the order robot and a human-operated device available to the human.Block 630 then transfers control to block 640. - In
step 640, the server sends to the order robot a direction to assist the human to pick the order item.Block 640 then transfers control to block 650. - In
step 650, the server determines if the order is nearly complete. If the order is determined to be nearly complete, block 650 then transfers control to block 660. If the order is not nearly complete, the process reverts to block 640. - In
step 660, the server determines if an order robot replacement suitable for fulfilling a next order has yet been sent. If the order robot replacement has not yet been sent, block 660 then transfers control to block 670. If the order robot replacement has already been sent, block 660 then transfers control to block 680. - In
step 670, the server sends a dispatch instruction to the order robot replacement instructing its dispatch.Block 670 then transfers control to block 680. - In
step 680, the server determines if the order is complete. If the order is complete, block 680 then transfers control to block 690. If the order is not complete, the process reverts to block 640. - In
step 690, the server instructs the order robot to carry the order item to a final destination.Block 690 then terminates the process. - For example, it will be understood by those skilled in the art that software used by the system and method for order fulfillment and inventory management using robots may be located in any location in which it may be accessed by the system. It will be further understood by those of skill in the art that the number of variations of the network, location of the software, interactions of robots and humans, and the like are virtually limitless. It is intended, therefore, that the subject matter in the above description shall be interpreted as illustrative and shall not be interpreted in a limiting sense.
- While the above representative embodiments have been described with certain components in exemplary configurations, it will be understood by one of ordinary skill in the art that other representative embodiments can be implemented using different configurations and/or different components. For example, it will be understood by one of ordinary skill in the art that the order of certain steps and certain components can be altered without substantially impairing the functioning of the invention. For example, the one or more shelves may be located within the order robot rather than on top of the order robot.
- The representative embodiments and disclosed subject matter, which have been described in detail herein, have been presented by way of example and illustration and not by way of limitation. It will be understood by those skilled in the art that various changes may be made in the form and details of the described embodiments resulting in equivalent embodiments that remain within the scope of the invention. It is intended, therefore, that the subject matter in the above description shall be interpreted as illustrative and shall not be interpreted in a limiting sense.
Claims (88)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/512,058 US20170337506A1 (en) | 2015-02-12 | 2016-02-11 | System and Method Using Robots to Assist Humans in Order Fulfillment |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201562115440P | 2015-02-12 | 2015-02-12 | |
US201562117457P | 2015-02-18 | 2015-02-18 | |
US15/512,058 US20170337506A1 (en) | 2015-02-12 | 2016-02-11 | System and Method Using Robots to Assist Humans in Order Fulfillment |
PCT/US2016/017628 WO2016130856A1 (en) | 2015-02-12 | 2016-02-11 | System and method using robots to assist humans in order fulfillment |
Publications (1)
Publication Number | Publication Date |
---|---|
US20170337506A1 true US20170337506A1 (en) | 2017-11-23 |
Family
ID=56614935
Family Applications (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/512,054 Active 2036-07-29 US10423150B2 (en) | 2015-02-12 | 2016-02-11 | System and method for order fulfillment using robots |
US15/512,058 Pending US20170337506A1 (en) | 2015-02-12 | 2016-02-11 | System and Method Using Robots to Assist Humans in Order Fulfillment |
US16/549,637 Active US10691109B2 (en) | 2015-02-12 | 2019-08-23 | System and method using robots to assist humans in order fulfillment |
US16/536,697 Active 2036-02-16 US11137742B2 (en) | 2015-02-12 | 2019-09-03 | System and method for order fulfillment using robots |
US17/463,350 Active 2036-07-05 US11934181B2 (en) | 2015-02-12 | 2021-08-31 | System and method for order fulfillment using robots |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/512,054 Active 2036-07-29 US10423150B2 (en) | 2015-02-12 | 2016-02-11 | System and method for order fulfillment using robots |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/549,637 Active US10691109B2 (en) | 2015-02-12 | 2019-08-23 | System and method using robots to assist humans in order fulfillment |
US16/536,697 Active 2036-02-16 US11137742B2 (en) | 2015-02-12 | 2019-09-03 | System and method for order fulfillment using robots |
US17/463,350 Active 2036-07-05 US11934181B2 (en) | 2015-02-12 | 2021-08-31 | System and method for order fulfillment using robots |
Country Status (8)
Country | Link |
---|---|
US (5) | US10423150B2 (en) |
EP (2) | EP3241107B1 (en) |
JP (2) | JP6902471B2 (en) |
AU (2) | AU2016219221B2 (en) |
CA (2) | CA2973000C (en) |
MX (2) | MX2017010387A (en) |
SG (2) | SG11201705992VA (en) |
WO (2) | WO2016130856A1 (en) |
Cited By (39)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180231973A1 (en) * | 2017-02-16 | 2018-08-16 | Wal-Mart Stores, Inc. | System and Methods for a Virtual Reality Showroom with Autonomous Storage and Retrieval |
US20190077599A1 (en) * | 2016-03-04 | 2019-03-14 | Ubimax Gmbh | Method for technically supporting a manual order picking process |
CN110405756A (en) * | 2019-06-28 | 2019-11-05 | 炬星科技(深圳)有限公司 | A kind of method for scheduling task, device, system, electronic equipment and storage medium |
US10562707B1 (en) * | 2018-11-20 | 2020-02-18 | Fetch Robotics, Inc. | System and method using robots to assist humans in order fulfillment |
US20200064827A1 (en) * | 2018-08-24 | 2020-02-27 | Ford Global Technologies, Llc | Self-driving mobile robots using human-robot interactions |
US20200184542A1 (en) * | 2018-12-05 | 2020-06-11 | Locus Robotics Corp. | Customer assisted robot picking |
USD892188S1 (en) | 2019-04-05 | 2020-08-04 | IAM Robotics, LLC | Autonomous mobile robot |
USD908153S1 (en) * | 2019-06-24 | 2021-01-19 | 6 River Systems, Llc | Mobile cart |
USD908152S1 (en) * | 2019-06-24 | 2021-01-19 | 6 River Systems, Llc | Mobile cart |
USD914780S1 (en) * | 2019-02-01 | 2021-03-30 | Hilti Aktiengesellschaft | Mobile jobsite robot |
USD915486S1 (en) * | 2018-12-31 | 2021-04-06 | Toyota Research Institute, Inc. | Virtual mobility robot |
WO2021067680A1 (en) * | 2019-10-02 | 2021-04-08 | Baker Hughes Oilfield Operations Llc | Telemetry harvesting and analysis from extended reality streaming |
USD917591S1 (en) * | 2018-10-31 | 2021-04-27 | Hangzhou Hikrobot Technology Co., Ltd | Automatic guided transport vehicle |
USD918977S1 (en) * | 2017-12-29 | 2021-05-11 | Dcentralized Systems Llc | Autonomous mobile platform |
USD921082S1 (en) * | 2020-05-09 | 2021-06-01 | Ubtech Robotics Corp Ltd | Robot |
USD921083S1 (en) * | 2020-05-09 | 2021-06-01 | Ubtech Robotics Corp Ltd | Robot |
USD924291S1 (en) * | 2019-01-18 | 2021-07-06 | Tata Consultancy Services Limited | Industrial robot |
US11069081B1 (en) * | 2019-01-25 | 2021-07-20 | Google Llc | Location discovery |
US20210240189A1 (en) * | 2018-09-05 | 2021-08-05 | Sony Corporation | Mobile device, mobile device control system, method, and program |
USD937920S1 (en) * | 2019-12-19 | 2021-12-07 | Toyota Research Institute, Inc. | Virtual mobility robot |
US20220009711A1 (en) * | 2018-11-19 | 2022-01-13 | Syrius Robotics Co., Ltd. | Robot-based Random Warehousing Method and Apparatus, Electronic Device, and Storage Medium |
USD945507S1 (en) * | 2020-06-30 | 2022-03-08 | Bossa Nova Robotics Ip, Inc. | Mobile robot for object detection |
US11321649B1 (en) * | 2014-04-29 | 2022-05-03 | Blue Yonder Group, Inc. | System and method of a supply chain retail process manager |
WO2022123533A1 (en) * | 2020-12-11 | 2022-06-16 | Dematic Corp. | Contactless customer order pick-up portal |
USD963722S1 (en) * | 2021-06-28 | 2022-09-13 | Ubtech North America Research And Development Center Corp | Robot |
USD966383S1 (en) * | 2021-06-29 | 2022-10-11 | Ubtech North America Research And Development Center Corp | Robot |
USD966381S1 (en) * | 2021-05-31 | 2022-10-11 | Lg Electronics Inc. | Security guide robot |
USD966382S1 (en) * | 2021-06-25 | 2022-10-11 | Ubtech North America Research And Development Center Corp | Robot |
USD968492S1 (en) * | 2020-05-29 | 2022-11-01 | Blue Ocean Robotics Aps | UV-light disinfection robot |
USD969189S1 (en) * | 2021-05-31 | 2022-11-08 | Lg Electronics Inc. | Security guide robot |
USD969894S1 (en) * | 2021-03-15 | 2022-11-15 | Shenzhen Pudu Technology Co., Ltd. | Robot |
US11542098B2 (en) | 2018-06-22 | 2023-01-03 | Daifuku Co., Ltd. | Article transport vehicle |
US11774842B2 (en) | 2019-08-16 | 2023-10-03 | Bossa Nova Robotics Ip, Inc. | Systems and methods for image capture and shelf content detection |
USD1012143S1 (en) * | 2021-02-04 | 2024-01-23 | Toyota Jidosha Kabushiki Kaisha | Delivery robot |
USD1016116S1 (en) * | 2022-04-29 | 2024-02-27 | Shenzhen Pudu Technology Co., Ltd. | Transfer robot |
USD1016117S1 (en) * | 2022-11-29 | 2024-02-27 | Shenzhen Reeman Intelligent Equipment Co., Ltd. | Delivery robot |
USD1017658S1 (en) * | 2022-06-17 | 2024-03-12 | RGT Inc. | Serving robot |
USD1018620S1 (en) * | 2022-08-02 | 2024-03-19 | John S Lee | Infinity smart serving robot |
US11960279B1 (en) * | 2018-01-09 | 2024-04-16 | AI Incorporated | Autonomous signal boosting robotic device |
Families Citing this family (61)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11348066B2 (en) | 2013-07-25 | 2022-05-31 | IAM Robotics, LLC | System and method for piece picking or put-away with a mobile manipulation robot |
WO2016130856A1 (en) * | 2015-02-12 | 2016-08-18 | Melonee Wise | System and method using robots to assist humans in order fulfillment |
US10669098B1 (en) * | 2016-03-28 | 2020-06-02 | Tension International, Inc. | Modular product dispensing and verification system and method |
JP6734728B2 (en) * | 2016-08-05 | 2020-08-05 | 株式会社日立製作所 | Robot system and picking method |
EP3309725A1 (en) * | 2016-10-15 | 2018-04-18 | The Hi-Tech Robotic Systemz Ltd | Automated warehouse management system |
CN108357886A (en) * | 2017-01-26 | 2018-08-03 | 菜鸟智能物流控股有限公司 | Item sorting method and related apparatus |
GB2573688A (en) * | 2017-01-30 | 2019-11-13 | Walmart Apollo Llc | Distributed autonomous robot systems and methods with RFID tracking |
CA3050716A1 (en) | 2017-01-30 | 2018-08-02 | Walmart Apollo, Llc | Systems and methods for distributed autonomous robot interfacing using live image feeds |
WO2018140722A1 (en) | 2017-01-30 | 2018-08-02 | Walmart Apollo, Llc | Distributed autonomous robot interfacing systems and methods |
GB2573707B (en) | 2017-01-30 | 2022-03-02 | Walmart Apollo Llc | Distributed autonomous robot systems and methods |
JP2018147359A (en) * | 2017-03-08 | 2018-09-20 | 富士ゼロックス株式会社 | Service providing system and request reception robot |
JP7105095B2 (en) * | 2017-05-10 | 2022-07-22 | 株式会社Ihi物流産業システム | picking equipment |
US11429918B2 (en) | 2017-06-26 | 2022-08-30 | Hewlett-Packard Development Company, L.P. | Robot deliveries based on personal data |
CN107563708B (en) * | 2017-09-30 | 2023-04-07 | 北京极智嘉科技股份有限公司 | Article sorting system and method |
CN108196455B (en) * | 2017-12-26 | 2020-08-11 | 北京康力优蓝机器人科技有限公司 | Intelligent object taking robot |
JP6904246B2 (en) * | 2017-12-27 | 2021-07-14 | トヨタ自動車株式会社 | Mobile system and control method of mobile system |
US11173605B2 (en) * | 2018-02-26 | 2021-11-16 | dogugonggan Co., Ltd. | Method of controlling mobile robot, apparatus for supporting the method, and delivery system using mobile robot |
CN112088341A (en) * | 2018-03-12 | 2020-12-15 | 创造者公司 | Control system structure and distributed human-machine interface for robot control |
CN110309993B (en) * | 2018-03-27 | 2022-04-05 | 杭州海康机器人技术有限公司 | AGV task allocation method and device for automatic guided transport vehicle |
CN111386233B (en) * | 2018-03-27 | 2022-04-01 | 株式会社日立产业机器 | Warehouse system |
CN110340863B (en) * | 2018-04-08 | 2023-02-17 | AIrobot株式会社 | Autonomous mobile transfer robot |
DE202018006834U1 (en) * | 2018-04-26 | 2023-08-08 | Beijing Geekplus Technology Co., Ltd. | robot |
WO2019218877A1 (en) * | 2018-05-18 | 2019-11-21 | 北京极智嘉科技有限公司 | Cargo sorting system and method |
CA3100279C (en) | 2018-05-21 | 2023-08-22 | Beijing Geekplus Technology Co., Ltd. | Order processing method and device, server, and storage medium |
CN108500949A (en) * | 2018-06-06 | 2018-09-07 | 北京极智嘉科技有限公司 | Mobile robot with multiple catching devices |
DE102018116834A1 (en) * | 2018-07-11 | 2020-01-16 | Sick Ag | Automation system for a warehouse |
WO2020012797A1 (en) * | 2018-07-13 | 2020-01-16 | 株式会社松浦機械製作所 | Tool storing method |
US11097897B1 (en) * | 2018-07-13 | 2021-08-24 | Vecna Robotics, Inc. | System and method of providing delivery of items from one container to another container via robot movement control to indicate recipient container |
US20200030967A1 (en) * | 2018-07-30 | 2020-01-30 | Ncr Corporation | Robots for picking products to complete an order |
JP7165547B2 (en) | 2018-09-26 | 2022-11-04 | 株式会社日立インダストリアルプロダクツ | Article transport system, control device and control method |
CN109377125A (en) * | 2018-09-26 | 2019-02-22 | 北京极智嘉科技有限公司 | Warehouse Management System and method |
US10399778B1 (en) * | 2018-10-25 | 2019-09-03 | Grey Orange Pte. Ltd. | Identification and planning system and method for fulfillment of orders |
CN109279252B (en) * | 2018-10-30 | 2022-10-11 | 北京极智嘉科技股份有限公司 | Cargo picking system and method |
US11500393B2 (en) * | 2019-01-03 | 2022-11-15 | Lg Electronics Inc. | Control method of robot system |
US11046518B2 (en) | 2019-01-14 | 2021-06-29 | Mujin, Inc. | Controller and control method for robot system |
JP6738112B2 (en) | 2019-01-14 | 2020-08-12 | 株式会社Mujin | Robot system control device and control method |
CN109592280A (en) * | 2019-01-21 | 2019-04-09 | 深圳市海柔创新科技有限公司 | A kind of intelligent warehousing system, cargo pick and place method and its background process terminal |
KR102352916B1 (en) * | 2019-01-21 | 2022-01-18 | 하이 로보틱스 씨오., 엘티디. | Smart warehouse storage system, cargo picking and placing method and its background processing terminal |
DE102019202094A1 (en) * | 2019-02-15 | 2020-08-20 | Kardex Produktion Deutschland Gmbh | Eye-catching light and system for color coding a pick-cart in order picking systems |
WO2020206457A1 (en) | 2019-04-05 | 2020-10-08 | IAM Robotics, LLC | Autonomous mobile robotic systems and methods for picking and put-away |
CN110040412A (en) * | 2019-04-24 | 2019-07-23 | 深圳市海柔创新科技有限公司 | Intelligent warehousing system, processing terminal, storage robot and intelligent storage method |
US11592815B2 (en) | 2019-06-24 | 2023-02-28 | Mul Technologies, Llc | Autonomous utility cart and robotic cart platform |
WO2021010502A1 (en) * | 2019-07-12 | 2021-01-21 | 엘지전자 주식회사 | Robot and method for managing article by using same |
CN112955942B (en) * | 2019-09-26 | 2023-05-30 | 乐天集团股份有限公司 | Control device, mobile body, system, and method |
CN113128821A (en) * | 2020-01-16 | 2021-07-16 | 北京京东振世信息技术有限公司 | Method and device for determining task |
FR3106585B1 (en) * | 2020-01-24 | 2022-08-26 | C Log Solutions | Installation and method of preparing orders |
US10814489B1 (en) * | 2020-02-28 | 2020-10-27 | Nimble Robotics, Inc. | System and method of integrating robot into warehouse management software |
DE202020103685U1 (en) | 2020-06-26 | 2021-09-29 | Hanns-Peter Mösonef | Shipping facility |
CN117098634A (en) * | 2020-08-17 | 2023-11-21 | 安比机器人有限公司 | System and method for dynamic robot bagging stock line |
CN112085934A (en) * | 2020-08-20 | 2020-12-15 | 上海姜歌机器人有限公司 | Goods picking prompting method for goods picking robot and goods picking robot |
US20220067645A1 (en) * | 2020-08-27 | 2022-03-03 | Walmart Apollo, Llc | Systems and Methods for Automatic Determination of a Packing Configuration to Pack Items in Shipping Boxes |
CN112215537A (en) * | 2020-09-11 | 2021-01-12 | 深圳优地科技有限公司 | Item delivery method and device, intelligent equipment and storage medium |
JP2022127096A (en) * | 2021-02-19 | 2022-08-31 | トヨタ自動車株式会社 | Shelf inventory management system, shelf inventory management method, and program |
US11676101B2 (en) | 2021-06-16 | 2023-06-13 | 6 River Systems, Llc | Systems and methods for using kits as a source of inventory in a fulfillment center |
US20220405669A1 (en) * | 2021-06-16 | 2022-12-22 | 6 River Systems, Llc | Systems And Methods For Optimizing Kit Assembly In A Fulfillment Center |
JP7429494B2 (en) * | 2021-06-18 | 2024-02-08 | 日本国民食株式会社 | Robot system with cleaning device and method of operating this robot system |
KR102619118B1 (en) * | 2021-12-10 | 2023-12-29 | 주식회사 엑스와이지 | Operator-Leading Smart Transport Robot |
KR102513885B1 (en) * | 2022-07-26 | 2023-03-24 | 주식회사 플로틱 | Cell directing apparatus and robot for assisting picking |
EP4325042A1 (en) | 2022-08-16 | 2024-02-21 | Dematic GmbH | Order fulfillment system with a floor-based order fulfilment area having at least one picking station |
US11816635B1 (en) | 2022-09-07 | 2023-11-14 | David Paul Winter | System and methods of three-dimensional projection mapping-based visual guidance for order fulfillment |
WO2024084990A1 (en) * | 2022-10-20 | 2024-04-25 | ソフトバンクグループ株式会社 | Picking system, and storage unit robot |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4484120A (en) * | 1983-04-13 | 1984-11-20 | Nordson Corporation | Auxiliary function command presequencing for a robot controller |
US20020165790A1 (en) * | 2001-05-04 | 2002-11-07 | Allen Bancroft | Methods for facilitating a retail environment |
US20130317642A1 (en) * | 2012-05-28 | 2013-11-28 | Well.Ca Inc. | Order processing systems using picking robots |
US20130345872A1 (en) * | 2012-06-21 | 2013-12-26 | Rethink Robotics, Inc. | User interfaces for robot training |
KR20140088849A (en) * | 2014-06-11 | 2014-07-11 | (주)미래컴퍼니 | Method and device for controlling/compensating movement of surgical robot |
US9463927B1 (en) * | 2013-09-23 | 2016-10-11 | Vecna Technologies, Inc. | Transporting and/or sorting items with mobile robot(s) |
Family Cites Families (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0558405A (en) * | 1991-09-02 | 1993-03-09 | Toshiba Corp | Carrying-in and-out control device for automated warehouse |
JPH06345220A (en) * | 1993-06-07 | 1994-12-20 | Mitsui Eng & Shipbuild Co Ltd | Assortment truck system |
JP2002087539A (en) * | 2000-09-18 | 2002-03-27 | Murata Mach Ltd | Carrying system |
JP2002338015A (en) * | 2001-05-15 | 2002-11-27 | Ishida Co Ltd | Commodity sorting system |
JP4029659B2 (en) * | 2002-05-10 | 2008-01-09 | 株式会社ダイフク | Goods storage facility |
JP2003327310A (en) * | 2002-05-13 | 2003-11-19 | Ishida Co Ltd | Commodity sorting system, commodity sorting method, and commodity sorting program |
WO2006043396A1 (en) * | 2004-10-19 | 2006-04-27 | Matsushita Electric Industrial Co., Ltd. | Robot apparatus |
US20060279531A1 (en) * | 2005-05-25 | 2006-12-14 | Jung Edward K | Physical interaction-responsive user interface |
US8220710B2 (en) * | 2006-06-19 | 2012-07-17 | Kiva Systems, Inc. | System and method for positioning a mobile drive unit |
TW201026456A (en) * | 2008-10-29 | 2010-07-16 | Sms Siemag Ag | Robot interaction system |
US8571700B2 (en) * | 2010-08-02 | 2013-10-29 | Brightstar Corp. | Robotic picking line for serialized products |
US8805573B2 (en) * | 2012-01-04 | 2014-08-12 | Amazon Technologies, Inc. | System and method for order fulfillment |
WO2013119942A1 (en) * | 2012-02-08 | 2013-08-15 | Adept Technology, Inc. | Job management sytem for a fleet of autonomous mobile robots |
JP5976460B2 (en) * | 2012-08-27 | 2016-08-23 | Ntn株式会社 | Automatic boxing apparatus and method |
SG11201504598VA (en) * | 2012-12-11 | 2015-07-30 | Novartis Ag | Method and packaging plant for placing product packages into shipment containers |
WO2014130937A1 (en) | 2013-02-24 | 2014-08-28 | Intelligrated Headquaters Llc | Goods to robot for order fulfillment |
US20170183157A9 (en) * | 2013-06-18 | 2017-06-29 | Hdt Robotics, Inc. | Robotic manipulator for warehouses |
US9785911B2 (en) * | 2013-07-25 | 2017-10-10 | I AM Robotics, LLC | System and method for piece-picking or put-away with a mobile manipulation robot |
MX2018013379A (en) * | 2013-09-09 | 2021-09-09 | Dematic Corp | Autonomous mobile picking. |
US9466046B1 (en) * | 2014-03-14 | 2016-10-11 | Vecna Technologies, Inc. | Inventorying item(s) within an environment |
US10282696B1 (en) * | 2014-06-06 | 2019-05-07 | Amazon Technologies, Inc. | Augmented reality enhanced interaction system |
US9636825B2 (en) * | 2014-06-26 | 2017-05-02 | Robotex Inc. | Robotic logistics system |
US9694977B2 (en) * | 2014-10-14 | 2017-07-04 | Nextshift Robotics, Inc. | Storage material handling system |
US9242799B1 (en) * | 2014-10-20 | 2016-01-26 | Amazon Technologies, Inc. | Dynamically reconfigurable inventory pods |
US10311400B2 (en) * | 2014-10-24 | 2019-06-04 | Fellow, Inc. | Intelligent service robot and related systems and methods |
US9465390B2 (en) * | 2014-11-11 | 2016-10-11 | Google Inc. | Position-controlled robotic fleet with visual handshakes |
US10482421B1 (en) * | 2014-12-18 | 2019-11-19 | Amazon Technologies, Inc. | System for expediting delivery of items |
WO2016129045A1 (en) * | 2015-02-09 | 2016-08-18 | 株式会社日立製作所 | Conveyance system, controller used in conveyance system, and conveyance method |
WO2016130856A1 (en) * | 2015-02-12 | 2016-08-18 | Melonee Wise | System and method using robots to assist humans in order fulfillment |
US9688472B1 (en) | 2015-12-10 | 2017-06-27 | Amazon Technologies, Inc. | Mobile robot manipulator |
US9827683B1 (en) * | 2016-07-28 | 2017-11-28 | X Development Llc | Collaborative inventory monitoring |
US10071856B2 (en) * | 2016-07-28 | 2018-09-11 | X Development Llc | Inventory management |
US10192195B1 (en) * | 2016-10-25 | 2019-01-29 | Amazon Technologies, Inc. | Techniques for coordinating independent objects with occlusions |
US10583560B1 (en) * | 2019-04-03 | 2020-03-10 | Mujin, Inc. | Robotic system with object identification and handling mechanism and method of operation thereof |
-
2016
- 2016-02-11 WO PCT/US2016/017628 patent/WO2016130856A1/en active Application Filing
- 2016-02-11 CA CA2973000A patent/CA2973000C/en active Active
- 2016-02-11 MX MX2017010387A patent/MX2017010387A/en active IP Right Grant
- 2016-02-11 JP JP2017542170A patent/JP6902471B2/en active Active
- 2016-02-11 US US15/512,054 patent/US10423150B2/en active Active
- 2016-02-11 WO PCT/US2016/017617 patent/WO2016130849A1/en active Application Filing
- 2016-02-11 EP EP16749915.1A patent/EP3241107B1/en active Active
- 2016-02-11 US US15/512,058 patent/US20170337506A1/en active Pending
- 2016-02-11 SG SG11201705992VA patent/SG11201705992VA/en unknown
- 2016-02-11 AU AU2016219221A patent/AU2016219221B2/en active Active
- 2016-02-11 SG SG11201705995RA patent/SG11201705995RA/en unknown
- 2016-02-11 AU AU2016219214A patent/AU2016219214B2/en active Active
- 2016-02-11 MX MX2017010388A patent/MX2017010388A/en active IP Right Grant
- 2016-02-11 EP EP16749911.0A patent/EP3265884A4/en active Pending
- 2016-02-11 CA CA2972999A patent/CA2972999C/en active Active
- 2016-02-11 JP JP2017542169A patent/JP6585177B2/en active Active
-
2019
- 2019-08-23 US US16/549,637 patent/US10691109B2/en active Active
- 2019-09-03 US US16/536,697 patent/US11137742B2/en active Active
-
2021
- 2021-08-31 US US17/463,350 patent/US11934181B2/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4484120A (en) * | 1983-04-13 | 1984-11-20 | Nordson Corporation | Auxiliary function command presequencing for a robot controller |
US20020165790A1 (en) * | 2001-05-04 | 2002-11-07 | Allen Bancroft | Methods for facilitating a retail environment |
US20130317642A1 (en) * | 2012-05-28 | 2013-11-28 | Well.Ca Inc. | Order processing systems using picking robots |
US20130345872A1 (en) * | 2012-06-21 | 2013-12-26 | Rethink Robotics, Inc. | User interfaces for robot training |
US9463927B1 (en) * | 2013-09-23 | 2016-10-11 | Vecna Technologies, Inc. | Transporting and/or sorting items with mobile robot(s) |
KR20140088849A (en) * | 2014-06-11 | 2014-07-11 | (주)미래컴퍼니 | Method and device for controlling/compensating movement of surgical robot |
Cited By (52)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11321649B1 (en) * | 2014-04-29 | 2022-05-03 | Blue Yonder Group, Inc. | System and method of a supply chain retail process manager |
US20220253778A1 (en) * | 2014-04-29 | 2022-08-11 | Blue Yonder Group, Inc. | System and Method of a Supply Chain Retail Process Manager |
US20190077599A1 (en) * | 2016-03-04 | 2019-03-14 | Ubimax Gmbh | Method for technically supporting a manual order picking process |
US10875713B2 (en) * | 2016-03-04 | 2020-12-29 | Ubimax Gmbh | Method for technically supporting a manual order picking process |
US20180231973A1 (en) * | 2017-02-16 | 2018-08-16 | Wal-Mart Stores, Inc. | System and Methods for a Virtual Reality Showroom with Autonomous Storage and Retrieval |
USD918977S1 (en) * | 2017-12-29 | 2021-05-11 | Dcentralized Systems Llc | Autonomous mobile platform |
US11960279B1 (en) * | 2018-01-09 | 2024-04-16 | AI Incorporated | Autonomous signal boosting robotic device |
US11542098B2 (en) | 2018-06-22 | 2023-01-03 | Daifuku Co., Ltd. | Article transport vehicle |
US20200064827A1 (en) * | 2018-08-24 | 2020-02-27 | Ford Global Technologies, Llc | Self-driving mobile robots using human-robot interactions |
US10948907B2 (en) * | 2018-08-24 | 2021-03-16 | Ford Global Technologies, Llc | Self-driving mobile robots using human-robot interactions |
US11906968B2 (en) * | 2018-09-05 | 2024-02-20 | Sony Group Corporation | Mobile device, mobile device control system, method, and program |
US20210240189A1 (en) * | 2018-09-05 | 2021-08-05 | Sony Corporation | Mobile device, mobile device control system, method, and program |
USD917591S1 (en) * | 2018-10-31 | 2021-04-27 | Hangzhou Hikrobot Technology Co., Ltd | Automatic guided transport vehicle |
US11713191B2 (en) * | 2018-11-19 | 2023-08-01 | Syrius Robotics Co., Ltd. | Robot-based random warehousing method and apparatus, electronic device, and storage medium |
US20220009711A1 (en) * | 2018-11-19 | 2022-01-13 | Syrius Robotics Co., Ltd. | Robot-based Random Warehousing Method and Apparatus, Electronic Device, and Storage Medium |
US10562707B1 (en) * | 2018-11-20 | 2020-02-18 | Fetch Robotics, Inc. | System and method using robots to assist humans in order fulfillment |
US10769716B2 (en) * | 2018-12-05 | 2020-09-08 | Locus Robotics Corp. | Customer assisted robot picking |
US20200184542A1 (en) * | 2018-12-05 | 2020-06-11 | Locus Robotics Corp. | Customer assisted robot picking |
USD915486S1 (en) * | 2018-12-31 | 2021-04-06 | Toyota Research Institute, Inc. | Virtual mobility robot |
USD924294S1 (en) * | 2018-12-31 | 2021-07-06 | Toyota Research Institute, Inc. | Virtual mobility robot |
USD924291S1 (en) * | 2019-01-18 | 2021-07-06 | Tata Consultancy Services Limited | Industrial robot |
US11069081B1 (en) * | 2019-01-25 | 2021-07-20 | Google Llc | Location discovery |
US11631191B2 (en) | 2019-01-25 | 2023-04-18 | Google Llc | Location discovery |
USD914780S1 (en) * | 2019-02-01 | 2021-03-30 | Hilti Aktiengesellschaft | Mobile jobsite robot |
USD892188S1 (en) | 2019-04-05 | 2020-08-04 | IAM Robotics, LLC | Autonomous mobile robot |
USD908152S1 (en) * | 2019-06-24 | 2021-01-19 | 6 River Systems, Llc | Mobile cart |
USD908153S1 (en) * | 2019-06-24 | 2021-01-19 | 6 River Systems, Llc | Mobile cart |
CN110405756A (en) * | 2019-06-28 | 2019-11-05 | 炬星科技(深圳)有限公司 | A kind of method for scheduling task, device, system, electronic equipment and storage medium |
US11774842B2 (en) | 2019-08-16 | 2023-10-03 | Bossa Nova Robotics Ip, Inc. | Systems and methods for image capture and shelf content detection |
WO2021067680A1 (en) * | 2019-10-02 | 2021-04-08 | Baker Hughes Oilfield Operations Llc | Telemetry harvesting and analysis from extended reality streaming |
USD949220S1 (en) * | 2019-12-19 | 2022-04-19 | Toyota Research Institute, Inc. | Virtual mobility robot |
USD937920S1 (en) * | 2019-12-19 | 2021-12-07 | Toyota Research Institute, Inc. | Virtual mobility robot |
USD921082S1 (en) * | 2020-05-09 | 2021-06-01 | Ubtech Robotics Corp Ltd | Robot |
USD921083S1 (en) * | 2020-05-09 | 2021-06-01 | Ubtech Robotics Corp Ltd | Robot |
USD976299S1 (en) * | 2020-05-29 | 2023-01-24 | Blue Ocean Robotics Aps | UV-light disinfection robot light assembly tower cap |
USD970577S1 (en) * | 2020-05-29 | 2022-11-22 | Blue Ocean Robotics Aps | UV-light disinfection robot base |
USD968492S1 (en) * | 2020-05-29 | 2022-11-01 | Blue Ocean Robotics Aps | UV-light disinfection robot |
USD972612S1 (en) * | 2020-05-29 | 2022-12-13 | Blue Ocean Robotics Aps | UV-light disinfection robot light assembly tower |
USD945507S1 (en) * | 2020-06-30 | 2022-03-08 | Bossa Nova Robotics Ip, Inc. | Mobile robot for object detection |
WO2022123533A1 (en) * | 2020-12-11 | 2022-06-16 | Dematic Corp. | Contactless customer order pick-up portal |
USD1012143S1 (en) * | 2021-02-04 | 2024-01-23 | Toyota Jidosha Kabushiki Kaisha | Delivery robot |
USD969894S1 (en) * | 2021-03-15 | 2022-11-15 | Shenzhen Pudu Technology Co., Ltd. | Robot |
USD969895S1 (en) * | 2021-03-15 | 2022-11-15 | Shenzhen Pudu Technology Co., Ltd. | Robot |
USD969189S1 (en) * | 2021-05-31 | 2022-11-08 | Lg Electronics Inc. | Security guide robot |
USD966381S1 (en) * | 2021-05-31 | 2022-10-11 | Lg Electronics Inc. | Security guide robot |
USD966382S1 (en) * | 2021-06-25 | 2022-10-11 | Ubtech North America Research And Development Center Corp | Robot |
USD963722S1 (en) * | 2021-06-28 | 2022-09-13 | Ubtech North America Research And Development Center Corp | Robot |
USD966383S1 (en) * | 2021-06-29 | 2022-10-11 | Ubtech North America Research And Development Center Corp | Robot |
USD1016116S1 (en) * | 2022-04-29 | 2024-02-27 | Shenzhen Pudu Technology Co., Ltd. | Transfer robot |
USD1017658S1 (en) * | 2022-06-17 | 2024-03-12 | RGT Inc. | Serving robot |
USD1018620S1 (en) * | 2022-08-02 | 2024-03-19 | John S Lee | Infinity smart serving robot |
USD1016117S1 (en) * | 2022-11-29 | 2024-02-27 | Shenzhen Reeman Intelligent Equipment Co., Ltd. | Delivery robot |
Also Published As
Publication number | Publication date |
---|---|
CA2972999C (en) | 2020-09-22 |
CA2972999A1 (en) | 2016-08-18 |
US10691109B2 (en) | 2020-06-23 |
WO2016130849A1 (en) | 2016-08-18 |
MX2017010387A (en) | 2018-01-23 |
CA2973000C (en) | 2020-03-10 |
US20200019144A1 (en) | 2020-01-16 |
US20210389751A1 (en) | 2021-12-16 |
WO2016130856A1 (en) | 2016-08-18 |
CA2973000A1 (en) | 2016-08-18 |
US20170336780A1 (en) | 2017-11-23 |
EP3241107A1 (en) | 2017-11-08 |
AU2016219221B2 (en) | 2018-08-02 |
US11137742B2 (en) | 2021-10-05 |
EP3241107B1 (en) | 2023-04-05 |
EP3241107A4 (en) | 2018-05-23 |
SG11201705995RA (en) | 2017-09-28 |
JP2018507829A (en) | 2018-03-22 |
AU2016219214B2 (en) | 2018-07-26 |
US10423150B2 (en) | 2019-09-24 |
SG11201705992VA (en) | 2017-09-28 |
EP3265884A4 (en) | 2018-12-12 |
US20210061565A1 (en) | 2021-03-04 |
AU2016219221A1 (en) | 2017-07-27 |
US11934181B2 (en) | 2024-03-19 |
JP6902471B2 (en) | 2021-07-14 |
EP3265884A1 (en) | 2018-01-10 |
AU2016219214A1 (en) | 2017-07-27 |
JP6585177B2 (en) | 2019-10-02 |
JP2018507830A (en) | 2018-03-22 |
MX2017010388A (en) | 2018-01-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10691109B2 (en) | System and method using robots to assist humans in order fulfillment | |
US10562707B1 (en) | System and method using robots to assist humans in order fulfillment | |
US20210383320A1 (en) | Object location in a delivery vehicle | |
US11188088B2 (en) | Human interacting automatic guided vehicle | |
WO2020077481A1 (en) | Self-driving vehicle system with steerable camera and indicator | |
US10577124B2 (en) | Method for destination approach control of unmanned aerial vehicles | |
JP5047709B2 (en) | Moving device, system, moving method, and moving program | |
US10481679B2 (en) | Method and system for optical-inertial tracking of a moving object | |
US10321065B2 (en) | Remote communication method, remote communication system, and autonomous movement device | |
AU2017315755B2 (en) | Observation based event tracking | |
US20200166932A1 (en) | Information processing method and apparatus, electronic device, and storage medium | |
US20200089943A1 (en) | Living body search system | |
US8768511B2 (en) | Object searching system, object searching method, and cleaning robot | |
US20210173407A1 (en) | Self-driving system with tracking capability | |
US10350760B2 (en) | Robot, robot control system, robot control method, and non-transitory computer-readable recording medium | |
US10762409B2 (en) | Industrial electronic badge | |
JP2009139250A (en) | Detection object detection server | |
US20210283513A1 (en) | A method and apparatus for detection of light-modulated signals in a video stream | |
US20190041868A1 (en) | Autonomous Vehicle-Based Item Retrieval System and Method | |
JP2021140227A (en) | Imaging mechanism control device and imaging mechanism control method | |
US20230074046A1 (en) | Positioning and identification of electronic labels using a camera | |
CN113014658A (en) | Device control, device, electronic device, and storage medium | |
WO2023162486A1 (en) | Delivery drone and dlivery method | |
JP2022132166A (en) | Robot supporting system | |
JP2023003124A (en) | robot support system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
AS | Assignment |
Owner name: FETCH ROBOTICS, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FERGUSON, MICHAEL;REEL/FRAME:050154/0894 Effective date: 20190809 Owner name: FETCH ROBOTICS, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WISE, MELONEE;REEL/FRAME:050154/0487 Effective date: 20190507 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCV | Information on status: appeal procedure |
Free format text: NOTICE OF APPEAL FILED |
|
STCV | Information on status: appeal procedure |
Free format text: APPEAL BRIEF (OR SUPPLEMENTAL BRIEF) ENTERED AND FORWARDED TO EXAMINER |
|
STCV | Information on status: appeal procedure |
Free format text: EXAMINER'S ANSWER TO APPEAL BRIEF MAILED |
|
STCV | Information on status: appeal procedure |
Free format text: ON APPEAL -- AWAITING DECISION BY THE BOARD OF APPEALS |
|
STCV | Information on status: appeal procedure |
Free format text: BOARD OF APPEALS DECISION RENDERED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
AS | Assignment |
Owner name: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT, NEW YORK Free format text: SECURITY INTEREST;ASSIGNOR:FETCH ROBOTICS, INC.;REEL/FRAME:057565/0329 Effective date: 20210921 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
AS | Assignment |
Owner name: ZEBRA TECHNOLOGIES CORPORATION, ILLINOIS Free format text: MERGER;ASSIGNOR:FETCH ROBOTICS, INC.;REEL/FRAME:061737/0712 Effective date: 20221011 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |