DE102020104468A1 - Robotersystem mit objektidentifizierungs- und handhabungsmechanismus und verfahren zu seinem betrieb - Google Patents

Robotersystem mit objektidentifizierungs- und handhabungsmechanismus und verfahren zu seinem betrieb Download PDF

Info

Publication number
DE102020104468A1
DE102020104468A1 DE102020104468.2A DE102020104468A DE102020104468A1 DE 102020104468 A1 DE102020104468 A1 DE 102020104468A1 DE 102020104468 A DE102020104468 A DE 102020104468A DE 102020104468 A1 DE102020104468 A1 DE 102020104468A1
Authority
DE
Germany
Prior art keywords
detectable
source
properties
entries
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
DE102020104468.2A
Other languages
German (de)
English (en)
Inventor
Jose Jeronimo Moreira Rodrigues
Xutao Ye
Jinze Yu
Rosen Nikolaev Diankov
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mujin Inc
Original Assignee
Mujin Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mujin Inc filed Critical Mujin Inc
Publication of DE102020104468A1 publication Critical patent/DE102020104468A1/de
Pending legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1694—Program controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1602—Program controls characterised by the control system, structure, architecture
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00—Manipulators not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1656—Program controls characterised by programming, planning systems for manipulators
    • B25J9/1661—Program controls characterised by programming, planning systems for manipulators characterised by task planning, object-oriented languages
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1656—Program controls characterised by programming, planning systems for manipulators
    • B25J9/1664—Program controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G1/00—Storing articles, individually or in orderly arrangement, in warehouses or magazines
    • B65G1/02—Storage devices
    • B65G1/04—Storage devices mechanical
    • B65G1/137—Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G47/00—Article or material-handling devices associated with conveyors; Methods employing such devices
    • B65G47/74—Feeding, transfer, or discharging devices of particular kinds or types
    • B65G47/90—Devices for picking-up and depositing articles or materials
    • B65G47/91—Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers
    • B65G47/915—Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers provided with drive systems with rotary movements only
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G47/00—Article or material-handling devices associated with conveyors; Methods employing such devices
    • B65G47/74—Feeding, transfer, or discharging devices of particular kinds or types
    • B65G47/90—Devices for picking-up and depositing articles or materials
    • B65G47/91—Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers
    • B65G47/917—Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers control arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/083—Shipping
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G2201/00—Indexing codes relating to handling devices, e.g. conveyors, characterised by the type of product or load being conveyed or handled
    • B65G2201/02—Articles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G57/00—Stacking of articles
    • B65G57/02—Stacking of articles by adding to the top of the stack
    • B65G57/03—Stacking of articles by adding to the top of the stack from above
    • B65G57/04—Stacking of articles by adding to the top of the stack from above by suction or magnetic devices
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G59/00—De-stacking of articles
    • B65G59/02—De-stacking from the top of the stack
    • B65G59/04—De-stacking from the top of the stack by suction or magnetic devices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/06—Recognition of objects for industrial automation

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Robotics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Economics (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Operations Research (AREA)
  • Automation & Control Theory (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Development Economics (AREA)
  • Quality & Reliability (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Manipulator (AREA)
  • Numerical Control (AREA)
DE102020104468.2A 2019-04-03 2020-02-20 Robotersystem mit objektidentifizierungs- und handhabungsmechanismus und verfahren zu seinem betrieb Pending DE102020104468A1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/374,617 US10583560B1 (en) 2019-04-03 2019-04-03 Robotic system with object identification and handling mechanism and method of operation thereof
US16/374,617 2019-04-03

Publications (1)

Publication Number Publication Date
DE102020104468A1 true DE102020104468A1 (de) 2020-10-08

Family

ID=68255213

Family Applications (1)

Application Number Title Priority Date Filing Date
DE102020104468.2A Pending DE102020104468A1 (de) 2019-04-03 2020-02-20 Robotersystem mit objektidentifizierungs- und handhabungsmechanismus und verfahren zu seinem betrieb

Country Status (4)

Country Link
US (2) US10583560B1 (https=)
JP (3) JP6617237B1 (https=)
CN (2) CN116494233A (https=)
DE (1) DE102020104468A1 (https=)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102020135011B3 (de) 2020-12-29 2022-03-03 Franka Emika Gmbh Bilderkennung zum angepassten Ausführen eines Steuerprogramms eines Robotermanipulators
DE102020135010A1 (de) 2020-12-29 2022-06-30 Franka Emika Gmbh Massedaten-Schätzung einer externen Last für einen Robotermanipulator

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6585177B2 (ja) * 2015-02-12 2019-10-02 ワイズ，メロニー ロボットを用いた注文実行のためのシステム及び方法
US11200531B1 (en) * 2018-05-14 2021-12-14 Amazon Technologies, Inc. Self-identifying overpackage for robotic retrieval
US11045952B2 (en) * 2018-11-28 2021-06-29 BITO Robotics, Inc. System and method for autonomously loading cargo into vehicles
US11148289B1 (en) 2019-01-08 2021-10-19 Amazon Technologies, Inc. Entanglement end effector for autonomous object retrieval
CN113692335B (zh) * 2019-05-13 2024-07-30 欧姆龙株式会社 吸附垫及变形测量装置
US11738447B2 (en) * 2019-07-29 2023-08-29 Nimble Robotics, Inc. Storage systems and methods for robotic picking
US11724880B2 (en) 2019-07-29 2023-08-15 Nimble Robotics, Inc. Storage systems and methods for robotic picking
EP3854731B1 (de) * 2020-01-24 2024-03-20 Becton Dickinson Rowa Germany GmbH Vorrichtung und verfahren zum vereinzeln von stückgütern
US11040836B1 (en) 2020-01-24 2021-06-22 Becton Dickinson Rowa Germany Gmbh Device and method for separating piece goods
US11518573B2 (en) * 2020-02-14 2022-12-06 Dell Products L.P. Palletizing containers for charging electronic devices contained therein
US11577395B2 (en) * 2020-02-17 2023-02-14 Toyota Research Institute, Inc. Systems for determining location using robots with deformable sensors
CN113145477A (zh) * 2020-08-28 2021-07-23 武汉联州科技有限公司 一种基于大数据的辊筒输送线多重检测系统
CN112651347B (zh) * 2020-12-29 2022-07-05 嘉兴恒创电力集团有限公司博创物资分公司 一种基于双光谱成像的吸烟行为样本生成的方法与系统
EP4035845A1 (de) * 2021-01-28 2022-08-03 Siemens Aktiengesellschaft Handhaben von stückgütern mittels einer sauggreifvorrichtung
CN113307042B (zh) * 2021-06-11 2023-01-03 梅卡曼德（北京）机器人科技有限公司 基于传送带的物体拆垛方法、装置、计算设备及存储介质
CN116168387A (zh) * 2021-08-09 2023-05-26 牧今科技 用于物体检测的系统和方法
JP7241374B2 (ja) * 2021-08-10 2023-03-17 株式会社Mujin ロボットによるオブジェクト配置のシステム及び方法
US12366440B2 (en) * 2021-08-10 2025-07-22 Xerox Corporation Interacting with machines using natural language input and an enhanced state graph
US12290933B2 (en) * 2021-08-19 2025-05-06 Electronics And Telecommunications Research Institute Method and apparatus for automatically recognizing location of object
CN114455335B (zh) * 2021-08-27 2024-06-07 西门子工业自动化产品(成都)有限公司 叠放箱体的分离装置和方法
JP7505463B2 (ja) * 2021-09-08 2024-06-25 株式会社ダイフク 荷卸し装置
JP7586037B2 (ja) * 2021-09-08 2024-11-19 株式会社ダイフク 荷卸し装置
US12221292B2 (en) 2021-12-22 2025-02-11 AMP Robotics Corporation Object path planning in a sorting facility
US12128567B2 (en) * 2021-12-22 2024-10-29 AMP Robotics Corporation Using machine learning to recognize variant objects
US12340287B2 (en) 2021-12-22 2025-06-24 AMP Robotics Corporation Maintaining a data structure corresponding to a target object
JP2023103799A (ja) * 2022-01-14 2023-07-27 パナソニックＩｐマネジメント株式会社 収納体配置装置
JP7840998B2 (ja) * 2022-02-08 2026-04-06 株式会社東芝 ハンドリングシステム、ハンドリング方法、プログラム、情報処理装置、及びデータ構造
CN115187769B (zh) * 2022-07-11 2025-10-03 杭州海康机器人股份有限公司 一种定位方法及装置
JP7722310B2 (ja) * 2022-09-27 2025-08-13 株式会社ダイフク 荷卸し装置
CN115321090B (zh) * 2022-10-17 2023-01-13 中国民航大学 机场行李自动接取方法、装置、设备、系统及介质
CN116142678A (zh) * 2022-12-22 2023-05-23 东莞盟大集团有限公司 自动化出入库方法、运货车及存储介质
CN115648224A (zh) * 2022-12-22 2023-01-31 北京钢铁侠科技有限公司 一种基于双深度相机识别定位的机械臂抓取方法
CN117548359B (zh) * 2024-01-09 2024-03-19 北京环宇宏业科技开发有限公司 一种基于图像分析的节能环保分拣装置
CN118990477B (zh) * 2024-08-16 2025-11-04 华中科技大学无锡研究院 一种基于数字孪生的重载机械臂参数在线辨识方法
CN121340304A (zh) * 2025-12-17 2026-01-16 纳博特南京科技有限公司 基于稳定性风险评估的机器人抓取控制方法

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6070169A (en) * 1998-02-12 2000-05-30 International Business Machines Corporation Method and system for the determination of a particular data object utilizing attributes associated with the object
JP2006102881A (ja) * 2004-10-06 2006-04-20 Nagasaki Prefecture 把持ロボット装置
US7931197B2 (en) * 2005-09-20 2011-04-26 Rockwell Automation Technologies, Inc. RFID-based product manufacturing and lifecycle management
WO2008076942A1 (en) 2006-12-15 2008-06-26 Braintech Canada, Inc. System and method of identifying objects
US8280837B2 (en) * 2009-05-28 2012-10-02 GM Global Technology Operations LLC Contact state estimation for multi-finger robot hands using particle filters
US9233470B1 (en) 2013-03-15 2016-01-12 Industrial Perception, Inc. Determining a virtual representation of an environment by projecting texture patterns
JP5847117B2 (ja) 2013-05-28 2016-01-20 東芝テック株式会社 認識辞書作成装置及び認識辞書作成プログラム
US9427874B1 (en) 2014-08-25 2016-08-30 Google Inc. Methods and systems for providing landmarks to facilitate robot localization and visual odometry
US9561587B2 (en) * 2014-12-16 2017-02-07 Amazon Technologies, Inc. Robotic grasping of items in inventory system
TWI607336B (zh) * 2015-07-08 2017-12-01 台灣色彩與影像科技股份有限公司 區域的監控方法
EP4235539A3 (en) * 2015-09-11 2023-09-27 Berkshire Grey Operating Company, Inc. Robotic systems and methods for identifying and processing a variety of objects
JP6711591B2 (ja) * 2015-11-06 2020-06-17 キヤノン株式会社 ロボット制御装置およびロボット制御方法
CN108778636B (zh) 2016-02-08 2021-11-19 伯克希尔格雷股份有限公司 用于提供使用运动规划的各种物体的处理的系统和方法
US10071856B2 (en) * 2016-07-28 2018-09-11 X Development Llc Inventory management
JP6692247B2 (ja) * 2016-08-04 2020-05-13 株式会社東芝 物品保持装置および物品保持方法
JP2018027581A (ja) * 2016-08-17 2018-02-22 株式会社安川電機 ピッキングシステム
JP6707485B2 (ja) 2017-03-22 2020-06-10 株式会社東芝 物体ハンドリング装置およびその較正方法
JP7244925B2 (ja) * 2017-03-30 2023-03-23 ソフト ロボティクス， インコーポレイテッド ソフトロボットアクチュエータのためのサーボ空気圧制御システム
CN108491799B (zh) * 2018-03-23 2022-04-01 海深科技（宁波）有限公司 一种基于图像识别的智能售货柜商品管理方法及系统

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102020135011B3 (de) 2020-12-29 2022-03-03 Franka Emika Gmbh Bilderkennung zum angepassten Ausführen eines Steuerprogramms eines Robotermanipulators
DE102020135010A1 (de) 2020-12-29 2022-06-30 Franka Emika Gmbh Massedaten-Schätzung einer externen Last für einen Robotermanipulator
DE102020135010B4 (de) 2020-12-29 2024-05-08 Franka Emika Gmbh Massedaten-Schätzung einer externen Last für einen Robotermanipulator

Also Published As

Publication number Publication date
JP7290280B2 (ja) 2023-06-13
JP2020168709A (ja) 2020-10-15
JP2020168710A (ja) 2020-10-15
US10583560B1 (en) 2020-03-10
JP6617237B1 (ja) 2019-12-11
JP2020168711A (ja) 2020-10-15
CN116494233A (zh) 2023-07-28
CN110370279B (zh) 2023-05-09
US10987807B2 (en) 2021-04-27
CN110370279A (zh) 2019-10-25
JP6621164B1 (ja) 2019-12-18
US20200316774A1 (en) 2020-10-08

Similar Documents

Publication Publication Date Title
DE102020104468A1 (de) Robotersystem mit objektidentifizierungs- und handhabungsmechanismus und verfahren zu seinem betrieb
DE102020114577B4 (de) Steuerung und steuerverfahren für robotersystem
DE102019009201B3 (de) Ein Robotersytem mit Stückverlustverwaltungsmechanismus
DE102020104483A1 (de) Robotersystem mit Roboterarm-Saugsteuermechanismus und Betriebsverfahren
DE102019009206B4 (de) Robotersystem mit dynamischem Packmechanismus
JP7818761B2 (ja) ロボットシステムの制御装置及び制御方法
DE112019000177T5 (de) Ein robotersystem mit automatisiertem paketregistrierungsmechanismus und verfahren zum betreiben dieses systems
DE112020000067T5 (de) Roboter-mehrfachgreiferbaugruppen und -verfahren zum greifen und halten von objekten
JP2024133556A (ja) ロボットシステムの制御装置及び制御方法
US20210260762A1 (en) Controller and control method for robotic system
DE102020112099A1 (de) Ein robotersystem mit einem koordinierten übertragungsmechanismus
CN109997108A (zh) 训练机器人操作臂
US12064886B1 (en) Systems and methods for scalable perception and purposeful robotic picking of items from a collection
CN118871953A (zh) 用于定位具有未知属性的物体以用于机器人操纵的系统和方法
JP2023016699A (ja) 深さベースの処理メカニズムを伴うロボットシステム及びロボットシステムを操作するための方法
Poss et al. Perceptionbased intelligent materialhandling in industrial logistics environments
CN116692389A (zh) 一种多类别多自由度机械臂卸货方法
Leitner et al. Designing Cartman: a cartesian manipulator for the Amazon Robotics Challenge 2017