CN116494233A - 具有物体识别和处理机制的机器人系统及其操作方法 - Google Patents

具有物体识别和处理机制的机器人系统及其操作方法 Download PDF

Info

Publication number
CN116494233A
CN116494233A CN202310473435.7A CN202310473435A CN116494233A CN 116494233 A CN116494233 A CN 116494233A CN 202310473435 A CN202310473435 A CN 202310473435A CN 116494233 A CN116494233 A CN 116494233A
Authority
CN
China
Prior art keywords
source
entry
detectable
target
handling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310473435.7A
Other languages
English (en)
Chinese (zh)
Inventor
J·J·M·罗德古斯
叶旭涛
余锦泽
出杏光鲁仙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mu Jinkeji
Original Assignee
Mu Jinkeji
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mu Jinkeji filed Critical Mu Jinkeji
Publication of CN116494233A publication Critical patent/CN116494233A/zh
Pending legal-status Critical Current

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1694—Program controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1602—Program controls characterised by the control system, structure, architecture
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00—Manipulators not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1656—Program controls characterised by programming, planning systems for manipulators
    • B25J9/1661—Program controls characterised by programming, planning systems for manipulators characterised by task planning, object-oriented languages
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1656—Program controls characterised by programming, planning systems for manipulators
    • B25J9/1664—Program controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G1/00—Storing articles, individually or in orderly arrangement, in warehouses or magazines
    • B65G1/02—Storage devices
    • B65G1/04—Storage devices mechanical
    • B65G1/137—Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G47/00—Article or material-handling devices associated with conveyors; Methods employing such devices
    • B65G47/74—Feeding, transfer, or discharging devices of particular kinds or types
    • B65G47/90—Devices for picking-up and depositing articles or materials
    • B65G47/91—Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers
    • B65G47/915—Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers provided with drive systems with rotary movements only
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G47/00—Article or material-handling devices associated with conveyors; Methods employing such devices
    • B65G47/74—Feeding, transfer, or discharging devices of particular kinds or types
    • B65G47/90—Devices for picking-up and depositing articles or materials
    • B65G47/91—Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers
    • B65G47/917—Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers control arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/083—Shipping
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G2201/00—Indexing codes relating to handling devices, e.g. conveyors, characterised by the type of product or load being conveyed or handled
    • B65G2201/02—Articles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G57/00—Stacking of articles
    • B65G57/02—Stacking of articles by adding to the top of the stack
    • B65G57/03—Stacking of articles by adding to the top of the stack from above
    • B65G57/04—Stacking of articles by adding to the top of the stack from above by suction or magnetic devices
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G59/00—De-stacking of articles
    • B65G59/02—De-stacking from the top of the stack
    • B65G59/04—De-stacking from the top of the stack by suction or magnetic devices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/06—Recognition of objects for industrial automation

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Robotics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Economics (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Operations Research (AREA)
  • Automation & Control Theory (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Development Economics (AREA)
  • Quality & Reliability (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Manipulator (AREA)
  • Numerical Control (AREA)
CN202310473435.7A 2019-04-03 2019-07-24 具有物体识别和处理机制的机器人系统及其操作方法 Pending CN116494233A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/374,617 2019-04-03
US16/374,617 US10583560B1 (en) 2019-04-03 2019-04-03 Robotic system with object identification and handling mechanism and method of operation thereof
CN201910669156.1A CN110370279B (zh) 2019-04-03 2019-07-24 具有物体识别和处理机制的机器人系统及其操作方法

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201910669156.1A Division CN110370279B (zh) 2019-04-03 2019-07-24 具有物体识别和处理机制的机器人系统及其操作方法

Publications (1)

Publication Number Publication Date
CN116494233A true CN116494233A (zh) 2023-07-28

Family

ID=68255213

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202310473435.7A Pending CN116494233A (zh) 2019-04-03 2019-07-24 具有物体识别和处理机制的机器人系统及其操作方法
CN201910669156.1A Active CN110370279B (zh) 2019-04-03 2019-07-24 具有物体识别和处理机制的机器人系统及其操作方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201910669156.1A Active CN110370279B (zh) 2019-04-03 2019-07-24 具有物体识别和处理机制的机器人系统及其操作方法

Country Status (4)

Country Link
US (2) US10583560B1 (https=)
JP (3) JP6617237B1 (https=)
CN (2) CN116494233A (https=)
DE (1) DE102020104468A1 (https=)

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2973000C (en) * 2015-02-12 2020-03-10 Melonee Wise System and method using robots to assist humans in order fulfillment
US11200531B1 (en) * 2018-05-14 2021-12-14 Amazon Technologies, Inc. Self-identifying overpackage for robotic retrieval
US11045952B2 (en) * 2018-11-28 2021-06-29 BITO Robotics, Inc. System and method for autonomously loading cargo into vehicles
US11148289B1 (en) 2019-01-08 2021-10-19 Amazon Technologies, Inc. Entanglement end effector for autonomous object retrieval
EP3970927B1 (en) * 2019-05-13 2024-05-01 OMRON Corporation Suction pad and deformation measuring device
US11724880B2 (en) 2019-07-29 2023-08-15 Nimble Robotics, Inc. Storage systems and methods for robotic picking
US11738447B2 (en) 2019-07-29 2023-08-29 Nimble Robotics, Inc. Storage systems and methods for robotic picking
ES2978595T3 (es) * 2020-01-24 2024-09-16 Becton Dickinson Rowa Germany Gmbh Dispositivo y procedimiento para separar mercancías por piezas
US11040836B1 (en) 2020-01-24 2021-06-22 Becton Dickinson Rowa Germany Gmbh Device and method for separating piece goods
US11518573B2 (en) * 2020-02-14 2022-12-06 Dell Products L.P. Palletizing containers for charging electronic devices contained therein
US11577395B2 (en) * 2020-02-17 2023-02-14 Toyota Research Institute, Inc. Systems for determining location using robots with deformable sensors
CN113145477A (zh) * 2020-08-28 2021-07-23 武汉联州科技有限公司 一种基于大数据的辊筒输送线多重检测系统
CN112651347B (zh) * 2020-12-29 2022-07-05 嘉兴恒创电力集团有限公司博创物资分公司 一种基于双光谱成像的吸烟行为样本生成的方法与系统
DE102020135011B3 (de) 2020-12-29 2022-03-03 Franka Emika Gmbh Bilderkennung zum angepassten Ausführen eines Steuerprogramms eines Robotermanipulators
DE102020135010B4 (de) 2020-12-29 2024-05-08 Franka Emika Gmbh Massedaten-Schätzung einer externen Last für einen Robotermanipulator
EP4035845A1 (de) * 2021-01-28 2022-08-03 Siemens Aktiengesellschaft Handhaben von stückgütern mittels einer sauggreifvorrichtung
CN113307042B (zh) * 2021-06-11 2023-01-03 梅卡曼德（北京）机器人科技有限公司 基于传送带的物体拆垛方法、装置、计算设备及存储介质
US20230044420A1 (en) * 2021-08-09 2023-02-09 Mujin, Inc. Systems and methods for object detection
US11725924B2 (en) * 2021-08-10 2023-08-15 Palo Alto Research Center Incorporated Controlling mechanical systems based on natural language input
US12319521B2 (en) * 2021-08-10 2025-06-03 Mujin, Inc. System and method for robotic object placement
US12290933B2 (en) * 2021-08-19 2025-05-06 Electronics And Telecommunications Research Institute Method and apparatus for automatically recognizing location of object
CN114455335B (zh) * 2021-08-27 2024-06-07 西门子工业自动化产品(成都)有限公司 叠放箱体的分离装置和方法
JP7586037B2 (ja) * 2021-09-08 2024-11-19 株式会社ダイフク 荷卸し装置
JP7505463B2 (ja) * 2021-09-08 2024-06-25 株式会社ダイフク 荷卸し装置
US12221292B2 (en) 2021-12-22 2025-02-11 AMP Robotics Corporation Object path planning in a sorting facility
US12128567B2 (en) * 2021-12-22 2024-10-29 AMP Robotics Corporation Using machine learning to recognize variant objects
US12340287B2 (en) 2021-12-22 2025-06-24 AMP Robotics Corporation Maintaining a data structure corresponding to a target object
JP2023103799A (ja) * 2022-01-14 2023-07-27 パナソニックＩｐマネジメント株式会社 収納体配置装置
DE112023000857B4 (de) * 2022-02-08 2026-04-23 Kabushiki Kaisha Toshiba Handhabungssystem, handhabungsverfahren, programm, informationsverarbeitungsvorrichtung und datenstruktur
CN115187769B (zh) * 2022-07-11 2025-10-03 杭州海康机器人股份有限公司 一种定位方法及装置
JP7722310B2 (ja) * 2022-09-27 2025-08-13 株式会社ダイフク 荷卸し装置
CN115321090B (zh) * 2022-10-17 2023-01-13 中国民航大学 机场行李自动接取方法、装置、设备、系统及介质
CN115648224A (zh) * 2022-12-22 2023-01-31 北京钢铁侠科技有限公司 一种基于双深度相机识别定位的机械臂抓取方法
CN116142678A (zh) * 2022-12-22 2023-05-23 东莞盟大集团有限公司 自动化出入库方法、运货车及存储介质
CN117548359B (zh) * 2024-01-09 2024-03-19 北京环宇宏业科技开发有限公司 一种基于图像分析的节能环保分拣装置
CN118990477B (zh) * 2024-08-16 2025-11-04 华中科技大学无锡研究院 一种基于数字孪生的重载机械臂参数在线辨识方法
CN121340304A (zh) * 2025-12-17 2026-01-16 纳博特南京科技有限公司 基于稳定性风险评估的机器人抓取控制方法

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6070169A (en) * 1998-02-12 2000-05-30 International Business Machines Corporation Method and system for the determination of a particular data object utilizing attributes associated with the object
JP2006102881A (ja) * 2004-10-06 2006-04-20 Nagasaki Prefecture 把持ロボット装置
US7931197B2 (en) * 2005-09-20 2011-04-26 Rockwell Automation Technologies, Inc. RFID-based product manufacturing and lifecycle management
WO2008076942A1 (en) 2006-12-15 2008-06-26 Braintech Canada, Inc. System and method of identifying objects
US8280837B2 (en) * 2009-05-28 2012-10-02 GM Global Technology Operations LLC Contact state estimation for multi-finger robot hands using particle filters
US9233470B1 (en) 2013-03-15 2016-01-12 Industrial Perception, Inc. Determining a virtual representation of an environment by projecting texture patterns
JP5847117B2 (ja) 2013-05-28 2016-01-20 東芝テック株式会社 認識辞書作成装置及び認識辞書作成プログラム
US9427874B1 (en) 2014-08-25 2016-08-30 Google Inc. Methods and systems for providing landmarks to facilitate robot localization and visual odometry
US9492923B2 (en) * 2014-12-16 2016-11-15 Amazon Technologies, Inc. Generating robotic grasping instructions for inventory items
TWI607336B (zh) * 2015-07-08 2017-12-01 台灣色彩與影像科技股份有限公司 區域的監控方法
CN113635319B (zh) * 2015-09-11 2024-11-15 伯克希尔格雷营业股份有限公司 用于识别和处理各种物体的机器人系统和方法
JP6711591B2 (ja) * 2015-11-06 2020-06-17 キヤノン株式会社 ロボット制御装置およびロボット制御方法
US10350755B2 (en) 2016-02-08 2019-07-16 Berkshire Grey, Inc. Systems and methods for providing processing of a variety of objects employing motion planning
US10071856B2 (en) * 2016-07-28 2018-09-11 X Development Llc Inventory management
JP6692247B2 (ja) * 2016-08-04 2020-05-13 株式会社東芝 物品保持装置および物品保持方法
JP2018027581A (ja) * 2016-08-17 2018-02-22 株式会社安川電機 ピッキングシステム
JP6707485B2 (ja) 2017-03-22 2020-06-10 株式会社東芝 物体ハンドリング装置およびその較正方法
EP3600793A2 (en) * 2017-03-30 2020-02-05 Soft Robotics, Inc. Servo-pneumatic control systems for soft robotic actuators
CN108491799B (zh) * 2018-03-23 2022-04-01 海深科技（宁波）有限公司 一种基于图像识别的智能售货柜商品管理方法及系统

Also Published As

Publication number Publication date
JP2020168709A (ja) 2020-10-15
JP2020168710A (ja) 2020-10-15
US20200316774A1 (en) 2020-10-08
JP6621164B1 (ja) 2019-12-18
CN110370279B (zh) 2023-05-09
JP6617237B1 (ja) 2019-12-11
JP7290280B2 (ja) 2023-06-13
CN110370279A (zh) 2019-10-25
US10583560B1 (en) 2020-03-10
US10987807B2 (en) 2021-04-27
JP2020168711A (ja) 2020-10-15
DE102020104468A1 (de) 2020-10-08

Similar Documents

Publication Publication Date Title
CN110370279B (zh) 具有物体识别和处理机制的机器人系统及其操作方法
CN110329710B (zh) 具有机器人臂吸附控制机制的机器人系统及其操作方法
JP7617577B2 (ja) ピースロス管理メカニズムを有するロボットシステム
US12311551B2 (en) Controller and control method for robotic system
JP7598112B2 (ja) 協調移送機構を有するロボットシステム
JP2021045811A (ja) ハンドリング装置、ハンドリング方法及びプログラム
CN115703232A (zh) 具有基于图像的尺寸确定机制的机器人系统及其操作方法
CN111618852B (zh) 具有协调转移机构的机器人系统
CN115609569A (zh) 具有基于图像的尺寸确定机制的机器人系统及其操作方法
WO2025084345A1 (ja) グリッパアッセンブリ、ロボットシステム及びその操作方法
JP2025069054A (ja) グリッパアッセンブリ、ロボットシステム及びその操作方法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination