CN116494233A - 具有物体识别和处理机制的机器人系统及其操作方法 - Google Patents

具有物体识别和处理机制的机器人系统及其操作方法 Download PDF

Info

Publication number
CN116494233A
CN116494233A CN202310473435.7A CN202310473435A CN116494233A CN 116494233 A CN116494233 A CN 116494233A CN 202310473435 A CN202310473435 A CN 202310473435A CN 116494233 A CN116494233 A CN 116494233A
Authority
CN
China
Prior art keywords
source
entry
detectable
target
handling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310473435.7A
Other languages
English (en)
Chinese (zh)
Inventor
J·J·M·罗德古斯
叶旭涛
余锦泽
出杏光鲁仙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mu Jinkeji
Original Assignee
Mu Jinkeji
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mu Jinkeji filed Critical Mu Jinkeji
Publication of CN116494233A publication Critical patent/CN116494233A/zh
Pending legal-status Critical Current

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1694—Program controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1602—Program controls characterised by the control system, structure, architecture
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00—Manipulators not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1656—Program controls characterised by programming, planning systems for manipulators
    • B25J9/1661—Program controls characterised by programming, planning systems for manipulators characterised by task planning, object-oriented languages
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1656—Program controls characterised by programming, planning systems for manipulators
    • B25J9/1664—Program controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G1/00—Storing articles, individually or in orderly arrangement, in warehouses or magazines
    • B65G1/02—Storage devices
    • B65G1/04—Storage devices mechanical
    • B65G1/137—Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G47/00—Article or material-handling devices associated with conveyors; Methods employing such devices
    • B65G47/74—Feeding, transfer, or discharging devices of particular kinds or types
    • B65G47/90—Devices for picking-up and depositing articles or materials
    • B65G47/91—Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers
    • B65G47/915—Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers provided with drive systems with rotary movements only
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G47/00—Article or material-handling devices associated with conveyors; Methods employing such devices
    • B65G47/74—Feeding, transfer, or discharging devices of particular kinds or types
    • B65G47/90—Devices for picking-up and depositing articles or materials
    • B65G47/91—Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers
    • B65G47/917—Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers control arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/083—Shipping
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G2201/00—Indexing codes relating to handling devices, e.g. conveyors, characterised by the type of product or load being conveyed or handled
    • B65G2201/02—Articles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G57/00—Stacking of articles
    • B65G57/02—Stacking of articles by adding to the top of the stack
    • B65G57/03—Stacking of articles by adding to the top of the stack from above
    • B65G57/04—Stacking of articles by adding to the top of the stack from above by suction or magnetic devices
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G59/00—De-stacking of articles
    • B65G59/02—De-stacking from the top of the stack
    • B65G59/04—De-stacking from the top of the stack by suction or magnetic devices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/06—Recognition of objects for industrial automation

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Robotics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Economics (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Operations Research (AREA)
  • Automation & Control Theory (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Development Economics (AREA)
  • Quality & Reliability (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Manipulator (AREA)
  • Numerical Control (AREA)
CN202310473435.7A 2019-04-03 2019-07-24 具有物体识别和处理机制的机器人系统及其操作方法 Pending CN116494233A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/374,617 US10583560B1 (en) 2019-04-03 2019-04-03 Robotic system with object identification and handling mechanism and method of operation thereof
US16/374,617 2019-04-03
CN201910669156.1A CN110370279B (zh) 2019-04-03 2019-07-24 具有物体识别和处理机制的机器人系统及其操作方法

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201910669156.1A Division CN110370279B (zh) 2019-04-03 2019-07-24 具有物体识别和处理机制的机器人系统及其操作方法

Publications (1)

Publication Number Publication Date
CN116494233A true CN116494233A (zh) 2023-07-28

Family

ID=68255213

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202310473435.7A Pending CN116494233A (zh) 2019-04-03 2019-07-24 具有物体识别和处理机制的机器人系统及其操作方法
CN201910669156.1A Active CN110370279B (zh) 2019-04-03 2019-07-24 具有物体识别和处理机制的机器人系统及其操作方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201910669156.1A Active CN110370279B (zh) 2019-04-03 2019-07-24 具有物体识别和处理机制的机器人系统及其操作方法

Country Status (4)

Country Link
US (2) US10583560B1 (https=)
JP (3) JP6617237B1 (https=)
CN (2) CN116494233A (https=)
DE (1) DE102020104468A1 (https=)

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6585177B2 (ja) * 2015-02-12 2019-10-02 ワイズ，メロニー ロボットを用いた注文実行のためのシステム及び方法
US11200531B1 (en) * 2018-05-14 2021-12-14 Amazon Technologies, Inc. Self-identifying overpackage for robotic retrieval
US11045952B2 (en) * 2018-11-28 2021-06-29 BITO Robotics, Inc. System and method for autonomously loading cargo into vehicles
US11148289B1 (en) 2019-01-08 2021-10-19 Amazon Technologies, Inc. Entanglement end effector for autonomous object retrieval
CN113692335B (zh) * 2019-05-13 2024-07-30 欧姆龙株式会社 吸附垫及变形测量装置
US11738447B2 (en) * 2019-07-29 2023-08-29 Nimble Robotics, Inc. Storage systems and methods for robotic picking
US11724880B2 (en) 2019-07-29 2023-08-15 Nimble Robotics, Inc. Storage systems and methods for robotic picking
EP3854731B1 (de) * 2020-01-24 2024-03-20 Becton Dickinson Rowa Germany GmbH Vorrichtung und verfahren zum vereinzeln von stückgütern
US11040836B1 (en) 2020-01-24 2021-06-22 Becton Dickinson Rowa Germany Gmbh Device and method for separating piece goods
US11518573B2 (en) * 2020-02-14 2022-12-06 Dell Products L.P. Palletizing containers for charging electronic devices contained therein
US11577395B2 (en) * 2020-02-17 2023-02-14 Toyota Research Institute, Inc. Systems for determining location using robots with deformable sensors
CN113145477A (zh) * 2020-08-28 2021-07-23 武汉联州科技有限公司 一种基于大数据的辊筒输送线多重检测系统
DE102020135010B4 (de) 2020-12-29 2024-05-08 Franka Emika Gmbh Massedaten-Schätzung einer externen Last für einen Robotermanipulator
DE102020135011B3 (de) 2020-12-29 2022-03-03 Franka Emika Gmbh Bilderkennung zum angepassten Ausführen eines Steuerprogramms eines Robotermanipulators
CN112651347B (zh) * 2020-12-29 2022-07-05 嘉兴恒创电力集团有限公司博创物资分公司 一种基于双光谱成像的吸烟行为样本生成的方法与系统
EP4035845A1 (de) * 2021-01-28 2022-08-03 Siemens Aktiengesellschaft Handhaben von stückgütern mittels einer sauggreifvorrichtung
CN113307042B (zh) * 2021-06-11 2023-01-03 梅卡曼德（北京）机器人科技有限公司 基于传送带的物体拆垛方法、装置、计算设备及存储介质
CN116168387A (zh) * 2021-08-09 2023-05-26 牧今科技 用于物体检测的系统和方法
JP7241374B2 (ja) * 2021-08-10 2023-03-17 株式会社Mujin ロボットによるオブジェクト配置のシステム及び方法
US12366440B2 (en) * 2021-08-10 2025-07-22 Xerox Corporation Interacting with machines using natural language input and an enhanced state graph
US12290933B2 (en) * 2021-08-19 2025-05-06 Electronics And Telecommunications Research Institute Method and apparatus for automatically recognizing location of object
CN114455335B (zh) * 2021-08-27 2024-06-07 西门子工业自动化产品(成都)有限公司 叠放箱体的分离装置和方法
JP7505463B2 (ja) * 2021-09-08 2024-06-25 株式会社ダイフク 荷卸し装置
JP7586037B2 (ja) * 2021-09-08 2024-11-19 株式会社ダイフク 荷卸し装置
US12221292B2 (en) 2021-12-22 2025-02-11 AMP Robotics Corporation Object path planning in a sorting facility
US12128567B2 (en) * 2021-12-22 2024-10-29 AMP Robotics Corporation Using machine learning to recognize variant objects
US12340287B2 (en) 2021-12-22 2025-06-24 AMP Robotics Corporation Maintaining a data structure corresponding to a target object
JP2023103799A (ja) * 2022-01-14 2023-07-27 パナソニックＩｐマネジメント株式会社 収納体配置装置
JP7840998B2 (ja) * 2022-02-08 2026-04-06 株式会社東芝 ハンドリングシステム、ハンドリング方法、プログラム、情報処理装置、及びデータ構造
CN115187769B (zh) * 2022-07-11 2025-10-03 杭州海康机器人股份有限公司 一种定位方法及装置
JP7722310B2 (ja) * 2022-09-27 2025-08-13 株式会社ダイフク 荷卸し装置
CN115321090B (zh) * 2022-10-17 2023-01-13 中国民航大学 机场行李自动接取方法、装置、设备、系统及介质
CN116142678A (zh) * 2022-12-22 2023-05-23 东莞盟大集团有限公司 自动化出入库方法、运货车及存储介质
CN115648224A (zh) * 2022-12-22 2023-01-31 北京钢铁侠科技有限公司 一种基于双深度相机识别定位的机械臂抓取方法
CN117548359B (zh) * 2024-01-09 2024-03-19 北京环宇宏业科技开发有限公司 一种基于图像分析的节能环保分拣装置
CN118990477B (zh) * 2024-08-16 2025-11-04 华中科技大学无锡研究院 一种基于数字孪生的重载机械臂参数在线辨识方法
CN121340304A (zh) * 2025-12-17 2026-01-16 纳博特南京科技有限公司 基于稳定性风险评估的机器人抓取控制方法

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6070169A (en) * 1998-02-12 2000-05-30 International Business Machines Corporation Method and system for the determination of a particular data object utilizing attributes associated with the object
JP2006102881A (ja) * 2004-10-06 2006-04-20 Nagasaki Prefecture 把持ロボット装置
US7931197B2 (en) * 2005-09-20 2011-04-26 Rockwell Automation Technologies, Inc. RFID-based product manufacturing and lifecycle management
WO2008076942A1 (en) 2006-12-15 2008-06-26 Braintech Canada, Inc. System and method of identifying objects
US8280837B2 (en) * 2009-05-28 2012-10-02 GM Global Technology Operations LLC Contact state estimation for multi-finger robot hands using particle filters
US9233470B1 (en) 2013-03-15 2016-01-12 Industrial Perception, Inc. Determining a virtual representation of an environment by projecting texture patterns
JP5847117B2 (ja) 2013-05-28 2016-01-20 東芝テック株式会社 認識辞書作成装置及び認識辞書作成プログラム
US9427874B1 (en) 2014-08-25 2016-08-30 Google Inc. Methods and systems for providing landmarks to facilitate robot localization and visual odometry
US9561587B2 (en) * 2014-12-16 2017-02-07 Amazon Technologies, Inc. Robotic grasping of items in inventory system
TWI607336B (zh) * 2015-07-08 2017-12-01 台灣色彩與影像科技股份有限公司 區域的監控方法
EP4235539A3 (en) * 2015-09-11 2023-09-27 Berkshire Grey Operating Company, Inc. Robotic systems and methods for identifying and processing a variety of objects
JP6711591B2 (ja) * 2015-11-06 2020-06-17 キヤノン株式会社 ロボット制御装置およびロボット制御方法
CN108778636B (zh) 2016-02-08 2021-11-19 伯克希尔格雷股份有限公司 用于提供使用运动规划的各种物体的处理的系统和方法
US10071856B2 (en) * 2016-07-28 2018-09-11 X Development Llc Inventory management
JP6692247B2 (ja) * 2016-08-04 2020-05-13 株式会社東芝 物品保持装置および物品保持方法
JP2018027581A (ja) * 2016-08-17 2018-02-22 株式会社安川電機 ピッキングシステム
JP6707485B2 (ja) 2017-03-22 2020-06-10 株式会社東芝 物体ハンドリング装置およびその較正方法
JP7244925B2 (ja) * 2017-03-30 2023-03-23 ソフト ロボティクス， インコーポレイテッド ソフトロボットアクチュエータのためのサーボ空気圧制御システム
CN108491799B (zh) * 2018-03-23 2022-04-01 海深科技（宁波）有限公司 一种基于图像识别的智能售货柜商品管理方法及系统

Also Published As

Publication number Publication date
JP7290280B2 (ja) 2023-06-13
JP2020168709A (ja) 2020-10-15
JP2020168710A (ja) 2020-10-15
DE102020104468A1 (de) 2020-10-08
US10583560B1 (en) 2020-03-10
JP6617237B1 (ja) 2019-12-11
JP2020168711A (ja) 2020-10-15
CN110370279B (zh) 2023-05-09
US10987807B2 (en) 2021-04-27
CN110370279A (zh) 2019-10-25
JP6621164B1 (ja) 2019-12-18
US20200316774A1 (en) 2020-10-08

Similar Documents

Publication Publication Date Title
CN110370279B (zh) 具有物体识别和处理机制的机器人系统及其操作方法
CN110329710B (zh) 具有机器人臂吸附控制机制的机器人系统及其操作方法
JP7617577B2 (ja) ピースロス管理メカニズムを有するロボットシステム
US12311551B2 (en) Controller and control method for robotic system
JP7598112B2 (ja) 協調移送機構を有するロボットシステム
JP2021045811A (ja) ハンドリング装置、ハンドリング方法及びプログラム
CN115703232A (zh) 具有基于图像的尺寸确定机制的机器人系统及其操作方法
CN111618852B (zh) 具有协调转移机构的机器人系统
CN115609569A (zh) 具有基于图像的尺寸确定机制的机器人系统及其操作方法
WO2025084345A1 (ja) グリッパアッセンブリ、ロボットシステム及びその操作方法
JP2025069054A (ja) グリッパアッセンブリ、ロボットシステム及びその操作方法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination