CN116638509A - 具有重叠处理机制的机器人系统及其操作方法 - Google Patents

具有重叠处理机制的机器人系统及其操作方法 Download PDF

Info

Publication number
CN116638509A
CN116638509A CN202310549157.9A CN202310549157A CN116638509A CN 116638509 A CN116638509 A CN 116638509A CN 202310549157 A CN202310549157 A CN 202310549157A CN 116638509 A CN116638509 A CN 116638509A
Authority
CN
China
Prior art keywords
detection
occlusion
detection result
information
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310549157.9A
Other languages
English (en)
Chinese (zh)
Inventor
金本良树
艾哈迈德·阿布勒拉
余锦泽
何塞·赫罗尼莫·莫雷拉·罗德里格斯
鲁仙·出杏光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mu Jinkeji
Original Assignee
Mu Jinkeji
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mu Jinkeji filed Critical Mu Jinkeji
Publication of CN116638509A publication Critical patent/CN116638509A/zh
Pending legal-status Critical Current

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1679—Program controls characterised by the tasks executed
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1694—Program controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1656—Program controls characterised by programming, planning systems for manipulators
    • B25J9/1664—Program controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G1/00—Storing articles, individually or in orderly arrangement, in warehouses or magazines
    • B65G1/02—Storage devices
    • B65G1/04—Storage devices mechanical
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G37/00—Combinations of mechanical conveyors of the same kind, or of different kinds, of interest apart from their application in particular machines or use in particular manufacturing processes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G43/00—Control devices, e.g. for safety, warning or fault-correcting
    • B65G43/10—Sequence control of conveyors operating in combination
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G47/00—Article or material-handling devices associated with conveyors; Methods employing such devices
    • B65G47/74—Feeding, transfer, or discharging devices of particular kinds or types
    • B65G47/90—Devices for picking-up and depositing articles or materials
    • B65G47/91—Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G67/00—Loading or unloading vehicles
    • B65G67/02—Loading or unloading land vehicles
    • B65G67/24—Unloading land vehicles
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/0014—Image feed-back for automatic industrial control, e.g. robot with camera
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/54—Extraction of image or video features relating to texture
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/757—Matching configurations of points or features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G2203/00—Indexing code relating to control or detection of the articles or the load carriers during conveying
    • B65G2203/02—Control or detection
    • B65G2203/0208—Control or detection relating to the transported articles
    • B65G2203/0233—Position of the article
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/39—Robotics, robotics to robotics hand
    • G05B2219/39469—Grip flexible, deformable plate, object and manipulate it
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07—Target detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Robotics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Manipulator (AREA)
  • Image Analysis (AREA)
  • De-Stacking Of Articles (AREA)
CN202310549157.9A 2021-09-01 2022-09-01 具有重叠处理机制的机器人系统及其操作方法 Pending CN116638509A (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US202163239795P 2021-09-01 2021-09-01
US63/239,795 2021-09-01
PCT/US2022/042387 WO2023034533A1 (en) 2021-09-01 2022-09-01 Robotic system with overlap processing mechanism and methods for operating the same
CN202280004989.6A CN116194256A (zh) 2021-09-01 2022-09-01 具有重叠处理机制的机器人系统及其操作方法

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN202280004989.6A Division CN116194256A (zh) 2021-09-01 2022-09-01 具有重叠处理机制的机器人系统及其操作方法

Publications (1)

Publication Number Publication Date
CN116638509A true CN116638509A (zh) 2023-08-25

Family

ID=85386627

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202310549157.9A Pending CN116638509A (zh) 2021-09-01 2022-09-01 具有重叠处理机制的机器人系统及其操作方法
CN202280004989.6A Pending CN116194256A (zh) 2021-09-01 2022-09-01 具有重叠处理机制的机器人系统及其操作方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202280004989.6A Pending CN116194256A (zh) 2021-09-01 2022-09-01 具有重叠处理机制的机器人系统及其操作方法

Country Status (5)

Country Link
US (1) US20230071488A1 (cg-RX-API-DMAC7.html)
EP (1) EP4395965A4 (cg-RX-API-DMAC7.html)
JP (2) JP7398763B2 (cg-RX-API-DMAC7.html)
CN (2) CN116638509A (cg-RX-API-DMAC7.html)
WO (1) WO2023034533A1 (cg-RX-API-DMAC7.html)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE112023000857B4 (de) * 2022-02-08 2026-04-23 Kabushiki Kaisha Toshiba Handhabungssystem, handhabungsverfahren, programm, informationsverarbeitungsvorrichtung und datenstruktur
US12515332B2 (en) * 2022-02-09 2026-01-06 eBots Inc. System and method for sequencing assembly tasks
JP2024155438A (ja) * 2023-04-21 2024-10-31 株式会社日立製作所 物体認識装置、物体認識方法、および、搬送ロボットシステム
US20240371127A1 (en) * 2023-05-07 2024-11-07 Plus One Robotics, Inc. Machine vision systems and methods for robotic picking and other environments
DE112024001966T5 (de) * 2023-06-15 2026-02-26 Kabushiki Kaisha Yaskawa Denki Robotersteuerungssystem, Robotersteuerungsverfahren und Robotersteuerungsprogramm
CN116654636B (zh) * 2023-06-21 2026-02-13 上海交通大学 一种基于力传感器感知与补偿的不规则物体堆叠方法
US12661803B2 (en) * 2023-07-03 2026-06-23 Mitsubishi Electric Research Laboratories, Inc. System and method for controlling operation of robotic manipulator with soft robotic touch
CH722492A1 (fr) * 2025-01-13 2026-07-31 Richemont Int Sa Procédé de manipulation automatique de composants d'horlogerie et de joaillerie
CN119858168B (zh) * 2025-03-24 2025-06-27 长春慧程科技有限公司 一种基于工业互联网的汽车生产线安全监控系统
CN120646439B (zh) * 2025-07-29 2026-06-12 美蓝(杭州)医药科技有限公司 液袋抓取控制方法、装置、电子设备及存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1862270A2 (en) * 2006-05-29 2007-12-05 Fanuc Ltd Workpiece picking device and method
WO2012089928A1 (en) * 2010-12-30 2012-07-05 Zenrobotics Oy Method, computer program and apparatus for determining a gripping location
US20150224650A1 (en) * 2014-02-12 2015-08-13 General Electric Company Vision-guided electromagnetic robotic system
CN109643448A (zh) * 2017-03-03 2019-04-16 华为技术有限公司 机器人系统中的细粒度物体识别
JP2019081208A (ja) * 2017-10-30 2019-05-30 株式会社東芝 情報処理装置及びロボットアーム制御システム
US20210260766A1 (en) * 2020-02-26 2021-08-26 Grey Orange Pte. Ltd. Method and system for handling deformable objects
US20220016767A1 (en) * 2020-07-14 2022-01-20 Vicarious Fpc, Inc. Method and system for object grasping

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101142593B (zh) * 2005-03-17 2010-12-15 英国电讯有限公司 跟踪视频序列中的目标的方法
JP6000029B2 (ja) * 2012-09-10 2016-09-28 株式会社アプライド・ビジョン・システムズ ハンドリングシステム、ハンドリング方法及びプログラム
US9904852B2 (en) * 2013-05-23 2018-02-27 Sri International Real-time object detection, tracking and occlusion reasoning
ES2929729T3 (es) * 2015-11-13 2022-12-01 Berkshire Grey Operating Company Inc Sistemas de clasificación para proporcionar clasificación de una variedad de objetos
CN108319953B (zh) * 2017-07-27 2019-07-16 腾讯科技(深圳)有限公司 目标对象的遮挡检测方法及装置、电子设备及存储介质
US11724401B2 (en) * 2019-11-13 2023-08-15 Nvidia Corporation Grasp determination for an object in clutter
US11559885B2 (en) * 2020-07-14 2023-01-24 Intrinsic Innovation Llc Method and system for grasping an object
US11541534B2 (en) * 2020-07-14 2023-01-03 Intrinsic Innovation Llc Method and system for object grasping
US11911919B2 (en) * 2021-03-05 2024-02-27 Mujin, Inc. Method and computing system for performing grip region detection

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1862270A2 (en) * 2006-05-29 2007-12-05 Fanuc Ltd Workpiece picking device and method
WO2012089928A1 (en) * 2010-12-30 2012-07-05 Zenrobotics Oy Method, computer program and apparatus for determining a gripping location
US20150224650A1 (en) * 2014-02-12 2015-08-13 General Electric Company Vision-guided electromagnetic robotic system
CN109643448A (zh) * 2017-03-03 2019-04-16 华为技术有限公司 机器人系统中的细粒度物体识别
JP2019081208A (ja) * 2017-10-30 2019-05-30 株式会社東芝 情報処理装置及びロボットアーム制御システム
US20210260766A1 (en) * 2020-02-26 2021-08-26 Grey Orange Pte. Ltd. Method and system for handling deformable objects
US20220016767A1 (en) * 2020-07-14 2022-01-20 Vicarious Fpc, Inc. Method and system for object grasping

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ANDREAS SARDELIS: "2-Stage vision system for robotic handling of flexible objects", 《PROCEDIA CIRP》, 11 February 2021 (2021-02-11) *

Also Published As

Publication number Publication date
JP2024020532A (ja) 2024-02-14
US20230071488A1 (en) 2023-03-09
JP7398763B2 (ja) 2023-12-15
CN116194256A (zh) 2023-05-30
WO2023034533A1 (en) 2023-03-09
JP2023539403A (ja) 2023-09-14
EP4395965A1 (en) 2024-07-10
EP4395965A4 (en) 2025-07-30

Similar Documents

Publication Publication Date Title
JP7398763B2 (ja) 重なり処理機構を備えたロボットシステム及びその操作方法
JP7352260B2 (ja) 自動物体検出機構を備えたロボットシステム、および、その動作方法
JP7349094B2 (ja) ピースロス管理メカニズムを有するロボットシステム
US10933527B2 (en) Robotic system with enhanced scanning mechanism
JP7398662B2 (ja) ロボット多面グリッパアセンブリ及びその操作方法
JP7175487B1 (ja) 画像ベースのサイジングメカニズムを備えたロボットシステム及びロボットシステムを操作するための方法
JP7126667B1 (ja) 深さベースの処理メカニズムを伴うロボットシステム及びロボットシステムを操作するための方法
CN115946107A (zh) 用于可打开对象的机器人抓持器总成和拾取对象的方法
JP7218881B1 (ja) 物体更新機構を備えたロボットシステム及びロボットシステムを操作するための方法
CN115609569A (zh) 具有基于图像的尺寸确定机制的机器人系统及其操作方法
CN115570556B (zh) 具有基于深度的处理机制的机器人系统及其操作方法
CN115258510A (zh) 具有物体更新机制的机器人系统和用于操作所述机器人系统的方法
WO2022264381A1 (ja) ワーク取出し個数算出装置、ハンドシステム、及び表示装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination