JP2019518297A - ロボット支援型物体学習視覚システム - Google Patents

ロボット支援型物体学習視覚システム Download PDF

Info

Publication number
JP2019518297A
JP2019518297A JP2019513505A JP2019513505A JP2019518297A JP 2019518297 A JP2019518297 A JP 2019518297A JP 2019513505 A JP2019513505 A JP 2019513505A JP 2019513505 A JP2019513505 A JP 2019513505A JP 2019518297 A JP2019518297 A JP 2019518297A
Authority
JP
Japan
Prior art keywords
image
channel value
contour
features
pixels
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2019513505A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019518297A5 (https=
Inventor
カルロス ベナイム
カルロス ベナイム
トソフナット バーシェシェット
トソフナット バーシェシェット
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Deep Learning Robotics Ltd
Original Assignee
Deep Learning Robotics Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Deep Learning Robotics Ltd filed Critical Deep Learning Robotics Ltd
Publication of JP2019518297A publication Critical patent/JP2019518297A/ja
Publication of JP2019518297A5 publication Critical patent/JP2019518297A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1694—Program controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1628—Program controls characterised by the control loop
    • B25J9/163—Program controls characterised by the control loop learning, adaptive, model based, rule based expert control
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/0014—Image feed-back for automatic industrial control, e.g. robot with camera
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40565—Detect features of object, not position or orientation

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)
  • Manipulator (AREA)
JP2019513505A 2016-05-19 2017-05-18 ロボット支援型物体学習視覚システム Pending JP2019518297A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662338558P 2016-05-19 2016-05-19
US62/338,558 2016-05-19
PCT/IL2017/050564 WO2017199261A1 (en) 2016-05-19 2017-05-18 Robot assisted object learning vision system

Publications (2)

Publication Number Publication Date
JP2019518297A true JP2019518297A (ja) 2019-06-27
JP2019518297A5 JP2019518297A5 (https=) 2020-06-25

Family

ID=60324862

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019513505A Pending JP2019518297A (ja) 2016-05-19 2017-05-18 ロボット支援型物体学習視覚システム

Country Status (4)

Country Link
US (1) US10974394B2 (https=)
EP (1) EP3458919B1 (https=)
JP (1) JP2019518297A (https=)
WO (1) WO2017199261A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023055217A (ja) * 2021-10-05 2023-04-17 ローベルト ボツシユ ゲゼルシヤフト ミツト ベシユレンクテル ハフツング ロボットを制御するための装置及び方法

Families Citing this family (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10179407B2 (en) * 2014-11-16 2019-01-15 Robologics Ltd. Dynamic multi-sensor and multi-robot interface system
US10974394B2 (en) 2016-05-19 2021-04-13 Deep Learning Robotics Ltd. Robot assisted object learning vision system
US12103170B2 (en) 2017-01-13 2024-10-01 Clara Vu Dynamic, interactive signaling of safety-related conditions in a monitored environment
US11518051B2 (en) 2017-02-07 2022-12-06 Veo Robotics, Inc. Dynamic, interactive signaling of safety-related conditions in a monitored environment
US11820025B2 (en) 2017-02-07 2023-11-21 Veo Robotics, Inc. Safe motion planning for machinery operation
US11541543B2 (en) 2017-02-07 2023-01-03 Veo Robotics, Inc. Dynamic, interactive signaling of safety-related conditions in a monitored environment
EP4088891A1 (en) 2017-02-07 2022-11-16 Veo Robotics, Inc. Workspace safety monitoring and equipment control
JP2018169660A (ja) * 2017-03-29 2018-11-01 セイコーエプソン株式会社 オブジェクト姿勢検出装置、制御装置、ロボットおよびロボットシステム
JP6795471B2 (ja) * 2017-08-25 2020-12-02 ファナック株式会社 ロボットシステム
DE102017219407A1 (de) * 2017-10-27 2019-05-02 Robert Bosch Gmbh Erfassungsvorrichtung
JP2019084609A (ja) * 2017-11-06 2019-06-06 セイコーエプソン株式会社 ロボット制御装置、ロボットおよびロボットシステム
US10572775B2 (en) 2017-12-05 2020-02-25 X Development Llc Learning and applying empirical knowledge of environments by robots
US12097625B2 (en) 2018-02-06 2024-09-24 Veo Robotics, Inc. Robot end-effector sensing and identification
US12049014B2 (en) 2018-02-06 2024-07-30 Veo Robotics, Inc. Workplace monitoring and semantic entity identification for safe machine operation
WO2019153245A1 (en) * 2018-02-09 2019-08-15 Baidu.Com Times Technology (Beijing) Co., Ltd. Systems and methods for deep localization and segmentation with 3d semantic map
US20190314995A1 (en) * 2018-04-12 2019-10-17 Aeolus Robotics Corporation Limited Robot and method for controlling the same
US11865730B2 (en) * 2018-06-05 2024-01-09 Hitachi, Ltd. Camera position/attitude calibration device, camera position/attitude calibration method, and robot
CN108772824A (zh) * 2018-06-06 2018-11-09 深圳市恒晨电器有限公司 一种螺丝机械手示教对位方法
US11292133B2 (en) * 2018-09-28 2022-04-05 Intel Corporation Methods and apparatus to train interdependent autonomous machines
US11312012B2 (en) * 2019-01-01 2022-04-26 Giant Ai, Inc. Software compensated robotics
US11185978B2 (en) * 2019-01-08 2021-11-30 Honda Motor Co., Ltd. Depth perception modeling for grasping objects
US10977480B2 (en) * 2019-03-27 2021-04-13 Mitsubishi Electric Research Laboratories, Inc. Detection, tracking and 3D modeling of objects with sparse RGB-D SLAM and interactive perception
JP7260402B2 (ja) * 2019-05-31 2023-04-18 ファナック株式会社 ケーブルの状態を学習する機械学習装置、ロボットシステム、及び機械学習方法
US11037329B2 (en) * 2019-06-03 2021-06-15 Google Llc Encoding positional coordinates based on multiple channel color values
US12288390B2 (en) 2019-08-12 2025-04-29 Qc Hero, Inc. System and method of object detection using AI deep learning models
US11839986B2 (en) * 2019-10-25 2023-12-12 Ocado Innovation Limited Systems and methods for active perception and coordination between robotic vision systems and manipulators
CN111145257B (zh) * 2019-12-27 2024-01-05 深圳市越疆科技有限公司 物品抓取方法、系统及物品抓取机器人
DE102020115628A1 (de) * 2020-06-12 2021-12-16 Schunk Gmbh & Co. Kg Spann- Und Greiftechnik Sensoreinrichtung für ein Greifsystem, Verfahren zur Erzeugung von optimalen Greifposen zur Ansteuerung einer Greifvorrichtung und zugehöriges Greifsystem
US11937019B2 (en) 2021-06-07 2024-03-19 Elementary Robotics, Inc. Intelligent quality assurance and inspection device having multiple camera modules
JP7492440B2 (ja) * 2020-11-10 2024-05-29 株式会社日立製作所 ロボット制御システム、ロボット制御方法及びプログラム
CN116802021A (zh) * 2021-01-29 2023-09-22 波士顿动力公司 基于对象的机器人控制
US11875528B2 (en) * 2021-05-25 2024-01-16 Fanuc Corporation Object bin picking with rotation compensation
US11605159B1 (en) 2021-11-03 2023-03-14 Elementary Robotics, Inc. Computationally efficient quality assurance inspection processes using machine learning
US12051186B2 (en) * 2021-11-03 2024-07-30 Elementary Robotics, Inc. Automatic object detection and changeover for quality assurance inspection
US12050454B2 (en) 2021-11-10 2024-07-30 Elementary Robotics, Inc. Cloud-based multi-camera quality assurance lifecycle architecture
US11675345B2 (en) 2021-11-10 2023-06-13 Elementary Robotics, Inc. Cloud-based multi-camera quality assurance architecture
CN114228950A (zh) * 2021-11-26 2022-03-25 江苏科技大学 一种基于OpenCV与深度学习的水面物体打捞方法及打捞船
US11605216B1 (en) 2022-02-10 2023-03-14 Elementary Robotics, Inc. Intelligent automated image clustering for quality assurance
WO2023168366A2 (en) 2022-03-03 2023-09-07 Siemens Healthcare Diagnostics Inc. Diagnostic laboratory systems and methods of imaging tube assemblies
CN114972560B (zh) * 2022-05-11 2024-08-13 北京市真我本色科技有限公司 一种图像绘制方法、系统、电子设备及介质
CN115256399B (zh) * 2022-08-26 2025-05-13 上海工程技术大学 一种用于移动机械臂的低自由度目标搜寻及到达控制方法
KR20240031731A (ko) 2022-09-01 2024-03-08 삼성전자주식회사 천장 저장 시스템 및 그 제어 방법
CN116512267A (zh) * 2023-05-19 2023-08-01 顾宁权 一种基于深度学习的双臂智能装袋机器人及实施方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06106490A (ja) * 1992-09-29 1994-04-19 Fujitsu Ltd 制御装置
US20090033655A1 (en) * 2007-08-02 2009-02-05 Boca Remus F System and method of three-dimensional pose estimation
US20100021051A1 (en) * 2008-07-22 2010-01-28 Recognition Robotics, Inc. Automated Guidance and Recognition System and Method of the Same
JP2012524663A (ja) * 2009-04-23 2012-10-18 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 物体学習ロボットおよび方法
JP2015145050A (ja) * 2014-02-04 2015-08-13 セイコーエプソン株式会社 ロボットシステム、ロボット制御装置、ロボット制御方法およびロボット制御プログラム
JP2016040650A (ja) * 2014-08-12 2016-03-24 株式会社Ｓｃｒｅｅｎホールディングス 分類器構築方法、画像分類方法および画像分類装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9124873B2 (en) * 2010-12-08 2015-09-01 Cognex Corporation System and method for finding correspondence between cameras in a three-dimensional vision system
US9295375B2 (en) * 2012-09-27 2016-03-29 Hrayr Karnig Shahinian Programmable spectral source and design tool for 3D imaging using complementary bandpass filters
US8958912B2 (en) 2012-06-21 2015-02-17 Rethink Robotics, Inc. Training and operating industrial robots
US9492923B2 (en) * 2014-12-16 2016-11-15 Amazon Technologies, Inc. Generating robotic grasping instructions for inventory items
US10974394B2 (en) 2016-05-19 2021-04-13 Deep Learning Robotics Ltd. Robot assisted object learning vision system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06106490A (ja) * 1992-09-29 1994-04-19 Fujitsu Ltd 制御装置
US20090033655A1 (en) * 2007-08-02 2009-02-05 Boca Remus F System and method of three-dimensional pose estimation
US20100021051A1 (en) * 2008-07-22 2010-01-28 Recognition Robotics, Inc. Automated Guidance and Recognition System and Method of the Same
JP2012524663A (ja) * 2009-04-23 2012-10-18 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 物体学習ロボットおよび方法
JP2015145050A (ja) * 2014-02-04 2015-08-13 セイコーエプソン株式会社 ロボットシステム、ロボット制御装置、ロボット制御方法およびロボット制御プログラム
JP2016040650A (ja) * 2014-08-12 2016-03-24 株式会社Ｓｃｒｅｅｎホールディングス 分類器構築方法、画像分類方法および画像分類装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023055217A (ja) * 2021-10-05 2023-04-17 ローベルト ボツシユ ゲゼルシヤフト ミツト ベシユレンクテル ハフツング ロボットを制御するための装置及び方法

Also Published As

Publication number Publication date
WO2017199261A1 (en) 2017-11-23
EP3458919B1 (en) 2022-08-24
EP3458919A4 (en) 2020-01-22
US10974394B2 (en) 2021-04-13
EP3458919A1 (en) 2019-03-27
US20190126487A1 (en) 2019-05-02

Similar Documents

Publication Publication Date Title
JP2019518297A (ja) ロボット支援型物体学習視覚システム
US11504853B2 (en) Robotic system architecture and control processes
Hodan et al. T-LESS: An RGB-D dataset for 6D pose estimation of texture-less objects
CN108399639B (zh) 基于深度学习的快速自动抓取与摆放方法
US10060857B1 (en) Robotic feature mapping and motion control
US9616569B2 (en) Method for calibrating an articulated end effector employing a remote digital camera
Pagano et al. A vision guided robotic system for flexible gluing process in the footwear industry
Bohg et al. Robot arm pose estimation through pixel-wise part classification
WO2019189661A1 (ja) 学習データセット作製方法及び装置
US20130131853A1 (en) Automated Identification Of Shoe Parts
CN113370217B (zh) 基于深度学习的物体姿态识别和抓取的智能机器人的方法
US12005592B2 (en) Creating training data variability in machine learning for object labelling from images
CN107030692B (zh) 一种基于感知增强的机械手遥操作方法及系统
Kiyokawa et al. Fully automated annotation with noise-masked visual markers for deep-learning-based object detection
CN108961144A (zh) 图像处理系统
Nissler et al. Evaluation and improvement of global pose estimation with multiple apriltags for industrial manipulators
WO2019059343A1 (ja) ワーク情報処理装置およびワークの認識方法
JP2020021212A (ja) 情報処理装置、情報処理方法及びプログラム
Block et al. Image-bot: Generating synthetic object detection datasets for small and medium-sized manufacturing companies
CN116721582A (zh) 三维机器视觉实训方法、系统、计算机设备及存储介质
De Gregorio et al. Robotfusion: Grasping with a robotic manipulator via multi-view reconstruction
Wolnitza et al. 3D object reconstruction and 6D-pose estimation from 2D shape for robotic grasping of objects
Perrollaz et al. Teachless teach-repeat: Toward vision-based programming of industrial robots
Rudorfer et al. Towards learning 3d object detection and 6d pose estimation from synthetic data
Sanchez-Lopez et al. A real-time 3D pose based visual servoing implementation for an autonomous mobile robot manipulator

Legal Events

Date Code Title Description
RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20191030

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20191107

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20191031

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200514

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200514

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210622

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210629

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20210924

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20211227

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20220118

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220518

C60 Trial request (containing other claim documents, opposition documents)

Free format text: JAPANESE INTERMEDIATE CODE: C60

Effective date: 20220518

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20220530

C21 Notice of transfer of a case for reconsideration by examiners before appeal proceedings

Free format text: JAPANESE INTERMEDIATE CODE: C21

Effective date: 20220531

A912 Re-examination (zenchi) completed and case transferred to appeal board

Free format text: JAPANESE INTERMEDIATE CODE: A912

Effective date: 20220610

C211 Notice of termination of reconsideration by examiners before appeal proceedings

Free format text: JAPANESE INTERMEDIATE CODE: C211

Effective date: 20220614

C22 Notice of designation (change) of administrative judge

Free format text: JAPANESE INTERMEDIATE CODE: C22

Effective date: 20220802

C22 Notice of designation (change) of administrative judge

Free format text: JAPANESE INTERMEDIATE CODE: C22

Effective date: 20221004

C13 Notice of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: C13

Effective date: 20221101

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230131