JP7492440B2 - ロボット制御システム、ロボット制御方法及びプログラム - Google Patents

ロボット制御システム、ロボット制御方法及びプログラム Download PDF

Info

Publication number
JP7492440B2
JP7492440B2 JP2020186988A JP2020186988A JP7492440B2 JP 7492440 B2 JP7492440 B2 JP 7492440B2 JP 2020186988 A JP2020186988 A JP 2020186988A JP 2020186988 A JP2020186988 A JP 2020186988A JP 7492440 B2 JP7492440 B2 JP 7492440B2
Authority
JP
Japan
Prior art keywords
robot
learning
output
environmental sensor
environmental
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020186988A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022076572A5 (https=
JP2022076572A (ja
Inventor
哲司 中村
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Ltd
Original Assignee
Hitachi Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Ltd filed Critical Hitachi Ltd
Priority to JP2020186988A priority Critical patent/JP7492440B2/ja
Priority to US18/033,814 priority patent/US20230390935A1/en
Priority to PCT/JP2021/031322 priority patent/WO2022102207A1/ja
Publication of JP2022076572A publication Critical patent/JP2022076572A/ja
Publication of JP2022076572A5 publication Critical patent/JP2022076572A5/ja
Application granted granted Critical
Publication of JP7492440B2 publication Critical patent/JP7492440B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1694—Program controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00—Controls for manipulators
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1628—Program controls characterised by the control loop
    • B25J9/163—Program controls characterised by the control loop learning, adaptive, model based, rule based expert control
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1656—Program controls characterised by programming, planning systems for manipulators
    • B25J9/1664—Program controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/37—Measurements
    • G05B2219/37555—Camera detects orientation, position workpiece, points of workpiece
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40053—Pick 3-D object from pile of objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Manipulator (AREA)
JP2020186988A 2020-11-10 2020-11-10 ロボット制御システム、ロボット制御方法及びプログラム Active JP7492440B2 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2020186988A JP7492440B2 (ja) 2020-11-10 2020-11-10 ロボット制御システム、ロボット制御方法及びプログラム
US18/033,814 US20230390935A1 (en) 2020-11-10 2021-08-26 Robot control system, robot control method, and program
PCT/JP2021/031322 WO2022102207A1 (ja) 2020-11-10 2021-08-26 ロボット制御システム、ロボット制御方法及びプログラム

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2020186988A JP7492440B2 (ja) 2020-11-10 2020-11-10 ロボット制御システム、ロボット制御方法及びプログラム

Publications (3)

Publication Number Publication Date
JP2022076572A JP2022076572A (ja) 2022-05-20
JP2022076572A5 JP2022076572A5 (https=) 2023-06-14
JP7492440B2 true JP7492440B2 (ja) 2024-05-29

Family

ID=81601054

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020186988A Active JP7492440B2 (ja) 2020-11-10 2020-11-10 ロボット制御システム、ロボット制御方法及びプログラム

Country Status (3)

Country Link
US (1) US20230390935A1 (https=)
JP (1) JP7492440B2 (https=)
WO (1) WO2022102207A1 (https=)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117836099A (zh) * 2021-08-20 2024-04-05 发那科株式会社 对机器人把持工件的位置以及姿势进行示教的装置、机器人系统以及方法
WO2023044356A1 (en) * 2021-09-16 2023-03-23 X Development Llc Learning from demonstration for determining robot perception motion
KR102709710B1 (ko) * 2022-07-25 2024-09-26 주식회사 아임토리 스마트 팩토리의 행동개선 솔루션을 제공하는 장치 및 방법
JPWO2024111303A1 (https=) * 2022-11-22 2024-05-30
JP2024101424A (ja) * 2023-01-17 2024-07-29 キヤノン株式会社 情報処理装置及び情報処理装置の制御方法
JP7848759B2 (ja) * 2023-06-27 2026-04-21 トヨタ自動車株式会社 経路決定システム及び方法
US20250249592A1 (en) * 2024-02-02 2025-08-07 Intrinsic Innovation Llc Pose correction for robotics
WO2025169341A1 (ja) * 2024-02-07 2025-08-14 株式会社Ｎｔｔドコモ ネットワーク構成要素及び無線通信方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006320997A (ja) 2005-05-18 2006-11-30 Nippon Telegr & Teleph Corp <Ntt> ロボット行動選択装置及びロボット行動選択方法
JP2018136211A (ja) 2017-02-22 2018-08-30 オムロン株式会社 環境認識システム及び学習装置
JP2019136807A (ja) 2018-02-08 2019-08-22 ファナック株式会社 制御装置及び機械学習装置
JP2020110894A (ja) 2019-01-16 2020-07-27 株式会社エクサウィザーズ 学習済モデル生成装置、ロボット制御装置、及び、プログラム

Family Cites Families (60)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8559699B2 (en) * 2008-10-10 2013-10-15 Roboticvisiontech Llc Methods and apparatus to facilitate operations in image based systems
US8504204B2 (en) * 2010-07-22 2013-08-06 Cognisense Labs, Inc. Automated positioning of an organic polarized object
US9579799B2 (en) * 2014-04-30 2017-02-28 Coleman P. Parker Robotic control system using virtual reality input
US9272417B2 (en) * 2014-07-16 2016-03-01 Google Inc. Real-time determination of object metrics for trajectory planning
US10518409B2 (en) * 2014-09-02 2019-12-31 Mark Oleynik Robotic manipulation methods and systems for executing a domain-specific application in an instrumented environment with electronic minimanipulation libraries
US9492923B2 (en) * 2014-12-16 2016-11-15 Amazon Technologies, Inc. Generating robotic grasping instructions for inventory items
DE102016015936B8 (de) * 2015-07-31 2024-10-24 Fanuc Corporation Vorrichtung für maschinelles Lernen, Robotersystem und maschinelles Lernsystem zum Lernen eines Werkstückaufnahmevorgangs
US10625432B2 (en) * 2015-11-13 2020-04-21 Berkshire Grey, Inc. Processing systems and methods for providing processing of a variety of objects
US10350755B2 (en) * 2016-02-08 2019-07-16 Berkshire Grey, Inc. Systems and methods for providing processing of a variety of objects employing motion planning
EP3414710B1 (en) * 2016-03-03 2022-11-02 Google LLC Deep machine learning methods and apparatus for robotic grasping
US10322506B2 (en) * 2016-05-06 2019-06-18 Kindred Systems Inc. Systems, devices, articles, and methods for using trained robots
US10974394B2 (en) * 2016-05-19 2021-04-13 Deep Learning Robotics Ltd. Robot assisted object learning vision system
US11338436B2 (en) * 2016-07-18 2022-05-24 RightHand Robotics, Inc. Assessing robotic grasping
AU2017357645B2 (en) * 2016-11-08 2022-11-10 Dogtooth Technologies Limited A robotic fruit picking system
US11097417B2 (en) * 2016-12-20 2021-08-24 Kindred Systems Inc. Systems, devices, articles and methods for the partition of items
JP6951659B2 (ja) * 2017-05-09 2021-10-20 オムロン株式会社 タスク実行システム、タスク実行方法、並びにその学習装置及び学習方法
SG11202000652SA (en) * 2017-07-25 2020-02-27 Mbl Ltd Systems and methods for operations a robotic system and executing robotic interactions
AU2018326171A1 (en) * 2017-09-01 2020-04-23 The Regents Of The University Of California Robotic systems and methods for robustly grasping and targeting objects
US10773382B2 (en) * 2017-09-15 2020-09-15 X Development Llc Machine learning methods and apparatus for robotic manipulation and that utilize multi-task domain adaptation
JP6695843B2 (ja) * 2017-09-25 2020-05-20 ファナック株式会社 装置、及びロボットシステム
US10958895B1 (en) * 2017-10-04 2021-03-23 Amazon Technologies, Inc. High speed automated capture of 3D models of packaged items
US10792810B1 (en) * 2017-12-14 2020-10-06 Amazon Technologies, Inc. Artificial intelligence system for learning robotic control policies
US10754318B2 (en) * 2017-12-21 2020-08-25 X Development Llc Robot interaction with objects based on semantic information associated with embedding spaces
US10766149B2 (en) * 2018-03-23 2020-09-08 Amazon Technologies, Inc. Optimization-based spring lattice deformation model for soft materials
US10919151B1 (en) * 2018-03-23 2021-02-16 Amazon Technologies, Inc. Robotic device control optimization using spring lattice deformation model
CN211826092U (zh) * 2018-09-11 2020-10-30 贝克顿·迪金森公司 具有自动化位置获悉的用于诊断测试的机器人样品制备系统
US11607810B2 (en) * 2018-09-13 2023-03-21 The Charles Stark Draper Laboratory, Inc. Adaptor for food-safe, bin-compatible, washable, tool-changer utensils
US12486061B2 (en) * 2018-09-26 2025-12-02 Dexterity, Inc. Robotic kitting system
US11007642B2 (en) * 2018-10-23 2021-05-18 X Development Llc Machine learning methods and apparatus for automated robotic placement of secured object in appropriate location
JP7205752B2 (ja) * 2018-11-09 2023-01-17 オムロン株式会社 ロボット制御装置、ロボット制御方法、及びロボット制御プログラム
US11839983B2 (en) * 2018-11-27 2023-12-12 Ocado Innovation Limited Systems and methods for robotic grasp verification
US11148289B1 (en) * 2019-01-08 2021-10-19 Amazon Technologies, Inc. Entanglement end effector for autonomous object retrieval
US10549928B1 (en) * 2019-02-22 2020-02-04 Dexterity, Inc. Robotic multi-item type palletizing and depalletizing
CA3130626C (en) * 2019-02-22 2023-11-21 Dexterity, Inc. Robotic handling of soft products in non-rigid packaging
WO2020185334A1 (en) * 2019-03-11 2020-09-17 RightHand Robotics, Inc. Item perturbation for picking operations
US11701771B2 (en) * 2019-05-15 2023-07-18 Nvidia Corporation Grasp generation using a variational autoencoder
US11345030B2 (en) * 2019-05-28 2022-05-31 Intel Corporation Methods and apparatus for complex assembly via autonomous robots using reinforcement learning action primitives
US11688030B2 (en) * 2019-06-12 2023-06-27 Frito-Lay North America, Inc. Shading topography imaging for robotic unloading
US11400592B2 (en) * 2019-08-19 2022-08-02 Wipro Limited Method and system for task execution in dynamic heterogeneous robotic environment
CN112405570A (zh) * 2019-08-21 2021-02-26 牧今科技 用于夹持和保持物体的机器人多夹持器组件和方法
US11345029B2 (en) * 2019-08-21 2022-05-31 Mujin, Inc. Robotic multi-gripper assemblies and methods for gripping and holding objects
EP4025393A1 (en) * 2019-09-07 2022-07-13 Embodied Intelligence, Inc. Systems and methods for robotic picking
WO2021046531A1 (en) * 2019-09-07 2021-03-11 Embodied Intelligence, Inc. Training artificial networks for robotic picking
US11911903B2 (en) * 2019-09-07 2024-02-27 Embodied Intelligence, Inc. Systems and methods for robotic picking and perturbation
WO2021046530A1 (en) * 2019-09-07 2021-03-11 Embodied Intelligence, Inc. Three-dimensional computer vision system for robotic devices
US12236340B2 (en) * 2019-09-13 2025-02-25 Osaro Computer-automated robot grasp depth estimation
US12493792B2 (en) * 2019-10-24 2025-12-09 Nvidia Corporation Reinforcement learning of tactile grasp policies
US11772262B2 (en) * 2019-10-25 2023-10-03 Dexterity, Inc. Detecting slippage from robotic grasp
US11839986B2 (en) * 2019-10-25 2023-12-12 Ocado Innovation Limited Systems and methods for active perception and coordination between robotic vision systems and manipulators
US11701776B2 (en) * 2019-10-25 2023-07-18 Dexterity, Inc. Robotic kitting machine
US10954081B1 (en) * 2019-10-25 2021-03-23 Dexterity, Inc. Coordinating multiple robots to meet workflow and avoid conflict
US11724401B2 (en) * 2019-11-13 2023-08-15 Nvidia Corporation Grasp determination for an object in clutter
US12109701B2 (en) * 2019-11-20 2024-10-08 Nvidia Corporation Guided uncertainty-aware policy optimization: combining model-free and model-based strategies for sample-efficient learning
US11440196B1 (en) * 2019-12-17 2022-09-13 X Development Llc Object association using machine learning models
US11587302B2 (en) * 2019-12-17 2023-02-21 X Development Llc Shared dense network with robot task-specific heads
US11318499B2 (en) * 2019-12-19 2022-05-03 Nimble Robotics, Inc. Robotic system having shuttle
JP2021146452A (ja) * 2020-03-19 2021-09-27 株式会社東芝 ハンドリング装置、制御装置、および制御プログラム
US11731271B2 (en) * 2020-06-30 2023-08-22 Microsoft Technology Licensing, Llc Verbal-based focus-of-attention task model encoder
US11654564B2 (en) * 2020-09-10 2023-05-23 Fanuc Corporation Efficient data generation for grasp learning with general grippers
US12070860B2 (en) * 2020-09-14 2024-08-27 Intelligrated Headquarters, Llc Machine learning based decision making for robotic item handling

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006320997A (ja) 2005-05-18 2006-11-30 Nippon Telegr & Teleph Corp <Ntt> ロボット行動選択装置及びロボット行動選択方法
JP2018136211A (ja) 2017-02-22 2018-08-30 オムロン株式会社 環境認識システム及び学習装置
JP2019136807A (ja) 2018-02-08 2019-08-22 ファナック株式会社 制御装置及び機械学習装置
JP2020110894A (ja) 2019-01-16 2020-07-27 株式会社エクサウィザーズ 学習済モデル生成装置、ロボット制御装置、及び、プログラム

Also Published As

Publication number Publication date
WO2022102207A1 (ja) 2022-05-19
US20230390935A1 (en) 2023-12-07
JP2022076572A (ja) 2022-05-20

Similar Documents

Publication Publication Date Title
JP7492440B2 (ja) ロボット制御システム、ロボット制御方法及びプログラム
US11691274B2 (en) Software compensated robotics
Zhang et al. Towards vision-based deep reinforcement learning for robotic motion control
US10293483B2 (en) Apparatus and methods for training path navigation by robots
JP3855812B2 (ja) 距離計測方法、その装置、そのプログラム、その記録媒体及び距離計測装置搭載型ロボット装置
US12246456B2 (en) Image generation device, robot training system, image generation method, and non-transitory computer readable storage medium
JP5806301B2 (ja) ロボットシステムにおける物理的な物体の選択のための方法
CN115890744B (zh) 一种基于td3的机械手臂6-dof物体操纵训练方法及系统
US11679496B2 (en) Robot controller that controls robot, learned model, method of controlling robot, and storage medium
US11833682B2 (en) Robot, method, and manipulating system
CN113172629B (zh) 一种基于时序触觉数据处理的物体抓取方法
US20240109190A1 (en) Robot Control System, Robot Control Method, and Program
JP2022076572A5 (https=)
KR102332314B1 (ko) 로봇과 카메라 간 좌표값 보정 장치 및 보정 방법
JP2021065955A (ja) ロボット制御システム及びその制御方法及びプログラム
JP2020104216A (ja) ロボット制御装置、ロボットシステム及びロボット制御方法
WO2020241037A1 (ja) 学習装置、学習方法、学習プログラム、自動制御装置、自動制御方法および自動制御プログラム
WO2020071174A1 (ja) 学習装置、制御装置、学習方法、及び学習プログラム
NL2035240B1 (en) Method and systems for compensating for a deviation in a plurality of workingposes of a manipulator of an autonomous charging device
US20230321826A1 (en) Method for Controlling a Robotic Device
US20250037025A1 (en) Method for training a machine learning model for controlling a robot to manipulate an object
JP7737865B2 (ja) 動作指令生成装置および動作指令生成方法
JPH06106490A (ja) 制御装置
CN120155919A (zh) 用于训练用于操纵对象的控制策略的设备和方法
CN111093007B (zh) 双足机器人的行走控制方法及装置、存储介质、终端

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230606

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230606

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240130

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240322

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240514

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240517

R150 Certificate of patent or registration of utility model

Ref document number: 7492440

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150