DE112004002219B4 - Verfahren zum Antreiben eines Roboters - Google Patents

Verfahren zum Antreiben eines Roboters Download PDF

Info

Publication number
DE112004002219B4
DE112004002219B4 DE112004002219.3T DE112004002219T DE112004002219B4 DE 112004002219 B4 DE112004002219 B4 DE 112004002219B4 DE 112004002219 T DE112004002219 T DE 112004002219T DE 112004002219 B4 DE112004002219 B4 DE 112004002219B4
Authority
DE
Germany
Prior art keywords
image data
robot
moving object
image
operation command
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
DE112004002219.3T
Other languages
German (de)
English (en)
Other versions
DE112004002219T5 (de
Inventor
Kiyoshi Hoshino
Takanobu Tanimoto
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Japan Science and Technology Agency
Original Assignee
Japan Science and Technology Agency
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Japan Science and Technology Agency filed Critical Japan Science and Technology Agency
Publication of DE112004002219T5 publication Critical patent/DE112004002219T5/de
Application granted granted Critical
Publication of DE112004002219B4 publication Critical patent/DE112004002219B4/de
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J15/00Gripping heads and other end effectors
    • B25J15/0009Gripping heads and other end effectors comprising multi-articulated fingers, e.g. resembling a human hand
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1694Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697Vision controlled systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00Controls for manipulators
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/42Recording and playback systems, i.e. in which the programme is recorded from a cycle of operations, e.g. the cycle of operations being manually controlled, after which this record is played back on the same machine
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Automation & Control Theory (AREA)
  • Manipulator (AREA)
  • Image Analysis (AREA)
DE112004002219.3T 2003-11-13 2004-11-15 Verfahren zum Antreiben eines Roboters Expired - Fee Related DE112004002219B4 (de)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
JP2003-384402 2003-11-13
JP2003384402 2003-11-13
JP2004173268 2004-06-10
JP2004-173268 2004-06-10
PCT/JP2004/016968 WO2005046942A1 (ja) 2003-11-13 2004-11-15 ロボットの駆動方法

Publications (2)

Publication Number Publication Date
DE112004002219T5 DE112004002219T5 (de) 2006-11-23
DE112004002219B4 true DE112004002219B4 (de) 2018-07-12

Family

ID=34593956

Family Applications (1)

Application Number Title Priority Date Filing Date
DE112004002219.3T Expired - Fee Related DE112004002219B4 (de) 2003-11-13 2004-11-15 Verfahren zum Antreiben eines Roboters

Country Status (5)

Country Link
US (1) US7848850B2 (enExample)
JP (2) JP4878842B2 (enExample)
DE (1) DE112004002219B4 (enExample)
GB (1) GB2424723B (enExample)
WO (1) WO2005046942A1 (enExample)

Families Citing this family (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6261095A (ja) * 1985-09-11 1987-03-17 カシオ計算機株式会社 波形エディット装置
US7668797B2 (en) * 2006-04-07 2010-02-23 Gary Kuvich Active semiotic system for image and video understanding by robots and unmanned vehicles, methods and apparatus
JP4798581B2 (ja) * 2006-09-27 2011-10-19 株式会社国際電気通信基礎技術研究所 ロボットシステム
US8068935B2 (en) * 2006-10-18 2011-11-29 Yutaka Kanayama Human-guided mapping method for mobile robot
JP2008140267A (ja) * 2006-12-04 2008-06-19 National Institute Of Advanced Industrial & Technology 動作認識装置および動作認識処理方法
US9060385B1 (en) * 2007-04-20 2015-06-16 Lloyd Douglas Manning Universal bluetooth/wireless glove
JP5109098B2 (ja) * 2007-06-14 2012-12-26 本田技研工業株式会社 運動制御システム、運動制御方法および運動制御プログラム
US8213706B2 (en) * 2008-04-22 2012-07-03 Honeywell International Inc. Method and system for real-time visual odometry
KR101494344B1 (ko) * 2008-04-25 2015-02-17 삼성전자주식회사 휴머노이드 로봇의 움직임 제어 시스템 및 그 방법
JP5403699B2 (ja) * 2008-06-04 2014-01-29 国立大学法人 筑波大学 手指形状推定装置、手指形状の推定方法及びプログラム
KR100995933B1 (ko) * 2008-09-01 2010-11-22 한국과학기술연구원 진화 알고리즘과 모방학습에 기초한 로봇의 동작 제어 방법
TWI373361B (en) 2008-10-09 2012-10-01 Univ Nat Chiao Tung Glove puppet manipulation system
TWI371303B (en) * 2009-02-04 2012-09-01 Inventec Appliances Corp Electronic pet cotrol system and control method thereof
US9052710B1 (en) * 2009-03-20 2015-06-09 Exelis Inc. Manipulation control based upon mimic of human gestures
US8260460B2 (en) * 2009-09-22 2012-09-04 GM Global Technology Operations LLC Interactive robot control system and method of use
FR2950559B1 (fr) 2009-09-29 2011-11-25 Artistic Robot Event Systeme et procede de restitution synchrone par un robot de mouvements d'une main ou d'un organe d'extremite
JP2011110621A (ja) * 2009-11-24 2011-06-09 Toyota Industries Corp ロボットの教示データを作成する方法およびロボット教示システム
JP2011110620A (ja) * 2009-11-24 2011-06-09 Toyota Industries Corp ロボットの動作を制御する方法およびロボットシステム
JP5400595B2 (ja) * 2009-12-11 2014-01-29 トヨタ自動車株式会社 動作補助装置
WO2011127410A2 (en) * 2010-04-09 2011-10-13 Deka Products Limited Partnership System and apparatus for robotic device and methods of using thereof
JP5306313B2 (ja) * 2010-12-20 2013-10-02 株式会社東芝 ロボット制御装置
JP5771413B2 (ja) * 2011-03-02 2015-08-26 パナソニック株式会社 姿勢推定装置、姿勢推定システム、および姿勢推定方法
KR101896473B1 (ko) * 2012-01-04 2018-10-24 삼성전자주식회사 로봇 핸드의 제어 방법
US9070004B2 (en) * 2012-05-03 2015-06-30 General Electric Company Automatic segmentation and characterization of cellular motion
JP5426719B2 (ja) * 2012-05-18 2014-02-26 ファナック株式会社 ロボットシステムの動作シミュレーション装置
JP2014140941A (ja) * 2013-01-25 2014-08-07 Seiko Epson Corp ロボット制御システム、ロボット、ロボット制御方法及びプログラム
JP2014140942A (ja) * 2013-01-25 2014-08-07 Seiko Epson Corp ロボット制御システム、ロボット、ロボット制御方法及びプログラム
US9804576B2 (en) 2013-02-27 2017-10-31 Rockwell Automation Technologies, Inc. Recognition-based industrial automation control with position and derivative decision reference
US9498885B2 (en) 2013-02-27 2016-11-22 Rockwell Automation Technologies, Inc. Recognition-based industrial automation control with confidence-based decision support
US9798302B2 (en) 2013-02-27 2017-10-24 Rockwell Automation Technologies, Inc. Recognition-based industrial automation control with redundant system input support
US9393695B2 (en) 2013-02-27 2016-07-19 Rockwell Automation Technologies, Inc. Recognition-based industrial automation control with person and object discrimination
JP6271903B2 (ja) * 2013-08-06 2018-01-31 キヤノン株式会社 サーボ装置、及びサーボ装置の制御方法
KR102000264B1 (ko) * 2013-10-01 2019-07-15 한국전자통신연구원 교시 데이터 입력 장치와 이를 이용한 로봇의 교시 명령어 생성 장치 및 방법
US9084411B1 (en) * 2014-04-10 2015-07-21 Animal Biotech Llc Livestock identification system and method
JP6003942B2 (ja) * 2014-04-24 2016-10-05 トヨタ自動車株式会社 動作制限装置及び動作制限方法
US10970428B2 (en) * 2015-04-01 2021-04-06 Research & Business Foundation Sungkyunkwan University Method of providing performance indicators of robot hand and method of optimizing structure of robot hand
US9669543B1 (en) * 2015-12-11 2017-06-06 Amazon Technologies, Inc. Validation of robotic item grasping
US10456910B2 (en) * 2016-01-14 2019-10-29 Purdue Research Foundation Educational systems comprising programmable controllers and methods of teaching therewith
DE112016006116T5 (de) * 2016-01-29 2018-09-13 Mitsubishi Electric Corporation Roboterlehrvorrichtung und Verfahren zum Erzeugen eines Robotersteuerprogramms
US20170249561A1 (en) * 2016-02-29 2017-08-31 GM Global Technology Operations LLC Robot learning via human-demonstration of tasks with force and position objectives
US11036230B1 (en) * 2016-03-03 2021-06-15 AI Incorporated Method for developing navigation plan in a robotic floor-cleaning device
US9827670B1 (en) * 2016-05-24 2017-11-28 X Development Llc Coaxial finger face and base encoding
TW201805598A (zh) * 2016-08-04 2018-02-16 鴻海精密工業股份有限公司 自主移動設備及建立導航路徑的方法
JP6514156B2 (ja) * 2016-08-17 2019-05-15 ファナック株式会社 ロボット制御装置
US10319109B2 (en) * 2017-03-31 2019-06-11 Honda Motor Co., Ltd. Interaction with physical objects as proxy objects representing virtual objects
CN107199566B (zh) * 2017-06-02 2019-09-10 东南大学 一种基于虚拟手臂的面向空间站机器人的遥操作系统
DE112018002565B4 (de) * 2017-08-10 2021-07-01 Robert Bosch Gmbh System und Verfahren zum direkten Anlernen eines Roboters
WO2019064752A1 (ja) * 2017-09-28 2019-04-04 日本電産株式会社 ロボット教示システム、ロボット教示方法、制御装置、及びコンピュータプログラム
WO2019064751A1 (ja) * 2017-09-28 2019-04-04 日本電産株式会社 ロボット教示システム、ロボット教示方法、制御装置、及びコンピュータプログラム
DE102018124671B4 (de) * 2018-10-06 2020-11-26 Bystronic Laser Ag Verfahren und Vorrichtung zur Erstellung eines Robotersteuerprogramms
DE102020124285B4 (de) 2019-09-20 2022-06-09 Nvidia Corporation Visionsbasierte Teleoperation eines beweglichen Robotersystems
US12399567B2 (en) 2019-09-20 2025-08-26 Nvidia Corporation Vision-based teleoperation of dexterous robotic system
JP7452657B2 (ja) * 2020-07-14 2024-03-19 日本電気株式会社 制御装置、制御方法及びプログラム
WO2022030242A1 (ja) * 2020-08-03 2022-02-10 ソニーグループ株式会社 情報処理装置、情報処理方法、およびプログラム
US12179350B2 (en) * 2020-09-11 2024-12-31 Fanuc Corporation Dual arm robot teaching from dual hand human demonstration
CN112847334B (zh) * 2020-12-16 2022-09-23 北京无线电测量研究所 一种基于视觉伺服的机械臂目标跟踪方法
US12205028B2 (en) 2021-10-07 2025-01-21 Nec Corporation Co-disentagled series/text multi-modal representation learning for controllable generation

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6236037B1 (en) 1998-02-20 2001-05-22 Massachusetts Institute Of Technology Finger touch sensors and virtual switch panels
US20020181773A1 (en) 2001-03-28 2002-12-05 Nobuo Higaki Gesture recognition system
JP2003117873A (ja) 2001-10-15 2003-04-23 Japan Science & Technology Corp 人型ロボットハンド

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS61122711A (ja) * 1984-11-20 1986-06-10 Fujitsu Ltd ロボツトのテイ−チング装置
JPH01322079A (ja) * 1988-06-22 1989-12-27 Shibuya Kinzoku Sangyo Kk 修正装置付ピボットヒンジ
JPH0380484A (ja) * 1989-08-22 1991-04-05 Hitachi Maxell Ltd テープカートリッジ
US5887069A (en) * 1992-03-10 1999-03-23 Hitachi, Ltd. Sign recognition apparatus and method and sign translation system using same
US6072494A (en) * 1997-10-15 2000-06-06 Electric Planet, Inc. Method and apparatus for real-time gesture recognition
US6421453B1 (en) * 1998-05-15 2002-07-16 International Business Machines Corporation Apparatus and methods for user recognition employing behavioral passwords
US6681031B2 (en) * 1998-08-10 2004-01-20 Cybernet Systems Corporation Gesture-controlled interfaces for self-service machines and other applications
JP4340367B2 (ja) * 1999-01-27 2009-10-07 株式会社リコー 画像分類装置およびその装置としてコンピュータを機能させるためのプログラムを記録したコンピュータ読み取り可能な記録媒体
JP2000329511A (ja) 1999-05-19 2000-11-30 Sony Corp データグローブ及びこれを用いた形状認識方法
JP2001092589A (ja) * 1999-09-22 2001-04-06 Suzuki Motor Corp モデリング装置及びモデリングデータ生成用プログラムを記憶した記憶媒体
JP3457617B2 (ja) * 2000-03-23 2003-10-20 株式会社東芝 画像検索システムおよび画像検索方法
JP2001322079A (ja) * 2000-05-15 2001-11-20 Sony Corp 脚式移動ロボット及びその動作教示方法
JP2001344567A (ja) * 2000-06-02 2001-12-14 Ricoh Co Ltd 文字認識装置、その方法およびその方法を実施するためのプログラムを記録した記録媒体
JP2002163655A (ja) * 2000-11-24 2002-06-07 Omron Corp 個人認証装置
JP2002239960A (ja) * 2001-02-21 2002-08-28 Sony Corp ロボット装置の動作制御方法、プログラム、記録媒体及びロボット装置
US20020152077A1 (en) * 2001-04-12 2002-10-17 Patterson Randall R. Sign language translator
JP4028192B2 (ja) * 2001-08-02 2007-12-26 日本電信電話株式会社 動作入力方法、装置、プログラム、及び記録媒体
JP2003080484A (ja) 2001-09-07 2003-03-18 Tomy Co Ltd 動作反応玩具
JP2003288594A (ja) * 2002-03-28 2003-10-10 Minolta Co Ltd 画像処理装置および方法
US7665041B2 (en) * 2003-03-25 2010-02-16 Microsoft Corporation Architecture for controlling a computer using hand gestures
US7565295B1 (en) * 2003-08-28 2009-07-21 The George Washington University Method and apparatus for translating hand gestures

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6236037B1 (en) 1998-02-20 2001-05-22 Massachusetts Institute Of Technology Finger touch sensors and virtual switch panels
US20020181773A1 (en) 2001-03-28 2002-12-05 Nobuo Higaki Gesture recognition system
JP2003117873A (ja) 2001-10-15 2003-04-23 Japan Science & Technology Corp 人型ロボットハンド

Non-Patent Citations (9)

* Cited by examiner, † Cited by third party
Title
Atsushi, Musya Yoshinori, (Society of Photographic Science and Technology of Japan, Band 66, 1, S. 93 bis 101, 2003
Dokument D2: T. Inamura, Y. Nakamure, H. Ezaki und I. Toshima, Thesis of „Imitation den Primitive Symbol Acquisition of Humanoids by the Integrated Mimesis Loop" in Proc. of Intl. Conf. on Robotics and Automation (ICRA 2001), Seite 4208 bis 4213, herausgegeben 2001
E. Ueda, Y. Matsumoto, M. Imai and T. Ogasawara: „Hand pose estimation using multi-viewpoint silhouette images, „Proc. 2001 IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems (IROS' 2001), Seiten 1989-1996, 2001
Kuniyoshi, Thesis of „A Robotic Approach to the Foundation of Communication and Symbols" in Proc. of 12th World Congress of Applied Linguistics (AILA ,99), Seite 94, herausgegeben 1999
M. H. Jeong, Y. Kuno, N. Shimada and Y. Shirai: „Recognition of shape-changing hand gestures", IEICE Transactions Division D, E85-D, 10, Seiten 1678-1687, 2002
N. Otsu and T. Kurita, „A new scheme for practical, flexible and intelligent vision systems", Proc. IAPR. Workshop on Computer vision, S. 431-435, 1998
N. Shimada, K. Kimura, Y. Kuno and Y. Shirai: „3-D hand posture estimation by indexing monocular silhouette images", Proc. 6th Workshop on Frontier of Computer Vision, Seiten 150-155, 2000)
R. Pfeifer, „Dynamics, morphology, and materials in the emergence of cognition" in Advances in Artificial Intelligence, ed. W. Burgard, A. B. Cremers, and T. Christaller, Proc. KI-99, 23rd Annual German Conference on Artificial Intelligence, 1999)
Y. Uno, K. Kawato and R. Suzuki; ein Dokument mit dem Titel „Formation and control of optimal trajectory in human multijoint arm movement-minimum torque-change model": Biological Cybernetics, 61, Seiten 89-101, 1989

Also Published As

Publication number Publication date
JP2011131376A (ja) 2011-07-07
WO2005046942A1 (ja) 2005-05-26
DE112004002219T5 (de) 2006-11-23
JP5209751B2 (ja) 2013-06-12
US20070078564A1 (en) 2007-04-05
JPWO2005046942A1 (ja) 2007-08-23
GB0611135D0 (en) 2006-07-19
GB2424723A (en) 2006-10-04
JP4878842B2 (ja) 2012-02-15
US7848850B2 (en) 2010-12-07
GB2424723B (en) 2007-09-19

Similar Documents

Publication Publication Date Title
DE112004002219B4 (de) Verfahren zum Antreiben eines Roboters
DE102019108787B4 (de) Handsteuerungsvorrichtung und Handsteuerungssystem
DE102014108287B4 (de) Schnelles Erlernen durch Nachahmung von Kraftdrehmoment-Aufgaben durch Roboter
DE102010021607B4 (de) Kontaktzustandsschätzung für Roboterhände mit mehreren Fingern unter Verwendung von Partikel-Filtern
EP0365928B1 (de) Verfahren zur Auswertung von Zellbildern
DE69823001T2 (de) Verfahren und Vorrichtung zur Rekonstruktion der dreidimensionalen Bewegung eines menschlichen Körpers aus Monokularbildsequenzen
DE202017106506U1 (de) Einrichtung für tiefes Maschinenlernen zum Robotergreifen
DE102017202717A1 (de) Roboteranlernung per menschlicher demonstration von aufgaben mit kraft- und positionszielen
DE102017220307B4 (de) Vorrichtung und Verfahren zum Erkennen von Verkehrszeichen
DE102013203381A1 (de) Verfahren und system zum trainieren eines roboters unter verwendung einer von menschen unterstützten aufgabendemonstration
DE112017007903B4 (de) Haltepositions- und Orientierungslehreinrichtung, Haltepositions- und Orientierungslehrverfahren und Robotersystem
DE112017003723B4 (de) Verbesserte Steuerung einer robotischen Prothese durch ein kognitives System
Nölker et al. Detection of fingertips in human hand movement sequences
DE102013017425A1 (de) Verfahren für die Erkennung von Gesten eines menschlichen Körpers
DE102018100315B4 (de) Erzeugen von Eingabedaten für ein konvolutionelles neuronales Netzwerk
DE102022202142B3 (de) Vorrichtung und Verfahren zum Trainieren eines maschinellen Lernmodells zum Ableiten eines Bewegungsvektors für einen Roboter aus Bilddaten
DE102022204724B4 (de) Verfahren zum Steuern einer Robotervorrichtung
DE102022207847A1 (de) Verfahren zum Steuern eines Roboters zum Manipulieren, insbesondere Aufnehmen, eines Objekts
DE102021211741A1 (de) Formvervollständigung und Objektlageabschätzung für maschinelles Sehen
DE102018129871A1 (de) Trainieren eins tiefen konvolutionellen neuronalen Netzwerks zum Verarbeiten von Sensordaten zur Anwendung in einem Fahrunterstützungssystem
DE102021210993A1 (de) Verfahren zum Erzeugen von Trainingsdaten für überwachtes Lernen zum Trainieren eines neuronalen Netzes
DE102022206274B4 (de) Verfahren zum Steuern eines Roboters zum Manipulieren, insbesondere Aufnehmen, eines Objekts
DE102022202143B4 (de) Vorrichtung und Verfahren zur Steuerung eines Roboters zur Durchführung einer Aufgabe
DE112021007813T5 (de) Vorrichtung zum lehren von position und haltung für einen roboter zum greifen eines werkstücks, robotersystem und verfahren
DE102004050942B4 (de) Bootstrap-Verfahren zum überwachten Einlernen eines Mustererkennungssystems

Legal Events

Date Code Title Description
8110 Request for examination paragraph 44
R016 Response to examination communication
R018 Grant decision by examination section/examining division
R020 Patent grant now final
R119 Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal fee