CN110958425B - 信息处理装置、信息处理方法和系统 - Google Patents

信息处理装置、信息处理方法和系统 Download PDF

Info

Publication number
CN110958425B
CN110958425B CN201910910738.4A CN201910910738A CN110958425B CN 110958425 B CN110958425 B CN 110958425B CN 201910910738 A CN201910910738 A CN 201910910738A CN 110958425 B CN110958425 B CN 110958425B
Authority
CN
China
Prior art keywords
image
area
information processing
target
robot
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910910738.4A
Other languages
English (en)
Chinese (zh)
Other versions
CN110958425A (zh
Inventor
山田大辅
肥后智昭
小林一彦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Publication of CN110958425A publication Critical patent/CN110958425A/zh
Application granted granted Critical
Publication of CN110958425B publication Critical patent/CN110958425B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1679—Program controls characterised by the tasks executed
    • B25J9/1687—Assembly, peg and hole, palletising, straight line, weaving pattern movement
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00—Manipulators not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1628—Program controls characterised by the control loop
    • B25J9/163—Program controls characterised by the control loop learning, adaptive, model based, rule based expert control
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1679—Program controls characterised by the tasks executed
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1694—Program controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/107—Static hand or arm
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/39—Robotics, robotics to robotics hand
    • G05B2219/39106—Conveyor, pick up article, object from conveyor, bring to test unit, place it
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40532—Ann for vision processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Manipulator (AREA)
  • Image Analysis (AREA)
CN201910910738.4A 2018-09-27 2019-09-25 信息处理装置、信息处理方法和系统 Active CN110958425B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018182089 2018-09-27
JP2018-182089 2018-09-27

Publications (2)

Publication Number Publication Date
CN110958425A CN110958425A (zh) 2020-04-03
CN110958425B true CN110958425B (zh) 2021-07-23

Family

ID=69781234

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910910738.4A Active CN110958425B (zh) 2018-09-27 2019-09-25 信息处理装置、信息处理方法和系统

Country Status (4)

Country Link
US (1) US11541545B2 (enExample)
JP (1) JP7467041B2 (enExample)
CN (1) CN110958425B (enExample)
DE (1) DE102019125126B4 (enExample)

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6810087B2 (ja) * 2018-03-29 2021-01-06 ファナック株式会社 機械学習装置、機械学習装置を用いたロボット制御装置及びロボットビジョンシステム、並びに機械学習方法
JP6885909B2 (ja) * 2018-10-12 2021-06-16 ファナック株式会社 ロボット制御装置
KR102821604B1 (ko) * 2018-10-30 2025-06-19 무진 아이엔씨 로봇 시스템을 동작하기 위한 방법, 로봇 시스템 및 컴퓨터로 실행 가능한 명령어를 저장한 비일시적 저장 매체
US11185978B2 (en) * 2019-01-08 2021-11-30 Honda Motor Co., Ltd. Depth perception modeling for grasping objects
JP2020166371A (ja) * 2019-03-28 2020-10-08 セイコーエプソン株式会社 情報処理方法、情報処理装置、物体検出装置およびロボットシステム
US12053887B2 (en) * 2020-03-06 2024-08-06 Embodied Intelligence Inc. Imaging process for detecting failures modes
CN111856988A (zh) * 2020-06-05 2020-10-30 哈工大机器人(中山)无人装备与人工智能研究院 一种采血装置的运动控制方法和装置
CN116234447B (zh) * 2020-07-27 2024-11-12 克里奥瓦克公司 针对基于真空的接合工具的对准
KR102350638B1 (ko) * 2020-08-26 2022-01-17 주식회사 이엠에스 인공지능형 로봇 시스템
CN112082480B (zh) * 2020-09-08 2024-07-30 浙江清华柔性电子技术研究院 芯片的空间取向的测量方法、系统、电子装置和存储介质
US11633862B2 (en) 2020-11-25 2023-04-25 Metal Industries Research & Development Centre Automatic control method of mechanical arm and automatic control system
JP7481247B2 (ja) * 2020-12-11 2024-05-10 ファナック株式会社 ロボット教示システム
JP7621123B2 (ja) * 2021-01-15 2025-01-24 株式会社安川電機 処理システム及び処理方法
US12151383B2 (en) * 2021-02-01 2024-11-26 The Boeing Company Robotic manufacturing systems and methods
IT202100003821A1 (it) * 2021-02-19 2022-08-19 Univ Pisa Procedimento di interazione con oggetti
DE102021104001B3 (de) 2021-02-19 2022-04-28 Gerhard Schubert Gesellschaft mit beschränkter Haftung Verfahren zum automatischen Ergreifen, insbesondere Umsetzen, von Gegenständen
US12330315B2 (en) * 2021-04-12 2025-06-17 Sanctuary Cognitive Systems Corporation Systems, devices, and methods for developing robot autonomy
US12269164B2 (en) * 2021-05-04 2025-04-08 Mujin, Inc. Method and computing system for performing robot motion planning and repository detection
JP7558115B2 (ja) * 2021-06-02 2024-09-30 株式会社イノアックコーポレーション パッド組付システム、複合パッドの製造ライン及び製造方法
US12544929B2 (en) 2021-07-21 2026-02-10 Mujin, Inc. Robotic system with depth-based processing mechanism and methods for operating the same
US12290944B2 (en) 2021-08-09 2025-05-06 Mujin, Inc. Robotic system with image-based sizing mechanism and methods for operating the same
JP2023042473A (ja) * 2021-09-14 2023-03-27 セイコーエプソン株式会社 教示方法
JP7730155B2 (ja) * 2022-01-12 2025-08-27 株式会社システック 非接触操作装置
CN114770559B (zh) * 2022-05-27 2022-12-13 中迪机器人(盐城)有限公司 一种机器人的取物控制系统及方法
GB2621371B (en) * 2022-08-10 2024-10-23 Dyson Technology Ltd A method and system for exploring a real-world environment
CN115890679B (zh) * 2022-12-02 2024-02-13 西南交通大学 基于视觉的轨道车辆转向架枕簧缺口定位与夹持方法
CN116216305B (zh) * 2022-12-29 2023-11-07 长园视觉科技(珠海)有限公司 上下料控制方法、控制器、上下料设备及存储介质
TW202433060A (zh) * 2023-02-01 2024-08-16 聯華電子股份有限公司 機台自動對準方法及應用其之流程機器人裝置
JP7856591B2 (ja) * 2023-02-06 2026-05-11 株式会社日立製作所 ロボットの制御方法及びシステム
WO2024214177A1 (ja) * 2023-04-11 2024-10-17 ファナック株式会社 画像処理装置
DE102023110111B3 (de) * 2023-04-20 2024-06-06 J.Schmalz Gmbh Verfahren zum Ansteuern einer Handhabungsanlage sowie Handhabungsanlage
CN119854608A (zh) * 2024-03-27 2025-04-18 比亚迪股份有限公司 Agv叉取货物方法和agv
WO2026116420A1 (ja) * 2024-11-27 2026-06-04 京セラ株式会社 処理装置及びプログラム
CN120735054B (zh) * 2025-09-03 2025-12-02 中国科学院水生生物研究所 用于生物样本转移的机械臂控制方法及装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105364927A (zh) * 2015-12-15 2016-03-02 天津立德尔智能装备科技有限公司 机器人搬运视觉系统及其快速定位方法
EP2998076A1 (en) * 2014-09-18 2016-03-23 Kabushiki Kaisha Yaskawa Denki Robot system and method for picking workpiece
CN105437248A (zh) * 2014-09-18 2016-03-30 株式会社安川电机 机器人系统、机器人装置以及工件拾取方法
US9630320B1 (en) * 2013-03-15 2017-04-25 Industrial Perception, Inc. Detection and reconstruction of an environment to facilitate robotic interaction with the environment
CN106945035A (zh) * 2015-11-06 2017-07-14 佳能株式会社 机器人控制设备及其控制方法和机器人系统
CN107932517A (zh) * 2017-11-15 2018-04-20 盐城盈信通科技有限公司 一种芯片机自动化作业系统

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3517529B2 (ja) * 1996-08-21 2004-04-12 株式会社東芝 画像入力型ロボットシステム
JP2002200588A (ja) 2000-12-28 2002-07-16 Denso Corp ロボットによる把持可能部品の把持位置検出方法及びその装置
EP1675709A2 (de) 2003-10-20 2006-07-05 Isra Vision Systems AG VERFAHREN ZUR EINRICHTUNG EINER BEWEGUNG EINES HANDHABUNGSGERÄTS UND BILDVERARBEITUNG
US7266422B1 (en) * 2004-04-09 2007-09-04 Fanuc Robotics America, Inc. Automated palletizing cases having mixed sizes and shapes
DE102006003859B3 (de) * 2006-01-27 2007-03-01 Robert Bosch Gmbh Verfahren zum Ablegen von Stückgütern in Behälter
JP5288908B2 (ja) 2008-06-30 2013-09-11 ファナック株式会社 物品整列システム及びロボットハンド
JP5265296B2 (ja) 2008-10-10 2013-08-14 本田技研工業株式会社 ワーク取り出し方法
DE102009011294B4 (de) * 2009-03-02 2020-12-24 Kuka Roboter Gmbh Palletieren von Paketen mittels eines Manipulators
JP4621789B2 (ja) * 2009-06-02 2011-01-26 ファナック株式会社 物品搬送ロボットシステム
JP2012030320A (ja) * 2010-07-30 2012-02-16 Dainippon Screen Mfg Co Ltd 作業システム、作業ロボット制御装置および作業プログラム
JP6343930B2 (ja) 2013-12-27 2018-06-20 セイコーエプソン株式会社 ロボットシステム、ロボット制御装置、及びロボット制御方法
JP2016091053A (ja) 2014-10-29 2016-05-23 キヤノン株式会社 情報処理装置および容器形状の推定方法、ワークピッキングシステム、プログラム
JP6576050B2 (ja) 2015-02-27 2019-09-18 キヤノン株式会社 物体移動方法及びシステム
US9751693B1 (en) * 2016-02-01 2017-09-05 Amazon Technologies, Inc. Automated shipment set item consolidation
JP2017189856A (ja) * 2016-04-15 2017-10-19 オムロン株式会社 アクチュエータ制御システム、アクチュエータ制御方法、情報処理プログラム、および記録媒体
TWM531349U (zh) 2016-05-04 2016-11-01 Factory Automation Technology 具有視覺量測之加工裝置
JP6370842B2 (ja) * 2016-06-29 2018-08-08 ファナック株式会社 仮置き部を備えた物品搬送装置
JP2018122945A (ja) 2017-01-30 2018-08-09 株式会社東芝 可変型物品保持装置、移載装置、ロボットハンドリングシステム、および移載装置の制御方法
JP6444499B1 (ja) * 2017-04-04 2018-12-26 株式会社Ｍｕｊｉｎ 制御装置、ピッキングシステム、物流システム、プログラム、及び、制御方法
JP2018203480A (ja) * 2017-06-07 2018-12-27 株式会社東芝 仕分装置および仕分システム
JP2019059004A (ja) * 2017-09-28 2019-04-18 セイコーエプソン株式会社 ロボットシステム
US11926057B2 (en) * 2018-06-14 2024-03-12 Yamaha Hatsudoki Kabushiki Kaisha Robot system
JP6856590B2 (ja) * 2018-08-31 2021-04-07 ファナック株式会社 センシングシステム、作業システム、拡張現実画像の表示方法、およびプログラム
US12008768B2 (en) * 2018-09-25 2024-06-11 Visual Robotics Systems, Inc. Spatially-aware camera and method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9630320B1 (en) * 2013-03-15 2017-04-25 Industrial Perception, Inc. Detection and reconstruction of an environment to facilitate robotic interaction with the environment
EP2998076A1 (en) * 2014-09-18 2016-03-23 Kabushiki Kaisha Yaskawa Denki Robot system and method for picking workpiece
CN105437248A (zh) * 2014-09-18 2016-03-30 株式会社安川电机 机器人系统、机器人装置以及工件拾取方法
CN106945035A (zh) * 2015-11-06 2017-07-14 佳能株式会社 机器人控制设备及其控制方法和机器人系统
CN105364927A (zh) * 2015-12-15 2016-03-02 天津立德尔智能装备科技有限公司 机器人搬运视觉系统及其快速定位方法
CN107932517A (zh) * 2017-11-15 2018-04-20 盐城盈信通科技有限公司 一种芯片机自动化作业系统

Also Published As

Publication number Publication date
DE102019125126B4 (de) 2020-12-17
DE102019125126A1 (de) 2020-04-02
JP2020055096A (ja) 2020-04-09
JP7467041B2 (ja) 2024-04-15
US20200101613A1 (en) 2020-04-02
US11541545B2 (en) 2023-01-03
CN110958425A (zh) 2020-04-03

Similar Documents

Publication Publication Date Title
CN110958425A (zh) 信息处理装置、信息处理方法和系统
US10723020B2 (en) Robotic arm processing method and system based on 3D image
US11117262B2 (en) Intelligent robots
JP5977544B2 (ja) 情報処理装置、情報処理方法
JP5471355B2 (ja) ３次元視覚センサ
CN102632506B (zh) 机械手用位置检测装置以及检测方法、机械手系统
US20180276501A1 (en) Information processing apparatus, information processing method, and storage medium
JP7191569B2 (ja) 把持装置
JP2019188580A (ja) 情報処理装置、制御方法、ロボットシステム、コンピュータプログラム、及び記憶媒体
US20150202776A1 (en) Data generation device for vision sensor and detection simulation system
JP2016099257A (ja) 情報処理装置及び情報処理方法
JP2012030320A (ja) 作業システム、作業ロボット制御装置および作業プログラム
US20230364787A1 (en) Automated handling systems and methods
US20210197391A1 (en) Robot control device, robot control method, and robot control non-transitory computer readable medium
KR102565444B1 (ko) 객체를 식별하기 위한 장치 및 방법
JP6902369B2 (ja) 提示装置、提示方法およびプログラム、ならびに作業システム
TWI806761B (zh) 標誌檢測裝置以及機器人示教系統
US20240051134A1 (en) Controller, robot system and learning device
US11126844B2 (en) Control apparatus, robot system, and method of detecting object
CN114080590A (zh) 使用先进扫描技术的机器人料箱拾取系统和方法
US20220168902A1 (en) Method And Control Arrangement For Determining A Relation Between A Robot Coordinate System And A Movable Apparatus Coordinate System
JP2015182212A (ja) ロボットシステム、ロボット、制御装置、及び制御方法
CN111899629B (zh) 柔性机器人教学系统和方法
US20240424671A1 (en) Robot control system, robot control method, and information storage medium
US20240066694A1 (en) Robot control system, robot control method, and robot control program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant