JP7397879B2 - 遠隔操作装置 - Google Patents

遠隔操作装置 Download PDF

Info

Publication number
JP7397879B2
JP7397879B2 JP2021559199A JP2021559199A JP7397879B2 JP 7397879 B2 JP7397879 B2 JP 7397879B2 JP 2021559199 A JP2021559199 A JP 2021559199A JP 2021559199 A JP2021559199 A JP 2021559199A JP 7397879 B2 JP7397879 B2 JP 7397879B2
Authority
JP
Japan
Prior art keywords
information
video
image
movable range
movable
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021559199A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2022030047A1 (https=
Inventor
正樹 春名
貴景 森本
亜紀 嶺岸
朋希 延命
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Publication of JPWO2022030047A1 publication Critical patent/JPWO2022030047A1/ja
Priority to JP2022126408A priority Critical patent/JP2022172112A/ja
Application granted granted Critical
Publication of JP7397879B2 publication Critical patent/JP7397879B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1679—Program controls characterised by the tasks executed
    • B25J9/1689—Teleoperation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Program-control systems
    • G05B19/02—Program-control systems electric
    • G05B19/18—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of program data in numerical form
    • G05B19/409—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of program data in numerical form characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/35—Nc in input of data, input till input file format
    • G05B2219/35438—Joystick
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/35—Nc in input of data, input till input file format
    • G05B2219/35506—Camera images overlayed with graphics, model
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/36—Nc in input of data, input key till input tape
    • G05B2219/36447—Project light on path to be followed, keep also distance constant
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/37—Measurements
    • G05B2219/37571—Camera detecting reflected light from laser
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/39—Robotics, robotics to robotics hand
    • G05B2219/39014—Match virtual world with real world
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/39—Robotics, robotics to robotics hand
    • G05B2219/39451—Augmented reality for robot programming
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40131—Virtual reality control, programming of manipulator
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40168—Simulated display of remote site, driven by operator interaction
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40382—Limit allowable area where robot can be teached
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40478—Graphic display of work area of robot, forbidden, permitted zone
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40617—Agile eye, control position of camera, active vision, pan-tilt camera, follow object

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Manufacturing & Machinery (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Manipulator (AREA)
JP2021559199A 2020-08-03 2021-04-19 遠隔操作装置 Active JP7397879B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022126408A JP2022172112A (ja) 2020-08-03 2022-08-08 遠隔操作装置

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2020131900 2020-08-03
JP2020131900 2020-08-03
PCT/JP2021/015911 WO2022030047A1 (ja) 2020-08-03 2021-04-19 遠隔操作装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2022126408A Division JP2022172112A (ja) 2020-08-03 2022-08-08 遠隔操作装置

Publications (2)

Publication Number Publication Date
JPWO2022030047A1 JPWO2022030047A1 (https=) 2022-02-10
JP7397879B2 true JP7397879B2 (ja) 2023-12-13

Family

ID=80117226

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2021559199A Active JP7397879B2 (ja) 2020-08-03 2021-04-19 遠隔操作装置
JP2022126408A Pending JP2022172112A (ja) 2020-08-03 2022-08-08 遠隔操作装置

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2022126408A Pending JP2022172112A (ja) 2020-08-03 2022-08-08 遠隔操作装置

Country Status (5)

Country Link
US (1) US12598375B2 (https=)
EP (1) EP4190513A4 (https=)
JP (2) JP7397879B2 (https=)
CN (1) CN116056843A (https=)
WO (1) WO2022030047A1 (https=)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7397879B2 (ja) * 2020-08-03 2023-12-13 三菱電機株式会社 遠隔操作装置
WO2024102726A1 (en) * 2022-11-07 2024-05-16 Noland Samantha Systems and methods to configure a robotic welding system
JP7814651B1 (ja) * 2025-02-07 2026-02-16 三菱電機株式会社 空間把握支援システム

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004223128A (ja) 2003-01-27 2004-08-12 Hitachi Ltd 医療行為支援装置および方法
JP2004243516A (ja) 2003-02-11 2004-09-02 Kuka Roboter Gmbh コンピュータによって生成された情報を現実環境の画像へとフェードインするための方法、およびコンピュータによって生成された情報を現実環境の画像に視覚化するための装置
JP2012236244A (ja) 2011-05-10 2012-12-06 Sony Corp ロボット装置、ロボット装置の制御方法、並びにロボット装置制御用プログラム
JP2014180723A (ja) 2013-03-19 2014-09-29 Yaskawa Electric Corp ロボットシステム及び被加工物の製造方法
JP2016531008A (ja) 2013-07-30 2016-10-06 ゴムテック ゲーエムベーハー ロボットの作業領域を定める方法及び装置
JP2016538894A (ja) 2013-10-01 2016-12-15 アーベーベー ゴムテック ゲーエムベーハー ジェスチャ制御を用いるロボットシステム制御用の制御装置及び方法
WO2019012812A1 (ja) 2017-07-12 2019-01-17 ソニー株式会社 制御装置及び制御方法、並びにマスタ－スレーブ・システム

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6044293A (ja) * 1983-08-18 1985-03-09 株式会社日立製作所 産業用ロボットの制御装置
JP2792842B2 (ja) * 1996-02-07 1998-09-03 川崎重工業株式会社 ロボット作業教示方法および装置
JPH11347983A (ja) 1998-06-11 1999-12-21 Meidensha Corp マニプレータの動作制限装置
US6581437B2 (en) * 2000-05-12 2003-06-24 Alberta Research Council Inc. Motion platform and method of use
KR20040099739A (ko) * 2003-05-20 2004-12-02 오리온피디피주식회사 전극패드부에 하지막을 구비한 플라즈마 디스플레이 패널
JP2006113858A (ja) * 2004-10-15 2006-04-27 Mitsubishi Heavy Ind Ltd 移動体の遠隔操作支援方法及びシステム
US9789608B2 (en) * 2006-06-29 2017-10-17 Intuitive Surgical Operations, Inc. Synthetic representation of a surgical robot
JP2007029232A (ja) 2005-07-25 2007-02-08 Hitachi Medical Corp 内視鏡手術操作支援システム
JP5178406B2 (ja) 2008-09-03 2013-04-10 株式会社Ｉｈｉエアロスペース 遠隔操縦システム
US8676382B2 (en) 2010-05-26 2014-03-18 GM Global Technology Operations LLC Applying workspace limitations in a velocity-controlled robotic mechanism
JP2015513858A (ja) * 2012-03-02 2015-05-14 エイチ4 エンジニアリング, インコーポレイテッドH4 Engineering, Inc. 多機能自動ビデオ記録装置
JP5974668B2 (ja) * 2012-06-25 2016-08-23 国立大学法人 筑波大学 マニピュレーションシステム
CN103056883B (zh) * 2013-01-11 2015-07-15 山东电力集团公司电力科学研究院 一种双机械臂协调控制系统及控制方法
US20150074749A1 (en) * 2013-09-10 2015-03-12 Rockwell Automation Technologies, Inc. Remote asset management services for industrial assets
JP6106122B2 (ja) * 2014-04-02 2017-03-29 ファナック株式会社 溶接検査ロボットシステム
CN107206947B (zh) * 2015-02-06 2019-09-06 三菱电机株式会社 车载设备操作装置及车载设备操作系统
WO2016137527A1 (en) 2015-02-24 2016-09-01 Sri International Hyperdexterous system user interface
JP2017013206A (ja) * 2015-07-03 2017-01-19 株式会社デンソーウェーブ ロボットシステム
CN105632293B (zh) * 2016-03-29 2019-03-12 北京双安达科技有限公司 智能教练车辅助教学系统及其使用方法
JP2018008347A (ja) * 2016-07-13 2018-01-18 東芝機械株式会社 ロボットシステムおよび動作領域表示方法
CN106973218B (zh) * 2017-01-23 2019-09-27 北京小米移动软件有限公司 智能飞行设备的拍摄方法及智能飞行设备
JP6445092B2 (ja) * 2017-05-31 2018-12-26 ファナック株式会社 ロボットの教示のための情報を表示するロボットシステム
WO2019092792A1 (ja) * 2017-11-07 2019-05-16 三菱電機株式会社 表示制御装置、表示制御方法および表示制御プログラム
JP2019084645A (ja) * 2017-11-09 2019-06-06 国立大学法人 東京大学 位置情報取得装置およびそれを備えたロボット制御装置
JP7259284B2 (ja) * 2017-11-28 2023-04-18 株式会社デンソーウェーブ 教示装置、教示方法
US11366525B2 (en) * 2018-07-03 2022-06-21 Boyd Randolph Hobbs Handwheels and associated control consoles
JP2020013548A (ja) * 2018-07-06 2020-01-23 キヤノン株式会社 画像処理装置、画像処理方法、システム、物品の製造方法
CN118700167A (zh) 2018-11-01 2024-09-27 佳能株式会社 输入设备、机器人系统、其控制方法和制造物品的方法
JP7250489B2 (ja) * 2018-11-26 2023-04-03 キヤノン株式会社 画像処理装置およびその制御方法、プログラム
JP7000364B2 (ja) * 2019-01-29 2022-01-19 ファナック株式会社 ロボットシステム
JP7517803B2 (ja) * 2019-10-23 2024-07-17 ファナック株式会社 ロボット教示システム、画像生成方法、及びプログラム
JP7397879B2 (ja) 2020-08-03 2023-12-13 三菱電機株式会社 遠隔操作装置
KR20220036645A (ko) * 2020-09-16 2022-03-23 김덕우 카메라서비스 시스템 및 방법

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004223128A (ja) 2003-01-27 2004-08-12 Hitachi Ltd 医療行為支援装置および方法
JP2004243516A (ja) 2003-02-11 2004-09-02 Kuka Roboter Gmbh コンピュータによって生成された情報を現実環境の画像へとフェードインするための方法、およびコンピュータによって生成された情報を現実環境の画像に視覚化するための装置
JP2012236244A (ja) 2011-05-10 2012-12-06 Sony Corp ロボット装置、ロボット装置の制御方法、並びにロボット装置制御用プログラム
JP2014180723A (ja) 2013-03-19 2014-09-29 Yaskawa Electric Corp ロボットシステム及び被加工物の製造方法
JP2016531008A (ja) 2013-07-30 2016-10-06 ゴムテック ゲーエムベーハー ロボットの作業領域を定める方法及び装置
JP2016538894A (ja) 2013-10-01 2016-12-15 アーベーベー ゴムテック ゲーエムベーハー ジェスチャ制御を用いるロボットシステム制御用の制御装置及び方法
WO2019012812A1 (ja) 2017-07-12 2019-01-17 ソニー株式会社 制御装置及び制御方法、並びにマスタ－スレーブ・システム

Also Published As

Publication number Publication date
US12598375B2 (en) 2026-04-07
EP4190513A4 (en) 2024-01-24
EP4190513A1 (en) 2023-06-07
US20230292000A1 (en) 2023-09-14
JP2022172112A (ja) 2022-11-15
CN116056843A (zh) 2023-05-02
WO2022030047A1 (ja) 2022-02-10
JPWO2022030047A1 (https=) 2022-02-10

Similar Documents

Publication Publication Date Title
JP7397879B2 (ja) 遠隔操作装置
Pan et al. Augmented reality-based robot teleoperation system using RGB-D imaging and attitude teaching device
JP6843051B2 (ja) 遠隔操作ロボットシステム
US9002517B2 (en) Telematic interface with directional translation
CN104942803B (zh) 机器人控制装置、机器人、机器人系统、示教方法及程序
KR101832346B1 (ko) 사용자 상호 장치 및 방법
JP2004213673A (ja) 強化現実システム及び方法
Ruffaldi et al. Third point of view augmented reality for robot intentions visualization
JP2020150297A (ja) リモートカメラシステム、コントロールシステム、映像出力方法、バーチャルカメラワークシステム、及びプログラム
JP2011101915A (ja) ロボットシステム
JP5800610B2 (ja) 医療用マスタスレーブマニピュレータ
JP2018144228A (ja) ロボット制御装置、ロボット、ロボットシステム、教示方法、及びプログラム
CN107000205A (zh) 机器人装置及机器人控制装置
Preusche et al. Haptics in telerobotics: Current and future research and applications
JP2003181785A (ja) 遠隔操作装置
JP2010079654A (ja) ロボット操作装置及びロボット操作システム
JP2000042960A (ja) マニピュレータの遠隔操作装置
WO2025024508A1 (en) View-based motion of imaging instruments
JPH0430981A (ja) 遠隔操縦型ロボットのテレビカメラ制御装置
JP2023017436A (ja) ロボット制御装置
KR102922902B1 (ko) 학습데이터 생성을 위한 무동력 교시장치
CN113612928A (zh) 遥操作系统、遥操作方法及芯片
KR102907654B1 (ko) 유니버셜추론모델을 이용한 개별로봇의 자동제어방법 및 시스템
JP2023017440A (ja) 画像処理装置
JPWO2020203819A1 (ja) 遠隔操作装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20211004

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20211004

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20211004

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220118

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220308

RD01 Notification of change of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7421

Effective date: 20220427

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20220510

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220714

C60 Trial request (containing other claim documents, opposition documents)

Free format text: JAPANESE INTERMEDIATE CODE: C60

Effective date: 20220714

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20220722

C21 Notice of transfer of a case for reconsideration by examiners before appeal proceedings

Free format text: JAPANESE INTERMEDIATE CODE: C21

Effective date: 20220726

A912 Re-examination (zenchi) completed and case transferred to appeal board

Free format text: JAPANESE INTERMEDIATE CODE: A912

Effective date: 20220902

C211 Notice of termination of reconsideration by examiners before appeal proceedings

Free format text: JAPANESE INTERMEDIATE CODE: C211

Effective date: 20220906

C22 Notice of designation (change) of administrative judge

Free format text: JAPANESE INTERMEDIATE CODE: C22

Effective date: 20230314

C13 Notice of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: C13

Effective date: 20230418

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230530

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230911

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20231201

R150 Certificate of patent or registration of utility model

Ref document number: 7397879

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150