JPH08216065A - Remote control device of mobile manipulator - Google Patents

Remote control device of mobile manipulator

Info

Publication number
JPH08216065A
JPH08216065A JP7046312A JP4631295A JPH08216065A JP H08216065 A JPH08216065 A JP H08216065A JP 7046312 A JP7046312 A JP 7046312A JP 4631295 A JP4631295 A JP 4631295A JP H08216065 A JPH08216065 A JP H08216065A
Authority
JP
Japan
Prior art keywords
manipulator
work
mobile
moving means
remote
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP7046312A
Other languages
Japanese (ja)
Inventor
Kenichi Yasuda
賢一 安田
Hiroyuki Maezawa
宏之 前澤
Koji Nakajima
浩二 中島
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yaskawa Electric Corp
Original Assignee
Yaskawa Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yaskawa Electric Corp filed Critical Yaskawa Electric Corp
Priority to JP7046312A priority Critical patent/JPH08216065A/en
Publication of JPH08216065A publication Critical patent/JPH08216065A/en
Pending legal-status Critical Current

Links

Landscapes

  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Manipulator (AREA)

Abstract

PURPOSE: To reduce a work burden by providing a means to switch operation to control to cooperate with an operation command of a manipulator when a moving means completes an autonomous movement up to a work point in a remote control device of a mobile manipulator having the moving means to autonomously move while avoiding an obstacle. CONSTITUTION: A mobile robot manipulator 1 autonomously moves up to a work point while avoiding an obstacle by an obstacle detecting part 4c and a monitoring camera 1c. When it arrives at the work point, an operator OP performs various works by operating a manipulator 1a by a manipulator operating device 2a while looking at the state of affairs of a job site whose image is picked up by the monitoring camera 1c by an image display device 2b. In this case, after the manipulator 1 arrives at the work point, a moving carriage 1b is switched to an automatic adjusting mode, and at this time, a movement of the carriage is determined by a manipulator control part, and for example, when approach is determined, an approach flag is transmitted to a moving carriage control part.

Description

【発明の詳細な説明】Detailed Description of the Invention

【0001】[0001]

【産業上の利用分野】本発明は遠隔操作を行う移動型マ
ニピュレータ、すなわち、無人搬送車のような自律移動
手段上に搭載されたマスタ・スレープ型のロボットマニ
ピュレータの遠隔制御装置に関する。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a remote control device for a mobile manipulator for remote operation, that is, a master-slave type robot manipulator mounted on an autonomous moving means such as an automatic guided vehicle.

【0002】[0002]

【従来の技術】作業地点まで移動手段(例えば移動台
車)が移動し、そこでメンテナンス、修理、採取などの
作業を行う際、マニピュレータの作業範囲や関節軸の可
動範囲など、運動学的な制限ために、マニピュレータの
手先が作業対象物に届かなかったり、無理な姿勢をとら
ないと作業ができないために関節軸のリミットにかかっ
たりする場合がある。このような状況になった時、従来
はオペレータ自身が移動台の位置を調整しながら作業を
行っていた。そのためにマニピュレータの操作装置の他
に移動台車の操作装置も必要となっていた。ところが、
オペレータはいつマニピュレータの手先が作業範囲の限
界に来るかわからないため作業に集中できない、移動台
の位置の調整を行わなければならないので作業負担が増
える、作業時間が長くなるなどの問題があった。一方、
実公平6−41818号公報には、移動台車の操作装置
を必要とせず、マニピュレータの作業範囲の限界点に達
しても、移動台を所定の作業域方向に移動させるように
した装置が開示されている。
2. Description of the Related Art When a moving means (for example, a mobile trolley) moves to a work point and performs work such as maintenance, repair, and collection there, due to kinematic restrictions such as a work range of a manipulator and a movable range of a joint shaft In addition, the manipulator's hand may not reach the work object, or the manipulator may be unable to work unless the manipulator is in an unnatural posture, and the manipulator may be limited by the joint axis. In such a situation, conventionally, the operator himself worked while adjusting the position of the movable table. Therefore, in addition to the manipulator operating device, an operating device for the moving carriage is required. However,
There is a problem that the operator cannot concentrate on the work because he / she does not know when the hand of the manipulator reaches the limit of the work range, the work load increases because the position of the moving table must be adjusted, and the work time increases. on the other hand,
Japanese Utility Model Publication No. 6-41818 discloses a device that does not require an operating device for a moving carriage and that moves the moving base in a predetermined work area direction even when the operating range of the manipulator is reached. ing.

【0003】[0003]

【発明が解決しようとする課題】しかし、実公平6−4
1818号公報に開示された技術では、ブームは自律移
動するものではなく、さらにマスタアームとスレーブア
ームが幾何学的に相似の関係にあるという前提があり、
またマスタアームにリミットを検出するエンドセンサー
と、負荷を検出する負荷検出手段を設ける必要がある。
したがって、マスタアームとスレーブアームが幾何学的
に異なる関係にある場合(例えば、マスタ側がジョイス
ティックの場合)には適用できないという問題がある。
そこで本発明は、マスタアームとスレーブアームが幾何
学的に異なる関係にある場合でも、マスタ側に特別な検
出器を取り付けることなく、自動的に移動台の位置を協
調して遠隔操作できる装置を提供することを目的とす
る。
[Problems to be Solved by the Invention] However, the fairness 6-4
In the technology disclosed in Japanese Patent No. 1818, the boom does not move autonomously, and there is a premise that the master arm and the slave arm have a geometrically similar relationship.
Further, it is necessary to provide the master arm with an end sensor for detecting a limit and a load detecting means for detecting a load.
Therefore, there is a problem that it cannot be applied when the master arm and the slave arm have a geometrically different relationship (for example, when the master side is a joystick).
Therefore, the present invention provides a device capable of automatically operating the position of the moving base in cooperation with each other remotely without attaching a special detector on the master side even when the master arm and the slave arm have a geometrically different relationship. The purpose is to provide.

【0004】[0004]

【課題を解決するための手段】上記問題を解決するた
め、本発明は、作業用のマニピュレータと監視カメラを
搭載し作業地点まで予め記憶した経路にほぼ沿って周囲
の環境を認識して障害物を回避しながら自律移動する移
動手段と、前記監視カメラが撮像した作業地点の画像を
離れた場所にいるオペレータに表示する画像表示装置
と、前記作業用のマニピュレータを遠隔操作する遠隔操
作装置とを有する移動型マニピュレータの遠隔制御装置
において、前記移動手段が作業地点まで自律移動が完了
すると、前記移動手段の自律移動制御を前記遠隔操作装
置からのマニピュレータの操作指令に協調する制御に切
り換える手段を設けたことを特徴とするものである。
In order to solve the above problems, the present invention is equipped with a manipulator for work and a surveillance camera, recognizes the surrounding environment substantially along a route stored in advance to a work point, and detects obstacles. A moving means that moves autonomously while avoiding the above, an image display device that displays an image of the work point captured by the surveillance camera to an operator at a remote place, and a remote control device that remotely operates the manipulator for work. In the remote control device for the mobile manipulator, the mobile means is provided with means for switching to autonomous control of the mobile means when the mobile means completes the autonomous movement to the work point, the control being in coordination with the manipulator operation command from the remote operation device. It is characterized by that.

【0005】[0005]

【作用】上記手段により、移動手段が作業地点まで自律
移動が完了すると、自動的に前記移動手段の自律移動制
御が、前記遠隔操作装置からのマニピュレータの操作指
令に協調する制御に切り替わるので、オペレータはマニ
ピュレータの運動学的な制限と移動台車の位置等を何等
考慮することなく作業を続行できる。
When the moving means completes the autonomous movement to the work point by the above means, the autonomous movement control of the moving means is automatically switched to the control cooperating with the manipulator operation command from the remote operation device. Can continue working without considering the kinematic restrictions of the manipulator and the position of the moving carriage.

【0006】[0006]

【実施例】以下、移動台を移動台車とした場合の本発明
の実施例を図に基づいて説明する。図1は、本発明で想
定した作業システムの例である。1は移動型ロボットマ
ニピュレータであり、マニピュレータ1a、監視カメラ
1c、無線通信装置1d、障害物検出部4cが自律移動
台車1bに搭載された構成である。この移動型ロボット
マニピュレータ1を操作するロボット操作部2は、マニ
ピュレータ操作装置2a、画像表示装置2b、無線通信
装置2cからなり、オペレータOPによって操作され
る。このシステムは、移動型ロボットマニピュレータ1
は障害物検出部4cまたは監視カメラ1cによって障害
物をよけながら、作業地点まで自律移動を行い、作業地
点に到着すると、ロボット操作部2を操作するオペレー
タOPは、画像表示装置2bで監視カメラ1cにより撮
像された作業現場の様子を見ながら、マニピュレータ操
作装置2aによってマニピュレータ1aを操作して配管
修理などの作業を行うというシステムである。なお、移
動型ロボットマニピュレータ1とロボット操作部2は無
線通信装置1dと2cによって通信を行う。マニピュレ
ータ操作装置2aは、本例では、磁気センサ等を利用
し、信号線等に拘束されることのないもの(例えば、特
開平1−153288号公報や本出願人の特願平6−6
7748「マスターハンド装置」)を利用できる。
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention in which the mobile table is a mobile vehicle will be described below with reference to the drawings. FIG. 1 is an example of a work system assumed in the present invention. A mobile robot manipulator 1 has a configuration in which a manipulator 1a, a surveillance camera 1c, a wireless communication device 1d, and an obstacle detection unit 4c are mounted on an autonomous mobile vehicle 1b. A robot operating unit 2 for operating the mobile robot manipulator 1 includes a manipulator operating device 2a, an image display device 2b, and a wireless communication device 2c, and is operated by an operator OP. This system is a mobile robot manipulator 1
Is moving autonomously to the work point while avoiding obstacles by the obstacle detection unit 4c or the surveillance camera 1c, and when reaching the work point, the operator OP who operates the robot operation unit 2 uses the image display device 2b to monitor the surveillance camera. This is a system in which the manipulator 1a is operated by the manipulator operating device 2a to perform work such as pipe repair while watching the state of the work site imaged by 1c. The mobile robot manipulator 1 and the robot operation unit 2 communicate with each other via the wireless communication devices 1d and 2c. In this example, the manipulator operating device 2a uses a magnetic sensor or the like and is not restricted by a signal line or the like (for example, JP-A-1-153288 or Japanese Patent Application No. 6-6 of the present applicant).
7748 "master hand device").

【0007】移動型ロボットマニピュレータ1が作業地
点に到着した後は、移動台車1bは自動調整モードに入
る(自律制御から自動調整モードに切り換える)。図2
はその自動調整モードに入った時のマニピュレータ1a
を制御するマニピュレータ制御部3と、移動台車1bを
制御する移動台車制御部4の制御ブロック図である。な
お、マニピュレータ制御部3と、移動台車制御部4は移
動型ロボットマニピュレータ1上に搭載されているが図
1には示していない。マニピュレータ制御部3は動作指
令入力部3aによってマニピュレータ操作装置2aによ
る動作指令を受け取る。その後関節角リミット接近検出
部3cと作業範囲境界接近検出部3dを通って接近判定
部3eによって台車の移動判定を行う。関節リミット、
作業範囲境界両方とも接近の判定がなければマニピュレ
ータへ動作指令を角軸へ出力する。接近判定があれば、
移動台車制御部(自動調整モード)4へ接近フラグを送
信する。移動台車制御部(自動調整モード)4は移動フ
ラグ検出部4aによってマニピュレータ制御部3の接近
判定部3eからの接近フラグを検出する。検出しなけれ
ば停止指令を出力して、移動台車は停止したままとな
る。接近フラグを検出すると、ロボット操作部2の指令
から移動方向・速度演算部4bで台車の移動方向と速度
を計算する。そして障害物の検出がなければ、台車のモ
ータへ動作指令を出力する。
After the mobile robot manipulator 1 arrives at the work point, the movable carriage 1b enters the automatic adjustment mode (switches from autonomous control to automatic adjustment mode). Figure 2
Is the manipulator 1a when the automatic adjustment mode is entered.
FIG. 3 is a control block diagram of a manipulator control unit 3 that controls the moving carriage and a moving carriage control unit 4 that controls the moving carriage 1b. Although the manipulator control unit 3 and the moving carriage control unit 4 are mounted on the mobile robot manipulator 1, they are not shown in FIG. The manipulator control unit 3 receives an operation command from the manipulator operating device 2a via the operation command input unit 3a. After that, the movement determination of the trolley is performed by the approach determination unit 3e through the joint angle limit approach detection unit 3c and the work range boundary approach detection unit 3d. Joint limits,
If both work range boundaries are not approached, the manipulator outputs a motion command to the angular axis. If there is an approach decision,
An approach flag is transmitted to the moving carriage control unit (automatic adjustment mode) 4. The moving carriage control unit (automatic adjustment mode) 4 detects the approach flag from the approach determination unit 3e of the manipulator control unit 3 by the movement flag detection unit 4a. If not detected, a stop command is output, and the moving carriage remains stopped. When the approach flag is detected, the moving direction / speed calculating unit 4b calculates the moving direction and speed of the carriage from the command from the robot operating unit 2. If no obstacle is detected, an operation command is output to the truck motor.

【0008】図3はこの協調制御方式によるマニピュレ
ータと移動台車の動作例を示している。マニピュレータ
の手先1a’が予め設定された作業範囲境界線に接近す
ると(マニピュレータの手先1a’が作業範囲境界接近
線に到達すると)、マニピュレータ1aの動作が停止
し、その接近する方向に移動台車1bが移動する(図3
(a)参照)。また、ある関節軸が予め設定された関節
角リミットに接近すると、マニピュレータ1aの動作が
停止し、マニピュレータの手先1a’の動作方向に移動
台車1bが移動する(図3(b)参照)。
FIG. 3 shows an example of the operation of the manipulator and the mobile carriage according to this cooperative control system. When the hand 1a 'of the manipulator approaches the preset work range boundary line (when the hand 1a' of the manipulator reaches the work range boundary approach line), the operation of the manipulator 1a stops and the moving carriage 1b moves in the approaching direction. Move (Fig. 3
(See (a)). Further, when a certain joint axis approaches a preset joint angle limit, the operation of the manipulator 1a is stopped and the moving carriage 1b moves in the operation direction of the hand 1a 'of the manipulator (see FIG. 3 (b)).

【0009】[0009]

【発明の効果】以上述べたように、本発明によれば、オ
ペレータが操作するマニピュレータが作業範囲を越えよ
うとするときや、マニピュレータの無理な姿勢によって
ある関節軸がリミットに近づいた時に、自動的に移動台
車の位置が調整されるため、オペレータはマニピュレー
タの運動学的な制限を考慮することなく作業に集中で
き、作業負担が軽減されるので作業時間の短縮が可能と
なる効果がある。
As described above, according to the present invention, when the manipulator operated by the operator tries to exceed the working range, or when a certain joint axis approaches the limit due to an unreasonable posture of the manipulator, the automatic Since the position of the movable carriage is adjusted, the operator can concentrate on the work without considering the kinematic limitation of the manipulator, and the work load is reduced, and the work time can be shortened.

【図面の簡単な説明】[Brief description of drawings]

【図1】本発明の想定した作業状況の例FIG. 1 is an example of a work situation assumed by the present invention.

【図2】本発明の実施例を示す制御ブロック図FIG. 2 is a control block diagram showing an embodiment of the present invention.

【図3】本発明の作用説明図FIG. 3 is an explanatory view of the operation of the present invention

【符号の説明】[Explanation of symbols]

1…移動型ロボットマニピュレータ 1a…マニピュレータ 1a’…マニピュレータの手先 1b…移動台車 1c…監視カメラ 1d…無線通信装置 2…ロボット操作部 2a…マニピュレータ操作装置 2b…画像表示装置 2c…無線通信装置 3…マニピュレータ制御部 4…移動台車制御部(自動調整モード) 4c…障害物検出部 DESCRIPTION OF SYMBOLS 1 ... Mobile robot manipulator 1a ... Manipulator 1a '... Manipulator hand 1b ... Mobile cart 1c ... Monitoring camera 1d ... Wireless communication device 2 ... Robot operating unit 2a ... Manipulator operating device 2b ... Image display device 2c ... Wireless communication device 3 ... Manipulator control unit 4 ... Mobile trolley control unit (automatic adjustment mode) 4c ... Obstacle detection unit

Claims (3)

【特許請求の範囲】[Claims] 【請求項1】 作業用のマニピュレータと監視カメラを
搭載し作業地点まで予め記憶した経路にほぼ沿って周囲
の環境を認識して障害物を回避しながら自律移動する移
動手段と、前記監視カメラが撮像した作業地点の画像を
離れた場所にいるオペレータに表示する画像表示装置
と、前記作業用のマニピュレータを遠隔操作する遠隔操
作装置とを有する移動型マニピュレータの遠隔制御装置
において、 前記移動手段が作業地点まで自律移動が完了すると、前
記移動手段の自律移動制御を前記遠隔操作装置からのマ
ニピュレータの操作指令に協調する制御に切り換える手
段を設けたことを特徴とする移動型マニピュレータの遠
隔制御装置。
1. A moving means for carrying a manipulator for work and a surveillance camera, which autonomously moves while recognizing the surrounding environment and avoiding obstacles along a prestored route to a work point, and the surveillance camera. In a remote control device for a mobile manipulator, comprising: an image display device for displaying an image of a captured work point to an operator at a remote place; and a remote operation device for remotely operating the work manipulator, wherein the moving means is a work device. A remote control device for a mobile manipulator, comprising means for switching the autonomous movement control of the moving means to control in cooperation with a manipulator operation command from the remote operation device when the autonomous movement to the point is completed.
【請求項2】 前記マニピュレータの操作指令に協調す
る制御は、前記遠隔操作装置からのマニピュレータの操
作指令を解析することにより、マニピュレータがマニピ
ュレータ自体の作業範囲制限に近づいた時、移動手段に
対して作業対象に近づく移動指令を発するものである請
求項1記載の移動型マニピュレータの遠隔制御装置。
2. The control that cooperates with the operation command of the manipulator analyzes the operation command of the manipulator from the remote operation device, and when the manipulator approaches the work range limit of the manipulator itself, the moving means is operated. The remote control device for a mobile manipulator according to claim 1, which issues a movement command to approach a work target.
【請求項3】 前記マニピュレータの操作指令に協調す
る制御は、前記遠隔操作装置からのマニピュレータの操
作指令を解析することにより、各ある関節軸の回転制限
角度に近づいた時、移動手段に対してそれを脱する方向
に移動する指令を発するものである請求項1記載の移動
型マニピュレータの遠隔制御装置。
3. The control that cooperates with the operation command of the manipulator analyzes the operation command of the manipulator from the remote operation device, and when the manipulator approaches a rotation limit angle of each joint shaft, the moving means is moved. 2. The remote control device for a mobile manipulator according to claim 1, which issues a command to move in a direction away from it.
JP7046312A 1995-02-10 1995-02-10 Remote control device of mobile manipulator Pending JPH08216065A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP7046312A JPH08216065A (en) 1995-02-10 1995-02-10 Remote control device of mobile manipulator

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP7046312A JPH08216065A (en) 1995-02-10 1995-02-10 Remote control device of mobile manipulator

Publications (1)

Publication Number Publication Date
JPH08216065A true JPH08216065A (en) 1996-08-27

Family

ID=12743665

Family Applications (1)

Application Number Title Priority Date Filing Date
JP7046312A Pending JPH08216065A (en) 1995-02-10 1995-02-10 Remote control device of mobile manipulator

Country Status (1)

Country Link
JP (1) JPH08216065A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005018882A1 (en) * 2003-08-21 2005-03-03 Tmsuk Co., Ltd. Robot system and remote operation system of robot
JP2010064198A (en) * 2008-09-11 2010-03-25 Kawada Kogyo Kk Robot working position correcting system, and simple installation type robot with the system
JP2012002419A (en) * 2010-06-16 2012-01-05 Ihi Aerospace Co Ltd Fighting vehicle
JP2019063951A (en) * 2017-10-02 2019-04-25 株式会社オカムラ Work system, work system control method and program
CN110216698A (en) * 2019-03-11 2019-09-10 浙江工业大学 A kind of mechanical arm remote control system based on ROS

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005018882A1 (en) * 2003-08-21 2005-03-03 Tmsuk Co., Ltd. Robot system and remote operation system of robot
JP2010064198A (en) * 2008-09-11 2010-03-25 Kawada Kogyo Kk Robot working position correcting system, and simple installation type robot with the system
JP2012002419A (en) * 2010-06-16 2012-01-05 Ihi Aerospace Co Ltd Fighting vehicle
JP2019063951A (en) * 2017-10-02 2019-04-25 株式会社オカムラ Work system, work system control method and program
CN110216698A (en) * 2019-03-11 2019-09-10 浙江工业大学 A kind of mechanical arm remote control system based on ROS

Similar Documents

Publication Publication Date Title
US11039895B2 (en) Industrial remote control robot system
CN101625573B (en) Digital signal processor based inspection robot monocular vision navigation system
US11753281B2 (en) Method for crane assembly
WO2005002783A1 (en) Parts conveying and attaching method and device therefor
JP3398009B2 (en) Remote control system
JPH0811071A (en) Controller for manipulator
CN111422739A (en) Electronic anti-swing method of bridge crane based on vision technology
JPH08216065A (en) Remote control device of mobile manipulator
CN110696012B (en) Intelligent robot system for distribution room
JP6988713B2 (en) Remote control system for industrial vehicles
JPH09149309A (en) Running-type checking robot
JPH09115088A (en) Monitor system for inside tunnel
CN105313129B (en) A kind of robot ambulation motion control method and device based on video
JP2023136380A (en) Regulation area management system, mobile object management system, regulation area management method, and program
JP3901006B2 (en) Visual recognition device
CN113352314A (en) Robot motion control system and method based on closed-loop feedback
CN219341497U (en) Lifting appliance positioning system, crown block control system and crown block
US20230333550A1 (en) Remote operation system, remote operation method, and storage medium
CN216030878U (en) Intelligent forking robot
CN113208734B (en) Surgical robot and positioning method
JPH1139035A (en) Robot remote control system
JPH0787541B2 (en) Image information transmission device
JP4219996B2 (en) robot
JP2597278B2 (en) Teaching device
JPH05285880A (en) High place working device

Legal Events

Date Code Title Description
A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20040217