JPH0811071A - Controller for manipulator - Google Patents

Controller for manipulator

Info

Publication number
JPH0811071A
JPH0811071A JP6171894A JP17189494A JPH0811071A JP H0811071 A JPH0811071 A JP H0811071A JP 6171894 A JP6171894 A JP 6171894A JP 17189494 A JP17189494 A JP 17189494A JP H0811071 A JPH0811071 A JP H0811071A
Authority
JP
Japan
Prior art keywords
slave manipulator
camera
surveillance camera
manipulator
slave
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP6171894A
Other languages
Japanese (ja)
Inventor
Kenichi Yasuda
賢一 安田
Shinji Murai
真二 村井
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yaskawa Electric Corp
Original Assignee
Yaskawa Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yaskawa Electric Corp filed Critical Yaskawa Electric Corp
Priority to JP6171894A priority Critical patent/JPH0811071A/en
Publication of JPH0811071A publication Critical patent/JPH0811071A/en
Pending legal-status Critical Current

Links

Landscapes

  • Manipulator (AREA)

Abstract

PURPOSE:To reduce a burden of an operator by arranging a means outputting a movement command by which a hand position in a slave manipulator is moved at a speed proportional to a ratio of a focal distance of a monitor camera to a distance from the monitor camera to the hand position in the slave manipulator. CONSTITUTION:An operator 9 operates a joy stick 6 while observing an image caught by a camera device 3 on a TV monitor 5. The operating direction of the joy stick 6 is inputted to a master controller 8 so as to be sent to a slave controller 4. In the slave controller 4, instruction to a slave manipulator 1 is carried out in such ways as detecting a focal distance and position quantity of a camera from the camera device 3, computing a moving speed of a slave manipulator controlling point 2 in a camera coordinate system on the basis of the operation quantity and the operating direction of the joy stick 6, transforming the coordinate system to a robot coordinate system, and then, transforming the speed to those in respective axes in articulation space.

Description

【発明の詳細な説明】Detailed Description of the Invention

【0001】[0001]

【産業上の利用分野】本発明は、遠隔操作を行うマスタ
ースレーブマニピュレータの制御装置に関し、特に、制
御装置のスレーブマニピュレータの作業空間各軸移動量
演算を行うものに関する。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a control device for a master-slave manipulator which is remotely operated, and more particularly to a device for calculating a movement amount of each axis of a work space of a slave manipulator of the control device.

【0002】[0002]

【従来の技術】非構造環境下などにおいて監視カメラを
用いてスレーブマニピュレータをジョイスティックやマ
スターアームを用いて遠隔操縦することによって作業を
行うとき、スレーブマニピュレータのエンドエフェクタ
を作業対象物にある距離まで接近させる場合は、広角で
環境周囲の映像を捉えながらマニピュレータのエンドエ
フェクタを移動させ、作業対象物にアプローチして実際
に作業を行う場合は、ズームカメラに切り換えるか、ズ
ームアップ操作することによって作業対象物を大きく捉
え、慎重な作業を行っている。この時、スレーブマニピ
ュレータの移動速度はオペレータによるジョイスティッ
クやマスターアームの操作量に対して一定に設定してい
るか、あるいは、速度切り換えスイッチによってオペレ
ータがスイッチ操作することによって移動速度を切り換
えている。また、カメラのズーム率に対応してオペレー
タの操作量に対するスレーブマニピュレータの移動速度
の割合を変化させる方法もある(特開平4−10178
8号公報)。そしてこの時、移動方向はいずれの場合も
オペレータの操作方向に対し常に一定である。
2. Description of the Related Art When working by operating a slave manipulator remotely with a joystick or a master arm using a surveillance camera in an unstructured environment, the end effector of the slave manipulator approaches a work object to a certain distance. To do this, move the end effector of the manipulator while capturing a wide-angle image of the surroundings of the environment.When approaching the work object and actually performing the work, switch to the zoom camera or perform the zoom-up operation. They take big things and carry out careful work. At this time, the moving speed of the slave manipulator is set to be constant with respect to the operation amount of the joystick or the master arm by the operator, or the moving speed is switched by the operator operating the speed changeover switch. There is also a method of changing the ratio of the moving speed of the slave manipulator to the operation amount of the operator according to the zoom ratio of the camera (Japanese Patent Laid-Open No. 4-10178).
No. 8). At this time, the movement direction is always constant with respect to the operation direction of the operator in any case.

【0003】[0003]

【発明が解決しようとする課題】ところが、オペレータ
がジョイスティック、あるいはマスターアームを使って
スレーブマニピュレータに動作指令を与えるときに、カ
メラの焦点距離を変化させると作業対象物の像の大きさ
が変わるために、TVモニタに映し出されたスレーブマ
ニピュレータの手先位置(位置決め制御の対象点であ
り、以下制御点という)の動作速度とオペレータの操作
感覚が一致しないという問題があった。また、ズーム率
によってマスタとスレーブの移動速度の割合を変化させ
る方法では、スレーブの制御点に全く関係なく移動速度
の割合を変化させてしまうので、モニタ上のスレーブマ
ニピュレータ制御点の移動速度は必ずしも一定になると
は限らない。また、カメラ座標系とロボット座標系の奥
行き方向が一致していない時に、TVモニタ上の移動速
度と移動方向がオペレータの操作量と操作方向に一致せ
ず、これによってもオペレータの操作感覚を紛らわすこ
とになる。本発明は上記の問題を解決するためになされ
たもので、オペレータの操作量と操作方向に対応して、
TVモニタ上のスレーブマニピュレータ制御点の移動速
度が、カメラの焦点距離やカメラからスレーブマニピュ
レータ制御点までの距離、あるいはカメラの姿勢が変化
しても常に設定した値に一定となるようなマニピュレー
タの制御装置を提供することを目的とする。
However, when the operator gives an operation command to the slave manipulator using the joystick or the master arm, the size of the image of the work object changes when the focal length of the camera is changed. In addition, there is a problem in that the operation speed of the hand position of the slave manipulator (a target point of positioning control, which will be referred to as a control point hereinafter) displayed on the TV monitor does not match the operation feeling of the operator. Further, in the method of changing the ratio of the moving speed of the master and the slave depending on the zoom ratio, since the ratio of the moving speed is changed irrespective of the control point of the slave, the moving speed of the slave manipulator control point on the monitor is not always required. It is not always constant. Further, when the depth directions of the camera coordinate system and the robot coordinate system do not match, the moving speed and moving direction on the TV monitor do not match the operation amount and operating direction of the operator, which also confuses the operator's operational feeling. It will be. The present invention has been made to solve the above problems, and corresponds to the operation amount and operation direction of the operator,
Control of the manipulator so that the moving speed of the slave manipulator control point on the TV monitor is always constant at the set value even if the focal length of the camera, the distance from the camera to the slave manipulator control point, or the attitude of the camera changes. The purpose is to provide a device.

【0004】[0004]

【課題を解決するための手段】本発明の目的を達成する
ために、本発明は、ズーム機構と位置・姿勢変更機能を
有する監視カメラによって捉えられた映像をTVモニタ
で見ながらオペレータがジョイスティックあるいはマス
ターアームを使って遠隔作業を行うマスタースレーブ方
式のマニピュレータの制御装置において、前記監視カメ
ラの焦点距離と、前記監視カメラから前記スレーブマニ
ピュレータの手先位置までの距離を検出し、前記監視カ
メラの焦点距離と前記監視カメラから前記スレーブマニ
ピュレータの手先位置までの距離の比に比例した速度で
前記スレーブマニピュレータの手先位置が移動するよう
な動作指令を出力すること手段を設けたことを特徴とす
るマニピュレータの制御装置。
In order to achieve the object of the present invention, according to the present invention, an operator operates a joystick while watching an image captured by a surveillance camera having a zoom mechanism and a position / orientation changing function on a TV monitor. In a controller of a master-slave manipulator that performs remote work using a master arm, the focal length of the surveillance camera and the distance from the surveillance camera to the hand position of the slave manipulator are detected, and the focal length of the surveillance camera is detected. And a manipulator control means for outputting an operation command for moving the hand position of the slave manipulator at a speed proportional to the ratio of the distance from the surveillance camera to the hand position of the slave manipulator. apparatus.

【0005】[0005]

【作用】上記手段により、オペレータによるジョイステ
ィックまたはマスターアームの操作量や操作方向に対す
るTVモニタ上のスレーブマニピュレータ制御点の移動
速度が、カメラの焦点距離やカメラからスレーブマニピ
ュレータまでの距離、あるいはカメラの姿勢が変化して
も、常に設定した値に一定となるため、どのような状況
でもTVモニタに映し出されたスレーブマニピュレータ
のエンドエフェクタの動作とオペレータの操作感覚が一
致する。
By the above means, the moving speed of the slave manipulator control point on the TV monitor with respect to the operation amount and the operation direction of the joystick or the master arm by the operator, the focal length of the camera, the distance from the camera to the slave manipulator, or the posture of the camera. Even if changes, the value is always constant to the set value, so that the operation of the end effector of the slave manipulator displayed on the TV monitor and the operation feeling of the operator are the same in any situation.

【0006】[0006]

【実施例】以下、本発明の実施例を図に基づいて説明す
る。図1は本発明の実施例の構成を示す図であり、スレ
ーブ側は、スレーブマニピュレータ1とそれを監視する
ズーム機能と位置・姿勢変更機能を有するカメラ装置
3、そしてこれらの制御を行うスレーブ制御装置4から
構成されている。また、マスタ側はカメラ装置3の捉え
た映像を映し出すTVモニタ5とスレーブマニピュレー
タ1を操作するジョイスティック6とズームスイッチや
カメラ方向制御を行うためのスイッチを含む操作卓7
と、これらを制御するマスタ制御装置8から構成されて
いる。なお、カメラ装置の焦点距離と位置・姿勢は、オ
ペレータが作業(スレーブマニピュレータの移動)に伴
って、適宜設定しなおすものを想定しているが、スレー
ブマニピュレータの移動に伴って自動的に焦点距離と位
置・姿勢がある時間間隔毎に設定されるものでもよい。
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a configuration of an embodiment of the present invention. A slave side is a slave manipulator 1, a camera device 3 having a zoom function and a position / orientation changing function for monitoring the slave manipulator 1, and a slave control for controlling these. It is composed of a device 4. On the master side, a TV monitor 5 for displaying the image captured by the camera device 3, a joystick 6 for operating the slave manipulator 1, an operation console 7 including a zoom switch and a switch for controlling the camera direction.
And a master control device 8 for controlling them. It is assumed that the operator sets the focal length and position / orientation of the camera device appropriately in accordance with the work (movement of the slave manipulator). However, the focal length is automatically changed with the movement of the slave manipulator. The position and orientation may be set at certain time intervals.

【0007】次に本装置の動作を説明する。カメラ装置
3が捉えた映像をTVモニタ5を見ながらオペレータ9
がジョイスティック6を操作する。ジョイスティック6
の操作量と操作方向はマスタ制御装置8に入力されて、
スレーブ制御装置4に送出される。スレーブ制御装置4
はカメラ装置3からカメラの焦点距離と姿勢量を検出
し、ジョイスティック6の操作量と操作方向からスレー
ブマニピュレータ制御点2のカメラ座標系での移動速度
を演算し、ロボット座標系へ座標変換した後、関節空間
各軸の速度へ変換してスレーブマニピュレータ1への指
令を行う。
Next, the operation of this apparatus will be described. The operator 9 looks at the image captured by the camera device 3 while watching the TV monitor 5.
Operates the joystick 6. Joystick 6
The operation amount and the operation direction of are input to the master control device 8,
It is sent to the slave control device 4. Slave controller 4
Detects the focal length and attitude amount of the camera from the camera device 3, calculates the moving speed of the slave manipulator control point 2 in the camera coordinate system from the operation amount and operation direction of the joystick 6, and after coordinate conversion to the robot coordinate system. , The joint space is converted into the velocity of each axis and a command is given to the slave manipulator 1.

【0008】図2は本発明の演算フローチャートを示
す。オペレータはまず、操作卓においてTVモニタ上の
スレーブマニピュレータ制御点の速度を設定する(ステ
ップ1)。そして、オペレータがジョイスティックを操
作するとき、カメラ装置から現在の焦点距離と姿勢を検
出し(ステップ2)、現在のカメラ装置からスレーブマ
ニピュレータ制御点までの距離を検出し(ステップ
3)、スレーブマニピュレータ制御点のカメラ座標系で
の各軸移動速度を計算し(ステップ4)、その後、ロボ
ット座標系へ座標変換し(ステップ5)、各関節角へ変
換してスレーブマニピュレータへ動作指令を出力する
(ステップ6)。
FIG. 2 shows a calculation flowchart of the present invention. The operator first sets the speed of the slave manipulator control point on the TV monitor at the console (step 1). Then, when the operator operates the joystick, the current focal length and posture are detected from the camera device (step 2), the distance from the current camera device to the slave manipulator control point is detected (step 3), and the slave manipulator control is performed. The moving speed of each axis in the camera coordinate system of the point is calculated (step 4), then the coordinates are converted to the robot coordinate system (step 5), the joint angles are converted, and the operation command is output to the slave manipulator (step). 6).

【0009】ここで本発明の移動速度の演算方法を詳し
く説明する。カメラ撮像面上(CCD素子上)の速度V
S は、式(1)に示すように、TVモニタ上でのスレー
ブマニピュレータ制御点の移動速度VM に、TVモニタ
の画面の大きさに比例した定数KM を乗じたものであ
る。 VS = KM ・VM ……(1)
Now, the method of calculating the moving speed of the present invention will be described in detail. Velocity V on camera image pickup surface (on CCD element)
S is obtained by multiplying the moving speed V M of the slave manipulator control point on the TV monitor by a constant K M proportional to the size of the screen of the TV monitor, as shown in Expression (1). V S = K M · V M ...... (1)

【0010】本発明では、実空間(カメラ座標系)での
速度VC を、式(2)に示すように、前記VS にカメラ
レンズ中心からスレーブマニピュレータ制御点2までの
距離DR とカメラの焦点距離fS の比を乗じ、さらにジ
ョイスティックの操作量に比例した定数KJ (KJ
1)を乗じたものとする所に特徴がある。 VC =(DR /fS )・VS ・KJ ……(2) すなわち、スレーブマニピュレータの制御点の実際の指
令速度VC は、 VC =(DR ・KM ・KJ ・VM )/fS とするものである。なお、KJ は、ジョイスティックの
操作量(倒し角度等)に従って速度指令を変化できる形
式の場合のものであり、最大操作量の場合1となる。速
度指令が一定の形式のものではKJ =1となる。
According to the present invention, the velocity V C in the real space (camera coordinate system) is expressed by the equation (2) where V S is the distance D R from the camera lens center to the slave manipulator control point 2 and the camera. Multiplied by the ratio of the focal length f S of the joystick, and further a constant K J (K J
The feature is that it is multiplied by 1). V C = (D R / f S ) · V S · K J (2) That is, the actual command speed V C of the control point of the slave manipulator is V C = (D R · K M · K J · V M ) / f S. It should be noted that K J is in the case where the speed command can be changed according to the operation amount (tilt angle, etc.) of the joystick, and is 1 in the case of the maximum operation amount. If the speed command has a constant format, K J = 1.

【0011】図3はカメラ座標系での速度VC と焦点距
離fS 、カメラからスレーブマニピュレータ制御点まで
の距離DR の比との関係を示しており、焦点距離fS
大きくなるにつれて、または、カメラからスレーブマニ
ピュレータ制御点までの距離DR が小さくなるにつれ
て、スレーブマニピュレータのカメラ座標系での移動速
度VC は小さくなる。また、ジョイスティックの操作量
に応じて速度VC は変化する。 そしてこのカメラ座標
系での速度VC をロボット座標系での速度VR へ、カメ
ラの姿勢量によって計算された変換行列Tによって変換
して動作指令を出力する。。 VT = T・VC このようにすると、オペレータによるジョイスティック
の操作によって、ある操作量に対するスレーブマニピュ
レータ制御点の移動速度VR は、カメラの焦点距離や姿
勢、カメラからスレーブマニピュレータ制御点までの距
離に応じて変化する。しかしながら、結果的にはTVモ
ニタ上のスレーブマニピュレータ制御点の移動速度はあ
らかじめ設定した値に一定となり、また。ジョイスティ
ックの操作方向とTVモニタ上の移動方向は一致する。
FIG. 3 shows the relationship between the velocity V C in the camera coordinate system and the focal length f S , and the ratio of the distance D R from the camera to the slave manipulator control point. As the focal length f S increases, Alternatively, as the distance D R from the camera to the slave manipulator control point decreases, the moving speed V C of the slave manipulator in the camera coordinate system decreases. Further, the speed V C changes according to the operation amount of the joystick. Then, the speed V C in the camera coordinate system is converted into the speed V R in the robot coordinate system by the conversion matrix T calculated by the posture amount of the camera, and the operation command is output. . V T = T · V C In this way, the moving speed V R of the slave manipulator control point with respect to a certain operation amount by the operation of the joystick by the operator is the focal length and posture of the camera, and the distance from the camera to the slave manipulator control point. Change according to. However, as a result, the moving speed of the slave manipulator control point on the TV monitor becomes constant at a preset value, and also. The operating direction of the joystick matches the moving direction on the TV monitor.

【0012】[0012]

【発明の効果】以上述べたように、本発明によれば、オ
ペレータによるジョイスティックまたはマスターアーム
の操作量や操作方向に対するTVモニタ上のスレーブマ
ニピュレータ制御点の移動速度が、カメラの焦点距離や
カメラからスレーブマニピュレータまでの距離、あるい
はカメラの姿勢が変化しても(オペレータの意思で変化
させた場合も)、常に設定した値に一定となるため、ど
のような状況でもTVモニタに映し出されたスレーブマ
ニピュレータのエンドエフェクタの動作とオペレータの
操作感覚が一致し、これによって、オペレータの負担が
軽減でき、作業の能率と安全性が向上するという効果が
ある。
As described above, according to the present invention, the moving speed of the slave manipulator control point on the TV monitor with respect to the operation amount and the operation direction of the joystick or the master arm by the operator is determined by the focal length of the camera or the camera. Even if the distance to the slave manipulator or the posture of the camera changes (even if it is changed by the operator's intention), the value always remains the set value, so the slave manipulator displayed on the TV monitor in any situation. The operation of the end effector and the operation feeling of the operator coincide with each other, which has the effect of reducing the burden on the operator and improving the work efficiency and safety.

【図面の簡単な説明】[Brief description of drawings]

【図1】 本発明の実施例である遠隔作業用マニピュレ
ータ制御装置の構成図
FIG. 1 is a configuration diagram of a manipulator control device for remote work according to an embodiment of the present invention.

【図2】実施例の制御フローチャートを示す図FIG. 2 is a diagram showing a control flowchart of the embodiment.

【図3】カメラの焦点距離とカメラからスレーブマニピ
ュレータ制御点までの距離の比、あるいはジョイスティ
ックの操作量に応じたカメラ座標系でのスレーブマニピ
ュレータ制御点の移動速度を示した図
FIG. 3 is a diagram showing the ratio of the focal length of the camera to the distance from the camera to the slave manipulator control point, or the moving speed of the slave manipulator control point in the camera coordinate system according to the operation amount of the joystick.

【符号の説明】[Explanation of symbols]

1 スレーブマニピュレータ 2 スレーブマニピュレータ制御点 3 カメラ装置 4 スレーブ制御装置 5 TVモニタ 6 ジョイスティック 7 操作卓 8 マスタ制御装置 9 オペレータ 1 Slave Manipulator 2 Slave Manipulator Control Point 3 Camera Device 4 Slave Control Device 5 TV Monitor 6 Joystick 7 Operation Console 8 Master Control Device 9 Operator

Claims (3)

【特許請求の範囲】[Claims] 【請求項1】 ズーム機構と位置・姿勢変更機能を有す
る監視カメラによって捉えられた映像をTVモニタで見
ながらオペレータがジョイスティックあるいはマスター
アームを使って遠隔作業を行うマスタースレーブ方式の
マニピュレータの制御装置において、 前記監視カメラの焦点距離と、前記監視カメラから前記
スレーブマニピュレータの手先位置までの距離を検出
し、前記監視カメラの焦点距離と前記監視カメラから前
記スレーブマニピュレータの手先位置までの距離の比に
比例した速度で前記スレーブマニピュレータの手先位置
が移動するような動作指令を出力する手段を設けたこと
を特徴とするマニピュレータの制御装置。
1. A controller of a master-slave type manipulator in which an operator remotely operates by using a joystick or a master arm while watching an image captured by a surveillance camera having a zoom mechanism and a position / orientation changing function on a TV monitor. The focal length of the surveillance camera and the distance from the surveillance camera to the hand position of the slave manipulator are detected, and are proportional to the ratio of the focal length of the surveillance camera and the distance from the surveillance camera to the hand position of the slave manipulator. A manipulator control device comprising means for outputting an operation command such that the hand position of the slave manipulator moves at a predetermined speed.
【請求項2】 ズーム機構と位置・姿勢変更機能を有す
る監視カメラによって捉えられた映像をTVモニタで見
ながらオペレータがジョイスティックあるいはマスター
アームを使って遠隔作業を行うマスタースレーブ方式の
マニピュレータの制御装置において、 前記監視カメラの焦点距離と、前記監視カメラから前記
スレーブマニピュレータの手先位置までの距離を検出
し、前記監視カメラの焦点距離と前記監視カメラから前
記スレーブマニピュレータの手先位置までの距離の比を
ジョイスティックあるいはマスターアームで与える指令
速度に乗じる手段を設けたことを特徴とするマニピュレ
ータの制御装置。
2. A controller for a master-slave manipulator in which an operator uses a joystick or a master arm to perform remote work while viewing an image captured by a surveillance camera having a zoom mechanism and a position / orientation changing function on a TV monitor. , A focal length of the surveillance camera and a distance from the surveillance camera to a hand position of the slave manipulator are detected, and a ratio of the focal length of the surveillance camera and the distance from the surveillance camera to the hand position of the slave manipulator is a joystick. Alternatively, the manipulator control device is provided with means for multiplying a command speed given by the master arm.
【請求項3】 前記監視カメラの姿勢量から、ジョイス
ティックあるいはマスターアームによる動作指令に対す
るTVモニタ上での前記スレーブマニピュレータの移動
方向が常に一致するように座標変換を行う請求項1また
は2記載のマニピュレータ制御装置。
3. The manipulator according to claim 1, wherein coordinate conversion is performed from the attitude amount of the surveillance camera so that the moving direction of the slave manipulator on the TV monitor in response to an operation command from a joystick or a master arm always matches. Control device.
JP6171894A 1994-06-29 1994-06-29 Controller for manipulator Pending JPH0811071A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP6171894A JPH0811071A (en) 1994-06-29 1994-06-29 Controller for manipulator

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP6171894A JPH0811071A (en) 1994-06-29 1994-06-29 Controller for manipulator

Publications (1)

Publication Number Publication Date
JPH0811071A true JPH0811071A (en) 1996-01-16

Family

ID=15931788

Family Applications (1)

Application Number Title Priority Date Filing Date
JP6171894A Pending JPH0811071A (en) 1994-06-29 1994-06-29 Controller for manipulator

Country Status (1)

Country Link
JP (1) JPH0811071A (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6359647B1 (en) * 1998-08-07 2002-03-19 Philips Electronics North America Corporation Automated camera handoff system for figure tracking in a multiple camera system
JP2002127060A (en) * 2000-10-23 2002-05-08 Matsushita Electric Ind Co Ltd Robot device
US7221775B2 (en) 2002-11-12 2007-05-22 Intellivid Corporation Method and apparatus for computerized image background analysis
US7280673B2 (en) 2003-10-10 2007-10-09 Intellivid Corporation System and method for searching for changes in surveillance video
US7286157B2 (en) 2003-09-11 2007-10-23 Intellivid Corporation Computerized method and apparatus for determining field-of-view relationships among multiple image sensors
US7346187B2 (en) 2003-10-10 2008-03-18 Intellivid Corporation Method of counting objects in a monitored environment and apparatus for the same
EP2092874A1 (en) 2008-02-21 2009-08-26 Olympus Medical Systems Corporation Manipulator operation system
US7671728B2 (en) 2006-06-02 2010-03-02 Sensormatic Electronics, LLC Systems and methods for distributed monitoring of remote sites
US7825792B2 (en) 2006-06-02 2010-11-02 Sensormatic Electronics Llc Systems and methods for distributed monitoring of remote sites
US8174572B2 (en) 2005-03-25 2012-05-08 Sensormatic Electronics, LLC Intelligent camera selection and object tracking
WO2015024579A1 (en) * 2013-08-19 2015-02-26 Abb Technology Ltd Robot manipulated viewpoint
US9036028B2 (en) 2005-09-02 2015-05-19 Sensormatic Electronics, LLC Object tracking and alerts
WO2017022307A1 (en) * 2015-07-31 2017-02-09 オリンパス株式会社 Manipulator system
JP2017061032A (en) * 2011-03-23 2017-03-30 エスアールアイ インターナショナルSRI International High performance remote manipulator system
JP2018202541A (en) * 2017-06-02 2018-12-27 日立Geニュークリア・エナジー株式会社 Remote-controlled working robot control system and control method for remote-controlled working robot
CN111152218A (en) * 2019-12-31 2020-05-15 浙江大学 Action mapping method and system of heterogeneous humanoid mechanical arm
CN111699077A (en) * 2018-02-01 2020-09-22 Abb瑞士股份有限公司 Vision-based operation for robots
US11083533B2 (en) 2016-02-25 2021-08-10 Olympus Corporation Manipulator system and operating method thereof
US11298199B2 (en) 2016-02-25 2022-04-12 Olympus Corporation Manipulator system and method for restricting a retreating motion of a manipulator according to a protrusion state of a manipulator joint

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6359647B1 (en) * 1998-08-07 2002-03-19 Philips Electronics North America Corporation Automated camera handoff system for figure tracking in a multiple camera system
JP2002127060A (en) * 2000-10-23 2002-05-08 Matsushita Electric Ind Co Ltd Robot device
US7460685B2 (en) 2002-11-12 2008-12-02 Intellivid Corporation Method and apparatus for computerized image background analysis
US7221775B2 (en) 2002-11-12 2007-05-22 Intellivid Corporation Method and apparatus for computerized image background analysis
US7286157B2 (en) 2003-09-11 2007-10-23 Intellivid Corporation Computerized method and apparatus for determining field-of-view relationships among multiple image sensors
US7280673B2 (en) 2003-10-10 2007-10-09 Intellivid Corporation System and method for searching for changes in surveillance video
US7346187B2 (en) 2003-10-10 2008-03-18 Intellivid Corporation Method of counting objects in a monitored environment and apparatus for the same
US8174572B2 (en) 2005-03-25 2012-05-08 Sensormatic Electronics, LLC Intelligent camera selection and object tracking
US9036028B2 (en) 2005-09-02 2015-05-19 Sensormatic Electronics, LLC Object tracking and alerts
US9881216B2 (en) 2005-09-02 2018-01-30 Sensormatic Electronics, LLC Object tracking and alerts
US9407878B2 (en) 2005-09-02 2016-08-02 Sensormatic Electronics, LLC Object tracking and alerts
US7671728B2 (en) 2006-06-02 2010-03-02 Sensormatic Electronics, LLC Systems and methods for distributed monitoring of remote sites
US7825792B2 (en) 2006-06-02 2010-11-02 Sensormatic Electronics Llc Systems and methods for distributed monitoring of remote sites
US8013729B2 (en) 2006-06-02 2011-09-06 Sensormatic Electronics, LLC Systems and methods for distributed monitoring of remote sites
EP2092874A1 (en) 2008-02-21 2009-08-26 Olympus Medical Systems Corporation Manipulator operation system
US8308633B2 (en) 2008-02-21 2012-11-13 Olympus Medical Systems Corp. Manipulator operation system
EP2092874B1 (en) * 2008-02-21 2019-05-29 Olympus Corporation Manipulator operation system
JP2017061032A (en) * 2011-03-23 2017-03-30 エスアールアイ インターナショナルSRI International High performance remote manipulator system
WO2015024579A1 (en) * 2013-08-19 2015-02-26 Abb Technology Ltd Robot manipulated viewpoint
JPWO2017022307A1 (en) * 2015-07-31 2017-08-03 オリンパス株式会社 Manipulator system
WO2017022307A1 (en) * 2015-07-31 2017-02-09 オリンパス株式会社 Manipulator system
US11083533B2 (en) 2016-02-25 2021-08-10 Olympus Corporation Manipulator system and operating method thereof
US11298199B2 (en) 2016-02-25 2022-04-12 Olympus Corporation Manipulator system and method for restricting a retreating motion of a manipulator according to a protrusion state of a manipulator joint
JP2018202541A (en) * 2017-06-02 2018-12-27 日立Geニュークリア・エナジー株式会社 Remote-controlled working robot control system and control method for remote-controlled working robot
CN111699077A (en) * 2018-02-01 2020-09-22 Abb瑞士股份有限公司 Vision-based operation for robots
US20200353624A1 (en) * 2018-02-01 2020-11-12 Abb Schweiz Ag Vision-based operation for robot
CN111699077B (en) * 2018-02-01 2024-01-23 Abb瑞士股份有限公司 Vision-based operation for robots
US11926065B2 (en) * 2018-02-01 2024-03-12 Abb Schweiz Ag Vision-based operation for robot
CN111152218A (en) * 2019-12-31 2020-05-15 浙江大学 Action mapping method and system of heterogeneous humanoid mechanical arm
CN111152218B (en) * 2019-12-31 2021-10-08 浙江大学 Action mapping method and system of heterogeneous humanoid mechanical arm

Similar Documents

Publication Publication Date Title
JPH0811071A (en) Controller for manipulator
EP3342561B1 (en) Remote control robot system
US10022195B2 (en) User interface for a robot
US11618166B2 (en) Robot operating device, robot, and robot operating method
JPH1034570A (en) Robot remote control system
JPH03213278A (en) Remote control support system for robot
JP3657854B2 (en) Remote location observation equipment
JP2004128646A (en) Monitoring system and controller
JP3376029B2 (en) Robot remote control device
JPH0430981A (en) Control unit for television camera of remote control type robot
JPH07328971A (en) Manipulator with tv camera
JP2000042960A (en) Remote control device for manipulator
JPH10249786A (en) Manipulator control device and operation supporting device
Liu et al. Assist control for ball catching using high-speed vision on a master-slave robot
JP2634880B2 (en) Robot remote control device
JP2520660B2 (en) Remotely operated manipulator device
CN113612928B (en) Teleoperation system, teleoperation method and chip
JPH0215349B2 (en)
JPH09116806A (en) Camera controller
JPS6042673B2 (en) Mobile monitoring device
JPH081558A (en) Remote operation robot
JP2920788B2 (en) Monitoring method and device for remote operation
Plopski et al. Invisiblerobot: Facilitating robot manipulation through diminished reality
JPH0646479A (en) Remote operation system
JPH07117403B2 (en) Robot visual coordinate calibration method and system

Legal Events

Date Code Title Description
R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 7

Free format text: PAYMENT UNTIL: 20080413

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090413

Year of fee payment: 8

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100413

Year of fee payment: 9

FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 10

Free format text: PAYMENT UNTIL: 20110413

S531 Written request for registration of change of domicile

Free format text: JAPANESE INTERMEDIATE CODE: R313531

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313117

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110413

Year of fee payment: 10

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 11

Free format text: PAYMENT UNTIL: 20120413

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 11

Free format text: PAYMENT UNTIL: 20120413

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 11

Free format text: PAYMENT UNTIL: 20120413

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130413

Year of fee payment: 12

FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 13

Free format text: PAYMENT UNTIL: 20140413

EXPY Cancellation because of completion of term