JPH06270076A - Camera control device for remote control - Google Patents

Camera control device for remote control

Info

Publication number
JPH06270076A
JPH06270076A JP6671993A JP6671993A JPH06270076A JP H06270076 A JPH06270076 A JP H06270076A JP 6671993 A JP6671993 A JP 6671993A JP 6671993 A JP6671993 A JP 6671993A JP H06270076 A JPH06270076 A JP H06270076A
Authority
JP
Japan
Prior art keywords
camera
remote
operator
robot
movement
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
JP6671993A
Other languages
Japanese (ja)
Inventor
Akihiro Okawa
明宏 大川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nippon Steel Corp
Original Assignee
Nippon Steel Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nippon Steel Corp filed Critical Nippon Steel Corp
Priority to JP6671993A priority Critical patent/JPH06270076A/en
Publication of JPH06270076A publication Critical patent/JPH06270076A/en
Withdrawn legal-status Critical Current

Links

Abstract

PURPOSE:To operate a camera optionally, and improve remote controllability by providing a head mount device by which the camera moves in response to the head movement of an operator in a system to operate a remote robot or the like while looking at an image by a remote camera. CONSTITUTION:In a system to operate a remote robot or a work machine or the like while looking at an image picked up by a remote camera 1, a head mount display 8 is installed on a head part of an operator 7. The movement of this head mount display 8 is detected by a detecting means, and the detecting signal is inputted to an operation device 9, and a camera stand 2 is controlled in response to the head part movement of the operator 7 through a camera stand controller 3. Thereby, an optional visual point can be obtained with a presence feeling as if the operator is staying at the work site, so that excellent remote controllability can be obtained.

Description

【発明の詳細な説明】Detailed Description of the Invention

【0001】[0001]

【産業上の利用分野】本発明は遠隔カメラから得られた
映像を見ながら操作者が遠隔のロボットまたは機械を操
作する遠隔操作システムにおけるカメラの制御装置に関
するものである。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a camera control device in a remote control system in which an operator operates a remote robot or machine while watching an image obtained from a remote camera.

【0002】[0002]

【従来の技術】近年、深海や宇宙空間での作業のように
人間が直接現場へ行って作業を行うことが困難であった
り、原子炉内の作業のように人間が行うのに危険が伴う
状況がいろいろと考えられる。このような作業を実現す
る技術として、人間の行けない作業現場や作業環境にお
いて人間の上肢に代わって作業を行うマニピュレータを
送り込み、現場から離れた安全な地点の作業環境から人
間がそれを操作して作業を行うテレオペレーションが研
究されてきている。この方法では人間の指令に従って自
由自在に運動できるマニピュレータという機構の開発と
ともに、遠隔地点の作業現場の状況を人間に自然に見せ
る視覚情報、特に立体視視覚情報のフイードバック及び
マニピュレータのもつ感覚をフイードバックすることで
操作性を上げることが考えられている。
2. Description of the Related Art In recent years, it has been difficult for humans to directly go to the site to perform work such as work in deep sea or outer space, and there is a danger that humans perform work such as work inside a nuclear reactor. There are various situations. As a technology to realize such work, we send a manipulator that works on behalf of human upper limbs at work sites and work environments where humans can not go, and humans operate it from a work environment at a safe point away from the site. Teleoperations that perform work by doing work have been studied. This method develops a mechanism called a manipulator that can freely move according to human commands, and also feeds back the visual information that makes humans naturally see the situation of the work site at a remote location, especially the feedback of stereoscopic visual information and the sense of the manipulator. Therefore, it is considered to improve operability.

【0003】従来、この立体視視覚情報をフイードバッ
クするために考えられている立体視視覚装置が知られて
いる。このような、従来の遠隔操作システムにおけるカ
メラの制御としては実開平1−95879号公報のよう
に、対象物に対して作業を行うロボットとその対象物近
傍に設置された対象物の画像を入力するカメラが一体連
結されているものや、実開昭55−107992号公報
のように保守作業等を行うためのマニピュレータにおけ
る指部付近の指先部近辺に焦点を合わせたテレビカメラ
を固定して設けて遠隔自動操作装置本体の適宜位置に対
象物を探すためのテレビカメラを適数設置したものであ
る。この各公報に示されているようにロボットの動きに
合わせてカメラを動かすだけのものが知られている。
Conventionally, there is known a stereoscopic vision device which is considered for feeding back the stereoscopic visual information. In order to control the camera in such a conventional remote control system, as in Japanese Utility Model Laid-Open No. 1-95879, a robot that works on an object and an image of the object installed near the object are input. A camera that is integrally connected, or a manipulator for performing maintenance work as in Japanese Utility Model Laid-Open No. 55-107992 is provided with a TV camera fixed near the fingertip near the fingertip. A proper number of TV cameras for searching for an object are installed at appropriate positions on the main body of the remote automatic operation device. It is known that only the camera is moved in accordance with the movement of the robot as shown in each of these publications.

【0004】[0004]

【発明が解決しようとする課題】上述した実開平1−9
5879号公報及び実開昭55−107992号公報の
いずれも、ロボットの動きに合わせてカメラを動かすだ
けのものであり、従ってこれらいずれもロボットの動き
を主とするとカメラの動きが従属する制御であり、遠隔
の操作者にとって作業に必要な任意の点を自由に見るこ
とは出来ないという問題がある。本発明はこのような問
題から、操作者の意志や操作性を優先し、カメラの制御
を行い、ロボットの動作と関係なく、モニター画面を見
ながら操作端により任意にカメラを操作することが可能
で、遠隔操作性の向上及び操作者の負担の減少を図るこ
とを目的とするものである。
DISCLOSURE OF THE INVENTION Problems to be Solved by the Invention
Both the Japanese Patent No. 5879 and the Japanese Utility Model Laid-Open No. 55-107992 only move the camera in accordance with the movement of the robot. Therefore, in both of these, the movement of the camera depends on the movement of the robot. However, there is a problem that a remote operator cannot freely see an arbitrary point necessary for work. Due to such a problem, the present invention gives priority to the operator's intention and operability, controls the camera, and can arbitrarily operate the camera by the operation end while observing the monitor screen regardless of the robot operation. It is intended to improve remote operability and reduce the burden on the operator.

【0005】[0005]

【課題を解決するための手段】このような目的に対し
て、本発明の要旨とするところは、遠隔におかれたカメ
ラとロボットまたは作業機械から成る遠隔操作システム
において、カメラ架台とズームの制御として、遠隔の作
業者による手動の操作端による装置とロボットまたは作
業機械の移動信号に連動してカメラが動くリモートモー
ドと、操作者の頭の動きに対応してカメラが動くヘッド
マウント装置を有することを特徴とする遠隔操作用カメ
ラ制御装置にある。
For such a purpose, the gist of the present invention is to control a camera pedestal and zoom in a remote control system comprising a camera and a robot or a work machine placed remotely. As a device, a remote mode in which the camera is operated by a manual operation end by a remote operator and a camera that operates in response to a movement signal of a robot or a work machine, and a head mount device that moves the camera in response to the movement of the operator's head are provided. A remote control camera control device characterized by the above.

【0006】[0006]

【実施例】以下本発明について実施例である図面に従っ
て詳細に説明する。図1は本発明に係るジョイステック
モードを示す説明図である。図1に示すように操作端で
あるジョイステック4からの指令に基づきカメラ架台コ
ントローラ3に送られ、それをもとにカメラ架台2の動
作、ズームがロボットとは独立に制御される。図2は本
発明に係るリモートモードを示す説明図である。ロボッ
ト5の移動量がロボットコントローラ6からカメラ架台
コントローラ3に送られ、それをもとにカメラ架台2が
ロボット5の手先を追うように移動し遠隔のモニタ上に
は常にロボットの手先が表示され操作者は作業の監視を
容易に行うことが可能となる。
DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described in detail below with reference to the drawings which are embodiments. FIG. 1 is an explanatory view showing a joystick mode according to the present invention. As shown in FIG. 1, the operation is sent to the camera pedestal controller 3 based on a command from the joystick 4, which is the operation end, and the operation and zoom of the camera pedestal 2 are controlled based on the command independently of the robot. FIG. 2 is an explanatory diagram showing the remote mode according to the present invention. The movement amount of the robot 5 is sent from the robot controller 6 to the camera mount controller 3, and the camera mount 2 moves so as to follow the hand of the robot 5 based on it, and the hand of the robot is always displayed on the remote monitor. The operator can easily monitor the work.

【0007】図3は本発明に係るヘッドマウントモード
を示す説明図である。図3に示すように、操作者7が装
着したヘッドマウントデスプレイ8の動きを検出し、演
算装置9を介してカメラ架台コントローラ3に送られ、
それをもとに、それに対応してカメラ架台2を制御する
ことにより操作者7は自分が遠隔にいるのと同様の感覚
の立体画像を得ることが出来る。
FIG. 3 is an explanatory view showing a head mount mode according to the present invention. As shown in FIG. 3, the movement of the head mount display 8 worn by the operator 7 is detected and sent to the camera mount controller 3 via the arithmetic unit 9.
Based on this, by controlling the camera mount 2 correspondingly, the operator 7 can obtain a stereoscopic image with the same feeling as if he / she were remote.

【0008】このように、操作者の意志や操作性を優先
しカメラの制御を行い、3つの制御を取り入れ、これら
3つの制御を任意に操作者が選択可能としたものであ
る。すなわち、ロボットの動作とは独立してカメラを動
かすジョイスチィックモードとオペレータの頭の移動に
連動して動かす制御及びヘッドマウントモードとロボッ
トの手先の動きに追従させる制御並びにリモートモード
を持ちこのうちのどれかを操作者が作業に応じて任意に
選択可能とした。
As described above, the camera is controlled by giving priority to the operator's intention and operability, and three controls are introduced, and the operator can arbitrarily select these three controls. That is, the robot has a joystick mode that moves the camera independently of the movement of the robot, a control that moves in conjunction with the movement of the operator's head, a head mount mode and a control that follows the movement of the hand of the robot, and a remote mode. The operator can select any of them according to the work.

【0009】このように、操業者が作業に応じて3つの
制御を任意に選択することによって、場合によってはロ
ボットの動作と関係なくモニター画面を見ながら操作端
により任意にカメラを操作することが出来るし、また、
ヘッドマウントデスプレイを設置して遠隔操作に有利な
立体画像を見ながら、作業者はあたかもその作業の現場
にいるような臨場感を持って任意の視点を得ることも出
来るし、更には単純な作業で操作者が監視程度で良い場
合は、ロボットの手先の移動情報から自動的にカメラを
制御し、監視に必要なモニター画面を容易に得ることが
可能となる。
In this way, the operator can arbitrarily operate the camera with the operating end while watching the monitor screen regardless of the operation of the robot by arbitrarily selecting the three controls according to the work. You can do it again
While installing a head-mounted display and viewing stereoscopic images that are advantageous for remote control, the worker can get an arbitrary viewpoint with the feeling of being as if he / she were at the site of the work. When the operator is only required to monitor, the camera can be automatically controlled from the movement information of the hand of the robot, and the monitor screen required for monitoring can be easily obtained.

【0010】[0010]

【発明の効果】以上述べたように、本発明によって上記
3つの制御を任意に選択することによりロボットの動作
と関係なくモニター画面を見ながら操作端により任意に
カメラを操作することが可能であり、かつ、ヘッドマウ
ントデスプレイを装着して遠隔操作に有利な立体画像を
見ながら任意の視点を得ることも可能であり、かつ単純
な作業で操作者が監視程度で良い場合はロボットの手先
の移動情報から自動的にカメラを制御し監視に必要な画
面を容易に得ることが可能となり、遠隔操作性が向上し
かつ操作者の負担が減少した。
As described above, according to the present invention, by arbitrarily selecting the above three controls, it is possible to arbitrarily operate the camera by the operation end while observing the monitor screen regardless of the operation of the robot. It is also possible to attach a head mount display to obtain an arbitrary viewpoint while viewing a stereoscopic image that is advantageous for remote control, and if the operator is only required to monitor with simple work, move the robot hand. It became possible to automatically control the camera from the information and easily obtain the screen required for monitoring, improving remote operability and reducing the burden on the operator.

【図面の簡単な説明】[Brief description of drawings]

【図1】本発明に係るジョイステックモードを示す説明
図、
FIG. 1 is an explanatory view showing a joystick mode according to the present invention,

【図2】本発明に係るリモートモードを示す説明図、FIG. 2 is an explanatory view showing a remote mode according to the present invention,

【図3】本発明に係るヘッドマウントモードを示す説明
図である。
FIG. 3 is an explanatory diagram showing a head mount mode according to the present invention.

【符号の説明】[Explanation of symbols]

1 カメラ 2 カメラ架台 3 カメラ架台コントローラ 4 ジョイステック 5 ロボット 6 ロボットコントローラ 7 操作者 8 ヘッドマウントデスプレイ 9 演算装置 1 camera 2 camera mount 3 camera mount controller 4 Joystick 5 robot 6 robot controller 7 operator 8 head mount display 9 arithmetic unit

Claims (1)

【特許請求の範囲】[Claims] 【請求項1】 遠隔におかれたカメラとロボットまたは
作業機械から成る遠隔操作システムにおいて、カメラ架
台とズームの制御として、遠隔の作業者による手動の操
作端による装置とロボットまたは作業機械の移動信号に
連動してカメラが動くリモートモードと、操作者の頭の
動きに対応してカメラが動くヘッドマウント装置を有す
ることを特徴とする遠隔操作用カメラ制御装置。
1. A remote control system comprising a camera and a robot or a work machine placed remotely, and a movement signal of a device and a robot or a work machine by a remote operator to control a camera mount and zoom. A remote control camera control device comprising: a remote mode in which the camera moves in synchronization with the above, and a head mount device in which the camera moves in response to the movement of the operator's head.
JP6671993A 1993-03-25 1993-03-25 Camera control device for remote control Withdrawn JPH06270076A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP6671993A JPH06270076A (en) 1993-03-25 1993-03-25 Camera control device for remote control

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP6671993A JPH06270076A (en) 1993-03-25 1993-03-25 Camera control device for remote control

Publications (1)

Publication Number Publication Date
JPH06270076A true JPH06270076A (en) 1994-09-27

Family

ID=13323997

Family Applications (1)

Application Number Title Priority Date Filing Date
JP6671993A Withdrawn JPH06270076A (en) 1993-03-25 1993-03-25 Camera control device for remote control

Country Status (1)

Country Link
JP (1) JPH06270076A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2016042862A1 (en) * 2014-09-19 2017-07-06 ソニー株式会社 Control device, control method and program
US10044921B2 (en) 2016-08-18 2018-08-07 Denso International America, Inc. Video conferencing support device
US10223601B1 (en) 2017-10-12 2019-03-05 Denso International America, Inc. Synthetic traffic object generator
WO2020054281A1 (en) * 2018-09-12 2020-03-19 キヤノン株式会社 Robot system, robot system control device, robot system control method, imaging device, control program, and recording medium

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2016042862A1 (en) * 2014-09-19 2017-07-06 ソニー株式会社 Control device, control method and program
US10044921B2 (en) 2016-08-18 2018-08-07 Denso International America, Inc. Video conferencing support device
US10223601B1 (en) 2017-10-12 2019-03-05 Denso International America, Inc. Synthetic traffic object generator
WO2020054281A1 (en) * 2018-09-12 2020-03-19 キヤノン株式会社 Robot system, robot system control device, robot system control method, imaging device, control program, and recording medium
JP2020040184A (en) * 2018-09-12 2020-03-19 キヤノン株式会社 Robot system, control method of robot system, control program and recording medium
CN113165186A (en) * 2018-09-12 2021-07-23 佳能株式会社 Robot system, control device and control method for robot system, image pickup device, control program, and storage medium

Similar Documents

Publication Publication Date Title
JP3318897B2 (en) Remote controller with video monitor
US6569086B2 (en) Controllable bending endoscope
US20120116416A1 (en) Medical Workstation
JP2000135689A (en) Image processor for robot
JPH0976063A (en) Welding equipment
JPH06270076A (en) Camera control device for remote control
US20200361092A1 (en) Robot operating device, robot, and robot operating method
JP3735708B2 (en) Remote environment guide device
JPH08257948A (en) Remote control device for robot
JPH03213278A (en) Remote control support system for robot
JPH0724767A (en) Remote control device for robot
JPH07328971A (en) Manipulator with tv camera
JPH08161031A (en) Monitor and control system
JPH0430981A (en) Control unit for television camera of remote control type robot
JPH0639753A (en) Remote control supporting device for robot
JPH10249786A (en) Manipulator control device and operation supporting device
JP2753121B2 (en) Manipulator control device
JPS639434Y2 (en)
JPH09102945A (en) Monitor television camera control method
WO2019137895A1 (en) Robotized apparatus for surgical operations
JPH1139035A (en) Robot remote control system
JPS60126985A (en) Working state display device for remote control operation
JPS61136783A (en) Control system of industrial television arm
JPS62212709A (en) Guidance control system for traveling object
JPH06285786A (en) Method of adjusting the position of remote-controlled camera and device therefor

Legal Events

Date Code Title Description
A300 Withdrawal of application because of no request for examination

Free format text: JAPANESE INTERMEDIATE CODE: A300

Effective date: 20000530