JPH06242883A - Inputting device - Google Patents

Inputting device

Info

Publication number
JPH06242883A
JPH06242883A JP5030838A JP3083893A JPH06242883A JP H06242883 A JPH06242883 A JP H06242883A JP 5030838 A JP5030838 A JP 5030838A JP 3083893 A JP3083893 A JP 3083893A JP H06242883 A JPH06242883 A JP H06242883A
Authority
JP
Japan
Prior art keywords
reflected
half mirror
line
position coordinate
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP5030838A
Other languages
Japanese (ja)
Inventor
Kenji Shimura
賢二 志村
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujitsu General Ltd
Original Assignee
Fujitsu General Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujitsu General Ltd filed Critical Fujitsu General Ltd
Priority to JP5030838A priority Critical patent/JPH06242883A/en
Publication of JPH06242883A publication Critical patent/JPH06242883A/en
Pending legal-status Critical Current

Links

Abstract

PURPOSE:To reduce a manual operation, and to improve the speed and efficiency of a computer input by making the movement of a cursor on a screen possible to be carried out by the line of sight of an operator. CONSTITUTION:An optical sensor is arranged at a goggle 2, the goggle 2 is mounted on a head 1 of an operator, and an infrared ray from a light source part 3 is transmitted through a first half mirror 6, reflected on a second half mirror 4, and made incident on an eye ball 5. A reflected light from the eye ball 5 is reflected on the half mirrors 4 and 6, and made incident on a CCD camera 7. The incident light is converted into an electric signal by the CCD camera 7, and video-processed by a video processing part 11, an outline is identified by an outline processing part 12, and the direction of the line of light is detected by a coordinate position detecting part 13 as a position coordinate on a display. Then, the position coordinate on the display is decided, and an input part switch 14 is turned on. The switch ON signal and the position coordinate information of the position coordinate detecting part 13 are transmitted from a control part 15 through a signal outputting part 16 to the input port of a computer.

Description

【発明の詳細な説明】Detailed Description of the Invention

【0001】[0001]

【産業上の利用分野】本発明は、入力装置に関する。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an input device.

【0002】[0002]

【従来の技術】従来、人とコンピュータとの間を仲介す
る入力装置として、例えばマウス、キーボード、ジョイ
スティック、ペン入力等の入力手段が実用化されてい
る。これらのうちマウスは、キーボードに比べて入力キ
ーが少ないので操作が煩雑でなく、また画面を見ながら
操作できるなどの利点があるが、ジョイスティックに比
べるとカーソルを移動させるスピードが遅いという欠点
があり、ジョイスティックは画面上の細かなポイントを
素早く指定するのには不向きである欠点を有するなど、
それぞれが一長一短を有している。また上記の入力手段
に共通することは、いずれも人の手によって操作するも
のであり、コンピュータの表示画面を見ながら手元の入
力装置を操作しなければならず、スピードが遅く、効率
も悪く、手による操作の煩雑さを伴うものであった。
2. Description of the Related Art Conventionally, input means such as a mouse, a keyboard, a joystick, and a pen input have been put into practical use as an input device for mediating between a person and a computer. Of these, the mouse has fewer input keys than the keyboard, so it has the advantage that it is not complicated to operate, and that it can be operated while looking at the screen, but it has the drawback of moving the cursor slower than the joystick. The joystick has the drawback that it is not suitable for quickly specifying small points on the screen.
Each has advantages and disadvantages. Also, what is common to the above-mentioned input means is that all are operated by human hands, and it is necessary to operate the input device at hand while looking at the display screen of the computer, which is slow, inefficient, This involved complicated manual operations.

【0003】[0003]

【発明が解決しようとする課題】本発明は、上記のよう
な、手による操作を少なくした入力手段を提供すること
により、コンピュータ入力のスピードと効率をアップさ
せ、手による操作の煩雑さを軽減できるものを提供する
ことにある。
DISCLOSURE OF THE INVENTION The present invention provides the input means with less manual operation as described above, thereby increasing the speed and efficiency of computer input and reducing the complexity of manual operation. It's about providing what you can.

【0004】[0004]

【課題を解決するための手段】上記の課題を解決するた
め、本発明はゴーグルに光センサーを配設し、このゴー
グルを人の頭部に装着し、前記光センサーの光源部から
の赤外線を第1ハーフミラーを通過させ、かつ第2ハー
フミラーで反射させて眼球に照射する。この眼球からの
反射光を前記第2および第1ハーフミラーで反射させ、
CCDカメラに入射する。このCCDカメラによって入
射光線を電気信号に変換し、映像処理部にて映像処理
し、輪郭処理部で輪郭を識別処理し、座標位置検出部に
て視線の方向をディスプレイ上の位置座標として検出す
るようになっている。前記の方法でディスプレイ上の位
置座標を決定し入力部スイッチをONする。このスイッ
チON信号と前記位置座標検出部の位置座標情報を制御
部を介して信号出力部よりコンピュータの入力ポートへ
送る。
In order to solve the above-mentioned problems, the present invention provides a goggle with an optical sensor, and the goggle is mounted on the head of a person, and infrared rays from a light source section of the optical sensor are emitted. The light passes through the first half mirror and is reflected by the second half mirror to irradiate the eyeball. The reflected light from this eyeball is reflected by the second and first half mirrors,
It is incident on the CCD camera. The CCD camera converts an incident light beam into an electric signal, an image processing unit performs image processing, an outline processing unit identifies an outline, and a coordinate position detection unit detects the direction of the line of sight as position coordinates on the display. It is like this. The position coordinates on the display are determined by the above method and the input unit switch is turned on. The switch ON signal and the position coordinate information of the position coordinate detecting unit are sent from the signal output unit to the input port of the computer via the control unit.

【0005】[0005]

【作用】以上のように構成したので、本発明による入力
装置によれば、視線が動くと、それに伴いカメラの像の
位置が変わるので、これによって視線の動きを追跡する
ことができる。この視線の動きは、輪郭処理され、前回
の視線位置データと今回の視線位置のデータとを比較す
ることによって視線方向のリアルタイムの検出が可能と
なり、画面上の所定のポイントを指定し、入力部スイッ
チをONにすることによりコンピュータに入力すること
ができる。
With the above arrangement, the input device according to the present invention can track the movement of the line of sight because the position of the image of the camera changes accordingly when the line of sight moves. This line-of-sight movement is contour-processed, and the line-of-sight direction can be detected in real time by comparing the previous line-of-sight position data with the current line-of-sight position data. It can be input to the computer by turning on the switch.

【0006】[0006]

【実施例】図1は、本発明による入力装置において、眼
球に向けて照射した赤外線のビームと、このビームの角
膜による反射光と網膜による反射光を電気信号に変換
し、コンピュータに入力することの説明図である。1は
人間の頭部で、2はその頭部に装着したゴーグルであ
る。3は光源部で、4は第2ハーフミラーで、5は人間
の眼球である。光センサーの光源部から出た赤外線は第
1ハーフミラー6を通過し第2ハーフミラー4で反射し
眼球に向けて照射される。眼球で反射した光は、前記第
2ハーフミラーおよび第1ハーフミラーで反射し、カメ
ラ7に入射する。ここで電気信号に変換し映像処理部1
1にて映像処理し、輪郭処理部12で角膜反射光の映像
輪郭と網膜反射光の映像輪郭とを識別処理し、座標位置
検出部13でディスプレイ上の位置座標を検出するよう
になっている。尚、ディスプレイ上の所定の位置を座標
の原点として予め指定し、人が操作を介しするに当たっ
て、最初にこの座標の原点を見つめて入力部スイッチ1
4を押し座標位置の初期化を行うようにする。座標位置
検出部13はこの初期化によって以後の検出操作での位
置座標データの値を決定する。上記の方法でディスプレ
イ上の位置座標を定め、以後操作の度に入力部スイッチ
14を押し、このスイッチON信号と位置座標データ信
号が前記位置座標検出部から制御部15を介して信号出
力部16よりコンピュータへ送られる。
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 shows an input device according to the present invention which converts an infrared ray beam directed toward an eyeball, a light beam reflected by a cornea and a light beam reflected by a retina of the beam into an electric signal and inputs the electric signal to a computer. FIG. Reference numeral 1 is a human head, and 2 is goggles attached to the head. 3 is a light source unit, 4 is a second half mirror, and 5 is a human eyeball. The infrared rays emitted from the light source section of the optical sensor pass through the first half mirror 6, are reflected by the second half mirror 4, and are irradiated toward the eyeball. The light reflected by the eyeball is reflected by the second half mirror and the first half mirror and enters the camera 7. Here, the video signal is converted into an electric signal and is processed by the video processing unit 1.
The image processing is performed at 1, the contour processing unit 12 discriminates the image contour of the cornea reflected light and the image contour of the retina reflected light, and the coordinate position detection unit 13 detects the position coordinates on the display. . It should be noted that a predetermined position on the display is designated in advance as the origin of the coordinates, and when the person operates, the operator first looks at the origin of the coordinates and inputs the switch 1
Press 4 to initialize the coordinate position. The coordinate position detector 13 determines the value of the position coordinate data in the subsequent detection operation by this initialization. The position coordinates on the display are determined by the above-described method, and the input unit switch 14 is pressed each time thereafter, and the switch ON signal and the position coordinate data signal are sent from the position coordinate detecting unit to the signal output unit 16 via the control unit 15. Sent to the computer.

【0007】図2は、コンピュータのディスプレイ画面
の所定の位置を選択する場合の入力装置の構成図で、2
1はコンピュータで、22はディスプレイ装置で、23
は視線追跡処理部で、24はキーボードで、25は視線
追跡装置を搭載したゴーグルである。26はクリックボ
タンでマウスボタンに相当し、これを押したときに視線
の方向が示している画面内の選択メニューがコンピュー
タに読み込まれる。上記の構成において、コンピュータ
を操作する人間がゴーグルを装着してディスプレイ装置
に対面し、画面上の所定のポイントを選択する場合は前
記ゴーグルの視線追跡装置よりアイポイント(視点)が
検出され視線追跡処理部に送られ、このアイポイント
(視点)情報は従来のマウス信号と同様のものに変換さ
れ、コンピュータに伝達される。
FIG. 2 is a block diagram of the input device for selecting a predetermined position on the display screen of the computer.
1 is a computer, 22 is a display device, and 23
Is a line-of-sight tracking processing unit, 24 is a keyboard, and 25 is goggles equipped with a line-of-sight tracking device. Reference numeral 26 denotes a click button, which corresponds to a mouse button, and when pressed, a selection menu on the screen indicated by the direction of the line of sight is read into the computer. In the above configuration, when a person operating the computer wears goggles and faces the display device and selects a predetermined point on the screen, an eye point (viewpoint) is detected by the eye tracking device of the goggles and the eye tracking is performed. The eyepoint information is sent to the processing unit, converted into the same kind of conventional mouse signal, and transmitted to the computer.

【0008】図3は視線の動きに連動して角膜で反射す
る角膜反射光と、眼底部の網膜で反射する網膜反射光と
が輪郭処理部で識別されることを説明する図で、図にお
いて、31は眼球の前面で、33は第1ハーフミラー
で、32は第2ハーフミラーで、34は反射光が結像す
る位置をを示す。眼球に向けて赤外線等のビームを照射
すると角膜で反射する角膜反射光と眼底部の網膜で反射
する網膜反射光が得られ、角膜反射光は高輝度でスポッ
トの径は小さく、網膜反射光は低輝度でスポットの径は
大きいので両者を判別することが可能である。また、網
膜は眼底部にあるので殆ど動かないので、このほとんど
静止した網膜の反射画像の中を視線の動きとともに角膜
反射光のスポットが素早く動きまわることになる。例え
ば視線が、矢印35の方向を指している時は、角膜反射
光は矢印36、37、38に沿って反射されて結像す
る。
FIG. 3 is a diagram for explaining that the corneal reflected light reflected by the cornea and the retinal reflected light reflected by the retina of the fundus are discriminated by the contour processing section in conjunction with the movement of the line of sight. , 31 is the front surface of the eyeball, 33 is the first half mirror, 32 is the second half mirror, and 34 is the position where the reflected light forms an image. When a beam of infrared rays or the like is directed toward the eyeball, corneal reflected light reflected by the cornea and retinal reflected light reflected by the retina of the fundus of the eye are obtained, and the corneal reflected light has high brightness and a small spot diameter. Since the spot size is low and the spot diameter is large, it is possible to distinguish between the two. Further, since the retina is located on the fundus of the eye, it hardly moves. Therefore, the spot of the corneal reflected light quickly moves around in this almost stationary reflection image of the retina as the line of sight moves. For example, when the line of sight points in the direction of the arrow 35, the corneal reflected light is reflected along the arrows 36, 37 and 38 to form an image.

【0009】[0009]

【発明の効果】以上に説明したように本発明による入力
装置によれば、従来、マウスにより人間が手によって画
面上のカーソルを移動していたものが、人間の視線によ
って移動するようになるので手を使う煩わしさがなくな
り、便利になるという効果がある。
As described above, according to the input device of the present invention, what is conventionally moved by the mouse to move the cursor on the screen by the human is moved by the line of sight of the human. It has the effect of eliminating the hassle of using hands and making it convenient.

【図面の簡単な説明】[Brief description of drawings]

【図1】本発明による入力装置の説明図である。FIG. 1 is an explanatory diagram of an input device according to the present invention.

【図2】本発明による入力装置の構成図である。FIG. 2 is a configuration diagram of an input device according to the present invention.

【図3】本発明による眼球反射光線の光学系の説明図で
ある。
FIG. 3 is an explanatory diagram of an optical system for eyeball reflected light rays according to the present invention.

【符号の説明】[Explanation of symbols]

1 頭部 2 ゴーグル 3 光源部 4 第2ハーフミラー 5 眼球 6 第1ハーフミラー 7 カメラ 8 メガネの窓 9 視線方向 10 視線方向 11 映像処理部 12 輪郭処理部 13 座標位置検出部 14 入力部スイッチ 15 制御部 16 信号出力部 1 head part 2 goggles 3 light source part 4 second half mirror 5 eyeball 6 first half mirror 7 camera 8 glasses window 9 line-of-sight direction 10 line-of-sight direction 11 image processing part 12 contour processing part 13 coordinate position detection part 14 input position switch 15 Control unit 16 Signal output unit

Claims (1)

【特許請求の範囲】[Claims] 【請求項1】 光センサー発光部と、前記赤外線の経路
を構成する第1ハーフミラーおよび第2ハーフミラー
と、前記赤外線を受光するカメラとを配設したゴーグル
と、前記カメラの映像を電気信号に変換し映像処理する
映像処理部と、前記映像処理部の映像を輪郭処理する輪
郭処理部と、座標位置検出部にて視線方向を位置座標と
して検出する座標位置検出部とを有し、位置座標を出力
するスイッチと、上記映像処理部と、輪郭処理部と、座
標位置検出部と、スイッチ、との制御をする制御部と、
この制御部の信号をコンピュータへ出力する信号出力部
とで構成したことを特徴とする入力装置。
1. A goggle in which an optical sensor light-emitting portion, a first half mirror and a second half mirror forming the path of the infrared rays, and a camera for receiving the infrared rays are arranged, and an image of the camera is an electrical signal. A video processing unit for converting the video into a video processing unit, a contour processing unit for processing the video of the video processing unit by a contour, and a coordinate position detection unit for detecting a line-of-sight direction as a position coordinate by the coordinate position detection unit. A switch that outputs coordinates, the video processing unit, a contour processing unit, a coordinate position detection unit, and a control unit that controls the switch,
An input device comprising a signal output unit for outputting a signal of the control unit to a computer.
JP5030838A 1993-02-19 1993-02-19 Inputting device Pending JPH06242883A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP5030838A JPH06242883A (en) 1993-02-19 1993-02-19 Inputting device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP5030838A JPH06242883A (en) 1993-02-19 1993-02-19 Inputting device

Publications (1)

Publication Number Publication Date
JPH06242883A true JPH06242883A (en) 1994-09-02

Family

ID=12314843

Family Applications (1)

Application Number Title Priority Date Filing Date
JP5030838A Pending JPH06242883A (en) 1993-02-19 1993-02-19 Inputting device

Country Status (1)

Country Link
JP (1) JPH06242883A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0699662A1 (en) * 1994-08-31 1996-03-06 Nippon Paper Industries Co., Ltd. Novel urea (thiourea) derivative and thermal recording sheet using same
JPH1091325A (en) * 1996-09-13 1998-04-10 Toshiba Corp Gaze detection system
KR100374346B1 (en) * 2000-12-06 2003-03-04 한국과학기술원 Head pose tracking method using image processing
KR20030022537A (en) * 2001-09-11 2003-03-17 김태용 Position Data Input System Using Eye Tracking Camera And Method Thereof

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0699662A1 (en) * 1994-08-31 1996-03-06 Nippon Paper Industries Co., Ltd. Novel urea (thiourea) derivative and thermal recording sheet using same
JPH1091325A (en) * 1996-09-13 1998-04-10 Toshiba Corp Gaze detection system
KR100374346B1 (en) * 2000-12-06 2003-03-04 한국과학기술원 Head pose tracking method using image processing
KR20030022537A (en) * 2001-09-11 2003-03-17 김태용 Position Data Input System Using Eye Tracking Camera And Method Thereof

Similar Documents

Publication Publication Date Title
JP7153096B2 (en) System and method enabling communication by eye feedback
JP5293154B2 (en) Head mounted display
US6791531B1 (en) Device and method for cursor motion control calibration and object selection
US4720189A (en) Eye-position sensor
JP2988178B2 (en) Gaze direction measuring device
EP0786117B1 (en) Apparatus and method for controlling the position of a graphical pointer
JPH0749744A (en) Head mounting type display input device
JP2010145861A (en) Head mount display
WO2004066097A2 (en) Gaze tracking system and method
CN106919262A (en) Augmented reality equipment
JPH0844490A (en) Interface device
JP3272906B2 (en) Gaze direction detecting method and apparatus and man-machine interface apparatus including the same
JP2001356875A (en) Pointer display system
JP2001154794A (en) Pointing device with click function by blink
JP2000112651A (en) Pointing mechanism
JPH06242883A (en) Inputting device
JPH10161801A (en) Input device
JPH05298015A (en) Glance detecting system and information processing system
JPH1039995A (en) Line-of-sight/voice input device
WO2005059736A1 (en) Device and method for controlling pointer by detecting pupil
JPH11184621A (en) Line of sight input device
KR100796771B1 (en) Image Shutter based Virtual Touch Screen System and Method
Bilal et al. Design a Real-Time Eye Tracker
JPH1173273A (en) Inputting device for physically handicapped person
JPH03256112A (en) Control processor