JPH08335135A - Information processor - Google Patents

Information processor

Info

Publication number
JPH08335135A
JPH08335135A JP7164757A JP16475795A JPH08335135A JP H08335135 A JPH08335135 A JP H08335135A JP 7164757 A JP7164757 A JP 7164757A JP 16475795 A JP16475795 A JP 16475795A JP H08335135 A JPH08335135 A JP H08335135A
Authority
JP
Japan
Prior art keywords
input
line
sight
switch
mouse
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP7164757A
Other languages
Japanese (ja)
Inventor
Hirokuni Takano
博邦 鷹野
Original Assignee
Canon Inc
キヤノン株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc, キヤノン株式会社 filed Critical Canon Inc
Priority to JP7164757A priority Critical patent/JPH08335135A/en
Publication of JPH08335135A publication Critical patent/JPH08335135A/en
Pending legal-status Critical Current

Links

Abstract

(57) [Abstract] [Purpose] To provide an information processing device that adopts two types of input methods including line-of-sight input, clearly distinguishes the input methods, and is capable of comfortable and unconfusing input operations. To aim. [Structure] Switch-only switch 1 as selection means for distinguishing between line-of-sight input and mouse 102 input
05 is provided on the mouse 102. Depending on the on / off operation of the switch 105 for exclusive use of switching, the cursor position is switched so as to be designated by either line-of-sight input or mouse 102 input.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing device such as a personal computer (hereinafter referred to as "personal computer") or a word processor (hereinafter referred to as "word processor").

[0002]

2. Description of the Related Art Conventionally, only one type of input method is used for inputting a cursor on a screen in an information processing apparatus of this type. For example, a so-called pointing device such as a mouse or a trackball for manually moving the cursor is used. The input method was adopted.

[0003]

However, since the conventional information processing apparatus as described above employs only one type of input method, there is a problem that the optimum input method cannot always be selected as necessary. Occurs.

On the other hand, if two types of input methods are to be adopted at the same time for this purpose, for example, when the input method using a pointing device and the input method using line-of-sight input are adopted, the input operation is performed by a different entity, the hand and the line-of-sight. Therefore, there is a problem that the operation is confused when inputting.

Therefore, the present invention has been made in order to solve such a problem, and adopts two types of input methods including line-of-sight input, clearly distinguishes the input methods, and is comfortable and confusing. An object of the present invention is to provide an information processing device capable of performing input operation without any error.

[0006]

In order to solve the above problems, the present invention has the following means.

According to a first aspect of the present invention, there is provided an information processing apparatus for performing information processing based on position information designated on a screen, wherein first designation means for designating a coordinate position on the screen by a coordinate indicator. And a second designating means for detecting the operator's line-of-sight position corresponding to the screen and designating a coordinate position on the screen based on this line-of-sight position, and a selection for distinguishing between the two designating means. And means.

An information processing apparatus according to a second aspect is characterized in that the selecting means is a dedicated switch for selection.

An information processing apparatus according to a third aspect is characterized in that the selecting means is a switch having two or more functions including selection.

[0010]

With the above construction, the present invention has the following functions.

According to a first aspect of the present invention, there is provided an information processing apparatus, wherein first designation means for designating a coordinate position on a screen by a coordinate indicator and second designation means for designating a coordinate position on the screen based on a line-of-sight position. One of the two designating means is selected using the selecting means.

The information processing apparatus according to the second aspect selects either one of the two designating means by using a dedicated switch for selection.

According to another aspect of the information processing apparatus of the present invention, the selection is performed by using a switch having two or more functions including selection.

[0014]

Embodiments of the present invention will now be described in detail with reference to the drawings.

(First Embodiment) FIG. 1 is a schematic external view showing a first embodiment of the information processing apparatus of the present invention.

The present apparatus has a control means 100 which will be described later.
Personal computer body 101 having this, and this personal computer body 10
Mouse 102 as the first designating means connected to 1
And a line-of-sight position designating means 1 as second designating means for inputting a line-of-sight, which is also connected to the personal computer main body 101.
And 10 are provided.

Here, the mouse 102 has the left switch 10
A function switch 103 composed of 3a and a right switch 103b is provided on the left and right sides of the main body, and a selection for switching the input is made by selecting either the line-of-sight input or the input by the mouse 102 above. A switch 105 dedicated for changeover is arranged as means.

The personal computer body 101 also has a first display means 107 for displaying an arrow 108 indicating the cursor position on the screen.

The line-of-sight position designation means 110 is a second
The observation display unit 106 for displaying the image from the display unit 2 of FIG.

The observation display unit 106 is adapted to display the same contents as those displayed on the first display means 107, and the arrow 1 which moves in synchronization with the arrow 108.
09 is displayed. However, in the center of the observation display unit 106, a hollow portion 10 is formed due to an opening 20 which will be described later and is provided for detecting the line of sight.

FIG. 2 is a diagram showing an internal configuration of the line-of-sight position designating means 110.

The line-of-sight position designating means 110 comprises an observation system and a line-of-sight detection system.

The observation system includes an observation optical element 1 having a positive refracting power as a whole, and an observation optical element 1 above or below the operator's eye E (see FIG. 2).
And a second display unit 2 formed of a liquid crystal image display element or the like for displaying an image on the observation display unit 106.

The line-of-sight detection system includes an illumination light source 3 for illuminating the eye E with infrared light, an image forming lens system 4 having lenses 4a and 4b for forming a reduced image of the eye E and its corneal reflection image, and image formation. It is configured to have a light receiving element 5 such as a photoelectric conversion element that detects an image formed by the lens system 4.

The observation optical element 1 comprises a first optical action surface 1
a, a second optical action surface 1b, and a third optical action surface 1c, and the second optical action surface 1b is inclined in the up-down direction of the operator's eye E and reflects light. Is provided with an opening 20 at the center thereof.

In the observation system, the light from the second display means 2 is first refracted and transmitted by the third optical action surface 1c, then totally reflected by the first optical action surface 1a, and then the second optical action surface 1a. After being reflected by the reflection layer 30 of the optical action surface 1b, it reaches the first optical action surface 1a again, is refracted and transmitted, and becomes a light beam having a divergence angle (or a convergence angle) adapted to the diopter of the operator, and is directed to the eye E side. It is supposed to eject.

Further, when the line connecting the operator's eye E and the center of the second display means 2 in this observation system is the basic optical axis L1 of the observation system, the adjustment of the operator's diopter is performed in the second manner. This is possible by moving the display means 2 in parallel along the optical axis L1 in the observation optical element 1.

Further, in the observation optical element 1, the three optical action surfaces 1a, 1b and 1c are each composed of a three-dimensional curved surface having no axis of rotational symmetry in order to correct the image performance and distortion and to make a telecentric system. Therefore, in the present embodiment, the curved surface structure is symmetrical only to the plane including the basic optical axis L1 and parallel to the paper surface.

In the line-of-sight detection system, when the optical axis connecting the light receiving element 5 from the eye E through the opening 20 is L2, the illumination light source 3 is symmetrical with respect to a plane including the optical axis L2 and parallel to the paper surface. Two light sources are arranged so that at least one pair of light sources illuminates the operator's eyes from below the eyes.

Further, in this visual axis detection system, the light emitted from the illumination light source 3 becomes the illumination light that illuminates the observer's eye E from a direction different from the optical axis L2 of the visual axis detection system, and further the operator's cornea and It is reflected and scattered by the pupil.
Here, the light reflected by the cornea forms a Purkinje image, and the light scattered by the pupil forms a pupil image.

The Purkinje image and the pupil image are imaged on the light receiving element 5 by the imaging lens system 4 through the opening 20 provided in the second optical action surface 1b, and based on these images. The line-of-sight detection circuit (not shown) can detect the line-of-sight direction of the operator. Here, the lens 4a of the imaging lens system 4 has a wedge shape suitable for downsizing because the imaging lens system 4 can be configured with a small number of lenses, and a curvature is imparted to an oblique surface of the lens 4a. The eccentric aberration generated on the second optical action surface 1b can be effectively corrected.

Further, the lens 4b of the imaging lens system 4 is
At least one aspherical surface effective for correcting off-axis imaging performance is provided.

Although not described in the above structure, the aperture of the imaging lens system 4 is the aperture 20 of the second optical action surface 1b.
It should be installed near And, if possible, the opening 20
It is desirable that the apertures and the apertures coincide with each other, so that the opening 20 can be made smaller, and the hollow portion 1 with respect to the observation system 1
It is effective in preventing 0.

Here, when the opening 20 is set to be smaller than 2 mm, it becomes smaller than the pupil diameter of the eye E, and it is effective to prevent the hollowness in the observation system.

Further, since the light for illuminating the eye E is preferably light having a wavelength with low luminosity, infrared light is suitable. At this time, at least one optical member for cutting visible light is formed in the imaging lens system 4. It is good to provide one. This optical member can further improve the detection accuracy of the line of sight.

Further, by arranging the illumination light source 3 on the side opposite to the observation optical element 1 and the eye E, the eye E can be appropriately illuminated even if the refractive power of the observation optical element 1 is strengthened to widen the field of view. It is desirable because it can be done. In this case, it is advisable to provide a new opening in the light source portion of the reflective layer 30 on the second optical action surface 1b. Then, at this time, the light emitted from the illumination light source 3 passes through this opening portion, and further, the first optical action surface 1a.
The illumination light source 3 may be arranged so as to illuminate the observer's eye E from a direction different from the optical axis L2 of the visual axis detection system.

FIG. 4 is a block diagram showing the outline of the control system of this apparatus.

The control system of this device controls the various parts of this device in accordance with various stored programs.
The mouse 102, the display means 107, and the line-of-sight position designating means 110.

Here, the control means 100 is the mouse 102.
It is for determining whether the function switch 103 and the switch 105 exclusively used for switching provided in the above are on or off. In addition, the switching control is performed so that the operator can specify the cursor position by either the line-of-sight input or the mouse 102 input in accordance with the ON / OFF operation of the switch 105 for exclusive use of the switch.

Further, the control means 100 moves the arrow 108 indicating the cursor position by the line of sight or the input with the mouse 102, designates a certain position, and then clicks the function switch 103 to move the cursor to that position. The position is determined and the cursor is displayed on the display means 107.

Next, the operation of the first embodiment of the present invention will be described with reference to FIG.
It will be described according to the flowchart of

First, when the operator activates this apparatus, the control means 100 determines whether the switch 105 for switching is on or off in order to determine which of the input method is the line of sight and the input method using the mouse 102 (S1). When it is on, the cursor can be moved by the line-of-sight input (S2), and the arrow 108 of the cursor automatically moves to the place where the operator is looking. Therefore, in order to determine the cursor position, the operator clicks the function switch 103 once to determine the cursor position (S3). After that, the operator decides whether or not to continue the input by the line-of-sight input (S4), and if not, the step S1
Return to, and if you want to continue, after continuing the line-of-sight input (S
5) and returns to step S2.

Further, in the step S1, if the switch 105 for exclusive use of changeover is off, the mouse 1
The cursor can be moved by inputting 02 (S6). When the operator wants to determine the cursor at the intended place, the function switch 103 is clicked once to determine the cursor position (S7). Thereafter, the operator decides whether or not to continue inputting with the mouse 102 (S8), and if not continuing, returns to step S1. If continuing, after continuing inputting with the mouse 102 (S9), returns to step S6. .

According to the first embodiment as described above, the mouse 10 is provided by providing the changeover switch 105.
Since it is possible to clearly distinguish the input method using the pointing device such as 2 from the input method using the line-of-sight input, the operator can arbitrarily select the input method suitable for the input, and for example, see the screen. However, when writing, it is possible to easily select the cursor input method based on the line of sight without using the manual input method using a pointing device.

(Second Embodiment) Next, a second embodiment of the present invention will be described.

In this embodiment, without providing the switch 105 exclusively used for changeover as described in the first embodiment, the addition of the operation of the function switch 103 clearly distinguishes the input by the mouse 102 and the input method by the line of sight. It is something that can be done.

Here, this distinction is made by the control means 100 judging whether or not the operator has continuously pressed the left switch 103a and the right switch 103b of the function switch 103 at the same time.

FIG. 6 is a flow chart showing the operation of the second embodiment according to the present invention.

First, the operator activates this device and the mouse 1
02: Input method or line-of-sight input method (S1
0). When inputting with the line of sight, the operator uses the mouse 1
By simultaneously pressing the left switch 103a and the right switch 103b of 02 (S15), the cursor can be moved by the line-of-sight input (S16).

Next, the control means 100 determines whether or not the operator has released the left switch 103a and the right switch 103b (S17). If not released, the process returns to step S16, and when released, the cursor position is determined at that position. Is done (S1
8). When the cursor position is determined, the operator further decides whether or not to continue the line-of-sight input (S19), and if so, the process returns to step S15, and if not, the process returns to step S10.

If the line-of-sight is not input in step S10, the cursor is moved by mouse input (S11). When the operator clicks the left switch 103a of the mouse 102 once in the movement of the cursor by the input of the mouse 102 (S12), the control unit 100 is activated there.
The cursor position is determined by (S13).

After the cursor position is determined, the operator further decides whether or not to continue mouse input (S14). If the operation is continued, the process returns to step S11. If not, the process returns to step S10.

According to the second embodiment as described above, the mouse 10 is used by using the existing switches and adding the operation thereof.
Since it is possible to clearly distinguish between the input method by 2 and the input method by the line-of-sight, especially the switch 10 for exclusive use of changeover
The operator can easily select an input method suitable for input by himself without providing 5.

The present invention is not limited to the above embodiment, and various modifications can be made within the scope of the gist thereof.

For example, the personal computer has been described in the above embodiments, but it goes without saying that the present invention can be applied to word processors and the like.

[0056]

As described in detail above, the present invention has the following effects.

According to the invention described in claim 1, the input method by the coordinate indicator such as a mouse and the input method by the line-of-sight input can be clearly distinguished, and the input method suitable for the input can be arbitrarily selected. Therefore, it is possible to provide an information processing device that is comfortable and can perform input operation without confusion.

According to the second aspect of the invention, by providing a dedicated switch for selection, it is possible to clearly distinguish between the input method using the coordinate indicator such as a mouse and the input method using the line-of-sight input. The person can more easily select an input method suitable for input.

According to the third aspect of the present invention, the existing switches are used, and by adding the operation, it is possible to clearly distinguish between the input method using the coordinate indicator such as a mouse and the input method using the line-of-sight input. The operator can easily select an input method suitable for input without providing a special switch.

[Brief description of drawings]

FIG. 1 is a schematic external view of the present apparatus.

FIG. 2 is an internal configuration diagram of a line-of-sight position designating unit.

FIG. 3 is a diagram for explaining a second optical action surface.

FIG. 4 is a block diagram showing a control system of the present apparatus.

FIG. 5 is a flowchart showing the operation of the first exemplary embodiment of the present invention.

FIG. 6 is a flowchart showing the operation of the second exemplary embodiment of the present invention.

[Description of Reference Signs] 1 Observation optical element 1a First optical action surface 1b Second optical action surface 1c Third optical action surface 2 Second display means 3 Illumination light source 4 Imaging lens system 5 Light receiving element 20 Opening 30 Reflective Layer 100 Control Means 101 Personal Computer Main Body 102 Mouse 103 Function Switch 105 Dedicated Switch 107 First Display Means 110 Gaze Position Designating Means

Claims (3)

[Claims]
1. An information processing apparatus that performs information processing based on position information specified on a screen, wherein the coordinate position on the screen is specified by a coordinate indicator.
And a second specifying unit that detects the line-of-sight position of the operator corresponding to the screen and specifies the coordinate position on the screen based on the line-of-sight position, and the two specifying units are distinguished. An information processing apparatus comprising: a selecting unit that selects one of the two.
2. The information processing apparatus according to claim 1, wherein the selection means is a dedicated switch for the selection.
3. The information processing apparatus according to claim 1, wherein the selection means is a switch having two or more functions including the selection.
JP7164757A 1995-06-07 1995-06-07 Information processor Pending JPH08335135A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP7164757A JPH08335135A (en) 1995-06-07 1995-06-07 Information processor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP7164757A JPH08335135A (en) 1995-06-07 1995-06-07 Information processor

Publications (1)

Publication Number Publication Date
JPH08335135A true JPH08335135A (en) 1996-12-17

Family

ID=15799351

Family Applications (1)

Application Number Title Priority Date Filing Date
JP7164757A Pending JPH08335135A (en) 1995-06-07 1995-06-07 Information processor

Country Status (1)

Country Link
JP (1) JPH08335135A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011145304A1 (en) * 2010-05-20 2011-11-24 日本電気株式会社 Portable information processing terminal
JP2012141988A (en) * 2011-01-05 2012-07-26 Visteon Global Technologies Inc System ready switch for eye tracking human machine interaction control system
JP6070833B2 (en) * 2013-05-08 2017-02-01 富士通株式会社 Input device and input program

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011145304A1 (en) * 2010-05-20 2011-11-24 日本電気株式会社 Portable information processing terminal
JP2012141988A (en) * 2011-01-05 2012-07-26 Visteon Global Technologies Inc System ready switch for eye tracking human machine interaction control system
JP6070833B2 (en) * 2013-05-08 2017-02-01 富士通株式会社 Input device and input program
US9804671B2 (en) 2013-05-08 2017-10-31 Fujitsu Limited Input device and non-transitory computer-readable recording medium

Similar Documents

Publication Publication Date Title
US9870050B2 (en) Interactive projection display
EP1562469B1 (en) Installation for detecting and following an eye and the gaze direction thereof
US6433760B1 (en) Head mounted display with eyetracking capability
US4702575A (en) Helmet mounted eye tracker using a position sensing detector
JP2863869B2 (en) Helmet system
US6577411B1 (en) Optical system for alternative or simultaneous direction of light originating from two scenes to the eye of a viewer
US4902123A (en) Topography measuring apparatus
US6389153B1 (en) Distance information generator and display device using generated distance information
US5841511A (en) Method of corneal analysis using a checkered placido apparatus
JP4517049B2 (en) Gaze detection method and gaze detection apparatus
JP3166179B2 (en) Eye gaze detection device
US7825996B2 (en) Apparatus and method for virtual retinal display capable of controlling presentation of images to viewer in response to viewer's motion
JP4649319B2 (en) Gaze detection device, gaze detection method, and gaze detection program
US6997874B2 (en) Noncontact ophthalmotonometer
EP0788613B1 (en) Microscope, in particular for surgical operations
JP4492847B2 (en) Eye refractive power measuring device
EP1183992B1 (en) Fundus camera
US6580448B1 (en) Process and device for the parallel capture of visual information
JP3709335B2 (en) Ophthalmic equipment
ES2345413T3 (en) Mug fixing device.
US6636696B2 (en) Fundus camera
US4974010A (en) Focus control system
DE60030019T2 (en) Device for measuring eye points of a subject with respect to a spectacle frame
DE60216557T2 (en) Shape measuring apparatus
US6373961B1 (en) Eye controllable screen pointer