JPH06194563A - Equipment for controlling line of sight - Google Patents

Abstract

PURPOSE:To surely input without the possibility of malfunction and also to accomplish an effective intension input which is free from unnatural feeling from a user's point of view. CONSTITUTION:The equipment is provided with a line of sight detecting means for detecting the user's line of sight and outputting information on the line of sight, display means 131, 132 and 14 provided with plural display marks which respectively correspond to different operations of the equipment, a selecting means for defining an operating method for respective operations of the equipment, and a control means for generating a control signal for controlling the operation of the equipment when the information on line of sight showing that the user closely observes specified one of, or plural display marks of the display means 131, 132 and 14 is outputted by the line of sight detecting means and also the operating method for the equipment operation which is meant by the closely observed display marks is selected by the selecting means, and then, the operation to be controlled is selected among different operations by the line of sight detecting means, and the operating method for the operation is selected by the selecting means.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an improvement of a visual axis control device equipped with visual axis detecting means for detecting the visual axis of a user and outputting visual axis information.

[0002]

2. Description of the Related Art Conventionally, various proposals have been made for detecting the line of sight. For example, the applicant of the present application discloses that
No. 241511, JP-A-1-274736, JP-A-2-264632, JP-A-4-138432 and the like are disclosed. Further, a technique that enables various controls of the device based on the detected line-of-sight information is also disclosed in Japanese Patent Laid-Open No. 2-323.
No. 12, JP-A-3-87818, JP-A-3-1090.
No. 30, U.S. Pat. No. 4,595,990 and the like.

Hereinafter, these conventional examples will be outlined.

Although various proposals have been made for detecting the line of sight as described above, photoelectric non-contact measurement has the least burden on the subject and is suitable for use in general equipment. Therefore, most of this kind.

For example, the applicant of the present application irradiates the eyeball of a user with infrared rays with an iRED (infrared light emitting diode), forms an image of the anterior segment image of the user, receives the image, and outputs the iRED from the output signal of the sensor. We have developed and put into practical use a technique for detecting the direction of the line of sight by estimating the corneal reflection image and the position of the pupil circle.

The line-of-sight detection will be briefly described below to the extent necessary for understanding the present invention described below.

FIG. 10 is an optical layout diagram showing an example of the case where the visual axis detecting means is incorporated in the single-lens reflex camera.

In FIG. 10, 101 is a taking lens and 1 is a taking lens.
Reference numeral 02 is a quick return mirror for guiding a part of the light flux passing through the taking lens 101 to a finder system (observation system), 103 is a display element, 104 is a focusing plate, 105 is a condenser lens, 106 is a penta roof prism, 107
Is a sub-mirror for guiding the light flux that has passed through the quick return mirror to the focus detection system, 108 is a multi-point focus detection device, and 109 is a camera for controlling the drive of the display element 103, focus detection calculation, lens drive, etc. Control circuit.

In the above structure, for example, the display element 103 and the multi-point focus detection device 108 are controlled (provided for line-of-sight control) based on line-of-sight information obtained by the line-of-sight detecting means described later. .

That is, the display element 103 is, for example, a two-layer type guest-host type liquid crystal element that does not use a polarizing plate, and displays a range-finding area (focus detection position) in the finder field. , One of a plurality of distance measurement areas on the display element 103 is selectively displayed based on the line-of-sight information, and among various operation mode displays on the display element 103, the operation mode to be used is the same as the line-of-sight information. Is selected and displayed.

Further, the multi-point focus detection device 108 detects the focus state based on the information of the selected distance measurement area among the plurality of distance measurement areas on the photographing screen. The selection of, for example, one distance measuring area in accordance with the photographer's intention from the area is performed using the line-of-sight information.

Next, an example of the line-of-sight detecting means will be described with reference to FIGS.

In FIG. 10, 110 is an eyepiece lens,
A dichroic mirror 110a that transmits visible light and reflects infrared light is installed obliquely inside the same and also serves as an optical path splitter. 111 is a light receiving lens. 113a, 113b
(Not shown in FIG. 10), 113c is, for example, a light emitting diode which is a lighting means. Reference numeral 114 denotes an image sensor having a configuration in which photoelectric element arrays are two-dimensionally arranged, and is arranged so as to be conjugate with the vicinity of the pupil of the eyeball E at a predetermined position with respect to the light receiving lens 111 and the eyepiece lens 110. Reference numeral 115 denotes a line-of-sight calculation processing circuit, which has a line-of-sight correction calculation, line-of-sight correction data storage, line-of-sight calculation function, and control functions of the infrared light emitting diodes 113a, 113b, 113c.

The above-described eyepiece lens 110 to the line-of-sight calculation processing circuit 115 constitute the line-of-sight detecting means for the eyeball E.

FIG. 11 is a perspective view showing a main part of the line-of-sight detecting means shown in FIG.

Infrared light emitting diodes 113a, 1 for illumination
The reference numerals 13b and 113c are used in pairs to detect the distance between the camera and the eyeball E of the observer. Depending on the posture of the camera, that is, when the camera is in the lateral position, the infrared light emitting diode 113a, In the case where the 113b is a set and is in the vertical position, the infrared light emitting diodes 113b and 113c are used as a set, respectively.

Although the means for detecting the attitude of the camera is not shown in FIG. 11, an attitude detecting means using a mercury switch or the like is effective.

FIG. 12 is for explaining the principle of visual axis detection and the output intensity distribution from the image sensor 114. More specifically, FIG. 12A is an explanatory view of the principle of visual axis detection. b) is the image sensor 1 of FIG.
It is explanatory drawing of the output intensity distribution from FIG.

Each infrared light emitting diode 113a, 113
b and 113c are arranged substantially symmetrically in the Z direction, and divergently illuminate the line of sight of the photographer. The infrared light emitting diode 11
The operation when using a pair of 3a and 113b is as follows.

The infrared light projected from the infrared light emitting diode 113b illuminates the cornea 116 of the eyeball E. At this time, the corneal reflection image d by a part of the infrared light reflected on the surface of the cornea 116 is condensed by the light receiving lens 111 and is re-imaged at the position d ′ on the image sensor 114.

Similarly, the infrared light projected from the infrared light emitting diode 113a illuminates the cornea 116 of the eyeball E. At this time, the cornea reflection image e by a part of the infrared light reflected on the surface of the cornea 116 is condensed by the light receiving lens 111 and is re-imaged at the position e ′ on the image sensor 114.

The light fluxes from the ends a and b of the iris 117 form the images of the ends a and b at the positions a ′ and b ′ on the image sensor 114 via the light receiving lens 111. The rotation angle θ of the optical axis a of the eyeball E with respect to the optical axis a of the light receiving lens 111.
Is small, the Z coordinate of the ends a and b of the iris 117 is Z
Letting a and Zb be the coordinates Zc of the central position c of the pupil 118.
Is expressed as Zc≈ (Za + Zb) / 2.

Further, since the Z coordinate of the midpoint of the corneal reflection images d and e and the Z coordinate Zo of the center of curvature o of the cornea 116 match, the Z coordinate of the generation position of the corneal reflection images d and e is Zd, Z.
e, a standard distance to the center c of the curvature center o the pupil 24 of the cornea 116 and L _oc, when the considered coefficient individual differences with respect to the distance L _oc and A1, the rotation angle of the optical axis v of the eyeball E theta
Is substantially satisfy a relational expression _{(A1 * L oc) * sinθ} ≒ Zc- (Zd + Ze) / 2 ......... (1). Therefore, the line-of-sight calculation processing circuit 1
15, the image sensor 114 as shown in FIG.
The rotation angle θ of the optical axis a of the eyeball E can be obtained by detecting the positions of the respective feature points (corneal reflection images d and e and the ends a and b of the iris 117) projected on the upper part. it can.
In this case equation _{(1), β (A1 * L oc)} * sinθ ≒ (Za' + Zb') / 2 - rewritten as (Zd' + Ze') / 2 ......... (2). However, β is a magnification determined by the position of the eyeball E with respect to the light receiving lens 111, and is substantially obtained as a function of the interval | Zd′−Ze ′ | of corneal reflection images.

Furthermore, Za ', Zb', Zd ', Ze'
Also, since it is a measured amount that can be calculated and extracted from the output of the image sensor 114, the eyeball rotation angle θ can be obtained using the above equation (2). The calculation for converting the eyeball rotation angle θ to the focused position on the focus can be easily performed.

The coefficient A1 representing the individual difference is fixed together with the eyeball optical axis deviation correction amount B1 which is not described here, and the photographer fixes the visual target arranged at a predetermined position in the viewfinder of the camera. It is obtained by matching the position of the target with the position of the fixation point calculated based on the above equation (2).

In the above description, the eyeball of the photographer is Z-.
Although an example in which the photographer rotates in the X plane (for example, horizontal plane) is shown, the same can be detected when the eyeball of the photographer rotates in the XY plane (for example, vertical plane).

Various measures are required when controlling the equipment or inputting information from the visual line information detected by the visual line detecting means as described above.

In general, the visual line input cannot be expected to be as accurate as a manual switch. The human eye moves fairly well, and does not always have a clear intention to operate the device. In addition, human beings are unfamiliar with the action of intentionally keeping an eye on one point, and an input system based on such a forced action causes fatigue of the user and causes a malfunction. There is also a problem with the accuracy of the line-of-sight direction detected by the photoelectric method.

Due to such a technical background, satisfying both efficient input and reliable input at the same time has always been an important issue for the line-of-sight input technique and the device control technique based on it.

The applicant of the present application discloses, in Japanese Patent Laid-Open No. 3-109030, one methodology for determining a point of interest.

That is, the direction of the line of sight of the user is repeatedly detected, and the position where the line of sight has stayed the longest within a predetermined time is set as the gazing point. Alternatively, the position with the highest frequency in the repeated detection a predetermined number of times is set as the gazing point. Alternatively, from the viewpoint that the number of gaze points is not always one, the idea is to set all gaze points at all positions where a stop for a certain time or more is recognized within a predetermined time.

Further, in view of using the line-of-sight information at the moment when another operation member (for example, a shutter button) is operated instead of the statistical method as described above, Japanese Patent Application Laid-Open No. 2-32312 by the applicant of the present application discloses. Can be mentioned.

This method can be said to be very good when the operation of the operation member and the movement of the line of sight have a high degree of inevitability, but otherwise it is an unnatural input operation and is troublesome. In addition, a problem remains when the information entered through the line of sight is different from the intention.

As another way of thinking, there is a way to make sure that confirmation is made after inputting with the line of sight. For example, according to U.S. Pat. No. 4,595,990, a selected display device in which numbers 1 to 10 are arranged has a cancel, veri
It is disclosed that an fy display is added. When one of 1 to 10 is selected by the line of sight in the first step, the display area of the selected number is lit up, and in the second step, it is confirmed by the line of sight whether or not it is the user's intention. Or, it is decided by verify input.

However, such an input form is very complicated and cannot be said to be appropriate as an intention input means for general equipment.

[0036]

In these known line-of-sight input devices and line-of-sight control devices, the line-of-sight detection technology is incomplete, and reliable operation itself has been a major technical goal. Therefore, the viewpoint of improving the input / control procedure and making it truly easy to use is lacking. In order to make the gaze input control a truly versatile and valuable technology, it is essential to make sure the intention input action, as well as the ease of input operation and high efficiency.

(Object of the Invention) An object of the present invention is to provide a line-of-sight control device which enables reliable input without fear of malfunction and which is capable of performing highly efficient intention input without feeling uncomfortable for the user. Is to provide.

[0038]

SUMMARY OF THE INVENTION The present invention has a line-of-sight detecting means for detecting the line of sight of a user and outputting line-of-sight information, and a plurality of display symbols, each of which corresponds to a different operation of a device. Meaningful display means, selection means for defining the operation method of each operation of the device, the line-of-sight detection means, the user gazes at the specific one or more display symbols of the display means That the line-of-sight information indicating that the device is operating is selected by the selecting means, the control signal is output to control the operation of the device. The visual axis detection means selects an operation to be controlled from different operations, and the selection means selects the operation method of the operation.

[0039]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described in detail below based on the illustrated embodiments.

FIG. 1 is a view showing the display in the finder in the first embodiment of the present invention when it is used in the viewfinder of a single-lens reflex camera.

In the figure, there is a focus frame 12 at the center of the finder screen 11, and the finder screen 1
A shutter speed (Tv) value display unit 13, an aperture (Av) value display unit 14, a strobe charging completion mark display unit 15, and a program program mode mark display unit 16 are provided in the lower portion of 1. ing. As the Tv value display, normally, the current value display unit 1 that displays the current control value is displayed.
Only 3 ₁ is displayed.

In this embodiment, it operates as follows.

When it is desired to change the Tv value, the current value display portion 13 ₁ is looked at. Then, the line-of-sight detecting means provided in the camera recognizes this and the control means (not shown) displays the selected value table 13 ₂ . When the user subsequently looks at the intended value in the selected value table 13 ₂ on which the shutter speed desired to be selected is displayed, the line-of-sight detecting means identifies this,
Based on this, the value is selected by the control means (not shown), and the display operation indicating the selection is performed. At this time, the selected Tv value is stored in the RAM or the like by the control means.

As a method of the display operation indicating that the selection has been made, for example, a method of increasing the display brightness of only the selected value or making the display blink is considered. In this state, another T
By looking at the v selection value, it is possible to design the sequence so that it is reselected.

[0045] In any case, if moves away gaze determination of Tv selected values and the later recognition display to confirm its value, the current value display section 13 ₁ and displays the Tv selected value, the display of the Tv selected value That is, the selected value table 13 ₂ is turned off.

According to the above arrangement, the type of information to be input through the visual line is selected by the first visual line input, and the specific amount of information is then selected by the second visual line input. It is defined only in the correct combination of directions, reliable input is performed without fear of malfunction, and because it is a natural input procedure with high inevitability, it is possible to perform highly efficient intention input without discomfort for the user. .

To further reduce the possibility of malfunction,
It is effective to add a discriminating condition such as staying in the line of sight for a predetermined time when detecting the first and second lines of sight.

Further, as shown in FIG. 2A, the Av value display section 14 is configured by a combination of the current value display section 14 ₁ and the selected value table 14 ₂ so that the operation when selecting the Av value is performed. The same can be done when selecting the Tv value.

That is, when the user looks at the current value display portion 14 ₁ , the selected value table 14 ₂ is displayed, and the user continues to select Av from the selected value table 14 _2.
When you look at a value, that value is selected and the current value display section 1
4 ₁ is displayed and the selected value table 14 ₂ is turned off.

Each display of the strobe charge completion mark and the program mode mark is used as a line-of-sight input display in the conventional sense.

For example, the strobe charge completion mark display section 1
When you look at 5, the built-in flash pops up to start the charging operation or start charging the external flash. In that case, the display state of the strobe charge completion mark display section 15 is changed by changing the brightness or the color,
It is desirable to allow the user to confirm the input.
Of course, it may be blinking.

The display in the program mode can also be the target of line-of-sight input in the same manner. When the line-of-sight is selected on the program mode mark display section 16, the automatic exposure mode (AE mode) can be configured as a program. At that time, since the Tv value and the Av value are only automatically controlled, Tv,
It is designed so that the selected value tables 13 ₂ and 14 ₂ do not appear or do not function even when gazing at the current value display portions 13 ₁ and 14 ₁ of Av.

Further, as shown in FIG. 2B, the program mode mark display section 16 is replaced with the current AE mode display section 16
_It is possible to set an AE mode other than the program mode "P" by constructing a combination of ₁ and the selected AE mode table 16 ₂ and selecting the line of sight as described above.

That is, when the user looks at the current AE mode display section 16 ₁ , the selected AE mode table 16
₂ appears, where another selectable AE mode is displayed as a symbol. Here, an example in which three modes of shutter speed priority AE, aperture priority AE, and manual exposure are displayed is shown. When the user subsequently looks at the AE mode to be selected from the selected AE mode display table 16 ₂ , that mode is currently displayed on the AE mode display section 16 ₁ and the selected AE mode table 16 ₂ is turned off.

In the case of such a configuration, when "P" is selected as the AE mode, the line-of-sight input of the Tv value and the Av value is prohibited, and when the shutter speed priority AE mode is selected, the Av is set. When the eye-gaze input of the value is prohibited and the aperture priority AE mode is selected, the eye-gaze input of the Tv value is prohibited. Since the prohibited current value display loses the function as the input means, the possibility of malfunction is reduced also from this aspect.

Steps 101 to 115 in FIG. 3 are flowcharts showing the operation of the part according to the present invention which is performed by the control means (not shown) of the camera having the above structure.

Here, the following ideas may be used in combination in the configurations shown in FIGS. 1 and 2.

For example, the first line-of-sight selection is performed by the line-of-sight at the moment when the shutter button is pressed to the first stroke. 1 and 2, 13 ₁ , 14 ₁ , 16 ₁ ,
Selections for major items such as 15 are made. Next, the selected value table 13 ₂ , 14 ₂ , 16 corresponding to the selected item
₂ is displayed or the function is started and the second line-of-sight selection is performed. Also in this case, the line of sight at the moment when the shutter button is pressed to the first slack may be selected.

With this configuration, the possibility of erroneous input can be greatly reduced, but the complexity of operations tends to increase.

In the case of the above method, it is needless to say that the line-of-sight input may be performed in conjunction with another operation member other than the shutter button.

The display member used in this embodiment may be constructed as shown in FIG.

That is, at the bottom of the finder screen 11,
Only the type of information desired to be input through the line of sight and the current control value are displayed. When the type is selected by the first line-of-sight input, the corresponding selected value table 17 appears on the left side of the finder screen 11 and is viewed. By doing so, the second line-of-sight input is performed. Figure 4
Shows the case where the selected display table of the Tv value is displayed.

The structure shown in FIG. 4 is easier to implement because of the mechanical optical structure of the single-lens reflex camera. Further, even if the items selected by the first line-of-sight input are different, there is an advantage that the same display device can be used in common. Also, the first
Since the positions of the eye gaze selection and the second eye gaze selection are largely different, there is no possibility of erroneous input due to the influence of the involuntary eye movement. On the other hand, the input speed tends to decrease as the moving distance of the line of sight increases.

Therefore, how to design the balance between the accuracy of input and the efficiency of input varies depending on the nature of assumed equipment and the nature of information to be input, and cannot be generally stated.

(Second Embodiment) FIG. 5 is a diagram showing a screen display in a second embodiment of the present invention when used as an input means of a computer.

In FIG. 10A, reference numeral 31 is a monitor screen screen, and four display parts 32 ₁ , 33 ₁ , 34 ₁ , 3 showing command type items are provided on the upper part of the screen 31.
5 ₁ are lined up.

"FILE" on the display unit 32 ₁ is a general term for commands relating to data file handling. “UTILITY” on the display unit 33 ₁ is a general term for dictionaries, other reference data, subprograms started from the currently running program, and the like. In addition, the display unit 34
“CHARACTER” of ₁ relates to the type and size of characters to be displayed and printed, and “EDITOR” of the display unit 35 ₁ indicates various editing functions.

When "FILE" on the display unit 32 ₁ is selected by the first line-of-sight input, the selected item table 32 ₂ appears under the display unit 32 ₁ as shown in FIG. 5 (b). In this selected item table 32 ₂ , each operation related to opening and closing of a data file and storage are itemized, and by selecting one of these by the second line-of-sight input, selection is made. The performed action is executed.

Due to such stepwise selection of motion, the accuracy of line-of-sight input is significantly improved. Moreover, since the stepwise selection operation of this embodiment follows the flow of the user's thoughts, it gives a natural impression that does not hinder the efficiency of intention input.

FIG. 5C shows "CHARA" on the display unit 34 ₁ .
It is a figure which shows the case where a command related to CTER, that is, a command related to characters is input through the line of sight.

When the user looks at the display section 34 ₁ (first line-of-sight input is made), the selected item table 34 ₂ appears on the monitor screen screen 11, and further, the "SIZE" display concerning the designation of the character size is displayed. When the line of sight is selected (the second line of sight is input), the second selected item table 34 ₃ appears (see FIG. 5C). A specific character size is specified by looking at the desired character size from this (by performing the third line-of-sight input).

Steps 201 to 211 in FIG. 6 are a flow chart showing the operation of a part of the part according to the present invention, which is performed by the computer having the above-mentioned configuration.

The embodiment may not be operated on the main monitor screen screen 31, or may be operated on the sub monitor dedicated to command input. In the latter case, the configuration such as a head mounted display has an advantage that the visual axis detection system can be relatively simple.

In the case of the second embodiment, it is appropriate that the gaze input at each stage is set as the gaze condition with the gaze remaining for a predetermined time or longer on the display to be selected. Alternatively, another manual operation member or a foot-operated switch may be used. In either case, a reliable and natural operation can be performed by using a procedure in which the item for which the line-of-sight is selected can be confirmed by seeing the confirmation display by the computer.

(Third Embodiment) FIGS. 7 and 8 are views for explaining a third embodiment when the present invention is used in a viewfinder of a single-lens reflex camera. The visual line input and the manual selection member are used together.

FIG. 7A is a view showing the display in the finder. In FIG. 7A, below the finder screen 11,
Current value display section 41 for Tv value, current value display section 4 for Av value
2, an exposure correction step number display section 43, a strobe charging completion mark display section 15 and a program mode mark display section 16 having the functions already described are arranged.

When the user wants to change the Tv control value, for example, he first looks at the current value display section 41. As a result, the first line-of-sight input is performed, and the display form of the display unit 41 is changed in order to confirm that the current value display 41 has been selected. For example, it is performed by changing the color, changing the brightness, blinking, or the like.

Next, in this state, the user can change the Tv control value by turning the rotary electronic dial 46 shown in FIG. 8, and the changed value is immediately displayed on the current value display section 41. Is displayed in.

The electronic dial 46 can be designed to rotate in both directions, so that the control value increases when turned in one direction, and the control value decreases when turned in the opposite direction. While changing the control value, the operation is performed while looking at the display section that displays the value.
This also serves as a continuous confirmation of the line-of-sight input selection, and the input operation is remarkably stable.

Generally, the combined use of line-of-sight input and manual operation is often difficult to use unless there is a high degree of relevance to each operation and inevitable connection.

However, in the third embodiment, the dial that can be bidirectionally increased / decreased in selecting and adjusting the control value defined by a series of numerical values is one desirable operation method, and therefore it is natural. A feeling of operation is realized. Moreover, since it is inevitable to look at the display unit during the increase / decrease operation, the operation method is extremely highly efficient and highly reliable.

Steps 301 to 311 of FIG. 9 are a flowchart showing a part of the operation according to the present invention performed by the control means (not shown) of the camera having the above-mentioned structure.

Various forms can be considered as the operation members used as long as they can be selected bidirectionally. For example, a dial 47 provided on the back cover of the camera may be used.

The combined use of the above-mentioned line-of-sight input and manual operation can similarly perform the Av value selection and the exposure correction selection. That is, the user may look at the display units 42 and 43, enter the desired information into the line of sight, and then select the information content with an interactive operation member such as an electronic dial.

FIG. 7B shows the exposure compensation step number display section 4 described above.
3 is not a numerical display, but an exposure correction display section 4 based on a scale
It is a figure which shows the example set to 4.

The exposure correction display section 44 has a scale and a marker 45. When the user looks at the display section 44, the exposure correction value can be changed, and the exposure correction value is changed by the dial.

By doing so, the marker 45
Since the movement of and the rotation direction of the dial can be matched, a very intuitive operation is possible, and the merit of line-of-sight input can be easily brought out.

Further, the combined use of the line-of-sight input and the manual operation member as described above can also be used as an input means of a computer or the like. For example, in FIGS. 5B and 5C described above, the selected value tables 32 ₂ , 34 ₂ , 34 ₃ etc. may be selected with a mouse or a joystick.

In this case, the second line-of-sight input is not used as a means for designating the individual selection technique of the selected value table, but the entire selected value table is considered as one block and whether or not the user is looking at it. It is desirable to use it as a criterion. If the selected value table is watched, selection input by a manual member such as a mouse or a joystick is permitted, and if not, it is prohibited. If the cursor is initialized in the area of the selected value table that is being watched, the operation load of the manual member is significantly reduced. If the line of sight departs from the selected value table for a predetermined time or more, the selection itself by the first line-of-sight input is invalidated, and various measures such as deleting the selected value table from the screen screen can be considered.

According to each of the above embodiments, the type of information desired to be input through the first line-of-sight is selected, and then the second line-of-sight input or the specific content of the information is input by the manual operation member. Since the amount is selected, 1) reliable input is performed without fear of malfunction. 2) Since it is a natural input procedure with high necessity, there is no discomfort for the user, and highly efficient intention input. The effect is that it can be done.

To further explain the above effect in detail, conventionally, for example, the distance measuring point was fixed by one line-of-sight input, but in the present embodiment, the distance measuring point is not disclosed in the embodiment. Taking selection as an example, first select the type of "distance measuring point selection" from several pieces of information, and then select one or a plurality of gazing points (or manual selections) selected from a large number of distance measuring points. Since the structure is defined only in the correct combination of the directions of two lines of sight, such as defining the distance point, in other words, the line of sight of a person moves well, but from this, information can be selected by one line of sight input. The confirmation is very likely to cause a malfunction, but since the confirmation is performed by inputting the line of sight twice or the like, the risk of malfunction is drastically reduced, and a natural input procedure with high necessity. Therefore, there is no sense of discomfort from the user's point of view, which means high efficiency. Input is possible.

[0092]

As described above, according to the present invention,
Line-of-sight detection means for detecting the line-of-sight of the user and outputting line-of-sight information, display means having a plurality of display symbols, each of which is meant to correspond to a different operation of the device, and each operation of the device Selection means for defining how the
The line-of-sight detection unit outputs line-of-sight information indicating that the user is gazing at a specific one or a plurality of display symbols of the display unit, and of the device operation made meaningful to the gazed display symbol. When the operating method is selected by the selecting means, it comprises a control means for generating a control signal to control the operation of the device, and the eye gaze detecting means selects the operation to be controlled from among different operations, The selecting means selects the operation method of the operation.

Therefore, it is possible to make a reliable input without fear of malfunction and to make a highly efficient intention input that does not cause the user to feel uncomfortable.

[Brief description of drawings]

FIG. 1 is a diagram showing an in-viewfinder display in a first embodiment of the present invention when used in a viewfinder of a single-lens reflex camera.

FIG. 2 is a diagram for explaining a partially modified example of the display unit in FIG.

FIG. 3 is a flowchart showing an operation of a main part of the camera of the first embodiment of the present invention.

FIG. 4 is a diagram showing a modified example of the display in the finder of FIG.

FIG. 5 is a diagram showing a monitor screen screen display in the second embodiment of the present invention when used as an input means of a computer.

FIG. 6 is a flowchart showing a partial operation of a main part of the computer according to the second embodiment of the present invention.

FIG. 7 is a diagram showing an in-viewfinder display in a third embodiment of the present invention when used in a viewfinder of a single-lens reflex camera.

FIG. 8 is a top view of a single-lens reflex camera according to a third embodiment of the present invention.

FIG. 9 is a flowchart showing a partial operation of a main part of the camera of the third embodiment of the present invention.

FIG. 10 is an optical layout diagram showing a conventional example in the case where a line-of-sight detecting means is incorporated in a single-lens reflex camera.

11 is a perspective view showing a main part of the line-of-sight detection means of FIG.

12 is a diagram for explaining the principle of line-of-sight detection in the line-of-sight detection means of FIG. 11 and the output intensity distribution from the image sensor of FIG.

[Explanation of symbols]

13 ₁ , 14 ₁ Current value display section 13 ₂ , 14 ₂ , 17 Selected value table 16 ₁ Current AE mode table 16 ₂ Selected AE mode table 32 ₁ , 33 ₁ , 34 ₁ , 35 ₁ Display section 32 ₂ , 34 ₂ , 34 ₃ Selected item table 41, 42 Current value display 43 43 Exposure compensation price number display 46 Electronic dial

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁵ Identification code Office reference number FI technical display location G03B 13/02 7139-2K 9119-2K G03B 3/00 A

Claims (4)

[Claims] 1. A line-of-sight detection unit that detects the line-of-sight of a user and outputs line-of-sight information, and a display unit that has a plurality of display symbols, each of which is defined to correspond to a different operation of a device. Selection means for defining an operation method of each operation of the device, and the line-of-sight detection unit outputs line-of-sight information indicating that the user is gazing at one or more specific display symbols of the display unit. And a control means for generating a control signal to control the operation of the device when the operation method of the device operation which is indicated by the gazed display symbol is selected by the selecting means. Eye control device. 2. The line-of-sight control device according to claim 1, wherein the selection unit is a line-of-sight detection unit. 3. The line-of-sight control device according to claim 1, wherein the selection means is a manual operation member. 4. The display means has a first type display symbol and a second type display symbol, and the control means causes the line-of-sight detection means to display a specific one or a plurality of first display symbols of the display means. When the selecting means selects the operation method of the device operation that outputs the line-of-sight information indicating that the user is gazing and the meaning is indicated by the gazed first display symbol, When a control signal is generated to control the operation and the line-of-sight detection unit outputs the line-of-sight information indicating that the user is gazing at the specific one or more second display symbols of the display unit. The gaze control device according to claim 1, wherein the gaze control device is means for generating a control signal to control the operation of the device corresponding to the second display symbol.