JPH03109029A - Eye sight detector - Google Patents

Abstract

PURPOSE:To enable highly accurate calculation of eye sight of an observer by selecting specified two from a plurality of photoelectric element array to obtain information based on a cornea reflection image and an iris reflection image from the two photoelectric element array. CONSTITUTION:Luminous fluxes from infrared light emitting diodes 5a and 5b arranged being separated in the way of a photoelectric element array 6 form cornear reflection images (e) and (d) individually in a Z axis. As an interval between the cornea reflection images (e) and (d) varies corresponding to a distance between the infrared light emitting diodes and eyeballs of an observer, reading of image signals of the photoelectric element array 6 is performed sequentially to detect a photoelectric element array Yp' in which cornear reflection image e' and d' are formed again and positions Zd' and Ze' of generation thereof in the way of the array to determine an image formation multiplying factor B from the interval. Moreover, field of view points Z2b' and Z2a' of iris 23 and pupil 24 are detected on the photoelectric element array Yp' to calculate the length of the pupil on the photoelectric element array Yp'. Then, another photoelectric element array Y1' of an image signal is calculated from the image formation multiplying factor and a value of the length of pupil. When detected, field of view points Z1a' and Z1b' of the iris 23 and the pupil 24 on the photoelectric element array Y1' can be used to calculate eye sight.

Description

DETAILED DESCRIPTION OF THE INVENTION (Industrial Application Field) The present invention relates to a line of sight detection device, for example, in an optical device such as a camera, when an observer on an observation plane (focus plane) on which a subject image is formed by a photographing system. Line-of-sight detection that detects the axis of the gaze point direction (visual axis) observed by the photographer (photographer) using the reflected image of the eyeball obtained when the surface of the viewer's eyeball is illuminated. It is related to the device.

(Prior Art) Various devices for detecting the so-called line of sight (visual axis), which detects which position on the observation surface an observer is observing, have been proposed.

For example, in Japanese Patent Application Laid-open No. 172552/1982, a parallel light beam from a light source is projected onto the anterior segment of the observer's eyeball, and the corneal reflection image due to the light reflected from the cornea and the image formation position of the pupil are used. I'm looking for the visual axis. 8(A) and 8(B) are diagrams explaining the principle of the line-of-sight detection method, where (A) is a schematic diagram of the line-of-sight detection optical system, and (B) is the intensity of the output signal from the photoelectric element array 6. It is a diagram.

In the figure, reference numeral 5 denotes a light source such as a light emitting diode that emits infrared light that is insensitive to the observer, and is arranged on the focal plane of the projection lens 3.

The infrared light emitted from the light source 5 becomes parallel light by the projection lens 3 and is reflected by the half mirror 2, and is reflected by the cornea 21 of the eyeball 201.
to illuminate. At this time, a corneal reflection image d, which is a part of the infrared light reflected on the surface of the cornea 21, passes through the half mirror 2, is focused by the light receiving lens 4, and is located at a position Zd' on the photoelectric element array 6.
re-image.

Also, the light flux from the ends a and b of the iris 23 is transmitted to the half mirror 2.
, positions Za, Z on the photoelectric element array 6 through the light receiving lens 4
Images of the ends a and b of the iris 23 are formed on "b". When the rotation angle θ of the optical axis A of the eyeball with respect to the optical axis of the light receiving lens 4 (optical axis A) is small, the images of the ends a and b of the iris 23 are When the Z coordinates are Za and Zb, the coordinate Zc of the center position C of the iris 23 is expressed as Z c ′=(Z a + Z b )/2.

Also, the Z coordinate of the position d of the corneal reflection image is Zd, and the cornea 21
If OC is the distance between the center of curvature 0 of
−Z d ” ” The relational expression (1) is approximately satisfied.

Here, the Z coordinate Zd of the position d of the corneal reflection image and the Z coordinate Z of the center of curvature O of the cornea 21. is consistent with Therefore, in the calculation means 9, by detecting the position of each singular point (1iJ11!2 reflected image d and the ends a and b of the iris) projected on the six surfaces of the photoelectric element array as shown in FIG. The rotation angle θ of the eyeball optical axis I can be determined. At this time, equation (1) is /3*OC*5INe'-,Za"Zb'-Zd"
It can be replaced with ・・・・・・・・・(2). However, β is the occurrence position d of the corneal reflection image.
The magnification is determined by the distance 111LI between the light-receiving lens 4 and the photoelectric element array 6, and the distance LO between the light-receiving lens 4 and the photoelectric element array 6, and is usually a constant value.

For example, in a camera's automatic focus detection device, if the distance measuring point is set not only at the center of the screen but also at multiple locations within the screen,
When an observer wants to select one of the distance measurement points and perform automatic focus detection, the point that the observer is observing is regarded as the distance measurement point, and the point that the observer is observing is assumed to be the distance measurement point. This is effective for automatically selecting points and performing automatic focus detection. Since it is desirable that the distance measurement point of the camera be set two-dimensionally within the finder screen, the line-of-sight detection device also needs to detect biaxial line-of-sight information.

(Problems to be Solved by the Invention) The line of sight detection method shown in FIG.
In principle, it is also effective when rotating within a vertical plane, for example.

FIG. 9 is an explanatory diagram showing a reflected image of the eyeball projected onto the six surfaces of the two-dimensional photoelectric element array. In order to detect the rotation angle of the eyeball in the X-Y plane, it is necessary to detect the boundary points Ya and Yb' between the iris 23 and the pupil 24 in the Y-axis direction.

Generally, the readout of the photoelectric element array 6 is performed line-sequentially, and in order to obtain information in the direction (Y-axis direction) perpendicular to the column direction of the photoelectric element array, the image information of each photoelectric element array must be stored once in the storage device. There is a problem in that a large-capacity storage device is required because a process of reading out information from the post-fill storage device and detecting the boundary point YaYb' is required.

Therefore, as shown in FIG. 10(A), two photoelectric element rows Yl' and Y2' containing the pupil 24 are sequentially selected, and four boundary points between the iris 23 and the pupil 24 are detected from the photoelectric element rows. A method can be considered in which the position of the center C' of the pupil 24 is calculated using three points among Zla, Zlb'Z2a', and Z2b', and the line of sight of the observer is calculated from this and the position of a corneal reflection image (not shown).

However, as shown in FIG. 8(A), the iris 23, which is the subject, is imaged on the photoelectric element array 6 through the cornea 21, which plays a role as a condenser lens. The position of the iris is an apparent position that is different from the actual position of the iris. Therefore, when two photoelectric element rows Yl' and Y2' are arbitrarily selected from a plurality of photoelectric element rows, two rows biased either above or below (+Y or -Y direction) with respect to the pupil center C' of the eyeball are selected. It may be stored away.

In this case, there is a problem in that the calculated rotation angle of the eyeball in the vertical direction (in the X-Y plane) is partially not linear with respect to the actual rotation angle, resulting in a detection error.

In addition, in general, taking into consideration changes in pupil diameter due to changes in the amount of light incident on the observer's eyeballs and differences in pupil diameter due to individual differences, the interval between the photoelectric element row Yl' and the photoelectric element row Y2' is set to the minimum value of the pupil diameter. It is initially set to be small, about 2/3 of . Therefore, as shown in Figure 1O (B), even if two photoelectric element arrays Yl'' and Y2' are selected above and below (+Y and -Y force directions) with respect to the pupil center C' of the eyeball, the observer's pupil If the diameter is large and the distance between each photoelectric element row Yl', Y2' and the pupil center C' is asymmetric, the vertical direction (in the x-y plane) of the eyeball calculated as shown in FIG. There is a problem in that the rotation angle is partially not linear with respect to the actual rotation angle, resulting in a detection error.

The present invention appropriately selects two predetermined photoelectric element arrays from among a plurality of photoelectric element arrays constituting a light receiving means, and obtains information based on a corneal reflection image and an iris reflection image from the selected two photoelectric element arrays. The present invention aims to provide a line-of-sight detection device that can calculate the line-of-sight of an observer with high accuracy.

(Means for Solving the Problems) The line of sight detecting device of the present invention illuminates an observer's eyeball with an illumination means, and detects the image formation position of a corneal reflected image and an iris reflected image of the eyeball on a predetermined plane using a light receiving means. In the line-of-sight detecting device, the line of sight of the eyeball is calculated by a calculating means using an output signal from the light receiving means, the light receiving means has a plurality of photoelectric element arrays, and the calculating means includes a plurality of photoelectric element arrays. The position of the corneal reflection image formed on the surface A of one of the photoelectric element arrays among the plurality of photoelectric element arrays is detected, and the position of the corneal reflection image formed on the photoelectric element array 6 is detected. Calculate the pupil length where row A crosses the pupil, select another photoelectric element row B based on the pupil length, and calculate the line of sight using information based on the iris reflection image obtained from the photoelectric element row B. It is characterized by the fact that it is made to do so.

In particular, the present invention is characterized in that the photoelectric element array A and the photoelectric element array B are located on opposite sides of the pupil center, for example, approximately symmetrically with respect to the pupil center.

(Example) Figure 1 (A) is a schematic diagram of the main parts of an optical system of an example when the present invention is applied to a single-lens reflex camera, and Figure 1 (B) is a
It is an explanatory view of a part of A).

In the figure, reference numeral 1 denotes an eyepiece lens, and a dichroic mirror 1a that transmits visible light and reflects infrared light is installed obliquely inside the eyepiece lens, and also serves as an optical path splitter.

4 is a light-receiving lens, and 5 (5a, 5b, 5c) is an illumination means, which is made of, for example, a light emitting diode. 6 is a photoelectric element array. The light receiving lens 4 and the photoelectric element array 6 constitute one element of the light receiving means.

The photoelectric element row 6 normally uses a device in which a plurality of photoelectric elements are arranged one-dimensionally in the direction perpendicular to the drawing, but if necessary, two or more photoelectric elements are used.
It uses a device with photoelectric elements lined up in one dimension. Each element 1
, 4, 5.6 constitute an eyeball line-of-sight detection system.

101 is a photographing lens, 102 is a quick return (QR)
) Mirror, 103 is a display element, 104 is a focusing plate, 10
5 is a condenser lens, 106 is a pentagonal roof prism, and 107 is a submirror 108, which is a multi-point focus detection device, which performs focus detection by selecting a plurality of areas within the If screen.

The explanation of the multi-point focus detection device is not necessary for understanding the present invention, so a brief explanation will be provided.

That is, in this embodiment, the photographing lens 1 is
A field mask 110 having a plurality of slits, each of which determines a distance measurement area, is arranged near the planned image forming plane of 01, and a lens member 111 that functions as a field lens for the image in each slit is arranged in close proximity. A set of re-imaging lenses 112 and a set of photoelectric element arrays 113 corresponding to the number are provided.

The slit 110, the field lens 111, the reimaging lens set 112, and the photoelectric element array set 113 each constitute a well-known focus detection system.

In this embodiment, a part of the subject light that has passed through the photographic lens 101 is reflected by the QR mirror 102 and is reflected by the focusing plate 102.
Forms an image of the subject nearby. The object light diffused by the diffusing surface of the focusing plate 104 is guided to the eye point E via the condenser lens 105, the penta roof prism 106, and the eyepiece lens 1.

Here, the display element 103 is, for example, a two-layer type guest-host type liquid crystal element that does not use a polarizing plate, and displays a distance measurement area (focus detection position) within the field of view of the finder.

Also, the part of the subject light that has passed through the photographic lens 101 is QR
The multi-point focus detection device 10 described above is transmitted through the mirror 102 and reflected by the sub-mirror 107, and is disposed at the bottom of the camera body.
Guided by 8. Further, based on the focus detection information of the position on the subject surface selected by the multi-point focus detection device 108, the photographic lens driving device (not shown) moves the photographic lens 101 to the edge (extending or retracting) to perform focus adjustment. It will be done.

The line-of-sight detection device according to this embodiment includes a line-of-sight detection system composed of members denoted by reference numerals 1, 4, 5, 6, and an eyeball optical axis detection circuit included in a signal processing circuit 109 that is a calculation means. , an eyeball discrimination circuit, a visual axis correction circuit, a gaze point detection circuit, etc.

In the line of sight detection system, infrared light emitted from an infrared light emitting diode 5 enters the eyepiece lens 1 from above in the figure, is reflected by the dichroic mirror 1a, and is directed to an eye point E.
The eyeball 201 of an observer located nearby is illuminated. In addition, the infrared light reflected by the eyeball 201 is reflected by the dichroic mirror 1a.
The light is reflected by the light receiving lens 4 and converged to form an image on the photoelectric element array 6. Further, the signal processing circuit 109
is executed by microcomputer software.

The gaze point information detected by the gaze point detection circuit is first transmitted to the display element 103 and the multi-point focus detection device 108. In the display element 103, l! The function is to display the place the viewer is looking at in the camera's viewfinder and to confirm the point of gaze (focus detection point).

In addition, the multi-point focus detection device 108 performs focus detection of the point gazed at by the observer, and performs focus adjustment on the gazed subject.

Figure 2 is a perspective view of the main parts of the line of sight detection system in Figure 1, and Figure 3 (A
) and (B) are diagrams of the optical principles of the line of sight detection system. Infrared light emitting diodes 5a, 5b for illumination.

5c is used in pairs to detect the distance between the camera and the observer's eyeballs, and depending on the camera posture, infrared light emitting diodes 5a and 5b are in the horizontal position, and infrared light emitting diode 5b is in the horizontal position.
, 5c, the vertical position is detected. Incidentally, although the attitude detection means of the camera is not shown in the figure, an attitude detection means using a mercury switch or the like is effective.

The infrared light emitting diodes 5a and 5b are connected to the optical axis (
It is arranged at a position shifted in the column direction (Z-axis direction) of the photoelectric element array 6 and in a direction perpendicular to the column direction with respect to the X-axis).

Infrared light emitting diodes 5a and 5b are arranged separately in the row direction (Z-axis direction) of the photoelectric element row 6 in FIG. 3(A).
The light flux from the corneal reflection images e,
d respectively.

At this time, the Z coordinate of the midpoint of the corneal reflection images e and d is the cornea 21
coincides with the Z coordinate of the center of curvature 0. Furthermore, since the interval between the corneal reflection images e and d changes depending on the distance between the infrared light emitting diode and the observer's eyeball, the positions e'' and d' of the corneal reflection images re-imaged on the photoelectric element array 6 are By detecting this, it is possible to determine the imaging magnification β of the reflected image from the eyeball.Also, in FIG. 5a
In (5b), the observer's eyeball is illuminated from diagonally above, so the observer's eyeball is in the vertical direction (within the X-Y plane).
If the corneal reflection image e(d,) is not rotated, the corneal reflection image e(d,) is formed in the +Y force direction in the figure from the center of curvature of the cornea and the center of the pupil.

FIG. 4(A) is an explanatory diagram showing a reflected image from an eyeball projected onto a plurality of photoelectric element array surfaces of the photoelectric element array 6 in this embodiment.

FIG. 4(A) shows the reflected image from the eyeball projected onto the photoelectric element array 6. In the same figure, the corneal reflection image e
', d' are re-imaged on the photoelectric element array yp'. At this time, the output signal obtained from the photoelectric element array Yp' is shown in FIG.
Shown in B).

Next, the line of sight detection method in this embodiment will be sequentially explained using the flowchart shown in FIG.

First, an eyeball optical axis detection circuit included in the signal processing circuit 109 detects the rotation angle of the eyeball optical axis.

Next, the image signal of the photoelectric element array 6 is read out as shown in FIG. 4(A).
Detect the photoelectric element array (line) Yp' where the corneal reflection images e and d' are formed sequentially in the −Y force direction shown by (#l)
. At the same time, the generation position Zd' of the corneal reflection images e and d'' in the column direction
, Ze′ #2), and the interval IZd between the corneal reflection images.
Find the imaging magnification β of the optical system from 'Ze l (#3)
. Further, a boundary point 22b "Z2a' between the iris 23 and the pupil 24 is detected on the photoelectric element array (line) Yp'.
4), pupil length 1Z2a −Z2 on the photoelectric element array yp
Calculate b'l (#5).

As shown in FIG. 4(A), normally, the photoelectric element array Yp' where a corneal reflection image is formed is generated in the -Y direction in the figure from the photoelectric element array YO' where the pupil center C' exists, and the image signal is Another photoelectric element array Y1' to be read out is calculated from the values of the imaging magnification β and pupil length (#6). This poetic photoelectric element array Yl' is set to have a sufficient distance from the photoelectric element array Yp'. Similarly, when the boundary point Z1a', zib'' between the iris 23 and the pupil 24 on the photoelectric element array Yl' is detected (#7), the boundary point (Zla, Yl'
), (Zlb', Yl') and the boundary point (Z2a
, Y2'), (22b'', Y2')
Using the points, the center position C' (Zc, Yc') of the pupil is determined. Furthermore, the position of the corneal reflection image (Zd'Yp
'), (Ze'', Yρ') to transform the above equation (2), the rotation angle θ2゜θy of the optical axis of the eyeball is... (3) β*oc*s I NθyYc ′−Yp ”+δY
′・・・・・・・・・(4) is satisfied (#8). However, δY' is because the infrared light emitting diode is arranged with respect to the light receiving lens 4 in a direction perpendicular to the column direction of the photoelectric element array 6, so that the re-imaging positions e and d' of the corneal reflected image are different from the photoelectric element array. This is a value for correcting the shift in the Y-axis direction with respect to the Y coordinate of the center of curvature of the cornea 21 on 6.

Furthermore, the eyeball discrimination circuit included in the signal processing circuit 109 discriminates whether the eye of the observer looking into the finder is the right eye or the left eye based on the distribution of the calculated rotation angle of the eyeball optical axis (Nt9). In the axis correction circuit, the visual axis is corrected based on the eyeball discrimination information and the rotation angle of the eyeball optical axis (#10). Furthermore, in the gaze point detection circuit, the gaze point is calculated based on the optical constants of the finder optical system (#11).

Note that, depending on the observer, the pupil may be obstructed by the eyelid. In such a case, it is necessary to select a photoelectric element array as shown in Fig. 10, but at this time, the eyeball optical axis detection circuit must perform a correction to reduce the detection error of the rotation angle of the eyeball optical axis. It is desirable to do so.

Furthermore, in this embodiment, when determining the rotation angle in the vertical direction, the rotation angle is determined by correcting the position of the corneal reflection image in the Y-axis direction, δY'. Light emitting diode 5a.

5b and 5c are always lit, and infrared light emitting diodes (5b
, 5c) may be used to find the midpoint (Y coordinate) of the corneal reflection image by the infrared light emitting diode, and then calculate the rotation angle. It is necessary to detect the position (Y coordinate) of the projected image of the corneal reflection image of the poem infrared light emitting diode 5C onto the photoelectric element array 6, but since the corneal reflection image has a relatively strong light intensity, it can be easily detected. It is.

Further, even when the viewer holds the camera in a vertical position, it is possible to accurately detect the viewer's gaze point using the same method.

FIG. 6 is an explanatory diagram showing a reflected image from the eyeball projected onto the six surfaces of the photoelectric element array in the second embodiment of the present invention. In this embodiment, the corneal reflection images e and d' are formed on the photoelectric element array yp' plane.

Next, the line of sight detection method in this embodiment will be sequentially explained using the flowchart shown in FIG.

First, the rotation angle of the eyeball optical axis is detected in the eyeball optical axis detection circuit included in the signal processing circuit 109, which is a calculation means.

Next, the image signals of the photoelectric element array 6 are sequentially read out in the -Y force direction shown in FIG. 6 to form corneal reflection images e and d'. The photoelectric element array (line) Yp' is detected (#21).

At the same time, the generation positions Zd' and Ze' of the corneal reflection images e and d' are detected #22), and the interval lZd"Ze' of the corneal reflection images is detected.
The imaging magnification β is determined from l (#23). Further, assuming that there is no rotation of the observer's eyeball in the vertical direction (in the X-Y plane), the distance in the Y-axis direction between the corneal reflected image generated on the photoelectric element array 6 and the pupil center C' is the distance detected by the line of sight. Since it is determined by the distance between the system and the observer's eyeball, the photoelectric element array (line) YO' where the pupil center C' is located is calculated from the interval between the corneal reflection images (#24).

Furthermore, by assuming the minimum value of the observer's pupil diameter, the interval between the two photoelectric element rows (lines) Yl' and Y2' to be detected is determined, and the photoelectric element row Y where the pupil center C' is located is determined.
Two photoelectric element rows Yl approximately symmetrical in the Y-axis direction with respect to O'
', Y2' are selected (I25).

In this embodiment, the photoelectric element array Y2' and the photoelectric element array Yp'
In this example, the photoelectric element row Y2'
exists in the -Y direction with respect to the photoelectric element array yp'. Therefore, a storage device is required to store the image information of the photoelectric element array read out before detecting the photoelectric element array Yp' where the corneal reflection images e'' and d' are present, but since its storage capacity is small, there is no inconvenience. do not have.

Next, the eyeball optical axis detection circuit detects the photoelectric element array Y2' (=Yp
') Upper boundary point 22a between iris 23 and pupil 24, Z
2b' and the iris 23 and pupil 2 on the photoelectric element row Y1'
Detect the boundary point ZlaZlb' with 4 (I26.I2
7). The boundary points (Zla, Y1'), (21b',
Yl') and the boundary point (22a, Y2'), (
The center position C' (Zc, Yc') of the pupil is determined using at least three points among the points C' (Zc, Yc').

Furthermore, the position (Zd'Yp') of the corneal reflection image, (2e
, Yp'), the rotation angle of the eyeball optical axis is calculated from equations (3) and (4) above ($28).

Furthermore, the eyeball discrimination circuit included in the signal processing circuit 109 roughly determines whether the observer looking into the finder has the right eye or the left eye based on the calculated rotation angle distribution of the optical axis of the eyeball (#29). In the visual axis correction circuit, the visual axis is corrected based on the eyeball discrimination information and the rotation angle of the eyeball optical axis (#30). Further, in the gaze point detection circuit, the gaze point is calculated based on the optical constants of the finder optical system (#31).

In this example, the vertical direction of the observer's eyeball (X-Y
The photoelectric element array YO' where the pupil center is located is calculated on the assumption that there is no rotation of the pupil center (plane circle), but if there is vertical rotation of the eyeball, the calculated position of the photoelectric element array YO' and the actual Although the position of the photoelectric element row where the center of the pupil exists is slightly shifted, there is no problem in practical use.

Also, in this example, when determining the rotation angle in the vertical direction (4
), the rotation angle is determined by correcting the position of the corneal reflected image in the Y-axis direction by δY'; is always turned on, and using a set of infrared light emitting diodes (5b, 5c) symmetrical with respect to the Z-x plane parallel to the column direction of the photoelectric element array 6, the midpoint of the corneal reflection image by the infrared light emitting diodes (
The rotation angle may be calculated after determining the Y coordinate). At this time, it is necessary to detect the position (Y coordinate) of the projected image of the corneal reflection image of the infrared light emitting diode 5C onto the photoelectric element array 6, but since the corneal reflection image has a relatively strong light intensity, it is easy to detect. Detectable.

Further, even when the viewer holds the camera in a vertical position, it is possible to accurately detect the viewer's gaze point using the same method.

(Effects of the Invention) According to the present invention, two predetermined photoelectric element arrays are selected as described above from among the plurality of photoelectric element arrays constituting the light receiving means, and
By obtaining positional information of the corneal reflection image and iris reflection image of the eyeball from two photoelectric element arrays, the line of sight of the observer's eyeball can be detected with high precision, and a storage device that stores information about the reflection image of the eyeball. It is possible to achieve a line-of-sight detection device that has the effect of requiring only a small capacity.

[Brief explanation of drawings]

FIG. 1(A) is a schematic diagram of the main parts of the first embodiment when the present invention is applied to a single-lens reflex camera, and FIG.
), FIG. 2 is a perspective view of a main part of the line of sight detection system in FIG. 1, and FIG. 3 (A). (B) is an explanatory diagram of the optical principle of the line of sight detection system of the present invention, and Figures 4 (^) and (B) are images reflected from the eyeball on the photoelectric element array surface and output signals from the photoelectric element array according to the present invention. Explanatory diagram, 5th
The figure is a flowchart of the first embodiment of the present invention, FIG. 6 is an explanatory diagram of the reflected image of the eyeball on the photoelectric element array surface according to the second embodiment of the present invention, and FIG. 7 is the second embodiment of the present invention. 8(A) and 8(B) are schematic diagrams of main parts of a conventional line of sight detection device and explanatory diagrams of output signals, and FIGS. 9 and 10(A).
), (B) is an explanatory diagram of the reflected image from the eyeball on the photoelectric element array surface, and FIG. 11 is a detection characteristic diagram of the rotation angle of the eyeball. In the figure, 1 is an eyepiece lens, 4 is a light receiving lens, 5a, 5b,
5c is an illumination means, 6 is a photoelectric element array, 109 is a calculation means,
101 is a photographing lens, 102 is a flip-up mirror, 103
104 is a display element, 104 is a focusing plate, 105 is a condenser lens, 106 is a penta roof prism, 21 is a cornea, 2
3 is an iris, and 24 is a pupil. Figure (ha)

Claims (4)

[Claims] (1) Illuminating the observer's eyeball with an illumination means, detecting the image formation position of the corneal reflection image and the iris reflection image of the eyeball on a predetermined plane with the light receiving means, and using the output signal from the light receiving means. In a visual line detection device that calculates the line of sight of the eyeball by a calculating means, the light receiving means has a plurality of photoelectric element arrays, and the calculating means calculates one photoelectric element array A of the plurality of photoelectric element arrays. The position of the corneal reflection image formed on the surface is detected, and the pupil length at which the photoelectric element array A crosses over the pupil is calculated from the information of the iris reflection image formed on the surface of the photoelectric element array A. A line-of-sight detection device characterized in that another photoelectric element array B is selected based on the pupil length, and the line of sight is calculated using information based on an iris reflection image obtained from the photoelectric element array B. (2) The line of sight detection device according to claim 1, wherein the photoelectric element array A and the photoelectric element array B are located on opposite sides of the pupil center. (3) Illuminating the observer's eyeball with the illumination means, detecting the image formation position of the corneal reflection image and the iris reflection image of the eyeball on a predetermined plane with the light reception means, and using the output signal from the light reception means. In a visual line detection device that calculates the line of sight of the eyeball by a calculating means, the light receiving means has a plurality of photoelectric element arrays, and the calculating means calculates one photoelectric element array A of the plurality of photoelectric element arrays. At the same time as detecting the position of the corneal reflection image formed on the surface, selecting the photoelectric element array C located approximately symmetrically with respect to the center of the pupil of the photoelectric element array A, and selecting the photoelectric element array C.
A line-of-sight detection device characterized in that the line-of-sight is calculated using information based on an iris reflection image obtained from the iris reflection image. (4) The line of sight detection device according to claim 1 or 3, wherein the optical axis of the illumination means and the optical axis of the light receiving means are different in a direction perpendicular to the column direction of the photoelectric element array.