JPH09276226A - Optometric device and visual axis input device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To detect gaze distance or convergence, prevent the fatigue by gazing for a long time, and provide a sufficient presence by regulating the focus of a three-dimensional image display means according to the gaze distance information calculated by taking the images of both eyes whose anterior parts are lighted. SOLUTION: The anterior parts of the left eye EL and right eye ER of a subject S are lighted by infrared LED 4L, 4R, the anterior part images are formed on image pickup elements 7L, 7R by lenses 6L, 6R through dichroic mirrors 5L, 5R. The degrees of convergence when the subject S looks at the near scene of liquid crystal image display members 1L, 1R are read into an arithmetic means as signals of the elements 7L, 7R, the positions of pupil and cornea reflection are recognized by operation, and the fixation distance information is calculated, the positions of the liquid crystal image display members 1L, 1R are mowed by a driving means 2 to set a display diopter according to the gaze distance information, and the focuses of the liquid crystal image display members 1L, 1R are regulated.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to the field of ophthalmic optics, and relates to an optometry device for inspecting the function of the eye, a stereoscopic image display device,
It can be applied to various imaging devices such as cameras, welfare equipment, and various eye-operated machines.

[0002]

2. Description of the Related Art Conventionally, there is known a method of detecting the line-of-sight direction based on the relationship between the pupil and corneal reflection.

[0003]

However, the conventional device is limited to the detection by one eye and cannot detect the gaze distance and the convergence. Further, in the stereoscopic image display device, the left and right images are given a parallax to form a stereoscopic image, but it is tired when viewed for a long time because it is not accompanied by adjustment.

It is an object of the present invention to provide an apparatus that solves any one of the above problems.

[0005]

A first eye optical device according to the present invention comprises a stereoscopic image display means, an image pickup means for picking up images of both eyes illuminated on an anterior eye part, and a gaze calculated by the image pickup means. It is characterized by further comprising focus adjusting means for adjusting the focus of the stereoscopic image display means according to the distance information.

The second eye optical device focuses the image pickup means for picking up images of both eyes illuminated on the anterior eye part and the image pickup means for picking up an object in accordance with the gaze distance information calculated from the image pickup means. It is characterized by having a focus adjusting means for adjusting.

Further, the third eye optical device has an image pickup means for picking up images of both eyes illuminated on the anterior eye part, and a comparison means for comparing the gaze distance information calculated by the image pickup means with predetermined distance information. Is characterized by.

Particularly in the above-mentioned eye optical device, the gaze distance information is any one of a gaze distance, a convergence angle, and a line-of-sight direction.

Further, the fourth eye optical device has an image pickup means for picking up an image of the pupil portion of the eye to be inspected, and an arithmetic means for successively calculating the signal thereof, and detects blinking by a change in the signal of the pupil portion. And

Further, the line-of-sight input device of the present invention comprises a detection means for detecting the line-of-sight direction of the eye, a plurality of switches in the field of view, and an execution switch which is displayed when the line of sight of each switch is detected. Display means for displaying is provided, and the detection means detects that the line of sight is directed to the execution switch, and inputs the switch.

[0011]

1 is a plan view seen from above.
This optical system is integrally configured and is fixed to the head of the subject S. The infrared LEDs 4L and 4R illuminate the anterior ocular segment of the subject S's left eye EL and right eye ER, respectively. The anterior ocular segment image is passed through the dichroic mirrors 5L and 5R and the lenses 6L and 6L.
Image pickup devices 7L and 7 such as CCDs as image pickup means by R
Each image is formed on R. An image of the image sensor 7L is shown in FIG. A corneal reflection image 4L 'of the pupil P and the light source 4L is shown. Eyes EL and ER to be inspected are dichroic mirrors 5L and 5
Liquid crystal image display members 1L and 1R as stereoscopic image display means for displaying a stereoscopic image that distinguishes a distant view and a near view by parallax through R and lenses 3L and 3R are viewed.
The display members 1L and 1R are interlocked with each other, and the drive means 2 drives the optical axis 0.
It is driven in the 1L and 01R directions to change the presented diopter of the image.

FIG. 3 shows an example of an image of the display member 1L.
A close view person 9 and a distant view person 8 are shown. Subject S is a close view 9
Congested when you see. To that extent, the signals of the elements 7L and 7R are taken into the arithmetic means, and the pupil P and corneal reflections 4L 'and 4
The position of R'is recognized by calculation, the gaze distance information is calculated, and the driving means 2 moves the positions of the display members 1L and 1R to obtain the display diopter according to the gaze distance information, and the focus of the stereoscopic image display means is adjusted. Note that the gaze distance information includes gaze distance, vergence angle, and line-of-sight direction (line-of-sight direction from the center of the left and right eyes)
And so on.

FIG. 4 shows the relationship between the pupil P and the corneal reflection images 4L 'and 4R' in the left and right eyes when the distant view F and the near view N are viewed. The top is a distant view and the bottom is a close view. The corneal reflex position shifts to the ear side with respect to the center of the pupil due to convergence. The shift amount is almost proportional to the vergence angle and inversely proportional to the gaze distance. The deviation from a distance when looking 30 cm ahead is about 0.5 mm. Since this amount of deviation differs slightly depending on the subject, it is possible to detect it with high accuracy by calibrating in advance. For the calibration, the pupil part images of the optotypes at two predetermined distances are calculated to obtain the positional relationship between the pupil and the corneal reflection. Other distances are converted proportionally.
It is also possible to calibrate the gaze direction and the gaze distance at the same time. In that case, two calibrated optotypes having different predetermined directions in the left-right direction and different predetermined distances are used. The pupil image when viewing them is calculated. Due to the change in the line-of-sight direction, the corneal reflection is shifted in the same direction on the left and right by the same amount. On the other hand, due to the change in the distance, the corneal reflection is shifted by the same amount in different directions in the left and right eyes. Therefore, the respective shifts can be calculated by adding and subtracting the shifts of the left and right eyes.

Although the configuration of FIG. 1 is a stereoscopic image device, in the optometry device for inspecting the visual function, the lenses 3L, 3R, the members 1L,
Instead of the image display means composed of 1R or the like, an unillustrated optotype means whose distance changes in a real space is used. The subject is inspected in relation to the diopter of the target and the gaze distance or vergence that is objectively detected. For example, the gazing position can be measured by comparing the gaze distance information calculated by the image pickup means for picking up both eyes with the predetermined distance information. In the device for measuring the distance from the subject to the object or the imaging device, the lenses 3L and 3R, the display member 1
There is no display means such as L and 1R, and there is no dichroic mirror 5.
See objects and subjects through L and 5R. The gaze distance information is calculated from the left and right pupil images at that time, and the focus of the image capturing device is driven according to the information to adjust the focus of the image capturing means for capturing the subject. Also, the distance of the object is measured and used as input for various operations.

FIG. 5 shows a signal of the scanning line 11 of the image pickup device 7L in which the pupil image is reflected. The corneal reflection 4L 'appears as a strong bright spot, and the iris and the sclera portion 16 appear in intermediate brightness. Pupil P
Looks dark. Reference numeral 15 is a horizontal synchronizing signal. FIG. 6 shows the signal of the scanning line 10 at the center of the pupil. FIG. 7 shows a signal of the scanning line 10 when blinking. The reflectance of the eyelid 17 is not so different from that of the sclera. Such a signal appears almost uniformly on the screen. The operation switch 12 displayed on the screen of FIG. 3 is used to operate the device with a line of sight.

In FIG. 8, the signals of the elements 7L and 7R are taken into the arithmetic control means 13 to calculate the line-of-sight direction based on the relationship between the pupil and the corneal reflection 4L 'to recognize which switch 12 of the display members 1L and 1R is facing. The switch 14 is executed by the actuator 14. The signals of the operating elements 7L and 7R are sequentially fetched by the computing means 13 and computed, and the pupil P and the corneal reflection 4 are calculated.
The positional relationship between L'and 4R 'is calculated. When there is a blink, the dark part of the pupil part is instantly changed into a relatively bright signal of the eyelid 17, so that it can be recognized. Even if the eye moves slightly, if the pupil is within the screen, the change can be recognized by the signal of the scanning line passing through the pupil. If infrared rays are used, the reflectance of the eyelids does not change much regardless of the amount of melanin. If the line of sight is directed to the switch 121 of the switch unit 12 provided on the screen, the line is recognized and the color changes as shown in FIG. The subject S then blinks to enter the switch. The calculation means 13 recognizes it. Immediately after that, when it is detected that the line of sight is still in that direction, the switch is input. At that time, the switch 121 blinks to notify the subject S to execute the switch 121. The recognition of the line-of-sight direction can be performed more accurately if it is calculated from the relationship between the pupils of the anterior segment images of both eyes and the corneal reflection. In the calibration, the relationship between the pupil of the binocular image and the corneal reflection is obtained by showing the predetermined bidirectional targets presented to both eyes. Details of the calibration in relation to the corneal reflex and the pupil are disclosed in JP-A-5-1999.
96 method. When the eyes are recognized, it is possible to discriminate between cases where there is no will and cases where there is no intention. When there is no intention, one eye looks at the switch direction, but the other eye does not. When willing, both eyes are facing the switch. When it is desired to cancel after inputting the switch 121, a blink command is input twice by blinking twice in succession. In this case, it is canceled regardless of the direction of the line of sight. Since you do not need to direct your line of sight in a specific direction, you can cancel it even if you are in a hurry. If the signal of the scanning line 10 is detected, the signals of FIG. 6 and FIG. 7 are obtained alternately, so that two blinks can be recognized. When the present invention is used for a functional test of eye movement, it passes through dichroic mirrors 5L, 5R and optical axes 01L, 01R.
Show a vertically moving target and check its followability.

Next, an apparatus which can be quickly operated by the line of sight and which enables various operations will be shown.

In FIG. 9, the image pickup means of the object S is operated by the line of sight in the first embodiment. The infrared LED 24 reflects the dichroic mirror to illuminate the anterior segment of the operator's eye E. The dichroic mirror 21 transmits visible light and reflects infrared light. The lens 22 forms an image of the anterior segment on the image pickup device of the image pickup means 23. The signal of the image pickup means 23 is calculated by the calculation means 27, and the direction of the line of sight is calculated from the positional relationship between the corneal reflection image 24 ′ of the light source 24 and the pupil P. During operation, the signal from the image pickup means 23 is fetched into the arithmetic control means 27 at predetermined repetitions to monitor the line-of-sight direction. This calculation method is disclosed in Japanese Patent Laid-Open No. 5-199.
996. The object S is imaged on the image pickup element surface of the image pickup means 28 by the zoom lens 29. The image is displayed on the liquid crystal display member 26. The pattern of the plurality of switches 30 generated by the arithmetic control means 27 is also displayed on the display member 26 as shown in FIG. The member 26 is near the focal point of the lens 25, and the eye E is the dichroic mirror 21.
View member 26 through. The switch 30 is for controlling the imaging condition of the object S, and is operated by the line of sight while watching the image of the object S. The switch 30A is for zooming the lens 29. When the line of sight of the eye E is directed to 30A, the computing means 27 recognizes it and changes the display of the switch 30A to a black background and displays the execution switch 31 as shown in FIG. 31T is telescopic, and 31W is wide. Further line of sight 31
When it is turned to W, it is recognized and the display is changed from a white background to a black background as shown and it is recognized and displayed.
Under the control of the control means 27, zooming is performed while the line of sight is directed in the wide direction by the driving means (not shown) of the lens 29. If you think it is too far, you can zoom in the tele direction by moving your line of sight to 31T. If it is good to look away, the execution switch 31 disappears and the display of 30A also returns to the original white background. Although there is one tele and one wide, a plurality of zoom lenses may be provided so that the zoom speed can be selected. When you move the handle or knob by hand, you can operate the rotation direction, holding time, and rotation speed, but if you display and select multiple switches in each direction as described above, you can do the same operation. Becomes When one button is enough like a recording button, when the corresponding switch 30C is selected with a line of sight, the display changes to a black background and one white background execution switch 32 is generated and displayed by the control means 27. When the line of sight is moved to the execution switch 32, the line of sight is recognized and the image is changed to a black background, and recording is executed by a recording means (not shown). At the same time, the white background interruption switch 33 is generated and displayed nearby. This state is shown in FIG. Other switches can also be operated here. If the line of sight is directed to the interruption switch 33, the recording is interrupted and the execution switch 32 and the interruption switch 33 disappear. Saves display space by not displaying the run or suspend switches when not in use. Further, since the number of the switches 30 constantly displayed is small, the operation of the corner device becomes easy.

FIG. 14 shows a different embodiment, in which the eye E looks at the outside world through the dichroic mirror 34 which transmits visible light and drives a car or an airplane. Infrared light source 2
4, the lens 22, and the image pickup means 23 are the light source 24 of FIG.
They correspond to the lens 22 and the image pickup means 23, respectively. Display member 3
6 displays the switch 30, the execution switch 31, etc. of FIGS. Part 34h of the dichroic mirror 34
Is a half mirror, and the eye E sees the display in a part of the visual field through the lens 35 through reflection. These optical system parts are integrally fixed to the head. The arithmetic control unit 37 corresponds to the arithmetic control unit 27, calculates the line-of-sight direction from the anterior segment image as shown in FIG. 10, and controls the switches, execution switches, and switch operation execution unit 38 based on the calculation.
Although claims 1 to 4 are intended for both eyes, claim 5
6 to 6 may be targeted for both eyes or may be targeted for one eye.

[0020]

According to the present invention described in claims 1 and 2, it becomes possible to focus on the basis of the calculated gaze distance information.

Further, according to the present invention described in claim 3,
It is possible to perform eye measurement such as phoria based on the calculated gaze distance information.

Further, according to the present invention described in claims 5 and 6, it is possible to provide a device having good operability through imaging of an eye to be inspected for one eye or both eyes.

[Brief description of drawings]

FIG. 1 is a diagram showing a configuration diagram of an optical system of the present invention.

FIG. 2 is a diagram showing an image of a pupil portion reflected on an image pickup means of an eye to be examined.

FIG. 3 is a diagram showing an example of a video image of an image display means.

FIG. 4 is a diagram showing a positional relationship of corneal reflections between the left and right eyes when viewing a distant view and a near view.

FIG. 5 is a diagram showing a signal of a scanning line having corneal reflection in a pupil image.

FIG. 6 is a diagram showing a signal of a scanning line at the center of the pupil.

FIG. 7 is a diagram showing scanning line signals during blinking.

FIG. 8 is a diagram showing a block diagram of a device configuration.

FIG. 9 is a diagram showing a configuration diagram of a first embodiment of a line-of-sight input device.

FIG. 10 is a diagram showing an image reflected on an image capturing unit that captures an anterior segment.

FIG. 11 is a diagram showing a display screen displaying an image of an object and a switch.

FIG. 12 is a diagram showing a display screen displaying an image of an object, a switch, and an execution switch.

FIG. 13 is a diagram showing a display screen displaying a switch, an execution switch, and an interruption switch.

FIG. 14 is a diagram showing a configuration diagram of a different embodiment of the line-of-sight input device.

[Explanation of symbols]

 P pupil 1L display member 1R display member 7L image pickup device 7R image pickup device 13 computing means 14 actuator

Claims (6)

[Claims] 1. A stereoscopic image display means, an imaging means for imaging both eyes illuminating the anterior segment, and a focus of the stereoscopic image display means is adjusted according to gaze distance information calculated from the imaging means. An eye optical device having a focus adjusting means. 2. An image pickup device for picking up images of both eyes whose front anterior part is illuminated, and a focus adjusting device for adjusting the focus of the image pickup device for taking an image of a subject according to gaze distance information calculated from the image pickup device. An ophthalmic optical device characterized by the above. 3. An ophthalmic optical apparatus comprising: an image pickup means for picking up images of both eyes whose anterior segment is illuminated, and a comparison means for comparing gaze distance information calculated by the image pickup means with predetermined distance information. . 4. The eye optical device according to claim 1, wherein the gaze distance information is one of a gaze distance, a convergence angle, and a line-of-sight direction. 5. An image pickup means for picking up an image of a pupil part of an eye to be inspected,
An eye optical device, comprising: an arithmetic unit that sequentially calculates the signal, and detecting a blink based on a change in the signal of the pupil portion. 6. A detection means for detecting the direction of the line of sight of the eye, a display means for displaying a plurality of switches in the field of view, and an execution switch which is displayed when the line of sight of each of the switches is detected. A line-of-sight input device for detecting that the line of sight is directed to the execution switch by the detecting means and inputting the switch.