JP2001242417A - Pupil position detector and image display device using the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a pupil position detector and an image display device using the same observable a stereoscopic image with satisfactory image quality, even when an observer's position changes by using a signal from the pupil position detector. SOLUTION: In the pupil position detector which illuminates infrared light emitted from an infrared light emitting means to an observer and detects an observer's pupil position by using a photographic means, photographic lenses of the infrared light-emitting means and the photographic means are disposed optically coaxial, and the position of the light-emitting part of the infrared light-emitting means and the position of the entrance pupil of the photographic lens are almost in agreement optically.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a pupil position detecting device and an image display device using the same, and for example, detects a pupil position of an eye of an observer observing an image display surface from a distant place without contact. TV, video,
The present invention is optimal for a stereoscopic image display device that performs stereoscopic observation of image information without using special glasses on a display such as a computer monitor or a game machine, for example, for expanding a stereoscopic viewing area.

[0002]

2. Description of the Related Art Conventionally, as a stereoscopic image display device for displaying a stereoscopic image without using special glasses, a parallax image for the left eye and a parallax image for the right eye are displayed on a display screen such as a liquid crystal panel. There is known a device in which a parallax image is guided to the left and right eyes of an observer by a light separating unit such as a lenticular lens or a barrier to recognize a stereoscopic image.

[0003] In this type of stereoscopic image display device, since there is a limit in the area in which stereoscopic vision is possible, the position of the observer's eye (pupil) is detected by a pupil position detection device or the like, and stereoscopic vision is detected based on the information. A method of following an area to the position of an eye is disclosed in, for example, Japanese Patent No.
2662252.

In order to improve the human interface function of a computer, a method of detecting the line of sight of a computer observer and detecting the position of a pupil of the eye of the observer in order to detect where the observer is looking. But Tokuhei 7-
No. 82539.

Further, Japanese Patent Application Laid-Open No. 7-1995 discloses a method of detecting the driver's eye position in order to observe the driver's eye condition in order to know the behavior of the driver such as a dozing state and an inattentive state. -134800.

The present inventors have disclosed in Japanese Patent Application Laid-Open No. Hei 9-311294 a method in which two lenticular lenses are arranged on the back of an image display to separate images entering the left and right eyes of an observer. A stereoscopic image display device which has a wide observation viewing range and can observe a good stereoscopic image has been proposed.

Further, the present inventors have proposed, as an improvement proposal of the above-mentioned proposal, Japanese Patent Application Laid-Open No. Hei 10-78563, based on information obtained by a viewpoint position detecting means for detecting an observation position of an observer, as the observer moves. There has been proposed a stereoscopic image display device that moves a stereoscopic viewing area to the right, left, back and forth to follow the stereoscopic viewing area.

[0008]

SUMMARY OF THE INVENTION The present invention is directed to a pupil position detecting method for detecting a pupil position with high accuracy and high efficiency as one of human eyeball information for the purpose of application to the above-mentioned conventional example. It is intended to provide equipment.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a pupil position detecting device that efficiently uses infrared light used for pupil position detection.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a pupil position detecting apparatus for tracking an eye image photographed in a visible light region with high position detection accuracy based on pupil position information detected using infrared light. .

An object of the present invention is to provide a pupil position detecting device for simultaneously detecting the horizontal and vertical positions of the pupil and the distance between the detecting device and the subject.

An object of the present invention is to provide a three-dimensional image display device capable of observing a three-dimensional image of good image quality.

Another object of the present invention is to provide a three-dimensional image display device capable of favorably observing a three-dimensional image of good image quality even when the observation position changes.

[0014]

According to a first aspect of the present invention, there is provided a pupil position detecting apparatus for projecting infrared light from an infrared light emitting means to an observer, and determining the pupil position of the observer using a photographing means. In the pupil position detecting device for detecting, the infrared light emitting means and the photographing lens of the photographing means are optically coaxially arranged, and the position of the light emitting section of the infrared light emitting means and the position of the entrance pupil of the photographing lens Are optically substantially coincident with each other.

According to a second aspect of the present invention, in the first aspect of the present invention, a size of a light emitting portion of the infrared light emitting means is smaller than a size of an entrance pupil of the photographing lens.

A pupil position detecting device according to a third aspect of the present invention is a pupil position detecting device for projecting infrared light from infrared light emitting means to an observer and detecting the pupil position of the observer using photographing means. In, the photographing means has a first photographing means for photographing using infrared light and a second photographing means for photographing using visible light, the infrared light emitting means, the first photographing means, and , The second photographing means is optically coaxially arranged.

According to a fourth aspect of the present invention, in the third aspect of the present invention, the position of the light emitting portion of the infrared light emitting means and the position of the entrance pupil of the photographing lens of the first photographing means are transmitted through the light dividing means. It is characterized by being substantially optically identical.

A pupil position detecting device according to a fifth aspect of the present invention is a pupil position detecting device for projecting infrared light from infrared light emitting means to an observer and detecting the pupil position of the observer using photographing means. In, the photographing means, a first photographing means for photographing using infrared light and a second photographing means for photographing using visible light,
A first light splitting means for splitting an optical path of the first and second imaging means, and a second light splitting means for splitting an optical path of the infrared light emitting means and the first or second imaging means It is characterized by having.

According to a sixth aspect of the present invention, in the fifth aspect, the first light splitting means and the second light splitting means each have a function of reflecting visible light and transmitting infrared light. Alternatively, it is characterized by comprising a hot mirror having a function of transmitting visible light and reflecting infrared light.

A pupil position detecting device according to a seventh aspect of the present invention is a pupil position detecting device for projecting infrared light from an infrared light emitting means to an observer and detecting the pupil position of the observer using a photographing means. Wherein the photographing means has an infrared photographing means for photographing using infrared light, a light dividing means for dividing an optical path between the infrared light emitting means and the infrared photographing means, and including them inside It is characterized in that a light absorbing means for absorbing a part of the infrared light passing through the light splitting means is provided in a part of the housing.

The invention of claim 8 is characterized in that, in the invention of claim 7, the light absorbing means comprises one or more infrared light absorbing members.

A pupil position detecting device according to a ninth aspect of the present invention is a pupil position detecting device for projecting infrared light from infrared light emitting means to an observer and detecting the pupil position of the observer using photographing means. Wherein the photographing means has infrared photographing means for photographing using infrared light, the infrared light emitting means has optical means including a condenser lens, and the optical means is Are arranged so as to form an image at the position of the observer.

A pupil position detecting device according to a tenth aspect of the present invention comprises:
In a pupil position detecting device that emits infrared light from an infrared light emitting unit to an observer observing an image display unit and detects a pupil position of the observer using an imaging unit, the light emitted from the infrared light emitting unit is used. The position of the section and the position of the image display on the image display section are substantially matched.

The pupil position detecting device according to the invention of claim 11 is
In a pupil position detecting device that condenses infrared light from infrared light emitting means by an optical means and projects the light to an observer, and detects the pupil position of the observer by using an imaging means, the imaging means includes a red light. It has an infrared imaging means for photographing using external light, the infrared light emitting means and the infrared imaging means are optically coaxially arranged,
The position of the image of the light emitting section of the infrared light emitting means by the optical means and the position of the exit pupil of the photographing lens of the infrared photographing means are optically conjugate positions.

According to a twelfth aspect of the present invention, in the eleventh aspect, the size of an image of the light emitting portion of the infrared light emitting means by the optical means is smaller than the size of an exit pupil of the photographing lens. I have.

According to a thirteenth aspect of the present invention, an image display device includes the pupil position detecting device according to any one of the first to twelfth aspects.

According to a fourteenth aspect of the present invention, there is provided an image display device including the pupil position detecting device according to any one of the first to twelfth aspects, wherein the image display device is obtained by the pupil position detecting device. The image display operation is controlled based on the pupil information of the observed observer.

According to a fifteenth aspect, in the thirteenth or fourteenth aspect, the image display device has a function of guiding a parallax image displayed on at least a part of a display to a left eye and a right eye of an observer. It is characterized by having.

[0029]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A pupil position detecting device according to the present invention and an image display device using the same will be described below.

[First Embodiment] FIG. 1 shows a pupil position detecting apparatus according to the present invention and a three-dimensional image display apparatus using the same.
This will be described with reference to FIG.

FIG. 1 shows a display (image display unit) 11.
It is possible to separately and independently display the striped parallax images for the left and right eyes of the observer on all or a part of 0, observe the parallax image, and stereoscopically observe the parallax image displayed on the display. 1 is an external view of a possible image display device (stereoscopic image display device).

In FIG. 1, reference numeral 100 denotes a main body of the three-dimensional image display device. 110 is a display display unit (display).

Reference numeral 111 denotes a 3D window in which a stereoscopic image (parallax image) is displayed and observed in the display unit 110.

Reference numeral 120 denotes a pupil position detecting device (viewpoint position detecting means) for detecting a pupil position of an observer's eye according to the present invention.

FIG. 2 is a system block diagram for explaining the system of the three-dimensional image display device of FIG.

Referring to FIG.
Is a transmissive display (image display means) 210 such as a liquid crystal for displaying a parallax image or a two-dimensional image in a stripe shape, an optical modulator 240 including a transmissive display such as a liquid crystal having a discrete pixel structure, a backlight light source (Light source means) 250,
In addition, it has an optical unit including two lenticular lenses 220 and 230 arranged between the display 210 and the light modulator 240 and whose generatrix directions are orthogonal to each other.

The display 210 displays a stereoscopic image (parallax image) with parallax or a normal two-dimensional image without parallax. In the present embodiment, for example, two parallax images corresponding to the left and right eyes are divided into a number of vertical stripe-shaped stripe images, and each stripe image which is an element of the parallax image is rearranged for each pixel (for each scanning line) and synthesized. Is used as a parallax image.

The area where the parallax image is displayed corresponds to the 3D window 111 in FIG.

When a stripe-shaped parallax image is displayed on the 3D window 111 and the luminous flux from the light modulator 240 is illuminated as a directional luminous flux via the optical means 220 and 230, the luminous flux based on each parallax image is obtained. Guide light to the right and left eyes of the observer, thereby observing a stereoscopic image.

Reference numeral 260 denotes a display drive circuit which displays an image on the display 210 based on a signal from the image processing means 270.

The size and position information of the 3D window 111 is output from the image processing means 270 to the signal synthesis circuit 280.

The pupil position information of the observer detected by the pupil position detection device 120 is also output to the signal synthesis circuit 280.

The signal synthesizing circuit 280 is connected to the image processing unit 27.
Information for driving the optical modulator 240 is generated based on both the information from the pupil position detecting device 120 and the information 0, and the information is output to the optical modulator driving circuit 290.

The optical modulator 240 is an optical modulator driving circuit 290
Driven by the display unit 2
A checkerboard-shaped mask pattern is displayed in an area corresponding to the 10 3D window section 111, and uniform density is displayed in an area corresponding to the two-dimensional image display section. This enables the display display unit 210 to observe a stereoscopic image and a two-dimensional image.

The principle of observation of a stereoscopic image and observation of a two-dimensional image in this embodiment is described in detail in Japanese Patent Application No. 10-322139 previously proposed by the present applicant.

Reference numeral 200 denotes an observer of the display 110. When the observer 200 moves, the optical modulator driving circuit 290 changes the region where the mask pattern of the optical modulator 240 is formed using the signal from the pupil position detection device 120 and moves the observer. So that you can view stereoscopically with
The tracking control is performed on the light emitting area of the mask pattern.

Next, detection of the pupil position of the observer will be described.

FIG. 3 shows a pupil position detecting device 120 for detecting the pupil position (gaze information) of the observer 200 according to the first embodiment.
FIG.

In this embodiment, infrared light is emitted to the observer of the image display apparatus, and the pupil position of the eye is detected from a distant position using reflected light from the retina of the eye.

In the figure, reference numeral 121 denotes a pupil position detecting device 1
Reference numeral 20 denotes a housing, and 122 denotes an opening formed in the housing.

Reference numerals 310 and 320 denote photographing means such as a video camera.

The photographing means 310 is used as an infrared camera (infrared photographing means), and the photographing means 320 is used as a visible light camera (visible photographing means).

Reference numerals 311 and 321 denote imaging elements such as CCDs having sensitivity to visible light and infrared light, and reference numerals 312 and 322 denote imaging lenses constituting the imaging means 310 and 320.

Reference numerals 313 and 323 denote photographing lenses 312 and 32, respectively.
2 is an entrance pupil (aperture).

Numeral 330 denotes an infrared light emitting means having a spectral peak at a wavelength of 850 nm, such as an LED which emits infrared light or the like, and is constituted by an LED with a lens or a combination of an LED and a condenser lens. There may be.

Reference numeral 331 denotes a light emitting section of the infrared light emitting means 330.

Reference numeral 340 denotes a band pass filter that transmits the emission wavelength of the infrared light emitting means 330, and reference numeral 350 denotes an infrared light cut filter.

Reference numerals 360 and 370 denote light dividing means such as a half mirror.

Numeral 380 denotes an infrared light absorbing member for preventing a ray of infrared light from the infrared light emitting means 330 that has passed through the light dividing means 370 from being reflected by the inner surface of the housing 121 to become noise light. To act.

First photographing means 310, second photographing means 3
20 is optically coaxial and observer 200 (subject)
Are arranged at the same optical distance, and the angle of view is set to the same value.

The infrared light emitting means 330 is provided for both photographing means 31
Coaxial illumination is arranged for 0,320.

The light emitting section 33 of the infrared light emitting means 330
1 is located at a position optically equivalent to the position of the entrance pupil 313 (323) of the photographing lens 312 (322) with respect to the observer 200 (subject), that is, as shown in FIG. The distance L1 from the light source 331 to the light emitting unit 331 and the distance L2 from the light splitting means 370 to the entrance pupil position of the taking lens 312 are optically equal.

The size of the light emitting portion 331 of the infrared light emitting means 330 is set so as to be within the entrance pupil diameter of the photographing means after it is formed on the retina of the eyeball. That is, the size of the light emitting unit 331 is determined by the area (diameter) of the entrance pupil 313 of the photographing lens 312.
It is set smaller, thereby improving the light receiving efficiency of the light beam.

In general, when the position of the image formed by the observer's eyes based on the infrared light from the infrared light emitting means deviates from the position of the entrance pupil 313 of the photographing lens 312 in the optical axis direction or the plane direction, the light amount Loss occurs, and the ratio of the brightness of the reflected image on the retina formed on the retina to the other brightness decreases, making it difficult to detect the reflected image by image processing.

Therefore, in this embodiment, the infrared light emitting means 33
0 and the photographing lens 312 are coaxial, the position of the light emitting section 331 of the infrared light emitting means 330 and the entrance pupil 313 of the photographing lens 312 are substantially optically matched, and the light emitting section 3
The position of the pupil of the observer is detected with high accuracy while preventing the loss of light amount by setting the size of the image 31 into the entrance pupil 313 of the photographing lens 312.

The pupil position detecting device 12 having the above configuration
0 is the main body 100 of the stereoscopic image display device as shown in FIG.
And the photographing range of both cameras is set to the face area of the observer.

When the pupil is disposed at the upper portion of the main body 100, the eyelid of the observer easily blocks the pupil, and a bright spot image of the pupil described later is easily lost.

FIGS. 4 and 5 show a photographing screen of the observer 200 photographed in this state.

FIG. 4 shows an image pickup means 3 as a visible light camera.
20 is a photographed image of the observer by No. 20; FIG. 5 shows a photographed image by the photographing means 310 as an infrared camera.

In FIG. 4, reference numeral 201 denotes a photographed image of the observer, and reference numeral 202 denotes a pupil image of the eye. FIG. 3 shows that the retina of the eye in the infrared region has a reflectance different from that of the eye other than the retina;
Since the light emitting unit 331 and the display 110 are substantially equidistant from the observer 200 in the configuration described in the above, in the state where the observer 200 is observing the display 110,
The light emitting section 33 of the infrared light emitting means 330 on the retina of the eye of 00
One image is formed.

Since the reflected light from the image of the light emitting unit 331 re-images at the position of the entrance pupil 313 of the infrared camera 310 by the action of the eye lens, the focus of the infrared camera 310 is set to the reference observation distance. In the infrared camera 310, the pupil image 202 of the eye of the observer 200 is photographed as a bright point as shown in FIG.

The pupil position information of the left and right eyes of the observer is detected from the pupil image 202 obtained by the infrared light camera 310 shown in FIG. 5 by a known image processing method.

Based on this information, utilizing the fact that the infrared light camera 310 and the visible light camera 320 are coaxial and have the same angle of view, the face image of the visible light camera 320 shown in FIG. The left and right (X-axis direction) and up-and-down (Y-axis direction) positions of the pupil of the observer 200 are detected in real time by tracking using the pattern matching method.

Here, a method of estimating the front and rear (Z-axis direction: the vertical direction of the paper) of the observer 200 based on the left-right and up-down position information will be described.

As shown in FIG. 4, the observer having the distance between the pupils of the left and right eyes on the photographed image as Ei, the standard interocular distance as E, the reference observation distance of the stereoscopic image display device as L, and the standard interocular distance E is obtained. The distance between pupils on the image in the observation state at the reference observation distance L is Ei
s, and assuming that the distance between the viewpoint detection device 120 and the observer 200 and the distance between the display 110 and the observer 200 are approximately equal, the value Li calculated by the following equation is changed to the front-back position (observation). (Distance between the user 200 and the display 10).

Li = L * Ei / Eis By using both the image from the infrared light camera 310 and the image from the visible light camera 320, the pupil position of the observer can be accurately detected and tracked. , A stable output can be obtained.

In FIG. 3, an image display section is provided inside or outside the housing 121 as one element of the pupil position detecting device, so that the observer can observe the image display section. Information may be detected.

Further, eyeball information such as iris and cornea may be detected instead of the pupil of the observer.

Next, a second embodiment of the present invention will be described.

[Embodiment 2] Embodiment 2 is based on Embodiment 1.
However, a pupil position detection device is used which has a reduced number of components and which has improved light use efficiency of a visible light camera and an infrared light camera.

The principle of pupil position detection is the same as in the first embodiment.

The pupil position detecting device according to the second embodiment will be described with reference to FIG. 6, focusing on differences from the first embodiment.

Members having the same functions as those of the first embodiment are denoted by the same reference numerals, and the description of the functions will be omitted.

In FIG. 6, reference numeral 670 reflects visible light.
This is a so-called cold mirror that transmits infrared light.

Desirably, a wavelength region below the wavelength region of the light emitted from the infrared light emitting means 330 is reflected, and the wavelength region on the long wavelength side exceeding the light emitting region including the light emitting wavelength region of the infrared light emitting device 330 is reflected. An optical member that transmits light.

Reference numeral 660 denotes a light splitting function in the emission wavelength range of the infrared light emitting means 330, and preferably, an absorption action in a long wavelength range exceeding the wavelength range of light emitted from the infrared light emitting means 330. , An optical member having a reflection function.

In the second embodiment, the infrared light emitting means 33
Distance L1 from light emitting unit 331 to optical member 660
From the optical member 660 to the entrance pupil 31 of the taking lens 312
The optical distance L2 to 3 is equal.

With the above configuration, the visible light transmitting filter 350 and the band pass filter 340 in the first embodiment are eliminated, and the infrared light camera 310 and the
The light use efficiency of the visible light camera 320 is improved.

Note that the visible light camera 320, the infrared light emitting means 330, the infrared light camera, and the optical member 660 are exchanged to form a hot mirror that transmits visible light to the optical member 670 and reflects infrared light. May be.

Next, a third embodiment of the present invention will be described.

[Embodiment 3] In Embodiment 3, left and right (X
In the first embodiment, a pupil position detection device having a function of accurately detecting the front and rear positions of the pupil, which have been estimated values in the first embodiment, as well as the upper and lower axes (Y axis).

The pupil position detecting device according to the third embodiment is shown in FIGS.
The description will be focused on the differences from the second embodiment with reference to FIG.

Members having the same functions as those of the first and second embodiments are denoted by the same reference numerals, and the description of the functions will be omitted.

In FIG. 7, reference numeral 123 denotes a second opening formed in the housing 121.

Reference numeral 710 denotes a second infrared light emitting means such as an infrared LED for distance measurement of the pupil before and after.

Reference numeral 720 denotes an optical unit including a condenser lens for condensing the infrared light from the infrared light emitting unit 710 at the position of the observer 200.

The focus position of the infrared light by the optical means 720 is set so that the infrared light is positioned almost at the center of the face of the observer when the observer 200 is observing the display 110 at the reference observation position. Light emitting means 710 and optical means 72
0 is arranged.

FIGS. 8, 9, and 10 show images captured by the infrared light camera 310 of the viewpoint detecting device (pupil position detecting device) having the above-described configuration.

FIG. 8 shows a case where the observer observes the display at the reference observation distance, FIG. 9 shows a case where the observation position is closer to the display than the reference observation distance, and FIG. This is a case where the position is observed farther from the display than the reference observation distance.

In FIGS. 8, 9 and 10, a large white area 810 is formed by the optical means 720 and the infrared light emitting means 1 is used.
It is a bright spot image of a light-collecting portion where infrared light from 0 is focused on the face of the observer.

Here, in FIG. 8 showing a state where the image is observed at the reference observation position, the coordinate position of the bright spot image 810 on the screen in the vertical direction (Y-axis direction) is set to y = 0, and the observer approaches. The method of calculating the observation distance of the observer 200 from the bright spot position coordinate value yn when the coordinates in FIG.

The calculation can be performed similarly in the case of FIG. 10 in which the observer has moved away.

In FIG. 11, reference observation distance (distance between display 110 and reference observation position 203) L0, distance between reference observation position 203 and principal point 315 of photographing lens 312
Lc0, reference observation position 203 and second infrared light emitting means 71
0, the distance between Li0, the distance L2 between the second infrared light emitting means 710 and the optical axis Lxa of the infrared camera 310, and the infrared camera 31
0, the distance l between the principal point 315 of the imaging lens 312 and the imaging surface of the image sensor 311, the observation distance Ln at the position 204 where the observer has approached the position 204 where the observer has approached
Lc between the principal points 315 of the object, the position 20 where the observer approaches
Distance between 4 and infrared light emitting means 710 Li, observer 200
Assuming that the distance Yn from the camera optical axis Lxa of the infrared light condensing position 204 on the face of the camera is Yn = L3 * (Li0-Li) / Li0 --------- ( 1) yn = Yn * l / Lc0 --------------- (2) Here, since L0 = Lc0 = Li0 Ln = Lc = Li approximately, (1) , (2), Ln = L0 * (1−yn / L3).

Since L0 and L3 are prerequisites when designing the stereoscopic image display device and the pupil position detecting device, the observation distance Ln can be obtained from these conditions.

In this embodiment, the position 204 when the observer has moved from the reference observation position 203 in the front-back direction is detected as described above.

Next, a fourth embodiment of the present invention will be described.

[Embodiment 4] Embodiment 4 is similar to Embodiment 3
In addition, an infrared light emitting means to be used or a viewpoint position detecting device which reduces the number of optical members is used.

Embodiment 4 will be described with reference to FIGS.

Members having the same functions as those of the first to third embodiments are denoted by the same reference numerals, and description thereof is omitted.

In FIG. 12, reference numeral 1210 denotes a mirror.

According to the configuration shown in the figure, of the infrared light emitted from the infrared light emitting means 330, the light beam that has passed through the optical member 660 is reflected by the mirror 1210, and the face of the observer 220 is reflected by the optical means 620 having a condensing function. Is collected.

FIG. 13 shows a modification of this embodiment, in which the mirror 1210 in FIG. 12 is replaced with a curved (spherical or aspherical) mirror 1310 and the optical means 720 is omitted.

According to FIGS. 12 and 13, the number of infrared light emitting means can be reduced, and infrared light can be effectively used.
The number of constituent members can be reduced.

The calculation of the pupil position information is performed in the third embodiment.
We go according to.

Next, a fifth embodiment of the present invention will be described.

[Embodiment 5] Embodiment 5 uses a viewpoint position detecting device which is an improvement on Embodiment 2 of FIG. 6 and which improves the use efficiency of infrared light.

However, this method is applicable to the other embodiments 1, 3,
4 is also applicable.

The members having the same functions as those of the first and second embodiments are denoted by the same reference numerals, and the description thereof will be omitted. The description will focus on the differences from the second embodiment.

In the second embodiment shown in FIG. 6, a part of the infrared light from the infrared light emitting means 330 is reflected by the optical member 660, while the other part is transmitted through the optical member 660 and is transmitted to the viewpoint detecting device. The inner surface of the housing 121 is illuminated.

When this irradiation light is reflected by the inner surface of the housing, it becomes noise light. Therefore, in the second embodiment, the light absorbing member 380 is disposed on the inner surface of the housing.

Of the infrared light that has not been completely absorbed by the light absorbing member 380, the light that has been irregularly reflected is again reflected by the optical member 6.
There is a case where the light is reflected at 60 and enters the infrared light camera 310.

This light acts as noise when a bright point image of the pupil due to retinal reflection is detected by image processing.
This may cause deterioration of detection performance.

In particular, when a small pupil position detecting device is to be realized, the light absorbing member 380 and the infrared light camera 3
Since the distance of No. 10 becomes short, the absorption characteristics need to be improved.

The present embodiment incorporates the countermeasures, and the configuration of the fifth embodiment will be described with reference to FIG.

In FIG. 14, reference numeral 124 denotes a hole formed in a portion of the casing 121 of the viewpoint position detecting device 120 where a large amount of infrared light is irradiated, and reference numeral 1410 denotes an infrared light absorbing characteristic. Moreover, it is an optical member having low diffusivity.

In this configuration, of the infrared light from the infrared light emitting means 330, the infrared light that has passed through the optical member
Since the light is emitted to the outside of the camera 21, noise light incident on the infrared light camera 310 is reduced, and even if the light emission intensity of the infrared light emitting means 330 is low, it is possible to detect the bright spot of the pupil by image processing.

FIG. 15 is an explanatory diagram of a further improved form of the present embodiment.

In the structure shown in FIG.
The infrared light that has been reflected by the light source and emitted once to the outside is irradiated onto an external object, and when the reflected light returns to the inside of the housing 121, there is a possibility that the infrared light may cause noise.

FIG. 15 incorporates such measures.

In FIG. 15, reference numeral 1510 denotes the optical member 14.
This is an optical member having characteristics similar to those of Example 10, that is, having an absorption characteristic for infrared light and a low diffusivity.

In the structure shown in the figure, the infrared light emitted to the outside of the housing 121 through the opening 124 is mutually reflected and absorbed by the two optical members 1410 and 1510, so that the noise light is not absorbed. It is reliably shut off without returning to the body 121.

Next, Embodiments 6 to 8 of the present invention will be described with reference to FIGS.

[Embodiments 6 to 8] In the following embodiments, the housing and the like are omitted, and members having the same functions as those of the above-described embodiments are denoted by the same reference numerals as in the previous embodiments. Omit.

The sixth embodiment shown in FIG. 16 is different from the second embodiment shown in FIG.
And a viewpoint position detection device that uses fewer photographing lenses.

In the sixth embodiment shown in FIG. 16, light is split by the light splitting means 360 behind the photographing lens 312, so that one photographing lens can photograph visible light and infrared light.

The seventh embodiment shown in FIG. 17 is different from the third embodiment shown in FIG.
To improve the light use efficiency of infrared light emitting means,
In addition, a viewpoint position detecting device which is downsized is used.

In the seventh embodiment shown in FIG. 17, reference numeral 332 denotes a lens for condensing infrared light of the infrared light emitting means 330, and the light emitting section 331 of the infrared light emitting means 330
It is arranged to form an image at the position of 12 exit pupils 313.

Further, by making the size of the formed image of the light emitting portion smaller than the area (dimension) of the exit pupil 313 of the photographing lens 312, effective use of infrared light is achieved.

The eighth embodiment shown in FIG. 18 further uses the viewpoint position detecting device in which the number of photographing lenses is reduced by improving the seventh embodiment shown in FIG.

In the eighth embodiment shown in FIG.
Reference numerals 20 and 930 constitute a so-called 3P prism for color separation and color synthesis.

The surface 911 of the prism 910 has the property of acting as a half mirror for infrared light, and has the property of transmitting light, and the surface 921 of the prism 920 reflects visible light and emits infrared light. It has the property of transmitting light.

Also in this embodiment, the external light emitting means 3
It is desirable to arrange the 30 light emitting units 331 so as to form an image at the position of the entrance pupil 313 of the photographing lens by the condenser lens 332.

In accordance with the arrangement of the infrared light emitting means and the image pickup device,
By appropriately setting the characteristics of each prism, various embodiments can be realized.

As described above, according to the present embodiment, based on the pupil position information detected accurately using infrared light, the position of the pupil is determined using the image of the eye photographed in the visible light region. In order to track, the position of the pupil can be accurately detected in real time.The position of the light emitting part of the infrared light emitting means and the position of the entrance pupil of the photographing lens can be made approximately the same optically. By providing an opening in the housing that reduces noise light, the use efficiency of infrared light is improved, and the pupil position can be detected efficiently, so that the amount of projected light is small and safety is required. ・In addition to the horizontal and vertical positions of the pupil, the front and rear positions can be detected from the interval of the pupil on the image.

[0145]

According to the present invention, the infrared light emitting means and the photographing means for photographing the infrared light region are used, and the infrared light emitting means and the lens of the photographing means are optically coaxially arranged. By arranging the position of the light emitting unit of the light emitting unit and the position of the entrance pupil of the photographing lens of the image pickup unit so as to substantially optically match each other, the pupil image of the subject's eye obtained from the photographing unit and the other brightness Thus, it is possible to achieve a pupil position detection device which can increase the ratio of the pupils and easily detect the pupil position by image processing, and an image display device using the same.

[Brief description of the drawings]

FIG. 1 is an external view of a main part according to a first embodiment of the present invention.

FIG. 2 is a system block diagram according to the first embodiment of the present invention.

FIG. 3 is an explanatory diagram of Embodiment 1 of the present invention.

FIG. 4 is an explanatory diagram of a shooting screen according to the first embodiment of the present invention.

FIG. 5 is an explanatory diagram of a shooting screen according to the first embodiment of the present invention.

FIG. 6 is an explanatory diagram of Embodiment 2 of the present invention.

FIG. 7 is an explanatory view of Embodiment 3 of the present invention.

FIG. 8 is an explanatory diagram of a shooting screen according to a third embodiment of the present invention.

FIG. 9 is an explanatory diagram of a shooting screen according to a third embodiment of the present invention.

FIG. 10 is an explanatory diagram of a shooting screen according to a third embodiment of the present invention.

FIG. 11 is an explanatory diagram of distance calculation according to the third embodiment of the present invention.

FIG. 12 is an explanatory view of Embodiment 4 of the present invention.

FIG. 13 is an explanatory view of a modification of the fourth embodiment of the present invention.

FIG. 14 is an explanatory view of Embodiment 5 of the present invention.

FIG. 15 is an explanatory view of a modification of the fifth embodiment of the present invention.

FIG. 16 is an explanatory diagram of Embodiment 6 of the present invention.

FIG. 17 is an explanatory view of a seventh embodiment of the present invention.

FIG. 18 is an explanatory diagram of Embodiment 8 of the present invention.

[Explanation of symbols]

Reference Signs List 100 main body of stereoscopic image display device 110 display 111 3D window 120 viewpoint position detecting device 121 housing of viewpoint position detecting device 122, 123, 124 opening provided in housing 200 observer 201 observer's face image 202 observer's eye Pupil image 203 Reference observation position 204 Position when observer approaches display 220 Vertical lenticular lens (vertical cylindrical lens array) 230 Horizontal lenticular lens (horizontal cylindrical lens array) 240 Optical modulator 250 Back light source 260 Display drive circuit 270 Image processing means 280 Signal synthesis circuit 290 Optical modulator drive circuit 310 Infrared light camera 311 Image sensor of infrared light camera 312 Photographing lens of infrared light camera 313 Entrance pupil of photographing lens of infrared light camera 315 Principal point of photographing lens of infrared light camera 320 Visible light camera 321 Image sensor of visible light camera 322 Shooting lens of visible light camera 323 Entrance pupil of photographing lens of visible light camera 330 Infrared light emitting means 331 Infrared light emitting means Light emitting part 332 Condensing lens 340 Band pass filter 350 Infrared light cut filter 360, 370 Light splitter 380 Light absorbing member 660, 670 Optical means 710 Second infrared light emitting means 720 Optical means 810 Infrared light focusing Infrared light camera image 910, 920, 930 3P prism 911, 920 Surface of prism 910, 920 1210 Mirror 1310 Spherical mirror 1410, 1510 Infrared light absorbing member E Standard interocular distance of observer Ei On photographing screen Eye distance Eis that the observer at the standard eye distance is observing at the reference observation position Distance between the principal points of the infrared light camera and the image sensor L observation distance L0 reference observation distance L1 distance between the infrared light emitting means and the light splitter L2 light splitter and the infrared light camera L3 Distance between the second infrared light emitting means and the optical axis of the infrared light camera Yn Distance between the optical axis of the infrared light camera and the condenser of the infrared light when the observer approaches Distance yn Distance between the image of the infrared light focusing part and the optical axis of the infrared light camera when the observer approaches. X, Y, Z coordinates

────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] October 13, 2000 (2000.10.
13)

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] 0075

[Correction method] Change

[Correction contents]

As shown in FIG. 4, the observer having the pupil distance Ei, the standard interocular distance E, the standard observation distance L of the stereoscopic image display device, and the standard interocular distance E on the captured image is E When the distance between pupils on the image in the observation state at the reference observation distance L is Eis, it is assumed that the distance between the viewpoint detection device 120 and the observer 200 and the distance between the display 110 and the observer 200 are approximately equal. Under the assumption that the value Li calculated by the following equation is the front-back position (the observer 200 and the display 110
(Interval distance).

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI theme coat ゛ (Reference) G06T 17/40 H04N 7/18 C H04N 7/18 13/04 13/04 A61B 3/10 B (72) Inventor Akinari Takagi 6-145 Hanasaki-cho, Nishi-ku, Yokohama-shi, Kanagawa F-term (reference) 2F065 AA03 AA04 AA06 AA19 BB07 CC16 DD00 DD06 DD09 DD12 FF04 FF42 GG07 GG12 GG21 HH13 JJ03 JJ05 JJ09 JJ19 JJ26 LL00 LL04 LL22 LL26 LL30 LL41 LL46 NN20 QQ26 QQ28 QQ36 QQ38 2H059 AA35 5B050 DA04 DA05 EA07 FA06 5C054 CA04 CA05 CC05 CC06 FA02 FD02 HA05 5C061 AA06 AB17 AB12 AB17

Claims (15)

[Claims] 1. A pupil position detecting device for projecting infrared light from an infrared light emitting means to an observer and detecting a pupil position of the observer using a photographing means, comprising: an infrared light emitting means; A pupil position, wherein a photographing lens of the photographing means is optically coaxially arranged, and a position of a light emitting portion of the infrared light emitting means and a position of an entrance pupil of the photographing lens substantially optically coincide with each other. Detection device. 2. The pupil position detecting device according to claim 1, wherein a size of a light emitting portion of said infrared light emitting means is smaller than a size of an entrance pupil of said photographing lens. 3. A pupil position detecting device for projecting infrared light from an infrared light emitting means to an observer and detecting a pupil position of the observer using an image pickup means, wherein the image pickup means emits infrared light. A first photographing means for photographing using visible light and a second photographing means for photographing using visible light, wherein the infrared light emitting means, the first photographing means, and the second photographing means are optically A pupil position detection device, which is arranged coaxially. 4. A position of a light emitting portion of said infrared light emitting means and a position of an entrance pupil of a photographing lens of said first photographing means are optically substantially coincident with each other via a light dividing means. 4. The pupil position detecting device according to claim 3, wherein 5. A pupil position detecting device for projecting infrared light from an infrared light emitting means to an observer and detecting a pupil position of the observer using an image pickup means, wherein the image pickup means emits infrared light. A first photographing unit for photographing using visible light, a second photographing unit for photographing using visible light, a first light dividing unit for dividing an optical path of the first and second photographing units, and the infrared light. A pupil position detecting device comprising a light emitting means and a second light dividing means for dividing an optical path of the first or second photographing means. 6. A cold mirror having a function of reflecting visible light and transmitting infrared light, or a transparent mirror having a function of reflecting visible light and transmitting infrared light. 6. The pupil position detecting device according to claim 5, comprising a hot mirror having a function of reflecting light. 7. A pupil position detecting device for projecting infrared light from an infrared light emitting means to an observer and detecting the pupil position of the observer using an image pickup means, wherein the image pickup means emits the infrared light. A light splitting means for splitting an optical path between the infrared light emitting means and the infrared shooting means; and a housing containing the light splitting means and the light splitting means. A pupil position detecting device, wherein a light absorbing means for absorbing a part of the infrared light passing through is provided in a part of the housing. 8. The pupil position detecting device according to claim 7, wherein said light absorbing means comprises one or a plurality of infrared light absorbing members. 9. A pupil position detecting device for projecting infrared light from an infrared light emitting means to an observer and detecting a pupil position of the observer using an image pickup means, wherein the image pickup means emits infrared light. An infrared photographing means for photographing using the infrared light emitting means, and the infrared light emitting means has optical means including a condenser lens, and the optical means connects a light emitting portion of the infrared light emitting means to a position of an observer. A pupil position detection device, which is arranged so as to form an image. 10. A pupil position detecting device for projecting infrared light from an infrared light emitting unit to an observer observing an image display unit and detecting a pupil position of the observer using a photographing unit. A pupil position detecting device, wherein a position of a light emitting unit of a light emitting unit substantially coincides with a position of an image display on the image display unit. 11. A pupil position detecting device for collecting infrared light from infrared light emitting means by an optical means, projecting the infrared light to an observer, and detecting the pupil position of the observer using a photographing means. The photographing means has infrared photographing means for photographing using infrared light, the infrared light emitting means and the infrared photographing means are optically coaxially arranged, and the infrared light emitting means A pupil position detecting device, wherein a position of an image of the light emitting unit by the optical unit and a position of an exit pupil of a photographing lens of the infrared photographing unit are optically conjugate positions. 12. The pupil position detecting device according to claim 11, wherein a size of an image of the light emitting section of the infrared light emitting means by the optical means is smaller than a size of an exit pupil of the photographing lens. 13. An image display device comprising the pupil position detection device according to claim 1. Description: 14. An image display device comprising the pupil position detection device according to claim 1, wherein the image display device is based on pupil information of an observer obtained by the pupil position detection device. An image display device for controlling an image display operation. 15. The image display device according to claim 13, wherein the image display device has a function of guiding a parallax image displayed on at least a part of a display to a left eye and a right eye of an observer. 14 image display devices.