JP2002318365A - Retina projection type display - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a retina projection type display which enables an observer to observe video even when moving the eyeballs. SOLUTION: The retina projection type display 1 is equipped with a point light source group 4, a lens 3 which converges the light emitted from the point light source group 4 on the pupil B of the observer, a liquid crystal display panel 2 which is arranged on the light convergence path, a half-mirror 5 which is arranged between the liquid crystal display panel 2 and the eyeball A, a camera 6, and an illumination control part 7. When the eyeball A of the observer faces the front, the illumination control part 7 detects the pupil B being present at the center position according to a video signal and turns on the point light source at the center position of the point light source group 4. When the eyeball of the observer is directed upward, the illumination control part 7 detects the pupil B moving up according to the video signal and turns on a spot light source below the center in response to the detection.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a retinal projection display.

[0002]

2. Description of the Related Art FIG. 7 shows a conventional retinal projection display 1.
1 and how the emitted image light is guided to the eyeball A. Retina projection display 11
Comprises a point light source 11a, a lens 11b for condensing light emitted from the point light source 11a on a pupil B of an observer, and a liquid crystal display panel 11c. Thus, the observer can recognize the image without depending on the adjusting function of the eyeball A.

[0003]

However, in the above-mentioned conventional retinal projection type display, when the observer moves the eyeball A, the focal point of the image by the lens 11b deviates from the pupil B of the observer, and the observer cannot observe the image. Cannot observe the video.

In view of the above circumstances, an object of the present invention is to provide a retinal projection display that enables an observer to observe an image even when the observer moves his or her eyeball.

[0005]

A retinal projection display according to the present invention is a retinal projection display for directly projecting an image on the retina through a pupil of an observer. A light source capable of moving the point light emission position, and control means for moving the point light emission position based on pupil position detection such that a focal point of image light is formed at the pupil position of the observer. It is characterized by having.

In the above arrangement, the light source may include a plurality of point light sources, and the control means may selectively turn on the point light sources. Further, the light source may include a planar light source and shutter means for forming a point light transmitting portion at an arbitrary position, and the control means may move the point light transmitting position of the shutter means. Further, the light source may comprise one point light source and an actuator for moving the point light source, and the control means may control the actuator.

Further, the retinal projection display of the present invention is a retinal projection display for projecting an image directly on the retina through a pupil of an observer. Control means for processing a video signal from the means to cause the video display means to function as a moving light source.

The retinal projection display of the present invention is a retinal projection display for projecting an image directly on the retina through the pupil of the observer. The pupil position detection means for detecting the pupil position of the observer, and the eyeball of the observer And a control means for moving the pinhole to the pupil position of the observer based on the detection of the pupil position.

In the above arrangement, the pinhole movement forming means comprises shutter means for forming a point light transmitting portion at an arbitrary position, and the control means moves the point light transmitting position of the shutter means. Good. Further, the pinhole movement forming means includes a pinhole plate movably provided and an actuator for moving the pinhole plate,
The control means may control the actuator.

In these configurations, the image light is transmitted or reflected to the eyeball side by a half mirror or a dichroic mirror disposed in front of the eyeball, and the pupil position is reflected or transmitted by the light from the eyeball. You may make it lead to a detection means or an imaging means. Further, the polarizing beam splitter disposed in front of the eyeball transmits or reflects the image light toward the eyeball and guides the light, and reflects or transmits the light from the eyeball and guides the light to the pupil position detecting means or the imaging means. You may.

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a retinal projection display according to an embodiment of the present invention will be described with reference to FIGS.

FIG. 1 shows a retinal projection display 1 and how the emitted image light is guided to an eyeball A. The retinal projection display 1 includes a point light source group 4, a lens 3 for condensing light emitted from the point light source group 4 on a pupil B of an observer, and a liquid crystal display panel 2 arranged on the light condensing path. A half mirror 5 disposed between the liquid crystal display panel 2 and the eyeball A; a camera 6;
And comprising.

The point light source group 4 is formed by arranging a plurality of point light sources, for example, 5 × 5 elements in a total of 25 in a plane, and any one point light source is controlled by the lighting control unit 7. To be lit. As the point light source, for example, an LED or a semiconductor laser can be used.

The half mirror 5 transmits the image light emitted from the liquid crystal display panel 2 and guides the light reflected by the eyeball A toward the lens of the camera 6. In this embodiment, infrared rays are emitted from the camera 6 side, and the infrared rays reflected by the eyeball A are imaged. The half mirror 5 transmits visible light and reflects infrared rays. Excellent ones are used. In this case, a dichroic mirror may be used instead of the half mirror 5.

The camera 6 is provided with, for example, a CCD image pickup device, converts an eyeball image into a video signal, and supplies the video signal to the lighting control unit 7.

The lighting control section 7 determines the position of the pupil B based on the video signal, and performs control to turn on the point light source corresponding to the determined position. Since there is a difference between the pupil B in the eyeball A and the amount of infrared absorption in the surrounding area, the position of the pupil B can be determined from the difference in image luminance between the pupil B and the surrounding area.

In this configuration, as shown in FIG. 1A, assuming that the observer's eyeball A is facing the front,
The lighting control unit 7 detects that the pupil B exists at the center position based on the video signal, and turns on the point light source located at the center position in the point light source group 4. Then, as shown in FIG. 3B, when the observer's eyeball is turned upward, the lighting control unit 7 detects the upward movement of the pupil B based on the video signal, and responds accordingly. The point light source located below the center is turned on. With this lighting control, even if the observer moves the eyeball A, the image converging point can be moved to the inside of the pupil B (preferably the center), following the movement of the eyeball A. Note that the movement of the pupil B is が of its diameter.
Within this range, retinal projection can recognize an image without relying on the eye's accommodation function, so image recognition is possible even if the image focus point deviates from the center of the pupil. By performing control so that the point is always guided to the center of the pupil, it is possible to perform stable image recognition.

FIG. 2 shows a modification of the retinal projection display. This retinal projection display has a surface light source 1
0, a liquid crystal shutter 9, a lens 3 for condensing light emitted through the liquid crystal shutter 9 on a pupil B of an observer,
The liquid crystal display panel 2 includes a liquid crystal display panel 2 disposed on the light condensing path, a half mirror 5 disposed between the liquid crystal display panel 2 and the eyeball A, a camera 6, and a shutter control unit 8.

The liquid crystal shutter 9 has a plurality of dot-shaped shutter portions, for example, in a horizontal and vertical plane, and any one dot-shaped shutter portion is opened by the control of the shutter control portion 8. It has become. Accordingly, light is emitted from any one point of the surface light source 10, and the movement of the point light source is realized. The shutter control unit 7 determines the position of the pupil B based on the video signal, and performs control to open the point-like shutter corresponding to the determined position.

In this configuration, as shown in FIG. 2A, assuming that the eyeball A for observation is facing the front,
The shutter control unit 8 detects that the pupil B exists at the center position based on the video signal, and opens the dot-shaped shutter unit at the center position of the liquid crystal shutter 9. Then, as shown in FIG. 3B, when the observer's eyeball is turned upward, the shutter control unit 8 detects the upward movement of the pupil B based on the video signal, and responds accordingly. The point-like shutter portion located below the center is opened. With this shutter control, even if the observer moves the eyeball A, the image converging point can be moved to the pupil B (preferably the center) following the movement of the eyeball A.

FIG. 3 shows a modification of the retinal projection display. This retinal projection display has a point light source 1
2, an actuator 13, a lens 3 for condensing light emitted from the point light source 12 on the pupil B of the observer, a liquid crystal display panel 2 disposed on the light condensing path, the liquid crystal display panel 2, and an eyeball. Half mirror 5 placed between A
, A camera 6, and an actuator control unit 11.

As the point light source 12, for example, an LED or a semiconductor laser can be used. The actuator 13 may have various configurations such as a combination of a micro rotary motor and a gear or a rack, or a combination of a member that slides in the X and Y directions and a linear motor. The actuator control unit 11 determines the position of the pupil B based on the video signal, and performs control to move the point light source 12 in accordance with the determined position.

In such a configuration, as shown in FIG. 2A, assuming that the eyeball A of the observer is facing forward,
The actuator control unit 11 determines the pupil B based on the video signal.
Is detected at the center position, the actuator 13 is driven, and control for bringing the point light source 12 to the center is performed. Then, as shown in FIG. 3B, when the observer's eyeball is turned upward, the actuator control unit 11 detects the upward movement of the pupil B based on the video signal, and responds accordingly. The point light source 12 is brought below the center. With this shutter control, even if the observer moves the eyeball A, the image converging point can be moved to the pupil B (preferably the center) following the movement of the eyeball A.

FIG. 4 shows a modification of the retinal projection display. The retinal projection display includes a display 15 serving as a light source, a lens 3 for condensing light emitted from the display 15 on a pupil B of an observer, and a liquid crystal display panel 2 disposed on the converging path. A half mirror 5, a camera 6, and a display controller 14 are provided between the liquid crystal display panel 2 and the eyeball A.

As the display 15, a CRT, EL, etc.
A display panel, a liquid crystal display panel, or the like can be used. When a liquid crystal display panel is used, the polarization direction is considered in relation to the liquid crystal display panel 2.

The display controller 14 processes the video signal from the camera 6 and supplies the processed video signal to the display 15. The above processing includes signal processing for setting the imaging pupil portion to a point-like white and setting the other portions to black, and processing for inverting the image vertically, horizontally, and horizontally. By this processing, as shown in FIG. 7A, assuming that the eyeball A of the observer is facing the front, a dotted white display portion on the display 15 is displayed at the center position of the display 15. Then, as shown in FIG. 3B, when the observer's eyeball is turned upward, the dotted white display portion on the display 15 moves below the center of the display 15. Even if the observer moves the eyeball A by the display (movement of the point light source) on the display 15, the image converging point is moved to the pupil B (preferably the center) following the movement of the eyeball A. Can be.

FIG. 5 shows a modification of the retinal projection display. This retinal projection display has a surface light source 1
0, a liquid crystal display panel 2 arranged on the light emitting side of the surface light source 10, a pinhole moving plate 23 provided in close proximity to the eyeball A of the observer, and the pinhole moving plate 23 and the liquid crystal display panel. 2, a polarization beam splitter 24, a camera 6, and a pinhole controller 22. The observer displays the image displayed on the liquid crystal display panel 2 through the pinhole formed on the pinhole moving plate 23.
By guiding to the pupil B through a, an image can be observed regardless of the accommodation function of the eyes.

As shown in FIG. 6, the pinhole moving plate 23 has a structure in which a polarizing plate 23b is provided only on one side of a liquid crystal panel 23a. The polarizing plate 23b has a transmission axis for transmitting s-polarized light, and the liquid crystal panel 23a rotates incident polarized light by 90 ° in an energized region, and passes incident polarized light as it is in a non-energized region. The energized area becomes the pinhole 23a, and the pinhole 23a moves by changing the energized location.

The polarizing beam splitter 24 transmits p-polarized light and reflects s-polarized light. The liquid crystal display panel 2 emits p-polarized image light. The p-polarized image light emitted from the liquid crystal display panel 2 passes through the polarization beam splitter 24 and reaches the pinhole moving plate 23. In the energized region of the pinhole moving plate 23, the incident polarized light is rotated by 90 ° to become s-polarized image light, so that the image light passing through the energized region (pinhole) is guided to the pupil B. On the other hand, among infrared rays emitted from the camera 6, the s-polarized light is reflected by the polarization beam splitter 24, passes through the non-energized region, passes through the polarizing plate 23b with the same polarized light, is reflected on the eyeball A, and is de-energized again. Since the light passes through the region and remains s-polarized light, the light is reflected by the polarizing beam splitter 24 and guided to the camera 6. Thereby, it is possible to perform image addition to the eyeball A and detection of the pupil position of the eyeball.

The pinhole controller 22 determines the position of the pupil B based on the video signal output from the camera 6, and energizes an electrode at a predetermined position of the pinhole moving plate 23 corresponding to the determined position. To form a pinhole 23a.

In this configuration, as shown in FIG. 5A, assuming that the eyeball A of the observer is facing the front, the pinhole control unit 22 has the pupil B at the center position based on the video signal. Is detected, and the pinhole moving plate 23 is detected.
The pinhole 23a is formed at the center position in the above. Then, as shown in FIG. 5B, if the eyeball of the observer is turned upward, the pinhole moving plate 23 detects the upward movement of the pupil B based on the video signal, and responds to this. To form a pinhole 23a below the center. With this pinhole movement control, even if the observer moves the eyeball A, the image converging point can be moved to the pupil B (preferably the center) following the movement of the eyeball A.

Incidentally, the pinhole can be moved by moving the plate having the pinhole formed thereon by an actuator. In addition, the polarization beam splitter 2
A half mirror can be used instead of 4. Also,
1 to 4, a polarization beam splitter can be used instead of the half mirror.

The retinal projection display described above can be configured as a head-mounted type, a helmet type or a glasses type. In addition to the liquid crystal display panel, other transmissive video display panels, reflective liquid crystal display panels, and other video display panels (DMD: digital micromirror device, etc.) can be used. Although the camera 6 for detecting the pupil position of the observer is provided, the pupil position may be detected by detecting the potential of the muscle that moves the eyeball. Further, a retinal projection display may be provided for two eyes, and further, in this binocular configuration, left and right images having binocular parallax may be displayed on each.

[0034]

As described above, according to the present invention, in a retinal projection type display that allows an observer to recognize an image without relying on the function of adjusting the eyes, the image is obtained even if the observer moves his or her eyes. Is observed.

[Brief description of the drawings]

FIG. 1 is a diagram showing a retinal projection display according to an embodiment of the present invention, wherein FIG. 1 (a) shows how an image is guided in a state where a pupil of an observer is facing forward; (B)
Shows how an image is guided when the pupil of the observer faces upward.

FIG. 2 is a view showing a modification of the retinal projection display according to the embodiment of the present invention, and FIG. 2 (a) shows how an image is guided in a state where the pupil of the observer is facing forward. FIG. 2B shows how an image is guided when the pupil of the observer faces upward.

FIG. 3 is a diagram showing a modification of the retinal projection display according to the embodiment of the present invention, and FIG. 3 (a) shows how an image is guided in a state where the pupil of the observer is facing forward. FIG. 2B shows how an image is guided when the pupil of the observer faces upward.

FIG. 4 is a view showing a modification of the retinal projection display according to the embodiment of the present invention, and FIG. 4 (a) shows how an image is guided in a state where the pupil of the observer is facing forward. FIG. 2B shows how an image is guided when the pupil of the observer faces upward.

FIG. 5 is a view showing a modification of the retinal projection display according to the embodiment of the present invention, and FIG. 5 (a) shows how an image is guided in a state where the pupil of the observer is facing forward. FIG. 2B shows how an image is guided when the pupil of the observer faces upward.

FIG. 6 is an explanatory diagram illustrating a polarization relationship between image light and detection light in the configuration of FIG. 5;

FIG. 7 is an explanatory view showing a conventional retinal projection display.

[Explanation of symbols]

 Reference Signs List 1 retinal projection display 2 liquid crystal display panel 3 lens 4 light source group 5 half mirror 6 camera 7 lighting control unit 8 shutter control unit 9 liquid crystal shutter 10 surface light source 11 actuator control unit 12 point light source 13 actuator 14 display control unit 15 display 21 retina Projection display 22 Pinhole controller 23 Pinhole moving plate 24 Polarizing beam splitter

Claims (10)

[Claims] 1. A retinal projection display for directly projecting an image on a retina through a pupil of an observer, a pupil position detecting means for detecting a pupil position of the observer, a light source capable of moving a point-like light emission position, Control means for moving the point-like light emission position based on pupil position detection such that a focal point of image light is formed at the pupil position of the retinal projection display. 2. The retinal projection display according to claim 1, wherein the light source comprises a plurality of point light sources, and the control means selectively turns on the point light sources. Type display. 3. The retinal projection display according to claim 1, wherein the light source comprises a surface light source and shutter means for forming a point light transmitting portion at an arbitrary position, and the control means comprises a point light source of the shutter means. A retinal projection display characterized by moving a light transmission position. 4. The retinal projection display according to claim 1, wherein the light source comprises one point light source and an actuator for moving the point light source, and the control means controls the actuator. Type display. 5. A retinal projection display for directly projecting an image on the retina through a pupil of an observer, an imager for imaging an eyeball of the observer, an image display, and a video signal from the imager. Control means for causing the video display means to function as a moving light source. 6. A retinal projection display for directly projecting an image on a retina through an observer's pupil, wherein a pupil position detecting means for detecting an observer's pupil position and a pinhole can be moved close to the observer's eyeball. 1. A retinal projection display comprising: a pinhole movement forming unit that can be formed in the camera; and a control unit that moves the pinhole to the pupil position of the observer based on pupil position detection. 7. The retinal projection display according to claim 6, wherein the pinhole movement forming means comprises shutter means capable of forming a point light transmitting portion at an arbitrary position, and the control means comprises a point light of the shutter means. A retinal projection display characterized by moving a transmission position. 8. The retinal projection display according to claim 6, wherein the pinhole movement forming means comprises a movable pinhole plate and an actuator for moving the pinhole plate, and the control means controls the actuator. A retinal projection display characterized by controlling. 9. The retinal projection display according to claim 1, wherein the image light is transmitted or reflected toward an eyeball by a half mirror or a dichroic mirror disposed in front of the eyeball. A retinal projection display that guides and reflects or transmits light from an eyeball to a pupil position detection unit or an imaging unit. 10. The retinal projection display according to any one of claims 1 to 8, wherein a polarizing beam splitter disposed in front of the eyeball transmits or reflects image light toward the eyeball and guides it. A retinal projection display for reflecting or transmitting light from an eyeball and guiding the light to a pupil position detecting means or an imaging means.