WO1995021440A1

WO1995021440A1 - Depixelated visual display

Info

Publication number: WO1995021440A1
Application number: PCT/US1994/001390
Authority: WO
Inventors: Richard Dennis Rallison
Original assignee: Virtual I/O, Inc.
Priority date: 1994-02-07
Filing date: 1994-02-07
Publication date: 1995-08-10
Also published as: AU7392794A

Abstract

The depixelated visual display relates to visual displays which combine generated images with the view of the environment surrounding a user and transmit such combined visual information to the eye position of the user. Image generators, such as a cathode ray tube and a liquid crystal display, produce an image composed of a multiplicity of pixels in a plane. The dark area between pixels becomes more prominent in a visual display. To eliminate this dark area while conserving photons, the depixelated visual display has a crossed diffraction grating (1) placed parallel to the pixel plane of the image generator on the side from which light exits the pixels. Prior techniques for depixelation had not controlled the direction into which image light is diffracted, as does the crossed diffraction grating (1), and, unlike the crossed diffraction grating (1), required sources of light which create heat that can be detrimental to a liquid crystal display.

Description

DESCRIPTION DEPIXELATED VISUAL DISPLAY

TECHNICAL FIELD This invention relates to visual displays which combine generated images with the view of the environment surrounding a user and transmit such combined visual information to the eye position of the user.

BACKGROUND ART

It is often desirable to provide visual information to a living being, usually a person.

Frequently one wishes to superimpose such visual information upon the being's view of the real world.

Such a display requires, in a form known as a folded catadioptric display, an image generator; a beam splitter, which receives the image light from the image generator and ε.nds a fraction, designated the reflected fraction, of such image light to a reflective combiner that both allows light from the real world to pass through such combiner and reflects the image light such that both the real-world light and the image light are transmitted to the eye of the user through the beam splitter.

The beam splitter will transmit a fraction, designated the transmitted fraction, of the image light reflected from the collimator-combiner. Of course, only a fraction of the real-world light is also transmitted by the beam splitter.

To correct for aberrations and distortions produced by the beam splitter and the combiner, a correction lens is often placed in the optical path between the image generator and the beam splitter. Another beneficial process in a visual display is depixelation of the image.

The image generators that are well known in the art, such as a cathode ray tube and a liquid crystal display, produce an image composed of a multiplicity of pixels. Each pixel is a point of light. Since adjacent pixels do not contact each other, every pixel is surrounded by a dark area. The combiner magnifies the image, causing the dark area to be perceptible and thereby detracting from the accurate portrayal of the image one wishes to depict.

Depixelation traditionally comprises blurring the edges of the pixels without losing resolution or contrast. In fact, perceived resolution - although necessarily somewhat subjective - appears to be increased by depixelation. And, in the case of triads of colored pixels, depixelation blends the colors together.

In United States application serial number 07/832,237, the inventor achieves depixelation of a liquid crystal display through the placement of a fiber optic faceplate between the liquid crystal display and the beam splitter, a fold mirror in that case, in such a manner that the input numerical aperture of the faceplate is approximately equal to twice the pixel size of the liquid crystal display divided by the distance between the fiber optic faceplate and the pixels.

A second process for achieving depixelation with a fiber optic faceplate involves simply placing the source of light for the liquid crystal display near the rear of the pixel plane of the liquid crystal display. Since the input surface of the faceplate is a finite distance in front of the pixel plane of the liquid crystal display, the image of each pixel on the input surface of the faceplate is not only enlarged, but also covers a greater portion of the total picture, correspondingly decreasing the amount of dark area surrounding each pixel. Also, the small size of each pixel causes considerable diffraction of the light which passes the edge of the pixel .

A common and third technique for depixelation is locating a weak diffuser plate a short distance from the pixels, in the direction of the beam splitter.

DISCLOSURE OF INVENTION The diffusion produced by the weak diffuser plate is, however, in random directions, as is the diffraction associated with the edge of the pixels, which was discussed above with respect to the second technique for depixelation.

And when a fiber optic faceplate is utilized, a diffuse source of light cannot be employed because it would create an image of each pixel on the input surface of the faceplate which would be excessively large. This forces the use of an incandescent lamp, which produces more heat; and heat can negatively affect liquid crystal displays.

The present invention introduces a new type of depixelator.

The inventive concept of this depixelator lies in the recognition that the desired goal of depixelation, i.e., elimination of the perceived dark area surrounding each pixel, can be accomplished with a more efficient use of photons if light can be diffracted in controlled directions, Moreover, since the technique, as described below, employs no fiber optic faceplate, a diffuse source of light can be used. Two examples of such a source are a glow lamp, which is a tiny fluorescent lamp that produces a nearly white spectrum while operating at nearly one thousand volts but consuming much less than one milliampere of current, and a woven fiber optic mat fed by a remote halogen lamp.

This controlled diffraction is accomplished by placing a crossed diffraction grating parallel to the pixel plane on the side from which light exits the pixels, i.e., in a folded catadioptric display, between the pixel plane, of the image generator, and the beam splitter. First order diffracted light produces eight images of a given pixel with the pixel, when viewed through the crossed grating, being in the center of the eight images. The second-order diffracted light creates sixteen images of the pixel which, when viewed through the crossed grating, are displaced farther from the pixel than are the first order images. The pixel appears in the center of these sixteen second-order images and is, thus, centered among the total twenty-four images.

The crossed diffraction grating, as its name suggests and as is well known in the art, is constructed to have a first spatial frequency in one direction and a second spatial frequency in the perpendicular direction. If the pixels are square, then the first and second spatial frequencies are made equal to one another. If the pixels are rectangular, the first and second spatial frequencies differ from one another.

Since the first-order images are the closest to the pixel, more than half the total light from the pixel goes into the first-order depixelation pattern. One fourth to one third of the light from the pixel goes into the second-order diffraction patter^; a lower amount of light is selected since the second- order images are farther from the pixel than are the first-order images. This is accomplished by adjusting the modulation depth of the crossed grating to fall within the range of eighty percent to one hundred twenty percent .

The crossed grating may be made as either a surface grating or a volume holographic grating. Preferably, the grating is a sinusoidal or slightly squared grating so that the power is concentrated in the +1 and -1 orders and their products, rather than in higher even orders or single-sided orders that may result from sawtooth or triangular gratings.

By selecting the proper spatial frequency for the grating, the angular distribution will be such that the overall image of a square pixel will be a square with the pixel at its center, eight squares composed of first-order images surrounding the pixel, and sixteen squares composed of second-order images surrounding the inner eight first-order images such that there is only a minimal gap between, and no overlap with, any of the squares generating the overall image.

If the pixel is rectangular, then the overall image, as well as the first-order and second-order images of which it is composed, is rectangular.

To accomplish this effect, the spatial frequency multiplied by the shortest wavelength of the image light that is used should approximately equal the center-to-center distance between adjacent pixels in the pixel plane of the image generator divided by twice the optical distance between the crossed diffraction grating and the pixel plane.

Since the grating is aligned parallel to the pixel plane, there will be one center-to-center distance measured perpendicularly to the tops and bottoms of the pixels and a second center-to-center distance measured perpendicularly to the sides of the pixels. This yields the first and second spatial frequencies discussed above.

Of course, the overall image thus generated of one pixel overlaps the overall image thus produced of an adjacent pixel, thereby achieving the desired depixelation.

If the folded catadioptric display incorporates a corrective lens, such a lens is a piano convex lens with the flat surface oriented toward the pixel plane of the image generator. The crossed diffraction grating can optionally be formed on the flat surface of the correction lens.

Similarly, some folded catadioptric displays utilize one or more wave plates between the image generator and the beam splitter to change the polarization of the light. In such a case, the crossed diffraction grating can be produced on the surface of the closest wave plate to the image generator that is directed toward the pixel plane of the image generator.

The technique of utilizing a crossed diffraction grating for depixelation may be utilized with any liquid crystal display or, since they have shadow masks, multi-color cathode ray tube. BRIEF DESCRIPTION OF DRAWINGS

Figure 1 portrays the depixelated visual display employing the crossed diffraction grating.

Figure 2 illustrates a depixelated visual display using the crossed diffraction grating and including a correction lens.

Figure 3 shows the same depixelated visual display as Figure 2 except that the crossed diffraction grating is attached to the correction lens.

BEST MODE FOR CARRYING OUT THE INVENTION The depixelated visual display comprises, as shown in Figure 1, a crossed diffraction grating (1) located parallel to the pixel plane of an image generator to receive, diffract, s J. transmit, and thereby depixelate, the image ligrvε from an image generator (2) ; a fold mirror (3) positioned to receive the depixelated image light from the crossed diffraction grating (1) and to reflect such depixelated image light; and a reflective combiner (4) situated to receive the depixelated image light from the fold mirror (3) , reflect such depixelated image light, combine such depixelated image light with light rays transmitted through the reflective combiner (4) from the surrounding environment, and transmit the combined environmental light rays and depixelated image light through the fold mirror (3) to the eye position (5) of the user. The optical path (6) of the image light is depicted in Figure 1.

Preferably, the spatial frequency of the crossed diffraction grating (1) is constructed such that this spatial frequency multiplied by the shortest wavelength of the image light that is used approximately equals the center-to-center distance between adjacent pixels in the pixel plane of the image generator (2) divided by twice the optical distance between the crossed diffraction grating (1) and the pixel plane of the image generator (2) .

An optional mode, illustrated in Figure 2, includes a correction lens (7) placed between the crossed diffraction grating (1) and the fold mirror (3) , with its flat surface oriented toward the pixel plane of the image generator, for optically correcting the depixelated image light.

And, as portrayed in Figure 3, a further optional mode has the crossed diffraction grating (1) attached to the flat surface of the correction lens (7) , which flat surface is oriented toward the pixel plane of the image generator (2) .

For all modes it is, as discussed with respect to the mode shown in Figure 1, preferable to construct the crossed diffraction grating (1) so that the spatial frequency of the crossed diffraction grating (1) multiplied by the shortest wavelength of the image light that is used approximately equals the center-to- center distance between adjacent pixels in the pixel plane of the image generator (2) divided by twice the optical distance between the crossed diffraction grating (1) and the pixel plane of the image generator (2) .

Similarly, for all modes it is preferable that the modulation depth of the crossed diffraction grating (1) fall within the range of eighty percent to one hundred twenty percent and that the crossed diffraction grating (1) be sinusoidal or slightly squared. INDUSTRIAL APPLICABILITY

From the preceding it is obvious how the depixelated visual display is made.

Industrial uses of the depixelated visual display include, but are not necessarily limited to, providing a heads-up display or helmet-mounted display which enables a pilot or driver of a ground vehicle, such as military tank, to receive visual information about the pilot's plane or the driver's vehicle without looking away from the surrounding outside environment.

Claims

1. A depixelated visual display, which comprises:

a crossed diffraction grating located parallel to the pixel plane of an image generator to receive, diffract, and transmit, and thereby depixelate, the image light from an image generator;

a fold mirror positioned to receive the depixelated image light from the crossed diffraction grating and to reflect such depixelated image light; and

a reflective combiner situated to receive the depixelated image light from the fold mirror, reflect such depixelated image light, combine such depixelated image light with light rays transmitted through the reflective combiner from the surrounding environment, and transmit the combined environmental light rays and depixelated image light through the fold mirror to the eye position of the user.

2. The depixelated visual display as recited in claim 1, wherein:

the spatial frequency of the crossed diffraction grating multiplied by the shortest wavelength of the image light that is used approximately equals the center-to-center distance between adjacent pixels in the pixel plane of the image generator divided by twice the optical distance between the crossed diffraction grating and the pixel plane of the image generator.

3. A depixelated visual display, which comprises :

a piano convex correction lens placed, with its flat surface oriented toward the pixel plane of the image generator, to receive, optically to correct, and to transmit the depixelated image light from the crossed diffraction grating;

a fold mirror positioned to receive the depixelated image light from the correction lens and to reflect such depixelated image light; and

4. The depixelated visual display as recited in claim 3, wherein:

the crossed diffraction grating is attached to the flat surface of the correction lens.

5. The depixelated visual display as recited in claim 3, wherein: the spatial frequency of the crossed diffraction grating multiplied by the shortest wavelength of the image light that is used approximately equals the center-to-center distance between adjacent pixels in the pixel plane of the image generator divided by twice the optical distance between the crossed diffraction grating and the pixel plane of the image generator.

6. The depixelated visual display as recited in claim 5, wherein:

7. A process for producing a depixelated visual display image, which comprises:

locating a crossed diffraction grating parallel to the pixel plane of an image generator to receive, diffract, and transmit, and thereby depixelate, the image light from an image generator;

positioning a fold mirror to receive the depixelated image light from the crossed diffraction grating and to reflect such depixelated image light; and

situating a reflective combiner to receive the depixelated image light from the fold mirror, reflect such depixelated image light, combine such depixelated image light with light rays transmitted through the reflective combiner from the surrounding environment, and transmit the combined environmental light rays and depixelated image light through the fold mirror to the eye position of the user.

8. The process for producing a depixelated visual display image as recited in claim 1, further comprising:

making the spatial frequency of the crossed diffraction grating multiplied by the shortest wavelength of the image light that is used approximately equal to the center-to-center distance between adjacent pixels in the pixel plane of the image generator divided by twice the optical distance between the crossed diffraction grating and the pixel plane of the image generator.

9. A process for producing a depixelated visual display image, which comprises:

placing a piano convex correction lens, with its flat surface oriented toward the pixel plane of the image generator, to receive, optically to correct, and to transmit the depixelated image light from the crossed diffraction grating;

positioning a fold mirror to receive the depixelated image light from the correction lens and to reflect such depixelated image light; and situating a reflective combiner to receive the depixelated image light from the fold mirror, reflect such depixelated image light, combine such depixelated image light with light rays transmitted through the reflective combiner from the surrounding environment, and transmit the combined environmental light rays and depixelated image light through the fold mirror to the eye position of the user.

10. The process for producing a depixelated visual display image as recited in claim 9, further comprising:

attaching the crossed diffraction grating to the flat surface of the correction lens.

11. The process for producing a depixelated visual display image as recited in claim 9, further comprising:

12. The process for producing a depixelated visual display image as recited in claim 11, further comprising: