US20230017615A1 - Waveguide illuminator with optical interference mitigation - Google Patents
Waveguide illuminator with optical interference mitigation Download PDFInfo
- Publication number
- US20230017615A1 US20230017615A1 US17/556,895 US202117556895A US2023017615A1 US 20230017615 A1 US20230017615 A1 US 20230017615A1 US 202117556895 A US202117556895 A US 202117556895A US 2023017615 A1 US2023017615 A1 US 2023017615A1
- Authority
- US
- United States
- Prior art keywords
- waveguide
- sub
- array
- coupled
- beams
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003287 optical effect Effects 0.000 title abstract description 24
- 230000000116 mitigating effect Effects 0.000 title description 2
- 238000003491 array Methods 0.000 claims abstract description 18
- 239000004065 semiconductor Substances 0.000 claims description 14
- 239000004973 liquid crystal related substance Substances 0.000 claims description 6
- 230000000295 complement effect Effects 0.000 claims description 5
- QNRATNLHPGXHMA-XZHTYLCXSA-N (r)-(6-ethoxyquinolin-4-yl)-[(2s,4s,5r)-5-ethyl-1-azabicyclo[2.2.2]octan-2-yl]methanol;hydrochloride Chemical compound Cl.C([C@H]([C@H](C1)CC)C2)CN1[C@@H]2[C@H](O)C1=CC=NC2=CC=C(OCC)C=C21 QNRATNLHPGXHMA-XZHTYLCXSA-N 0.000 claims description 4
- 230000010287 polarization Effects 0.000 abstract description 29
- 238000010168 coupling process Methods 0.000 abstract description 6
- 238000005859 coupling reaction Methods 0.000 abstract description 6
- 210000001525 retina Anatomy 0.000 description 8
- 230000007261 regionalization Effects 0.000 description 7
- 239000000758 substrate Substances 0.000 description 7
- 230000000007 visual effect Effects 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 6
- 230000001427 coherent effect Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 230000001902 propagating effect Effects 0.000 description 5
- 238000005286 illumination Methods 0.000 description 4
- 230000003190 augmentative effect Effects 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 238000000034 method Methods 0.000 description 3
- 230000008093 supporting effect Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 210000004087 cornea Anatomy 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000001976 improved effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 210000001747 pupil Anatomy 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000001629 suppression Effects 0.000 description 2
- 230000001154 acute effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 230000002939 deleterious effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000000295 emission spectrum Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000000392 somatic effect Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0033—Means for improving the coupling-out of light from the light guide
- G02B6/0035—Means for improving the coupling-out of light from the light guide provided on the surface of the light guide or in the bulk of it
- G02B6/0036—2-D arrangement of prisms, protrusions, indentations or roughened surfaces
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0081—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. enlarging, the entrance or exit pupil
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/09—Beam shaping, e.g. changing the cross-sectional area, not otherwise provided for
- G02B27/0938—Using specific optical elements
- G02B27/0944—Diffractive optical elements, e.g. gratings, holograms
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/09—Beam shaping, e.g. changing the cross-sectional area, not otherwise provided for
- G02B27/0938—Using specific optical elements
- G02B27/0994—Fibers, light pipes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/106—Beam splitting or combining systems for splitting or combining a plurality of identical beams or images, e.g. image replication
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/18—Diffraction gratings
- G02B5/1814—Diffraction gratings structurally combined with one or more further optical elements, e.g. lenses, mirrors, prisms or other diffraction gratings
- G02B5/1819—Plural gratings positioned on the same surface, e.g. array of gratings
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/30—Polarising elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/30—Polarising elements
- G02B5/3025—Polarisers, i.e. arrangements capable of producing a definite output polarisation state from an unpolarised input state
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/30—Polarising elements
- G02B5/3025—Polarisers, i.e. arrangements capable of producing a definite output polarisation state from an unpolarised input state
- G02B5/3033—Polarisers, i.e. arrangements capable of producing a definite output polarisation state from an unpolarised input state in the form of a thin sheet or foil, e.g. Polaroid
- G02B5/3041—Polarisers, i.e. arrangements capable of producing a definite output polarisation state from an unpolarised input state in the form of a thin sheet or foil, e.g. Polaroid comprising multiple thin layers, e.g. multilayer stacks
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0013—Means for improving the coupling-in of light from the light source into the light guide
- G02B6/0023—Means for improving the coupling-in of light from the light source into the light guide provided by one optical element, or plurality thereof, placed between the light guide and the light source, or around the light source
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0033—Means for improving the coupling-out of light from the light guide
- G02B6/005—Means for improving the coupling-out of light from the light guide provided by one optical element, or plurality thereof, placed on the light output side of the light guide
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0033—Means for improving the coupling-out of light from the light guide
- G02B6/005—Means for improving the coupling-out of light from the light guide provided by one optical element, or plurality thereof, placed on the light output side of the light guide
- G02B6/0055—Reflecting element, sheet or layer
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0033—Means for improving the coupling-out of light from the light guide
- G02B6/0058—Means for improving the coupling-out of light from the light guide varying in density, size, shape or depth along the light guide
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0066—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form characterised by the light source being coupled to the light guide
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0075—Arrangements of multiple light guides
- G02B6/0078—Side-by-side arrangements, e.g. for large area displays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/10—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings of the optical waveguide type
- G02B6/12—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings of the optical waveguide type of the integrated circuit kind
- G02B6/12004—Combinations of two or more optical elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/10—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings of the optical waveguide type
- G02B6/12—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings of the optical waveguide type of the integrated circuit kind
- G02B6/12007—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings of the optical waveguide type of the integrated circuit kind forming wavelength selective elements, e.g. multiplexer, demultiplexer
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/10—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings of the optical waveguide type
- G02B6/12—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings of the optical waveguide type of the integrated circuit kind
- G02B6/122—Basic optical elements, e.g. light-guiding paths
- G02B6/124—Geodesic lenses or integrated gratings
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/10—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings of the optical waveguide type
- G02B6/12—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings of the optical waveguide type of the integrated circuit kind
- G02B6/122—Basic optical elements, e.g. light-guiding paths
- G02B6/125—Bends, branchings or intersections
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/24—Coupling light guides
- G02B6/26—Optical coupling means
- G02B6/28—Optical coupling means having data bus means, i.e. plural waveguides interconnected and providing an inherently bidirectional system by mixing and splitting signals
- G02B6/2804—Optical coupling means having data bus means, i.e. plural waveguides interconnected and providing an inherently bidirectional system by mixing and splitting signals forming multipart couplers without wavelength selective elements, e.g. "T" couplers, star couplers
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/18—Diffraction gratings
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0033—Means for improving the coupling-out of light from the light guide
- G02B6/0058—Means for improving the coupling-out of light from the light guide varying in density, size, shape or depth along the light guide
- G02B6/0061—Means for improving the coupling-out of light from the light guide varying in density, size, shape or depth along the light guide to provide homogeneous light output intensity
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/24—Coupling light guides
- G02B6/26—Optical coupling means
- G02B6/34—Optical coupling means utilising prism or grating
Definitions
- the present disclosure relates to illuminators, visual display devices, and related components and modules.
- Visual displays provide information to viewer(s) including still images, video, data, etc. Visual displays have applications in diverse fields including entertainment, education, engineering, science, professional training, advertising, to name just a few examples. Some visual displays such as TV sets display images to several users, and some visual display systems such s near-eye displays (NEDs) are intended for individual users.
- NEDs near-eye displays
- An artificial reality system generally includes an NED (e.g., a headset or a pair of glasses) configured to present content to a user.
- the near-eye display may display virtual objects or combine images of real objects with virtual objects, as in virtual reality (VR), augmented reality (AR), or mixed reality (MR) applications.
- VR virtual reality
- AR augmented reality
- MR mixed reality
- a user may view images of virtual objects (e.g., computer-generated images (CGIs)) superimposed with the surrounding environment by seeing through a “combiner” component.
- CGIs computer-generated images
- the combiner of a wearable display is typically transparent to external light but includes some light routing optic to direct the display light into the user's field of view.
- head-mounted display devices can benefit from a compact and efficient configuration, including efficient light sources and illuminators providing illumination of a display panel, high-throughput ocular lenses and other optical elements in the image forming train.
- FIG. 1 is a schematic plan view of a waveguide illuminator of the present disclosure
- FIG. 2 is a schematic view of a display device using the waveguide illuminator of FIG. 1 ;
- FIG. 3 is a zoom-in view of the display device of FIG. 2 showing optical interference between neighboring pixels on the eye's retina;
- FIG. 4 A is a schematic plan view of a waveguide illuminator embodiment using two light sources and interleaved waveguides
- FIG. 4 B is a schematic plan view of a waveguide illuminator embodiment using a light source, a splitter, and interleaved waveguides;
- FIG. 5 is a magnified frontal view of an embodiment of the display device of FIG. 2 showing relative configuration of grating out-couplers and display panel pixels;
- FIG. 6 is a plan view of a spatially variant polarizer for a waveguide illuminator of this disclosure, the spatially varying polarizer including a checkerboard pattern of orthogonally oriented linear polarizer segments;
- FIGS. 7 A and 7 B are plan and side views, respectively, of a spatially variant polarizer embodiment for a waveguide illuminator of this disclosure, including a linear polarizer followed by a checkerboard pattern of waveplates;
- FIG. 8 is a three-dimensional diagram illustrating the principle of interleaved sub-images for interference reduction
- FIG. 9 is a view of an augmented reality (AR) display of this disclosure having a form factor of a pair of eyeglasses.
- AR augmented reality
- FIG. 10 is a three-dimensional view of a head-mounted display (HMD) of this disclosure.
- HMD head-mounted display
- the efficiency of light utilization depends on a ratio of a geometrical area occupied by pixels to a total area of the display panel.
- the ratio can be lower than 50%.
- the efficient backlight utilization can be further hindered by color filters on the display panel which on average transmit no more than 30% of incoming light.
- LC liquid crystal
- light utilization and wall plug efficiency of a backlit display may be improved by providing a waveguide illuminator including an array of out-couplers aligned with pixels of the display panel.
- the illuminator emits light of primary colors, e.g. red, green, and blue
- the color of the illuminating light may be matched to the color filters, or the color filters may be omitted altogether.
- the polarization of the emitted light may be matched to a pre-defined input polarization state.
- Matching the spatial distribution, transmission wavelength, and/or the transmitted polarization characteristics of the pixels of the display panel enables one to considerably improve the useful portion of display light that is not absorbed or reflected by the display panel on its way to the eyes of the viewer, and consequently to considerably improve the display's wall plug efficiency.
- Singlemode or few-mode waveguides e.g. ridge waveguides with up to 12 modes of propagation
- laser illumination allow for efficient control of such light properties as color and directivity.
- the output can be diffraction-limited and highly directional.
- Single mode propagation also allows one to out-couple light in specific points on the waveguide and incorporate focusing pixels that can focus light into the pixels of a display panel while avoiding scattering in inter-pixel areas.
- the narrow spectrum of laser illumination enables large color gamut displays.
- single mode waveguides may preserve polarization, which results in highly polarized output from the backlight unit without the need of a polarizer.
- illuminators based on single-mode waveguides may be prone to speckle pattern formation caused by optical interference between different sub-beams of out-coupled coherent light.
- effects of speckle formation may be lessened by making sure that neighboring out-coupled sub-beams of illuminating light do not interfere with one another on a retina of a user's eye.
- a waveguide illuminator comprising first and second waveguide splitters configured to receive first and second light beams, respectively, for splitting the first and second light beams into first and second pluralities of sub-beams, respectively.
- First and second waveguide arrays are coupled to the first and second waveguide splitters, respectively, and configured to propagate the sub-beams of the first and second pluralities of sub-beams, respectively.
- Waveguides of the first and second waveguide arrays are interleaved and run parallel to each other.
- the waveguide illuminator includes an array of rows of out-couplers.
- Each row of out-couplers of the array is coupled to a waveguide of the first or second waveguide array along a length of the waveguide for forming a two-dimensional array of interleaved out-coupled sub-beam portions of the first and second pluralities of sub-beams.
- first and second waveguide arrays are coupled to the first and second waveguide splitters at opposed ends of the first and second waveguide arrays, such that the sub-beams of the first and second pluralities of sub-beams counter-propagate in the respective waveguide arrays.
- Out-couplers of neighboring rows of out-couplers may be offset relative to one another in a direction along the waveguides of the first and second waveguide arrays, to form a rhombic array of out-couplers.
- the waveguide illuminator may further include first and second semiconductor light sources coupled to the first and second waveguide splitters, respectively, for providing the first and second light beams to the first and second waveguide splitters.
- the first and second semiconductor light sources may be configured to emit light at different wavelengths of a same color channel.
- the first and second semiconductor light sources may include laser diodes at different emission wavelengths.
- a controller may be coupled to the first and second semiconductor light sources. The controller may be configured to operate the first and second semiconductor light sources alternately in a time-sequential manner.
- a display device comprising a display panel comprising a two-dimensional pixel array, a waveguide illuminator of this disclosure, and a spatially variant polarizer.
- the waveguide illuminator is configured to illuminate the display panel.
- the waveguide illuminator may include a waveguide splitter configured to receive and split a light beam into a plurality of sub-beams; a waveguide array coupled to the waveguide splitter and configured to propagate the sub-beams therein, waveguides of the waveguide array running parallel to each other; and an array of rows of out-couplers, each row of out-couplers of the array being coupled to a waveguide of the waveguide array along a length of the waveguide for forming a two-dimensional array of out-coupled sub-beam portions.
- the spatially variant polarizer may be disposed downstream of the display panel and configured to propagate out-coupled sub-beam portions of a first polarization state and to block out-coupled neighboring sub-beam portions of a second, orthogonal polarization state.
- the spatially variant polarizer may include laterally joined linear polarizer segments of orthogonal orientations of polarization transmission axes.
- the linear polarizer segments of a same direction of polarization may be arranged in a checkerboard pattern.
- the spatially variant polarizer may include a linear polarizer and a spatially variant waveplate downstream of the linear polarizer, the spatially variant waveplate comprising laterally joined waveplate segments of different direction of optic axis arranged in a checkerboard pattern.
- the waveplate segments of a same direction of optic axis may be arranged in a checkerboard pattern.
- a display device comprising a display panel and a waveguide illuminator of this disclosure.
- the display panel may include a two-dimensional pixel array, e.g. an array of transmissive light valves, which may be formed in a liquid crystal layer.
- the waveguide illuminator may include a waveguide splitter configured to receive and split a light beam into a plurality of sub-beams; a waveguide array coupled to the waveguide splitter and configured to propagate the sub-beams therein, waveguides of the waveguide array running parallel to each other; and an array of rows of out-couplers, each row of out-couplers of the array being coupled to a waveguide of the waveguide array along a length of the waveguide for forming a two-dimensional array of out-coupled sub-beam portions corresponding to the two-dimensional pixel array of the display panel.
- the display device may further include a controller operably coupled to the display panel and configured to cause the display panel to display a plurality of sub-images in a time-sequential manner, the sub-images adding up to an image to be displayed to a user.
- Pixels of different sub-images of the plurality of sub-images may be interleaved with one another.
- pixels of different sub-images of the plurality of sub-images may be disposed in complementary checkerboard patterns.
- the plurality of sub-images may include first and second sub-images having interleaved pixels, such that each pixel of the first sub-image has at least two neighboring pixels of the second sub-image.
- Each pixel of the first sub-image may have at least three neighboring pixels of the second sub-image.
- a waveguide illuminator 100 includes a substrate 101 supporting an input waveguide 106 for guiding an input light beam 108 provided by a light source 110 , such as a laser source.
- a light source 110 such as a laser source.
- waveguide denotes a light guiding structure that bounds the light propagation in two dimensions, like a light wire, and guides the light in a single transversal mode, or in several transversal modes, e.g. up to 12 modes of propagation.
- a waveguide may be straight, curved, etc.
- One example of a linear waveguide is a ridge-type waveguide.
- the waveguide illuminator 100 may be implemented in a photonic integrated circuit (PIC).
- PIC photonic integrated circuit
- a waveguide splitter 112 is coupled to the input waveguide 106 .
- the function of the waveguide splitter 112 is to split the input light beam 108 into a plurality of sub-beams 114 .
- An array of waveguides 116 is coupled to the waveguide splitter 112 for guiding the sub-beams 114 in the waveguides 116 .
- the waveguides 116 run parallel to one another as illustrated.
- Each waveguide 116 is configured to guide one of the sub-beams 114 from the waveguide splitter 112 to an end 129 of the waveguide 116 .
- An array of rows 119 of out-couplers 120 is supported by the substrate 101 of the waveguide illuminator 100 .
- Each row 119 of the out-couplers 120 is coupled to one of the waveguides 116 along a length of the waveguide 116 , for out-coupling portions 122 of one of the sub-beams 114 propagating in the waveguide 116 .
- the portions 122 out-coupled by all rows 119 of the out-couplers 120 form a two-dimensional array of the sub-beam portions 122 out-coupled from the waveguide array and exiting at an angle, including an acute or straight angle, to the substrate 101 .
- X- and Y-pitch of the two-dimensional array of the sub-beam portions 122 may be selected to match X- and Y-pitch of a display panel illuminated by the waveguide illuminator 100 .
- a display device 200 includes the waveguide illuminator 100 of FIG. 1 , or any other waveguide illuminator disclosed herein.
- the waveguide illuminator 100 is coupled to a display panel 202 ( FIG. 2 ).
- a light source 201 e.g. a semiconductor light source at a wavelength of a color channel, may be optically coupled to the illuminator 100 for providing the light beam 108 to the illuminator 100 .
- the display panel 202 includes a two-dimensional array of display pixels 220 , e.g.
- locations and pitch of the display pixels 220 may be matched to locations and pitch of the array of out-couplers 120 , in both X- and Y-directions.
- a pitch of the display pixels 220 may be substantially equal to a pitch of the array of the out-couplers 120 .
- the display device 200 may further include a controller 250 operably coupled to the light source 201 and the display panel 202 for energizing the light source 201 while providing control signals for setting individual optical transmission values, or other properties such as polarization conversion properties, of the display pixels 220 .
- the display panel 202 may include a liquid crystal layer 204 , with the display pixels 220 configured to individually and controllably convert or tune a polarization state of the individual sub-beam portions 122 , e.g. rotate a linear polarization state.
- the light source 201 may be a polarized light source emitting linearly polarized light.
- a linear polarizer 228 may be provided to convert the polarization distribution of the sub-beam portions 122 imparted by the display pixels 220 into an optical power density distribution, or brightness distribution, representing an image to be displayed.
- a polarizer that converts the polarization distribution into an optical power density or brightness distribution is commonly termed analyzer.
- analyzer The liquid crystal pixels in combination with analyzer form the array of light valve pixels having controllable optical transmission.
- the image formed downstream of the linear polarizer 228 is in linear domain, where pixel coordinates of the image being displayed correspond to XY coordinates of the display pixels 220 .
- An ocular lens 230 may be used to convert the image in linear domain into an image in angular domain at an eyebox 226 for direct observation by an eye 280 .
- image in angular domain refers to an image where pixel coordinates of the image being displayed correspond to ray angles of the sub-beam portions 122 .
- the light source 201 may emit polarized light, and the waveguide illuminator 100 may preserve that state of polarization.
- the waveguide illuminator 100 may be made transparent to external light 214 .
- speckle pattern formation One potential issue associated with using coherent light sources to illuminate a display panel, e.g. the light source 201 illuminating the display panel 202 , is speckle pattern formation. Speckles may be observed by the eye 280 due to the coherent nature of the light source 201 .
- FIG. 3 illustrates origins of such a speckle pattern.
- FIG. 3 is a zoon-in of the display 200 of FIG. 2 with light paths 320 A, 320 B of neighboring sub-beam portions 122 propagated through neighboring display pixels 220 A, 220 B, redirected by the ocular lens 230 , and focused by a lens/cornea 380 of the eye 280 onto a retina 302 of the eye 280 . Due to the imperfect nature of the entire imaging train, including the ocular lens 230 and the eye lens/cornea 380 , images 328 A and 328 B of the neighboring display pixels 220 A and 220 B may overlap on the retina 302 somewhat.
- An optical interference pattern 300 may appear in an overlap area between the images 328 A and 328 B of the neighboring display pixels 220 A and 220 B.
- the optical interference pattern 300 will also occur between other neighboring pixel images, not shown for clarity.
- the end result of the interference pattern formation 300 is that the entire visible image is highly speckled, creating a distracting, unnatural look of the observed imagery.
- a waveguide illuminator 400 A is similar to the waveguide illuminator 100 of FIG. 1 , includes similar elements, may be implemented as a PIC, and may be used in the display device 200 of FIG. 2 . Similarly to the waveguide illuminator 100 , the waveguide illuminator 400 A of FIG.
- A includes a substrate 401 supporting a first input waveguide 406 for guiding a first input light beam 408 provided by a first light source 410 , e.g. a semiconductor light source such as a laser diode.
- a first waveguide splitter 412 is coupled to the first input waveguide 406 .
- the function of the first waveguide splitter 412 is to split the first input light beam 408 into a first plurality of sub-beams 414 .
- a first array of waveguides 416 is coupled to the first waveguide splitter 412 for propagating the sub-beams 414 in the waveguides 416 of the first array.
- the waveguides 416 run parallel to one another as illustrated.
- Each waveguide 416 is configured to guide one of the sub-beams 414 .
- a first array of out-couplers 420 arranged in rows corresponding to individual waveguides 416 , is supported by the substrate 401 .
- Each row of the out-couplers 420 is coupled to one waveguide 416 of the first waveguide array along a length of the waveguide 416 , for out-coupling portions 422 of one of the sub-beams 414 propagating in the waveguides 416 .
- the portions 422 form a first two-dimensional array of out-coupled sub-beam portions.
- the waveguide illuminator 400 A further includes a second input waveguide 407 for guiding a second input light beam 409 provided by a second light source 411 , e.g. a semiconductor light source such as a laser diode, at an opposite side of the substrate 401 .
- a second waveguide splitter 413 is coupled to the second input waveguide 407 for splitting the second input light beam 409 into a second plurality of sub-beams 415 .
- a second array of waveguides 417 is coupled to the second waveguide splitter 413 for propagating the sub-beams 415 in the waveguides 417 .
- the waveguides 417 of the second waveguide array run parallel to one another and between the waveguides 416 of the first waveguide array, i.e.
- the waveguides 416 of the first waveguide array and the waveguides 416 of the first waveguide array are interleaved.
- the first 412 and second 413 waveguide splitters are disposed at opposite ends of the first and second waveguide arrays, i.e. to the left and right of the arrays in FIG. 4 A .
- Each waveguide 417 of the second waveguide array is configured to guide one sub-beam 415 .
- a second array of out-couplers 421 arranged in rows, is supported by the substrate 401 .
- Each row of out-couplers 421 is coupled to one of the waveguides 417 of the second waveguide array along the length of the waveguides 417 , for out-coupling portions 423 forming a second two-dimensional array of out-coupled sub-beam portions.
- the first 408 and second 409 input light beams may be launched into the respective interleaved waveguide arrays from the two opposite sides of the waveguide illuminator 400 A along the pairs of parallel waveguides 416 , 417 .
- the two arrays of the out-coupled beam portions 422 and 423 are interleaved, which is a consequence of the waveguides 416 and 417 of the first and second waveguide arrays, and corresponding out-couplers 420 and 421 being interleaved as illustrated.
- the sub-beams 414 and 415 split from the first 408 and second 409 input light beams propagate in opposite directions, i.e. they counter-propagate.
- the first 410 and second 411 light sources may be configured to emit light at different wavelengths, e.g. wavelengths of a same color channel; for example, the first 410 and second 411 light sources may include laser diodes at different emission wavelengths, such that no steady optical interference pattern formation is possible.
- the interleaved configuration illustrated in FIG. 4 allows one to reduce or completely eliminate undesired optical interference effects between neighboring out-coupled beam portions 422 and 423 , reducing or eliminating the deleterious effects of speckle pattern formation.
- the waveguide illuminator 400 A of FIG. 4 A may include a controller 450 coupled to the first 410 and second 411 light sources.
- the controller 450 may be configured to operate the first 410 and second 411 semiconductor light sources alternately in a time-sequential manner, to suppress interference between neighboring out-coupled beam portions 422 and 423 .
- the first 410 and second 411 light sources are operated in time-sequential manner, no interference occurs even when the emission spectra of the first 410 and second 411 light sources overlap fully or partially.
- the first 408 and second 409 input light beams can be emitted by a same laser source coupled to a light beam splitter, with sufficient path length between the first 408 and second 409 input light beams to destroy the phase coherence and suppress interference anywhere inside the output area.
- a waveguide illuminator 400 B is similar to the waveguide illuminator 400 A of FIG. 4 A , includes similar elements, may be implemented in a PIC, and may be used in the display device 200 of FIG. 2 .
- the 4 B has a single light source, specifically the first light source 410 , and a light source splitter 477 , e.g. a 50/50 splitter, coupled to the first light source 410 for splitting light provided by the first light source 410 into the first 408 and second 409 input light beams and coupling the first 408 and second 409 input light beams to the first 412 and second 413 waveguide splitters respectively.
- An optical path length difference from the first light source 410 to the first 412 and second 413 waveguide splitters is greater than a coherence length of the first light source 410 .
- the path length difference is approximately equal to a length of an auxiliary waveguide 478 running from the light source splitter 477 to the second waveguide splitter 413 .
- the optical interference and associated undesired speckle pattern formation result from neighboring sub-beam portions corresponding to neighboring pixels of a display panel illuminated with the waveguide illuminator overlapping on the retina of the user's eyes.
- such sub-beam spot overlapping results from imperfections in the optical system that broadens images of the neighboring pixels on the retina. Consequently, increasing a distance between light spots from neighboring sub-beam portions of the illuminator may result in reduction of unwanted interference and suppression of the speckle pattern. Such a distance increase may be achieved by carefully selecting a spatial pattern of the illuminating light. Referring to FIG.
- an embodiment 500 of the display device 200 of FIG. 2 may use the waveguide illuminator 400 A of FIG. 4 A or the waveguide illuminator 400 B of FIG. 4 B .
- the pixels 220 of the display panel 202 form a rectangular array of pixels shown with thick dotted lines.
- the out-couplers 420 and 421 of neighboring rows of out-couplers are offset relative to one another in a direction of the waveguides 416 , 417 i.e. horizontally in FIG.
- each one of the pixels 220 of the rectangular pixel array still being illuminated with one of the out-couplers 420 , 421 of the rhombic array of out-couplers.
- Such a configuration enables the out-couplers 420 , 421 be spaced further away from one another, reducing the strength of optical interference between sub-beam portions out-coupled by neighboring out-couplers 420 , 421 and, accordingly, suppressing the speckle pattern formation.
- a spatially variant polarizer may be placed downstream of a display panel, e.g. the display panel 202 of the display device 200 of FIG. 2 .
- a spatially variant polarizer 600 FIG. 6
- the spatially variant polarizer 600 includes laterally joined linear polarizer segments 601 , 602 having orthogonal orientations of polarization transmission axes.
- the spatially variant polarizer 600 is thus configured to propagate out-coupled sub-beam portions of a first polarization state and to block out-coupled neighboring sub-beam portions of a second, orthogonal polarization state.
- the transmitted neighboring sub-beam portions 122 will be orthogonally polarized and, accordingly, the optical interference between them will be suppressed.
- the display panel 202 may be calibrated to act as a different waveplate depending on the corresponding polarizer orientation for each given pixel 220 .
- Light transmitted through pixels 220 at different linear polarization will not undergo optical interference.
- the checkerboard pattern of transmission polarization orientations increases the distance between pixels 220 and sub-beam portions 122 of a same polarization state, reducing the likelihood of their overlap at the retina of the user's eye as explained above with reference to FIG. 3 .
- a spatially variant polarizer 700 may be placed instead of the linear polarizer/analyzer 228 .
- the spatially variant polarizer 700 includes a uniform linear polarizer 710 and a spatially variant waveplate 720 downstream of the uniform linear polarizer 710 .
- the spatially variant waveplate 720 includes laterally joined waveplate segments 721 , 722 of different direction of optic axis. For half-wave waveplates, the directions may differ by 45 degrees.
- the waveplate segments 721 , 722 of same directions of optic axis may be arranged in complementary checkerboard patterns as shown.
- optical interference/speckle effects in a display device caused by coherent illumination may be mitigated by controlling individual pixels of the display to only provide non-zero optical power density for non-neighboring pixels, with all pixels being eventually energized in a time-sequential manner.
- the controller 250 of the display device 200 of FIG. 2 may be configured to cause the display panel 202 to display a plurality of sub-images in a time-sequential manner, the sub-images adding up to an image to be displayed to a user.
- an image 800 to be displayed to a user includes a two-dimensional array of brightness values represented by numbers placed in individual pixels.
- First 801 and second 802 sub-images add up to the image 800 .
- corresponding pixel values of the first and second sub-images 801 and 802 add up to the pixel values of the image 800 .
- a pixel 820 of the image 800 has a value of 17.
- This value is represented by a sum of a pixel 821 of the first sub-image 801 , having a zero value, and a pixel 822 of the second sub-image 802 having the value of 17.
- a pixel 830 of the image 800 has a value of 64.
- This value is represented by a sum of a pixel 831 of the first sub-image 801 , having a value of 64, and a pixel 832 of the second sub-image 802 having a zero value.
- the sub-images 801 and 802 may be displayed by the controller 250 in a time-sequential manner, i.e. quickly one after another such that the user's eye integrates them into a single image.
- Pixels of different sub-images of the plurality of sub-images may be interleaved, e.g. the pixels of different sub-images with non-zero brightness values may be disposed in complementary checkerboard patterns, as illustrated in FIG. 8 .
- the interleaving of non-zero pixel values ensures that no light from neighboring pixels can interfere on the user's eye retina. The net result will be the suppression of visible speckle/interference patterns.
- More than two sub-images may be provided, with the same principle that the pixel brightness values add up to the desired images.
- the pixel may have at least one neighboring pixel of the second image, at least two neighboring pixels of the second sub-image, or at least three or four neighboring pixels.
- neighboring pixels are defined herein as sharing at least one side border.
- optical interference/speckle mitigation configurations and methods disclosed herein are not mutually exclusive, and may be used in a complementary manner.
- the counter-propagation of sub-beams in interleaved waveguides illustrated in FIGS. 4 A and 4 B may be complemented by time-sequential energizing of corresponding light sources, providing output interlaced polarization by means of the analyzer presented in FIGS. 7 A and 7 B , and/or providing sub-images in time-sequential manner.
- the time-sequential light source energizing may be complemented by time-sequential sub-image display illustrated in FIG. 8 , or by other methods disclosed herein.
- the time-sequential sub-image display may be complemented by checkerboard output polarization, and so forth.
- a virtual reality (VR) near-eye display 900 includes a frame 901 supporting, for each eye: a light source 902 ; a waveguide illuminator 906 operably coupled to the light source 902 , the waveguide illuminator 906 including any of the waveguide illuminators disclosed herein; a display panel 918 including an array of display pixels, where positions of the out-coupling gratings in the waveguide illuminator 906 are coordinated with positions of the polarization-tuning pixels of the display panel 918 ; and an ocular lens 932 for converting the image in linear domain generated by the display panel 918 into an image in angular domain for direct observation at an eyebox 926 .
- VR virtual reality
- a plurality of eyebox illuminators 962 may be placed onto the side of the waveguide illuminator 906 that faces the eyebox 926 .
- An eye-tracking camera 942 may be provided for each eyebox 926 .
- the purpose of the eye-tracking cameras 942 is to determine position and/or orientation of both eyes of the user.
- the eyebox illuminators 962 illuminate the eyes at the corresponding eyeboxes 926 , allowing the eye-tracking cameras 942 to obtain the images of the eyes, as well as to provide reference reflections i.e. glints.
- the glints may function as reference points in the captured eye image, facilitating the eye gazing direction determination by determining position of the eye pupil images relative to the glints images.
- the latter may be made to emit light invisible to the user. For example, infrared light may be used to illuminate the eyeboxes 926 .
- an HMD 1000 is an example of an AR/VR wearable display system which encloses the user's face, for a greater degree of immersion into the AR/VR environment.
- the HMD 1000 may generate the entirely virtual 3D imagery.
- the HMD 1000 may include a front body 1002 and a band 1004 that can be secured around the user's head.
- the front body 1002 is configured for placement in front of eyes of a user in a reliable and comfortable manner.
- a display system 1080 may be disposed in the front body 1002 for presenting AR/VR imagery to the user.
- the display system 1080 may include any of the display devices and illuminators disclosed herein. Sides 1006 of the front body 1002 may be opaque or transparent.
- the front body 1002 includes locators 1008 and an inertial measurement unit (IMU) 1010 for tracking acceleration of the HMD 1000 , and position sensors 1012 for tracking position of the HMD 1000 .
- the IMU 1010 is an electronic device that generates data indicating a position of the HMD 1000 based on measurement signals received from one or more of position sensors 1012 , which generate one or more measurement signals in response to motion of the HMD 1000 .
- position sensors 1012 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of the IMU 1010 , or some combination thereof.
- the position sensors 1012 may be located external to the IMU 1010 , internal to the IMU 1010 , or some combination thereof.
- the locators 1008 are traced by an external imaging device of a virtual reality system, such that the virtual reality system can track the location and orientation of the entire HMD 1000 .
- Information generated by the IMU 1010 and the position sensors 1012 may be compared with the position and orientation obtained by tracking the locators 1008 , for improved tracking accuracy of position and orientation of the HMD 1000 .
- Accurate position and orientation is important for presenting appropriate virtual scenery to the user as the latter moves and turns in 3D space.
- the HMD 1000 may further include a depth camera assembly (DCA) 1011 , which captures data describing depth information of a local area surrounding some or all of the HMD 1000 .
- the depth information may be compared with the information from the IMU 1010 , for better accuracy of determination of position and orientation of the HMD 1000 in 3D space.
- DCA depth camera assembly
- the HMD 1000 may further include an eye tracking system 1014 for determining orientation and position of user's eyes in real time.
- the obtained position and orientation of the eyes also allows the HMD 1000 to determine the gaze direction of the user and to adjust the image generated by the display system 1080 accordingly.
- the determined gaze direction and vergence angle may be used to adjust the display system 1080 to reduce the vergence-accommodation conflict.
- the direction and vergence may also be used for displays' exit pupil steering as disclosed herein.
- the determined vergence and gaze angles may be used for interaction with the user, highlighting objects, bringing objects to the foreground, creating additional objects or pointers, etc.
- An audio system may also be provided including e.g. a set of small speakers built into the front body 1002 .
- Embodiments of the present disclosure may include, or be implemented in conjunction with, an artificial reality system.
- An artificial reality system adjusts sensory information about outside world obtained through the senses such as visual information, audio, touch (somatosensation) information, acceleration, balance, etc., in some manner before presentation to a user.
- artificial reality may include virtual reality (VR), augmented reality (AR), mixed reality (MR), hybrid reality, or some combination and/or derivatives thereof.
- Artificial reality content may include entirely generated content or generated content combined with captured (e.g., real-world) content.
- the artificial reality content may include video, audio, somatic or haptic feedback, or some combination thereof.
- artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, for example, create content in artificial reality and/or are otherwise used in (e.g., perform activities in) artificial reality.
- the artificial reality system that provides the artificial reality content may be implemented on various platforms, including a wearable display such as an HMD connected to a host computer system, a standalone HMD, a near-eye display having a form factor of eyeglasses, a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Optical Integrated Circuits (AREA)
- Optical Couplings Of Light Guides (AREA)
- Liquid Crystal (AREA)
Abstract
A waveguide illuminator includes an input waveguide, a waveguide splitter coupled to the input waveguide, and a waveguide array coupled to the waveguide splitter. The waveguide array includes an array of out-couplers out-coupling portions of the split light beam to form an array of out-coupled beam portions for illuminating a display panel. To reduce optical interference, the waveguide illuminator may have two interlaced waveguide arrays energized by two different light sources. Output polarizations of neighboring light pixels of a display illuminated with such waveguide illuminator may be orthogonal to each other. The frames to be displayed may be broken down into sequentially displayed sub-frames with interleaved pixels.
Description
- This application claims priority from U.S. Provisional Patent Application No. 63/222,224 entitled “Single Mode Backlight Illuminator”, filed on Jul. 15, 2021 and incorporated herein by reference in its entirety.
- The present disclosure relates to illuminators, visual display devices, and related components and modules.
- Visual displays provide information to viewer(s) including still images, video, data, etc. Visual displays have applications in diverse fields including entertainment, education, engineering, science, professional training, advertising, to name just a few examples. Some visual displays such as TV sets display images to several users, and some visual display systems such s near-eye displays (NEDs) are intended for individual users.
- An artificial reality system generally includes an NED (e.g., a headset or a pair of glasses) configured to present content to a user. The near-eye display may display virtual objects or combine images of real objects with virtual objects, as in virtual reality (VR), augmented reality (AR), or mixed reality (MR) applications. For example, in an AR system, a user may view images of virtual objects (e.g., computer-generated images (CGIs)) superimposed with the surrounding environment by seeing through a “combiner” component. The combiner of a wearable display is typically transparent to external light but includes some light routing optic to direct the display light into the user's field of view.
- Because a display of HMD or NED is usually worn on the head of a user, a large, bulky, unbalanced, and/or heavy display device with a heavy battery would be cumbersome and uncomfortable for the user to wear. Consequently, head-mounted display devices can benefit from a compact and efficient configuration, including efficient light sources and illuminators providing illumination of a display panel, high-throughput ocular lenses and other optical elements in the image forming train.
- Exemplary embodiments will now be described in conjunction with the drawings, in which:
-
FIG. 1 is a schematic plan view of a waveguide illuminator of the present disclosure; -
FIG. 2 is a schematic view of a display device using the waveguide illuminator ofFIG. 1 ; -
FIG. 3 is a zoom-in view of the display device ofFIG. 2 showing optical interference between neighboring pixels on the eye's retina; -
FIG. 4A is a schematic plan view of a waveguide illuminator embodiment using two light sources and interleaved waveguides; -
FIG. 4B is a schematic plan view of a waveguide illuminator embodiment using a light source, a splitter, and interleaved waveguides; -
FIG. 5 is a magnified frontal view of an embodiment of the display device ofFIG. 2 showing relative configuration of grating out-couplers and display panel pixels; -
FIG. 6 is a plan view of a spatially variant polarizer for a waveguide illuminator of this disclosure, the spatially varying polarizer including a checkerboard pattern of orthogonally oriented linear polarizer segments; -
FIGS. 7A and 7B are plan and side views, respectively, of a spatially variant polarizer embodiment for a waveguide illuminator of this disclosure, including a linear polarizer followed by a checkerboard pattern of waveplates; -
FIG. 8 is a three-dimensional diagram illustrating the principle of interleaved sub-images for interference reduction; -
FIG. 9 is a view of an augmented reality (AR) display of this disclosure having a form factor of a pair of eyeglasses; and -
FIG. 10 is a three-dimensional view of a head-mounted display (HMD) of this disclosure. - While the present teachings are described in conjunction with various embodiments and examples, it is not intended that the present teachings be limited to such embodiments. On the contrary, the present teachings encompass various alternatives and equivalents, as will be appreciated by those of skill in the art. All statements herein reciting principles, aspects, and embodiments of this disclosure, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
- As used herein, the terms “first”, “second”, and so forth are not intended to imply sequential ordering, but rather are intended to distinguish one element from another, unless explicitly stated. Similarly, sequential ordering of method steps does not imply a sequential order of their execution, unless explicitly stated. In
FIGS. 1, 7, and 8 , similar number refer to similar elements. Also inFIGS. 3A, 3B toFIGS. 6A, 6B , similar number refer to similar elements. - In a visual display including an array of pixels coupled to an illuminator, the efficiency of light utilization depends on a ratio of a geometrical area occupied by pixels to a total area of the display panel. For miniature displays often used in near-eye and/or head-mounted displays, the ratio can be lower than 50%. The efficient backlight utilization can be further hindered by color filters on the display panel which on average transmit no more than 30% of incoming light. On top of that, there may exist a 50% polarization loss for polarization-based display panels such as liquid crystal (LC) display panels. All these factors considerably reduce the light utilization and overall wall plug efficiency of the display, which is undesirable.
- In accordance with this disclosure, light utilization and wall plug efficiency of a backlit display may be improved by providing a waveguide illuminator including an array of out-couplers aligned with pixels of the display panel. In displays where the illuminator emits light of primary colors, e.g. red, green, and blue, the color of the illuminating light may be matched to the color filters, or the color filters may be omitted altogether. For polarization-based displays, the polarization of the emitted light may be matched to a pre-defined input polarization state. Matching the spatial distribution, transmission wavelength, and/or the transmitted polarization characteristics of the pixels of the display panel enables one to considerably improve the useful portion of display light that is not absorbed or reflected by the display panel on its way to the eyes of the viewer, and consequently to considerably improve the display's wall plug efficiency.
- Singlemode or few-mode waveguides, e.g. ridge waveguides with up to 12 modes of propagation, in combination with laser illumination allow for efficient control of such light properties as color and directivity. As light propagates in a single spatial mode, the output can be diffraction-limited and highly directional. Single mode propagation also allows one to out-couple light in specific points on the waveguide and incorporate focusing pixels that can focus light into the pixels of a display panel while avoiding scattering in inter-pixel areas. The narrow spectrum of laser illumination enables large color gamut displays. Furthermore, single mode waveguides may preserve polarization, which results in highly polarized output from the backlight unit without the need of a polarizer.
- Due to coherent nature of propagating light, illuminators based on single-mode waveguides may be prone to speckle pattern formation caused by optical interference between different sub-beams of out-coupled coherent light. In accordance with this disclosure, effects of speckle formation may be lessened by making sure that neighboring out-coupled sub-beams of illuminating light do not interfere with one another on a retina of a user's eye. Thus may be achieved e.g. by destroying coherence between the neighboring sub-beams, by making sure their polarization is mutually orthogonal, and/or by making sure only one of two neighboring sub-beams reaches user's eye at any given time.
- In accordance with the present disclosure, there is provided a waveguide illuminator comprising first and second waveguide splitters configured to receive first and second light beams, respectively, for splitting the first and second light beams into first and second pluralities of sub-beams, respectively. First and second waveguide arrays are coupled to the first and second waveguide splitters, respectively, and configured to propagate the sub-beams of the first and second pluralities of sub-beams, respectively. Waveguides of the first and second waveguide arrays are interleaved and run parallel to each other. The waveguide illuminator includes an array of rows of out-couplers. Each row of out-couplers of the array is coupled to a waveguide of the first or second waveguide array along a length of the waveguide for forming a two-dimensional array of interleaved out-coupled sub-beam portions of the first and second pluralities of sub-beams.
- In some embodiments, first and second waveguide arrays are coupled to the first and second waveguide splitters at opposed ends of the first and second waveguide arrays, such that the sub-beams of the first and second pluralities of sub-beams counter-propagate in the respective waveguide arrays. Out-couplers of neighboring rows of out-couplers may be offset relative to one another in a direction along the waveguides of the first and second waveguide arrays, to form a rhombic array of out-couplers. The waveguide illuminator may further include first and second semiconductor light sources coupled to the first and second waveguide splitters, respectively, for providing the first and second light beams to the first and second waveguide splitters. The first and second semiconductor light sources may be configured to emit light at different wavelengths of a same color channel. The first and second semiconductor light sources may include laser diodes at different emission wavelengths. A controller may be coupled to the first and second semiconductor light sources. The controller may be configured to operate the first and second semiconductor light sources alternately in a time-sequential manner.
- In accordance with the present disclosure, there is provided a display device comprising a display panel comprising a two-dimensional pixel array, a waveguide illuminator of this disclosure, and a spatially variant polarizer. The waveguide illuminator is configured to illuminate the display panel. The waveguide illuminator may include a waveguide splitter configured to receive and split a light beam into a plurality of sub-beams; a waveguide array coupled to the waveguide splitter and configured to propagate the sub-beams therein, waveguides of the waveguide array running parallel to each other; and an array of rows of out-couplers, each row of out-couplers of the array being coupled to a waveguide of the waveguide array along a length of the waveguide for forming a two-dimensional array of out-coupled sub-beam portions. The spatially variant polarizer may be disposed downstream of the display panel and configured to propagate out-coupled sub-beam portions of a first polarization state and to block out-coupled neighboring sub-beam portions of a second, orthogonal polarization state.
- The spatially variant polarizer may include laterally joined linear polarizer segments of orthogonal orientations of polarization transmission axes. The linear polarizer segments of a same direction of polarization may be arranged in a checkerboard pattern. The spatially variant polarizer may include a linear polarizer and a spatially variant waveplate downstream of the linear polarizer, the spatially variant waveplate comprising laterally joined waveplate segments of different direction of optic axis arranged in a checkerboard pattern. The waveplate segments of a same direction of optic axis may be arranged in a checkerboard pattern.
- In accordance with the present disclosure, there is further provided a display device comprising a display panel and a waveguide illuminator of this disclosure. The display panel may include a two-dimensional pixel array, e.g. an array of transmissive light valves, which may be formed in a liquid crystal layer. The waveguide illuminator may include a waveguide splitter configured to receive and split a light beam into a plurality of sub-beams; a waveguide array coupled to the waveguide splitter and configured to propagate the sub-beams therein, waveguides of the waveguide array running parallel to each other; and an array of rows of out-couplers, each row of out-couplers of the array being coupled to a waveguide of the waveguide array along a length of the waveguide for forming a two-dimensional array of out-coupled sub-beam portions corresponding to the two-dimensional pixel array of the display panel.
- The display device may further include a controller operably coupled to the display panel and configured to cause the display panel to display a plurality of sub-images in a time-sequential manner, the sub-images adding up to an image to be displayed to a user. Pixels of different sub-images of the plurality of sub-images may be interleaved with one another. For example, pixels of different sub-images of the plurality of sub-images may be disposed in complementary checkerboard patterns. The plurality of sub-images may include first and second sub-images having interleaved pixels, such that each pixel of the first sub-image has at least two neighboring pixels of the second sub-image. Each pixel of the first sub-image may have at least three neighboring pixels of the second sub-image.
- Referring now to
FIG. 1 , awaveguide illuminator 100 includes asubstrate 101 supporting aninput waveguide 106 for guiding aninput light beam 108 provided by alight source 110, such as a laser source. Herein, the term “waveguide” denotes a light guiding structure that bounds the light propagation in two dimensions, like a light wire, and guides the light in a single transversal mode, or in several transversal modes, e.g. up to 12 modes of propagation. A waveguide may be straight, curved, etc. One example of a linear waveguide is a ridge-type waveguide. Thewaveguide illuminator 100 may be implemented in a photonic integrated circuit (PIC). - A
waveguide splitter 112 is coupled to theinput waveguide 106. The function of thewaveguide splitter 112 is to split theinput light beam 108 into a plurality ofsub-beams 114. An array ofwaveguides 116 is coupled to thewaveguide splitter 112 for guiding the sub-beams 114 in thewaveguides 116. Thewaveguides 116 run parallel to one another as illustrated. Eachwaveguide 116 is configured to guide one of the sub-beams 114 from thewaveguide splitter 112 to anend 129 of thewaveguide 116. - An array of
rows 119 of out-couplers 120 is supported by thesubstrate 101 of thewaveguide illuminator 100. Eachrow 119 of the out-couplers 120 is coupled to one of thewaveguides 116 along a length of thewaveguide 116, for out-couplingportions 122 of one of the sub-beams 114 propagating in thewaveguide 116. Theportions 122 out-coupled by allrows 119 of the out-couplers 120 form a two-dimensional array of thesub-beam portions 122 out-coupled from the waveguide array and exiting at an angle, including an acute or straight angle, to thesubstrate 101. X- and Y-pitch of the two-dimensional array of thesub-beam portions 122 may be selected to match X- and Y-pitch of a display panel illuminated by thewaveguide illuminator 100. - Referring to
FIG. 2 with further reference toFIG. 1 , adisplay device 200 includes thewaveguide illuminator 100 ofFIG. 1 , or any other waveguide illuminator disclosed herein. Thewaveguide illuminator 100 is coupled to a display panel 202 (FIG. 2 ). Alight source 201, e.g. a semiconductor light source at a wavelength of a color channel, may be optically coupled to theilluminator 100 for providing thelight beam 108 to theilluminator 100. Thedisplay panel 202 includes a two-dimensional array ofdisplay pixels 220, e.g. an array of transmissive light valves, disposed and configured to receive the array of the out-coupledsub-beam portions 122 from theilluminator 100. To ensure that thesub-beam portions 122 are used efficiently, locations and pitch of thedisplay pixels 220 may be matched to locations and pitch of the array of out-couplers 120, in both X- and Y-directions. A pitch of thedisplay pixels 220 may be substantially equal to a pitch of the array of the out-couplers 120. - The
display device 200 may further include acontroller 250 operably coupled to thelight source 201 and thedisplay panel 202 for energizing thelight source 201 while providing control signals for setting individual optical transmission values, or other properties such as polarization conversion properties, of thedisplay pixels 220. In some embodiments, thedisplay panel 202 may include aliquid crystal layer 204, with thedisplay pixels 220 configured to individually and controllably convert or tune a polarization state of the individualsub-beam portions 122, e.g. rotate a linear polarization state. In such embodiments, thelight source 201 may be a polarized light source emitting linearly polarized light. Alinear polarizer 228 may be provided to convert the polarization distribution of thesub-beam portions 122 imparted by thedisplay pixels 220 into an optical power density distribution, or brightness distribution, representing an image to be displayed. A polarizer that converts the polarization distribution into an optical power density or brightness distribution is commonly termed analyzer. The liquid crystal pixels in combination with analyzer form the array of light valve pixels having controllable optical transmission. - The image formed downstream of the
linear polarizer 228 is in linear domain, where pixel coordinates of the image being displayed correspond to XY coordinates of thedisplay pixels 220. Anocular lens 230 may be used to convert the image in linear domain into an image in angular domain at aneyebox 226 for direct observation by aneye 280. Herein, the term “image in angular domain” refers to an image where pixel coordinates of the image being displayed correspond to ray angles of thesub-beam portions 122. In embodiments with tunable polarization rotators, thelight source 201 may emit polarized light, and thewaveguide illuminator 100 may preserve that state of polarization. In some embodiments, thewaveguide illuminator 100 may be made transparent toexternal light 214. - One potential issue associated with using coherent light sources to illuminate a display panel, e.g. the
light source 201 illuminating thedisplay panel 202, is speckle pattern formation. Speckles may be observed by theeye 280 due to the coherent nature of thelight source 201. -
FIG. 3 illustrates origins of such a speckle pattern.FIG. 3 is a zoon-in of thedisplay 200 ofFIG. 2 withlight paths sub-beam portions 122 propagated through neighboringdisplay pixels ocular lens 230, and focused by a lens/cornea 380 of theeye 280 onto aretina 302 of theeye 280. Due to the imperfect nature of the entire imaging train, including theocular lens 230 and the eye lens/cornea 380,images display pixels retina 302 somewhat. Anoptical interference pattern 300 may appear in an overlap area between theimages display pixels optical interference pattern 300 will also occur between other neighboring pixel images, not shown for clarity. The end result of theinterference pattern formation 300 is that the entire visible image is highly speckled, creating a distracting, unnatural look of the observed imagery. - One approach to alleviate the
optical interference pattern 300 is to provide a waveguide illuminator having a plurality of phase-uncorrelated light sources. Such light sources may be at slightly different emission wavelengths such that beams emitted by these sources when overlapped show no visible interference pattern. Referring for a non-limiting illustrative example toFIG. 4A , awaveguide illuminator 400A is similar to thewaveguide illuminator 100 ofFIG. 1 , includes similar elements, may be implemented as a PIC, and may be used in thedisplay device 200 ofFIG. 2 . Similarly to thewaveguide illuminator 100, thewaveguide illuminator 400A ofFIG. 4A includes asubstrate 401 supporting afirst input waveguide 406 for guiding a firstinput light beam 408 provided by a firstlight source 410, e.g. a semiconductor light source such as a laser diode. Afirst waveguide splitter 412 is coupled to thefirst input waveguide 406. The function of thefirst waveguide splitter 412 is to split the firstinput light beam 408 into a first plurality ofsub-beams 414. A first array ofwaveguides 416 is coupled to thefirst waveguide splitter 412 for propagating the sub-beams 414 in thewaveguides 416 of the first array. Thewaveguides 416 run parallel to one another as illustrated. Eachwaveguide 416 is configured to guide one of the sub-beams 414. A first array of out-couplers 420, arranged in rows corresponding toindividual waveguides 416, is supported by thesubstrate 401. Each row of the out-couplers 420 is coupled to onewaveguide 416 of the first waveguide array along a length of thewaveguide 416, for out-couplingportions 422 of one of the sub-beams 414 propagating in thewaveguides 416. Theportions 422 form a first two-dimensional array of out-coupled sub-beam portions. - The
waveguide illuminator 400A further includes asecond input waveguide 407 for guiding a secondinput light beam 409 provided by a secondlight source 411, e.g. a semiconductor light source such as a laser diode, at an opposite side of thesubstrate 401. Asecond waveguide splitter 413 is coupled to thesecond input waveguide 407 for splitting the secondinput light beam 409 into a second plurality ofsub-beams 415. A second array ofwaveguides 417 is coupled to thesecond waveguide splitter 413 for propagating the sub-beams 415 in thewaveguides 417. Thewaveguides 417 of the second waveguide array run parallel to one another and between thewaveguides 416 of the first waveguide array, i.e. thewaveguides 416 of the first waveguide array and thewaveguides 416 of the first waveguide array are interleaved. The first 412 and second 413 waveguide splitters are disposed at opposite ends of the first and second waveguide arrays, i.e. to the left and right of the arrays inFIG. 4A . - Each
waveguide 417 of the second waveguide array is configured to guide onesub-beam 415. A second array of out-couplers 421, arranged in rows, is supported by thesubstrate 401. Each row of out-couplers 421 is coupled to one of thewaveguides 417 of the second waveguide array along the length of thewaveguides 417, for out-couplingportions 423 forming a second two-dimensional array of out-coupled sub-beam portions. The first 408 and second 409 input light beams may be launched into the respective interleaved waveguide arrays from the two opposite sides of thewaveguide illuminator 400A along the pairs ofparallel waveguides - The two arrays of the out-coupled
beam portions waveguides couplers FIG. 4 allows one to reduce or completely eliminate undesired optical interference effects between neighboring out-coupledbeam portions - In some embodiments, the
waveguide illuminator 400A ofFIG. 4A may include acontroller 450 coupled to the first 410 and second 411 light sources. Thecontroller 450 may be configured to operate the first 410 and second 411 semiconductor light sources alternately in a time-sequential manner, to suppress interference between neighboring out-coupledbeam portions - In some embodiments, the first 408 and second 409 input light beams can be emitted by a same laser source coupled to a light beam splitter, with sufficient path length between the first 408 and second 409 input light beams to destroy the phase coherence and suppress interference anywhere inside the output area. Referring for a non-limiting illustrative example to
FIG. 4B , awaveguide illuminator 400B is similar to thewaveguide illuminator 400A ofFIG. 4A , includes similar elements, may be implemented in a PIC, and may be used in thedisplay device 200 ofFIG. 2 . Thewaveguide illuminator 400B ofFIG. 4B has a single light source, specifically the firstlight source 410, and alight source splitter 477, e.g. a 50/50 splitter, coupled to the firstlight source 410 for splitting light provided by the firstlight source 410 into the first 408 and second 409 input light beams and coupling the first 408 and second 409 input light beams to the first 412 and second 413 waveguide splitters respectively. An optical path length difference from the firstlight source 410 to the first 412 and second 413 waveguide splitters is greater than a coherence length of the firstlight source 410. InFIG. 4B , the path length difference is approximately equal to a length of anauxiliary waveguide 478 running from thelight source splitter 477 to thesecond waveguide splitter 413. - In a near-eye display, the optical interference and associated undesired speckle pattern formation result from neighboring sub-beam portions corresponding to neighboring pixels of a display panel illuminated with the waveguide illuminator overlapping on the retina of the user's eyes. As explained above with reference to
FIG. 3 , such sub-beam spot overlapping results from imperfections in the optical system that broadens images of the neighboring pixels on the retina. Consequently, increasing a distance between light spots from neighboring sub-beam portions of the illuminator may result in reduction of unwanted interference and suppression of the speckle pattern. Such a distance increase may be achieved by carefully selecting a spatial pattern of the illuminating light. Referring toFIG. 5 for a non-limiting illustrative example, anembodiment 500 of thedisplay device 200 ofFIG. 2 may use thewaveguide illuminator 400A ofFIG. 4A or thewaveguide illuminator 400B ofFIG. 4B . InFIG. 5 , thepixels 220 of thedisplay panel 202 form a rectangular array of pixels shown with thick dotted lines. The out-couplers waveguides FIG. 5 , to form a rhombic array of out-couplers pixels 220 of the rectangular pixel array still being illuminated with one of the out-couplers couplers couplers - The optical interference between neighboring out-coupled sub-beam portions may also be suppressed or lessened by ensuring that the neighboring out-coupled sub-beam portions have orthogonal states of polarization. To that end, a spatially variant polarizer may be placed downstream of a display panel, e.g. the
display panel 202 of thedisplay device 200 ofFIG. 2 . For example, referring toFIG. 6 with further reference toFIG. 2 , a spatially variant polarizer 600 (FIG. 6 ) may be placed instead of the linear polarizer/analyzer 228 (FIG. 2 ). In the embodiment shown inFIG. 6 , the spatiallyvariant polarizer 600 includes laterally joinedlinear polarizer segments variant polarizer 600 is thus configured to propagate out-coupled sub-beam portions of a first polarization state and to block out-coupled neighboring sub-beam portions of a second, orthogonal polarization state. The transmitted neighboringsub-beam portions 122 will be orthogonally polarized and, accordingly, the optical interference between them will be suppressed. - The
display panel 202 may be calibrated to act as a different waveplate depending on the corresponding polarizer orientation for each givenpixel 220. Light transmitted throughpixels 220 at different linear polarization will not undergo optical interference. The checkerboard pattern of transmission polarization orientations increases the distance betweenpixels 220 andsub-beam portions 122 of a same polarization state, reducing the likelihood of their overlap at the retina of the user's eye as explained above with reference toFIG. 3 . - Referring now to
FIGS. 7A and 7B with further reference toFIG. 2 , a spatiallyvariant polarizer 700 may be placed instead of the linear polarizer/analyzer 228. In the embodiment shown, the spatiallyvariant polarizer 700 includes a uniformlinear polarizer 710 and a spatiallyvariant waveplate 720 downstream of the uniformlinear polarizer 710. The spatiallyvariant waveplate 720 includes laterally joinedwaveplate segments waveplate segments - In some embodiments of this disclosure, optical interference/speckle effects in a display device caused by coherent illumination may be mitigated by controlling individual pixels of the display to only provide non-zero optical power density for non-neighboring pixels, with all pixels being eventually energized in a time-sequential manner. To that end, the
controller 250 of thedisplay device 200 ofFIG. 2 may be configured to cause thedisplay panel 202 to display a plurality of sub-images in a time-sequential manner, the sub-images adding up to an image to be displayed to a user. - Turning to
FIG. 8 for a non-limiting illustrative example, animage 800 to be displayed to a user includes a two-dimensional array of brightness values represented by numbers placed in individual pixels. First 801 and second 802 sub-images add up to theimage 800. In other words, corresponding pixel values of the first andsecond sub-images image 800. For example, apixel 820 of theimage 800 has a value of 17. This value is represented by a sum of apixel 821 of thefirst sub-image 801, having a zero value, and apixel 822 of the second sub-image 802 having the value of 17. Similarly, apixel 830 of theimage 800 has a value of 64. This value is represented by a sum of apixel 831 of thefirst sub-image 801, having a value of 64, and apixel 832 of the second sub-image 802 having a zero value. - The sub-images 801 and 802 may be displayed by the
controller 250 in a time-sequential manner, i.e. quickly one after another such that the user's eye integrates them into a single image. Pixels of different sub-images of the plurality of sub-images may be interleaved, e.g. the pixels of different sub-images with non-zero brightness values may be disposed in complementary checkerboard patterns, as illustrated inFIG. 8 . The interleaving of non-zero pixel values ensures that no light from neighboring pixels can interfere on the user's eye retina. The net result will be the suppression of visible speckle/interference patterns. - More than two sub-images may be provided, with the same principle that the pixel brightness values add up to the desired images. Depending on the total number of sub-images and a boundary or in-frame location of a pixel of the first sub-image, the pixel may have at least one neighboring pixel of the second image, at least two neighboring pixels of the second sub-image, or at least three or four neighboring pixels. For definiteness, it is noted that neighboring pixels are defined herein as sharing at least one side border.
- It is further noted that optical interference/speckle mitigation configurations and methods disclosed herein are not mutually exclusive, and may be used in a complementary manner. For example, the counter-propagation of sub-beams in interleaved waveguides illustrated in
FIGS. 4A and 4B may be complemented by time-sequential energizing of corresponding light sources, providing output interlaced polarization by means of the analyzer presented inFIGS. 7A and 7B , and/or providing sub-images in time-sequential manner. The time-sequential light source energizing may be complemented by time-sequential sub-image display illustrated inFIG. 8 , or by other methods disclosed herein. The time-sequential sub-image display may be complemented by checkerboard output polarization, and so forth. - Turning to
FIG. 9 , a virtual reality (VR) near-eye display 900 includes aframe 901 supporting, for each eye: alight source 902; awaveguide illuminator 906 operably coupled to thelight source 902, thewaveguide illuminator 906 including any of the waveguide illuminators disclosed herein; adisplay panel 918 including an array of display pixels, where positions of the out-coupling gratings in thewaveguide illuminator 906 are coordinated with positions of the polarization-tuning pixels of thedisplay panel 918; and anocular lens 932 for converting the image in linear domain generated by thedisplay panel 918 into an image in angular domain for direct observation at aneyebox 926. A plurality ofeyebox illuminators 962, shown as black dots, may be placed onto the side of thewaveguide illuminator 906 that faces theeyebox 926. An eye-trackingcamera 942 may be provided for eacheyebox 926. - The purpose of the eye-tracking
cameras 942 is to determine position and/or orientation of both eyes of the user. The eyebox illuminators 962 illuminate the eyes at thecorresponding eyeboxes 926, allowing the eye-trackingcameras 942 to obtain the images of the eyes, as well as to provide reference reflections i.e. glints. The glints may function as reference points in the captured eye image, facilitating the eye gazing direction determination by determining position of the eye pupil images relative to the glints images. To avoid distracting the user with the light of theeyebox illuminators 962, the latter may be made to emit light invisible to the user. For example, infrared light may be used to illuminate theeyeboxes 926. - Turning to
FIG. 10 , anHMD 1000 is an example of an AR/VR wearable display system which encloses the user's face, for a greater degree of immersion into the AR/VR environment. TheHMD 1000 may generate the entirely virtual 3D imagery. TheHMD 1000 may include afront body 1002 and aband 1004 that can be secured around the user's head. Thefront body 1002 is configured for placement in front of eyes of a user in a reliable and comfortable manner. Adisplay system 1080 may be disposed in thefront body 1002 for presenting AR/VR imagery to the user. Thedisplay system 1080 may include any of the display devices and illuminators disclosed herein.Sides 1006 of thefront body 1002 may be opaque or transparent. - In some embodiments, the
front body 1002 includeslocators 1008 and an inertial measurement unit (IMU) 1010 for tracking acceleration of theHMD 1000, andposition sensors 1012 for tracking position of theHMD 1000. TheIMU 1010 is an electronic device that generates data indicating a position of theHMD 1000 based on measurement signals received from one or more ofposition sensors 1012, which generate one or more measurement signals in response to motion of theHMD 1000. Examples ofposition sensors 1012 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of theIMU 1010, or some combination thereof. Theposition sensors 1012 may be located external to theIMU 1010, internal to theIMU 1010, or some combination thereof. - The
locators 1008 are traced by an external imaging device of a virtual reality system, such that the virtual reality system can track the location and orientation of theentire HMD 1000. Information generated by theIMU 1010 and theposition sensors 1012 may be compared with the position and orientation obtained by tracking thelocators 1008, for improved tracking accuracy of position and orientation of theHMD 1000. Accurate position and orientation is important for presenting appropriate virtual scenery to the user as the latter moves and turns in 3D space. - The
HMD 1000 may further include a depth camera assembly (DCA) 1011, which captures data describing depth information of a local area surrounding some or all of theHMD 1000. The depth information may be compared with the information from theIMU 1010, for better accuracy of determination of position and orientation of theHMD 1000 in 3D space. - The
HMD 1000 may further include aneye tracking system 1014 for determining orientation and position of user's eyes in real time. The obtained position and orientation of the eyes also allows theHMD 1000 to determine the gaze direction of the user and to adjust the image generated by thedisplay system 1080 accordingly. The determined gaze direction and vergence angle may be used to adjust thedisplay system 1080 to reduce the vergence-accommodation conflict. The direction and vergence may also be used for displays' exit pupil steering as disclosed herein. Furthermore, the determined vergence and gaze angles may be used for interaction with the user, highlighting objects, bringing objects to the foreground, creating additional objects or pointers, etc. An audio system may also be provided including e.g. a set of small speakers built into thefront body 1002. - Embodiments of the present disclosure may include, or be implemented in conjunction with, an artificial reality system. An artificial reality system adjusts sensory information about outside world obtained through the senses such as visual information, audio, touch (somatosensation) information, acceleration, balance, etc., in some manner before presentation to a user. By way of non-limiting examples, artificial reality may include virtual reality (VR), augmented reality (AR), mixed reality (MR), hybrid reality, or some combination and/or derivatives thereof. Artificial reality content may include entirely generated content or generated content combined with captured (e.g., real-world) content. The artificial reality content may include video, audio, somatic or haptic feedback, or some combination thereof. Any of this content may be presented in a single channel or in multiple channels, such as in a stereo video that produces a three-dimensional effect to the viewer. Furthermore, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, for example, create content in artificial reality and/or are otherwise used in (e.g., perform activities in) artificial reality. The artificial reality system that provides the artificial reality content may be implemented on various platforms, including a wearable display such as an HMD connected to a host computer system, a standalone HMD, a near-eye display having a form factor of eyeglasses, a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.
- The present disclosure is not to be limited in scope by the specific embodiments described herein. Indeed, other various embodiments and modifications, in addition to those described herein, will be apparent to those of ordinary skill in the art from the foregoing description and accompanying drawings. Thus, such other embodiments and modifications are intended to fall within the scope of the present disclosure. Further, although the present disclosure has been described herein in the context of a particular implementation in a particular environment for a particular purpose, those of ordinary skill in the art will recognize that its usefulness is not limited thereto and that the present disclosure may be beneficially implemented in any number of environments for any number of purposes. Accordingly, the claims set forth below should be construed in view of the full breadth and spirit of the present disclosure as described herein.
Claims (16)
1. A waveguide illuminator comprising:
first and second waveguide splitters configured to receive first and second light beams, respectively, for splitting the first and second light beams into first and second pluralities of sub-beams, respectively;
first and second waveguide arrays coupled to the first and second waveguide splitters, respectively, at opposed ends of the first and second waveguide arrays, and configured to counter-propagate the sub-beams of the first and second pluralities of sub-beams, respectively, wherein waveguides of the first and second waveguide arrays are interleaved and run parallel to each other; and
an array of rows of out-couplers, each row of out-couplers of the array being coupled to a waveguide of the first or second waveguide array along a length of the waveguide for forming a two-dimensional array of interleaved out-coupled sub-beam portions of the first and second pluralities of sub-beams.
2. (canceled)
3. A waveguide illuminator comprising:
first and second waveguide splitters configured to receive first and second light beams, respectively, for splitting the first and second light beams into first and second pluralities of sub-beams, respectively;
first and second waveguide arrays coupled to the first and second waveguide splitters, respectively, and configured to propagate the sub-beams of the first and second pluralities of sub-beams, respectively, wherein waveguides of the first and second waveguide arrays are interleaved and run parallel to each other; and
an array of rows of out-couplers, each row of out-couplers of the array being coupled to a waveguide of the first or second waveguide array along a length of the waveguide for forming a two-dimensional array of interleaved out-coupled sub-beam portions of the first and second pluralities of sub-beams;
wherein out-couplers of neighboring rows of out-couplers are offset relative to one another in a direction along the waveguides of the first and second waveguide arrays, to form a rhombic array of out-couplers.
4. The waveguide illuminator of claim 1 , further comprising first and second semiconductor light sources coupled to the first and second waveguide splitters, respectively, for providing the first and second light beams thereto.
5. The waveguide illuminator of claim 4 , wherein the first and second semiconductor light sources are configured to emit light at different wavelengths of a same color channel.
6. The waveguide illuminator of claim 4 , wherein the first and second semiconductor light sources comprise laser diodes at different emission wavelengths.
7. The waveguide illuminator of claim 4 , further comprising a controller coupled to the first and second semiconductor light sources and configured to operate the first and second semiconductor light sources alternately in a time-sequential manner.
8-12. (canceled)
13. A display device comprising:
a display panel comprising a two-dimensional pixel array; and
a waveguide illuminator configured to illuminate the display panel and comprising:
a waveguide splitter configured to receive and split a light beam into a plurality of sub-beams;
a waveguide array coupled to the waveguide splitter and configured to propagate the sub-beams therein, waveguides of the waveguide array running parallel to each other; and
an array of rows of out-couplers, each row of out-couplers of the array being coupled to a waveguide of the waveguide array along a length of the waveguide for forming a two-dimensional array of out-coupled sub-beam portions corresponding to the two-dimensional pixel array of the display panel.
14. The display device of claim 13 , further comprising a controller operably coupled to the display panel and configured to cause the display panel to display a plurality of sub-images in a time-sequential manner, the sub-images adding up to an image to be displayed to a user.
15. The display device of claim 14 , wherein pixels of different sub-images of the plurality of sub-images are interleaved.
16. The display device of claim 15 , wherein pixels of different sub-images of the plurality of sub-images are disposed in complementary checkerboard patterns.
17. The display device of claim 15 , wherein the plurality of sub-images comprises first and second sub-images having interleaved pixels, such that each pixel of the first sub-image has at least two neighboring pixels of the second sub-image.
18. The display device of claim 17 , wherein each pixel of the first first sub-image has at least three neighboring pixels of the second sub-image.
19. The display device of claim 14 , wherein the display panel comprises an array of transmissive light valves.
20. The display device of claim 19 , wherein the display panel comprises a liquid crystal layer.
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/556,895 US11555962B1 (en) | 2021-07-15 | 2021-12-20 | Waveguide illuminator with optical interference mitigation |
TW111120236A TW202305430A (en) | 2021-07-15 | 2022-05-31 | Waveguide illuminator with optical interference mitigation |
EP22748173.6A EP4370961A1 (en) | 2021-07-15 | 2022-07-04 | Waveguide illuminator with optical interference mitigation |
CN202280050066.4A CN117642676A (en) | 2021-07-15 | 2022-07-04 | Waveguide illuminator for reducing optical interference |
PCT/US2022/036058 WO2023287605A1 (en) | 2021-07-15 | 2022-07-04 | Waveguide illuminator with optical interference mitigation |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202163222224P | 2021-07-15 | 2021-07-15 | |
US17/556,895 US11555962B1 (en) | 2021-07-15 | 2021-12-20 | Waveguide illuminator with optical interference mitigation |
Publications (2)
Publication Number | Publication Date |
---|---|
US11555962B1 US11555962B1 (en) | 2023-01-17 |
US20230017615A1 true US20230017615A1 (en) | 2023-01-19 |
Family
ID=84891258
Family Applications (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/481,227 Active US11567255B1 (en) | 2021-07-15 | 2021-09-21 | Waveguide illuminator having slab waveguide portion |
US17/485,061 Active US11609370B2 (en) | 2021-07-15 | 2021-09-24 | Waveguide illuminator having waveguide array |
US17/486,383 Active US11555960B1 (en) | 2021-07-15 | 2021-09-27 | Waveguide array illuminator with light scattering mitigation |
US17/525,211 Active US11555961B1 (en) | 2021-07-15 | 2021-11-12 | Display device with waveguide-based talbot illuminator |
US17/556,895 Active US11555962B1 (en) | 2021-07-15 | 2021-12-20 | Waveguide illuminator with optical interference mitigation |
Family Applications Before (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/481,227 Active US11567255B1 (en) | 2021-07-15 | 2021-09-21 | Waveguide illuminator having slab waveguide portion |
US17/485,061 Active US11609370B2 (en) | 2021-07-15 | 2021-09-24 | Waveguide illuminator having waveguide array |
US17/486,383 Active US11555960B1 (en) | 2021-07-15 | 2021-09-27 | Waveguide array illuminator with light scattering mitigation |
US17/525,211 Active US11555961B1 (en) | 2021-07-15 | 2021-11-12 | Display device with waveguide-based talbot illuminator |
Country Status (4)
Country | Link |
---|---|
US (5) | US11567255B1 (en) |
EP (1) | EP4370964A1 (en) |
CN (1) | CN117616325A (en) |
TW (1) | TW202307492A (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019140269A1 (en) * | 2018-01-14 | 2019-07-18 | Light Field Lab, Inc. | Systems and methods for transverse energy localization in energy relays using ordered structures |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5911018A (en) | 1994-09-09 | 1999-06-08 | Gemfire Corporation | Low loss optical switch with inducible refractive index boundary and spaced output target |
KR100509511B1 (en) | 1997-11-06 | 2005-11-08 | 삼성전자주식회사 | Integrated optical power splitter and its manufacturing method |
SG142126A1 (en) | 2003-10-28 | 2008-05-28 | Sony Corp | A waveguide system, a device for displaying an image using such a system and a method for displaying an image |
KR101086411B1 (en) | 2005-04-04 | 2011-11-25 | 삼성전자주식회사 | Stereo-scopic display apparatus capable of switching 2D/3D image |
CN102349013B (en) | 2009-01-09 | 2014-04-16 | 惠普开发有限公司 | Optical engine for point-to-point communications |
CN103890624A (en) | 2011-10-21 | 2014-06-25 | 惠普发展公司,有限责任合伙企业 | Grating couplers with deep-groove non-uniform gratings |
US8797620B2 (en) | 2011-12-20 | 2014-08-05 | Ergophos, Llc | Autostereoscopic display assembly based on digital semiplanar holography |
US9594261B2 (en) | 2012-05-18 | 2017-03-14 | Reald Spark, Llc | Directionally illuminated waveguide arrangement |
US9557466B2 (en) | 2014-07-30 | 2017-01-31 | Leia, Inc | Multibeam diffraction grating-based color backlighting |
JP6824171B2 (en) | 2015-01-10 | 2021-02-10 | レイア、インコーポレイテッドLeia Inc. | Grating-based back illumination with controlled diffraction coupling efficiency |
EP3464994B1 (en) | 2016-05-23 | 2023-06-07 | LEIA Inc. | Diffractive multibeam element-based backlighting |
WO2018128662A2 (en) | 2016-10-14 | 2018-07-12 | Analog Photonics LLC | Large scale optical phased array |
US10444704B2 (en) | 2016-10-21 | 2019-10-15 | Sony Interactive Entertainment Inc. | Dynamic display using holographic recorded pixels |
US10110863B2 (en) | 2016-11-30 | 2018-10-23 | Microvision, Inc. | Speckle reduction in multi-laser beam scanning display |
CN106405450A (en) | 2016-12-05 | 2017-02-15 | 中北大学 | End-coupling nanometer optical waveguide dual-optical-path chip-level magnetometer |
US10345506B1 (en) | 2018-07-16 | 2019-07-09 | Shenzhen Guangjian Technology Co., Ltd. | Light projecting method and device |
US10838132B1 (en) | 2018-08-21 | 2020-11-17 | Facebook Technologies, Llc | Diffractive gratings for eye-tracking illumination through a light-guide |
US10976483B2 (en) | 2019-02-26 | 2021-04-13 | Facebook Technologies, Llc | Variable-etch-depth gratings |
WO2022120250A1 (en) | 2020-12-04 | 2022-06-09 | Facebook Technologies, Llc | Patterned backlight for display panel |
WO2022120253A1 (en) | 2020-12-04 | 2022-06-09 | Facebook Technologies, Llc | Display device with transparent illuminator |
US11914190B2 (en) * | 2021-01-25 | 2024-02-27 | Huawei Technologies Co., Ltd. | Optical-phased array beam-steerer |
-
2021
- 2021-09-21 US US17/481,227 patent/US11567255B1/en active Active
- 2021-09-24 US US17/485,061 patent/US11609370B2/en active Active
- 2021-09-27 US US17/486,383 patent/US11555960B1/en active Active
- 2021-11-12 US US17/525,211 patent/US11555961B1/en active Active
- 2021-12-20 US US17/556,895 patent/US11555962B1/en active Active
-
2022
- 2022-05-30 TW TW111120057A patent/TW202307492A/en unknown
- 2022-07-13 EP EP22751562.4A patent/EP4370964A1/en active Pending
- 2022-07-13 CN CN202280049276.1A patent/CN117616325A/en active Pending
Also Published As
Publication number | Publication date |
---|---|
US20230015615A1 (en) | 2023-01-19 |
US11567255B1 (en) | 2023-01-31 |
US11555962B1 (en) | 2023-01-17 |
US11555960B1 (en) | 2023-01-17 |
US20230017167A1 (en) | 2023-01-19 |
US20230014790A1 (en) | 2023-01-19 |
US11609370B2 (en) | 2023-03-21 |
CN117616325A (en) | 2024-02-27 |
TW202307492A (en) | 2023-02-16 |
EP4370964A1 (en) | 2024-05-22 |
US20230013534A1 (en) | 2023-01-19 |
US11555961B1 (en) | 2023-01-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11280997B1 (en) | Low-obliquity pupil relay for tiltable reflectors | |
US11698538B2 (en) | Multipass scanner for near-eye display | |
WO2022120253A1 (en) | Display device with transparent illuminator | |
US11555962B1 (en) | Waveguide illuminator with optical interference mitigation | |
US11740471B2 (en) | Display device with transparent illuminator | |
US20230045957A1 (en) | Multi-source light-guiding illuminator | |
US20220050286A1 (en) | Beam scanner with pic input and display based thereon | |
WO2023287605A1 (en) | Waveguide illuminator with optical interference mitigation | |
CN117642676A (en) | Waveguide illuminator for reducing optical interference | |
WO2023287604A1 (en) | Waveguide array illuminator with light scattering mitigation | |
US20230107434A1 (en) | Geometrical waveguide illuminator and display based thereon | |
WO2023287897A1 (en) | Display device with waveguide-based talbot illuminator | |
WO2023287915A1 (en) | Waveguide illuminator having waveguide array | |
US11619774B2 (en) | Talbot pattern illuminator and display based thereon | |
US20230085138A1 (en) | Lightguide with radial pupil replication and visual display based thereon | |
CN117642575A (en) | Display device with waveguide-based taber illuminator | |
EP4370828A1 (en) | Waveguide illuminator having slab waveguide portion | |
CN116762024A (en) | Display device with transparent illuminator | |
CN117642576A (en) | Waveguide illuminator with slab waveguide portion | |
WO2023039124A1 (en) | Lightguide with radial pupil replication and visual display based thereon | |
CN117581060A (en) | Waveguide array illuminator with light scattering mitigation | |
WO2023056083A1 (en) | Geometrical waveguide illuminator and display based thereon |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |