WO2013188464A1 - Multiple depth plane three-dimensional display using a wave guide reflector array projector - Google Patents

Multiple depth plane three-dimensional display using a wave guide reflector array projector Download PDF

Info

Publication number
WO2013188464A1
WO2013188464A1 PCT/US2013/045267 US2013045267W WO2013188464A1 WO 2013188464 A1 WO2013188464 A1 WO 2013188464A1 US 2013045267 W US2013045267 W US 2013045267W WO 2013188464 A1 WO2013188464 A1 WO 2013188464A1
Authority
WO
WIPO (PCT)
Prior art keywords
wave guide
reflectors
axis
light
wave
Prior art date
Application number
PCT/US2013/045267
Other languages
French (fr)
Inventor
John Graham MACNAMARA
Original Assignee
Magic Leap, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to AU2013274359A priority Critical patent/AU2013274359B2/en
Priority to EP22195536.2A priority patent/EP4130820A1/en
Priority to JP2015517371A priority patent/JP6238974B2/en
Priority to CA2876335A priority patent/CA2876335C/en
Priority to CN202211183246.8A priority patent/CN115494654A/en
Priority to KR1020157000711A priority patent/KR102100438B1/en
Priority to CN201380042218.7A priority patent/CN104737061B/en
Priority to NZ702897A priority patent/NZ702897A/en
Application filed by Magic Leap, Inc. filed Critical Magic Leap, Inc.
Priority to EP13803879.9A priority patent/EP2859403B1/en
Priority to KR1020207010092A priority patent/KR102217788B1/en
Publication of WO2013188464A1 publication Critical patent/WO2013188464A1/en
Priority to IL236176A priority patent/IL236176A0/en
Priority to AU2017202843A priority patent/AU2017202843B2/en
Priority to IL257945A priority patent/IL257945B/en
Priority to IL261484A priority patent/IL261484B/en
Priority to AU2018264080A priority patent/AU2018264080B2/en
Priority to AU2020205208A priority patent/AU2020205208B2/en

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/24Coupling light guides
    • G02B6/26Optical coupling means
    • G02B6/262Optical details of coupling light into, or out of, or between fibre ends, e.g. special fibre end shapes or associated optical elements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/50Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/0001Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
    • G02B6/0011Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
    • G02B6/0033Means for improving the coupling-out of light from the light guide
    • G02B6/0035Means for improving the coupling-out of light from the light guide provided on the surface of the light guide or in the bulk of it
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/0001Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
    • G02B6/0011Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
    • G02B6/0075Arrangements of multiple light guides
    • G02B6/0078Side-by-side arrangements, e.g. for large area displays
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/04Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings formed by bundles of fibres
    • G02B6/06Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings formed by bundles of fibres the relative position of the fibres being the same at both ends, e.g. for transporting images
    • GPHYSICS
    • G02OPTICS
    • G02FOPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/011Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  in optical waveguides, not otherwise provided for in this subclass
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0127Head-up displays characterised by optical features comprising devices increasing the depth of field
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/0001Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
    • G02B6/0011Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
    • G02B6/0013Means for improving the coupling-in of light from the light source into the light guide
    • G02B6/0023Means for improving the coupling-in of light from the light source into the light guide provided by one optical element, or plurality thereof, placed between the light guide and the light source, or around the light source
    • G02B6/0028Light guide, e.g. taper
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/0001Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
    • G02B6/0011Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
    • G02B6/0075Arrangements of multiple light guides
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/0001Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
    • G02B6/0011Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
    • G02B6/0075Arrangements of multiple light guides
    • G02B6/0076Stacked arrangements of multiple light guides of the same or different cross-sectional area

Definitions

  • a light field encompasses all the light rays at every point in space traveling in every direction. Light fields are considered four dimensional because every point in a three-dimensional space also has an associated direction, which is the fourth dimension.
  • Wearable three-dimensional displays may include a substrate guided optical device, also known as the light-guide optical element (LOE) system.
  • LOE light-guide optical element
  • Such devices are manufactured by, for example Lumus Ltd.
  • the LOE system 10 uses a single layer wave guide 12 made of two parallel planar surfaces 14a, 14b.
  • Light 16 is coupled into the LOE wave guide 12 using a mini-projector (not shown) and reflector strip 18.
  • FIGS 1 B-1 , 1 B-2 and 1 B-3 illustrate the wave guide 12 of the LOE system 10, showing light 16 entering at three respective angles
  • the LOE system 10 uses planar micro-reflectors 20a-20n (only two called out for sake of drawing clarity) that are only oriented along one angular direction and are positioned parallel to one another. However, the LOE system 10 only projects a single depth plane, focused at infinity, with a spherical wave front curvature of zero.
  • FIG. 1A shows an example convex spherical mirror that refocuses light focused at infinity at a specific radial distance.
  • FIGS. 1 B-1 , 1 B-2 and 1 B-3 show a conventional system that uses a light-guide optical element (LOE) technology to project a single depth plane, with input light entering at three respective angles.
  • LOE light-guide optical element
  • FIG. 2A is an illustration of example curved micro-reflectors that are used to produce a spherical wave front that appears to radiate from a virtual point source.
  • FIG. 2B shows example relative orientation angles of micro- reflectors in a wave guide.
  • FIG. 3A shows an example layer in a wave guide reflector array projector.
  • FIG. 3B shows example orientation angles of micro-reflectors in a wave guide.
  • FIG. 3C shows an example curved micro-reflector.
  • FIG. 4 illustrates example flat and spherical wave fronts.
  • FIG. 5A is an isometric view of an optical apparatus in the form of an example multiple depth plane 3D display system or wave guide reflector array projector (WRAP) apparatus.
  • WRAP wave guide reflector array projector
  • FIG. 5B is a schematic view of a portion of the optical apparatus of FIG. 5A showing a number of wave guide layers projecting light to produce respective virtual depth planes having at respective radial distances representing a number of virtual point sources to simulate a 4D light field, according to one illustrated embodiment
  • FIG. 5C is a schematic view of a portion of the optical apparatus of FIG. 5A showing a number of wave guide layers projecting light to produce respective virtual depth planes having spherical wave fronts at respective radial distances to simulate a 4D light field, according to one illustrated embodiment
  • FIG. 6 shows example projection and propagation light cones for a WRAP system.
  • FIG. 7 shows an example of a reduced projection cone resulting from curved micro-reflectors.
  • FIG. 8 shows an example of a multiple layer multiplexing system with a z-axis coupling tube equipped with optical gates.
  • FIG. 9 shows an example illustration of light propagation through a WRAP system.
  • FIG. 10 illustrates the use of deformable reflective surfaces for producing an example wave front.
  • FIG. 1 1 illustrates an example system that uses transparent display screen with pixels that project light in specified directions.
  • FIG. 12 is an example illustration of how a three-dimensional volume is generated from a stack of two-dimensional projections.
  • FIG. 13 shows a coordinate system for virtual object points.
  • FIG. 14 shows a coordinate system for a 4D light field on a display surface.
  • FIG. 15 shows a coordinate system for two-dimensional micro- reflector orientations.
  • FIG. 16 shows an example of depth indexing of a two- dimensional light field.
  • FIG. 17 illustrates an example of deformable micro-fluids used as micro-reflectors.
  • FIG. 18 illustrates an example of an array of micro-reflectors that functions similar to a side-injected Fresnel mirror.
  • FIG. 19 illustrates an example wave guide tube that generates a wide two-dimensional array of light beams from a single, narrow light beam.
  • FIG. 20 shows an example of a light beam that must be sufficiently wide to minimize gaps in a light beam array.
  • FIG. 21 is a flow diagram illustrating an example process of recreating a three-dimensional volume on a display by driving a multiple layer wave guide in parallel.
  • the ability of the humans to perceive depth of field in a scene is limited, that is, humans have limited visual resolution at different radial distances. Consequently, to recreate an object or scene so that a user experiences the full 3D effect, not every possible focal plane in the 3D volume needs to be recreated.
  • the 3D volume can be recreated for human perception by simply reproducing a limited number of slices of a particular 3D volume.
  • Theories as to the number of slices that need to be recreated range from less than 16 to 36 or more, where the width of the slices are thinnest for distances closer to the eye and increase with distance.
  • the human vision system i.e.
  • An optical apparatus or system may be employed to, for example, generate or project light to simulate a four dimensional (4D) light field that would be produced by light reflecting from a real three-dimensional object or scene.
  • an optical apparatus such as a wave guide reflector array projector (WRAP) apparatus or multiple depth plane three dimensional (3D) display system may generate or project multiple virtual depth planes at respective radial focal distances to simulate a 4D light field.
  • the optical apparatus in the form of a WRAP apparatus or multiple depth plane 3D display system may, for instance, project images into each eye of a user, either directly or indirectly.
  • a discrete set of projected depth planes mimics the psycho-physical effect that is produced by a real, continuous, three dimensional object or scene.
  • an optical apparatus in the form of a WRAP apparatus or multiple depth plane 3D display system 500 may include a 2D array 502 of a plurality of wave guides 504a-504n (collectively 504, only two called out for drawing clarity).
  • each of the wave guides 504 may have a rectangular cross section taken across a length or longitudinal axis thereof (the longitudinal axis denominated herein as x axis).
  • the wave guides 504 may be arranged in a plurality of columns 506 ⁇ e.g., xy planes, extending vertically in the view of FIG.
  • the columns 506 may be characterized as two-dimensional (2D) wave guides or sets of wave guides (each identified with reference number 506).
  • the 2D wave guides 506 may be stacked as layers, for example along a first lateral axis, denominated herein as z axis. As explained herein, each 2D planar wave guide, set of wave guides, layer or column 506 produces or generates a respective virtual depth plane at a respective distance to produce a 4D light field.
  • the WRAP apparatus or multiple depth plane 3D display system 500 may include one or more components to provide one or more optical paths to, or from, the wave guides 504.
  • a set of distribution wave guides 510a-510n (collectively 510, only two called out for drawing clarity).
  • the distribution wave guides may provide an optical path to wave guides 504 in respective columns or layers 506.
  • the WRAP apparatus or multiple depth plane 3D display system 500 may include a plurality of optical couplers (e.g. , optical fibers) illustrated by arrows 512 (referenced collectively) that provide an optical path to respective ones of the distribution wave guides 510 (i.e., each respective column 508).
  • the WRAP apparatus or multiple depth plane 3D display system 500 may include a single optical coupler (e.g. , optical fibers) illustrated by arrow 514 that provides an optical path to two, more or all of the distribution wave guides 510.
  • the distribution wave guides 510 and/or optical couplers 512, 514 may, for example provide input to the wave guides 504 of the 2D array 502, for instance as a pixel pattern from a source of red/green/blue (RGB) light (not illustrated in FIG. 5A.
  • RGB red/green/blue
  • each column or wave guide layer 506a-506c produces a respective slice or virtual depth plane 522a-522c (only three shown, collectively 522) having a spherical wave front 524a-524c (only three shown, collectively 524) to cumulatively simulate a 4D light field 526.
  • a position of a respective virtual point source 528a-528c (only three shown, collectively 528) for each of the virtual depth planes 522a-522c is also illustrated.
  • FIG. 3A shows a single column, 2D planar wave guide, column, layer or set of wave guides 506, along with its respective distribution coupler 510 and an optical coupler 512, 514, according to one illustrated embodiment,
  • Each of the 2D planar wave guides or layers 506 are comprised of a plurality of linear wave guides 504e, 504f (collectively 504, only two called out for drawing clarity).
  • the 2D planar wave guides 506 may, for example, each include a series or linear array of rectangular cylindrical wave guides 504, sometimes referred to as wave guide tubes.
  • tubes While sometimes denominated as “tubes” one of skill in the art will readily appreciate that such structures do not need to be hollow, and in many implementations will be solid, similar in many respects to optical fibers but having at least one pair of opposed planar surfaces, which are at least partially internally reflective to propagate electromagnetic energy (e.g., light) along a length 530 of the wave guide 504.
  • the at least one pair of opposed planar surfaces 532a, 532b may substantially internally reflect certain defined modes of light while allowing certain other defined modes of light to substantially pass out of the wave guide 504.
  • the wave guide 504 will include two pairs of opposed planar surfaces 532a/532b, 532c/532d (collectively 532), which are partially internally reflective, for example substantially internally reflective of certain defined modes.
  • substantially means more than 50 percent, and typically more than 85 percent or 95 percent.
  • the wave guides 504 of the 2D planar wave guide, layer, column or set 506 may be formed individually and assembled or coupled together.
  • the wave guides 504 of the 2D planar wave guide, layer, column or set 506 may be formed as a single unitary structure. Planar surfaces may facilitate production of the desired depth planes and/or increase the density of packing the wave guides 504 into a 3D structure.
  • each linear wave guide 504 Embedded, located or formed within each linear wave guide 504 is a series of deconstructed curved spherical reflectors or mirrors 540a-540n (only two of the curved micro-reflectors called out for clarity of drawing) that are designed to refocus infinity-focused light at specific radial distances. It is noted that in the interest of drawing clarity, the full micro-reflectors of a single linear array of only one of the linear wave guides 504 are fully illustrated in broken line, the micro-reflectors of other linear arrays of other linear wave guides 504 represented schematically by simple convex curves. A number of micro-reflectors 504A-504D for a single linear or rectangular wave guide 504n are represented in FIG. 5A.
  • FIG. 1A shows an example of how an input plane wave 100 focused at infinity can be reflected from a convex spherical mirror 102 to produce an output spherical wave 104 to represent a virtual point source 106 which appears to be located at a defined distance behind the convex spherical mirror 102.
  • a series of micro-reflectors 540 whose shapes ⁇ e.g., radii of curvature about two axes) and orientation together project a 3D image that corresponds to a spherical wave front produced by a virtual point source at a particular x, y, z, coordinate.
  • Each of the 2D wave guides or layers 506 provides an independent optical path relative to the other wave guides, and shapes the wave front and focuses incoming light to project a virtual depth plane 522 (FIG. 5C) that corresponds to a respective radial distance.
  • a virtual depth plane 522 (FIG. 5C) that corresponds to a respective radial distance.
  • FIGS. 5A-5C shows a portion of an example multiple layer WRAP display apparatus or system 500 with 2D planar wave guides, columns or sets of wave guides 506 stacked as layers.
  • Each layer 506 includes multiple wave guides, for instance linear or rectangular wave guides 504, as shown in the example of FIG. 3A.
  • a set of optical distribution couplers 510 and/or other optical couplers 512, 514 optically couple the linear or rectangular wave guides 504 of the 2D array 502, to other components.
  • the optical distribution couplers 510 and/or other optical couplers 512, 514 may optically couple the linear or rectangular wave guides 504 of the 2D array 502 to a subsystem that provides pixel patterns ⁇ e.g., RGB intensity modulated pixel patterns).
  • the set of optical couplers 510 are referred to herein and/or in the claims as a linear array of column distribution couplers or as second lateral (Y) axis distribution optical couplers, or coupling tubes.
  • Y second lateral
  • Each individual wave guide 504 in the WRAP apparatus 500 includes a series of deconstructed curved spherical reflectors or mirrors 540 that are designed to refocus infinity-focused light at specific radial distances.
  • a Fresnel lens is an example of a macroscopic optical element constructed from a series of optical micro-components.
  • the WRAP apparatus 500 includes an array of micro-reflectors 540 that operate effectively as a side- injected ⁇ e.g., injected from a side denominated as the first end) Fresnel mirror.
  • FIG. 18 illustrates an example of an array of micro-reflectors 1802a- 1802n (collectively 1802, only two called out for drawing clarity) in the configuration of a portion of a sphere 1804 rather than an array of micro- reflectors 1806a-1806n (collectively 1806, only two called out for drawing clarity) in a linear configuration 1808 as would be found in the equivalent Fresnel mirror, where the orientation of the micro-reflectors 1802 in the sphere configuration 1804 matches the orientation of the micro-components or micro-reflectors 1806 of the linear Fresnel mirror configuration 1808.
  • the WRAP apparatus 500 includes an array of curved micro- reflectors in the linear or rectangular wave guides 504 that comprise each of the 2D wave guides 506.
  • the array of curved micro-reflectors are positioned and oriented to act similarly to a lens or curved mirror, to project virtual images at specified radial distances. While denominated herein and/or in the claims as "reflectors," as explained herein the curved micro-reflectors typically partially reflect and partially pass electromagnetic energy, for instance optical wavelengths of light (i.e., Near Infrared or N-IR, visible, Near Ultraviolet or N-UV). As described herein, the reflectance may be a function of an angular mode of the electromagnetic energy or light.
  • Conventional lens-based imaging systems or curved mirror-based imaging systems use optical elements with large surface curvatures.
  • Conventional lens-based imaging systems or curved mirror-based imaging systems are front- or back-injected, typically by a wide light field from a projector element.
  • Such conventional systems tend to be relatively thick and heavy, and often use multiple optical elements and moving parts to vary their focal lengths.
  • the illustrated 2D array 502 (FIG. 5A) of linear wave guides 504 of the WRAP apparatus 500 has a planar surface.
  • the illustrated 2D array 502 of linear wave guides 504 of the WRAP apparatus 500 may be side-injected (i.e., injected into side denominated herein and in the claims as a first end) by a cone 542 (FIG.
  • the illustrated 2D array 502 of linear wave guides 504 of the WRAP apparatus 500 may be can be made very thin and light.
  • the illustrated 2D planar wave guides or layers 506 may be easily stacked to create a multifocal display in which each 2D planar wave guide, layer, column or set 506 provides optical paths independently of other 2D planar wave guides, layers, columns or sets, for example allowing each to provide a respective focal or depth plane in a 3D image.
  • the WRAP apparatus 500 projects multiple depth planes 522 (FIG. 5C), each focused at a different radial distance with the corresponding spherical wave front curvatures 524 (FIG. 5C).
  • the WRAP apparatus 500 may include a series of linear or rectangular cylindrical wave guides arranged in vertical (xy) columns to create a planar 2D wave guide 506, which is some instances may be referred to as a 2D assembly of linear or rectangular wave guides 503.
  • the WRAP apparatus 500 may include multiple 2D planar wave guides, columns, layers or sets 506, each corresponding to a different virtual depth plane 522 (FIG.
  • the WRAP apparatus 500 may use convex spherically curved micro- reflectors 540 (FIGS. 3A and 5A).
  • the micro-reflectors 540 may have one or more surface curvatures, and the surface curvatures may vary in each wave guide layer 506.
  • each of the micro- reflectors 540 may be oriented along two angular directions ⁇ , ⁇ .
  • the angular directions ⁇ , ⁇ may vary in any given linear wave guide 504 or may vary between linear wave guides 504 in a single layer 506 or between different layers 506.
  • light may be coupled to the 2D array 503 of the WRAP apparatus 500 from one or more RGB (red, green, blue) light sources 544, for example via one or more of a light intensity modulator 546, fiber optic cables 548, angular mode modulator or beam deflector 550, optional optical demultiplexing switch for instance implemented via optical gates 552, optional z-axis coupling array 554, and the previously described and illustrated separate set of y-axis optical couplers or optical coupling array 510.
  • RGB red, green, blue
  • a WRAP apparatus 500 may include a stack of thin, planar, 2D wave guides 506 that are themselves made up of horizontal rows of linear or rectangular cylindrical wave guides 504. While denominated as 2D, the 2D wave guides 506 physically have depth, but are denominated as such since each represents a 2D slice or portion (i.e., column) of the 2D array 502.
  • the 2D array of wave guides physically have a length, but are denominated as such since the length is an inherent property of the individual linear or rectangular wave guides 504 which may up the 2D array 502, Likewise, while sometimes referred to as a linear wave guide 504, these wave guides physically have heights and widths, but are denominated as such since each provides a linear optical path.
  • FIG. 3A shows an example single layer of the 2D array 503 of a WRAP apparatus 500.
  • An input cone 542 of light is directed via an optical fiber 512, 514, 548 into a distribution optical coupler or y-axis optical coupler 510, sometimes referred to herein as a coupling tube (oriented vertically in FIG. 3A).
  • a distribution optical coupler or y-axis optical coupler 510 mounted in a row within the optical coupler 510 are a number of multiple beam splitters 556a-556n (collectively 556, only two called out in interest of drawing clarity).
  • Each beam splitter 556v reflects a first portion of the light incident upon it to one of multiple stacked linear or rectangular wave guides 504 (oriented horizontally in FIG.
  • light incident into the distribution optical coupler or y-axis optical coupler 510 is emitted into multiple linear or rectangular wave guides 504 positioned along at least a portion of a length of the distribution optical coupler or y-axis optical coupler 510.
  • each linear or rectangular wave guide 504 embedded, positioned or formed in each linear or rectangular wave guide 504 is a linear array of curved micro- reflectors 540 that are shaped and angularly oriented such that each angled light beam that is guided through the linear or rectangular wave guide 504 is projected from the linear or rectangular wave guide 504 by the micro- reflectors 540 into a three dimensional curved pattern.
  • FIG. 3B shows example orientation angles ⁇ , ⁇ of micro-reflectors 540 in a wave guide, where the micro-reflectors are represented in planar form for ease if illustration.
  • FIG. 3C shows an example of orientation angles ⁇ , ⁇ for a curved micro-reflector 540.
  • the projected pattern corresponds to the spherical wave front that is produced by a virtual point source placed at a given x,y,z coordinate, with the x and y coordinates being determined by the 2D angular orientation of the light beam, and the z-coordinate being determined by the particular configuration of micro-reflector shapes and 2D orientation gradients in a given 2D planar wave guide, column, layer or set 506.
  • Each 2D planar wave guide, column, layer or set 506 is configured to have different wave front shaping and focusing properties such that each layer projects a virtual depth plane corresponding to a different z-coordinate, or radial coordinate (r-coordinate).
  • a point source of light that is placed at a given x,y,z coordinate produces a radiating three dimensional pattern of light that varies in a very specific way throughout three dimensional space.
  • the point source generates a spherical wave front whose surface curvature varies in inverse proportion to the radius of the radiating sphere.
  • the WRAP apparatus 500 is designed to generate a section of this sphere with the appropriate wave front curvature and two dimensional rotation, for a particular z-coordinate, upon receiving the input ray that corresponds to a given x, y coordinate.
  • each WRAP 2D planar wave guide, column, layer or set 506 may be provided via a separate multi-mode optical fiber 512 into which a small cone 542 of light has been injected.
  • light input to each 2D planar wave guide, column, layer or set 506 is in the form of the light cone 542 via a respective output channel 514 of a demultiplexing switch 552 (FIG. 8).
  • the light cone 542 contains a two dimensional angular distribution of light beams that corresponds to the two dimensional x, y light intensity pattern that is present in a single depth plane of a 3D volume to be re-created.
  • There are a number of ways to couple the angular distribution of the light cone into the input fiber such as using a MEMS scanner, a switchable liquid crystal, or a MEMS diffraction grating.
  • the propagating light cone 542 should have a defined or known angular pattern, for example as shown in the example of FIG. 6.
  • the light cone 542 that propagates inside of the linear or rectangular wave guide 504 should lie approximately in the angular range of -22.5 degrees to -67.5 degrees, in both angular directions, and the light cone 560 that is projected out of the wave guide should lie approximately in the angular range of -22.5 degrees to +22.5 degrees, in both angular directions.
  • the angular range of the input image should be limited accordingly. Light that is propagated outside of these angular ranges will produce aliasing and double images.
  • each wave guide layer 506 is driven by a different multi-mode fiber 512 that propagates an angular pattern corresponding to that portion of the visual field which is contained in a particular depth layer volume.
  • These angular patterns are generated by drive electronics ⁇ e.g., RGB light source, intensity modulator) that are located in a base unit and then sent to the 2D array 502 in parallel over multiple multi-mode fibers 512.
  • drive electronics e.g., RGB light source, intensity modulator
  • 2D images can be angularly encoded using a scanning projector system (such as the scanning fiber projector) or by coupling a 2D micro-projector to a pinhole aperture.
  • the angular pattern for the entire visual field is simultaneously created and sorted amongst the different wave guide layers 506, one angular beam at a time, using optical gates 552 that are synchronized with a 2D beam deflector 550 that creates the pattern. Because this process takes place at the 2D array 502, distribution or y-axis optical coupler 510 and/or z-axis optical coupler 562 (FIG. 9), and not in a base unit, it can be driven by a single single-mode fiber 514.
  • input images are angularly encoded such that each resolvable angle that propagates through a fiber or other wave guide 514 corresponds to an intensity of a single object point.
  • multi-mode fibers 514 and optical couplers 514, 562 are used that are able to propagate numerous angular modes with an angular density that is comparable to the linear resolution of the display.
  • the angular range of the light cone corresponds to the maximum field of view of the optical apparatus 500, for example, 45 degrees.
  • FIG. 9 shows an example illustration of light propagation through a portion of a WRAP apparatus which includes a z-axis optical coupler 562.
  • FIG. 9 represents the relative orientations of the z-axis optical coupler 562, the distribution or y-axis optical coupler 510, and the linear or rectangular wave guides (interchangeably referred to as x-axis wave guides) 504.
  • light initially enters via the z-axis optical coupler 562.
  • the z-axis optical coupler may be similar in many respects to the linear or rectangular wave guides, for example having at least one pair of opposed planar sides that provide at least partial internal reflection to propagate or guide light along a length of the z-axis optical coupler 562.
  • the z-axis optical coupler 562 contains a linear array of angled, planar micro-reflectors 564a- 564n (collectively 564) that multiply and inject copies of the incoming angular distribution of light into each of the distribution or y-axis optical couplers 510 of the various columns, sets or layers 506.
  • the distribution or y-axis optical couplers 510 may be similar in construction to the z-axis optical coupler 562, having a linear array of angled, planar micro-reflectors 566a-566n (collectively 566).
  • the distribution or y-axis optical couplers 510 multiplies and injects copies of the incoming angular distribution of light into each of the x-axis wave guides 504 in the respective column, set or layer 506.
  • narrow, angled, plane wave light beam 566 enters the linear or rectangular wave guide 504, reflecting from a planar reflector 568 toward at least one of the opposed reflective surfaces 532.
  • the plane wave light beam is split into two beams.
  • a first beam continues to the next micro-reflector 540, and a second beam is reflected in a divergent pattern with a curvature that is twice as great as that of a surface of the micro-reflector 540 from which the second beam reflected.
  • a narrow incident plane wave is converted into a small wedge-like section of a spherical wave front that has a 2D orientation that corresponds to that of the incident plane wave.
  • all of the spherical wave front wedges that are projected from each micro-reflector 540 can be aligned into a single spherical wave front 569 that appears to be radiating from a virtual point 570 located at the x and y coordinates that correspond to the 2D orientation of the plane wave 566 and the z-coordinate that corresponds to the curvature(s) of the micro-reflector 540 and 2D orientation gradient of the 2D wave guide, column, set or layer 506, as shown in FIG.
  • FIGS. 13-15 show coordinate systems for virtual object points, a 4D light field on a display surface, and 2D micro-reflector orientations, respectively.
  • the beams recreate the superposed light field that is produced by a single depth plane.
  • the input signals for each 2D wave guide, plane, set or layer 506 propagate throughout the 2D array 502 they reproduce the superposed light field that is generated by multiple depth plane volumes.
  • depth planes are sufficiently numerous and have the appropriate thicknesses as a function of their radial distance (as determined by the depth of field equation), such that if the depth planes meet or exceed the limits of human z-coordinate resolution (as well as x, y coordinate resolution), then the light field that is generated from a virtual 3D volume should be indistinguishable to a human from that of a real, physical, three dimensional space.
  • each 2D wave guide, plane, set or layer 506 is mutually unaffected by the other 2D wave guide, plane, set or layers 506. This feature allows the 2D wave guide, plane, set or layers 506 to be stacked on top of each other to create a multifocal optical system, a feature which is not believe to be possible with conventional lenses.
  • orthogonal light polarization can be used to decouple light from the real outside world from that of the virtual display to create an augmented reality multiple depth plane 3D display.
  • Polarized reflectors 540 only reflect that portion of light which is aligned parallel to the axis of polarization of the reflector.
  • Cross polarized light is not reflected by the reflector 540, and in the case of a semi-transparent reflector 540, would simply pass through the reflector without being reflected.
  • a 2D wave guide, plane, set or layer 506 can be made transparent to light from the outside world or to other 2D wave guide, plane, set or layers 506 simply by cross polarizing the 2D wave guide, plane, set or layer's 506 light.
  • a 2D light pattern 1602 is generated that corresponds to the radial pinhole projections of the entire virtual 3D volume 1604 in a time sequential manner, and each of the points in the 2D field are depth indexed, for example, as shown in FIG. 16, then as shown in FIG. 8, a z-axis optical coupler 562 (FIG. 9) can be equipped with optical gates 522 that are synchronized with the beam deflector 550 to sort the light beams from a multiplexed input cone 542 into multiple output channel cones 572 (only one called out in FIG. 8 for clarity of drawing) that correspond to each of the depth plane in the virtual 3D volume 1604.
  • the 2D array 502 is driven by a single single-mode fiber 514, 548, and the light cones 572 that correspond to the different 2D wave guide, plane, set or layers 506 are generated within the device itself.
  • the light angles should be simultaneously created and sorted, one angle at a time. If the light angles are not created in a time sequential manner, the light angles cannot easily be sorted into each of the 2D wave guide, plane, set or layers 506.
  • the optical apparatus 500 can be viewed as a mathematical operator that transforms 2D light fields into 4D light fields.
  • FIG. 4 shows example details of the transformation.
  • the optical apparatus 500 performs the transformation by applying a positive curvature to each of the light beams in an input cone 402 and mapping 406 a 2D array of differentially rotated copies of the modified light cone onto a surface of a display. These operations are physically generated by the array(s) of micro-reflectors 540 and have the effect of transforming narrow, plane wave light beams into wide, spherical wave fronts 404; converting light cones into virtual depth planes; and generating a 3D volume from a stack of two dimensional projections, as shown in the example of FIG. 12. (For comparison, FIGS.
  • FIG. 4 and 12 also show an input cone 408 generated into a flat wave front 410.
  • FIG. 13 shows a coordinate system 1300 for virtual object points.
  • FIG. 14 shows a coordinate system 1400 for a 4D light field on a display surface.
  • FIG. 15 shows a coordinate system 1500 for two-dimensional micro-reflector orientations.
  • linear or rectangular wave guides 504 function as beam multipliers and wideners that mathematically and physically generate a wide 2D array of light beams based on the input of a single, narrow light beam.
  • FIG. 19 illustrates how a light cone 1902a1902d (collectively 1902) is multiplied through the use of multiple beam splitters that transmit a portion of incident light and reflect a portion of the incident light.
  • the micro-reflectors ⁇ e.g., curved micro-reflectors 504) should be partially transparent and perform the function of a beam splitter as well as a reflector. In this way, a single beam of light having a narrow range of angles can be repeatedly multiplied and redistributed through the array to create a wide 4D light field.
  • the reflectances of the reflective surfaces (e.g. 532) of the wave guides ⁇ e.g., linear or rectangular wave guides 504) and the micro- reflectors ⁇ e.g., curved micro-reflectors 504) should be angle specific. Specifically, the micro-reflectors ⁇ e.g., curved micro-reflectors 504) should only reflect the angular modes of the input cone that are internally reflected from the surface ⁇ e.g., 532) of the wave guide ⁇ e.g., linear or rectangular wave guides 504), and should be transparent to all other angular modes.
  • Each wave guide ⁇ e.g., linear or rectangular wave guides 504) should only be transparent to the angular modes which are reflected from the micro- reflectors ⁇ e.g., curved micro-reflectors 504) and should confine all other angular modes to the interior of the wave guide ⁇ e.g., linear or rectangular wave guides 504). This allows the light from the input cone to be distributed throughout the entire length of the wave guide ⁇ e.g., linear or rectangular wave guides 504) and to be coupled to each of the micro-reflectors ⁇ e.g., curved micro-reflectors 504) before being projected out of the 2D array 502.
  • This also prevents light from striking the micro-reflectors ⁇ e.g., curved micro- reflectors 504) from two opposing surfaces ⁇ e.g., 532) in the wave guides ⁇ e.g., linear or rectangular wave guides 504), which would result in the creation of a dual set of images instead of a single set of images.
  • This may restrict the field of view. For example, this may restrict the field of view to a maximum field of view (FOV) 700 (FIG. 7) of 45 degrees.
  • FOV maximum field of view
  • the field of view 700 of the optical apparatus 500 will be less than 45 degrees to accommodate the beam curvature that is produced by the micro-reflectors 540, as shown in FIG. 7.
  • the light beams that are coupled into the linear or rectangular wave guides 504 should be wide enough so that the micro-reflectors 540 are evenly covered by the light beams, and gaps and irregularities in the output are minimized.
  • FIG. 20 shows an example where the width of the light beam 2002 is not wide enough to prevent gaps in the light beam array.
  • the light from the input cone should be polarized along a single axis, and the micro-reflectors 540 and reflective opposed surfaces 532 of the wave guides 504 should only reflect light that is polarized along the same axis.
  • an exterior side of the display should have an orthogonally polarizing screen (not shown), such as a liquid crystal display, that allows the user to adjust the real-virtual contrast, i.e., the relative light intensities of the real and virtual visual fields.
  • the orthogonally polarizing screen can also orthogonally polarize the light from the real world relative to the polarization axis of the virtual display, thus allowing the light to pass through the display without being affected by the micro-reflectors 540 or reflective opposed surfaces 532 of the linear or rectangular wave guides 504. [0071] Further, any phase differences and incoherence that is brought about by variations in path length, transit time and wavelength should be undetectable by the human visual system.
  • each 2D planar wave guide, column, set or layer 506 of the 2D array 502 should be as thin as possible. For example, in one embodiment with 10 layers, a thickness of approximately 1 mm per layer would work for the wearable device. With a larger number of layers, e.g., 25 to 35, near and far light fields can be fully recreated. However, fewer than 10 or greater than 35 layers can be used.
  • each 2D planar wave guide, column, set or layer 506 can be reconfigured in real-time, i.e., the curvature(s) of the micro-reflector(s) 504 and/or 2D orientation gradient can be dynamically varied in a rapid manner.
  • the projection of each virtual depth layer can be time multiplexed, instead of being presented simultaneously.
  • a single layer N-plane display system should be reconfigured at a rate N times that of the refresh rate of a single layer in an N-layer system.
  • Dynamically configurable curved micro-reflectors 504a (FIG. 10) may be employed.
  • two dimensional liquid crystal surfaces can be used, where the shapes and orientations of the surfaces can be controlled with electric and/or magnetic fields, as shown in the example of FIG. 10.
  • electrically and/or magnetically deformable microfluids can be used as the micro-reflectors 504b, where the shapes and orientations can be dynamically changed, as shown in the example of FIG. 17.
  • transparent display screens whose pixels 540b are able to project light in specified directions can be used to change the direction of the projected light, for instance as shown in the examples of the bottom of FIG. 10 and FIG. 1 1 .
  • FIG. 21 is a flow diagram illustrating an example process 2100 of re-creating a three-dimensional volume on a display by driving a multiple layer wave guide in parallel.
  • the optical apparatus 502 receives multiple input light beams.
  • Each of the multiple light beams can be delivered by a multi-mode optical fiber.
  • Each of the multiple input light beams corresponds to an intensity pattern of a portion of a visual field in a different layer of the three-dimensional volume to be recreated.
  • the system creates a set of intermediate light beams from each of the multiple input light beams.
  • the system independently rotates copies of the set of multiple intermediate light beams, and at block 2120, projects a wave front that appears to radiate from a virtual point. All of the projected wave fronts together recreate the 3D volume for viewing by the user.
  • the words “comprise,” “comprising,” and the like are to be construed in an inclusive sense (i.e., to say, in the sense of “including, but not limited to”), as opposed to an exclusive or exhaustive sense.
  • the terms “connected,” “coupled,” or any variant thereof means any connection or coupling, either direct or indirect, between two or more elements. Such a coupling or connection between the elements can be physical, logical, or a combination thereof.
  • the words “herein,” “above,” “below,” and words of similar import when used in this application, refer to this application as a whole and not to any particular portions of this application.

Abstract

A two-dimensional array of linear wave guides includes a plurality of 2D planar wave guide assemblies, columns, sets or layers which each produce a respective depth plane to for a simulated 4D light field. Linear wave guides may have a rectangular cylindrical shape, and may stacked in rows and columns. Each linear wave guide is at least partially internally reflective, for example via at least one opposed pair of at least partially reflective planar side walls, to propogate light along a length of the wave guide. Curved micro-reflectors may reflect some modes of light while passing others. The side walls or a face may reflect some modes of light while passing others. The curved micro-reflectors of any given wave guide each contribute to spherical wave front at a defined radial distance, the various layers producing image planes at respective radial distances.

Description

MULTIPLE DEPTH PLANE THREE-DIMENSIONAL DISPLAY USING A WAVE GUIDE REFLECTOR ARRAY PROJECTOR
BACKGROUND
[0001] A light field encompasses all the light rays at every point in space traveling in every direction. Light fields are considered four dimensional because every point in a three-dimensional space also has an associated direction, which is the fourth dimension.
[0002] Wearable three-dimensional displays may include a substrate guided optical device, also known as the light-guide optical element (LOE) system. Such devices are manufactured by, for example Lumus Ltd. As illustrated in FIGS 1 B-1 , 1 B-2 and 1 B-3, the LOE system 10 uses a single layer wave guide 12 made of two parallel planar surfaces 14a, 14b. Light 16 is coupled into the LOE wave guide 12 using a mini-projector (not shown) and reflector strip 18. FIGS 1 B-1 , 1 B-2 and 1 B-3 illustrate the wave guide 12 of the LOE system 10, showing light 16 entering at three respective angles, The LOE system 10 uses planar micro-reflectors 20a-20n (only two called out for sake of drawing clarity) that are only oriented along one angular direction and are positioned parallel to one another. However, the LOE system 10 only projects a single depth plane, focused at infinity, with a spherical wave front curvature of zero.
BRIEF DESCRIPTION OF THE DRAWINGS
[0003] In the drawings, identical reference numbers identify similar elements or acts. The sizes and relative positions of elements in the drawings are not necessarily drawn to scale. For example, the shapes of various elements and angles are not drawn to scale, and some of these elements are arbitrarily enlarged and positioned to improve drawing legibility. Further, the particular shapes of the elements as drawn, are not intended to convey any information regarding the actual shape of the particular elements, and have been solely selected for ease of recognition in the drawings. [0004] Examples of a wave guide reflector array projector (WRAP) system are illustrated in the figures. The examples and figures are illustrative rather than limiting.
[0005] FIG. 1A shows an example convex spherical mirror that refocuses light focused at infinity at a specific radial distance.
[0006] FIGS. 1 B-1 , 1 B-2 and 1 B-3 show a conventional system that uses a light-guide optical element (LOE) technology to project a single depth plane, with input light entering at three respective angles.
[0007] FIG. 2A is an illustration of example curved micro-reflectors that are used to produce a spherical wave front that appears to radiate from a virtual point source.
[0008] FIG. 2B shows example relative orientation angles of micro- reflectors in a wave guide.
[0009] FIG. 3A shows an example layer in a wave guide reflector array projector.
[0010] FIG. 3B shows example orientation angles of micro-reflectors in a wave guide.
[0011] FIG. 3C shows an example curved micro-reflector.
[0012] FIG. 4 illustrates example flat and spherical wave fronts.
[0013] FIG. 5A is an isometric view of an optical apparatus in the form of an example multiple depth plane 3D display system or wave guide reflector array projector (WRAP) apparatus.
[0014] FIG. 5B is a schematic view of a portion of the optical apparatus of FIG. 5A showing a number of wave guide layers projecting light to produce respective virtual depth planes having at respective radial distances representing a number of virtual point sources to simulate a 4D light field, according to one illustrated embodiment
[0015] FIG. 5C is a schematic view of a portion of the optical apparatus of FIG. 5A showing a number of wave guide layers projecting light to produce respective virtual depth planes having spherical wave fronts at respective radial distances to simulate a 4D light field, according to one illustrated embodiment
[0016] FIG. 6 shows example projection and propagation light cones for a WRAP system.
[0017] FIG. 7 shows an example of a reduced projection cone resulting from curved micro-reflectors.
[0018] FIG. 8 shows an example of a multiple layer multiplexing system with a z-axis coupling tube equipped with optical gates.
[0019] FIG. 9 shows an example illustration of light propagation through a WRAP system.
[0020] FIG. 10 illustrates the use of deformable reflective surfaces for producing an example wave front.
[0021] FIG. 1 1 illustrates an example system that uses transparent display screen with pixels that project light in specified directions.
[0022] FIG. 12 is an example illustration of how a three-dimensional volume is generated from a stack of two-dimensional projections.
[0023] FIG. 13 shows a coordinate system for virtual object points.
[0024] FIG. 14 shows a coordinate system for a 4D light field on a display surface.
[0025] FIG. 15 shows a coordinate system for two-dimensional micro- reflector orientations.
[0026] FIG. 16 shows an example of depth indexing of a two- dimensional light field.
[0027] FIG. 17 illustrates an example of deformable micro-fluids used as micro-reflectors.
[0028] FIG. 18 illustrates an example of an array of micro-reflectors that functions similar to a side-injected Fresnel mirror. [0029] FIG. 19 illustrates an example wave guide tube that generates a wide two-dimensional array of light beams from a single, narrow light beam.
[0030] FIG. 20 shows an example of a light beam that must be sufficiently wide to minimize gaps in a light beam array.
[0031] FIG. 21 is a flow diagram illustrating an example process of recreating a three-dimensional volume on a display by driving a multiple layer wave guide in parallel.
DETAILED DESCRIPTION
[0032] Various aspects and examples of the invention will now be described. The following description provides specific details for a thorough understanding and enabling description of these examples. One skilled in the art will understand, however, that the invention may be practiced without many of these details. Additionally, some well-known structures or functions may not be shown or described in detail, so as to avoid unnecessarily obscuring the relevant description.
[0033] The terminology used in the description presented below is intended to be interpreted in its broadest reasonable manner, even though it is being used in conjunction with a detailed description of certain specific examples of the technology. Certain terms may even be emphasized below; however, any terminology intended to be interpreted in any restricted manner will be overtly and specifically defined as such in this Detailed Description section.
[0034] The ability of the humans to perceive depth of field in a scene is limited, that is, humans have limited visual resolution at different radial distances. Consequently, to recreate an object or scene so that a user experiences the full 3D effect, not every possible focal plane in the 3D volume needs to be recreated. The 3D volume can be recreated for human perception by simply reproducing a limited number of slices of a particular 3D volume. Theories as to the number of slices that need to be recreated range from less than 16 to 36 or more, where the width of the slices are thinnest for distances closer to the eye and increase with distance. The human vision system (i.e. eyes, retinal nerve, brain) focally collapses each of these planes so that additional slices of information presented are not necessary for the human to perceive the 3D volume. Independent of the actual number of slices needed, the basic assumption is that only a finite number of slices of a 3D volume need to be reproduced for a human to perceive the full 3D effect.
[0035] An optical apparatus or system may be employed to, for example, generate or project light to simulate a four dimensional (4D) light field that would be produced by light reflecting from a real three-dimensional object or scene. For example, an optical apparatus such as a wave guide reflector array projector (WRAP) apparatus or multiple depth plane three dimensional (3D) display system may generate or project multiple virtual depth planes at respective radial focal distances to simulate a 4D light field. The optical apparatus in the form of a WRAP apparatus or multiple depth plane 3D display system may, for instance, project images into each eye of a user, either directly or indirectly. When the number and radial placement of the virtual depth planes is comparable to the depth resolution of the human vision system as a function of radial distance, a discrete set of projected depth planes mimics the psycho-physical effect that is produced by a real, continuous, three dimensional object or scene.
[0036] As best illustrated in FIG. 5A, an optical apparatus in the form of a WRAP apparatus or multiple depth plane 3D display system 500 may include a 2D array 502 of a plurality of wave guides 504a-504n (collectively 504, only two called out for drawing clarity). As illustrated, each of the wave guides 504 may have a rectangular cross section taken across a length or longitudinal axis thereof (the longitudinal axis denominated herein as x axis). The wave guides 504 may be arranged in a plurality of columns 506 {e.g., xy planes, extending vertically in the view of FIG. 5A, only one called out for drawing clarity) and rows 508 {e.g., xz planes, extending horizontally in the view of FIG. 5A, only one called out for drawing clarity). The columns 506 may be characterized as two-dimensional (2D) wave guides or sets of wave guides (each identified with reference number 506). The 2D wave guides 506 may be stacked as layers, for example along a first lateral axis, denominated herein as z axis. As explained herein, each 2D planar wave guide, set of wave guides, layer or column 506 produces or generates a respective virtual depth plane at a respective distance to produce a 4D light field.
[0037] The WRAP apparatus or multiple depth plane 3D display system 500 may include one or more components to provide one or more optical paths to, or from, the wave guides 504. For example, a set of distribution wave guides 510a-510n (collectively 510, only two called out for drawing clarity). The distribution wave guides may provide an optical path to wave guides 504 in respective columns or layers 506. Also for example, in a non- multiplexed implementation, the WRAP apparatus or multiple depth plane 3D display system 500 may include a plurality of optical couplers (e.g. , optical fibers) illustrated by arrows 512 (referenced collectively) that provide an optical path to respective ones of the distribution wave guides 510 (i.e., each respective column 508). Also for example, in a multiplexed implementation, the WRAP apparatus or multiple depth plane 3D display system 500 may include a single optical coupler (e.g. , optical fibers) illustrated by arrow 514 that provides an optical path to two, more or all of the distribution wave guides 510. The distribution wave guides 510 and/or optical couplers 512, 514 may, for example provide input to the wave guides 504 of the 2D array 502, for instance as a pixel pattern from a source of red/green/blue (RGB) light (not illustrated in FIG. 5A.
[0038] As best illustrated in FIGS. 5B and 5C, each column or wave guide layer 506a-506c (only three shown, collectively 506) produces a respective slice or virtual depth plane 522a-522c (only three shown, collectively 522) having a spherical wave front 524a-524c (only three shown, collectively 524) to cumulatively simulate a 4D light field 526. A position of a respective virtual point source 528a-528c (only three shown, collectively 528) for each of the virtual depth planes 522a-522c is also illustrated.
[0039] FIG. 3A shows a single column, 2D planar wave guide, column, layer or set of wave guides 506, along with its respective distribution coupler 510 and an optical coupler 512, 514, according to one illustrated embodiment, Each of the 2D planar wave guides or layers 506 are comprised of a plurality of linear wave guides 504e, 504f (collectively 504, only two called out for drawing clarity). The 2D planar wave guides 506 may, for example, each include a series or linear array of rectangular cylindrical wave guides 504, sometimes referred to as wave guide tubes. While sometimes denominated as "tubes" one of skill in the art will readily appreciate that such structures do not need to be hollow, and in many implementations will be solid, similar in many respects to optical fibers but having at least one pair of opposed planar surfaces, which are at least partially internally reflective to propagate electromagnetic energy (e.g., light) along a length 530 of the wave guide 504. As explained further herein, the at least one pair of opposed planar surfaces 532a, 532b (collectively 532) may substantially internally reflect certain defined modes of light while allowing certain other defined modes of light to substantially pass out of the wave guide 504. Typically, the wave guide 504 will include two pairs of opposed planar surfaces 532a/532b, 532c/532d (collectively 532), which are partially internally reflective, for example substantially internally reflective of certain defined modes. As used herein and in the claims, the term substantially means more than 50 percent, and typically more than 85 percent or 95 percent. The wave guides 504 of the 2D planar wave guide, layer, column or set 506 may be formed individually and assembled or coupled together. Alternatively, the wave guides 504 of the 2D planar wave guide, layer, column or set 506 may be formed as a single unitary structure. Planar surfaces may facilitate production of the desired depth planes and/or increase the density of packing the wave guides 504 into a 3D structure.
[0040] Embedded, located or formed within each linear wave guide 504 is a series of deconstructed curved spherical reflectors or mirrors 540a-540n (only two of the curved micro-reflectors called out for clarity of drawing) that are designed to refocus infinity-focused light at specific radial distances. It is noted that in the interest of drawing clarity, the full micro-reflectors of a single linear array of only one of the linear wave guides 504 are fully illustrated in broken line, the micro-reflectors of other linear arrays of other linear wave guides 504 represented schematically by simple convex curves. A number of micro-reflectors 504A-504D for a single linear or rectangular wave guide 504n are represented in FIG. 5A.
[0041] FIG. 1A shows an example of how an input plane wave 100 focused at infinity can be reflected from a convex spherical mirror 102 to produce an output spherical wave 104 to represent a virtual point source 106 which appears to be located at a defined distance behind the convex spherical mirror 102. By concatenating in a (linear or rectangular) wave guide a series of micro-reflectors 540 whose shapes {e.g., radii of curvature about two axes) and orientation together project a 3D image that corresponds to a spherical wave front produced by a virtual point source at a particular x, y, z, coordinate. Each of the 2D wave guides or layers 506 provides an independent optical path relative to the other wave guides, and shapes the wave front and focuses incoming light to project a virtual depth plane 522 (FIG. 5C) that corresponds to a respective radial distance. With a sufficient number of 2D wave guides, a user viewing the projected virtual depth planes experiences a 3D effect.
[0042] A multiple layer 2D array 502 of planar wave guides 506 is described herein, in which each layer projects light that corresponds to a different virtual depth plane in the 3D volume. As explained above, FIGS. 5A-5C shows a portion of an example multiple layer WRAP display apparatus or system 500 with 2D planar wave guides, columns or sets of wave guides 506 stacked as layers. Each layer 506 includes multiple wave guides, for instance linear or rectangular wave guides 504, as shown in the example of FIG. 3A. A set of optical distribution couplers 510 and/or other optical couplers 512, 514 optically couple the linear or rectangular wave guides 504 of the 2D array 502, to other components. For instance, the optical distribution couplers 510 and/or other optical couplers 512, 514 may optically couple the linear or rectangular wave guides 504 of the 2D array 502 to a subsystem that provides pixel patterns {e.g., RGB intensity modulated pixel patterns). In some instances the set of optical couplers 510 are referred to herein and/or in the claims as a linear array of column distribution couplers or as second lateral (Y) axis distribution optical couplers, or coupling tubes. As previously noted, one of skill in the art will readily appreciate that such structure do not need to be hollow, and in many implementations will be solid, similar in many respects to optical fiber.
[0043] Each individual wave guide 504 in the WRAP apparatus 500 includes a series of deconstructed curved spherical reflectors or mirrors 540 that are designed to refocus infinity-focused light at specific radial distances. A Fresnel lens is an example of a macroscopic optical element constructed from a series of optical micro-components. The WRAP apparatus 500 includes an array of micro-reflectors 540 that operate effectively as a side- injected {e.g., injected from a side denominated as the first end) Fresnel mirror. FIG. 18 illustrates an example of an array of micro-reflectors 1802a- 1802n (collectively 1802, only two called out for drawing clarity) in the configuration of a portion of a sphere 1804 rather than an array of micro- reflectors 1806a-1806n (collectively 1806, only two called out for drawing clarity) in a linear configuration 1808 as would be found in the equivalent Fresnel mirror, where the orientation of the micro-reflectors 1802 in the sphere configuration 1804 matches the orientation of the micro-components or micro-reflectors 1806 of the linear Fresnel mirror configuration 1808.
What The WRAP Does
[0044] The WRAP apparatus 500 includes an array of curved micro- reflectors in the linear or rectangular wave guides 504 that comprise each of the 2D wave guides 506. The array of curved micro-reflectors are positioned and oriented to act similarly to a lens or curved mirror, to project virtual images at specified radial distances. While denominated herein and/or in the claims as "reflectors," as explained herein the curved micro-reflectors typically partially reflect and partially pass electromagnetic energy, for instance optical wavelengths of light (i.e., Near Infrared or N-IR, visible, Near Ultraviolet or N-UV). As described herein, the reflectance may be a function of an angular mode of the electromagnetic energy or light. [0045] Conventional lens-based imaging systems or curved mirror- based imaging systems use optical elements with large surface curvatures. Conventional lens-based imaging systems or curved mirror-based imaging systems are front- or back-injected, typically by a wide light field from a projector element. Such conventional systems tend to be relatively thick and heavy, and often use multiple optical elements and moving parts to vary their focal lengths. In contrast, the illustrated 2D array 502 (FIG. 5A) of linear wave guides 504 of the WRAP apparatus 500 has a planar surface. The illustrated 2D array 502 of linear wave guides 504 of the WRAP apparatus 500 may be side-injected (i.e., injected into side denominated herein and in the claims as a first end) by a cone 542 (FIG. 3A) of narrow angled beams from an optical fiber which are then internally multiplied into a wide light field. The illustrated 2D array 502 of linear wave guides 504 of the WRAP apparatus 500 may be can be made very thin and light. The illustrated 2D planar wave guides or layers 506 may be easily stacked to create a multifocal display in which each 2D planar wave guide, layer, column or set 506 provides optical paths independently of other 2D planar wave guides, layers, columns or sets, for example allowing each to provide a respective focal or depth plane in a 3D image.
[0046] In contrast to the LOE system 10 (FIGS. 1 B-1 , 1 B-2, 1 B-3) described above, in one embodiment, the WRAP apparatus 500 projects multiple depth planes 522 (FIG. 5C), each focused at a different radial distance with the corresponding spherical wave front curvatures 524 (FIG. 5C). The WRAP apparatus 500 may include a series of linear or rectangular cylindrical wave guides arranged in vertical (xy) columns to create a planar 2D wave guide 506, which is some instances may be referred to as a 2D assembly of linear or rectangular wave guides 503. The WRAP apparatus 500 may include multiple 2D planar wave guides, columns, layers or sets 506, each corresponding to a different virtual depth plane 522 (FIG. 5C). The WRAP apparatus 500 may use convex spherically curved micro- reflectors 540 (FIGS. 3A and 5A). The micro-reflectors 540 may have one or more surface curvatures, and the surface curvatures may vary in each wave guide layer 506. As best illustrated in FIGS. 3B and 3C, each of the micro- reflectors 540 may be oriented along two angular directions φ, Θ. The angular directions φ, Θ may vary in any given linear wave guide 504 or may vary between linear wave guides 504 in a single layer 506 or between different layers 506.
[0047] As best illustrated in FIG. 8,, light (e.g. , pixel pattern) may be coupled to the 2D array 503 of the WRAP apparatus 500 from one or more RGB (red, green, blue) light sources 544, for example via one or more of a light intensity modulator 546, fiber optic cables 548, angular mode modulator or beam deflector 550, optional optical demultiplexing switch for instance implemented via optical gates 552, optional z-axis coupling array 554, and the previously described and illustrated separate set of y-axis optical couplers or optical coupling array 510.
What The WRAP Is
[0048] A WRAP apparatus 500 may include a stack of thin, planar, 2D wave guides 506 that are themselves made up of horizontal rows of linear or rectangular cylindrical wave guides 504. While denominated as 2D, the 2D wave guides 506 physically have depth, but are denominated as such since each represents a 2D slice or portion (i.e., column) of the 2D array 502. While denominated as a 2D, the 2D array of wave guides physically have a length, but are denominated as such since the length is an inherent property of the individual linear or rectangular wave guides 504 which may up the 2D array 502, Likewise, while sometimes referred to as a linear wave guide 504, these wave guides physically have heights and widths, but are denominated as such since each provides a linear optical path.
[0049] FIG. 3A shows an example single layer of the 2D array 503 of a WRAP apparatus 500. An input cone 542 of light is directed via an optical fiber 512, 514, 548 into a distribution optical coupler or y-axis optical coupler 510, sometimes referred to herein as a coupling tube (oriented vertically in FIG. 3A). Mounted in a row within the optical coupler 510 are a number of multiple beam splitters 556a-556n (collectively 556, only two called out in interest of drawing clarity). Each beam splitter 556vreflects a first portion of the light incident upon it to one of multiple stacked linear or rectangular wave guides 504 (oriented horizontally in FIG. 3A), and transmits a second portion of light to the next beam splitter 556. Thus, light incident into the distribution optical coupler or y-axis optical coupler 510 is emitted into multiple linear or rectangular wave guides 504 positioned along at least a portion of a length of the distribution optical coupler or y-axis optical coupler 510.
[0050] As previously explained, embedded, positioned or formed in each linear or rectangular wave guide 504 is a linear array of curved micro- reflectors 540 that are shaped and angularly oriented such that each angled light beam that is guided through the linear or rectangular wave guide 504 is projected from the linear or rectangular wave guide 504 by the micro- reflectors 540 into a three dimensional curved pattern. FIG. 3B shows example orientation angles φ, Θ of micro-reflectors 540 in a wave guide, where the micro-reflectors are represented in planar form for ease if illustration. FIG. 3C shows an example of orientation angles φ, Θ for a curved micro-reflector 540. The projected pattern corresponds to the spherical wave front that is produced by a virtual point source placed at a given x,y,z coordinate, with the x and y coordinates being determined by the 2D angular orientation of the light beam, and the z-coordinate being determined by the particular configuration of micro-reflector shapes and 2D orientation gradients in a given 2D planar wave guide, column, layer or set 506. Each 2D planar wave guide, column, layer or set 506 is configured to have different wave front shaping and focusing properties such that each layer projects a virtual depth plane corresponding to a different z-coordinate, or radial coordinate (r-coordinate).
[0051] A point source of light that is placed at a given x,y,z coordinate produces a radiating three dimensional pattern of light that varies in a very specific way throughout three dimensional space. Specifically, the point source generates a spherical wave front whose surface curvature varies in inverse proportion to the radius of the radiating sphere. The WRAP apparatus 500 is designed to generate a section of this sphere with the appropriate wave front curvature and two dimensional rotation, for a particular z-coordinate, upon receiving the input ray that corresponds to a given x, y coordinate.
[0052] How The WRAP Works
[0053] As shown in the example of FIG. 3A, light input to each WRAP 2D planar wave guide, column, layer or set 506 may be provided via a separate multi-mode optical fiber 512 into which a small cone 542 of light has been injected. Alternatively, light input to each 2D planar wave guide, column, layer or set 506 is in the form of the light cone 542 via a respective output channel 514 of a demultiplexing switch 552 (FIG. 8). The light cone 542 contains a two dimensional angular distribution of light beams that corresponds to the two dimensional x, y light intensity pattern that is present in a single depth plane of a 3D volume to be re-created. There are a number of ways to couple the angular distribution of the light cone into the input fiber, such as using a MEMS scanner, a switchable liquid crystal, or a MEMS diffraction grating.
[0054] The propagating light cone 542 should have a defined or known angular pattern, for example as shown in the example of FIG. 6. In some embodiments, the light cone 542 that propagates inside of the linear or rectangular wave guide 504 should lie approximately in the angular range of -22.5 degrees to -67.5 degrees, in both angular directions, and the light cone 560 that is projected out of the wave guide should lie approximately in the angular range of -22.5 degrees to +22.5 degrees, in both angular directions. Notably, on a relatively narrow range of ray angles will propagate in the wave guide, thus the angular range of the input image should be limited accordingly. Light that is propagated outside of these angular ranges will produce aliasing and double images.
[0055] There are two ways to drive the 2D planar wave guide, column, set or multiple layers 506 of the 2D array 502, in parallel or in series. In the parallel method (shown in the example of FIG. 5A), each wave guide layer 506 is driven by a different multi-mode fiber 512 that propagates an angular pattern corresponding to that portion of the visual field which is contained in a particular depth layer volume. These angular patterns are generated by drive electronics {e.g., RGB light source, intensity modulator) that are located in a base unit and then sent to the 2D array 502 in parallel over multiple multi-mode fibers 512. For example, 2D images can be angularly encoded using a scanning projector system (such as the scanning fiber projector) or by coupling a 2D micro-projector to a pinhole aperture.
[0056] In the series method (shown in the example of FIG. 8), the angular pattern for the entire visual field is simultaneously created and sorted amongst the different wave guide layers 506, one angular beam at a time, using optical gates 552 that are synchronized with a 2D beam deflector 550 that creates the pattern. Because this process takes place at the 2D array 502, distribution or y-axis optical coupler 510 and/or z-axis optical coupler 562 (FIG. 9), and not in a base unit, it can be driven by a single single-mode fiber 514. In this system, input images are angularly encoded such that each resolvable angle that propagates through a fiber or other wave guide 514 corresponds to an intensity of a single object point. To encode an image in this way, multi-mode fibers 514 and optical couplers 514, 562 are used that are able to propagate numerous angular modes with an angular density that is comparable to the linear resolution of the display. The angular range of the light cone corresponds to the maximum field of view of the optical apparatus 500, for example, 45 degrees.
[0057] FIG. 9 shows an example illustration of light propagation through a portion of a WRAP apparatus which includes a z-axis optical coupler 562. FIG. 9 represents the relative orientations of the z-axis optical coupler 562, the distribution or y-axis optical coupler 510, and the linear or rectangular wave guides (interchangeably referred to as x-axis wave guides) 504. In the embodiment of FIG. 9, light initially enters via the z-axis optical coupler 562. The z-axis optical coupler may be similar in many respects to the linear or rectangular wave guides, for example having at least one pair of opposed planar sides that provide at least partial internal reflection to propagate or guide light along a length of the z-axis optical coupler 562. The z-axis optical coupler 562 contains a linear array of angled, planar micro-reflectors 564a- 564n (collectively 564) that multiply and inject copies of the incoming angular distribution of light into each of the distribution or y-axis optical couplers 510 of the various columns, sets or layers 506. The distribution or y-axis optical couplers 510 may be similar in construction to the z-axis optical coupler 562, having a linear array of angled, planar micro-reflectors 566a-566n (collectively 566). The distribution or y-axis optical couplers 510 multiplies and injects copies of the incoming angular distribution of light into each of the x-axis wave guides 504 in the respective column, set or layer 506.
[0058] As shown in FIG. 2A, narrow, angled, plane wave light beam 566 enters the linear or rectangular wave guide 504, reflecting from a planar reflector 568 toward at least one of the opposed reflective surfaces 532. When each narrow, angled, plane wave light beam propagates through the wave guide and strikes a curved micro-reflector 540, the plane wave light beam is split into two beams. Also as shown in FIG. 2A, a first beam continues to the next micro-reflector 540, and a second beam is reflected in a divergent pattern with a curvature that is twice as great as that of a surface of the micro-reflector 540 from which the second beam reflected. In other words, a narrow incident plane wave is converted into a small wedge-like section of a spherical wave front that has a 2D orientation that corresponds to that of the incident plane wave. If the 2D orientations of all of the curved micro-reflectors 540 in a 2D wave guide, column, set or layer 506 are varied in a very precise way, all of the spherical wave front wedges that are projected from each micro-reflector 540 can be aligned into a single spherical wave front 569 that appears to be radiating from a virtual point 570 located at the x and y coordinates that correspond to the 2D orientation of the plane wave 566 and the z-coordinate that corresponds to the curvature(s) of the micro-reflector 540 and 2D orientation gradient of the 2D wave guide, column, set or layer 506, as shown in FIG. 2B. For reference, FIGS. 13-15 show coordinate systems for virtual object points, a 4D light field on a display surface, and 2D micro-reflector orientations, respectively. [0059] As all of the angled, plane wave light beams in an input cone propagate throughout a 2D wave guide, plane, set or layer 506, the beams recreate the superposed light field that is produced by a single depth plane. When all of the input signals for each 2D wave guide, plane, set or layer 506 propagate throughout the 2D array 502 they reproduce the superposed light field that is generated by multiple depth plane volumes. If these depth planes are sufficiently numerous and have the appropriate thicknesses as a function of their radial distance (as determined by the depth of field equation), such that if the depth planes meet or exceed the limits of human z-coordinate resolution (as well as x, y coordinate resolution), then the light field that is generated from a virtual 3D volume should be indistinguishable to a human from that of a real, physical, three dimensional space.
[0060] Because of the unique optical properties of the materials that are used in the optical system 500 (as described herein) each 2D wave guide, plane, set or layer 506 is mutually unaffected by the other 2D wave guide, plane, set or layers 506. This feature allows the 2D wave guide, plane, set or layers 506 to be stacked on top of each other to create a multifocal optical system, a feature which is not believe to be possible with conventional lenses.
[0061] Additionally, orthogonal light polarization can be used to decouple light from the real outside world from that of the virtual display to create an augmented reality multiple depth plane 3D display. Polarized reflectors 540 only reflect that portion of light which is aligned parallel to the axis of polarization of the reflector. Cross polarized light is not reflected by the reflector 540, and in the case of a semi-transparent reflector 540, would simply pass through the reflector without being reflected. In this way, a 2D wave guide, plane, set or layer 506 can be made transparent to light from the outside world or to other 2D wave guide, plane, set or layers 506 simply by cross polarizing the 2D wave guide, plane, set or layer's 506 light.
[0062] If a 2D light pattern 1602 is generated that corresponds to the radial pinhole projections of the entire virtual 3D volume 1604 in a time sequential manner, and each of the points in the 2D field are depth indexed, for example, as shown in FIG. 16, then as shown in FIG. 8, a z-axis optical coupler 562 (FIG. 9) can be equipped with optical gates 522 that are synchronized with the beam deflector 550 to sort the light beams from a multiplexed input cone 542 into multiple output channel cones 572 (only one called out in FIG. 8 for clarity of drawing) that correspond to each of the depth plane in the virtual 3D volume 1604.
[0063] In the series method for driving the different 2D wave guide, plane, set or layers 506 of the 2D array 502 discussed above, the 2D array 502 is driven by a single single-mode fiber 514, 548, and the light cones 572 that correspond to the different 2D wave guide, plane, set or layers 506 are generated within the device itself. The light angles should be simultaneously created and sorted, one angle at a time. If the light angles are not created in a time sequential manner, the light angles cannot easily be sorted into each of the 2D wave guide, plane, set or layers 506.
Mathematical Observations
[0064] The optical apparatus 500 can be viewed as a mathematical operator that transforms 2D light fields into 4D light fields. FIG. 4 shows example details of the transformation. The optical apparatus 500 performs the transformation by applying a positive curvature to each of the light beams in an input cone 402 and mapping 406 a 2D array of differentially rotated copies of the modified light cone onto a surface of a display. These operations are physically generated by the array(s) of micro-reflectors 540 and have the effect of transforming narrow, plane wave light beams into wide, spherical wave fronts 404; converting light cones into virtual depth planes; and generating a 3D volume from a stack of two dimensional projections, as shown in the example of FIG. 12. (For comparison, FIGS. 4 and 12 also show an input cone 408 generated into a flat wave front 410.) FIG. 13 shows a coordinate system 1300 for virtual object points. FIG. 14 shows a coordinate system 1400 for a 4D light field on a display surface. FIG. 15 shows a coordinate system 1500 for two-dimensional micro-reflector orientations. [0065] Within the context of the optical apparatus 500, linear or rectangular wave guides 504 function as beam multipliers and wideners that mathematically and physically generate a wide 2D array of light beams based on the input of a single, narrow light beam. FIG. 19 illustrates how a light cone 1902a1902d (collectively 1902) is multiplied through the use of multiple beam splitters that transmit a portion of incident light and reflect a portion of the incident light.
Example System Specifications:
[0066] The micro-reflectors {e.g., curved micro-reflectors 504) should be partially transparent and perform the function of a beam splitter as well as a reflector. In this way, a single beam of light having a narrow range of angles can be repeatedly multiplied and redistributed through the array to create a wide 4D light field.
[0067] Further, the reflectances of the reflective surfaces (e.g. 532) of the wave guides {e.g., linear or rectangular wave guides 504) and the micro- reflectors {e.g., curved micro-reflectors 504) should be angle specific. Specifically, the micro-reflectors {e.g., curved micro-reflectors 504) should only reflect the angular modes of the input cone that are internally reflected from the surface {e.g., 532) of the wave guide {e.g., linear or rectangular wave guides 504), and should be transparent to all other angular modes. Each wave guide {e.g., linear or rectangular wave guides 504) should only be transparent to the angular modes which are reflected from the micro- reflectors {e.g., curved micro-reflectors 504) and should confine all other angular modes to the interior of the wave guide {e.g., linear or rectangular wave guides 504). This allows the light from the input cone to be distributed throughout the entire length of the wave guide {e.g., linear or rectangular wave guides 504) and to be coupled to each of the micro-reflectors {e.g., curved micro-reflectors 504) before being projected out of the 2D array 502. This also prevents light from striking the micro-reflectors {e.g., curved micro- reflectors 504) from two opposing surfaces {e.g., 532) in the wave guides {e.g., linear or rectangular wave guides 504), which would result in the creation of a dual set of images instead of a single set of images. [0068] This may restrict the field of view. For example, this may restrict the field of view to a maximum field of view (FOV) 700 (FIG. 7) of 45 degrees. Of the total possible 360 degrees of angles that can propagate in the wave guide, half of those angles (180 degrees) are propagating in the wrong direction (out of, instead of into the wave guide), another 45 degrees correspond to the field of view that is projected out by the micro-reflectors, and a further 45 degrees correspond to the angularly shifted light cone that is propagated by the wave guide before the light cone strikes the micro- reflectors. The remaining 90 degrees do not appear useable because these angles may create aliasing effects from the secondary reflections off the outer wave guide surface, as shown in FIG. 6. In practice, the field of view 700 of the optical apparatus 500 will be less than 45 degrees to accommodate the beam curvature that is produced by the micro-reflectors 540, as shown in FIG. 7.
[0069] The light beams that are coupled into the linear or rectangular wave guides 504 should be wide enough so that the micro-reflectors 540 are evenly covered by the light beams, and gaps and irregularities in the output are minimized. FIG. 20 shows an example where the width of the light beam 2002 is not wide enough to prevent gaps in the light beam array.
[0070] For the display to function as an augmented reality device, the light from the input cone should be polarized along a single axis, and the micro-reflectors 540 and reflective opposed surfaces 532 of the wave guides 504 should only reflect light that is polarized along the same axis. Furthermore, an exterior side of the display should have an orthogonally polarizing screen (not shown), such as a liquid crystal display, that allows the user to adjust the real-virtual contrast, i.e., the relative light intensities of the real and virtual visual fields. The orthogonally polarizing screen can also orthogonally polarize the light from the real world relative to the polarization axis of the virtual display, thus allowing the light to pass through the display without being affected by the micro-reflectors 540 or reflective opposed surfaces 532 of the linear or rectangular wave guides 504. [0071] Further, any phase differences and incoherence that is brought about by variations in path length, transit time and wavelength should be undetectable by the human visual system.
[0072] To be thin enough to be a wearable device, each 2D planar wave guide, column, set or layer 506 of the 2D array 502 should be as thin as possible. For example, in one embodiment with 10 layers, a thickness of approximately 1 mm per layer would work for the wearable device. With a larger number of layers, e.g., 25 to 35, near and far light fields can be fully recreated. However, fewer than 10 or greater than 35 layers can be used.
[0073] In some implementations, each 2D planar wave guide, column, set or layer 506 can be reconfigured in real-time, i.e., the curvature(s) of the micro-reflector(s) 504 and/or 2D orientation gradient can be dynamically varied in a rapid manner. Using such an implementation, the projection of each virtual depth layer can be time multiplexed, instead of being presented simultaneously. To do this, a single layer N-plane display system should be reconfigured at a rate N times that of the refresh rate of a single layer in an N-layer system. Dynamically configurable curved micro-reflectors 504a (FIG. 10) may be employed. For example, two dimensional liquid crystal surfaces can be used, where the shapes and orientations of the surfaces can be controlled with electric and/or magnetic fields, as shown in the example of FIG. 10. Alternatively, electrically and/or magnetically deformable microfluids can be used as the micro-reflectors 504b, where the shapes and orientations can be dynamically changed, as shown in the example of FIG. 17.
[0074] In some embodiments, transparent display screens whose pixels 540b are able to project light in specified directions can be used to change the direction of the projected light, for instance as shown in the examples of the bottom of FIG. 10 and FIG. 1 1 .
Operating the WRAP
[0075] FIG. 21 is a flow diagram illustrating an example process 2100 of re-creating a three-dimensional volume on a display by driving a multiple layer wave guide in parallel. At block 2105, the optical apparatus 502 receives multiple input light beams. Each of the multiple light beams can be delivered by a multi-mode optical fiber. Each of the multiple input light beams corresponds to an intensity pattern of a portion of a visual field in a different layer of the three-dimensional volume to be recreated.
[0076] Then at block 21 10, the system creates a set of intermediate light beams from each of the multiple input light beams.
[0077] Next, at block 21 15, the system independently rotates copies of the set of multiple intermediate light beams, and at block 2120, projects a wave front that appears to radiate from a virtual point. All of the projected wave fronts together recreate the 3D volume for viewing by the user.
Conclusion
[0078] Unless the context clearly requires otherwise, throughout the description and the claims, the words "comprise," "comprising," and the like are to be construed in an inclusive sense (i.e., to say, in the sense of "including, but not limited to"), as opposed to an exclusive or exhaustive sense. As used herein, the terms "connected," "coupled," or any variant thereof means any connection or coupling, either direct or indirect, between two or more elements. Such a coupling or connection between the elements can be physical, logical, or a combination thereof. Additionally, the words "herein," "above," "below," and words of similar import, when used in this application, refer to this application as a whole and not to any particular portions of this application. Where the context permits, words in the above Detailed Description using the singular or plural number may also include the plural or singular number respectively. The word "or," in reference to a list of two or more items, covers all of the following interpretations of the word: any of the items in the list, all of the items in the list, and any combination of the items in the list.
[0079] The above Detailed Description of examples of the invention is not intended to be exhaustive or to limit the invention to the precise form disclosed above. While specific examples for the invention are described above for illustrative purposes, various equivalent modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize. While processes or blocks are presented in a given order in this application, alternative implementations may perform routines having steps performed in a different order, or employ systems having blocks in a different order. Some processes or blocks may be deleted, moved, added, subdivided, combined, and/or modified to provide alternative or subcombinations. Also, while processes or blocks are at times shown as being performed in series, these processes or blocks may instead be performed or implemented in parallel, or may be performed at different times. Further any specific numbers noted herein are only examples. It is understood that alternative implementations may employ differing values or ranges.
[0080] The various illustrations and teachings provided herein can also be applied to systems other than the system described above. The elements and acts of the various examples described above can be combined to provide further implementations of the invention.
[0081] Any patents and applications and other references noted above, including any that may be listed in accompanying filing papers, are incorporated herein by reference. Aspects of the invention can be modified, if necessary, to employ the systems, functions, and concepts included in such references to provide further implementations of the invention.
[0082] These and other changes can be made to the invention in light of the above Detailed Description. While the above description describes certain examples of the invention, and describes the best mode contemplated, no matter how detailed the above appears in text, the invention can be practiced in many ways. Details of the system may vary considerably in its specific implementation, while still being encompassed by the invention disclosed herein. As noted above, particular terminology used when describing certain features or aspects of the invention should not be taken to imply that the terminology is being redefined herein to be restricted to any specific characteristics, features, or aspects of the invention with which that terminology is associated. In general, the terms used in the following claims should not be construed to limit the invention to the specific examples disclosed in the specification, unless the above Detailed Description section explicitly defines such terms. Accordingly, the actual scope of the invention encompasses not only the disclosed examples, but also all equivalent ways of practicing or implementing the invention under the claims.
[0083] While certain aspects of the invention are presented below in certain claim forms, the applicant contemplates the various aspects of the invention in any number of claim forms. For example, while only one aspect of the invention is recited as a means-plus-function claim under 35 U.S.C. § 1 12, sixth paragraph, other aspects may likewise be embodied as a means-plus-function claim, or in other forms, such as being embodied in a computer-readable medium. (Any claims intended to be treated under 35 U.S.C. § 1 12, If 6 will begin with the words "means for.") Accordingly, the applicant reserves the right to add additional claims after filing the application to pursue such additional claim forms for other aspects of the invention.
[0084] U.S. Patent Application No. 61/658,355, filed June 1 1 , 2012 is incorporated herein by reference in its entirety.

Claims

CLAIMS We claim:
1 . A wave guide reflector array projector apparatus, comprising:
a first planar set of a plurality of rectangular wave guides, each of the rectangular wave guides in the first planar set having at least a first side, a second side, a first face, and a second face, the second side opposed to the first side along a length of the rectangular wave guide, at least the first and the second sides forming an at least partially internally reflective optical path along at least a portion of the length of the rectangular wave guide, and each of the rectangular wave guides in the first planar set including a respective plurality of curved micro-reflectors disposed between the first and the second sides at respective positions along at least a portion of the length of the respective rectangular wave guide to partially reflect a respective portion of a spherical wave front outwardly from the first face of the respective rectangular wave guide; and
at least a second planar set of a plurality of rectangular wave guides, each of the rectangular wave guides in the second planar set having at least a first side, a second side, a first face, and a second face, the second side opposed to the first side along a length of the rectangular wave guide, at least the first and the second sides forming an at least partially internally reflective optical path along at least a portion of the length of the rectangular wave guide, and each of the rectangular wave guides in the second planar set including a respective plurality of curved micro-reflectors disposed between the first and the second sides at respective positions along at least a portion of the length of the respective rectangular wave guide to partially reflect a respective portion outwardly from the first face of the respective rectangular wave guide,
the second planar set of rectangular wave guides arranged laterally from the first planar set of rectangular wave guides along a first lateral (Z) axis, the first lateral axis perpendicular to a longitudinal axis (X), the longitudinal (X) axis parallel to the lengths of the rectangular wave guides of at least the first and the second planar sets.
2. The wave guide reflector array projector apparatus of claim 1 wherein the rectangular wave guides in each of the first and at least the second planar set are arranged laterally along a second lateral (Y) axis, the second lateral (Y) axis orthogonal with respect to the first lateral and the longitudinal axes.
3. The wave guide reflector array projector apparatus of claim 1 wherein the first faces of the rectangular wave guides of the second planar set parallel to the first faces of the rectangular wave guides of the first planar set.
4. The wave guide reflector array projector apparatus of claim 1 wherein the second planar set of wave guides is immediately adjacent the first planar set of wave guides.
5. The wave guide reflector array projector apparatus of claim 1 , further comprising:
a plurality of additional planar sets of wave guides, the first, the second and the plurality of additional sets of wave guide arranged as respective layers in a stack along the first lateral (Z) axis.
6. The wave guide reflector array projector apparatus of claim
5 wherein for each of the first, the second and the additional planar sets of the rectangular wave guides that comprise the respective first, the second and the additional planar set, the rectangular wave guides are stacked along the second lateral (Y) axis immediately adjacent to successive ones of one another.
7. The wave guide reflector array projector apparatus of claim
6 wherein the rectangular wave guides in each successive one of the first, the second, and the additional planar sets of rectangular wave guides are stacked along the first lateral (Z) axis immediately adjacent to successive ones of one another.
8. The wave guide reflector array projector apparatus of claim 5, further comprising:
a set of a plurality of second lateral (Y) axis distribution optical couplers, each of the second lateral (Y) axis distribution optical couplers in the set optically coupled to provide a respective optical path to a respective one of the first, the second, and the additional planar sets of the plurality of rectangular wave guides.
9. The wave guide reflector array projector apparatus of claim 8, further comprising:
a first lateral (Z) axis distribution coupler having a first end, a second end spaced from the first end along a length of the first lateral (Z) axis distribution coupler, and a plurality of at least partially reflective elements that provide an optical path between the first end of the lateral axis distribution coupler and a respective one of the second lateral (Y) axis distribution couplers of the set of the plurality of second lateral (Y) axis distribution couplers.
10. The wave guide reflector array projector apparatus of claim 9 wherein the at least partially reflective elements of the first lateral (Z) axis distribution coupler comprise a number of optical gates, and further comprising:
at least one light source, the at least one light source operable to emit red, green and blue pixel patterns;
an intensity modulator operable to modulate an intensity of the red, green and blue pixel patterns to produce modulated red, green and blue pixel patterns;
a beam deflector, the beam deflector optically coupled between at least one light source and the linear array of column distribution couplers and operable to deflect the modulated red, green and blue pixel patterns, and wherein the optical gates are controlled to operate in synchronization with the beam deflector; and
an input fiber optically coupled to the first lateral (Z) axis distribution coupler at least proximate the first end thereof to provide intensity modulated beam deflected pixel patterns as an input cone of light representative of at least a portion of an image to be projected via the wave guide reflector array projector apparatus.
1 1 . The optical apparatus of claim 8, further comprising:
a plurality of input fibers optically coupled to respective ones of the second lateral (Y) axis distribution couplers to provide an input cone of light representative of at least a portion of an image to be projected via the wave guide reflector array projector apparatus.
12. The wave guide reflector array projector apparatus of claim 1 wherein for each of the rectangular wave guides the plurality of curved micro- reflectors are aligned in a linear array.
13. The wave guide reflector array projector apparatus of claim 1 wherein the curved micro-reflectors are oriented to reflect a portion of light from the face of the respective rectangular wave guide in a spherical wave front.
14. The wave guide reflector array projector apparatus of claim 1 wherein the curved micro-reflectors are oriented to each reflect a conical projection of rays from the face of the respective rectangular wave guide to form a respective portion of a spherical wave front.
15. The wave guide reflector array projector apparatus of claim 1 wherein the curved micro-reflectors are each oriented at a respective angle about a second lateral (Y) axis to reflect a portion of light from the face of the respective rectangular wave guide in a spherical wave front, the second lateral (Y) axis orthogonal to the first lateral (Z) axis and the longitudinal (X) axis.
16. The wave guide reflector array projector apparatus of claim 1 wherein for each of at least some of the rectangular wave guides the respective angle about the second lateral (Y) axis for each of the respective curved micro-reflectors is greater than the respective angle of an immediately preceding one of the respective curved micro-reflectors as the longitudinal (X) axis is traversed.
17. The wave guide reflector array projector apparatus of claim 1 wherein the curved micro-reflectors are each oriented at a respective angle about the longitudinal (X) axis to reflect a portion of light from the face of the respective rectangular wave guide in a spherical wave front.
18. The wave guide reflector array projector apparatus of claim 1 wherein the curved micro-reflectors are each oriented at both a respective first angle about a second lateral (Y) axis and a respective second angle about an axis that is perpendicular to a plane in which the respective first angle lies to reflect a portion of light from the face of the respective rectangular wave guide in a spherical wave front, the second lateral (Y) axis orthogonal to the first lateral (Z) axis and the longitudinal (X) axis.
19. The wave guide reflector array projector apparatus of claim 1 wherein the curved micro-reflectors are each oriented at a respective angle about both of at least two different axes to refocus infinity focused light at specific radial distances.
20. The wave guide reflector array projector apparatus of claim 1 wherein the curved micro-reflectors are each oriented to reflect light received via an end of the respective rectangular wave guide out of the first face of the respective rectangular wave guide, where the first face through which the light is reflected outwardly of the respective rectangular wave guide is perpendicular to the end via which the light is received.
21 . The wave guide reflector array projector apparatus of claim 20 wherein the curved micro-reflectors reflect the light outwardly from the respective rectangular wave guide along respective radial axes (R) which are oriented at respective angles with respect to first face from which the light is reflected outward.
22. The wave guide reflector array projector apparatus of claim
21 wherein at least some of the respective radial axes (R) are oriented at both a respective first non-perpendicular angle and a respective second non- perpendicular angle with respect to the first face from which the light is reflected outward, the first and the second non- perpendicular angles being non-planar with one another.
23. The wave guide reflector array projector apparatus of claim
22 wherein the rectangular wave guides arranged laterally successively with one another along the first lateral (Z) axis are at least partially transmissive of light reflected from the curved micro-reflectors of one another in at least one direction.
24. The wave guide reflector array projector apparatus of claim
23 wherein the rectangular wave guides arranged laterally successively with one another along the first lateral (Z) axis are at least partially transmissive of light reflected from the curved micro-reflectors of one another in only one direction.
25. The wave guide reflector array projector apparatus of claim 23 wherein the rectangular wave guides arranged laterally successively with one another along the second lateral (Y) axis are not transmissive of light reflected from the curved micro-reflectors of one another.
26. The wave guide reflector array projector apparatus of claim 1 wherein for at least some of the rectangular wave guides, the plurality of curved micro-reflectors each have a respective first radius of curvature, the first radius of curvature for at least one of the curved micro-reflectors different from the first radius of curvature of at least another one of the curved micro-reflectors of the respective rectangular wave guide.
27. The wave guide reflector array projector apparatus of claim 1 wherein for at least some of the rectangular wave guides, the plurality of curved micro-reflectors each have a respective first radius of curvature about a first axis and a respective second radius of curvature about of second axis, the second axis not collinear with the first axis.
28. The wave guide reflector array projector apparatus of claim 27 wherein for at least some of the rectangular wave guides, the respective first and the respective second radii of curvature of at least one of curved micro- reflectors is different from the respective first and the respective second radii of curvature of at least a second one of the curved micro-reflectors of the respective rectangular wave guide.
29. The wave guide reflector array projector apparatus of claim 27 wherein for each of the rectangular wave guides, at least one of the first side, the second sides, the first face or second face substantially retain a first set of angular modes in the rectangular wave guide and substantially pass a second set of angular modes from the rectangular wave guide, and the respective curved micro-reflectors of the rectangular wave guide substantially reflect the second set of angular modes and substantially pass the first set of angular modes to traverse along the length of the respective rectangular wave guide.
30. An optical apparatus, comprising:
a two dimensional array of a plurality of wave guides arranged in a plurality of rows and columns, each of the wave guides having a first end, a second end spaced from the first end along a length of the wave guide, at least a first pair of opposed sides which are at least partially reflective toward an interior of the wave guide to reflect light along the length of the wave guide, the length which defines a major axis of the respective wave guide, each of the wave guides having a plurality of curved micro-reflectors disposed at respective positions along the length of the respective wave guide and which are at least partially reflective of at least defined wavelengths, the curved micro-reflectors oriented at respective angles with respect to the face of the respective wave guide to provide in conjunction with at least the first pair of opposed sides an optical path that extends between the face and the first end of the wave guide; and
a linear array of column distribution couplers, a respective column distribution coupler for each column of the two dimensional array of the plurality of rectangular wave guides, each of the column distribution couplers having a first end, a second end spaced from the first end along a length of the column distribution coupler, each of the column distribution couplers having a plurality of elements that provide an optical path between the first end of the column distribution coupler and a respective one of the wave guides in the respective column of the two dimensional array of the plurality of wave guides.
31 . The optical apparatus of claim 30 wherein each of the wave guides has a rectangular cross section.
32. The optical apparatus of claim 30 wherein the curved micro-reflectors are oriented to reflect a portion of electromagnetic energy from a face of the wave guide.
33. The optical apparatus of claim 30 wherein the curved micro-reflectors are oriented to reflect a portion of electromagnetic energy from a face of the wave guide in a spherical wave front.
34. The optical apparatus of claim 30 wherein the curved micro-reflectors are oriented to each reflect a conical projection of rays from a face of the wave guide to form a respective portion of a spherical wave front.
35. The optical apparatus of claim 30 wherein the curved micro-reflectors are each oriented at a respective angle about a lateral axis of the respective wave guide, the lateral axis perpendicular to the major axis, to reflect a portion of electromagnetic energy from a face of the wave guide in a spherical wave front.
36. The optical apparatus of claim 30 wherein the curved micro-reflectors are each oriented at a respective angle about the major axis to reflect a portion of electromagnetic energy from a face of the wave guide in a spherical wave front.
37. The optical apparatus of claim 30 wherein the curved micro-reflectors are each oriented at a respective angle about both the major axis and about a lateral axis of the respective wave guide, the lateral axis perpendicular to the major axis, to reflect a portion of electromagnetic energy from a face of the wave guide in a spherical wave front.
38. The optical apparatus of claim 30 wherein the curved micro-reflectors are each oriented at a respective angle about both the major axis and about a lateral axis of the respective wave guide, the lateral axis perpendicular to the major axis, to focus infinity focused light at specific radial distances.
39. The optical apparatus of claim 30 wherein the respective plurality of elements of each of the column distribution coupler comprises a linear array of splitters oriented to split at least a portion of light toward a respective one of the wave guides in the respective column of the two dimensional array of the plurality of rectangular wave guides.
40. The optical apparatus of claim 30 wherein each column of the two dimensional array of the plurality of rectangular wave guides forms a respective depth layer of a four dimensional image.
41 . The optical apparatus of claim 30, further comprising:
a lateral axis (Z axis) distribution coupler having a first end, a second end spaced from the first end along a length of the lateral axis distribution coupler, and a plurality of at least partially reflective elements that provide an optical path between the first end of the lateral axis distribution coupler and a respective one of the column distribution couplers of the linear array of column distribution couplers.
42. The optical apparatus of claim 41 , further comprising:
an input fiber (multiplexed) optically coupled to the lateral axis distribution coupler at least proximate the first end thereof to provide an input cone of light representative of an image to be projected via the optical apparatus.
43. The optical apparatus of claim 42 wherein the at least partially reflective elements of the lateral axis distribution coupler comprise a number of optical gates.
44. The optical apparatus of claim 43, further comprising:
a beam deflector optically coupled between at least one light source and the linear array of column distribution couplers, and wherein the optical gates are controlled to operate in synchronization with the beam deflector.
45. The optical apparatus of claim 44, further comprising:
the at least one light source, which is operable to emit red, green and blue light;
an intensity modulator operable to modulate an intensity of the red, green and blue light; and
a single mode optical fiber optically coupled between the at least one light source and the beam deflector.
46. The optical apparatus of claim 30, further comprising:
a plurality of input fibers (non-multiplexed) optically coupled to respective ones of the column distribution couplers at least proximate the first end of the respective column distribution coupler to provide an input cone of light representative of an image to be projected via the optical apparatus.
47. The optical apparatus of claim 30 wherein the curved micro-reflectors are at least one of dynamically deformable or dynamically orientable about at least one axis in response to at least one control signal.
48. The optical apparatus of claim 47 wherein the curved micro-reflectors comprise curved liquid crystal surfaces.
49. The optical apparatus of claim 30 wherein for each of the columns, the wave guides that comprise the column are stacked along a first lateral axis immediately adjacent to successive ones of one another, the first lateral axis perpendicular to the major axes of the wave guides.
50. The optical apparatus of claim 49 wherein for each of the plurality of rows in the two dimensional array of a plurality of wave guides, the wave guides that comprise the row are stacked along a second lateral axis immediately adjacent to successive ones of one another, the second lateral axis orthogonal with the major axes and the first lateral axes.
51 . The optical apparatus of claim 30 wherein for each of the plurality of rows in the two dimensional array of a plurality of wave guides, the wave guides that comprise the respective row are at least partially transmissive of light reflected from the curved micro-reflectors of the wave guides from other columns that comprise the respective row.
52. The optical apparatus of claim 51 wherein each of the columns in the two dimensional array of the plurality of wave guides, the wave guides that comprise the column are not transmissive of light reflected from the curved micro-reflectors of the other wave guides that comprise the respective column.
53. The optical apparatus of claim 30 wherein the curved micro-reflectors are each oriented to reflect light received via the first end of the respective wave guide out of the face of the respective wave guide, where the face through which the light is reflected outwardly of the respective wave guide is perpendicular to the first end via which the light is received.
54. The optical apparatus of claim 30 wherein for at least some of the wave guides, the plurality of curved micro-reflectors each have a respective first radius of curvature, the first radius of curvature for each of the curved micro-reflectors different from the first radius of curvature of each other of the curved micro-reflectors of the respective wave guide.
55. The optical apparatus of claim 30 wherein for at least some of the wave guides, the plurality of curved micro-reflectors each have a respective first radius of curvature about a first axis and a respective second radius of curvature about of second axis, the second axis not collinear with the first axis.
56. The optical apparatus of claim 55 wherein for at least some of the wave guides, the respective first and the respective second radii of curvature of at least one of curved micro-reflectors is different from the respective first and the respective second radii of curvature of at least a second one of the curved micro-reflectors of the respective wave guide.
57. The optical apparatus of claim 30 wherein the curved micro-reflectors allow a portion of light that is not reflected to traverse along the length of the respective wave guide.
58. The optical apparatus of claim 30 wherein for each of the wave guides, at least the first and the second sides substantially retain a first set of angular modes in the wave guide and substantially pass a second set of angular modes from the wave guide, and the respective curved micro-reflectors of the wave guide substantially reflect the second set of angular modes and substantially pass the first set of angular modes to traverse along the length of the respective wave guide.
59. An apparatus comprising
a coupling tube oriented in a first direction and having a series of beam splitters, wherein the coupling tube is configured to receive input light, and further wherein each of the beam splitters reflects a portion of light incident on the beam splitter to a wave guide and transmits a second portion of light;
multiple wave guides oriented in a second direction different from the first direction;
multiple sets of curved micro-reflectors, wherein a set of curved micro-reflectors is embedded in each of the multiple wave guides,
wherein each set of micro-reflectors reflects light into a three- dimensional (3D) pattern.
60. The system of claim 59, wherein each of the curved micro- reflectors are partially transparent.
61 . The system of claim 59, wherein the input light is a cone of light.
62. The system of claim 61 , wherein a first reflectance of each of the micro-reflectors reflects angular modes of the cone of light that are reflected from an inner surface of the corresponding wave guide and is transparent to other angular modes.
63. The system of claim 61 , wherein a second reflectance of each of the wave guides does not reflect angular modes reflected from the corresponding micro-reflectors and reflects other angular modes within the wave guide.
64. The system of claim 59, wherein the input light has a sufficiently wide so that no gap is present between light reflected from the micro-reflectors in the 3D pattern.
65. The system of claim 59, further comprising a multi-mode optical fiber configured to direct the input light into the coupling tube.
66. The system of claim 59, wherein the input light is polarized along a first axis, and the micro-reflectors and wave guide surfaces only reflect light polarized along the first axis.
67. The system of claim 66, wherein an exterior of a display housing the apparatus has an orthogonally polarizing screen configured to adjust a contrast level between external light and light reflected into the 3D pattern.
68. The system of claim 59, wherein a curvature and shape of the micro-reflectors are dynamically varied.
69. The system of claim 59, wherein the 3D pattern corresponds to a spherical wave front produced by a virtual point source at a given x-coordinate, y-coordinate, and z-coordinate.
70. The system of claim 69, wherein the x-coordinate and the y-coordinate are determined by a 2D angular orientation of each of the curved micro-reflectors in the multiple sets of curved micro-reflectors.
71 . The system of claim 69, wherein the z-coordinate is determined by a configuration of micro-reflector shapes and two-dimensional orientation gradients of the micro-reflectors.
72. The system of claim 59, wherein the second direction is substantially perpendicular to the first direction.
73. A three-dimensional projection system comprising multiple stacked apparatuses as claimed in claim 59, wherein the input light is directed into each coupling tube by a separate multi-mode optical fiber.
74. A system having an array of reflectors, wherein the array converts an input light beam into a stack of two-dimensional projections of virtual depth planes that recreates a three-dimensional volume on a display.
75. The system of claim 74, further comprising a coupling tube having multiple beam splitters configured to receive the input light beam and create multiple copies of the input light beam.
76. The system of claim 74, wherein the micro-reflectors in the array are partially transparent.
77. A method of recreating a three-dimensional volume for viewing, the method comprising:
receiving multiple input light beams, wherein each input light beam corresponds to an intensity pattern of a portion of a visual field in a different layer of the three-dimensional volume;
creating a set of multiple intermediate light beams from each of the multiple input light beams;
projecting at least a portion of each set of multiple intermediate light beams into a virtual depth plane; wherein together, the virtual depth planes recreate the three- dimensional volume.
78. The method of claim 77, wherein the multiple input light beams include light having a range of angles.
79. The method of claim 77, wherein projecting at least a portion of each set of multiple intermediate light beams into a virtual depth plane comprises independently rotating copies of the multiple intermediate light beams for each set and projecting a wave front that appears to radiate from a virtual point for each set.
80. A method of recreating a three-dimensional volume for viewing, the method comprising:
receiving time-multiplexed input light via a single single-mode fiber, wherein the received input light beam corresponds to an intensity pattern of a portion of a visual field for a plurality of depth planes of the three- dimensional volume;
transferring the received time-multiplexed input light to a z-axis optical coupler;
transferring the portions of the received time-multiplexed input light to respective ones of a set of y-axis distribution optical couplers by the z- axis optical coupler;
transferring the portions of the received time-multiplexed input light to respective sets of wave guides by the y-axis optical couplers; and
projecting at least a portion of the received time-multiplexed input light via the wave guides of each of at least some of the sets of wave guides, where each set of wave guide projects a respective virtual depth plane, the cumulative virtual depth planes forming the three-dimensional volume for viewing.
PCT/US2013/045267 2012-06-11 2013-06-11 Multiple depth plane three-dimensional display using a wave guide reflector array projector WO2013188464A1 (en)

Priority Applications (16)

Application Number Priority Date Filing Date Title
EP13803879.9A EP2859403B1 (en) 2012-06-11 2013-06-11 Multiple depth plane three-dimensional display using a wave guide reflector array projector
EP22195536.2A EP4130820A1 (en) 2012-06-11 2013-06-11 Multiple depth plane three-dimensional display using a wave guide reflector array projector
KR1020207010092A KR102217788B1 (en) 2012-06-11 2013-06-11 Multiple depth plane three-dimensional display using a wave guide reflector array projector
CN202211183246.8A CN115494654A (en) 2012-06-11 2013-06-11 Multi-depth planar three-dimensional display using a waveguide reflector array projector
KR1020157000711A KR102100438B1 (en) 2012-06-11 2013-06-11 Multiple depth plane three-dimensional display using a wave guide reflector array projector
CN201380042218.7A CN104737061B (en) 2012-06-11 2013-06-11 Use more depth plane three dimensional displays of the waveguided reflector arrays projector
NZ702897A NZ702897A (en) 2012-06-11 2013-06-11 Multiple depth plane three-dimensional display using a wave guide reflector array projector
AU2013274359A AU2013274359B2 (en) 2012-06-11 2013-06-11 Multiple depth plane three-dimensional display using a wave guide reflector array projector
JP2015517371A JP6238974B2 (en) 2012-06-11 2013-06-11 Multiple depth planar 3D displays using waveguide reflector array projectors
CA2876335A CA2876335C (en) 2012-06-11 2013-06-11 Multiple depth plane three-dimensional display using a wave guide reflector array projector
IL236176A IL236176A0 (en) 2012-06-11 2014-12-11 Multiple depth plane three-dimensional display using a wave guide reflector array projector
AU2017202843A AU2017202843B2 (en) 2012-06-11 2017-04-28 Multiple depth plane three-dimensional display using a wave guide reflector array projector
IL257945A IL257945B (en) 2012-06-11 2018-03-07 Multiple depth plane three-dimensional display using a wave guide reflector array projector
IL261484A IL261484B (en) 2012-06-11 2018-08-30 Multiple depth plane three-dimensional display using a wave guide reflector array projector
AU2018264080A AU2018264080B2 (en) 2012-06-11 2018-11-15 Multiple depth plane three-dimensional display using a wave guide reflector array projector
AU2020205208A AU2020205208B2 (en) 2012-06-11 2020-07-13 Multiple depth plane three-dimensional display using a wave guide reflector array projector

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201261658355P 2012-06-11 2012-06-11
US61/658,355 2012-06-11

Publications (1)

Publication Number Publication Date
WO2013188464A1 true WO2013188464A1 (en) 2013-12-19

Family

ID=49758682

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/045267 WO2013188464A1 (en) 2012-06-11 2013-06-11 Multiple depth plane three-dimensional display using a wave guide reflector array projector

Country Status (10)

Country Link
US (1) US9310559B2 (en)
EP (2) EP2859403B1 (en)
JP (2) JP6238974B2 (en)
KR (2) KR102100438B1 (en)
CN (4) CN107817555A (en)
AU (4) AU2013274359B2 (en)
CA (1) CA2876335C (en)
IL (3) IL236176A0 (en)
NZ (1) NZ702897A (en)
WO (1) WO2013188464A1 (en)

Cited By (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9541383B2 (en) 2013-07-12 2017-01-10 Magic Leap, Inc. Optical system having a return planar waveguide
WO2017017981A1 (en) * 2015-07-29 2017-02-02 オムロン株式会社 Optical device
US9612403B2 (en) 2013-06-11 2017-04-04 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
CN106575034A (en) * 2014-08-03 2017-04-19 威福光学有限公司 Exit pupil expanding diffractive optical waveguiding device
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
WO2018048018A1 (en) * 2016-09-08 2018-03-15 하정훈 Optical apparatus
WO2018057528A1 (en) 2016-09-21 2018-03-29 Magic Leap, Inc. Systems and methods for optical systems with exit pupil expander
JP2018509983A (en) * 2015-03-16 2018-04-12 マジック リープ,インコーポレイティド Method and system for diagnosing and treating diseases that impair health
EP3292431A4 (en) * 2015-05-04 2018-05-02 Magic Leap, Inc. Separated pupil optical systems for virtual and augmented reality and methods for displaying images using same
WO2018164914A3 (en) * 2017-03-07 2018-10-11 Apple Inc. Head-mounted display system
EP3326023A4 (en) * 2015-07-20 2018-12-19 Magic Leap, Inc. Collimating fiber scanner design with inward pointing angles in virtual/augmented reality system
EP3365712A4 (en) * 2016-10-09 2019-05-01 Lumus Ltd. Aperture multiplier using a rectangular waveguide
US10302835B2 (en) 2017-02-22 2019-05-28 Lumus Ltd. Light guide optical assembly
US10317690B2 (en) 2014-01-31 2019-06-11 Magic Leap, Inc. Multi-focal display system and method
US10338391B2 (en) 2015-10-06 2019-07-02 Magic Leap, Inc. Virtual/augmented reality system having reverse angle diffraction grating
US10440345B2 (en) 2015-03-12 2019-10-08 Beijing Zhigu Rui Tuo Tech Co., Ltd. Display control methods and apparatuses
US10437031B2 (en) 2016-11-08 2019-10-08 Lumus Ltd. Light-guide device with optical cutoff edge and corresponding production methods
US10481319B2 (en) 2017-03-22 2019-11-19 Lumus Ltd. Overlapping facets
US10520731B2 (en) 2014-11-11 2019-12-31 Lumus Ltd. Compact head-mounted display system protected by a hyperfine structure
US10536783B2 (en) 2016-02-04 2020-01-14 Magic Leap, Inc. Technique for directing audio in augmented reality system
US10551544B2 (en) 2018-01-21 2020-02-04 Lumus Ltd. Light-guide optical element with multiple-axis internal aperture expansion
US10587848B2 (en) 2016-01-20 2020-03-10 Magic Leap, Inc. Polarizing maintaining optical fiber in virtual/augmented reality system
US10598937B2 (en) 2005-11-08 2020-03-24 Lumus Ltd. Polarizing optical system
US10725729B2 (en) 2017-02-28 2020-07-28 Magic Leap, Inc. Virtual and real object recording in mixed reality device
US10809528B2 (en) 2014-04-23 2020-10-20 Lumus Ltd. Compact head-mounted display system
US10895679B2 (en) 2017-04-06 2021-01-19 Lumus Ltd. Light-guide optical element and method of its manufacture
US10962855B2 (en) 2017-02-23 2021-03-30 Magic Leap, Inc. Display system with variable power reflector
US10962784B2 (en) 2005-02-10 2021-03-30 Lumus Ltd. Substrate-guide optical device
US11016298B2 (en) 2015-10-05 2021-05-25 Magic Leap, Inc. Microlens collimator for scanning optical fiber in virtual/augmented reality system
WO2021107828A1 (en) * 2019-11-26 2021-06-03 Telefonaktiebolaget Lm Ericsson (Publ) Supply of multi-layer extended reality images to a user
US11086128B2 (en) 2017-09-28 2021-08-10 Magic Leap, Inc. Methods and apparatuses for reducing stray light emission from an eyepiece of an optical imaging system
US11106041B2 (en) 2016-04-08 2021-08-31 Magic Leap, Inc. Augmented reality systems and methods with variable focus lens elements
US11126842B2 (en) 2015-10-16 2021-09-21 Magic Leap, Inc. Eye pose identification using eye features
US11243434B2 (en) 2017-07-19 2022-02-08 Lumus Ltd. LCOS illumination via LOE
US11262587B2 (en) 2018-05-22 2022-03-01 Lumus Ltd. Optical system and method for improvement of light field uniformity
US11288350B2 (en) 2016-03-07 2022-03-29 Magic Leap, Inc. Blue light adjustment for biometric security
US11402629B2 (en) 2013-11-27 2022-08-02 Magic Leap, Inc. Separated pupil optical systems for virtual and augmented reality and methods for displaying images using same
US11415812B2 (en) 2018-06-26 2022-08-16 Lumus Ltd. Compact collimating optical device and system
US11445305B2 (en) 2016-02-04 2022-09-13 Magic Leap, Inc. Technique for directing audio in augmented reality system
EP4022218A4 (en) * 2020-02-02 2022-11-23 Lumus Ltd. Method for producing light-guide optical elements
US11523092B2 (en) 2019-12-08 2022-12-06 Lumus Ltd. Optical systems with compact image projector
US11526003B2 (en) 2018-05-23 2022-12-13 Lumus Ltd. Optical system including light-guide optical element with partially-reflective internal surfaces
US11538280B2 (en) 2015-08-21 2022-12-27 Magic Leap, Inc. Eyelid shape estimation using eye pose measurement
US11586065B2 (en) 2016-11-18 2023-02-21 Magic Leap, Inc. Spatially variable liquid crystal diffraction gratings
US11617559B2 (en) 2016-05-09 2023-04-04 Magic Leap, Inc. Augmented reality systems and methods for user health analysis
US11693282B2 (en) 2016-11-18 2023-07-04 Magic Leap, Inc. Liquid crystal diffractive devices with nano-scale pattern and methods of manufacturing the same
US11789264B2 (en) 2021-07-04 2023-10-17 Lumus Ltd. Display with stacked light-guide elements providing different parts of field of view
US11849262B2 (en) 2019-03-12 2023-12-19 Lumus Ltd. Image projector
US11914161B2 (en) 2019-06-27 2024-02-27 Lumus Ltd. Apparatus and methods for eye tracking based on eye imaging via light-guide optical element

Families Citing this family (262)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IL166799A (en) 2005-02-10 2014-09-30 Lumus Ltd Substrate-guided optical device utilizing beam splitters
GB0522968D0 (en) 2005-11-11 2005-12-21 Popovich Milan M Holographic illumination device
GB0718706D0 (en) 2007-09-25 2007-11-07 Creative Physics Ltd Method and apparatus for reducing laser speckle
US9335604B2 (en) 2013-12-11 2016-05-10 Milan Momcilo Popovich Holographic waveguide display
US11726332B2 (en) 2009-04-27 2023-08-15 Digilens Inc. Diffractive projection apparatus
US11204540B2 (en) 2009-10-09 2021-12-21 Digilens Inc. Diffractive waveguide providing a retinal image
US20200057353A1 (en) 2009-10-09 2020-02-20 Digilens Inc. Compact Edge Illuminated Diffractive Display
US9274349B2 (en) 2011-04-07 2016-03-01 Digilens Inc. Laser despeckler based on angular diversity
WO2016020630A2 (en) 2014-08-08 2016-02-11 Milan Momcilo Popovich Waveguide laser illuminator incorporating a despeckler
EP2748670B1 (en) 2011-08-24 2015-11-18 Rockwell Collins, Inc. Wearable data display
US10670876B2 (en) 2011-08-24 2020-06-02 Digilens Inc. Waveguide laser illuminator incorporating a despeckler
US20150010265A1 (en) 2012-01-06 2015-01-08 Milan, Momcilo POPOVICH Contact image sensor using switchable bragg gratings
EP2842003B1 (en) 2012-04-25 2019-02-27 Rockwell Collins, Inc. Holographic wide angle display
WO2013167864A1 (en) 2012-05-11 2013-11-14 Milan Momcilo Popovich Apparatus for eye tracking
IL219907A (en) 2012-05-21 2017-08-31 Lumus Ltd Head-mounted display eyeball tracker integrated system
US9122966B2 (en) 2012-09-07 2015-09-01 Lawrence F. Glaser Communication device
US11593776B2 (en) 2012-09-07 2023-02-28 Studebaker & Brackett PC Communication device to sense one or more biometric characteristics of a user
US10044985B1 (en) * 2012-10-19 2018-08-07 Amazon Technologies, Inc. Video monitoring using plenoptic cameras and mirrors
US9933684B2 (en) * 2012-11-16 2018-04-03 Rockwell Collins, Inc. Transparent waveguide display providing upper and lower fields of view having a specific light output aperture configuration
WO2014188149A1 (en) 2013-05-20 2014-11-27 Milan Momcilo Popovich Holographic waveguide eye tracker
US10262462B2 (en) 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
WO2015015138A1 (en) 2013-07-31 2015-02-05 Milan Momcilo Popovich Method and apparatus for contact image sensing
US10203762B2 (en) 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US11138793B2 (en) 2014-03-14 2021-10-05 Magic Leap, Inc. Multi-depth plane display system with reduced switching between depth planes
US10430985B2 (en) 2014-03-14 2019-10-01 Magic Leap, Inc. Augmented reality systems and methods utilizing reflections
WO2015145119A1 (en) * 2014-03-24 2015-10-01 Wave Optics Ltd Display system
KR102193052B1 (en) 2014-05-30 2020-12-18 매직 립, 인코포레이티드 Methods and systems for generating virtual content display with a virtual or augmented reality apparatus
US10852838B2 (en) 2014-06-14 2020-12-01 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US10359736B2 (en) 2014-08-08 2019-07-23 Digilens Inc. Method for holographic mastering and replication
WO2016042283A1 (en) 2014-09-19 2016-03-24 Milan Momcilo Popovich Method and apparatus for generating input images for holographic waveguide displays
EP3198192A1 (en) 2014-09-26 2017-08-02 Milan Momcilo Popovich Holographic waveguide opticaltracker
CA2962899C (en) 2014-09-29 2022-10-04 Robert Dale Tekolste Architectures and methods for outputting different wavelength light out of waveguides
WO2016054079A1 (en) 2014-09-29 2016-04-07 Zyomed Corp. Systems and methods for blood glucose and other analyte detection and measurement using collision computing
US10154239B2 (en) 2014-12-30 2018-12-11 Onpoint Medical, Inc. Image-guided surgery with surface reconstruction and augmented reality visualization
EP3245551B1 (en) 2015-01-12 2019-09-18 DigiLens Inc. Waveguide light field displays
WO2016113534A1 (en) 2015-01-12 2016-07-21 Milan Momcilo Popovich Environmentally isolated waveguide display
CN107533137A (en) 2015-01-20 2018-01-02 迪吉伦斯公司 Holographical wave guide laser radar
US9632226B2 (en) 2015-02-12 2017-04-25 Digilens Inc. Waveguide grating device
WO2016146963A1 (en) 2015-03-16 2016-09-22 Popovich, Milan, Momcilo Waveguide device incorporating a light pipe
WO2016156776A1 (en) 2015-03-31 2016-10-06 Milan Momcilo Popovich Method and apparatus for contact image sensing
CN106293557B (en) 2015-05-04 2019-12-03 北京智谷睿拓技术服务有限公司 Display control method and device
CN106293561B (en) 2015-05-28 2020-02-28 北京智谷睿拓技术服务有限公司 Display control method and device and display equipment
CN106303315B (en) 2015-05-30 2019-08-16 北京智谷睿拓技术服务有限公司 Video display control method and device, display equipment
CN106303499B (en) 2015-05-30 2018-10-16 北京智谷睿拓技术服务有限公司 Video display control method and device, display equipment
CN106303498B (en) 2015-05-30 2018-10-16 北京智谷睿拓技术服务有限公司 Video display control method and device, display equipment
KR20240014621A (en) 2015-06-15 2024-02-01 매직 립, 인코포레이티드 Virtual and augmented reality systems and methods
US10492981B1 (en) 2015-07-17 2019-12-03 Bao Tran Systems and methods for computer assisted operation
US10685488B1 (en) 2015-07-17 2020-06-16 Naveen Kumar Systems and methods for computer assisted operation
US10335572B1 (en) 2015-07-17 2019-07-02 Naveen Kumar Systems and methods for computer assisted operation
US10149958B1 (en) 2015-07-17 2018-12-11 Bao Tran Systems and methods for computer assisted operation
US10176642B2 (en) 2015-07-17 2019-01-08 Bao Tran Systems and methods for computer assisted operation
JP2017032673A (en) * 2015-07-30 2017-02-09 日本電気硝子株式会社 Light guide plate and laminated light guide plate prepared therewith
CN114998557A (en) 2015-08-18 2022-09-02 奇跃公司 Virtual and augmented reality systems and methods
KR20180044346A (en) 2015-08-21 2018-05-02 매직 립, 인코포레이티드 Eyelid shape estimation
JP6887422B2 (en) 2015-09-16 2021-06-16 マジック リープ, インコーポレイテッドMagic Leap,Inc. Head posture mixing of audio files
AU2016326384B2 (en) 2015-09-23 2021-09-09 Magic Leap, Inc. Eye imaging with an off-axis imager
EP3359999A1 (en) 2015-10-05 2018-08-15 Popovich, Milan Momcilo Waveguide display
CA3002369A1 (en) 2015-10-20 2017-04-27 Magic Leap, Inc. Selecting virtual objects in a three-dimensional space
WO2017079329A1 (en) 2015-11-04 2017-05-11 Magic Leap, Inc. Dynamic display calibration based on eye-tracking
US11231544B2 (en) 2015-11-06 2022-01-25 Magic Leap, Inc. Metasurfaces for redirecting light and methods for fabricating
US10204451B2 (en) 2015-11-30 2019-02-12 Microsoft Technology Licensing, Llc Multi-optical surface optical design
CA3010237A1 (en) * 2016-01-07 2017-07-13 Magic Leap, Inc. Virtual and augmented reality systems and methods having unequal numbers of component color images distributed across depth planes
KR102483345B1 (en) 2016-01-19 2022-12-29 매직 립, 인코포레이티드 Acquire, select and combine eye images
IL260604B2 (en) 2016-01-19 2023-09-01 Magic Leap Inc Augmented reality systems and methods utilizing reflections
WO2017127897A1 (en) 2016-01-27 2017-08-03 Paul Lapstun Shuttered waveguide light field display
IL260825B (en) 2016-01-29 2022-06-01 Magic Leap Inc Display for three-dimensional image
US10429639B2 (en) 2016-01-31 2019-10-01 Paul Lapstun Head-mounted light field display
EP3398007A1 (en) 2016-02-04 2018-11-07 DigiLens, Inc. Holographic waveguide optical tracker
CA3014189A1 (en) * 2016-02-11 2017-08-17 Magic Leap, Inc. Multi-depth plane display system with reduced switching between depth planes
IL261102B2 (en) 2016-02-24 2023-10-01 Magic Leap Inc Low profile interconnect for light emitter
KR20180114162A (en) 2016-02-24 2018-10-17 매직 립, 인코포레이티드 Polarizing beam splitter with low light leakage
AU2017223997B2 (en) 2016-02-26 2021-09-16 Magic Leap, Inc. Light output system with reflector and lens for highly spatially uniform light output
IL295839A (en) 2016-02-26 2022-10-01 Magic Leap Inc Display system having a plurality of light pipes for a plurality of light emitters
WO2017151467A1 (en) 2016-02-29 2017-09-08 Magic Leap, Inc. Virtual and augmented reality systems and methods
JP6978423B2 (en) 2016-03-01 2021-12-08 マジック リープ, インコーポレイテッドMagic Leap, Inc. Reflection switching device for inputting different wavelengths of light into a waveguide
JP7190903B2 (en) 2016-03-04 2022-12-16 マジック リープ, インコーポレイテッド Current drain reduction in AR/VR display systems
CN111329551A (en) 2016-03-12 2020-06-26 P·K·朗 Augmented reality guidance for spinal and joint surgery
CN105589202A (en) * 2016-03-18 2016-05-18 京东方科技集团股份有限公司 Display device, display method, and display system
KR102504245B1 (en) 2016-03-22 2023-02-24 매직 립, 인코포레이티드 Head mounted display system configured to exchange biometric information
US10859768B2 (en) 2016-03-24 2020-12-08 Digilens Inc. Method and apparatus for providing a polarization selective holographic waveguide device
NZ746514A (en) 2016-03-25 2020-03-27 Magic Leap Inc Virtual and augmented reality systems and methods
US9411167B1 (en) 2016-03-29 2016-08-09 Kedrick F. Brown Auto-multiscopic 3D billboard display system
US9554738B1 (en) 2016-03-30 2017-01-31 Zyomed Corp. Spectroscopic tomography systems and methods for noninvasive detection and measurement of analytes using collision computing
WO2017172982A1 (en) 2016-03-31 2017-10-05 Magic Leap, Inc. Interactions with 3d virtual objects using poses and multiple-dof controllers
US10317679B2 (en) 2016-04-04 2019-06-11 Akonia Holographics, Llc Light homogenization
WO2017178781A1 (en) 2016-04-11 2017-10-19 GRANT, Alastair, John Holographic waveguide apparatus for structured light projection
KR102445364B1 (en) 2016-04-21 2022-09-19 매직 립, 인코포레이티드 visual aura around the field of view
NZ787464A (en) 2016-04-26 2023-06-30 Magic Leap Inc Electromagnetic tracking with augmented reality systems
US10046229B2 (en) 2016-05-02 2018-08-14 Bao Tran Smart device
CN109476175B (en) 2016-05-06 2021-07-30 奇跃公司 Supersurface with asymmetric grating for redirecting light and method of making same
AU2017264780B2 (en) 2016-05-12 2022-05-12 Magic Leap, Inc. Distributed light manipulation over imaging waveguide
WO2017201329A1 (en) 2016-05-20 2017-11-23 Magic Leap, Inc. Contextual awareness of user interface menus
US9491444B2 (en) 2016-05-27 2016-11-08 Kedrick F. Brown Auto-multiscopic 3D display system
CA3025936A1 (en) 2016-06-03 2017-12-07 Magic Leap, Inc. Augmented reality identity verification
JP6978442B2 (en) 2016-06-10 2021-12-08 マジック リープ, インコーポレイテッドMagic Leap, Inc. Integral point source for textured projection bulbs
KR102491130B1 (en) 2016-06-20 2023-01-19 매직 립, 인코포레이티드 Augmented reality display system for evaluation and modification of neurological conditions, including visual processing and perception conditions
CN116777994A (en) 2016-06-30 2023-09-19 奇跃公司 Estimating pose in 3D space
EP3270208B1 (en) 2016-07-12 2024-03-06 Essilor International Method for supplying a display device for an electronic information device
JP7001672B2 (en) 2016-07-14 2022-01-19 マジック リープ, インコーポレイテッド Deep neural network for iris recognition
CN109661194B (en) 2016-07-14 2022-02-25 奇跃公司 Iris boundary estimation using corneal curvature
CN109788901B (en) 2016-07-25 2024-01-02 奇跃公司 Light field processor system
CA3031771A1 (en) 2016-07-25 2018-02-01 Magic Leap, Inc. Imaging modification, display and visualization using augmented and virtual reality eyewear
KR102639135B1 (en) 2016-07-29 2024-02-20 매직 립, 인코포레이티드 Secure exchange of cryptographically signed records
IL264690B (en) 2016-08-11 2022-06-01 Magic Leap Inc Automatic placement of a virtual object in a three-dimensional space
JP6814279B2 (en) 2016-08-12 2021-01-13 マジック リープ, インコーポレイテッドMagic Leap,Inc. Wordflow annotation
NZ750551A (en) 2016-08-22 2023-05-26 Magic Leap Inc Multi-layer diffractive eyepiece
CA3034644A1 (en) 2016-08-22 2018-03-01 Magic Leap, Inc. Augmented reality display device with deep learning sensors
CN109642716B (en) * 2016-09-07 2021-07-23 奇跃公司 Virtual reality, augmented reality, and mixed reality systems including thick media and related methods
KR20230130773A (en) * 2016-09-13 2023-09-12 매직 립, 인코포레이티드 Sensory eyewear
US10558047B2 (en) 2016-09-22 2020-02-11 Magic Leap, Inc. Augmented reality spectroscopy
KR102357876B1 (en) 2016-09-26 2022-01-28 매직 립, 인코포레이티드 Calibration of Magnetic and Optical Sensors in Virtual Reality or Augmented Reality Display Systems
CN114356098A (en) 2016-09-28 2022-04-15 奇跃公司 Face model capture by wearable device
RU2016138608A (en) 2016-09-29 2018-03-30 Мэджик Лип, Инк. NEURAL NETWORK FOR SEGMENTING THE EYE IMAGE AND ASSESSING THE QUALITY OF THE IMAGE
IL281321B (en) 2016-10-04 2022-07-01 Magic Leap Inc Efficient data layouts for convolutional neural networks
IL295059A (en) 2016-10-05 2022-09-01 Magic Leap Inc Periocular test for mixed reality calibration
CA3039990A1 (en) 2016-10-21 2018-04-26 Magic Leap, Inc. System and method for presenting image content on multiple depth planes by providing multiple intra-pupil parallax views
JP6913164B2 (en) 2016-11-11 2021-08-04 マジック リープ, インコーポレイテッドMagic Leap,Inc. Full facial image peri-eye and audio composition
WO2018093796A1 (en) 2016-11-15 2018-05-24 Magic Leap, Inc. Deep learning system for cuboid detection
AU2017361096B2 (en) 2016-11-16 2022-09-01 Magic Leap, Inc. Thermal management systems for wearable components
CN110199220B (en) 2016-11-18 2022-11-01 奇跃公司 Waveguide optical multiplexer using crossed grating
CN110178077B (en) 2016-11-18 2022-08-30 奇跃公司 Multilayer liquid crystal diffraction grating for redirecting light with a wide range of incident angles
US11668876B2 (en) * 2016-11-29 2023-06-06 Technische Universiteit Eindhoven Two-dimensional optical beam steering module
CN106371222A (en) * 2016-11-30 2017-02-01 苏州苏大维格光电科技股份有限公司 Waveguide lens of nanometer optical lens and multi-field-depth 3D display device
KR20240038823A (en) 2016-12-01 2024-03-25 매직 립, 인코포레이티드 Projector with scanning array light engine
EP3548939A4 (en) 2016-12-02 2020-11-25 DigiLens Inc. Waveguide device with uniform output illumination
US10531220B2 (en) 2016-12-05 2020-01-07 Magic Leap, Inc. Distributed audio capturing techniques for virtual reality (VR), augmented reality (AR), and mixed reality (MR) systems
CA3045664A1 (en) 2016-12-05 2018-06-14 Magic Leap, Inc. Virtual user input controls in a mixed reality environment
IL304304B1 (en) 2016-12-08 2024-04-01 Magic Leap Inc Diffractive devices based on cholesteric liquid crystal
US9762892B2 (en) 2016-12-11 2017-09-12 Lightscope Media, Llc Auto-multiscopic 3D display and camera system
US9955144B2 (en) 2016-12-11 2018-04-24 Lightscope Media, Llc 3D display system
EP3555865A4 (en) 2016-12-13 2020-07-08 Magic Leap, Inc. 3d object rendering using detected features
KR102170123B1 (en) 2016-12-14 2020-10-26 주식회사 엘지화학 Waveguide having light shielding and manufacturing method for the same
JP7164525B2 (en) 2016-12-14 2022-11-01 マジック リープ, インコーポレイテッド Liquid crystal patterning using soft imprint replication of surface-matched patterns
US10371896B2 (en) 2016-12-22 2019-08-06 Magic Leap, Inc. Color separation in planar waveguides using dichroic filters
US10746999B2 (en) 2016-12-28 2020-08-18 Magic Leap, Inc. Dual depth exit pupil expander
US11138436B2 (en) 2016-12-29 2021-10-05 Magic Leap, Inc. Automatic control of wearable display device based on external conditions
KR20230117764A (en) 2017-01-05 2023-08-09 매직 립, 인코포레이티드 Patterning of high refractive index glasses by plasma etching
US10545346B2 (en) 2017-01-05 2020-01-28 Digilens Inc. Wearable heads up displays
US10108014B2 (en) 2017-01-10 2018-10-23 Microsoft Technology Licensing, Llc Waveguide display with multiple focal depths
CN116230153A (en) * 2017-01-11 2023-06-06 奇跃公司 Medical assistant
EP3568070B1 (en) 2017-01-16 2024-01-03 Philipp K. Lang Optical guidance for surgical, medical, and dental procedures
EP4250242A3 (en) 2017-01-23 2023-11-29 Magic Leap, Inc. Eyepiece for virtual, augmented, or mixed reality systems
US10841724B1 (en) 2017-01-24 2020-11-17 Ha Tran Enhanced hearing system
IL268115B2 (en) 2017-01-27 2024-01-01 Magic Leap Inc Antireflection coatings for metasurfaces
KR20230106742A (en) 2017-01-27 2023-07-13 매직 립, 인코포레이티드 Diffraction gratings formed by metasurfaces having differently oriented nanobeams
CN110431467A (en) 2017-01-28 2019-11-08 鲁姆斯有限公司 Augmented reality imaging system
US11347054B2 (en) 2017-02-16 2022-05-31 Magic Leap, Inc. Systems and methods for augmented reality
AU2018234409B2 (en) 2017-03-14 2022-06-30 Magic Leap, Inc. Waveguides with light absorbing films and processes for forming the same
EP3596659A4 (en) 2017-03-17 2021-01-27 Magic Leap, Inc. Room layout estimation methods and techniques
US10564533B2 (en) 2017-03-21 2020-02-18 Magic Leap, Inc. Low-profile beam splitter
CN115047627A (en) 2017-03-21 2022-09-13 奇跃公司 Method, apparatus and system for illuminating a spatial light modulator
IL303471B1 (en) 2017-03-21 2024-04-01 Magic Leap Inc Eye-imaging apparatus using diffractive optical elements
CN110431841B (en) 2017-03-21 2021-08-17 奇跃公司 Depth sensing techniques for virtual, augmented and mixed reality systems
US11644669B2 (en) 2017-03-22 2023-05-09 Magic Leap, Inc. Depth based foveated rendering for display systems
US10859812B2 (en) * 2017-03-22 2020-12-08 Magic Leap, Inc. Dynamic field of view variable focus display system
KR20190132507A (en) * 2017-04-06 2019-11-27 콘스탄틴 로가츠 Method for blending virtual images into an image viewable by the wearer of the glasses through augmented reality (AR) glasses and at least one spectacle lens
KR102377377B1 (en) 2017-04-18 2022-03-21 매직 립, 인코포레이티드 Waveguides having reflective layers formed by reflective flowable materials
EP4220258A1 (en) 2017-04-19 2023-08-02 Magic Leap, Inc. Multimodal task execution and text editing for a wearable system
CN110832439B (en) 2017-04-27 2023-09-29 奇跃公司 Luminous user input device
KR102552551B1 (en) 2017-05-19 2023-07-06 매직 립, 인코포레이티드 Keyboards for virtual, augmented and mixed reality display systems
IL270564B (en) 2017-05-22 2022-07-01 Magic Leap Inc Pairing with companion device
JP7319927B2 (en) 2017-05-30 2023-08-02 マジック リープ, インコーポレイテッド Power supply assembly with fan assembly for electronic devices
WO2018222753A1 (en) 2017-05-31 2018-12-06 Magic Leap, Inc. Eye tracking calibration techniques
CN107238928B (en) 2017-06-09 2020-03-06 京东方科技集团股份有限公司 Array waveguide
US11307420B2 (en) 2017-07-03 2022-04-19 Holovisions LLC Augmented reality eyewear with “ghost buster” technology
US11163163B2 (en) 2017-07-03 2021-11-02 Holovisions Augmented reality (AR) eyewear with at least one quasi Fresnel reflector (QFR)
US10859834B2 (en) 2017-07-03 2020-12-08 Holovisions Space-efficient optical structures for wide field-of-view augmented reality (AR) eyewear
US10338400B2 (en) 2017-07-03 2019-07-02 Holovisions LLC Augmented reality eyewear with VAPE or wear technology
US11754843B2 (en) 2017-07-03 2023-09-12 Holovisions LLC Augmented reality eyewear with “ghost buster” technology
US10908680B1 (en) 2017-07-12 2021-02-02 Magic Leap, Inc. Pose estimation using electromagnetic tracking
IL271929B (en) 2017-07-26 2022-07-01 Magic Leap Inc Training a neural network with representations of user interface devices
US11138915B2 (en) 2017-07-28 2021-10-05 Magic Leap, Inc. Fan assembly for displaying an image
US10521661B2 (en) 2017-09-01 2019-12-31 Magic Leap, Inc. Detailed eye shape model for robust biometric applications
US11801114B2 (en) 2017-09-11 2023-10-31 Philipp K. Lang Augmented reality display for vascular and other interventions, compensation for cardiac and respiratory motion
IL272289B (en) 2017-09-20 2022-08-01 Magic Leap Inc Personalized neural network for eye tracking
EP3685215B1 (en) 2017-09-21 2024-01-03 Magic Leap, Inc. Augmented reality display with waveguide configured to capture images of eye and/or environment
US10409071B2 (en) 2017-09-27 2019-09-10 University Of Miami Visual enhancement for dynamic vision defects
US10531795B1 (en) 2017-09-27 2020-01-14 University Of Miami Vision defect determination via a dynamic eye-characteristic-based fixation point
CA3075934A1 (en) 2017-09-27 2019-04-04 University Of Miami Digital therapeutic corrective spectacles
US10742944B1 (en) 2017-09-27 2020-08-11 University Of Miami Vision defect determination for facilitating modifications for vision defects related to double vision or dynamic aberrations
US10389989B2 (en) 2017-09-27 2019-08-20 University Of Miami Vision defect determination and enhancement using a prediction model
JP7303557B2 (en) * 2017-09-29 2023-07-05 ルムス エルティーディー. augmented reality display
CN116149058A (en) 2017-10-16 2023-05-23 迪吉伦斯公司 System and method for multiplying image resolution of pixellated display
EP3704592A4 (en) 2017-10-26 2022-03-16 Magic Leap, Inc. Gradient normalization systems and methods for adaptive loss balancing in deep multitask networks
CN111373296B (en) 2017-11-21 2023-02-28 鲁姆斯有限公司 Optical aperture expansion arrangement for near-eye displays
EP4293414A3 (en) 2017-12-15 2024-03-13 Magic Leap, Inc. Eyepieces for augmented reality display system
US10506220B2 (en) 2018-01-02 2019-12-10 Lumus Ltd. Augmented reality displays with active alignment and corresponding methods
WO2019136476A1 (en) 2018-01-08 2019-07-11 Digilens, Inc. Waveguide architectures and related methods of manufacturing
EP3710893A4 (en) 2018-01-08 2021-09-22 Digilens Inc. Systems and methods for high-throughput recording of holographic gratings in waveguide cells
US11348257B2 (en) 2018-01-29 2022-05-31 Philipp K. Lang Augmented reality guidance for orthopedic and other surgical procedures
US10540941B2 (en) 2018-01-30 2020-01-21 Magic Leap, Inc. Eclipse cursor for mixed reality displays
US11567627B2 (en) 2018-01-30 2023-01-31 Magic Leap, Inc. Eclipse cursor for virtual content in mixed reality displays
US10735649B2 (en) 2018-02-22 2020-08-04 Magic Leap, Inc. Virtual and augmented reality systems and methods using display system control information embedded in image data
EP4212222A1 (en) 2018-03-07 2023-07-19 Magic Leap, Inc. Visual tracking of peripheral devices
CN112136094A (en) 2018-03-16 2020-12-25 奇跃公司 Depth-based foveated rendering for display systems
US10690851B2 (en) 2018-03-16 2020-06-23 Digilens Inc. Holographic waveguides incorporating birefringence control and methods for their fabrication
WO2019183399A1 (en) 2018-03-21 2019-09-26 Magic Leap, Inc. Augmented reality system and method for spectroscopic analysis
CN108469684B (en) * 2018-05-22 2024-04-30 成都工业学院 Transparent display and display system
US10861242B2 (en) 2018-05-22 2020-12-08 Magic Leap, Inc. Transmodal input fusion for a wearable system
JP6793882B2 (en) * 2018-05-24 2020-12-02 三菱電機株式会社 Display control device for vehicles
US11157159B2 (en) 2018-06-07 2021-10-26 Magic Leap, Inc. Augmented reality scrollbar
US11624909B2 (en) 2018-06-18 2023-04-11 Magic Leap, Inc. Head-mounted display systems with power saving functionality
CN112805997A (en) * 2018-06-30 2021-05-14 石井房雄 Augmented Reality (AR) display
WO2020018938A1 (en) 2018-07-19 2020-01-23 Magic Leap, Inc. Content interaction driven by eye metrics
WO2020023542A1 (en) 2018-07-24 2020-01-30 Magic Leap, Inc. Display systems and methods for determining registration between a display and eyes of a user
USD924204S1 (en) 2018-07-24 2021-07-06 Magic Leap, Inc. Totem controller having an illumination region
USD918176S1 (en) 2018-07-24 2021-05-04 Magic Leap, Inc. Totem controller having an illumination region
USD930614S1 (en) 2018-07-24 2021-09-14 Magic Leap, Inc. Totem controller having an illumination region
US11402801B2 (en) 2018-07-25 2022-08-02 Digilens Inc. Systems and methods for fabricating a multilayer optical structure
US11227435B2 (en) 2018-08-13 2022-01-18 Magic Leap, Inc. Cross reality system
CN112805750A (en) 2018-08-13 2021-05-14 奇跃公司 Cross-reality system
IL281242B1 (en) 2018-09-09 2024-02-01 Lumus Ltd Optical systems including light-guide optical elements with two-dimensional expansion
US11103763B2 (en) 2018-09-11 2021-08-31 Real Shot Inc. Basketball shooting game using smart glasses
US11141645B2 (en) 2018-09-11 2021-10-12 Real Shot Inc. Athletic ball game using smart glasses
US11803056B2 (en) * 2018-09-14 2023-10-31 Apple Inc. Waveguided display systems
US10969604B2 (en) * 2018-09-20 2021-04-06 E Ink Corporation Three dimensional display apparatus
WO2020072985A1 (en) 2018-10-05 2020-04-09 Magic Leap, Inc. Rendering location specific virtual content in any location
CN111007589A (en) * 2018-10-08 2020-04-14 成都理想境界科技有限公司 Waveguide module, display module based on waveguide and near-to-eye display equipment
WO2020081085A1 (en) * 2018-10-16 2020-04-23 Facebook Technologies, Llc Display waveguide assembly with color cross-coupling
US11237393B2 (en) 2018-11-20 2022-02-01 Magic Leap, Inc. Eyepieces for augmented reality display system
US11899235B2 (en) 2018-12-05 2024-02-13 Elbit Systems Ltd. Display illumination optics
EP3911983B1 (en) 2019-01-15 2024-02-14 Lumus Ltd. Method of fabricating a symmetric light guide optical element
EP4220276A3 (en) 2019-01-24 2023-08-09 Lumus Ltd. Optical systems including loe with three stage expansion
US11857378B1 (en) 2019-02-14 2024-01-02 Onpoint Medical, Inc. Systems for adjusting and tracking head mounted displays during surgery including with surgical helmets
US11553969B1 (en) 2019-02-14 2023-01-17 Onpoint Medical, Inc. System for computation of object coordinates accounting for movement of a surgical site for spinal and other procedures
CN113692544A (en) 2019-02-15 2021-11-23 迪吉伦斯公司 Method and apparatus for providing holographic waveguide display using integrated grating
WO2020176783A1 (en) 2019-02-28 2020-09-03 Magic Leap, Inc. Display system and method for providing variable accommodation cues using multiple intra-pupil parallax views formed by light emitter arrays
EP3938821A4 (en) 2019-03-12 2023-04-26 Digilens Inc. Holographic waveguide backlight and related methods of manufacturing
USD962981S1 (en) 2019-05-29 2022-09-06 Magic Leap, Inc. Display screen or portion thereof with animated scrollbar graphical user interface
WO2020247930A1 (en) 2019-06-07 2020-12-10 Digilens Inc. Waveguides incorporating transmissive and reflective gratings and related methods of manufacturing
WO2020257469A1 (en) 2019-06-20 2020-12-24 Magic Leap, Inc. Eyepieces for augmented reality display system
EP4270090A3 (en) 2019-07-04 2024-01-03 Lumus Ltd. Image waveguide with symmetric beam multiplication
EP4004646A4 (en) 2019-07-29 2023-09-06 Digilens Inc. Methods and apparatus for multiplying the image resolution and field-of-view of a pixelated display
JP7196038B2 (en) * 2019-08-26 2022-12-26 株式会社日立エルジーデータストレージ VIDEO DISPLAY DEVICE AND HEAD MOUNT DISPLAY USING THE SAME
KR20220054386A (en) 2019-08-29 2022-05-02 디지렌즈 인코포레이티드. Vacuum Bragg grating and manufacturing method thereof
US11244516B2 (en) 2019-09-16 2022-02-08 Magic Leap, Inc. Object interactivity in virtual space
CN114600064A (en) 2019-10-15 2022-06-07 奇跃公司 Cross reality system with location services
US11257294B2 (en) 2019-10-15 2022-02-22 Magic Leap, Inc. Cross reality system supporting multiple device types
US11632679B2 (en) 2019-10-15 2023-04-18 Magic Leap, Inc. Cross reality system with wireless fingerprints
US11386627B2 (en) 2019-11-12 2022-07-12 Magic Leap, Inc. Cross reality system with localization service and shared location-based content
CA3223538C (en) 2019-12-05 2024-02-20 Lumus Ltd Light-guide optical element employing complementary coated partial reflectors, and light-guide optical element having reduced light scattering
CN114762008A (en) 2019-12-09 2022-07-15 奇跃公司 Simplified virtual content programmed cross reality system
KR102349597B1 (en) * 2019-12-13 2022-01-11 한국전자기술연구원 Waveguide display structure for extended field of vision using non-planar partial reflector array
EP4042228A4 (en) 2019-12-30 2022-12-07 Lumus Ltd. Optical systems including light-guide optical elements with two-dimensional expansion
CN115398484A (en) 2020-02-13 2022-11-25 奇跃公司 Cross reality system with geolocation information priority for location
WO2021163300A1 (en) 2020-02-13 2021-08-19 Magic Leap, Inc. Cross reality system with map processing using multi-resolution frame descriptors
CN115427758A (en) 2020-02-13 2022-12-02 奇跃公司 Cross reality system with accurate shared map
JP2023515524A (en) 2020-02-26 2023-04-13 マジック リープ, インコーポレイテッド Cross-reality system with fast localization
US11481965B2 (en) 2020-04-10 2022-10-25 Samsung Electronics Co., Ltd. Electronic device for communicating in augmented reality and method thereof
WO2021222371A1 (en) 2020-04-29 2021-11-04 Magic Leap, Inc. Cross reality system for large scale environments
IL297051B2 (en) 2020-05-24 2023-10-01 Lumus Ltd Method of fabrication of compound light-guide optical elements
CN111610634B (en) * 2020-06-23 2022-05-27 京东方科技集团股份有限公司 Display system based on four-dimensional light field and display method thereof
KR102544150B1 (en) * 2020-08-31 2023-06-15 한국전자기술연구원 Waveguide display structure and method of prism junction type for expanding the field of view
DE202021104723U1 (en) 2020-09-11 2021-10-18 Lumus Ltd. Image projector coupled to an optical light guide element
JP2024502701A (en) 2020-12-20 2024-01-23 ルムス エルティーディー. Image projector with laser scanning on spatial light modulator
CN112946895B (en) * 2021-02-02 2022-09-20 业成科技(成都)有限公司 Head-mounted display device
KR20210023921A (en) * 2021-02-18 2021-03-04 주식회사 레티널 Optical device for augmented reality having visual acuity correction function
EP4162314A4 (en) 2021-02-25 2023-11-22 Lumus Ltd. Optical aperture multipliers having a rectangular waveguide
WO2022185306A1 (en) 2021-03-01 2022-09-09 Lumus Ltd. Optical system with compact coupling from a projector into a waveguide
EP4304490A1 (en) 2021-03-10 2024-01-17 Onpoint Medical, Inc. Augmented reality guidance for imaging systems and robotic surgery
WO2022246018A1 (en) 2021-05-19 2022-11-24 Lumus Ltd. Active optical engine
WO2023026266A1 (en) * 2021-08-23 2023-03-02 Lumus Ltd. Methods of fabrication of compound light-guide optical elements having embedded coupling-in reflectors

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5812186A (en) * 1994-07-25 1998-09-22 Polaroid Corporation Three-dimensional display method(s) and apparatus
US20060132914A1 (en) * 2003-06-10 2006-06-22 Victor Weiss Method and system for displaying an informative image against a background image
US20080094586A1 (en) 2004-12-06 2008-04-24 Yoshikazu Hirayama Image Display Optical System, Image Display Unit, Illuminating Optical System, And Liquid Crystal Display Unit
US20080151379A1 (en) * 2005-02-10 2008-06-26 Lumus Ltd. Substrate-Guide Optical Device Utilizing Polarization Beam Splitters
US20110227487A1 (en) * 2007-10-09 2011-09-22 Flex Lighting Ii, Llc Light emitting display with light mixing within a film
US20110248904A1 (en) * 2010-04-08 2011-10-13 Sony Corporation Head mounted display and optical position adjustment method of the same

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222971B1 (en) * 1998-07-17 2001-04-24 David Slobodin Small inlet optical panel and a method of making a small inlet optical panel
ATE473464T1 (en) * 2000-06-05 2010-07-15 Lumus Ltd OPTICAL BEAM EXPANDER WITH SUBSTRATE LIGHT WAVE GUIDE
TW556008B (en) * 2001-08-01 2003-10-01 Samsung Electronics Co Ltd Light guided panel and liquid crystal display device using the same and method for displaying picture using the same
WO2006064500A2 (en) * 2004-12-14 2006-06-22 Oms Displays Ltd. Device and method for optical resizing
EP1958011A2 (en) * 2005-10-18 2008-08-20 OMS Displays Ltd. Device and method for optical resizing and backlighting
US7535638B2 (en) * 2005-11-01 2009-05-19 Hewlett-Packard Development Company, L.P. Fractional coverage louver device for a light guide screen
KR101258584B1 (en) * 2006-06-21 2013-05-02 엘지디스플레이 주식회사 Volumetric type 3-Dimension Image Display Device
CN101153958A (en) * 2006-09-26 2008-04-02 深圳国际技术创新研究院 Novel glasses type displayer
CN101470311A (en) * 2007-12-26 2009-07-01 康佳集团股份有限公司 Laser display apparatus employing planar optical waveguide array as optical modulator and method thereof
JP5104823B2 (en) * 2009-07-29 2012-12-19 株式会社島津製作所 Display device
JP5240214B2 (en) * 2010-02-15 2013-07-17 株式会社島津製作所 Display device
JP2013525955A (en) * 2010-04-16 2013-06-20 フレックス ライティング 2,エルエルシー Lighting device with film-based light guide
JP2012028141A (en) * 2010-07-22 2012-02-09 Panasonic Electric Works Co Ltd Non-contact type lighting system
WO2012068543A1 (en) * 2010-11-18 2012-05-24 Flex Lighting Ii, Llc Light emitting device comprising a lightguide film and aligned coupling lightguides
CN102402005B (en) * 2011-12-06 2015-11-25 北京理工大学 Bifocal-surface monocular stereo helmet-mounted display device with free-form surfaces

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5812186A (en) * 1994-07-25 1998-09-22 Polaroid Corporation Three-dimensional display method(s) and apparatus
US20060132914A1 (en) * 2003-06-10 2006-06-22 Victor Weiss Method and system for displaying an informative image against a background image
US20080094586A1 (en) 2004-12-06 2008-04-24 Yoshikazu Hirayama Image Display Optical System, Image Display Unit, Illuminating Optical System, And Liquid Crystal Display Unit
US20080151379A1 (en) * 2005-02-10 2008-06-26 Lumus Ltd. Substrate-Guide Optical Device Utilizing Polarization Beam Splitters
US20110227487A1 (en) * 2007-10-09 2011-09-22 Flex Lighting Ii, Llc Light emitting display with light mixing within a film
US20110248904A1 (en) * 2010-04-08 2011-10-13 Sony Corporation Head mounted display and optical position adjustment method of the same

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2859403A4

Cited By (114)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10962784B2 (en) 2005-02-10 2021-03-30 Lumus Ltd. Substrate-guide optical device
US10598937B2 (en) 2005-11-08 2020-03-24 Lumus Ltd. Polarizing optical system
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
US9612403B2 (en) 2013-06-11 2017-04-04 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
US9541383B2 (en) 2013-07-12 2017-01-10 Magic Leap, Inc. Optical system having a return planar waveguide
US11060858B2 (en) 2013-07-12 2021-07-13 Magic Leap, Inc. Method and system for generating a virtual user interface related to a totem
US11029147B2 (en) 2013-07-12 2021-06-08 Magic Leap, Inc. Method and system for facilitating surgery using an augmented reality system
US9857170B2 (en) 2013-07-12 2018-01-02 Magic Leap, Inc. Planar waveguide apparatus having a plurality of diffractive optical elements
US10866093B2 (en) 2013-07-12 2020-12-15 Magic Leap, Inc. Method and system for retrieving data in response to user input
US11656677B2 (en) 2013-07-12 2023-05-23 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
US10533850B2 (en) 2013-07-12 2020-01-14 Magic Leap, Inc. Method and system for inserting recognized object data into a virtual world
US9952042B2 (en) 2013-07-12 2018-04-24 Magic Leap, Inc. Method and system for identifying a user location
US10352693B2 (en) 2013-07-12 2019-07-16 Magic Leap, Inc. Method and system for obtaining texture data of a space
US10641603B2 (en) 2013-07-12 2020-05-05 Magic Leap, Inc. Method and system for updating a virtual world
US10495453B2 (en) 2013-07-12 2019-12-03 Magic Leap, Inc. Augmented reality system totems and methods of using same
US9651368B2 (en) 2013-07-12 2017-05-16 Magic Leap, Inc. Planar waveguide apparatus configured to return light therethrough
US10228242B2 (en) 2013-07-12 2019-03-12 Magic Leap, Inc. Method and system for determining user input based on gesture
US10571263B2 (en) 2013-07-12 2020-02-25 Magic Leap, Inc. User and object interaction with an augmented reality scenario
US10473459B2 (en) 2013-07-12 2019-11-12 Magic Leap, Inc. Method and system for determining user input based on totem
US10591286B2 (en) 2013-07-12 2020-03-17 Magic Leap, Inc. Method and system for generating virtual rooms
US10288419B2 (en) 2013-07-12 2019-05-14 Magic Leap, Inc. Method and system for generating a virtual user interface related to a totem
US10295338B2 (en) 2013-07-12 2019-05-21 Magic Leap, Inc. Method and system for generating map data from an image
US11221213B2 (en) 2013-07-12 2022-01-11 Magic Leap, Inc. Method and system for generating a retail experience using an augmented reality system
US10408613B2 (en) 2013-07-12 2019-09-10 Magic Leap, Inc. Method and system for rendering virtual content
US10767986B2 (en) 2013-07-12 2020-09-08 Magic Leap, Inc. Method and system for interacting with user interfaces
US11402629B2 (en) 2013-11-27 2022-08-02 Magic Leap, Inc. Separated pupil optical systems for virtual and augmented reality and methods for displaying images using same
US10317690B2 (en) 2014-01-31 2019-06-11 Magic Leap, Inc. Multi-focal display system and method
US11150489B2 (en) 2014-01-31 2021-10-19 Magic Leap, Inc. Multi-focal display system and method
US11520164B2 (en) 2014-01-31 2022-12-06 Magic Leap, Inc. Multi-focal display system and method
US10908426B2 (en) 2014-04-23 2021-02-02 Lumus Ltd. Compact head-mounted display system
US10809528B2 (en) 2014-04-23 2020-10-20 Lumus Ltd. Compact head-mounted display system
CN106575034B (en) * 2014-08-03 2018-11-23 威福光学有限公司 The diffraction optics waveguide assembly of emergent pupil extension
CN106575034A (en) * 2014-08-03 2017-04-19 威福光学有限公司 Exit pupil expanding diffractive optical waveguiding device
US10782532B2 (en) 2014-11-11 2020-09-22 Lumus Ltd. Compact head-mounted display system protected by a hyperfine structure
US10520731B2 (en) 2014-11-11 2019-12-31 Lumus Ltd. Compact head-mounted display system protected by a hyperfine structure
US10440345B2 (en) 2015-03-12 2019-10-08 Beijing Zhigu Rui Tuo Tech Co., Ltd. Display control methods and apparatuses
US10969588B2 (en) 2015-03-16 2021-04-06 Magic Leap, Inc. Methods and systems for diagnosing contrast sensitivity
US10983351B2 (en) 2015-03-16 2021-04-20 Magic Leap, Inc. Augmented and virtual reality display systems and methods for diagnosing health conditions based on visual fields
US11156835B2 (en) 2015-03-16 2021-10-26 Magic Leap, Inc. Methods and systems for diagnosing and treating health ailments
US11256096B2 (en) 2015-03-16 2022-02-22 Magic Leap, Inc. Methods and systems for diagnosing and treating presbyopia
US11474359B2 (en) 2015-03-16 2022-10-18 Magic Leap, Inc. Augmented and virtual reality display systems and methods for diagnosing health conditions based on visual fields
JP2018509983A (en) * 2015-03-16 2018-04-12 マジック リープ,インコーポレイティド Method and system for diagnosing and treating diseases that impair health
US11747627B2 (en) 2015-03-16 2023-09-05 Magic Leap, Inc. Augmented and virtual reality display systems and methods for diagnosing health conditions based on visual fields
JP7414935B2 (en) 2015-03-16 2024-01-16 マジック リープ,インコーポレイティド Method and system for diagnosing and treating diseases that impair health
US10788675B2 (en) 2015-03-16 2020-09-29 Magic Leap, Inc. Methods and systems for diagnosing and treating eyes using light therapy
JP7480412B2 (en) 2015-03-16 2024-05-09 マジック リープ,インコーポレイティド Method and system for diagnosing and treating health-threatening diseases - Patents.com
US11526007B2 (en) 2015-05-04 2022-12-13 Magic Leap, Inc. Separated pupil optical systems for virtual and augmented reality and methods for displaying images using same
EP3292431A4 (en) * 2015-05-04 2018-05-02 Magic Leap, Inc. Separated pupil optical systems for virtual and augmented reality and methods for displaying images using same
AU2016296723B2 (en) * 2015-07-20 2021-03-04 Magic Leap, Inc. Collimating fiber scanner design with inward pointing angles in virtual/augmented reality system
IL256838B1 (en) * 2015-07-20 2023-06-01 Magic Leap Inc Collimating fiber scanner design with inward pointing angles in virtual/augmented reality system
EP3671317A1 (en) 2015-07-20 2020-06-24 Magic Leap, Inc. Collimating fiber scanner design with inward pointing angles in virtual/augmented reality system
US10254536B2 (en) 2015-07-20 2019-04-09 Magic Leap, Inc. Collimating fiber scanner design with inward pointing angles in virtual/augmented reality system
EP3326023A4 (en) * 2015-07-20 2018-12-19 Magic Leap, Inc. Collimating fiber scanner design with inward pointing angles in virtual/augmented reality system
WO2017017981A1 (en) * 2015-07-29 2017-02-02 オムロン株式会社 Optical device
JP2017032664A (en) * 2015-07-29 2017-02-09 オムロン株式会社 Optical device
US10739614B2 (en) 2015-07-29 2020-08-11 Omron Corporation Optical device
US11538280B2 (en) 2015-08-21 2022-12-27 Magic Leap, Inc. Eyelid shape estimation using eye pose measurement
US11906739B2 (en) 2015-10-05 2024-02-20 Magic Leap, Inc. Microlens collimator for scanning optical fiber in virtual/augmented reality system
US11016298B2 (en) 2015-10-05 2021-05-25 Magic Leap, Inc. Microlens collimator for scanning optical fiber in virtual/augmented reality system
US11662585B2 (en) 2015-10-06 2023-05-30 Magic Leap, Inc. Virtual/augmented reality system having reverse angle diffraction grating
US10935792B2 (en) 2015-10-06 2021-03-02 Magic Leap, Inc. Virtual/augmented reality system having reverse angle diffraction grating
US10338391B2 (en) 2015-10-06 2019-07-02 Magic Leap, Inc. Virtual/augmented reality system having reverse angle diffraction grating
US11749025B2 (en) 2015-10-16 2023-09-05 Magic Leap, Inc. Eye pose identification using eye features
US11126842B2 (en) 2015-10-16 2021-09-21 Magic Leap, Inc. Eye pose identification using eye features
US10587848B2 (en) 2016-01-20 2020-03-10 Magic Leap, Inc. Polarizing maintaining optical fiber in virtual/augmented reality system
US11317064B2 (en) 2016-01-20 2022-04-26 Magic Leap, Inc. Polarizing maintaining optical fiber in virtual/augmented reality system
US11812222B2 (en) 2016-02-04 2023-11-07 Magic Leap, Inc. Technique for directing audio in augmented reality system
US10536783B2 (en) 2016-02-04 2020-01-14 Magic Leap, Inc. Technique for directing audio in augmented reality system
US11445305B2 (en) 2016-02-04 2022-09-13 Magic Leap, Inc. Technique for directing audio in augmented reality system
US11288350B2 (en) 2016-03-07 2022-03-29 Magic Leap, Inc. Blue light adjustment for biometric security
US11106041B2 (en) 2016-04-08 2021-08-31 Magic Leap, Inc. Augmented reality systems and methods with variable focus lens elements
US11614626B2 (en) 2016-04-08 2023-03-28 Magic Leap, Inc. Augmented reality systems and methods with variable focus lens elements
US11617559B2 (en) 2016-05-09 2023-04-04 Magic Leap, Inc. Augmented reality systems and methods for user health analysis
WO2018048018A1 (en) * 2016-09-08 2018-03-15 하정훈 Optical apparatus
US11119323B2 (en) 2016-09-21 2021-09-14 Magic Leap, Inc. Systems and methods for optical systems with exit pupil expander
EP3516434A4 (en) * 2016-09-21 2020-05-06 Magic Leap, Inc. Systems and methods for optical systems with exit pupil expander
KR20190050814A (en) * 2016-09-21 2019-05-13 매직 립, 인코포레이티드 Systems and methods for optical systems having an exit diffuser
AU2017332030B2 (en) * 2016-09-21 2022-02-03 Magic Leap, Inc. Systems and methods for optical systems with exit pupil expander
WO2018057528A1 (en) 2016-09-21 2018-03-29 Magic Leap, Inc. Systems and methods for optical systems with exit pupil expander
KR102345433B1 (en) 2016-09-21 2021-12-29 매직 립, 인코포레이티드 Systems and methods for optical systems with exit pupil dilator
US11347065B2 (en) 2016-09-21 2022-05-31 Magic Leap, Inc. Systems and methods for optical systems with exit pupil expander
US10564417B2 (en) 2016-10-09 2020-02-18 Lumus Ltd. Aperture multiplier using a rectangular waveguide
EP3365712A4 (en) * 2016-10-09 2019-05-01 Lumus Ltd. Aperture multiplier using a rectangular waveguide
US11567316B2 (en) 2016-10-09 2023-01-31 Lumus Ltd. Aperture multiplier with depolarizer
US10437031B2 (en) 2016-11-08 2019-10-08 Lumus Ltd. Light-guide device with optical cutoff edge and corresponding production methods
US11378791B2 (en) 2016-11-08 2022-07-05 Lumus Ltd. Light-guide device with optical cutoff edge and corresponding production methods
US11693282B2 (en) 2016-11-18 2023-07-04 Magic Leap, Inc. Liquid crystal diffractive devices with nano-scale pattern and methods of manufacturing the same
US11586065B2 (en) 2016-11-18 2023-02-21 Magic Leap, Inc. Spatially variable liquid crystal diffraction gratings
US11194084B2 (en) 2017-02-22 2021-12-07 Lumus Ltd. Light guide optical assembly
US10684403B2 (en) 2017-02-22 2020-06-16 Lumus Ltd. Light guide optical assembly
US10302835B2 (en) 2017-02-22 2019-05-28 Lumus Ltd. Light guide optical assembly
US11774823B2 (en) 2017-02-23 2023-10-03 Magic Leap, Inc. Display system with variable power reflector
US10962855B2 (en) 2017-02-23 2021-03-30 Magic Leap, Inc. Display system with variable power reflector
US11300844B2 (en) 2017-02-23 2022-04-12 Magic Leap, Inc. Display system with variable power reflector
US11669298B2 (en) 2017-02-28 2023-06-06 Magic Leap, Inc. Virtual and real object recording in mixed reality device
US10725729B2 (en) 2017-02-28 2020-07-28 Magic Leap, Inc. Virtual and real object recording in mixed reality device
US11194543B2 (en) 2017-02-28 2021-12-07 Magic Leap, Inc. Virtual and real object recording in mixed reality device
US11822078B2 (en) 2017-03-07 2023-11-21 Apple Inc. Head-mounted display system
WO2018164914A3 (en) * 2017-03-07 2018-10-11 Apple Inc. Head-mounted display system
US11125927B2 (en) 2017-03-22 2021-09-21 Lumus Ltd. Overlapping facets
US10481319B2 (en) 2017-03-22 2019-11-19 Lumus Ltd. Overlapping facets
US10895679B2 (en) 2017-04-06 2021-01-19 Lumus Ltd. Light-guide optical element and method of its manufacture
US11243434B2 (en) 2017-07-19 2022-02-08 Lumus Ltd. LCOS illumination via LOE
US11086128B2 (en) 2017-09-28 2021-08-10 Magic Leap, Inc. Methods and apparatuses for reducing stray light emission from an eyepiece of an optical imaging system
US10551544B2 (en) 2018-01-21 2020-02-04 Lumus Ltd. Light-guide optical element with multiple-axis internal aperture expansion
US11262587B2 (en) 2018-05-22 2022-03-01 Lumus Ltd. Optical system and method for improvement of light field uniformity
US11526003B2 (en) 2018-05-23 2022-12-13 Lumus Ltd. Optical system including light-guide optical element with partially-reflective internal surfaces
US11415812B2 (en) 2018-06-26 2022-08-16 Lumus Ltd. Compact collimating optical device and system
US11849262B2 (en) 2019-03-12 2023-12-19 Lumus Ltd. Image projector
US11914161B2 (en) 2019-06-27 2024-02-27 Lumus Ltd. Apparatus and methods for eye tracking based on eye imaging via light-guide optical element
WO2021107828A1 (en) * 2019-11-26 2021-06-03 Telefonaktiebolaget Lm Ericsson (Publ) Supply of multi-layer extended reality images to a user
US11523092B2 (en) 2019-12-08 2022-12-06 Lumus Ltd. Optical systems with compact image projector
EP4022218A4 (en) * 2020-02-02 2022-11-23 Lumus Ltd. Method for producing light-guide optical elements
US11789264B2 (en) 2021-07-04 2023-10-17 Lumus Ltd. Display with stacked light-guide elements providing different parts of field of view

Also Published As

Publication number Publication date
CA2876335C (en) 2020-04-28
JP6238974B2 (en) 2017-11-29
AU2018264080B2 (en) 2020-04-16
KR102100438B1 (en) 2020-04-13
CN115494654A (en) 2022-12-20
EP2859403B1 (en) 2022-10-19
CN107817555A (en) 2018-03-20
IL261484B (en) 2022-02-01
CN104737061B (en) 2018-01-16
NZ702897A (en) 2017-03-31
CA2876335A1 (en) 2013-12-16
IL257945A (en) 2018-05-31
US9310559B2 (en) 2016-04-12
IL257945B (en) 2021-04-29
US20140003762A1 (en) 2014-01-02
AU2017202843A1 (en) 2017-05-25
EP2859403A1 (en) 2015-04-15
AU2018264080A1 (en) 2018-12-06
IL236176A0 (en) 2015-01-29
NZ730745A (en) 2020-10-30
EP2859403A4 (en) 2016-03-02
CN104737061A (en) 2015-06-24
KR20200039829A (en) 2020-04-16
CN107817556A (en) 2018-03-20
AU2020205208B2 (en) 2022-01-20
AU2013274359B2 (en) 2017-05-25
AU2020205208A1 (en) 2020-07-30
KR102217788B1 (en) 2021-02-18
IL261484A (en) 2018-10-31
EP4130820A1 (en) 2023-02-08
AU2013274359A1 (en) 2015-01-22
KR20150018879A (en) 2015-02-24
JP2015528919A (en) 2015-10-01
AU2017202843B2 (en) 2019-01-03
JP2017223998A (en) 2017-12-21
CN107817556B (en) 2020-01-31

Similar Documents

Publication Publication Date Title
AU2020205208B2 (en) Multiple depth plane three-dimensional display using a wave guide reflector array projector
JP7298809B2 (en) Energy propagation and lateral Anderson localization by two-dimensional, light-field and holographic relays
KR101812299B1 (en) Beam divergence and various collimators for holographic or stereoscopic displays
EP1377871B1 (en) Display
KR101819905B1 (en) Stereoscopic imaging method and device employing planar optical waveguide loop
JP2010237416A (en) Stereoscopic display device
CN112305776B (en) Light field display system based on light waveguide coupling light exit pupil segmentation-combination control
CN109254410B (en) space imaging device
CN109375469B (en) space projection display device
CN109212871B (en) projection display device
NZ730745B2 (en) Multiple depth plane three-dimensional display using a wave guide reflector array projector

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13803879

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2876335

Country of ref document: CA

Ref document number: 2015517371

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2013803879

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 20157000711

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2013274359

Country of ref document: AU

Date of ref document: 20130611

Kind code of ref document: A