US20210349316A1 - Diffraction based monochromatic head up display for airborne applications - Google Patents
Diffraction based monochromatic head up display for airborne applications Download PDFInfo
- Publication number
- US20210349316A1 US20210349316A1 US17/208,839 US202117208839A US2021349316A1 US 20210349316 A1 US20210349316 A1 US 20210349316A1 US 202117208839 A US202117208839 A US 202117208839A US 2021349316 A1 US2021349316 A1 US 2021349316A1
- Authority
- US
- United States
- Prior art keywords
- optical
- diffraction
- image
- display system
- optical display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000003287 optical effect Effects 0.000 claims abstract description 211
- 238000010168 coupling process Methods 0.000 claims abstract description 75
- 238000005859 coupling reaction Methods 0.000 claims abstract description 73
- 238000003384 imaging method Methods 0.000 claims abstract description 32
- 230000008878 coupling Effects 0.000 claims abstract description 31
- 238000000034 method Methods 0.000 claims abstract description 7
- 239000006185 dispersion Substances 0.000 claims description 40
- 239000000463 material Substances 0.000 claims description 39
- 239000000758 substrate Substances 0.000 claims description 21
- 125000006850 spacer group Chemical group 0.000 claims description 15
- 230000005684 electric field Effects 0.000 claims description 7
- 230000000694 effects Effects 0.000 claims description 5
- 230000003116 impacting effect Effects 0.000 claims 1
- 238000013461 design Methods 0.000 description 26
- 230000008859 change Effects 0.000 description 16
- 210000001747 pupil Anatomy 0.000 description 15
- 238000010586 diagram Methods 0.000 description 10
- 210000003128 head Anatomy 0.000 description 8
- 230000004308 accommodation Effects 0.000 description 7
- 230000001419 dependent effect Effects 0.000 description 7
- 238000000576 coating method Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 239000011521 glass Substances 0.000 description 6
- 230000033001 locomotion Effects 0.000 description 6
- 238000004519 manufacturing process Methods 0.000 description 6
- 238000012634 optical imaging Methods 0.000 description 6
- 230000000737 periodic effect Effects 0.000 description 6
- 230000001902 propagating effect Effects 0.000 description 6
- 239000010409 thin film Substances 0.000 description 5
- 239000011248 coating agent Substances 0.000 description 4
- 230000003190 augmentative effect Effects 0.000 description 3
- 238000005452 bending Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 239000002305 electric material Substances 0.000 description 3
- 238000002310 reflectometry Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000001070 adhesive effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000001066 destructive effect Effects 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 239000005304 optical glass Substances 0.000 description 2
- 239000004033 plastic Substances 0.000 description 2
- 229920003023 plastic Polymers 0.000 description 2
- 230000010287 polarization Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- NCGICGYLBXGBGN-UHFFFAOYSA-N 3-morpholin-4-yl-1-oxa-3-azonia-2-azanidacyclopent-3-en-5-imine;hydrochloride Chemical compound Cl.[N-]1OC(=N)C=[N+]1N1CCOCC1 NCGICGYLBXGBGN-UHFFFAOYSA-N 0.000 description 1
- 239000004593 Epoxy Substances 0.000 description 1
- 206010019233 Headaches Diseases 0.000 description 1
- 241000282412 Homo Species 0.000 description 1
- 239000000853 adhesive Substances 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 208000003464 asthenopia Diseases 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 239000013590 bulk material Substances 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 231100000869 headache Toxicity 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000000059 patterning Methods 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000035899 viability Effects 0.000 description 1
- 238000001429 visible spectrum Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/4205—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having a diffractive optical element [DOE] contributing to image formation, e.g. whereby modulation transfer function MTF or optical aberrations are relevant
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/34—Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
- G02B30/35—Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers using reflective optical elements in the optical path between the images and the observer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0123—Head-up displays characterised by optical features comprising devices increasing the field of view
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2213/00—Details of stereoscopic systems
- H04N2213/001—Constructional or mechanical details
Definitions
- Augmented reality (AR) and virtual reality (VR) systems promise to revolutionize the way humans interact with each other and the world around them. These technologies provide human eyes additional information that either augments or supplant visual information received from the outside world to entertain, inform and/or educate a user.
- VR systems immerse a user in a virtual world, limiting input from the outside world, and AR systems superimpose information and/or virtual images onto a scene observed by a user.
- the user may be allowed to engage in interactive games, view information (e.g., instruction manuals, handbooks) while performing a task or exploring, conduct virtual training, and/or visualize digital information.
- AR systems may use a head's up display (HUD), overlaying the outside world with images and/or data screens containing information adding to a user's experience.
- HUD head's up display
- AR displays consist of four common main subsystems, each of which may impact the display performance.
- the optical system generates, manipulates and presents images to the viewer in a manner that causes a user to perceive existence of virtual objects within an outside visual world.
- environmental mapping may use cameras and sensors to obtain knowledge of the surrounding environment, such as walls, desks and other surfaces that could support images and detect a user's movement within the environment.
- head and eye tracking systems may provide feedback on where a user wishes to look and the existence of any alignment issues for which the system must accommodate.
- extensive software and hardware processing systems may contain the computing power that controls, coordinates, and drives the actions of the other three subsystems.
- Design and implementation of the optical system generally use either bulk optics systems or waveguide systems.
- Bulk optical systems use a combination of lenses and custom designed prisms to magnify and distribute the image to a user's eye.
- the image generator projects light into a free-form prism—the shape of the prism deviates from regular geometric figures—and total internal reflection (TIR) at the surface combined with the shape provides the means to magnify the image and direct the magnified image toward a user's eye.
- TIR total internal reflection
- a second prism placed nearly in contact with the first prism corrects distortions caused by the first prism and may allow light from the external world to pass through to a user's eye.
- This solution possesses several drawbacks that may limit use for practical applications, including the large size and weight of the prisms, incomplete correction of image distortions, small field of view (FOV), and no practical path to implementing methods to resolve vergence-accommodation conflict.
- Examples of this type of system include multi-focal plane displays and Google Glass, manufactured by Google having a principle place of business in Mountain View, Calif.
- the more current offering of AR head-mounted displays use an optical waveguide system to connect the output of the image generator to a user's eye.
- the waveguide generally may consist of a piece of glass cut thin in one dimension, typically in width.
- Light rays propagate through the waveguide by TIR, and optical elements placed within the waveguide or along the walls of the waveguide provide means to couple light into the waveguide from the image generator, modify the magnification and divergence of the image, and couple the light out of the waveguide towards the user's eye.
- Diffractive elements consist of periodic variations in the waveguide's refractive index (holographic optical elements or HOEs), periodic variations in the surface structure, created by patterning or cutting of material on the waveguide surface, computer-generated holograms (CCH), sub-wavelength digital elements (SWE) or dynamic diffractive optics.
- HOEs holographic optical elements
- CH computer-generated holograms
- SWE sub-wavelength digital elements
- Diffractive elements may present many advantages, including small size and weight, the ability to create them directly on or within the waveguide, the ability to tune the element to pass light from the external scene with minimal distortion or dimming, and ease of design. Diffractive elements also may present three key disadvantages. First, the elements may operate in a very narrow band of wavelengths, and thus systems based on diffractive elements may require three waveguides, with each waveguide individually processing one of the RGB wavelengths thus adding to the size and cost of the display system. Second, diffractive elements display high angular selectivity, which may limit the range of ray angles directed by the grating towards the user, thus significantly limiting the FOV achieved by the display. Third, many of the diffractive elements currently in use have complex shapes that may require lengthy and/or costly manufacturing processes. Differences in the use and implementation of the optical elements drive the differences in performance achieved by existing display offerings.
- the Quantum Display generally utilizes a set of diffraction gratings expanding the exit pupil and generating a range of output ray angles.
- the display positions the image projector at a specific angle with respect to a horizontal waveguide in order to accommodate for the angular selectivity of the diffraction gratings.
- the optics and mechanics required to achieve the optimal launch conditions add significantly to the size and weight of the display.
- Light propagating through the first waveguide interacts with a diffraction grating placed or etched on the top surface, and the grating diffracts a portion of the light into a vertical waveguide at each point along horizontal waveguide.
- a second grating on the surface of the vertical waveguide performs a similar function, coupling light out at each point of the waveguide surface at a range of angles determined by the design of the diffraction grating.
- the current design projects a collimated output beam and thus produces an output at infinity, and does not provide for any accommodation allowance.
- the display produces a 30° FOV for one eye (monocular) and uses only one set of waveguides and gratings, limiting current versions to monochrome image generation.
- the angular positioning of the source and the relatively large thickness of the waveguide make expanding the system to binocular, RGB image generation impractical.
- the Lumus display as described in patent applications filed by Lumus (U.S. Pat. No. 7,391,573, U.S. Ser. No. 12/596,823 and U.S. Ser. No. 12/092,818, for example), generally utilizes a set of reflective surfaces to perform in-coupling, expand the exit pupil and generate a range of output angles.
- the reflective surfaces rely on the reflection and transmission of light at the boundary between two materials of different refractive index.
- Each reflector in the waveguide uses a multi-layer coating to produce a partially reflecting mirror. Light rays striking the mirror at certain angles are partially reflected, sending light toward the user's eyes.
- An element design may prevent reflection from the back of the element, which would send light out the side or rear of the waveguide, away from the user's eye.
- Several elements distributed along the length of the waveguide couple light out from an extended length along the horizontal direction, effectively expanding the exit pupil in this direction.
- a similar optical element at the waveguide input couples light into the waveguide from an image generator.
- a series of lenses, mirrors, and prisms conditions and converges the light from the image generator to coupling and create the divergent beam to present a virtual image to the user.
- An additional optic may distribute light in the vertical direction to increase the exit pupil in the vertical direction as well as the horizontal direction.
- the Lumus display exhibits many design challenges that may limit effectiveness.
- the in-coupling system requires custom, heavy, and bulky optics and a 45° angle, adding weight, size and cost to the system.
- the eye pupil expansion in both the vertical and horizontal direction may occur relatively slowly, requiring the beam to travel a long distance within the waveguide (around half an inch) before reaching the out-coupling reflective elements.
- only a small fraction (around 1 ⁇ 3rd) of the glass area in front of the user's eye may contribute to the production of an image, creating significant dead space in the display. Since most of the FOV produced by a display depends on the size of the emitting area, the small image-producing area greatly restricts the FOV to below 30 degrees.
- the in-coupling optical design may need to compensate for the polarization-dependent nature of the reflective out-coupling elements. To ensure that each polarization state reflects the same amount of power at each mirror, the in-coupling system may need to carefully control the angle at which each state enters the waveguide.
- the solution used in the Lumus display contributes to the size, weight and cost of the system.
- the display produces virtual images at a fixed accommodation and provides no method for adjusting the accommodation to address the vergence-accommodation conflict.
- a user's eyes adjust to objects at different distance by changing the focus of the lens (accommodation) to produce a clear image on the user's retina, and by rotating the eyes inward or outward such that the line of sight from the two eyes may converge at the same distance as the object (vergence).
- the Lumus display presents images at a fixed distance from the eyes such that the images create a virtual object at a perceived distance from the viewer.
- the eyes may rotate to adapt the vergence based on perceived depth, but the eyes remain focused on the screens, causing an unnatural disconnect between the vergence and accommodation activities. This disconnect may cause moderate to severe problems for a user, including eye strain, headaches and discomfort or disorientation. Further, such issues may worsen over extended viewing periods.
- the current design of the reflective layers of the Lumus display produces scattering, which may reduce image clarity and/or may increase power required to produce an image. Increased power requirements may strain the limited battery capacity, limiting use time.
- the Hololens system is manufactured by Microsoft, having a principle place of business in Redmond, Wash., and utilizes a series of specialized diffractive gratings to perform in-coupling, exit pupil expansion, and out-coupling.
- light from the image generator may enter perpendicular to the waveguide and couple into the waveguide at specific angles through a specially designed diffraction grating.
- the Hololens system is further described in the article “Diffractive optics for virtual reality displays,” Journal of the Society for Information Display , Vol. 14, No. 5, pp. 467-475, 2006, and is herein incorporated by reference in its entirety.
- the grating possesses a tilted structure that couples light in the outward direction toward the eye, with little or no power directed away from the eye.
- An extended, cone-shaped grating panel uses a similar grating structure to expand the exit pupil in the horizontal direction, directing fractions of light to the larger grating, which expands the exit pupil in the vertical direction.
- the area of the larger grating may effectively define the Hololens' exit pupil.
- the modulation depth of both gratings increases with distance from the in-coupling point such that the same amount of power reflects from each point of the grating to produce a uniform intensity image.
- a liquid crystal display contained in a separate layer provides selective occlusion of the external scene to improve image contrast.
- the Hololens design presents many design challenges and choices that may limit the system effectiveness and commercial viability.
- the diffraction gratings operate efficiently at only a single wavelength.
- the display uses three parallel waveguides, one for each color, with alignment carefully controlled to match pixel positions in each waveguide. Each eye therefore may require nine of the costly and complicated gratings, for a total of 18 gratings, quickly driving the cost of the system out of the range of most potential users.
- the use of multiple layers also increases the size and weight of the display, particularly at the front.
- the Hololens achieves a FOV of 30 degree horizontally and 17 degrees vertically resulting in a restricted virtual world for the user.
- Such a small FOV restrict the user's ability to work with multiple objects simultaneously and/or view an entirety of a virtual scene (e.g., objects on edge of scene may disappear or cut-off).
- the user can typically see only one complete object at a time, with other objects out of view or only party visible, contrary to the wide FOV concept pictures presented on the Hololens web page.
- a user may be required to turn their head and center each object within the FOV, causing other objects to disappear and/or placing motion strain on a user's neck.
- the fixed nature and angular selectivity of the gratings precludes adding optical components that would adjust beam divergence to alleviate the vergence-accommodation conflict.
- optical display manufactured by Magic Leap, having a principle place of business in Plantation, Fla., and described in U.S. Pat. No. 8,950,867, “Three Dimensional Virtual Augmented Reality Display System,” and U.S. Pat. No. 9,310,559, “Multiple Depth Plane Three-dimensional Display Using a Waveguide Reflector Array Projector,” utilizes a combination of beam-splitters and micro-reflectors to produce the only prior art display attempting to address the accommodation-vergence conflict.
- light couples from the image generator into a coupling tube, with the coupling process using a fiber or diffractive element, depending on the specific implementation.
- the coupling tube may contain a series of beam splitters that reflect a portion of the light into an array of waveguide tubes.
- the coupling tube may expand the exit pupil in the vertical directions.
- Each waveguide tube contains a series of curved reflective elements that serve to expand the exit pupil in the horizontal direction (similar to the Lumus display described herein) and to produce a specific divergence in the beam that may cause the virtual image to appear at a specific distance from the user.
- multiple coupling-waveguide tube combinations may be stacked in parallel with each combination containing reflective elements of different curvature.
- the total system may produce images at twelve discrete distances, and the system may produce a distance continuum by illuminating adjacent combinations with different optical power ratios. Switches or other elements select the amount of power delivered to each layer in the overall stack.
- the Magic Leap design presents a number of challenging design issues that has prevented the completion of a working prototype.
- One such stack may require manufacturing of multiple tubes, each with multiple reflective elements, and each layer of tubes requiring a different curvature for the reflective elements.
- Fourth, light from one layer must pass through one or more other layers as the light travels to the eye, which raises the possibility of cross-talk and scattering issues that may likely degrade image quality.
- FIG. 1 is block diagram of an exemplary optical display system of the present disclosure.
- FIGS. 2A, 2B and 2C are perspective views of exemplary optical display systems of the present disclosure.
- FIG. 3 is a block diagram of an exemplary diffraction enhanced optical imaging system for use in the optical display system illustrated in FIG. 1 .
- FIG. 4 is a graphical representation of example output of an exemplary embodiment of the diffraction enhanced optical imaging system illustrated in FIG. 3 .
- FIG. 5 is a block diagram of another exemplary diffraction enhanced optical imaging system for use in the optical display system illustrated in FIG. 1 .
- FIG. 6 is a graphical representation of example output of an exemplary embodiment of the diffraction enhanced optical imaging system illustrated in FIG. 5 .
- FIG. 7A is a block diagram of another exemplary diffraction enhanced optical imaging system for use in the optical display system illustrated in FIG. 1 .
- FIG. 7B is a block diagram of another exemplary diffraction enhanced optical imaging system for use in the optical display system illustrated in FIG. 1 .
- FIG. 8A is a block diagram of an exemplary in-coupling diffraction element for use in the optical display system illustrated in FIG. 1 .
- FIG. 8B is a graphical representation of example output of an exemplary embodiment of the in-coupling diffraction element illustrated in FIG. 8 .
- FIGS. 9A and 9B are block diagrams of exemplary in-coupling diffraction elements for use in the optical display system illustrated in FIG. 1 .
- FIG. 10 is a block diagram of an exemplary wavelength compensated beam expander for use in the optical display system illustrated in FIG. 1 .
- FIGS. 11A-11C are block diagrams of exemplary optical elements for use in the wavelength compensated beam expander illustrated in FIG. 10 .
- FIG. 12 is a graphical representation of example output of an exemplary embodiment of the wavelength compensated beam expander illustrated in FIG. 10 .
- FIG. 13 is a block diagram of an exemplary output coupling and vertical expansion system for use in the optical display system illustrated in FIG. 1 .
- FIGS. 14 and 15 are graphical representation of example output of an exemplary embodiment of the output coupling and vertical expansion system illustrated in FIG. 13 .
- the optical display system may maximize coupling of light from an image generator to an optical waveguide, include image magnification (e.g., exit pupil expansion) and wavelength dispersion correction over short distances to minimize size and/or weight of the optical display system, out-couple light substantially equally at most or all wavelengths over a significant area and range of angles to achieve a field of view (FOV) greater than 30 degrees, greater than 40 degrees, greater than 50 degrees, greater than 60 degrees, and/or provide beam divergence to provide natural eye accommodation.
- FOV field of view
- the optical display system may include electrical and/or software components for driving image generators.
- the optical display system may provide three-dimensional, two-dimensional, convergence corrected, and/or full-color images to a user while minimizing size and/or weight of the optical display system.
- the optical display system may use only a single waveguide to expand and/or direct light from an image generator to a user's eyes.
- a combination of diffractive elements may provide beam expansion within short distances and/or correction of chromatic aberrations within the optical display system to provide a sharp image with a wide FOV.
- Output couplers may provide additional enhancement of the FOV in some embodiments.
- a variable optical element may change divergence of the beam that reaches the output couplers, allowing the optical display system to change perceived distance of an object from the user and provide substantially correct convergence to ensure natural viewing by the user.
- a refractive optical element may provide images at different angles from an optical axis, as well as different distances from an output plane of the lens.
- a multi-layer diffractive optical element may provide wavelength dispersion of opposite sign.
- At least one may extend up to 100 or 1000 or more, depending on the term to which it is attached; in addition, the quantities of 100/1000 are not to be considered limiting, as higher limits may also produce satisfactory results.
- the use of the term “at least one of X, Y and Z” will be understood to include X alone, Y alone, and Z alone, as well as any combination of X, Y, and Z.
- the words “comprising” (and any form of comprising, such as “comprise” and “comprises”), “having” (and any form of having, such as “have” and “has”), “including” (and any form of including, such as “includes” and “include”) or “containing” (and any form of containing, such as “contains” and “contain”) are inclusive or open-ended and do not exclude additional, unrecited elements or method steps.
- A, B, C, or combinations thereof refers to all permutations and combinations of the listed items preceding the term.
- “A, B, C, or combinations thereof” is intended to include at least one of: A, B, C, AB, AC, BC, or ABC, and if order is important in a particular context, also BA, CA, CB, CBA, BCA, ACB, BAC, or CAB.
- expressly included are combinations that contain repeats of one or more item or term, such as BB, AAA, AAB, BBC, AAABCCCC, CBBAAA, CABABB, and so forth.
- BB BB
- AAA AAA
- AAB BBC
- AAABCCCCCC CBBAAA
- CABABB CABABB
- any range listed or described herein is intended to include, implicitly or explicitly, any number within the range, particularly all integers, including the end points, and is to be considered as having been so stated. For example, “a range from 1 to 10” is to be read as indicating each possible number, particularly integers, along the continuum between about 1 and about 10.
- any data points within the range are to be considered to have been specified, and that the inventors possessed knowledge of the entire range and the points within the range.
- an embodiment having a feature characterized by the range does not have to be achieved for every value in the range, but can be achieved for just a subset of the range. For example, where a range covers units 1-10, the feature specified by the range could be achieved for only units 4-6 in a particular embodiment.
- the term “substantially” means that the subsequently described event or circumstance completely occurs or that the subsequently described event or circumstance occurs to a great extent or degree.
- the term “substantially” means that the subsequently described event or circumstance occurs at least 90% of the time, or at least 95% of the time, or at least 98% of the time.
- optical display systems 10 for providing three-dimensional, two-dimensional, convergence corrected images to a user.
- Images may be full-color images, limited color images, grayscale images, and/or black and white images.
- the optical display system 10 may couple one or more images into an optical waveguide 12 .
- images may include still images, video, animation, and/or the like.
- the optical display system 10 may be configured to magnify the image in a horizontal direction and/or horizontal and vertical directions without producing any or minimal wavelength separation and/or distortion of the one or more images.
- the optical display system 10 may include one or more diffraction enhanced imaging systems 16 configured to collect one or more rays 18 produced by the image generator 14 (e.g., DLP projector, LCD display system, LCOS display system, GLV system, fiber controlled display system, and/or the like).
- the diffraction enhanced imaging system 16 may control convergence angle of each of the rays 18 at each wavelength (e.g., red, green, blue) prior to coupling each of the rays 18 into the optical waveguide 12 .
- One or more in-coupling diffraction systems 20 may use diffraction to couple the incoming rays 18 into the optical waveguide 12 at specific convergence and/or divergence angles needed by subsequent systems to produce an expanded beam having specific final divergence angles.
- one or more wavelength compensated beam expanders 22 configured to simultaneously expand horizontal extension of the image (i.e., horizontal magnification), and/or compensate for wavelength dispersion such that color components of each image pixel may overlap precisely at one or more output coupling and vertical expansion systems 24 .
- the output coupling and vertical expansion system 24 may be configured to magnify the image in a vertical direction and/or to direct a fraction of light towards the user at specific angles to create a wide FOV. It should be noted that via rotation of the optical display system 10 , horizontal movement may become vertical and vertical movement may become horizontal.
- FIG. 2C illustrates an exemplary vertical arrangement of the optical display system 10 .
- an adjustable optical element may be configured to control apparent distance at which the object appears such that the eye's convergence and accommodation system may work in concert, resulting in reduced fatigue and disorientation.
- One or more of the wavelength compensated beam expanders 22 may contain adjustable components that maintain the overlap of the color components of each image pixel for different configurations of the adjustable optical element.
- Other systems, as described herein, may control and/or coordinate generation of one or more images, track user movement (e.g., determine user directed attention), track user's eyes movement, map external surrounding, and/or the like.
- optical display system 10 Details and possible embodiments of the optical display system 10 and each of the diffraction enhanced imaging system(s) 16 , in-coupling diffraction system(s) 20 , wavelength compensated beam expander(s) 22 , and output coupling and vertical expansion system(s) 24 are herein described.
- the optical display system 10 may be housed in a headset 30 as illustrated in FIGS. 2A and 2B .
- the headset 30 may include a frame 32 .
- the frame 32 may include one or more portions 34 configured to rest on a nose and/or ears of a user.
- the frame 32 may include a band (not shown) configured to secure the headset 30 to a user's head.
- the band may be an elastic band configured to secure the headset 30 to the user's head.
- the frame 32 may be mounted within a helmet (not shown) configured to be positioned on a user's head.
- the frame 32 may include a front support element 36 .
- Two or more image generators 14 may be spatially disposed and positioned on the front support element 36 .
- Each image generator 14 may be configured to provide a separate image to each eye.
- a first image generator 14 a may be configured to provide a first image to a left eye of a user and a second image generator 14 b may be configured to provide a second image to a right eye of the user.
- the image generators 14 a and 14 b are illustrated as positioned adjacent to temples of a user on the frame 32 .
- the image generators 14 a and 14 b are illustrated as positioned at the bridge of a nose of a user on the frame 32 .
- the diffraction enhanced imaging system 16 includes a plurality of lens 38 (designated by way of example as 38 a and 38 b in FIGS. 2A and 2B ) positioned in the frame 32 with the lens 38 a such that an image may be substantially aligned with one of the user's eyes and the lens 38 b such that an image may be substantially aligned with the other one of the user's eyes.
- the lens 38 includes both diffractive and refractive portions configured to alter wavelength dispersion effects on the image distance produced by the lens 38 . Referring to FIG.
- the lens 38 may include multiple layers including, but not limited to, a first substrate layer 40 , a first diffractive grating layer 42 , a spacer layer 44 , a second diffractive grating layer 46 , and a second substrate layer 48 .
- the first substrate layer 40 may be formed of glass and/or other optically clear (e.g., transparent) material having known wavelength dispersion properties.
- the first substrate layer 40 may include a first surface 50 and a second surface 52 .
- the first surface 50 and/or the second surface 52 may be curved.
- the first surface 50 and/or the second surface 52 may be substantially flat.
- at least one of the first surface 50 and the second surface 52 may be curved, such as, for example, the second surface 52 as illustrated in FIG. 3 .
- the lens 38 may include the first diffractive grating layer 42 positioned adjacent to the second surface 52 of the first substrate layer 40 .
- the first diffractive grating layer 42 may include at least one grating 54 formed of a holographic or surface-contained periodic modulation of the optical refractive index or surface height, respectively.
- a bulk material substantially similar in index and clarity with materiality of the optical waveguide 12 may be used to write the gratings 54 .
- Period of the grating 54 of the first diffractive grating layer 42 may impact wavelength dispersion, both magnitude and sign, of the light generated by the one or more imaging generators 14 .
- Grating 54 may aid in a higher coupling efficiency as compared to other prior art coupling methods. Higher coupling efficiency may translate into lower power requirements at input and/or brighter images presented to a user.
- the lens 38 may also include a spacer layer 44 .
- the spacer layer 44 may occupy space between the first diffractive grating layer 42 and the second diffractive grating layer 46 .
- the spacer layer 44 may be formed of optically clear (e.g., transparent) material to light in the visible spectrum, for example.
- a portion or the entirety of the spacer layer 44 may include air.
- the refractive index of the spacer layer 44 may impact diffraction properties of the first diffractive grating layer 42 and/or the second diffractive grating layer 46 .
- the second diffractive grating layer 46 may be positioned adjacent to the spacer layer 44 .
- the second diffractive grating layer 46 may be formed of substantially similar material and properties as the first diffractive grating layer 42 .
- the second diffractive grating layer 46 may include at least one grating 56 formed of a holographic or surface-contained periodic modulation of the optical refractive index or surface height, respectively. Period of the grating 56 of the second diffractive grating layer 46 may impact wavelength dispersion, both magnitude and sign, of the light generated by the imaging generator 14 .
- grating variation with position may complement variation of the first diffractive grating 42 .
- peaks of the grating 56 of the second diffractive grating layer 46 may lie at substantially the same position as valleys of the grating 54 of the first diffractive grating layer 42 .
- the second substrate layer 48 may be positioned adjacent to the second diffractive grating layer 46 .
- the second substrate layer 48 may be formed of glass and/or other optically clear material having known wavelength dispersion. In some embodiments, dispersion magnitude and/or sign of the second substrate layer 48 may be different than dispersion magnitude and/or sign of the first substrate layer 40 .
- the second substrate layer 48 may include a first surface 358 and a second surface 60 .
- the first surface 358 and/or the second surface 60 may be curved. Alternatively, the first surface 58 and/or the second surface 60 may be substantially flat. In some embodiments, at least one of the first surface 53 and the second surface 60 may be curved, such as, for example, the second surface 60 as illustrated in FIG. 3 .
- At least one of the first substrate layer 40 , first diffractive grating layer 42 , spacer layer 44 , second diffractive grating layer 46 , and second substrate layer 48 may consist of one or more materials having a refractive index configured to be controlled by application of an electric field (e.g., via applied voltage). Changing the refractive index of the material may alter either or both refractive properties and diffractive properties of the lens 38 thus altering image distances and/or corresponding convergence or divergence of rays exiting the lens 38 .
- FIG. 4 illustrates an example of a graph 70 of an exemplary output of an exemplary embodiment of the lens 38 .
- magnitude of the difference in focal length between red wavelength 72 , green wavelength 74 and blue wavelength 76 may depend on wavelength dispersion of materials used in each layer of the lens 38 .
- a first material may have a change in refractive index of 0.013364 between the red wavelength 72 and the blue wavelength 76
- a second material may have a refractive index change of 0.027 between the red wavelength 72 and the blue wavelength 76 .
- the lens 38 may further include a refractive optical element and/or wedge element 80 as illustrated in FIG. 5 .
- the wedge element 80 may be configured to provide images at different angles from an optical axis 82 , as well as different distances from an output plane of the lens 38 .
- the wedge element may be placed within the layers of the lens 38 as shown in FIG. 5 , before lens 38 (between the image generator 14 and the front layer 50 of first substrate 40 ), or after lens 38 (beyond the second layer 60 of second substrate 48 ) and prior to waveguide 12 . Referring to FIGS.
- the wedge element 80 may create a 0.57 degree tilt in an imaging axis for blue wavelengths 76 , but only a 0.548 degree tilt in the imaging axis for red wavelengths 72 , for example, as shown in graph 84 illustrating output of the lens 38 having the wedge element 80 .
- the wedge angle ⁇ W may be determined to achieve a pre-determined angle in output rays and/or imaging axes. In some embodiments, wedge angle ⁇ W may be determined and/or dependent on materiality of the wedge element 80 , focal length of the lens 38 , and/or focal power of the lens 38 . In some embodiments, the wedge angle ⁇ W may be up to 10 degrees, for example. As a result, light at different wavelengths 72 , 74 and 76 may enter the in-coupling diffraction system 20 (shown in FIG. 1 ) at different angles and/or different positions.
- a second refractive element 86 may be positioned adjacent to but spaced a distance away from the lens 38 .
- the second refractive element 86 may be a variable focal length lens configured to modify divergence of rays exiting the lens 38 .
- the second refractive element 86 may be, for example, a liquid-based variable focal length lens and/or other refractive element capable of modifying divergence of rays exiting the lens 38 .
- a refractive element 88 may be positioned adjacent to and in contact with the lens 38 .
- the refractive element 88 may be, for example, one or more lens formed of dispersive material to counteract and/or enhance wavelength dispersion of the lens 38 to increase or decrease wavelength dispersion of the optical display system 10 .
- the refractive element 88 may be formed of material having a refractive index more strongly dependent on wavelength than standard optical glasses (e.g., BK7), in that the material has a greater change in refractive index as a function of wavelength than standard glasses, for example.
- the in-coupling diffraction system 20 redirects light incident on the diffraction enhanced imaging system 16 into a different direction of travel such that light may propagate in a guided way along a length of the optical waveguide 12 .
- the in-coupling diffraction system 20 may include a single diffraction grating 90 . Using the single diffraction grating 90 may further reduce size of the in-coupling diffraction system 20 and reduce manufacturing and complexity cost.
- Period of the single diffraction grating 90 may be selected such that rays entering the single diffraction grating 90 from the diffraction enhanced imaging system 16 exit the single diffraction grating 90 at angles conducive to propagation within the optical waveguide 12 by total internal reflection (TIR). Period of the single diffraction grating 90 may also alter ray cone for each wavelength to create a new image point, either virtual or real, that may act as an input image for the wavelength compensated beam expander 22 (shown in FIG. 1 ).
- Gratings 92 in the single diffraction grating 90 may affect light entering normal to the optical waveguide 12 , simplifying and/or minimizing size of optics between the image generator 14 and the optical waveguide 12 .
- period of the single diffraction grating 90 may be selected to modify (i.e., enhance or reduce) wavelength dispersion introduced by the diffraction enhanced imaging system 16 .
- the single diffraction grating 90 may contain blazing and/or other design configured to couple energy into forward propagating direction (i.e., either positive 1 st order or negative 1 st order diffraction) minimizing loss of optical power during coupling.
- Blazing is altering symmetry of each period of the grating 92 to support constructive interference in one direction and/or angle out of the grating 92 and/or create strong destructive interference in other angles at which the grating 92 may attempt to diffract light.
- Depth and length of the grating 92 may also influence coupling efficiency, and may be selected to maximize power coupled into desired diffraction order without making grating complicated or costly to manufacture.
- the gratings 92 may consist of either a holographic (index-based) grating, alternating materials of different refractive index in a periodic manner over distance, dynamic diffractive elements, subwavelength diffractive elements, and/or an amplitude grating (periodic surface structure).
- parameters may include modulation period ( ⁇ g ), depth of modulation, and shape of function within each modulation period.
- ⁇ g modulation period
- depth of modulation a modulation period
- shape of function within each modulation period.
- ⁇ d sin - 1 ( m ⁇ ⁇ ⁇ ⁇ g + sin ⁇ ( ⁇ in ) ) ( EQ . ⁇ 1 )
- ⁇ in is the angle of the incoming light with respect to the grating normal, which equals zero for base design of the optical display system 10 .
- a greater depth of modulation generally increases the coupling efficiency which determines the fraction of incident power directed into first-order beams.
- Functional shape within each period of the gratings 92 may also influence diffraction efficiency for two first-order beams.
- a sinusoidal shape couples power equally into first order beams. As illustrated in FIG. 8A , power entering the ⁇ 1 order may not travel to the user's eye, and thus may represent a loss in the optical display system 10 .
- Altering shape of variation including blazing, from sinusoidal to some other shape may diffract power into the +1 order and significantly weaken coupling into the ⁇ 1 order, increasing power delivered to the user's eye and increasing in-coupling efficiency. Length of grating 92 and positioning of the image generator 14 along length of the grating 92 may also influence diffraction efficiency.
- FIG. 8B illustrates a graph 94 of a result of an exemplary embodiment of the in-coupling diffraction system 20 having a grating period of 1.648 ⁇ m. Rays diffract away from the in-coupling diffraction system 20 in diffraction directions and at different divergences for each of the three wavelengths.
- Distance between the diffraction enhanced imaging system 16 and the in-coupling diffraction system 20 may be configured to aid in propagation of the light. The distance may determine width of the beam of light for each color at the input plane of the in-coupling diffraction system 20 , and the difference in location of where the center of the beams intercept the in-coupling diffraction system 20 . In some embodiments, both beam width and beam axis location at the single diffraction grating 90 may be selected such that the resulting beams of light for each of the wavelengths have substantially similar width and beam axis when exiting the wavelength compensated beam expander 22 . In the exemplary embodiment illustrated in FIG. 8B , the single diffraction grating 90 was positioned at a distance of 5.865 mm from the diffraction enhanced imaging system 16 .
- the in-coupling diffraction system 20 may include multiple diffraction gratings 90 with each grating tuned to one of the three RGB colors such that each independently controls imaging properties of each wavelength.
- multiple gratings may include three spatially distinct diffraction gratings 90 a , 90 b and 90 c as illustrated in FIG. 9A .
- Each diffraction grating 90 a , 90 b and 90 c may be layered one behind the other, with angular output of each grating chosen to compensate for the difference in depth from which each output may be generated.
- multiple gratings 90 a , 90 b and 90 c may be formed within the same material as illustrated in FIG. 9B .
- the gratings 90 a , 90 b and 90 c may be superposed on one another, minimizing depth and/or thickness of the in-coupling diffraction system 20 and subsequent optical waveguide 12 .
- each may include a sinusoidal pattern having a different period and/or frequency.
- images from the in-coupling diffraction system 20 may be propagated towards the wavelength compensated beam expander 22 .
- the wavelength compensated beam expander 22 may provide an output image that contains magnification in a horizontal direction and/or corrects for wavelength dispersion such that color components of each pixel spatially overlap.
- the wavelength compensated beam expander 22 may include one or more optical elements 96 configured to simultaneously expand horizontal extension of the image (i.e., horizontal magnification), and/or compensate for wavelength dispersion such that color components of each image pixel may overlap precisely at one or more output coupling and vertical expansion systems 24 .
- diffracted light from in-coupling diffraction system 20 may strike each optical element 96 in series, with the divergence and/or wavelength dispersion properties being altered at each optical element 96 .
- at least two of the optical elements 96 may be configured as curved mirrors and/or the like.
- the optical elements 96 may alter the beam width based on relative focal lengths of each optical element 96 and/or distance traveled between each optical element 96 .
- the wavelength compensated beam expander 22 receives images formed by the in-coupling diffractive system 20 at each wavelength.
- Light from the image may either directly illuminate a first optical element 96 a or illuminate the first optical element 96 a after one or more reflections within the optical waveguide 12 , depending on design of the first optical element 96 a and/or needs of the application.
- the first optical element 96 a may produce a subsequent image, one for each wavelength, via diffraction and/or reflection, and may provide corrective action to reduce wavelength dispersion introduced by the diffraction enhanced imaging system 16 and the in-coupling diffractive system 20 .
- the image produced by the first optical element 96 a may act as the input to the second optical element 96 b .
- Light from the image produced by the first optical element 96 a may either directly illuminate the second optical element 96 b or may illuminate the second optical element 96 b after one or more reflections within the optical waveguide 12 .
- the design of the second optical element 96 b may produce images at infinity (i.e., collimated light) for each wavelength under initial design conditions, with the position and propagation direction (i.e., angle) of each output beam overlapping and coinciding with that of the beams for the other wavelengths.
- thickness of the optical waveguide 12 may determine the effective object distances for the elements. Distance of the object combined with design of each optical element 96 a and 96 b may determine the distance of the image for each wavelength. Further, selection of thickness for the optical waveguide 12 may allow for objects and images to appear at distances in concert with diffractive nature of the first optical element 96 a and the second optical element 96 b to provide corrected final output properties for each of the wavelengths. Additional optical elements (e.g., 96 c . . . 96 n ) may be used within the beam expander 22 and the output coupling and vertical expansion system 24 .
- Imaging properties of each optical element 96 may depend on effective shape of the optical element 96 . For example, spherical shapes may produce greater distortion as compared to aspheric shapes. In some embodiments, an intermediate image may be produced between two optical elements 96 . Depending on design, each optical element 96 may reduce or increase a difference in ray angles between wavelengths that occur due to in-coupling grating (e.g., wavelength dispersion). To minimize and/or eliminate wavelength dispersion and/or maximize image clarity, an additional optical element 96 (e.g., 96 c . . . 96 n ) may be used within the beam expander 22 . Such additional optical element 96 may be configured to compensate and/or correct for differences in ray angles among wavelengths. As such, beam expander 22 may produce a large lateral magnification in a short distance, provide a collimated output beam, and/or minimize wavelength dispersion artifacts in the image.
- in-coupling grating e.g., wavelength
- Each optical element 96 may include at least one of a reflective mirror 98 , a single-axis Fresnel reflector 100 , and a reflection grating 102 .
- the reflective mirror 98 may include a first surface 104 .
- the first surface 104 may be a curved surface.
- the first surface 104 may be spherical, aspheric, and/or the like.
- curvature of the first surface 104 may be dependent on function of the optical element 96 .
- the reflective mirror 98 may include a first end 106 and a second end 108 .
- the first end 106 and/or the second end 108 may be truncated such that a vertex is offset from center C of the reflective mirror 98 . With the vertex offset from center C, output angles may be adjusted for the reflected beam. Width w and length l of the reflective mirror 98 may be sufficient to intercept all or substantially all incoming light rays to minimize optical loss at the optical element 96 .
- the single-axis Fresnel reflector 100 may embody the concept of Fresnel zones to provide imaging along only one axis and/or direction.
- Fresnel reflectors 100 create effects of a curved surface by slicing the surface into rings (two-dimensional) or strips (one-dimensional) and placing such rings or strips in a flat plane.
- the one-dimensional configuration may alter beam width along only one axis. Constructive and destructive interference between light rays reflected from each strip may effectively focus or defocus optical power in the incident beam.
- r n n ⁇ ⁇ ⁇ ⁇ ⁇ f + n 2 ⁇ ⁇ 2 4 ( EQ . ⁇ 2 )
- r n is the distance from the center of the Fresnel reflector 100 to the center of the n th Fresnel zone
- n is a positive integer
- f is the desired focal length of the Fresnel reflector 100
- ⁇ is the design wavelength.
- the design wavelength may be selected to achieve specific values of wavelength dispersion (e.g., variation in value of f as a function of wavelength) to counteract, in part or in whole, dispersion generated by the diffraction enhanced imaging system 16 and the in-coupling diffractive system 20 .
- Width and length of the optical element 96 may be sufficient to intercept all incoming light rays in order to minimize optical loss at the optical element 96 .
- the optical element 96 may include the reflection grating 102 .
- the angle of reflection from the reflection grating 102 may be dependent on gratings 116 causing a reflected angle in a nonlinear manner, and as such, may alter divergence/convergence point of a cone of rays effectively changing location of the image with respect to the next optical element (e.g., 96 b ).
- the change in location of the image may depend on the wavelength, and as such, the reflective grating 116 may alter and/or compensate for wavelength dispersion.
- Other factors influencing reflection angle may include, but are not limited to, period of the grating, use of blazing to diffract light into a specific diffraction order, and/or the like.
- the optical element 96 may be positioned on the exterior of the optical waveguide 12 as illustrated in FIG. 10 .
- Light may pass through the optical waveguide 12 to the optical element 96 .
- space between the optical waveguide 12 and the optical element 96 may be filled with an optically clear material.
- the refractive index of the material maybe selected to reduce and/or eliminate total internal reflection at the wall of the optical waveguide 12 and/or minimize bending of rays passing through the optical waveguide 12 to the optical element 96 .
- the refractive index of the optically clear material may be substantially similar (a percent difference of less than 5%, for example) to the refractive index of the optical waveguide 12 .
- the material of the optically clear material may be an optical epoxy. In some embodiments, the material of the optically clear material may include adhesive properties such that the optical element 96 may be attached to the optical waveguide 12 . In some embodiments, the optical element 96 may be attached using a separate adhesive material and/or structure.
- the space between optical waveguide 12 and the optical element 96 may be filled with a material possessing a refractive index controllable by an applied electric field.
- Applying an electric field including but not limited to an applied voltage or current, may raise or lower the refractive index, depending on the properties of the material and polarity of the applied electric field. Raising or lowering the refractive index makes the refractive index of the material different from that of the optical waveguide 12 , causing refractive bending of the light rays at the boundary between the material and the optical waveguide 12 .
- Refractive bending may change the effective location and/or distance of the object for the optical element 96 , thereby changing the imaging properties (divergence, image location and type) of the optical element 96 and thus changing the wavelength dispersion compensation achieved by the optical element 96 .
- the change in wavelength dispersion compensation may allow the wavelength compensated beam expander 22 to correct for changes in the wavelength dispersion of the diffraction enhanced imaging system 16 resulting from changes in the second refractive element 86 .
- a piezo electric material may be positioned as a spacer between the wall of waveguide 12 and the optical element 96 .
- a voltage applied to the piezo electric material may cause the piezo electric material to expand or contract in size, subsequently causing the optical element 96 to move closer to or further away from wall of waveguide 12 .
- two or more piezo electric spacers may be used to change the tilt of the optical element 96 .
- the piezo electric spacer on one side may be directed to expand while the piezo electric spacer on the opposite side may be directed to contract, causing the optical element 96 to obtain a tilt with respect to the wall of waveguide 12 , with the tilt oriented toward the side on which the piezo electric spacer expanded and oriented away from the side on which the piezo electric spacer contracted.
- the change in distance between optical element 96 and the wall of waveguide 12 may change the effective object distance between the prior image and the optical element 96 , thereby changing the imaging properties (divergence, image location and type) of the optical element 96 and thus changing the wavelength dispersion compensation achieved by the optical element 96 .
- the change in wavelength dispersion compensation may allow the wavelength compensated beam expander 22 to correct for changes in the wavelength dispersion of the diffraction enhanced imaging system 16 resulting from changes in the second refractive element 86 .
- the optical element 96 may be formed within the wall of the optical waveguide 12 .
- the wall of the optical waveguide 12 may be sculpted to a desired shape.
- the exterior surface of the optical waveguide 12 may then be coated with a reflective coating forming the optical element 96 .
- the reflective coating may consist of a metal substance, for example, reflecting at each of the RGB wavelengths.
- Other coatings and/or implementation of the reflective coating, such as dielectric coatings, are contemplated that provide for equal reflection power at each of the RGB wavelengths.
- FIG. 12 illustrates a graph 120 of output for an exemplary wavelength compensated beam expander 22 having at least one optical element 96 including the single axis Fresnel reflector 100 .
- the single axis Fresnel reflector 100 may collect light and bring reflections to a focal point with the optical waveguide 12 .
- the first optical element 96 a has a focal length of 0.14 mm at a design wavelength of 665 nm, and the center of the first optical element 96 a is positioned 2.2 ⁇ m from the central axis of the red wavelength 72 .
- Other combination of thickness for the optical waveguide 12 , focal length, design wavelength, and reflector center may potentially produce equal width beams at the second optical element 96 b .
- Each wavelength may focus at a different distance and/or angle within the optical waveguide 12 , and the width of beam at the input plane of the second optical element 96 b (e.g., second single-axis Fresnel reflector 100 ) may be substantially equal for all wavelengths.
- the second optical element 96 b may utilize a design providing collimated light at substantially all wavelengths and direction of wavelengths down the length at substantially the same angle.
- small focal length e.g., less than or equal to 0.1 mm
- reflection from at least a section of the second optical element 96 b off-center may be used. Off-centered reflection may provide less divergence in output beams, with less than 0.005 degrees of divergence shown in FIG. 12 .
- the output angle provided may also produce total-internal reflection of all wavelengths about the walls of the optical waveguide 12 .
- the output coupling and vertical expansion system 24 may magnify the image in a vertical direction creating a large output area (i.e., exit pupil).
- the output coupling and vertical expansion system 24 may include a vertically oriented waveguide 122 employing a vertical beam expanding element 121 and two or more reflecting elements 124 configured to magnify the exit pupil in a vertical direction and/or to direct a fraction of light out of the vertically oriented waveguide 122 and towards the user at specific angles to create a wide FOV.
- a large exit pupil, combined with the range of light angles entering the eye may produce the large total FOV.
- the FOV describes the range of angles over which the user may perceive the image generated by the optical display system 10 , and may determine the size of viewing area for the user.
- a larger FOV may allow the user to observe scenes and objects over a larger range, reducing the need to turn the user's head to view images away from a center of vision and/or preventing objects from clipping or disappearing off edges of the images when looking at another object.
- a turning optic 126 may direct the image in a vertical direction as shown in FIG. 13 .
- the turning optic 126 may consist of, but is not limited to, a mirrored surface, consisting of one or more discrete component surfaces deflecting light, or a distributed reflecting element, including but not limited to a long-period variation in the refractive index for which reflection rather than diffraction may be the predominant optical effect Fabry Perot Filters, and/or the like. Light propagation off of the turning optic 126 may then contain a component perpendicular to propagation along the optical waveguide 12 .
- the vertical beam expanding element 121 contains components that may be used to deflect light through a range of angles in the vertical direction. Such components may provide for rays to propagate at a faster rate as compared to other rays propagating solely in the vertical direction, and as such, the image may be expanded in the vertical direction.
- Components of the vertical beam expanding element 121 may include, but are not limited to, a wavelength compensated beam expander of similar composition to that of the wavelength compensated beam expander 22 in waveguide 12 , one or more mirrors of which at least two must be curved, and/or TIR reflections between the walls of vertical waveguide 122 .
- the vertical waveguide 122 may be similar in construction to the compensated beam expander 22 .
- a 45 degree deflection may be created in a vertical direction by turning optic 126 providing light to propagate between walls of the vertical waveguide 122 employing TIR.
- one or more of the components may possess the capability to change the image forming properties of the component through the application of an electric field.
- the components may possess structure similar to optical element 96 in the optical waveguide 12 , including a material possessing a refractive index that varies with the application of an applied electric field and piezoelectric devices placed between the component and the wall of vertical waveguide 122 .
- the change in image forming properties allows the vertical beam expanding element 121 to alter the divergence of the light traveling along vertical waveguide 122 which may change the perceived distance of an object from the viewer, either as an independent control or in combination with the second refractive element 86 .
- the vertical waveguide 122 may be formed of an optically clear material having sufficiently high index of refraction to provide for total internal reflection over a wide range of incident angles.
- Potential materials include, but are not limited to, optical plastic, optical glass, and/or the like.
- one or more optical plastics may be used to reduce cost and/or weight of the optical display system 10 .
- Thickness of the vertical waveguide 122 , angle of deflection created by the turning optic 126 , and/or spacing of the reflecting elements 124 may determine magnification achieved between the turning optic 126 and the reflecting elements 124 .
- the reflecting elements 124 may be designed to direct a fraction of the optical power propagating within the vertical waveguide 122 towards a user's eye at a specific angle and/or specific divergence, independent of the wavelength incident on the reflecting elements 124 .
- the reflecting element 124 may maintain color balance (ratio) in the original image due to its wavelength independent reflection properties.
- the reflecting element 124 may include, but is not limited to, a Fabry-Perot filter, a partially reflecting thin film element, and/or the like.
- the Fabry-Perot filter may have low reflectivity at end surfaces and a sufficiently small distance between such end surfaces, such that the range of wavelengths between resonances of the filter exceeds the range between the blue and red wavelengths contained in the image projected by the image generator 14 .
- Low reflectivity surfaces may increase transmission coefficient in a region between resonance wavelengths of the filter, thereby reducing the reflectance. Changing surface reflectivity subsequently may change the reflectance.
- the reflectance may be configured to begin at a lower value for the first reflector and increase steadily for each subsequent reflector in the series chain, since the incident power on each subsequent reflector has been reduced by the reflecting operation of the previous reflector.
- the reflectance of the first reflector and each subsequent reflector depends on the number of reflectors.
- the first reflector would reflect 0.25 of the incident light
- the next reflector would reflect 1 ⁇ 3 rd of the remaining light transmitted through the first reflector
- the third reflector would reflect 0.5
- the final reflector would reflect all incident light, resulting in each reflector directing 1 ⁇ 4 th of the original power to the user's eye.
- the distance between the end surfaces decreases, the distance between resonant wavelengths increases, and the reflectance as a function of wavelength may closely approximate ((i.e., within a few percent and up to 20% difference, for example) a constant in the region between the resonant wavelengths, resulting in less wavelength dependence in the fraction of power reflected toward the user.
- the Fabry-Perot filter may consist of, but is not limited to, a material of different index than the surrounding waveguide inserted into the waveguide, an air gap created by slicing the waveguide and shifting one side of the slice a specified distance from the other slice, or slicing the waveguide at two nearly adjacent points, applying a reflecting thin film to the slice surfaces, and reassembling the sliced parts into a single waveguide.
- the reflecting element 124 may also include a partially reflecting thin film element.
- the partially reflecting thin film element may be configured to obtain a given reflection coefficient at each wavelength.
- the vertical waveguide 122 may be sliced with ends of the slices polished. A thin film may then be applied to each polished end with the vertical waveguide 122 splice together into a whole component.
- the angle at which the reflecting element 124 deflects light toward the user may be determined by the angle of the reflecting element 124 with respect to the walls of the vertical waveguide 122 and with respect to the angle of propagation of the light within the vertical waveguide 122 .
- the angle of each reflecting element 124 may be configured to be different, such that each reflecting element 124 directs light into the user's eye from a different direction. For example, a first reflecting element 124 may directs light downward at a relatively steep angle, the second reflecting element 124 may direct light downward at a shallow angle, the third reflecting element 124 may direct light upward at a shallow angle, and the fourth reflecting element 124 may direct light upward at a relatively steep angle.
- the reflecting elements 124 on the left side of vertical waveguide 122 may also possess some horizontal tilt, directing light back toward the right, and the reflecting elements 124 on the right side of vertical waveguide 122 may possess a different horizontal tilt directing light back toward the left. Varying the direction in such a way effectively increases the FOV by directing light from a large area of the vertical waveguide 122 (FOV is highly dependent on the emitting area) and increasing the range of angles at which light from the image reaches the eye (increases the FOV further, beyond that resulting from the size of the emitting area). Other orientations and positioning of the reflecting elements 124 along the vertical direction are possible, depending on the targeted application.
- FIG. 14 illustrates a graph 130 of output of an exemplary embodiment of the output coupling and vertical expansion system 24 .
- FIG. 14 illustrates image formation and reflection operation of reflecting elements 124 for the blue wavelength 76 .
- images form at relatively large distances from the optical waveguide 12 . Such distances increase as divergence of the beam exiting the output coupling and vertical expansion system 24 approaches zero (i.e., collimated condition).
- positioning of the reflecting elements 124 may be dependent on size restrictions imposed by the application, including distance common to a human head and human eye.
- FIG. 15 illustrates a graph 132 of a guided beam striking the reflecting elements 124 along the length of the vertical waveguide 122 .
- the percentage of power reflected may depend on the incident angle determined by the angle at which light travels along the vertical waveguide 122 and the angle of the reflective element 124 .
- the divergence of rays exiting from the output coupling and vertical expansion system 24 may be different from the divergence within the vertical waveguide 122 if surfaces of the reflecting elements 124 are not flat, but instead configured with a degree of curvature. Curvature may alter the reflecting element 124 and as such provide a low power (i.e., long focal length) mirror, for example.
- curvature of the reflecting surface may limit the range of incident angle to the range wherein cos( ⁇ ) ⁇ 1.
- collimated light propagating within the vertical waveguide 122 may strike one or more reflecting elements 124 configured to create a divergent beam that creates a virtual image for the user at a designed distance, such as the near point of the user's eye.
- Changes in the divergence of the light propagating within the vertical waveguide 122 , configuration of adjustments to focal length of the diffraction enhanced imaging system 16 may create greater or less divergence of light from the reflecting elements 124 thus changing location of the virtual image and providing a more natural and/or comfortable viewing experience for a user.
Abstract
Optical display systems and methods for providing three-dimensional and two-dimensional convergence corrected images to a user are described. The optical display systems may include at least two image generators producing a plurality of rays forming a plurality of images. A diffraction enhanced imaging system may be configured to collect the rays produced and control convergence angle of each ray at specific wavelengths into an optical waveguide. An in-coupling diffraction system may couple the rays into the optical waveguide. A wavelength compensated beam expander may expand horizontal extension of the images and an output coupling and vertical expansion system may magnify the images in a vertical direction and direct light towards a user at specific angles creating a wide field of view.
Description
- The present application is a continuation of U.S. Ser. No. 15/896,889, filed Feb. 14, 2018, which claims the benefit of U.S. Ser. No. 62/458,808, filed Feb. 14, 2017, and U.S. Ser. No. 62/547,352, filed Aug. 25, 2017, which are hereby incorporated by reference in their entirety.
- Augmented reality (AR) and virtual reality (VR) systems promise to revolutionize the way humans interact with each other and the world around them. These technologies provide human eyes additional information that either augments or supplant visual information received from the outside world to entertain, inform and/or educate a user. Generally, VR systems immerse a user in a virtual world, limiting input from the outside world, and AR systems superimpose information and/or virtual images onto a scene observed by a user. The user may be allowed to engage in interactive games, view information (e.g., instruction manuals, handbooks) while performing a task or exploring, conduct virtual training, and/or visualize digital information. For example, AR systems may use a head's up display (HUD), overlaying the outside world with images and/or data screens containing information adding to a user's experience.
- In general, AR displays consist of four common main subsystems, each of which may impact the display performance. First, the optical system generates, manipulates and presents images to the viewer in a manner that causes a user to perceive existence of virtual objects within an outside visual world. Second, environmental mapping may use cameras and sensors to obtain knowledge of the surrounding environment, such as walls, desks and other surfaces that could support images and detect a user's movement within the environment. Third, head and eye tracking systems may provide feedback on where a user wishes to look and the existence of any alignment issues for which the system must accommodate. Finally, extensive software and hardware processing systems may contain the computing power that controls, coordinates, and drives the actions of the other three subsystems.
- Design and implementation of the optical system generally use either bulk optics systems or waveguide systems. Bulk optical systems use a combination of lenses and custom designed prisms to magnify and distribute the image to a user's eye. The image generator projects light into a free-form prism—the shape of the prism deviates from regular geometric figures—and total internal reflection (TIR) at the surface combined with the shape provides the means to magnify the image and direct the magnified image toward a user's eye. A second prism placed nearly in contact with the first prism corrects distortions caused by the first prism and may allow light from the external world to pass through to a user's eye. This solution possesses several drawbacks that may limit use for practical applications, including the large size and weight of the prisms, incomplete correction of image distortions, small field of view (FOV), and no practical path to implementing methods to resolve vergence-accommodation conflict. Examples of this type of system include multi-focal plane displays and Google Glass, manufactured by Google having a principle place of business in Mountain View, Calif.
- The more current offering of AR head-mounted displays use an optical waveguide system to connect the output of the image generator to a user's eye. The waveguide generally may consist of a piece of glass cut thin in one dimension, typically in width. Light rays propagate through the waveguide by TIR, and optical elements placed within the waveguide or along the walls of the waveguide provide means to couple light into the waveguide from the image generator, modify the magnification and divergence of the image, and couple the light out of the waveguide towards the user's eye.
- Present waveguide systems use either diffractive or reflective optical elements in conjunction with the waveguides. Reflective elements possess an advantage of operating at all RGB wavelengths, greatly reducing the number of waveguides needed. Current implementations of such systems, however, suffer from bulkiness and scattering that may deteriorate image quality. Most systems may utilize diffractive optical elements to overcome the size and scattering constraints of the reflective elements. Diffractive elements consist of periodic variations in the waveguide's refractive index (holographic optical elements or HOEs), periodic variations in the surface structure, created by patterning or cutting of material on the waveguide surface, computer-generated holograms (CCH), sub-wavelength digital elements (SWE) or dynamic diffractive optics.
- Diffractive elements may present many advantages, including small size and weight, the ability to create them directly on or within the waveguide, the ability to tune the element to pass light from the external scene with minimal distortion or dimming, and ease of design. Diffractive elements also may present three key disadvantages. First, the elements may operate in a very narrow band of wavelengths, and thus systems based on diffractive elements may require three waveguides, with each waveguide individually processing one of the RGB wavelengths thus adding to the size and cost of the display system. Second, diffractive elements display high angular selectivity, which may limit the range of ray angles directed by the grating towards the user, thus significantly limiting the FOV achieved by the display. Third, many of the diffractive elements currently in use have complex shapes that may require lengthy and/or costly manufacturing processes. Differences in the use and implementation of the optical elements drive the differences in performance achieved by existing display offerings.
- Many development-level systems currently exist in the market that attempt to harness and deliver the potential of AR, however such systems suffer from a number of issues that limit their potential and/or effectiveness for long term wearing and broad spectrum adoption. For example, existing systems may limit the field of view (FOV) presented to a user. The human eyes capture images from angles over 180 degrees horizontally and 60 degrees vertically. Current optical systems used to present three-dimensional (3D) images to a user's eyes may restrict the field of view (FOV) to 30 degrees by 17 degrees. This limitation may decrease the amount of information the system is able to present to the user in a single frame. The following prior art system provide an overview of those seen typically within the industry.
- The BAE System having a principle place of business in Farnborough, United Kingdom, manufacturers the Quantum Display. The Quantum Display generally utilizes a set of diffraction gratings expanding the exit pupil and generating a range of output ray angles. The display positions the image projector at a specific angle with respect to a horizontal waveguide in order to accommodate for the angular selectivity of the diffraction gratings. The optics and mechanics required to achieve the optimal launch conditions add significantly to the size and weight of the display. Light propagating through the first waveguide interacts with a diffraction grating placed or etched on the top surface, and the grating diffracts a portion of the light into a vertical waveguide at each point along horizontal waveguide. A second grating on the surface of the vertical waveguide performs a similar function, coupling light out at each point of the waveguide surface at a range of angles determined by the design of the diffraction grating. The current design projects a collimated output beam and thus produces an output at infinity, and does not provide for any accommodation allowance. The display produces a 30° FOV for one eye (monocular) and uses only one set of waveguides and gratings, limiting current versions to monochrome image generation. The angular positioning of the source and the relatively large thickness of the waveguide make expanding the system to binocular, RGB image generation impractical.
- The Lumus display, as described in patent applications filed by Lumus (U.S. Pat. No. 7,391,573, U.S. Ser. No. 12/596,823 and U.S. Ser. No. 12/092,818, for example), generally utilizes a set of reflective surfaces to perform in-coupling, expand the exit pupil and generate a range of output angles. The reflective surfaces rely on the reflection and transmission of light at the boundary between two materials of different refractive index. Each reflector in the waveguide uses a multi-layer coating to produce a partially reflecting mirror. Light rays striking the mirror at certain angles are partially reflected, sending light toward the user's eyes. An element design may prevent reflection from the back of the element, which would send light out the side or rear of the waveguide, away from the user's eye. Several elements distributed along the length of the waveguide couple light out from an extended length along the horizontal direction, effectively expanding the exit pupil in this direction. A similar optical element at the waveguide input couples light into the waveguide from an image generator. A series of lenses, mirrors, and prisms conditions and converges the light from the image generator to coupling and create the divergent beam to present a virtual image to the user. An additional optic may distribute light in the vertical direction to increase the exit pupil in the vertical direction as well as the horizontal direction.
- The Lumus display exhibits many design challenges that may limit effectiveness. First, the in-coupling system requires custom, heavy, and bulky optics and a 45° angle, adding weight, size and cost to the system. Second, the eye pupil expansion in both the vertical and horizontal direction may occur relatively slowly, requiring the beam to travel a long distance within the waveguide (around half an inch) before reaching the out-coupling reflective elements. As a result, only a small fraction (around ⅓rd) of the glass area in front of the user's eye may contribute to the production of an image, creating significant dead space in the display. Since most of the FOV produced by a display depends on the size of the emitting area, the small image-producing area greatly restricts the FOV to below 30 degrees. Third, the in-coupling optical design may need to compensate for the polarization-dependent nature of the reflective out-coupling elements. To ensure that each polarization state reflects the same amount of power at each mirror, the in-coupling system may need to carefully control the angle at which each state enters the waveguide. The solution used in the Lumus display contributes to the size, weight and cost of the system.
- Fourth, the display produces virtual images at a fixed accommodation and provides no method for adjusting the accommodation to address the vergence-accommodation conflict. In natural viewing, a user's eyes adjust to objects at different distance by changing the focus of the lens (accommodation) to produce a clear image on the user's retina, and by rotating the eyes inward or outward such that the line of sight from the two eyes may converge at the same distance as the object (vergence). The Lumus display presents images at a fixed distance from the eyes such that the images create a virtual object at a perceived distance from the viewer. The eyes may rotate to adapt the vergence based on perceived depth, but the eyes remain focused on the screens, causing an unnatural disconnect between the vergence and accommodation activities. This disconnect may cause moderate to severe problems for a user, including eye strain, headaches and discomfort or disorientation. Further, such issues may worsen over extended viewing periods.
- Lastly, the current design of the reflective layers of the Lumus display produces scattering, which may reduce image clarity and/or may increase power required to produce an image. Increased power requirements may strain the limited battery capacity, limiting use time.
- The Hololens system is manufactured by Microsoft, having a principle place of business in Redmond, Wash., and utilizes a series of specialized diffractive gratings to perform in-coupling, exit pupil expansion, and out-coupling. Generally, light from the image generator may enter perpendicular to the waveguide and couple into the waveguide at specific angles through a specially designed diffraction grating. The Hololens system is further described in the article “Diffractive optics for virtual reality displays,” Journal of the Society for Information Display, Vol. 14, No. 5, pp. 467-475, 2006, and is herein incorporated by reference in its entirety. The grating possesses a tilted structure that couples light in the outward direction toward the eye, with little or no power directed away from the eye. An extended, cone-shaped grating panel uses a similar grating structure to expand the exit pupil in the horizontal direction, directing fractions of light to the larger grating, which expands the exit pupil in the vertical direction. The area of the larger grating may effectively define the Hololens' exit pupil. The modulation depth of both gratings increases with distance from the in-coupling point such that the same amount of power reflects from each point of the grating to produce a uniform intensity image. A liquid crystal display contained in a separate layer provides selective occlusion of the external scene to improve image contrast.
- The Hololens design presents many design challenges and choices that may limit the system effectiveness and commercial viability. First, the design of the diffraction gratings makes the gratings exceedingly difficult and quite costly to manufacture. Second, the diffraction gratings operate efficiently at only a single wavelength. To project RGB images, the display uses three parallel waveguides, one for each color, with alignment carefully controlled to match pixel positions in each waveguide. Each eye therefore may require nine of the costly and complicated gratings, for a total of 18 gratings, quickly driving the cost of the system out of the range of most potential users. The use of multiple layers also increases the size and weight of the display, particularly at the front. Third, difficulties in producing the gratings may also limit the maximum area of the out-coupling grating and thus may limit the FOV. The Hololens achieves a FOV of 30 degree horizontally and 17 degrees vertically resulting in a restricted virtual world for the user. Such a small FOV restrict the user's ability to work with multiple objects simultaneously and/or view an entirety of a virtual scene (e.g., objects on edge of scene may disappear or cut-off). Because of the limited FOV, the user can typically see only one complete object at a time, with other objects out of view or only party visible, contrary to the wide FOV concept pictures presented on the Hololens web page. In order to view a complete scene, a user may be required to turn their head and center each object within the FOV, causing other objects to disappear and/or placing motion strain on a user's neck. Lastly, the fixed nature and angular selectivity of the gratings precludes adding optical components that would adjust beam divergence to alleviate the vergence-accommodation conflict.
- The optical display manufactured by Magic Leap, having a principle place of business in Plantation, Fla., and described in U.S. Pat. No. 8,950,867, “Three Dimensional Virtual Augmented Reality Display System,” and U.S. Pat. No. 9,310,559, “Multiple Depth Plane Three-dimensional Display Using a Waveguide Reflector Array Projector,” utilizes a combination of beam-splitters and micro-reflectors to produce the only prior art display attempting to address the accommodation-vergence conflict. Generally, light couples from the image generator into a coupling tube, with the coupling process using a fiber or diffractive element, depending on the specific implementation. The coupling tube may contain a series of beam splitters that reflect a portion of the light into an array of waveguide tubes. The coupling tube may expand the exit pupil in the vertical directions. Each waveguide tube contains a series of curved reflective elements that serve to expand the exit pupil in the horizontal direction (similar to the Lumus display described herein) and to produce a specific divergence in the beam that may cause the virtual image to appear at a specific distance from the user. To produce images at varying distances, multiple coupling-waveguide tube combinations may be stacked in parallel with each combination containing reflective elements of different curvature. The total system may produce images at twelve discrete distances, and the system may produce a distance continuum by illuminating adjacent combinations with different optical power ratios. Switches or other elements select the amount of power delivered to each layer in the overall stack.
- The Magic Leap design presents a number of challenging design issues that has prevented the completion of a working prototype. First, the stacked layers of coupling-waveguide tube combinations prove challenging and quite difficult and costly to produce. One such stack may require manufacturing of multiple tubes, each with multiple reflective elements, and each layer of tubes requiring a different curvature for the reflective elements. Second, the size of one such stack, coupled with the need to produce a separate stack for each color to produce an RGB image, may cause the size and weight of the display to grow rapidly. The thickness of the display may exceed that of either the Hololens or Lumus displays. Third, little information exists on the method for implementing layer selection and distribution of power amongst the layers, leaving a number of design challenges unsolved based on the present information available. Fourth, light from one layer must pass through one or more other layers as the light travels to the eye, which raises the possibility of cross-talk and scattering issues that may likely degrade image quality.
- As such, there exists a need within the art for a low cost, lightweight and broad FOV optical display system to realize the potential of AR and/or VR systems.
- Several embodiments of the present disclosure are hereby illustrated in the appended drawings. It is to be noted however, that the appended drawings only illustrate several typical embodiments and are therefore not intended to be considered limiting of the scope of the present disclosure. Further, in the appended drawings, like or identical reference numerals or letters may be used to identify common or similar elements, and not all such elements may be so numbered. The figures are not necessarily to scale, and certain features and certain views of the figures may be shown as exaggerated in scale or in schematic in the interest of clarity and conciseness. Various dimensions shown in the figures are not limited to those shown therein and are only intended to be exemplary.
-
FIG. 1 is block diagram of an exemplary optical display system of the present disclosure. -
FIGS. 2A, 2B and 2C are perspective views of exemplary optical display systems of the present disclosure. -
FIG. 3 is a block diagram of an exemplary diffraction enhanced optical imaging system for use in the optical display system illustrated inFIG. 1 . -
FIG. 4 is a graphical representation of example output of an exemplary embodiment of the diffraction enhanced optical imaging system illustrated inFIG. 3 . -
FIG. 5 is a block diagram of another exemplary diffraction enhanced optical imaging system for use in the optical display system illustrated inFIG. 1 . -
FIG. 6 is a graphical representation of example output of an exemplary embodiment of the diffraction enhanced optical imaging system illustrated inFIG. 5 . -
FIG. 7A is a block diagram of another exemplary diffraction enhanced optical imaging system for use in the optical display system illustrated inFIG. 1 . -
FIG. 7B is a block diagram of another exemplary diffraction enhanced optical imaging system for use in the optical display system illustrated inFIG. 1 . -
FIG. 8A is a block diagram of an exemplary in-coupling diffraction element for use in the optical display system illustrated inFIG. 1 . -
FIG. 8B is a graphical representation of example output of an exemplary embodiment of the in-coupling diffraction element illustrated inFIG. 8 . -
FIGS. 9A and 9B are block diagrams of exemplary in-coupling diffraction elements for use in the optical display system illustrated inFIG. 1 . -
FIG. 10 is a block diagram of an exemplary wavelength compensated beam expander for use in the optical display system illustrated inFIG. 1 . -
FIGS. 11A-11C are block diagrams of exemplary optical elements for use in the wavelength compensated beam expander illustrated inFIG. 10 . -
FIG. 12 is a graphical representation of example output of an exemplary embodiment of the wavelength compensated beam expander illustrated inFIG. 10 . -
FIG. 13 is a block diagram of an exemplary output coupling and vertical expansion system for use in the optical display system illustrated inFIG. 1 . -
FIGS. 14 and 15 are graphical representation of example output of an exemplary embodiment of the output coupling and vertical expansion system illustrated inFIG. 13 . - The present disclosure describes an optical display system for use in augmented reality systems and/or virtual reality systems. Generally, the optical display system may maximize coupling of light from an image generator to an optical waveguide, include image magnification (e.g., exit pupil expansion) and wavelength dispersion correction over short distances to minimize size and/or weight of the optical display system, out-couple light substantially equally at most or all wavelengths over a significant area and range of angles to achieve a field of view (FOV) greater than 30 degrees, greater than 40 degrees, greater than 50 degrees, greater than 60 degrees, and/or provide beam divergence to provide natural eye accommodation. In some embodiments, the optical display system may include electrical and/or software components for driving image generators.
- In some embodiments, the optical display system may provide three-dimensional, two-dimensional, convergence corrected, and/or full-color images to a user while minimizing size and/or weight of the optical display system. In some embodiments, the optical display system may use only a single waveguide to expand and/or direct light from an image generator to a user's eyes. A combination of diffractive elements may provide beam expansion within short distances and/or correction of chromatic aberrations within the optical display system to provide a sharp image with a wide FOV. Output couplers may provide additional enhancement of the FOV in some embodiments. A variable optical element may change divergence of the beam that reaches the output couplers, allowing the optical display system to change perceived distance of an object from the user and provide substantially correct convergence to ensure natural viewing by the user. A refractive optical element may provide images at different angles from an optical axis, as well as different distances from an output plane of the lens. A multi-layer diffractive optical element may provide wavelength dispersion of opposite sign.
- Before describing various embodiments of the present disclosure in more detail by way of exemplary descriptions, examples, and results, it is to be understood that the embodiments of the present disclosure are not limited in application to the details of systems, methods, and compositions as set forth in the following description. The embodiments of the present disclosure are capable of other embodiments or of being practiced or carried out in various ways. As such, the language used herein is intended to be given the broadest possible scope and meaning; and the embodiments are meant to be exemplary, not exhaustive. Also, it is to be understood that the phraseology and terminology employed herein is for the purpose of description and should not be regarded as limiting unless otherwise indicated as so. Moreover, in the following detailed description, numerous specific details are set forth in order to provide a more thorough understanding of the disclosure. However, it will be apparent to a person having ordinary skill in the art that the embodiments of the present disclosure may be practiced without these specific details. In other instances, features that are well known to persons of ordinary skill in the art have not been described in detail to avoid unnecessary complication of the description.
- Unless otherwise defined herein, scientific and technical terms used in connection with the embodiments of the present disclosure shall have the meanings that are commonly understood by those having ordinary skill in the art. Further, unless otherwise required by context, singular terms shall include pluralities and plural terms shall include the singular.
- All patents, published patent applications, and non-patent publications referenced in any portion of this application are herein expressly incorporated by reference in their entirety to the same extent as if each individual patent or publication was specifically and individually indicated to be incorporated by reference.
- As utilized in accordance with the concepts of the present disclosure, the following terms, unless otherwise indicated, shall be understood to have the following meanings:
- The use of the word “a” or “an” when used in conjunction with the term “comprising” in the claims and/or the specification may mean “one,” but it is also consistent with the meaning of “one or more,” “at least one,” and “one or more than one.” The use of the term “or” in the claims and/or the specification is used to mean “and/or” unless explicitly indicated to refer to alternatives only or when the alternatives are mutually exclusive, although the disclosure supports a definition that refers to only alternatives and “and/or.” The use of the term “at least one” will be understood to include one as well as any quantity more than one, including but not limited to 2, 3, 4, 5, 6, 7, 8, 9, 10, 15, 20, 30, 40, 50, 100, or any integer inclusive therein. The term “at least one” may extend up to 100 or 1000 or more, depending on the term to which it is attached; in addition, the quantities of 100/1000 are not to be considered limiting, as higher limits may also produce satisfactory results. In addition, the use of the term “at least one of X, Y and Z” will be understood to include X alone, Y alone, and Z alone, as well as any combination of X, Y, and Z.
- As used in this specification and claim(s), the words “comprising” (and any form of comprising, such as “comprise” and “comprises”), “having” (and any form of having, such as “have” and “has”), “including” (and any form of including, such as “includes” and “include”) or “containing” (and any form of containing, such as “contains” and “contain”) are inclusive or open-ended and do not exclude additional, unrecited elements or method steps.
- The term “or combinations thereof” as used herein refers to all permutations and combinations of the listed items preceding the term. For example, “A, B, C, or combinations thereof” is intended to include at least one of: A, B, C, AB, AC, BC, or ABC, and if order is important in a particular context, also BA, CA, CB, CBA, BCA, ACB, BAC, or CAB. Continuing with this example, expressly included are combinations that contain repeats of one or more item or term, such as BB, AAA, AAB, BBC, AAABCCCC, CBBAAA, CABABB, and so forth. The skilled artisan will understand that typically there is no limit on the number of items or terms in any combination, unless otherwise apparent from the context.
- Throughout this application, the term “about” is used to indicate that a value includes the inherent variation of error that exists among the study subjects. Further; in this detailed description, each numerical value (e.g., temperature or time) should be read once as modified by the term “about” (unless already expressly so modified), and then read again as not so modified unless otherwise indicated in context. Also, any range listed or described herein is intended to include, implicitly or explicitly, any number within the range, particularly all integers, including the end points, and is to be considered as having been so stated. For example, “a range from 1 to 10” is to be read as indicating each possible number, particularly integers, along the continuum between about 1 and about 10. Thus, even if specific data points within the range, or even no data points within the range, are explicitly identified or specifically referred to, it is to be understood that any data points within the range are to be considered to have been specified, and that the inventors possessed knowledge of the entire range and the points within the range. Further, an embodiment having a feature characterized by the range does not have to be achieved for every value in the range, but can be achieved for just a subset of the range. For example, where a range covers units 1-10, the feature specified by the range could be achieved for only units 4-6 in a particular embodiment.
- As used herein, the term “substantially” means that the subsequently described event or circumstance completely occurs or that the subsequently described event or circumstance occurs to a great extent or degree. For example, the term “substantially” means that the subsequently described event or circumstance occurs at least 90% of the time, or at least 95% of the time, or at least 98% of the time.
- Referring to the Figures, and in particular to
FIGS. 1 and 2A-2B , illustrated areoptical display systems 10 for providing three-dimensional, two-dimensional, convergence corrected images to a user. Images may be full-color images, limited color images, grayscale images, and/or black and white images. Generally, theoptical display system 10 may couple one or more images into anoptical waveguide 12. It should be noted that images may include still images, video, animation, and/or the like. Additionally, theoptical display system 10 may be configured to magnify the image in a horizontal direction and/or horizontal and vertical directions without producing any or minimal wavelength separation and/or distortion of the one or more images. To that end, theoptical display system 10 may include one or more diffraction enhancedimaging systems 16 configured to collect one ormore rays 18 produced by the image generator 14 (e.g., DLP projector, LCD display system, LCOS display system, GLV system, fiber controlled display system, and/or the like). The diffraction enhancedimaging system 16 may control convergence angle of each of therays 18 at each wavelength (e.g., red, green, blue) prior to coupling each of therays 18 into theoptical waveguide 12. One or more in-coupling diffraction systems 20 may use diffraction to couple theincoming rays 18 into theoptical waveguide 12 at specific convergence and/or divergence angles needed by subsequent systems to produce an expanded beam having specific final divergence angles. Within theoptical waveguide 12, one or more wavelength compensatedbeam expanders 22 configured to simultaneously expand horizontal extension of the image (i.e., horizontal magnification), and/or compensate for wavelength dispersion such that color components of each image pixel may overlap precisely at one or more output coupling andvertical expansion systems 24. The output coupling andvertical expansion system 24 may be configured to magnify the image in a vertical direction and/or to direct a fraction of light towards the user at specific angles to create a wide FOV. It should be noted that via rotation of theoptical display system 10, horizontal movement may become vertical and vertical movement may become horizontal.FIG. 2C illustrates an exemplary vertical arrangement of theoptical display system 10. - In some embodiments, an adjustable optical element may be configured to control apparent distance at which the object appears such that the eye's convergence and accommodation system may work in concert, resulting in reduced fatigue and disorientation. One or more of the wavelength compensated
beam expanders 22 may contain adjustable components that maintain the overlap of the color components of each image pixel for different configurations of the adjustable optical element. Other systems, as described herein, may control and/or coordinate generation of one or more images, track user movement (e.g., determine user directed attention), track user's eyes movement, map external surrounding, and/or the like. - Details and possible embodiments of the
optical display system 10 and each of the diffraction enhanced imaging system(s) 16, in-coupling diffraction system(s) 20, wavelength compensated beam expander(s) 22, and output coupling and vertical expansion system(s) 24 are herein described. - In some embodiments, the
optical display system 10 may be housed in aheadset 30 as illustrated inFIGS. 2A and 2B . Theheadset 30 may include aframe 32. In some embodiments, theframe 32 may include one ormore portions 34 configured to rest on a nose and/or ears of a user. In some embodiments, theframe 32 may include a band (not shown) configured to secure theheadset 30 to a user's head. For example, the band may be an elastic band configured to secure theheadset 30 to the user's head. In some embodiments, theframe 32 may be mounted within a helmet (not shown) configured to be positioned on a user's head. - Referring to
FIGS. 2A and 2B , in some embodiments, theframe 32 may include afront support element 36. Two ormore image generators 14 may be spatially disposed and positioned on thefront support element 36. Eachimage generator 14 may be configured to provide a separate image to each eye. For example, afirst image generator 14 a may be configured to provide a first image to a left eye of a user and asecond image generator 14 b may be configured to provide a second image to a right eye of the user. InFIG. 2A , theimage generators frame 32. InFIG. 2B , theimage generators frame 32. - Referring to
FIGS. 1 and 2A-2B , the diffraction enhancedimaging system 16 includes a plurality of lens 38 (designated by way of example as 38 a and 38 b inFIGS. 2A and 2B ) positioned in theframe 32 with thelens 38 a such that an image may be substantially aligned with one of the user's eyes and thelens 38 b such that an image may be substantially aligned with the other one of the user's eyes. Generally, thelens 38 includes both diffractive and refractive portions configured to alter wavelength dispersion effects on the image distance produced by thelens 38. Referring toFIG. 3 , thelens 38 may include multiple layers including, but not limited to, afirst substrate layer 40, a first diffractive gratinglayer 42, aspacer layer 44, a second diffractive gratinglayer 46, and asecond substrate layer 48. - The
first substrate layer 40 may be formed of glass and/or other optically clear (e.g., transparent) material having known wavelength dispersion properties. Thefirst substrate layer 40 may include afirst surface 50 and asecond surface 52. Thefirst surface 50 and/or thesecond surface 52 may be curved. Alternatively, thefirst surface 50 and/or thesecond surface 52 may be substantially flat. In some embodiments, at least one of thefirst surface 50 and thesecond surface 52 may be curved, such as, for example, thesecond surface 52 as illustrated inFIG. 3 . - Referring to
FIG. 3 , thelens 38 may include the first diffractive gratinglayer 42 positioned adjacent to thesecond surface 52 of thefirst substrate layer 40. The first diffractive gratinglayer 42 may include at least onegrating 54 formed of a holographic or surface-contained periodic modulation of the optical refractive index or surface height, respectively. In some embodiments, a bulk material substantially similar in index and clarity with materiality of theoptical waveguide 12 may be used to write thegratings 54. - Period of the grating 54 of the first diffractive grating
layer 42 may impact wavelength dispersion, both magnitude and sign, of the light generated by the one ormore imaging generators 14.Grating 54 may aid in a higher coupling efficiency as compared to other prior art coupling methods. Higher coupling efficiency may translate into lower power requirements at input and/or brighter images presented to a user. - Referring to
FIG. 3 , thelens 38 may also include aspacer layer 44. Thespacer layer 44 may occupy space between the first diffractive gratinglayer 42 and the seconddiffractive grating layer 46. In some embodiments, thespacer layer 44 may be formed of optically clear (e.g., transparent) material to light in the visible spectrum, for example. In some embodiments, a portion or the entirety of thespacer layer 44 may include air. The refractive index of thespacer layer 44 may impact diffraction properties of the first diffractive gratinglayer 42 and/or the seconddiffractive grating layer 46. - The second
diffractive grating layer 46 may be positioned adjacent to thespacer layer 44. In some embodiments, the seconddiffractive grating layer 46 may be formed of substantially similar material and properties as the first diffractive gratinglayer 42. The seconddiffractive grating layer 46 may include at least onegrating 56 formed of a holographic or surface-contained periodic modulation of the optical refractive index or surface height, respectively. Period of the grating 56 of the seconddiffractive grating layer 46 may impact wavelength dispersion, both magnitude and sign, of the light generated by theimaging generator 14. Generally, grating variation with position may complement variation of the firstdiffractive grating 42. For example, in a surface-etched grating, peaks of the grating 56 of the seconddiffractive grating layer 46 may lie at substantially the same position as valleys of the grating 54 of the first diffractive gratinglayer 42. - The
second substrate layer 48 may be positioned adjacent to the seconddiffractive grating layer 46. Thesecond substrate layer 48 may be formed of glass and/or other optically clear material having known wavelength dispersion. In some embodiments, dispersion magnitude and/or sign of thesecond substrate layer 48 may be different than dispersion magnitude and/or sign of thefirst substrate layer 40. Thesecond substrate layer 48 may include a first surface 358 and asecond surface 60. The first surface 358 and/or thesecond surface 60 may be curved. Alternatively, thefirst surface 58 and/or thesecond surface 60 may be substantially flat. In some embodiments, at least one of the first surface 53 and thesecond surface 60 may be curved, such as, for example, thesecond surface 60 as illustrated inFIG. 3 . - In some embodiments, at least one of the
first substrate layer 40, first diffractive gratinglayer 42,spacer layer 44, second diffractive gratinglayer 46, andsecond substrate layer 48 may consist of one or more materials having a refractive index configured to be controlled by application of an electric field (e.g., via applied voltage). Changing the refractive index of the material may alter either or both refractive properties and diffractive properties of thelens 38 thus altering image distances and/or corresponding convergence or divergence of rays exiting thelens 38.FIG. 4 illustrates an example of agraph 70 of an exemplary output of an exemplary embodiment of thelens 38. Generally, magnitude of the difference in focal length betweenred wavelength 72,green wavelength 74 andblue wavelength 76 may depend on wavelength dispersion of materials used in each layer of thelens 38. In the exemplary embodiments illustrated inFIG. 4 , a first material may have a change in refractive index of 0.013364 between thered wavelength 72 and theblue wavelength 76, and a second material may have a refractive index change of 0.027 between thered wavelength 72 and theblue wavelength 76. - In some embodiments, the
lens 38 may further include a refractive optical element and/orwedge element 80 as illustrated inFIG. 5 . Thewedge element 80 may be configured to provide images at different angles from anoptical axis 82, as well as different distances from an output plane of thelens 38. The wedge element may be placed within the layers of thelens 38 as shown inFIG. 5 , before lens 38 (between theimage generator 14 and thefront layer 50 of first substrate 40), or after lens 38 (beyond thesecond layer 60 of second substrate 48) and prior towaveguide 12. Referring toFIGS. 5 and 6 , thewedge element 80 may create a 0.57 degree tilt in an imaging axis forblue wavelengths 76, but only a 0.548 degree tilt in the imaging axis forred wavelengths 72, for example, as shown ingraph 84 illustrating output of thelens 38 having thewedge element 80. The wedge angle ΘW may be determined to achieve a pre-determined angle in output rays and/or imaging axes. In some embodiments, wedge angle ΘW may be determined and/or dependent on materiality of thewedge element 80, focal length of thelens 38, and/or focal power of thelens 38. In some embodiments, the wedge angle ΘW may be up to 10 degrees, for example. As a result, light atdifferent wavelengths FIG. 1 ) at different angles and/or different positions. - Referring to
FIGS. 1 and 7A , in some embodiments, a secondrefractive element 86 may be positioned adjacent to but spaced a distance away from thelens 38. In some embodiments, the secondrefractive element 86 may be a variable focal length lens configured to modify divergence of rays exiting thelens 38. The secondrefractive element 86 may be, for example, a liquid-based variable focal length lens and/or other refractive element capable of modifying divergence of rays exiting thelens 38. - Referring to
FIGS. 1 and 7B , in some embodiments, arefractive element 88 may be positioned adjacent to and in contact with thelens 38. Therefractive element 88 may be, for example, one or more lens formed of dispersive material to counteract and/or enhance wavelength dispersion of thelens 38 to increase or decrease wavelength dispersion of theoptical display system 10. In some embodiments, therefractive element 88 may be formed of material having a refractive index more strongly dependent on wavelength than standard optical glasses (e.g., BK7), in that the material has a greater change in refractive index as a function of wavelength than standard glasses, for example. - Referring to
FIGS. 1 and 8A , the in-coupling diffraction system 20 redirects light incident on the diffraction enhancedimaging system 16 into a different direction of travel such that light may propagate in a guided way along a length of theoptical waveguide 12. In some embodiments, the in-coupling diffraction system 20 may include asingle diffraction grating 90. Using thesingle diffraction grating 90 may further reduce size of the in-coupling diffraction system 20 and reduce manufacturing and complexity cost. Period of thesingle diffraction grating 90 may be selected such that rays entering thesingle diffraction grating 90 from the diffraction enhancedimaging system 16 exit thesingle diffraction grating 90 at angles conducive to propagation within theoptical waveguide 12 by total internal reflection (TIR). Period of thesingle diffraction grating 90 may also alter ray cone for each wavelength to create a new image point, either virtual or real, that may act as an input image for the wavelength compensated beam expander 22 (shown inFIG. 1 ). -
Gratings 92 in thesingle diffraction grating 90 may affect light entering normal to theoptical waveguide 12, simplifying and/or minimizing size of optics between theimage generator 14 and theoptical waveguide 12. In some embodiments, period of thesingle diffraction grating 90 may be selected to modify (i.e., enhance or reduce) wavelength dispersion introduced by the diffraction enhancedimaging system 16. Thesingle diffraction grating 90 may contain blazing and/or other design configured to couple energy into forward propagating direction (i.e., either positive 1st order or negative 1st order diffraction) minimizing loss of optical power during coupling. Blazing is altering symmetry of each period of the grating 92 to support constructive interference in one direction and/or angle out of the grating 92 and/or create strong destructive interference in other angles at which the grating 92 may attempt to diffract light. Depth and length of the grating 92 may also influence coupling efficiency, and may be selected to maximize power coupled into desired diffraction order without making grating complicated or costly to manufacture. Thegratings 92 may consist of either a holographic (index-based) grating, alternating materials of different refractive index in a periodic manner over distance, dynamic diffractive elements, subwavelength diffractive elements, and/or an amplitude grating (periodic surface structure). - For the structure of the
gratings 92, parameters may include modulation period (ΛΛg), depth of modulation, and shape of function within each modulation period. Referring toFIG. 8A , illustrated therein is light passing through thesingle diffraction grating 90 havinggratings 92. Some portion of the light does not diffract (m=0, or 0th order), and fractions of the optical power diffract primarily into two first order beams (m=±1), each exiting at angle θd that depends on ΛΛg and wavelength λ, according to the equation: -
- wherein θin is the angle of the incoming light with respect to the grating normal, which equals zero for base design of the
optical display system 10. A greater depth of modulation generally increases the coupling efficiency which determines the fraction of incident power directed into first-order beams. Functional shape within each period of thegratings 92 may also influence diffraction efficiency for two first-order beams. A sinusoidal shape couples power equally into first order beams. As illustrated inFIG. 8A , power entering the −1 order may not travel to the user's eye, and thus may represent a loss in theoptical display system 10. Altering shape of variation, including blazing, from sinusoidal to some other shape may diffract power into the +1 order and significantly weaken coupling into the −1 order, increasing power delivered to the user's eye and increasing in-coupling efficiency. Length of grating 92 and positioning of theimage generator 14 along length of the grating 92 may also influence diffraction efficiency. -
FIG. 8B illustrates agraph 94 of a result of an exemplary embodiment of the in-coupling diffraction system 20 having a grating period of 1.648 μm. Rays diffract away from the in-coupling diffraction system 20 in diffraction directions and at different divergences for each of the three wavelengths. - Distance between the diffraction enhanced
imaging system 16 and the in-coupling diffraction system 20 may be configured to aid in propagation of the light. The distance may determine width of the beam of light for each color at the input plane of the in-coupling diffraction system 20, and the difference in location of where the center of the beams intercept the in-coupling diffraction system 20. In some embodiments, both beam width and beam axis location at thesingle diffraction grating 90 may be selected such that the resulting beams of light for each of the wavelengths have substantially similar width and beam axis when exiting the wavelength compensatedbeam expander 22. In the exemplary embodiment illustrated inFIG. 8B , thesingle diffraction grating 90 was positioned at a distance of 5.865 mm from the diffraction enhancedimaging system 16. - Referring to
FIGS. 9A and 9B , in some embodiments, the in-coupling diffraction system 20 may includemultiple diffraction gratings 90 with each grating tuned to one of the three RGB colors such that each independently controls imaging properties of each wavelength. In some embodiments, multiple gratings may include three spatiallydistinct diffraction gratings FIG. 9A . Eachdiffraction grating multiple gratings FIG. 9B . Thegratings coupling diffraction system 20 and subsequentoptical waveguide 12. In some embodiments, each may include a sinusoidal pattern having a different period and/or frequency. - Referring to
FIGS. 1 and 10 , images from the in-coupling diffraction system 20 may be propagated towards the wavelength compensatedbeam expander 22. The wavelength compensatedbeam expander 22 may provide an output image that contains magnification in a horizontal direction and/or corrects for wavelength dispersion such that color components of each pixel spatially overlap. Within theoptical waveguide 12, the wavelength compensatedbeam expander 22 may include one or moreoptical elements 96 configured to simultaneously expand horizontal extension of the image (i.e., horizontal magnification), and/or compensate for wavelength dispersion such that color components of each image pixel may overlap precisely at one or more output coupling andvertical expansion systems 24. Generally, diffracted light from in-coupling diffraction system 20 may strike eachoptical element 96 in series, with the divergence and/or wavelength dispersion properties being altered at eachoptical element 96. In some embodiments, at least two of theoptical elements 96 may be configured as curved mirrors and/or the like. Theoptical elements 96 may alter the beam width based on relative focal lengths of eachoptical element 96 and/or distance traveled between eachoptical element 96. - The wavelength compensated
beam expander 22 receives images formed by the in-coupling diffractive system 20 at each wavelength. Light from the image may either directly illuminate a firstoptical element 96 a or illuminate the firstoptical element 96 a after one or more reflections within theoptical waveguide 12, depending on design of the firstoptical element 96 a and/or needs of the application. The firstoptical element 96 a may produce a subsequent image, one for each wavelength, via diffraction and/or reflection, and may provide corrective action to reduce wavelength dispersion introduced by the diffraction enhancedimaging system 16 and the in-coupling diffractive system 20. The image produced by the firstoptical element 96 a may act as the input to the secondoptical element 96 b. Light from the image produced by the firstoptical element 96 a may either directly illuminate the secondoptical element 96 b or may illuminate the secondoptical element 96 b after one or more reflections within theoptical waveguide 12. The design of the secondoptical element 96 b may produce images at infinity (i.e., collimated light) for each wavelength under initial design conditions, with the position and propagation direction (i.e., angle) of each output beam overlapping and coinciding with that of the beams for the other wavelengths. - For both the first
optical element 96 a and the secondoptical element 96 b, thickness of theoptical waveguide 12 may determine the effective object distances for the elements. Distance of the object combined with design of eachoptical element optical waveguide 12 may allow for objects and images to appear at distances in concert with diffractive nature of the firstoptical element 96 a and the secondoptical element 96 b to provide corrected final output properties for each of the wavelengths. Additional optical elements (e.g., 96 c . . . 96 n) may be used within thebeam expander 22 and the output coupling andvertical expansion system 24. - Imaging properties of each
optical element 96 may depend on effective shape of theoptical element 96. For example, spherical shapes may produce greater distortion as compared to aspheric shapes. In some embodiments, an intermediate image may be produced between twooptical elements 96. Depending on design, eachoptical element 96 may reduce or increase a difference in ray angles between wavelengths that occur due to in-coupling grating (e.g., wavelength dispersion). To minimize and/or eliminate wavelength dispersion and/or maximize image clarity, an additional optical element 96 (e.g., 96 c . . . 96 n) may be used within thebeam expander 22. Such additionaloptical element 96 may be configured to compensate and/or correct for differences in ray angles among wavelengths. As such,beam expander 22 may produce a large lateral magnification in a short distance, provide a collimated output beam, and/or minimize wavelength dispersion artifacts in the image. - Each
optical element 96 may include at least one of areflective mirror 98, a single-axis Fresnel reflector 100, and a reflection grating 102. - Referring to
FIG. 11A , thereflective mirror 98 may include afirst surface 104. In some embodiments, thefirst surface 104 may be a curved surface. For example, thefirst surface 104 may be spherical, aspheric, and/or the like. In some embodiments, curvature of thefirst surface 104 may be dependent on function of theoptical element 96. Thereflective mirror 98 may include afirst end 106 and asecond end 108. In some embodiments, thefirst end 106 and/or thesecond end 108 may be truncated such that a vertex is offset from center C of thereflective mirror 98. With the vertex offset from center C, output angles may be adjusted for the reflected beam. Width w and length l of thereflective mirror 98 may be sufficient to intercept all or substantially all incoming light rays to minimize optical loss at theoptical element 96. - Referring to
FIG. 11B , the single-axis Fresnel reflector 100 may embody the concept of Fresnel zones to provide imaging along only one axis and/or direction.Fresnel reflectors 100 create effects of a curved surface by slicing the surface into rings (two-dimensional) or strips (one-dimensional) and placing such rings or strips in a flat plane. The one-dimensional configuration may alter beam width along only one axis. Constructive and destructive interference between light rays reflected from each strip may effectively focus or defocus optical power in the incident beam. - Size of each
Fresnel zone 110 in theFresnel reflector 100 may be determined by effective focal length for theoptical element 96 and/or wavelength for which desired effective focal length may be achieved. Center of eachFresnel zone 110 of theFresnel reflector 100 may be determined using the following equation: -
- wherein rn is the distance from the center of the
Fresnel reflector 100 to the center of the nth Fresnel zone, n is a positive integer, f is the desired focal length of theFresnel reflector 100, and λ is the design wavelength. The design wavelength may be selected to achieve specific values of wavelength dispersion (e.g., variation in value of f as a function of wavelength) to counteract, in part or in whole, dispersion generated by the diffraction enhancedimaging system 16 and the in-coupling diffractive system 20. Width and length of theoptical element 96 may be sufficient to intercept all incoming light rays in order to minimize optical loss at theoptical element 96. TheFresnel reflector 100 may be constructed with the n=0 zone positioned less than halfway between afirst edge 112 and asecond edge 114 of theFresnel reflector 100. Such positioning may obtain one or more desired output angles for reflected beams by having light from each wavelength strike theFresnel reflector 100 at different positions, and as such, different effective curvature thus changing the direction of the 0th order reflection. - Referring to
FIG. 11C , in some embodiments, theoptical element 96 may include the reflection grating 102. The angle of reflection from the reflection grating 102 may be dependent ongratings 116 causing a reflected angle in a nonlinear manner, and as such, may alter divergence/convergence point of a cone of rays effectively changing location of the image with respect to the next optical element (e.g., 96 b). The change in location of the image may depend on the wavelength, and as such, thereflective grating 116 may alter and/or compensate for wavelength dispersion. Other factors influencing reflection angle may include, but are not limited to, period of the grating, use of blazing to diffract light into a specific diffraction order, and/or the like. - In some embodiments, the
optical element 96 may be positioned on the exterior of theoptical waveguide 12 as illustrated inFIG. 10 . Light may pass through theoptical waveguide 12 to theoptical element 96. In some embodiments, space between theoptical waveguide 12 and theoptical element 96 may be filled with an optically clear material. The refractive index of the material maybe selected to reduce and/or eliminate total internal reflection at the wall of theoptical waveguide 12 and/or minimize bending of rays passing through theoptical waveguide 12 to theoptical element 96. In some embodiments, the refractive index of the optically clear material may be substantially similar (a percent difference of less than 5%, for example) to the refractive index of theoptical waveguide 12. In some embodiments, the material of the optically clear material may be an optical epoxy. In some embodiments, the material of the optically clear material may include adhesive properties such that theoptical element 96 may be attached to theoptical waveguide 12. In some embodiments, theoptical element 96 may be attached using a separate adhesive material and/or structure. - In some embodiments, the space between
optical waveguide 12 and theoptical element 96 may be filled with a material possessing a refractive index controllable by an applied electric field. Applying an electric field, including but not limited to an applied voltage or current, may raise or lower the refractive index, depending on the properties of the material and polarity of the applied electric field. Raising or lowering the refractive index makes the refractive index of the material different from that of theoptical waveguide 12, causing refractive bending of the light rays at the boundary between the material and theoptical waveguide 12. Refractive bending may change the effective location and/or distance of the object for theoptical element 96, thereby changing the imaging properties (divergence, image location and type) of theoptical element 96 and thus changing the wavelength dispersion compensation achieved by theoptical element 96. The change in wavelength dispersion compensation may allow the wavelength compensatedbeam expander 22 to correct for changes in the wavelength dispersion of the diffraction enhancedimaging system 16 resulting from changes in the secondrefractive element 86. - In some embodiments, a piezo electric material may be positioned as a spacer between the wall of
waveguide 12 and theoptical element 96. A voltage applied to the piezo electric material may cause the piezo electric material to expand or contract in size, subsequently causing theoptical element 96 to move closer to or further away from wall ofwaveguide 12. In some embodiments, two or more piezo electric spacers may be used to change the tilt of theoptical element 96. For example, the piezo electric spacer on one side may be directed to expand while the piezo electric spacer on the opposite side may be directed to contract, causing theoptical element 96 to obtain a tilt with respect to the wall ofwaveguide 12, with the tilt oriented toward the side on which the piezo electric spacer expanded and oriented away from the side on which the piezo electric spacer contracted. The change in distance betweenoptical element 96 and the wall ofwaveguide 12 may change the effective object distance between the prior image and theoptical element 96, thereby changing the imaging properties (divergence, image location and type) of theoptical element 96 and thus changing the wavelength dispersion compensation achieved by theoptical element 96. The change in wavelength dispersion compensation may allow the wavelength compensatedbeam expander 22 to correct for changes in the wavelength dispersion of the diffraction enhancedimaging system 16 resulting from changes in the secondrefractive element 86. - In some embodiments, the
optical element 96 may be formed within the wall of theoptical waveguide 12. For example, in some embodiments, the wall of theoptical waveguide 12 may be sculpted to a desired shape. The exterior surface of theoptical waveguide 12 may then be coated with a reflective coating forming theoptical element 96. The reflective coating may consist of a metal substance, for example, reflecting at each of the RGB wavelengths. Other coatings and/or implementation of the reflective coating, such as dielectric coatings, are contemplated that provide for equal reflection power at each of the RGB wavelengths. -
FIG. 12 illustrates agraph 120 of output for an exemplary wavelength compensatedbeam expander 22 having at least oneoptical element 96 including the singleaxis Fresnel reflector 100. The singleaxis Fresnel reflector 100 may collect light and bring reflections to a focal point with theoptical waveguide 12. In this example, the firstoptical element 96 a has a focal length of 0.14 mm at a design wavelength of 665 nm, and the center of the firstoptical element 96 a is positioned 2.2 μm from the central axis of thered wavelength 72. Other combination of thickness for theoptical waveguide 12, focal length, design wavelength, and reflector center may potentially produce equal width beams at the secondoptical element 96 b. Each wavelength may focus at a different distance and/or angle within theoptical waveguide 12, and the width of beam at the input plane of the secondoptical element 96 b (e.g., second single-axis Fresnel reflector 100) may be substantially equal for all wavelengths. The secondoptical element 96 b may utilize a design providing collimated light at substantially all wavelengths and direction of wavelengths down the length at substantially the same angle. In some embodiments, small focal length (e.g., less than or equal to 0.1 mm), may be utilized and/or reflection from at least a section of the secondoptical element 96 b off-center may be used. Off-centered reflection may provide less divergence in output beams, with less than 0.005 degrees of divergence shown inFIG. 12 . The output angle provided may also produce total-internal reflection of all wavelengths about the walls of theoptical waveguide 12. - Referring to
FIGS. 1 and 13 , the output coupling andvertical expansion system 24 may magnify the image in a vertical direction creating a large output area (i.e., exit pupil). The output coupling andvertical expansion system 24 may include a vertically orientedwaveguide 122 employing a verticalbeam expanding element 121 and two or more reflectingelements 124 configured to magnify the exit pupil in a vertical direction and/or to direct a fraction of light out of the vertically orientedwaveguide 122 and towards the user at specific angles to create a wide FOV. A large exit pupil, combined with the range of light angles entering the eye may produce the large total FOV. The FOV describes the range of angles over which the user may perceive the image generated by theoptical display system 10, and may determine the size of viewing area for the user. A larger FOV may allow the user to observe scenes and objects over a larger range, reducing the need to turn the user's head to view images away from a center of vision and/or preventing objects from clipping or disappearing off edges of the images when looking at another object. After the image expands and propagates along theoptical waveguide 12, aturning optic 126 may direct the image in a vertical direction as shown inFIG. 13 . Theturning optic 126 may consist of, but is not limited to, a mirrored surface, consisting of one or more discrete component surfaces deflecting light, or a distributed reflecting element, including but not limited to a long-period variation in the refractive index for which reflection rather than diffraction may be the predominant optical effect Fabry Perot Filters, and/or the like. Light propagation off of theturning optic 126 may then contain a component perpendicular to propagation along theoptical waveguide 12. - After the
turning optic 126 directs light to propagate along thevertical waveguide 122, the light enters a verticalbeam expanding element 121 that expands the image along the vertical direction. The verticalbeam expanding element 121 contains components that may be used to deflect light through a range of angles in the vertical direction. Such components may provide for rays to propagate at a faster rate as compared to other rays propagating solely in the vertical direction, and as such, the image may be expanded in the vertical direction. Components of the verticalbeam expanding element 121 may include, but are not limited to, a wavelength compensated beam expander of similar composition to that of the wavelength compensatedbeam expander 22 inwaveguide 12, one or more mirrors of which at least two must be curved, and/or TIR reflections between the walls ofvertical waveguide 122. Thevertical waveguide 122 may be similar in construction to the compensatedbeam expander 22. In some embodiments, a 45 degree deflection may be created in a vertical direction by turningoptic 126 providing light to propagate between walls of thevertical waveguide 122 employing TIR. - In some embodiments, one or more of the components may possess the capability to change the image forming properties of the component through the application of an electric field. The components may possess structure similar to
optical element 96 in theoptical waveguide 12, including a material possessing a refractive index that varies with the application of an applied electric field and piezoelectric devices placed between the component and the wall ofvertical waveguide 122. The change in image forming properties allows the verticalbeam expanding element 121 to alter the divergence of the light traveling alongvertical waveguide 122 which may change the perceived distance of an object from the viewer, either as an independent control or in combination with the secondrefractive element 86. - In some embodiments, the
vertical waveguide 122 may be formed of an optically clear material having sufficiently high index of refraction to provide for total internal reflection over a wide range of incident angles. Potential materials include, but are not limited to, optical plastic, optical glass, and/or the like. For example, one or more optical plastics may be used to reduce cost and/or weight of theoptical display system 10. Thickness of thevertical waveguide 122, angle of deflection created by theturning optic 126, and/or spacing of the reflectingelements 124 may determine magnification achieved between the turningoptic 126 and the reflectingelements 124. - The reflecting
elements 124 may be designed to direct a fraction of the optical power propagating within thevertical waveguide 122 towards a user's eye at a specific angle and/or specific divergence, independent of the wavelength incident on the reflectingelements 124. The reflectingelement 124 may maintain color balance (ratio) in the original image due to its wavelength independent reflection properties. The reflectingelement 124 may include, but is not limited to, a Fabry-Perot filter, a partially reflecting thin film element, and/or the like. - The Fabry-Perot filter may have low reflectivity at end surfaces and a sufficiently small distance between such end surfaces, such that the range of wavelengths between resonances of the filter exceeds the range between the blue and red wavelengths contained in the image projected by the
image generator 14. Low reflectivity surfaces may increase transmission coefficient in a region between resonance wavelengths of the filter, thereby reducing the reflectance. Changing surface reflectivity subsequently may change the reflectance. To ensure that each reflector in the array delivers substantially similar (i.e., within a few percent and up to 20% difference, for example) optical power to the user, the reflectance may be configured to begin at a lower value for the first reflector and increase steadily for each subsequent reflector in the series chain, since the incident power on each subsequent reflector has been reduced by the reflecting operation of the previous reflector. The reflectance of the first reflector and each subsequent reflector depends on the number of reflectors. For example, in the case of four reflectors, the first reflector would reflect 0.25 of the incident light, the next reflector would reflect ⅓rd of the remaining light transmitted through the first reflector, the third reflector would reflect 0.5 and the final reflector would reflect all incident light, resulting in each reflector directing ¼th of the original power to the user's eye. As the distance between the end surfaces decreases, the distance between resonant wavelengths increases, and the reflectance as a function of wavelength may closely approximate ((i.e., within a few percent and up to 20% difference, for example) a constant in the region between the resonant wavelengths, resulting in less wavelength dependence in the fraction of power reflected toward the user. The Fabry-Perot filter may consist of, but is not limited to, a material of different index than the surrounding waveguide inserted into the waveguide, an air gap created by slicing the waveguide and shifting one side of the slice a specified distance from the other slice, or slicing the waveguide at two nearly adjacent points, applying a reflecting thin film to the slice surfaces, and reassembling the sliced parts into a single waveguide. - The reflecting
element 124 may also include a partially reflecting thin film element. The partially reflecting thin film element may be configured to obtain a given reflection coefficient at each wavelength. In some embodiments, thevertical waveguide 122 may be sliced with ends of the slices polished. A thin film may then be applied to each polished end with thevertical waveguide 122 splice together into a whole component. - The angle at which the reflecting
element 124 deflects light toward the user may be determined by the angle of the reflectingelement 124 with respect to the walls of thevertical waveguide 122 and with respect to the angle of propagation of the light within thevertical waveguide 122. In some embodiments, the angle of each reflectingelement 124 may be configured to be different, such that each reflectingelement 124 directs light into the user's eye from a different direction. For example, a first reflectingelement 124 may directs light downward at a relatively steep angle, the second reflectingelement 124 may direct light downward at a shallow angle, the third reflectingelement 124 may direct light upward at a shallow angle, and the fourth reflectingelement 124 may direct light upward at a relatively steep angle. As a further example, the reflectingelements 124 on the left side ofvertical waveguide 122 may also possess some horizontal tilt, directing light back toward the right, and the reflectingelements 124 on the right side ofvertical waveguide 122 may possess a different horizontal tilt directing light back toward the left. Varying the direction in such a way effectively increases the FOV by directing light from a large area of the vertical waveguide 122 (FOV is highly dependent on the emitting area) and increasing the range of angles at which light from the image reaches the eye (increases the FOV further, beyond that resulting from the size of the emitting area). Other orientations and positioning of the reflectingelements 124 along the vertical direction are possible, depending on the targeted application. -
FIG. 14 illustrates agraph 130 of output of an exemplary embodiment of the output coupling andvertical expansion system 24. In particular,FIG. 14 illustrates image formation and reflection operation of reflectingelements 124 for theblue wavelength 76. Generally, images form at relatively large distances from theoptical waveguide 12. Such distances increase as divergence of the beam exiting the output coupling andvertical expansion system 24 approaches zero (i.e., collimated condition). It should be noted that positioning of the reflectingelements 124 may be dependent on size restrictions imposed by the application, including distance common to a human head and human eye. -
FIG. 15 illustrates agraph 132 of a guided beam striking the reflectingelements 124 along the length of thevertical waveguide 122. The percentage of power reflected may depend on the incident angle determined by the angle at which light travels along thevertical waveguide 122 and the angle of thereflective element 124. The divergence of rays exiting from the output coupling andvertical expansion system 24 may be different from the divergence within thevertical waveguide 122 if surfaces of the reflectingelements 124 are not flat, but instead configured with a degree of curvature. Curvature may alter the reflectingelement 124 and as such provide a low power (i.e., long focal length) mirror, for example. As the reflection coefficient of a Fabry-Perot filter, for example, depends on angle of incidence, according to cos(Θ), curvature of the reflecting surface may limit the range of incident angle to the range wherein cos(Θ)≈1. In some embodiments, collimated light propagating within thevertical waveguide 122 may strike one or more reflectingelements 124 configured to create a divergent beam that creates a virtual image for the user at a designed distance, such as the near point of the user's eye. Changes in the divergence of the light propagating within thevertical waveguide 122, configuration of adjustments to focal length of the diffraction enhancedimaging system 16 may create greater or less divergence of light from the reflectingelements 124 thus changing location of the virtual image and providing a more natural and/or comfortable viewing experience for a user.
Claims (23)
1. An optical display system for providing three-dimensional convergence corrected images to a user, comprising:
at least one image generator producing a plurality of rays forming a limited color, two-dimensional image;
a diffraction enhanced imaging system configured to collect rays produced by the image generator and configured to control convergence angle of each ray at specific wavelengths into an optical waveguide such that rays at different wavelengths have different convergence angles;
an in-coupling diffraction system configured to couple the rays controlled by the diffraction enhanced imaging system into the optical waveguide via at least one of specific convergence angles and a specific divergence angle;
a wavelength compensated beam expander configured to simultaneously expand horizontal extension of the images and compensate for wavelength dispersion; and,
an output coupling and vertical expansion system configured to magnify the image in a vertical direction and direct a fraction of light toward the user at one or more specific angles creating a wide field of view.
2. The optical display system of claim 1 , wherein the in-coupling diffraction system uses diffraction to couple the rays into the optical waveguide at specific convergence angles such that at least one of the wavelength compensated beam expander and the output coupling and vertical expansion system produce an expanded beam of the rays having specific divergence angles.
3. The optical display system of claim 1 , wherein the wavelength compensated beam expander simultaneously expands horizontal extension of the images and compensate for wavelength dispersion such that a color component of each image pixel of each image overlap precisely at the output coupling and vertical expansion system.
4. The optical display system of claim 1 , wherein the diffraction enhanced imaging system includes at least one lens, the lens comprising at least one diffractive portion and at least one refractive portion configured to alter wavelength dispersion effect on image distance produced by the lens.
5. The optical display system of claim 4 , wherein the lens comprises:
a first substrate layer formed of an optically clear material having known wavelength dispersion properties;
a first diffractive grating layer positioned adjacent to the first substrate layer, the first diffractive grating layer is formed of a holographic material and includes a plurality of gratings, the gratings configured with a grating period impacting wavelength dispersion;
a second diffractive grating layer positioned adjacent to the first diffractive grating layer and formed of substantially similar material and properties as the first diffractive grating layer, the second diffractive grating layer having a plurality of gratings; and,
a second substrate layer positioned adjacent to the second diffractive grating layer and formed of an optically clear material.
6. The optical display system of claim 5 , the lens further comprises a spacer layer formed of an optically clear material and positioned between the first diffractive grating layer and the second diffractive grating layer.
7. The optical display system of claim 5 , wherein the first substrate layer includes a first surface and a second surface and at least one of the first surface and the second surface is a curved surface.
8. The optical display system of claim 5 , wherein the second substrate layer includes a first surface and a second surface and at least one of the first surface and the second surface is a curved surface.
9. The optical display system of claim 5 , wherein peaks of the gratings of the second diffractive grating layer lie at a substantially similar position as valleys of the gratings of the first diffractive grating layer.
10. The optical display system of claim 5 , wherein at least one of the first substrate layer, first diffractive grating layer, second diffraction grating layer and second substrate layer consist of at least one material having a refractive index configured to be controlled by application of an electric field.
11. The optical display system of claim 5 , further comprising a wedge element configured to provide at least one image at a different angle from an optical axis of the lens and a different distance from an output plane of the lens.
12. The optical display system of claim 5 , further comprising a refractive element positioned adjacent to the lens, the refractive element being formed of dispersive material and configured to enhance wavelength dispersion of the lens.
13. The optical display system of claim 1 , wherein the in-coupling diffraction system includes a single diffraction grating having a period configured to direct rays entering the in-coupling diffraction system to exit the in-coupling diffraction system at an angle conducive to propagation within the optical waveguide by total internal reflection.
14. The optical display system of claim 13 , wherein period of the single diffraction grating, alters ray cone for each wavelength to create a new image point configured as an input image for the wavelength compensated beam expander.
15. The optical display system of claim 13 , wherein period of the single diffraction grating is configured to modify wavelength dispersion introduced by the diffraction enhanced imaging system.
16. The optical display system of claim 1 , wherein distance between the diffraction imaging system and the in-coupling diffraction system is determined such that beam width for each color at an input plane of the in-coupling diffraction system and axis of beams intercepting the in-coupling diffraction system results in a beam of light that includes wavelengths having substantially similar beam width and beam axis when exiting the wavelength compensated beam expander.
17. The optical display system of claim 1 , wherein the wavelength compensated beam expander includes at least two optical elements positioned in series and each configured to alter wavelength dispersion properties of rays.
18. The optical display system of claim 17 , wherein a first image produced by a first optical element is an input image for a second optical element.
19. The optical display system of claim 18 , wherein the second optical element may be configured to produce collimated light for each wavelength with position and propagation direction of each output beam overlapping with beams for other wavelengths.
20. The optical display system of claim 118, wherein each optical element includes at least one of a reflective mirror, a single-axis Fresnel reflector, and a reflection grating.
21. The optical display system of claim 1 , wherein the output coupling and vertical expansion system includes a vertically oriented waveguide having at least two reflecting elements configured to magnify images in a vertical direction and direct at least a fraction of light out of the vertically oriented waveguide and towards the user at specific angles; to create the wide field of view.
22. A method, comprising:
collecting a plurality of rays forming images produced by an image generator and altering convergence angle of the rays at each wavelength such that rays at different wavelengths have different convergence angles;
coupling the rays into an optical waveguide system using diffraction at specific convergence and divergence angles;
expanding horizontal extent of each image;
compensating for wavelength dispersion such that color components of each image pixel overlap;
magnifying each image in a vertical direction; and,
directing a fraction of light out of the optical waveguide system and toward a user at specific angles to create a wide field of view.
23. An optical display system, comprising:
an image generator producing a plurality of rays forming a color limited two-dimensional image; and,
a diffraction enhanced imaging system configured to collect rays produced by the image generator and configured to control convergence angle of each ray at specific wavelengths into an optical waveguide such that rays having different wavelengths have different convergence angles, the diffraction enhanced imaging system comprising a lens having at least one diffractive portion and at least one refractive portion configured to alter wavelength dispersion effect on image distance produced by the lens.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/208,839 US20210349316A1 (en) | 2017-02-14 | 2021-03-22 | Diffraction based monochromatic head up display for airborne applications |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762458808P | 2017-02-14 | 2017-02-14 | |
US201762547352P | 2017-08-18 | 2017-08-18 | |
US15/896,889 US10955668B2 (en) | 2017-02-14 | 2018-02-14 | Optical display system for augmented reality and virtual reality |
US17/208,839 US20210349316A1 (en) | 2017-02-14 | 2021-03-22 | Diffraction based monochromatic head up display for airborne applications |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/896,889 Continuation US10955668B2 (en) | 2017-02-14 | 2018-02-14 | Optical display system for augmented reality and virtual reality |
Publications (1)
Publication Number | Publication Date |
---|---|
US20210349316A1 true US20210349316A1 (en) | 2021-11-11 |
Family
ID=63105088
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/896,889 Active US10955668B2 (en) | 2017-02-14 | 2018-02-14 | Optical display system for augmented reality and virtual reality |
US17/208,839 Abandoned US20210349316A1 (en) | 2017-02-14 | 2021-03-22 | Diffraction based monochromatic head up display for airborne applications |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/896,889 Active US10955668B2 (en) | 2017-02-14 | 2018-02-14 | Optical display system for augmented reality and virtual reality |
Country Status (2)
Country | Link |
---|---|
US (2) | US10955668B2 (en) |
WO (1) | WO2018152235A1 (en) |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11307420B2 (en) | 2017-07-03 | 2022-04-19 | Holovisions LLC | Augmented reality eyewear with “ghost buster” technology |
US11163163B2 (en) | 2017-07-03 | 2021-11-02 | Holovisions | Augmented reality (AR) eyewear with at least one quasi Fresnel reflector (QFR) |
US11754843B2 (en) | 2017-07-03 | 2023-09-12 | Holovisions LLC | Augmented reality eyewear with “ghost buster” technology |
US11022799B2 (en) * | 2018-08-23 | 2021-06-01 | Facebook Technologies, Llc | Projector-combiner display with beam replication |
EP3857274B1 (en) * | 2018-09-28 | 2023-11-08 | Magic Leap, Inc. | Projector integrated with a scanning mirror |
CN109164582B (en) * | 2018-11-01 | 2022-05-27 | 京东方科技集团股份有限公司 | Head-up display |
WO2020152668A1 (en) * | 2019-01-25 | 2020-07-30 | Ben Yacov Michael Shlomo | Augmented reality optical and corrective lens system |
US20200356050A1 (en) * | 2019-05-08 | 2020-11-12 | Facebook Technologies, Llc | Spatial deposition of resins with different functionality |
CN112213855B (en) * | 2019-07-11 | 2022-07-12 | 苏州苏大维格科技集团股份有限公司 | Display device and optical waveguide lens |
CN114746792A (en) * | 2019-11-26 | 2022-07-12 | 瑞典爱立信有限公司 | Supplying a user with a multi-layered augmented reality image |
CN111708175A (en) * | 2020-06-29 | 2020-09-25 | 国科光芯(海宁)科技股份有限公司 | Structured light projection device |
CN113075793B (en) * | 2021-04-06 | 2023-06-02 | 业成科技(成都)有限公司 | Display device and method of operating the same |
CN113777707B (en) * | 2021-09-16 | 2024-02-13 | Oppo广东移动通信有限公司 | Optical structure and optical device |
CN115469393B (en) * | 2022-01-27 | 2023-09-05 | 珠海莫界科技有限公司 | Diffraction optical waveguide and AR glasses |
CN114755827B (en) * | 2022-04-08 | 2023-10-17 | 荣耀终端有限公司 | Head-mounted display device |
Family Cites Families (50)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5162928A (en) * | 1988-11-02 | 1992-11-10 | Canon Kabushiki Kaisha | Head-up display apparatus |
US20040130783A1 (en) * | 2002-12-02 | 2004-07-08 | Solomon Dennis J | Visual display with full accommodation |
GB2256476B (en) * | 1991-05-30 | 1995-09-27 | Rank Taylor Hobson Ltd | Positional measurement |
JP3472092B2 (en) * | 1997-07-28 | 2003-12-02 | キヤノン株式会社 | Diffractive optical element and optical system using the same |
JP3883816B2 (en) * | 2001-03-02 | 2007-02-21 | 富士通株式会社 | Device that can vary chromatic dispersion and chromatic dispersion slope |
KR20030088218A (en) * | 2002-05-13 | 2003-11-19 | 삼성전자주식회사 | Wearable color-display system |
KR20030088217A (en) * | 2002-05-13 | 2003-11-19 | 삼성전자주식회사 | Wearable display system enabling adjustment of magnfication |
US6805490B2 (en) * | 2002-09-30 | 2004-10-19 | Nokia Corporation | Method and system for beam expansion in a display device |
US20050271325A1 (en) * | 2004-01-22 | 2005-12-08 | Anderson Michael H | Liquid crystal waveguide having refractive shapes for dynamically controlling light |
CN101174028B (en) * | 2004-03-29 | 2015-05-20 | 索尼株式会社 | Optical device and virtual image display device |
EP1862826A4 (en) * | 2005-02-22 | 2010-02-17 | Nikon Corp | Diffractive optical element |
US7434940B2 (en) * | 2005-09-06 | 2008-10-14 | Hewlett-Packard Development Company, L.P. | Light coupling system and method |
US8643948B2 (en) * | 2007-04-22 | 2014-02-04 | Lumus Ltd. | Collimating optical device and system |
CN101688977B (en) * | 2007-06-04 | 2011-12-07 | 诺基亚公司 | A diffractive beam expander and a virtual display based on a diffractive beam expander |
WO2009061861A2 (en) * | 2007-11-05 | 2009-05-14 | Lightsmyth Technologies Inc. | Highly efficient optical gratings with reduced thickness requirements and impedance-matching layers |
US20100149073A1 (en) * | 2008-11-02 | 2010-06-17 | David Chaum | Near to Eye Display System and Appliance |
US8965152B2 (en) * | 2008-12-12 | 2015-02-24 | Bae Systems Plc | Waveguides |
FR2948775B1 (en) * | 2009-07-31 | 2011-12-02 | Horiba Jobin Yvon Sas | PLANAR OPTICAL POLYCHROMATIC IMAGING SYSTEM WITH BROAD FIELD OF VISION |
US11320571B2 (en) * | 2012-11-16 | 2022-05-03 | Rockwell Collins, Inc. | Transparent waveguide display providing upper and lower fields of view with uniform light extraction |
US8233204B1 (en) * | 2009-09-30 | 2012-07-31 | Rockwell Collins, Inc. | Optical displays |
DE102010008342A1 (en) * | 2010-02-17 | 2011-08-18 | Jos. Schneider Optische Werke GmbH, 55543 | imaging system |
US20130278631A1 (en) * | 2010-02-28 | 2013-10-24 | Osterhout Group, Inc. | 3d positioning of augmented reality information |
US9753297B2 (en) * | 2010-03-04 | 2017-09-05 | Nokia Corporation | Optical apparatus and method for expanding an exit pupil |
JP5777353B2 (en) * | 2010-06-11 | 2015-09-09 | キヤノン株式会社 | Diffractive optical element, optical system, and optical instrument |
US8649099B2 (en) * | 2010-09-13 | 2014-02-11 | Vuzix Corporation | Prismatic multiple waveguide for near-eye display |
WO2012062681A1 (en) * | 2010-11-08 | 2012-05-18 | Seereal Technologies S.A. | Display device, in particular a head-mounted display, based on temporal and spatial multiplexing of hologram tiles |
EP2748670B1 (en) * | 2011-08-24 | 2015-11-18 | Rockwell Collins, Inc. | Wearable data display |
CN104040410B (en) * | 2011-08-29 | 2017-06-09 | 伊奎蒂公司 | For the controllable waveguide of near-to-eye application |
US20130229712A1 (en) * | 2012-03-02 | 2013-09-05 | Google Inc. | Sandwiched diffractive optical combiner |
CN106125308B (en) * | 2012-04-25 | 2019-10-25 | 罗克韦尔柯林斯公司 | Device and method for displaying images |
US10502876B2 (en) * | 2012-05-22 | 2019-12-10 | Microsoft Technology Licensing, Llc | Waveguide optics focus elements |
US9019615B2 (en) * | 2012-06-12 | 2015-04-28 | Microsoft Technology Licensing, Llc | Wide field-of-view virtual image projector |
US9933684B2 (en) * | 2012-11-16 | 2018-04-03 | Rockwell Collins, Inc. | Transparent waveguide display providing upper and lower fields of view having a specific light output aperture configuration |
WO2014091204A1 (en) * | 2012-12-10 | 2014-06-19 | Bae Systems Plc | Display comprising an optical waveguide and switchable diffraction gratings and method of producing the same |
US9689744B2 (en) * | 2013-07-17 | 2017-06-27 | Massachusetts Institute Of Technology | Visible-infrared plane grating imaging spectrometer |
US9377623B2 (en) * | 2014-08-11 | 2016-06-28 | Microsoft Technology Licensing, Llc | Waveguide eye tracking employing volume Bragg grating |
US9494799B2 (en) * | 2014-09-24 | 2016-11-15 | Microsoft Technology Licensing, Llc | Waveguide eye tracking employing switchable diffraction gratings |
KR102417136B1 (en) * | 2014-09-29 | 2022-07-05 | 매직 립, 인코포레이티드 | Architectures and methods for outputting different wavelength light out of waveguides |
US10191196B2 (en) * | 2014-11-20 | 2019-01-29 | Samsung Electronics Co., Ltd. | Backlight unit for holographic display apparatus and holographic display apparatus including the same |
TWI547717B (en) * | 2015-05-13 | 2016-09-01 | 華邦電子股份有限公司 | Head-mounted display |
WO2017015056A1 (en) * | 2015-07-17 | 2017-01-26 | Abl Ip Holding Llc | Arrangements for software configurable lighting device |
EP3325400A1 (en) * | 2015-07-17 | 2018-05-30 | ABL IP Holding LLC | Software configurable lighting device |
US9915825B2 (en) * | 2015-11-10 | 2018-03-13 | Microsoft Technology Licensing, Llc | Waveguides with embedded components to improve intensity distributions |
DE102015122055B4 (en) * | 2015-12-17 | 2018-08-30 | Carl Zeiss Ag | Optical system and method for transmitting a source image |
EP3420388A4 (en) * | 2016-04-04 | 2019-11-27 | Akonia Holographics, LLC | Pupil equalization |
US10025093B2 (en) * | 2016-04-13 | 2018-07-17 | Microsoft Technology Licensing, Llc | Waveguide-based displays with exit pupil expander |
US10061124B2 (en) * | 2016-04-29 | 2018-08-28 | Microsoft Technology Licensing, Llc | Robust architecture for large field of view components |
US20170322414A1 (en) * | 2016-05-09 | 2017-11-09 | Fusao Ishii | Optical waveguide using fresnel lenses |
US10663756B2 (en) * | 2016-07-18 | 2020-05-26 | Lumens Co., Ltd. | Display apparatus |
US9959818B2 (en) * | 2016-09-22 | 2018-05-01 | Microsoft Technology Licensing, Llc | Display engines for use with optical waveguides |
-
2018
- 2018-02-14 US US15/896,889 patent/US10955668B2/en active Active
- 2018-02-14 WO PCT/US2018/018224 patent/WO2018152235A1/en active Application Filing
-
2021
- 2021-03-22 US US17/208,839 patent/US20210349316A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
US10955668B2 (en) | 2021-03-23 |
US20180231784A1 (en) | 2018-08-16 |
WO2018152235A1 (en) | 2018-08-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20210349316A1 (en) | Diffraction based monochromatic head up display for airborne applications | |
JP7158396B2 (en) | Display system with variable power reflector | |
US20220091422A1 (en) | Ar headsets with improved pinhole mirror arrays | |
JP7304874B2 (en) | Ultra-High Index Eyepiece Substrate-Based Viewing Optics Assembly Architecture | |
JP6598269B2 (en) | Waveguide display | |
JP4605152B2 (en) | Image display optical system and image display apparatus | |
JP2020512578A (en) | Stacked waveguides with different diffraction gratings for combined field of view | |
JP2023075080A (en) | Display device for enlarging the field of view | |
KR20180114162A (en) | Polarizing beam splitter with low light leakage | |
CN113167946B (en) | Projector integrated with scanning mirror | |
CN116235087A (en) | Bragg grating for augmented reality display system | |
US10962782B2 (en) | Exit pupil expansion via curved waveguide | |
US10534177B1 (en) | Scanning assembly with gratings in waveguide displays with a large eyebox | |
US20210278686A1 (en) | Method and system for fiber scanning projector with angled eyepiece | |
CN117642654A (en) | Waveguide with anti-reflection properties | |
KR20220148315A (en) | optical system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: OPTECKS, LLC, OKLAHOMA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:REFAI, HAKKI H.;KOUDSI, BADIA;REEL/FRAME:055675/0468 Effective date: 20170214 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |