WO2016064773A1 - Near-eye display system - Google Patents

Near-eye display system Download PDF

Info

Publication number
WO2016064773A1
WO2016064773A1 PCT/US2015/056296 US2015056296W WO2016064773A1 WO 2016064773 A1 WO2016064773 A1 WO 2016064773A1 US 2015056296 W US2015056296 W US 2015056296W WO 2016064773 A1 WO2016064773 A1 WO 2016064773A1
Authority
WO
WIPO (PCT)
Prior art keywords
lens array
lens
microlenses
display
array
Prior art date
Application number
PCT/US2015/056296
Other languages
French (fr)
Inventor
Hongbae Sam PARK
Reynald Antoine Hoskinson
Hamid Abdollahi
Boris Stoeber
Original Assignee
Intel Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corporation filed Critical Intel Corporation
Priority to US15/510,283 priority Critical patent/US10241334B2/en
Publication of WO2016064773A1 publication Critical patent/WO2016064773A1/en
Priority to US16/363,275 priority patent/US11307414B2/en

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K37/00Dashboards
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B3/00Simple or compound lenses
    • G02B3/0006Arrays
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0127Head-up displays characterised by optical features comprising devices increasing the depth of field

Definitions

  • the present disclosure relates to a near-eye display system, which may, for example, be encompassed in a heads-up display system.
  • HUD Head-Up Display
  • HUD systems have become popular in a number of applications, including personal wearable devices.
  • HUD systems present data to a user without requiring the user to look away from their usual viewpoints.
  • a near-eye display system creates a display in front of the user's field of vision and is an integral part of any HUD system.
  • One of the limiting factors in designing a near-eye system for HUD systems is the human eye's accommodation. Accommodation is the process by which the human eye changes optical power to maintain a clear image or focus on an object as its distance varies.
  • a normal human eye can typically comfortably focus on objects at a distance of 25 cm or greater, although studies have indicated that the minimum distance a normal human eye can focus (minimum amplitude of accommodation) can be as small as about 10 Dioptre, which is roughly around 10 cm.
  • Wearable HUD systems are generally intended for ease of portability and comfort of use. Compact systems that provide for the minimum amplitude of accommodation of a user's eye, are desirable.
  • Figure 1 is a schematic diagram of an example of a near-eye display (NED) system.
  • NED near-eye display
  • Figures 2A-H are a schematic diagrams of different arrangements and shapes of microlenses in a lens array.
  • Figure 3 is a schematic diagram of an example of a lens array.
  • Figure 4 is a schematic diagram of a near-eye display system, wherein the solid line style (— ) represent light rays, dashed and dotted lines (— ⁇ — ⁇ ) represent the apparent path of light rays; and dashed-only lines (— ) represent the virtual image.
  • Figure 5A is a schematic diagram of a spherical microlens surface.
  • Figure 5B is a schematic diagram of an aspherical micolens surface.
  • Figure 6A is a schematic diagram of a diffractive grating layer.
  • Figure 6B is a schematic diagram of a Fresnel grooves layer.
  • Figure 7 is a schematic diagram of an example of a folded-eye display system.
  • Figure 8 is a schematic diagram of another example of a folded-eye display system.
  • Figure 9 is a schematic diagram of an eyebox (shaded region) formed in an example of a near-eye display system.
  • Figure 10 is a schematic diagram of the results of a 2-D ray tracing simulation of an example of a near-eye display system.
  • Figure 1 1 is a process flow diagram for creating a virtual and real image from a display for a near-eye display device.
  • the present disclosure provides a near-eye display (NED) system for generating a virtual image of a display, including: a display, a first lens array positioned in front of the display, the first lens array comprising a plurality of concave microlenses having a first pitch, and a second lens array positioned in front of the first lens array, the second lens array comprising a plurality of convex microlenses having a second pitch, wherein the first lens array has a focal plane at the display and the second lens array has a focal plane at a virtual image plane of the first array.
  • NED near-eye display
  • FIG. 1 A schematic illustration of an example near-eye display (NED) system 100 is shown in Figure 1 .
  • the near-eye display system 100 includes a display 102 that transmits visual information for visual reception, and a first lens array 104 and a second lens array 106 that transmit and refract light provided by the display 102.
  • Figure 1 shows a convex first microlens array 104 and a concave second lens array 106.
  • each of a lens' optical surfaces may be convex (bulging outwards from the lens), concave (depressed into the lens), or planar (flat).
  • a lens is biconvex if both of its optical surfaces are convex, whereas a lens is biconcave if both of its optical surfaces are concave.
  • a near-eye display system is a system with one or more optical elements within the user's field of vision that present an image for viewing by the user.
  • the optical elements may be transparent or opaque depending on the application.
  • the display itself may be within the user's field of vision, whereas in other embodiments the display may be outside of the user's field of vision, and a beamsplitter, holographic optical element, or other optical element may be used to direct light from the display to the user's eye.
  • the display 102 may be any display that presents visual information by emitting light.
  • An example of a display that may be used in the present disclosure is a liquid crystal display (LCD).
  • a lens array contains multiple small lenses, which may be referred to as microlenses.
  • the microlenses of a lens array may be arranged in a one-dimensional or two-dimensional matrix.
  • the examples disclosed herein contemplate lens arrays comprising two-dimensional matrices of microlenses, which would typically be used in conjunction with typical displays such as, for example, LCDs.
  • Lens arrays comprising one-dimensional matrices of microlenses may be useful in conjunction with retinal-scanning type near- eye displays.
  • the microlenses of each lens array are all evenly spaced.
  • the term "pitch" is used to refer to the center-to-center spacing between adjacent microlenses of an array.
  • the microlenses of an array may be formed from a block of transparent optical material, or may be formed from transparent optical material on a supporting substrate.
  • a supporting substrate may be a thin sheet of light-permitting substrate.
  • the optical material used for the microlenses and/or the supporting substrate may, for example, be quartz glass, borosilicate glass (e.g. PyrexTM), or polymer-based materials such as polydimethylsiloxane (PDMS) or poly(methyl methacrylate) (PMMA).
  • a lens array may be made by preparing a mold and using the mold for example to stamp out the array from a suitable optical material, or filling the mold with suitable optical material.
  • each lens array may consist of either convex or concave microlenses.
  • the pitch of a lens array is defined as the distance between the centers of adjacent microlenses in the lens array.
  • FIG. 2A shows an example array 200A with circular lenses 202A arranged in an orthogonal formation
  • Figure 2B shows an example array 200B with circular lenses 202A arranged in a hexagonal formation.
  • there is some "non-lens area" 204A/204B formed by the gaps between microlenses), such that the "fill-factor" of the microlenses is less than 100%.
  • the hexagonal formation of circular lenses in array 200B has a higher fill-factor than the orthogonal formation circular lenses in array 200A.
  • Figures 2C and 2D show example arrays 200C and 200D that provide 100% fill-factor, but the square microlenses202C of array 200C of Figure 2C, and the hexagonal microlenses 202C of array 200D of Figure 2D may be more difficult to fabricate than circular lenses.
  • Lens arrays with 100% fill factor provide increased light propagation efficiency in comparison to arrays with less than 100% fill factor. For example, where light from the display passes through gaps between the microlenses, this light is not refracted and instead reaches the user's eye as stray light, which may be perceived as a blur, and result in decreased resolution.
  • the non-lens area of a lens array may be covered with a light-blocking paint or other opaque material such that light is only permitted to pass through the lens portions of the lens array.
  • the non-lens areas of both of the first and second lens arrays 104/106 comprise opaque material.
  • the non-lens area of only one of the first and second lens arrays 104/106 comprises opaque material.
  • an opaque coating may be applied to the second (convex) lens array 106, which is the outermost array.
  • an opaque coating may be applied to the first (concave) lens array 104, which may simplify fabrication since the first lens array 104 has a flatter profile (e.g., the concave microlenses of the first lens array 104 may not protrude outwardly from the surface(s) of the array).
  • Figure 2E shows an example lens array 200Ewith circular microlenses 202E arranged in an orthogonal formation, and separated from one another such that the edges of the microlenses do not abut each other, resulting in a greater percentage of non-lens area 204E (and thus a lower fill-factor) in comparison to array 200A of Figure 2A.
  • the non-lens area 204E of array 200E is covered with a light-blocking material such that light can only pass through the array 200E through the microlenses 202E.
  • Arrays such as the example array 200E of Figure 2E with relatively greater amounts of non-lens area that is rendered opaque may be useful in situations where strong ambient light is present.
  • sunlight management is an important consideration in the design of NEDs, because oftentimes sunlight can enter into the NED through the lens (e.g., by reflection from the user's cheek), if the intensity of the sunlight overpowers the brightness of the display, it can wash out the display.
  • the light-blocking coating on the non-lens area can advantageously reduce the amount of sunlight entering the NED through the array.
  • lens arrays of Figures 2A-E have generally square shapes, but it is to be understood that the shape of a lens array can be varied depending on the intended application.
  • lens arrays can have shapes that are generally circular (e.g. array 200F of Figure 2F), rectangular (e.g. array 200G of Figure 2G), triangular (e.g. array 200H of Figure 2H), hexagonal (now shown), or other shapes.
  • FIG. 3 is a schematic diagram of an example of a convex (second) lens array 106 consisting of convex microlenses 108 having a pitch p 109. (The first lens array is not shown in Figure 3.)
  • Equation 1 the relationship between the pitches and focal lengths of the first and the second lens arrays 104 and 106, and the behavior of the light rays passing through the system 100, is defined by Equation 1 :
  • F is the focal length of the system 100 as a whole
  • p1 is the pitch of the first lens array 104
  • p2 and f2 are the pitch and effective focal length, respectively, of the second lens array 106.
  • focal length is the measure of how strongly an optical system converges or diverges light.
  • the focal plane is the plane through a focal point and perpendicular to the optical axis of a lens.
  • a virtual image is an image formed when the outgoing rays from a point on an object diverge and the image appears to be located at the point of apparent divergence.
  • a real image is one that is formed when the outgoing rays from a point on an object converge at a real location.
  • particular combinations of pitch and focal lengths of the first and second lens arrays 104/106 may be selected such that the superlens can behave as a singlet lens producing a magnified image.
  • An illustration of a portion of an example of a near-eye display system 100 is shown in Figure 4.
  • the display 102 is at the focal plane of the first lens array 104.
  • Outgoing rays from the display 102 diverge as they pass through the first lens array 104, generating a virtual image 1 10 on the same side of the first lens array 104 as the display 102, and are collimated as they pass through the second lens array 106.
  • the focal plane of the second lens array 106 is at the plane of the virtual image 1 10 generated by the first lens array 104.
  • each microlens of each of the first and second lens arrays 104/106 is a spherical microlens.
  • microlens is spherical when the
  • microlenssurface at all points, is equidistant from the center of the microlens, as shown in Figure 5A (e.g., the microlens has a constant radius of curvature.
  • the microlenses may be aspherical.
  • a microlens is a spherical when the points of the microlenssurface are not equidistant from the center of the microlens, as shown in Figure 5B (e.g., the microlens does not have a constant radius of
  • Aspherical microlenses may be used for optical aberration correction.
  • optical aberrations include chromatic aberrations, distortion aberrations, coma aberrations and spherical aberrations.
  • Chromatic aberrations can occur, for example, when color displays (such as an LCD monitor) are viewed through a typical magnifying glass, and color separation might be observed. This is because the refractive power of the color displays (such as an LCD monitor) are viewed through a typical magnifying glass, and color separation might be observed. This is because the refractive power of the color displays (such as an LCD monitor) are viewed through a typical magnifying glass, and color separation might be observed. This is because the refractive power of the
  • chromatic aberrations are minimized with the use of low refractive index materials, or the surface of a lens can be treated with diffractive gratings optimized for wavelengths of light of interest.
  • concave-convex lens pairs can be used such that they cancel out the chromatic aberration.
  • the concave and convex arrays 104 and 104 of system 100 can be designed to minimize chromatic aberration.
  • Distortion aberrations can occur, for example, in typical spherical magnifiers, where the image viewed through the spherical magnifier can seem to be either pulled towards the viewer or away from the viewer at the edges of the image. This is because the magnification differs as we move from the center of the lens to the edge of the lens. This can be corrected by making the lens surface aspherical.
  • system 100 comprises only two arrays 104 and 106 of microlenses, and surface treatments may be used to correct for aberrations, such as for example, using diffractive gratings or modifying the lens surface geometry from spherical to aspherical. Whether or not particular aspherical microlenses and/or surface treatments are desirable for a particular NED system depends on what type of optical aberrations are required to be corrected.
  • a NED system design may begin with spherical microlenses in the arrays, then, based on other elements of the system (e.g., whether it is a folded or non-folded type system), adjust one or both of the lens arrays to include aspherical microlenses, diffractive gratings, or other surface treatments to address any optical aberrations.
  • first and second lens arrays 104/106 may be implemented as an array of diffractive grating microlenses or an array of Fresnel microlenses.
  • a diffractive grating is an optical component with periodic structure, which splits and diffracts light into several beams traveling in different directions. The directions of these beams depend on the spacing of the grating and the wavelength of light.
  • Figure 6A shows an example lens array 600A comprising a plurality of diffractive grating microlenses 602A.
  • a diffractive grating microlens may be configured to act as a convex microlens or a concave microlens.
  • the lens array 600A has binary phase gratings (i.e., only 1 grating step size), but other grating types may be used in other embodiments.
  • diffractive optics can also be used in conjunction with refractive optics, for example a refractive lens can be surface treated to have diffractive gratings on it.
  • Figure 6B shows an example lens array 600B comprising a plurality of Fresnel microlenses 602B.
  • Each Fresnel microlens comprises a plurality Fresnel grooves that have the same curvature as corresponding portions of a traditional continuous lens surface.
  • the lens array 600B
  • convex Fresnel microlenses 602B comprises convex Fresnel microlenses 602B, but concave Fresnel microlenses may be used to implement a concave lens array.
  • Some embodiments of a NED system according to the present disclosure comprise lens arrays with aspheric microlenses having diffractive gratings formed on the surfaces of the microlenses.
  • Such a lens array may require more initial time or effort to construct (e.g. a more complex mold may be required), but once the initial lens array design is completed mass production of such arrays would be largely similar to arrays with spherical microlenses (e.g., by using the mold for stamping the arrays from suitable optical material).
  • the near-eye display system may have a non- folded configuration, such as in the example schematically depicted in Figure 1 .
  • the near-eye display system may be in a folded configuration, as shown for example in Figures 7 and 8.
  • a non-folded optics configuration is an optical system in which the display surface and the surfaces of the lens arrays are parallel and share the same optical axis, which is normal to the surfaces.
  • a folded optics configuration is an optical system in which the beam is bent for the purpose of reducing the physical length of the system or for the purpose of changing the path of the optical axis.
  • Components such as free-form surface prisms, beam splitters, mirrors, waveguides and other optical components may be used to make a folded near-eye display system.
  • Figure 7 shows one example of a folded near-eye display system 700 where the lens arrays 104/106 are the final elements that light from the display passes through before reaching a user's eye.
  • the beam from the display 102 is redirected by a transparent beam redirection element 702 (e.g., a beam splitter, holographic optical element, or the like) before it travels to the lens arrays 104/106, then to a user's eye.
  • a null lens 704 is used to negate the optical effect of the lens arrays 104/106, thus allowing the outside scenery to be seen through the transparent beam redirection element 702.
  • Figure 8 shows a second example of a folded near-eye display system 800 where the lens arrays 104/106 are the initial elements that light from the display passes through. Briefly, a beam from the display 102 travels to the lens arrays 104/106 before it is redirected by a transparent beam redirection element 802, then to a user's eye.
  • the transparent beam redirection element 802 may, for example, be embedded within a transparent optical medium between a rear surface 804 and a front surface 806.
  • Head-up display (HUD) systems were initially developed for military aviation, but are now used in commercial aircrafts, automobiles, computer gaming and wearable devices.
  • HUD systems for example, include head-mounted wearable display devices that have the capability of reflecting projected images as well as allowing the user to see through it.
  • wearable HUD systems should be as compact as possible so that the user is comfortable wearing the system.
  • the display of most contemporary wearable HUD systems are positioned as close to the eye as possible to minimize the overall form-factor.
  • the distance of a display from the eye may be referred to as "eye relief" of the display.
  • a near-eye display system as disclosed herein may be used to permit smaller eye relieve than certain prior art HUD systems.
  • the eyebox is the three-dimensional space in front of a near-eye display within which the complete virtual image of the display can be viewed by a user's eye.
  • the larger the eyebox the more freedom of head movement the viewer has while still being able to view the complete virtual image.
  • An example of an eyebox 1 14 of a near-eye display system 100 according to certain embodiments of the present disclosure is shown in Figure 9.
  • the eyebox 1 14 is formed in the space created by overlapping collimated beams.
  • the size of the eyebox is determined by the size of the display 102 and lens arrays 104/106, and the angle a, which may be referred to as the "exit angle.”
  • Angle a is defined as the angle between the optical axis 120 of the arrays 104/106, and light rays refracted from the outer edges (which may be referred to as "edge rays") of the second lens array 106.
  • Angle a is considered to have a negative value when the edge rays converge, as shown in Figure 9, which occurs in a concave-convex system such as system 100.
  • Angle a is considered to have a positive value in systems where the edge rays diverge.
  • the eyebox can be viewed as the area where collimated beams overlap, as shown in Figure 10.
  • the results of the simulation show the deflection of collimated beams, launched from different locations on the display 102, and deflected when exiting from the near-eye display system 100, which consists of the first and second lens arrays 104/106.
  • the field of view (FOV) of a near-eye display is a linear function of the size of the lens arrays. Consequently, in the examples herein, without any change in the lens array parameters (such as focal length or microlens diameter), a large FOV can be achieved by increasing the surface area of the lens arrays 104/106.
  • An F- number is the ratio between the focal length and the aperture diameter of a lens.
  • the present disclosure provides a near-eye display system with an F-number of less than 1 .
  • some embodiments provide a NED system with lens arrays 104/106 having a combined focal length of about 5.4mm and an aperture diameter of about 12mm, which translates to an F-number of about 0.45.
  • the distance between the first lens array 104 and the second lens array 106 may be about 10 mm or less.
  • the first and second lens arrays 104/106 may be in contact with each other.
  • the distance between the first lens array 104 and the display 102 may be between about 0 mm and about 50 mm.
  • the combined overall focal length of the first and second lens arrays 104/106 may be about 5mm, the exit angle of the first and second lens arrays 104/106 may be about -14 degrees.
  • the first lens array 104 may have a pitch of about 260 ⁇ , and the second lens array 106 may have a pitch of about 250 ⁇ .
  • the first lens array 104 may have a pitch of about 280 ⁇ , and the second lens array 106 may have a pitch of about 269 ⁇ . ⁇ 5 long as the ratio between pitches and the respective focal lengths of the first and second lens arrays 104/106are kept constant, any pitches will work for given overall system focal length and exit angle.
  • the first lens array may have a focal length of about -400 ⁇ and the second lens array may have a focal length of about 1020 ⁇ .
  • Figure 1 1 is a process flow diagram 1 100 for generating a virtual image.
  • a display can emit light representing a displayed image (1 102).
  • a first, concave microlens array can receive the emitted light and refract the light, which can create a virtual image between the display and the first, concave microlens (1 104).
  • a second, convex microlens array can receive the refracted light, and refract the light to create real image of the emitted light representing the displayed image (1 106).
  • the refracted light from the second, convex microlens array can be redirected to change the location of the resulting real image.
  • the displayed image can be redirected before reaching the first, concave microlens array.
  • the near-eye display system may include a display, a first lens array comprising a plurality of concave microlenses having a first pitch; and a second lens array positioned in front of the first lens array, the second lens array comprising a plurality of convex microlenses having a second pitch.
  • the first lens array can be positioned on an optical path between the display and the second lens array.
  • the first lens array has a focal plane at the display and the second lens array has a focal plane at a virtual image plane of the first lens array.
  • aspects of the embodiments are directed to a method for generating a virtual image.
  • the method can include receiving, at a first, concave microlens array, light emitted from a display, generating a virtual image based on the light emitted from the display at a location between the display and the first, concave microlens array, receiving, at a second, convex microlens array, the light transmitted from the first, concave microlens array, and generating a real image based on the light emitted from the display with the second, convex microlens array.
  • aspects of the embodiments are directed to a wearable apparatus configured to perform the method steps. Aspects of the embodiments are directed to a near-eye display device that includes a display means, a means for generating a real image, and a means for generating a virtual image. In some embodiments, the near-eye display device also includes means for changing the direction of emitted light.
  • the pitch of the first lens array is not equal to the pitch of the second lens array, such that the virtual image is magnified.
  • virtual image is magnified in comparison to the display by a magnification factor of at least 1 .
  • the distance between the first lens array and the second lens array is between about 0 mm and about 10 mm.
  • the distance between the first lens array and the display is between about 0 mm and about 50 mm.
  • the distance between the first lens array and the second lens array is between about 0 mm and about 10 mm, and the distance between the first lens array and the display is between about 0 mm to about 50 mm.
  • the first lens array has a pitch of about 260 ⁇ .
  • the second lens array has a pitch of about 250 ⁇ .
  • the first lens array has a pitch of about 260 ⁇ and the second lens array has a pitch of about 250 ⁇ .
  • the first lens array has a focal length of about -400 ⁇ .
  • the second lens array has a focal length of about 1020 ⁇ .
  • the first lens array has a focal length of about -400 ⁇ and the second lens array has a focal length of about 1020 ⁇ .
  • the first and second lens arrays have an exit angle of about -14 degrees.
  • the first and second lens arrays have a ratio of combined focal length to aperture diameter of less than 1 .
  • the first and second lens arrays have a ratio of combined focal length to aperture diameter of about 0.5.
  • the display, the first lens array and the second lens array have the same optical axis.
  • Some implementations of the near-eye display system may include a transparent beam redirection element; and a null lens.
  • the display may be
  • the transparent beam redirection element may be positioned on the optical path between the display and the first lens array, and the first and second lens arrays may be positioned between transparent beam redirection element and a user's eye.
  • the null lens may be positioned on the opposite side the transparent beam redirection element from the first and second lens arrays and the null lens may be configured to negate the optical effect of the first and lens arrays.
  • Some implementations of the near-eye display system may include a transparent beam redirection element embedded within a transparent optical medium.
  • the transparent beam redirection element may be positioned on the optical path between the second lens array and a user's eye.
  • the microlenses are spherical lenses.
  • the microlenses are aspherical lenses.
  • the near-eye display system includes diffractive gratings formed on the surfaces of the microlenses.
  • the near-eye display system includes diffractive gratings formed on the surfaces of the microlenses.
  • one of the first and second lens arrays comprises diffractive grating microlenses.
  • one of the first and second lens arrays comprises Fresnel microlenses.
  • the microlenses of the first lens array are biconcave.
  • the microlenses of the second lens array are biconvex.
  • the microlenses of the first lens array are biconcave and the microlenses of the second lens array are biconvex.
  • the microlenses of the first and second lens arrays are square lenses or hexagonal lenses arranged to provide a fill factor of substantially 100%.
  • the microlenses of the first and second lens arrays are circular lenses arranged in an orthogonal arrangement.
  • the microlenses of the first and second lens arrays are circular lenses arranged in a hexagonal arrangement.
  • a non-lens area of one of the first and second lens arrays comprises an opaque material.
  • a non-lens area of one of the first and second lens arrays comprises an opaque material.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)

Abstract

The present disclosure provides a near-eye display system for generating a virtual image of a display, including: a display, a first lens array comprising a plurality of concave microlenses having a first pitch, and a second lens array positioned in front of the first lens array, the second lens array comprising a plurality of convex microlenses having a second pitch, wherein the first lens array is positioned on an optical path between the display and the second lens array, and wherein the first lens array has a focal plane at the display and the second lens array has a focal plane at a virtual image plane of the first lens array.

Description

NEAR-EYE DISPLAY SYSTEM
Cross reference to related applications
[0001] The present disclosure claims the benefit of priority to United States Provisional Patent Application No. 62/066,256 titled "NEAR-EYE DISPLAY
SYSTEM" and filed on October 20, 2014, the entire contents of which are
incorporated by reference herein.
Technical Field
[0002] The present disclosure relates to a near-eye display system, which may, for example, be encompassed in a heads-up display system.
Background
[0003] Head-Up Display (HUD) systems have become popular in a number of applications, including personal wearable devices. Generally, HUD systems present data to a user without requiring the user to look away from their usual viewpoints.
[0004] A near-eye display system creates a display in front of the user's field of vision and is an integral part of any HUD system. One of the limiting factors in designing a near-eye system for HUD systems is the human eye's accommodation. Accommodation is the process by which the human eye changes optical power to maintain a clear image or focus on an object as its distance varies. A normal human eye can typically comfortably focus on objects at a distance of 25 cm or greater, although studies have indicated that the minimum distance a normal human eye can focus (minimum amplitude of accommodation) can be as small as about 10 Dioptre, which is roughly around 10 cm.
[0005] Wearable HUD systems are generally intended for ease of portability and comfort of use. Compact systems that provide for the minimum amplitude of accommodation of a user's eye, are desirable.
[0006] Improvements in near-eye displays are desirable. Brief Description of the Drawings
[0007] These and other features of the disclosure will become more apparent from the following description in which reference is made to the appended drawings wherein:
[0008] Figure 1 is a schematic diagram of an example of a near-eye display (NED) system.
[0009] Figures 2A-H are a schematic diagrams of different arrangements and shapes of microlenses in a lens array.
[0010] Figure 3 is a schematic diagram of an example of a lens array.
[0011] Figure 4 is a schematic diagram of a near-eye display system, wherein the solid line style (— ) represent light rays, dashed and dotted lines (—■—■) represent the apparent path of light rays; and dashed-only lines (— ) represent the virtual image.
[0012] Figure 5A is a schematic diagram of a spherical microlens surface.
[0013] Figure 5B is a schematic diagram of an aspherical micolens surface.
[0014] Figure 6A is a schematic diagram of a diffractive grating layer.
[0015] Figure 6B is a schematic diagram of a Fresnel grooves layer.
[0016] Figure 7 is a schematic diagram of an example of a folded-eye display system.
[0017] Figure 8 is a schematic diagram of another example of a folded-eye display system.
[0018] Figure 9 is a schematic diagram of an eyebox (shaded region) formed in an example of a near-eye display system.
[0019] Figure 10 is a schematic diagram of the results of a 2-D ray tracing simulation of an example of a near-eye display system.
[0020] Figure 1 1 is a process flow diagram for creating a virtual and real image from a display for a near-eye display device.
Detailed Description
[0021] Generally, the present disclosure provides a near-eye display (NED) system for generating a virtual image of a display, including: a display, a first lens array positioned in front of the display, the first lens array comprising a plurality of concave microlenses having a first pitch, and a second lens array positioned in front of the first lens array, the second lens array comprising a plurality of convex microlenses having a second pitch, wherein the first lens array has a focal plane at the display and the second lens array has a focal plane at a virtual image plane of the first array.
[0022] For simplicity and clarity of illustration, reference numerals may be repeated among the figures to indicate corresponding or analogous elements.
Numerous details are set forth to provide an understanding of the examples described herein. The examples may be practiced without these details. In other instances, well-known methods, procedures, and components are not described in detail to avoid obscuring the examples described. The description is not to be considered as limited to the scope of the examples described herein.
[0023] A schematic illustration of an example near-eye display (NED) system 100 is shown in Figure 1 . The near-eye display system 100 includes a display 102 that transmits visual information for visual reception, and a first lens array 104 and a second lens array 106 that transmit and refract light provided by the display 102. Figure 1 shows a convex first microlens array 104 and a concave second lens array 106.
[0024] In the context of the present disclosure, it should be understood that each of a lens' optical surfaces may be convex (bulging outwards from the lens), concave (depressed into the lens), or planar (flat). A lens is biconvex if both of its optical surfaces are convex, whereas a lens is biconcave if both of its optical surfaces are concave.
[0025] In the context of the present disclosure, a near-eye display system is a system with one or more optical elements within the user's field of vision that present an image for viewing by the user. The optical elements may be transparent or opaque depending on the application. For example, as discussed further below in some embodiments, the display itself may be within the user's field of vision, whereas in other embodiments the display may be outside of the user's field of vision, and a beamsplitter, holographic optical element, or other optical element may be used to direct light from the display to the user's eye. [0026] In the context of the present disclosure, the display 102 may be any display that presents visual information by emitting light. An example of a display that may be used in the present disclosure is a liquid crystal display (LCD).
[0027] In the context of the present disclosure, a lens array contains multiple small lenses, which may be referred to as microlenses. The microlenses of a lens array may be arranged in a one-dimensional or two-dimensional matrix. The examples disclosed herein contemplate lens arrays comprising two-dimensional matrices of microlenses, which would typically be used in conjunction with typical displays such as, for example, LCDs. Lens arrays comprising one-dimensional matrices of microlenses may be useful in conjunction with retinal-scanning type near- eye displays.
[0028] In some embodiments, the microlenses of each lens array are all evenly spaced. The term "pitch" is used to refer to the center-to-center spacing between adjacent microlenses of an array.
[0029] The microlenses of an array may be formed from a block of transparent optical material, or may be formed from transparent optical material on a supporting substrate. A supporting substrate may be a thin sheet of light-permitting substrate. The optical material used for the microlenses and/or the supporting substrate may, for example, be quartz glass, borosilicate glass (e.g. Pyrex™), or polymer-based materials such as polydimethylsiloxane (PDMS) or poly(methyl methacrylate) (PMMA). In some embodiments, a lens array may be made by preparing a mold and using the mold for example to stamp out the array from a suitable optical material, or filling the mold with suitable optical material.
[0030] In some embodiments, all microlenses in an array have the same focal length. Accordingly, each lens array may consist of either convex or concave microlenses.
[0031] In the context of the present disclosure, it should be understood that two or more lens arrays, with different pitches, in series, collectively form a
superlens. The pitch of a lens array is defined as the distance between the centers of adjacent microlenses in the lens array.
[0032] Microlenses of different shapes and arrangements in a microlens may be used, as desired. For example, Figure 2A shows an example array 200A with circular lenses 202A arranged in an orthogonal formation, and Figure 2B shows an example array 200B with circular lenses 202A arranged in a hexagonal formation. In both of the arrays 200A/200B, there is some "non-lens area" 204A/204B (formed by the gaps between microlenses), such that the "fill-factor" of the microlenses is less than 100%. The hexagonal formation of circular lenses in array 200B has a higher fill-factor than the orthogonal formation circular lenses in array 200A. Figures 2C and 2D show example arrays 200C and 200D that provide 100% fill-factor, but the square microlenses202C of array 200C of Figure 2C, and the hexagonal microlenses 202C of array 200D of Figure 2D may be more difficult to fabricate than circular lenses.
[0033] Lens arrays with 100% fill factor provide increased light propagation efficiency in comparison to arrays with less than 100% fill factor. For example, where light from the display passes through gaps between the microlenses, this light is not refracted and instead reaches the user's eye as stray light, which may be perceived as a blur, and result in decreased resolution. In some embodiments, the non-lens area of a lens array may be covered with a light-blocking paint or other opaque material such that light is only permitted to pass through the lens portions of the lens array. In some embodiments, the non-lens areas of both of the first and second lens arrays 104/106 comprise opaque material. In some embodiments, the non-lens area of only one of the first and second lens arrays 104/106 comprises opaque material. For example, in some embodiments an opaque coating may be applied to the second (convex) lens array 106, which is the outermost array. In other embodiments, an opaque coating may be applied to the first (concave) lens array 104, which may simplify fabrication since the first lens array 104 has a flatter profile (e.g., the concave microlenses of the first lens array 104 may not protrude outwardly from the surface(s) of the array).
[0034] Figure 2E shows an example lens array 200Ewith circular microlenses 202E arranged in an orthogonal formation, and separated from one another such that the edges of the microlenses do not abut each other, resulting in a greater percentage of non-lens area 204E (and thus a lower fill-factor) in comparison to array 200A of Figure 2A. The non-lens area 204E of array 200E is covered with a light-blocking material such that light can only pass through the array 200E through the microlenses 202E. [0035] Arrays such as the example array 200E of Figure 2E with relatively greater amounts of non-lens area that is rendered opaque may be useful in situations where strong ambient light is present. For example, sunlight management is an important consideration in the design of NEDs, because oftentimes sunlight can enter into the NED through the lens (e.g., by reflection from the user's cheek), if the intensity of the sunlight overpowers the brightness of the display, it can wash out the display. By providing a lens array with a reduced fill factor and an opaque non-lens area, the light-blocking coating on the non-lens area can advantageously reduce the amount of sunlight entering the NED through the array.
[0036] The example arrays of Figures 2A-E have generally square shapes, but it is to be understood that the shape of a lens array can be varied depending on the intended application. For example, lens arrays can have shapes that are generally circular (e.g. array 200F of Figure 2F), rectangular (e.g. array 200G of Figure 2G), triangular (e.g. array 200H of Figure 2H), hexagonal (now shown), or other shapes.
[0037] Figure 3 is a schematic diagram of an example of a convex (second) lens array 106 consisting of convex microlenses 108 having a pitch p 109. (The first lens array is not shown in Figure 3.) In the context of the present disclosure, it should be understood that the relationship between the pitches and focal lengths of the first and the second lens arrays 104 and 106, and the behavior of the light rays passing through the system 100, is defined by Equation 1 :
F =——— f2 Equation 1 , pl-p2
wherein F is the focal length of the system 100 as a whole, p1 is the pitch of the first lens array 104, and p2 and f2 are the pitch and effective focal length, respectively, of the second lens array 106.
[0038] In the context of the present disclosure, it should be understood that focal length is the measure of how strongly an optical system converges or diverges light. For an optical system in air, it is the distance over which initially collimated rays are brought to a focus. The focal plane is the plane through a focal point and perpendicular to the optical axis of a lens. A virtual image is an image formed when the outgoing rays from a point on an object diverge and the image appears to be located at the point of apparent divergence. In contrast, a real image is one that is formed when the outgoing rays from a point on an object converge at a real location.
[0039] In some examples, particular combinations of pitch and focal lengths of the first and second lens arrays 104/106 may be selected such that the superlens can behave as a singlet lens producing a magnified image. An illustration of a portion of an example of a near-eye display system 100 is shown in Figure 4. The display 102 is at the focal plane of the first lens array 104. Outgoing rays from the display 102 diverge as they pass through the first lens array 104, generating a virtual image 1 10 on the same side of the first lens array 104 as the display 102, and are collimated as they pass through the second lens array 106. In this example, the focal plane of the second lens array 106 is at the plane of the virtual image 1 10 generated by the first lens array 104.
[0040] In some embodiments, each microlens of each of the first and second lens arrays 104/106 is a spherical microlens. In the context of the present
disclosure, it should be understood that a microlens is spherical when the
microlenssurface, at all points, is equidistant from the center of the microlens, as shown in Figure 5A (e.g., the microlens has a constant radius of curvature. In other embodiments, the microlenses may be aspherical. In the context of the present disclosure, it should be understood that a microlens is a spherical when the points of the microlenssurface are not equidistant from the center of the microlens, as shown in Figure 5B (e.g., the microlens does not have a constant radius of
curvature).Aspherical microlenses may be used for optical aberration correction. Examples of optical aberrations include chromatic aberrations, distortion aberrations, coma aberrations and spherical aberrations.
[0041] Chromatic aberrations can occur, for example, when color displays (such as an LCD monitor) are viewed through a typical magnifying glass, and color separation might be observed. This is because the refractive power of the
magnifying glass is different for different colors (wavelengths). Usually chromatic aberrations are minimized with the use of low refractive index materials, or the surface of a lens can be treated with diffractive gratings optimized for wavelengths of light of interest. Also, concave-convex lens pairs can be used such that they cancel out the chromatic aberration. The concave and convex arrays 104 and 104 of system 100 can be designed to minimize chromatic aberration. [0042] Distortion aberrations can occur, for example, in typical spherical magnifiers, where the image viewed through the spherical magnifier can seem to be either pulled towards the viewer or away from the viewer at the edges of the image. This is because the magnification differs as we move from the center of the lens to the edge of the lens. This can be corrected by making the lens surface aspherical.
[0043] Other aberrations such as coma and spherical aberrations can also occur with spherical lenses, since the effective resolution of the lens will be far less than ideal because the light refracted by a spherical lens do not actually get focused at a common point on the optical axis. Instead, the focal point would be spread over a certain range on the optical axis, and the lens will never be in a perfect focus, which could decrease the resolution. This can also be corrected by having an aspherical lens surface. In practice, all non-ideal lenses cause optical aberrations to occur to a certain degree, and can be challenging to correct for all of the aberrations at the same time. Prior art solutions typically address aberrations through the use of additional lenses. In contrast, system 100 comprises only two arrays 104 and 106 of microlenses, and surface treatments may be used to correct for aberrations, such as for example, using diffractive gratings or modifying the lens surface geometry from spherical to aspherical. Whether or not particular aspherical microlenses and/or surface treatments are desirable for a particular NED system depends on what type of optical aberrations are required to be corrected. In some embodiments, a NED system design may begin with spherical microlenses in the arrays, then, based on other elements of the system (e.g., whether it is a folded or non-folded type system), adjust one or both of the lens arrays to include aspherical microlenses, diffractive gratings, or other surface treatments to address any optical aberrations.
[0044] In some embodiments, instead of each microlens of each being implemented a small simple lens, one or both of the first and second lens arrays 104/106 may be implemented as an array of diffractive grating microlenses or an array of Fresnel microlenses. A diffractive grating is an optical component with periodic structure, which splits and diffracts light into several beams traveling in different directions. The directions of these beams depend on the spacing of the grating and the wavelength of light.
[0045] Figure 6A shows an example lens array 600A comprising a plurality of diffractive grating microlenses 602A. A diffractive grating microlens may be configured to act as a convex microlens or a concave microlens. In the example of Figure 6A, the lens array 600A has binary phase gratings (i.e., only 1 grating step size), but other grating types may be used in other embodiments. Also, in some embodiments diffractive optics can also be used in conjunction with refractive optics, for example a refractive lens can be surface treated to have diffractive gratings on it.
[0046] Figure 6B shows an example lens array 600B comprising a plurality of Fresnel microlenses 602B. Each Fresnel microlens comprises a plurality Fresnel grooves that have the same curvature as corresponding portions of a traditional continuous lens surface. In the example of Figure 6B, the lens array 600B
comprises convex Fresnel microlenses 602B, but concave Fresnel microlenses may be used to implement a concave lens array.
[0047] Some embodiments of a NED system according to the present disclosure comprise lens arrays with aspheric microlenses having diffractive gratings formed on the surfaces of the microlenses. Such a lens array may require more initial time or effort to construct (e.g. a more complex mold may be required), but once the initial lens array design is completed mass production of such arrays would be largely similar to arrays with spherical microlenses (e.g., by using the mold for stamping the arrays from suitable optical material).
[0048] In some embodiments, the near-eye display system may have a non- folded configuration, such as in the example schematically depicted in Figure 1 . In other examples, the near-eye display system may be in a folded configuration, as shown for example in Figures 7 and 8. In the context of the present disclosure, it should be understood that a non-folded optics configuration is an optical system in which the display surface and the surfaces of the lens arrays are parallel and share the same optical axis, which is normal to the surfaces. A folded optics configuration is an optical system in which the beam is bent for the purpose of reducing the physical length of the system or for the purpose of changing the path of the optical axis. Components such as free-form surface prisms, beam splitters, mirrors, waveguides and other optical components may be used to make a folded near-eye display system.
[0049] Figure 7 shows one example of a folded near-eye display system 700 where the lens arrays 104/106 are the final elements that light from the display passes through before reaching a user's eye. Briefly, the beam from the display 102 is redirected by a transparent beam redirection element 702 (e.g., a beam splitter, holographic optical element, or the like) before it travels to the lens arrays 104/106, then to a user's eye. A null lens 704 is used to negate the optical effect of the lens arrays 104/106, thus allowing the outside scenery to be seen through the transparent beam redirection element 702.
[0050] Figure 8 shows a second example of a folded near-eye display system 800 where the lens arrays 104/106 are the initial elements that light from the display passes through. Briefly, a beam from the display 102 travels to the lens arrays 104/106 before it is redirected by a transparent beam redirection element 802, then to a user's eye. The transparent beam redirection element 802 may, for example, be embedded within a transparent optical medium between a rear surface 804 and a front surface 806.
[0051] Head-up display (HUD) systems were initially developed for military aviation, but are now used in commercial aircrafts, automobiles, computer gaming and wearable devices. HUD systems, for example, include head-mounted wearable display devices that have the capability of reflecting projected images as well as allowing the user to see through it. Ideally, wearable HUD systems should be as compact as possible so that the user is comfortable wearing the system.
Consequently, the display of most contemporary wearable HUD systems are positioned as close to the eye as possible to minimize the overall form-factor. The distance of a display from the eye may be referred to as "eye relief" of the display. For example, a near-eye display system as disclosed herein may be used to permit smaller eye relieve than certain prior art HUD systems.
[0052] One consideration in the design of a HUD is the eyebox. The eyebox is the three-dimensional space in front of a near-eye display within which the complete virtual image of the display can be viewed by a user's eye. The larger the eyebox, the more freedom of head movement the viewer has while still being able to view the complete virtual image. An example of an eyebox 1 14 of a near-eye display system 100 according to certain embodiments of the present disclosure is shown in Figure 9. The eyebox 1 14 is formed in the space created by overlapping collimated beams. The size of the eyebox is determined by the size of the display 102 and lens arrays 104/106, and the angle a, which may be referred to as the "exit angle." Angle a is defined as the angle between the optical axis 120 of the arrays 104/106, and light rays refracted from the outer edges (which may be referred to as "edge rays") of the second lens array 106. Angle a is considered to have a negative value when the edge rays converge, as shown in Figure 9, which occurs in a concave-convex system such as system 100. In contrast, Angle a is considered to have a positive value in systems where the edge rays diverge.
[0053] In 2-D ray tracing simulations, the eyebox can be viewed as the area where collimated beams overlap, as shown in Figure 10. The results of the simulation show the deflection of collimated beams, launched from different locations on the display 102, and deflected when exiting from the near-eye display system 100, which consists of the first and second lens arrays 104/106.
[0054] The field of view (FOV) of a near-eye display is a linear function of the size of the lens arrays. Consequently, in the examples herein, without any change in the lens array parameters (such as focal length or microlens diameter), a large FOV can be achieved by increasing the surface area of the lens arrays 104/106. An F- number is the ratio between the focal length and the aperture diameter of a lens. In some examples, the present disclosure provides a near-eye display system with an F-number of less than 1 . For example, some embodiments provide a NED system with lens arrays 104/106 having a combined focal length of about 5.4mm and an aperture diameter of about 12mm, which translates to an F-number of about 0.45.
[0055] In some embodiments, the distance between the first lens array 104 and the second lens array 106 may be about 10 mm or less. For example, in some embodiments the first and second lens arrays 104/106 may be in contact with each other. In some embodiments, the distance between the first lens array 104 and the display 102 may be between about 0 mm and about 50 mm.
[0056] In some embodiments, the combined overall focal length of the first and second lens arrays 104/106 may be about 5mm, the exit angle of the first and second lens arrays 104/106 may be about -14 degrees. In some embodiments, the first lens array 104 may have a pitch of about 260 μιτι, and the second lens array 106 may have a pitch of about 250 μιτι. In some embodiments, the first lens array 104 may have a pitch of about 280 μιτι, and the second lens array 106 may have a pitch of about 269μηη.Α5 long as the ratio between pitches and the respective focal lengths of the first and second lens arrays 104/106are kept constant, any pitches will work for given overall system focal length and exit angle. In some examples, the first lens array may have a focal length of about -400 μιτι and the second lens array may have a focal length of about 1020 μιτι.
[0057] Figure 1 1 is a process flow diagram 1 100 for generating a virtual image. A display can emit light representing a displayed image (1 102). A first, concave microlens array can receive the emitted light and refract the light, which can create a virtual image between the display and the first, concave microlens (1 104). A second, convex microlens array can receive the refracted light, and refract the light to create real image of the emitted light representing the displayed image (1 106). In some embodiments, the refracted light from the second, convex microlens array can be redirected to change the location of the resulting real image. In some
embodiments, the displayed image can be redirected before reaching the first, concave microlens array.
[0058] Aspects of the embodiments are directed to a near-eye display system for generating a virtual image of a display. The near-eye display system may include a display, a first lens array comprising a plurality of concave microlenses having a first pitch; and a second lens array positioned in front of the first lens array, the second lens array comprising a plurality of convex microlenses having a second pitch. The first lens array can be positioned on an optical path between the display and the second lens array. The first lens array has a focal plane at the display and the second lens array has a focal plane at a virtual image plane of the first lens array.
[0059] Aspects of the embodiments are directed to a method for generating a virtual image. The method can include receiving, at a first, concave microlens array, light emitted from a display, generating a virtual image based on the light emitted from the display at a location between the display and the first, concave microlens array, receiving, at a second, convex microlens array, the light transmitted from the first, concave microlens array, and generating a real image based on the light emitted from the display with the second, convex microlens array.
[0060] Aspects of the embodiments are directed to a wearable apparatus configured to perform the method steps. Aspects of the embodiments are directed to a near-eye display device that includes a display means, a means for generating a real image, and a means for generating a virtual image. In some embodiments, the near-eye display device also includes means for changing the direction of emitted light.
[0061] In some implementations of the embodiments, the pitch of the first lens array is not equal to the pitch of the second lens array, such that the virtual image is magnified.
[0062] In some implementations of the embodiments, virtual image is magnified in comparison to the display by a magnification factor of at least 1 .
[0063] In some implementations of the embodiments, the distance between the first lens array and the second lens array is between about 0 mm and about 10 mm.
[0064] In some implementations of the embodiments, the distance between the first lens array and the display is between about 0 mm and about 50 mm.
[0065] In some implementations of the embodiments, the distance between the first lens array and the second lens array is between about 0 mm and about 10 mm, and the distance between the first lens array and the display is between about 0 mm to about 50 mm.
[0066] In some implementations of the embodiments, wherein the first lens array has a pitch of about 260 μιτι.
[0067] In some implementations of the embodiments, wherein the second lens array has a pitch of about 250 μιτι.
[0068] In some implementations of the embodiments, the first lens array has a pitch of about 260 μιτι and the second lens array has a pitch of about 250 μιτι.
[0069] In some implementations of the embodiments, the first lens array has a focal length of about -400 μιτι.
[0070] In some implementations of the embodiments, the second lens array has a focal length of about 1020 μιτι.
[0071] In some implementations of the embodiments, the first lens array has a focal length of about -400 μιτι and the second lens array has a focal length of about 1020 μηη.
[0072] In some implementations of the embodiments, the first and second lens arrays have an exit angle of about -14 degrees.
[0073] In some implementations of the embodiments, the first and second lens arrays have a ratio of combined focal length to aperture diameter of less than 1 . [0074] In some implementations of the embodiments, the first and second lens arrays have a ratio of combined focal length to aperture diameter of about 0.5.
[0075] In some implementations of the embodiments, the display, the first lens array and the second lens array have the same optical axis.
[0076] Some implementations of the near-eye display system may include a transparent beam redirection element; and a null lens. The display may be
positioned substantially perpendicular to the first and second lens arrays. The transparent beam redirection element may be positioned on the optical path between the display and the first lens array, and the first and second lens arrays may be positioned between transparent beam redirection element and a user's eye. The null lens may be positioned on the opposite side the transparent beam redirection element from the first and second lens arrays and the null lens may be configured to negate the optical effect of the first and lens arrays.
[0077] Some implementations of the near-eye display system may include a transparent beam redirection element embedded within a transparent optical medium. The transparent beam redirection element may be positioned on the optical path between the second lens array and a user's eye.
[0078] In some implementations of the embodiments, the microlenses are spherical lenses.
[0079] In some implementations of the embodiments, the microlenses are aspherical lenses.
[0080] In some implementations of the embodiments, the near-eye display system includes diffractive gratings formed on the surfaces of the microlenses.
[0081] In some implementations of the embodiments, the near-eye display system includes diffractive gratings formed on the surfaces of the microlenses.
[0082] In some implementations of the embodiments, one of the first and second lens arrays comprises diffractive grating microlenses.
[0083] In some implementations of the embodiments, one of the first and second lens arrays comprises Fresnel microlenses.
[0084] In some implementations of the embodiments, the microlenses of the first lens array are biconcave.
[0085] In some implementations of the embodiments, the microlenses of the second lens array are biconvex. [0086] In some implementations of the embodiments, the microlenses of the first lens array are biconcave and the microlenses of the second lens array are biconvex.
[0087] In some implementations of the embodiments, the microlenses of the first and second lens arrays are square lenses or hexagonal lenses arranged to provide a fill factor of substantially 100%.
[0088] In some implementations of the embodiments, the microlenses of the first and second lens arrays are circular lenses arranged in an orthogonal arrangement.
[0089] In some implementations of the embodiments, the microlenses of the first and second lens arrays are circular lenses arranged in a hexagonal arrangement.
[0090] In some implementations of the embodiments, a non-lens area of one of the first and second lens arrays comprises an opaque material.
[0091] In some implementations of the embodiments, a non-lens area of one of the first and second lens arrays comprises an opaque material.
[0092] The present disclosure may be embodied in other specific forms without departing from its spirit or essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive.

Claims

Claims:
1 . A near-eye display system for generating a virtual image of a display, comprising
a display;
a first lens array comprising a plurality of concave microlenses having a first pitch; and
a second lens array positioned in front of the first lens array, the second lens array comprising a plurality of convex microlenses having a second pitch,
wherein the first lens array is positioned on an optical path between the display and the second lens array, and
wherein the first lens array has a focal plane at the display and the second lens array has a focal plane at a virtual image plane of the first lens array.
2. The near-eye display system of claim 1 , wherein the pitch of the first lens array is not equal to the pitch of the second lens array, such that the virtual image is magnified.
3. The near-eye display system of claim 1 , wherein the display, the first lens array and the second lens array have the same optical axis.
4. The near-eye display system of claim 1 , wherein one of the first and second lens arrays comprises diffractive grating microlenses.
5. The near-eye display system of claim 1 , wherein one of the first and second lens arrays comprises Fresnel microlenses.
6. The near-eye display system of claim 1 , wherein the microlenses of the first lens array are biconcave.
7. The near-eye display system of claim 1 , wherein the microlenses of the second lens array are biconvex.
8. The near-eye display system of claim 1 , wherein the microlenses of the first and second lens arrays are circular lenses arranged in an orthogonal arrangement.
9. The near-eye display system of claim 1 , wherein the microlenses of the first and second lens arrays are circular lenses arranged in a hexagonal arrangement.
10. The near-eye display system of claim 1 , wherein a non-lens area of one of the first and second lens arrays comprises an opaque material.
1 1 . An wearable apparatus for generating a near-eye virtual image of a display, comprising:
a first lens array comprising a plurality of concave microlenses having a first pitch; and
a second lens array positioned in front of the first lens array, the second lens array comprising a plurality of convex microlenses having a second pitch,
wherein the first lens array is positioned on an optical path between the display and the second lens array, and
wherein the first lens array has a focal plane at the display and the second lens array has a focal plane at a virtual image plane of the first lens array.
12. The wearable apparatus of claim 1 1 , wherein the pitch of the first lens array is not equal to the pitch of the second lens array, such that the virtual image is magnified.
13. The wearable apparatus of claim 1 1 , wherein the display, the first lens array and the second lens array have the same optical axis.
14. The wearable apparatus of claim 1 1 , wherein one of the first and second lens arrays comprises diffractive grating microlenses.
15. The wearable apparatus of claim 1 1 , wherein one of the first and second lens arrays comprises Fresnel microlenses.
16. The wearable apparatus of claim 1 1 , wherein the microlenses of the first lens array are biconcave.
17. The wearable apparatus of claim 1 1 , wherein the microlenses of the second lens array are biconvex.
18. An wearable apparatus for generating a near-eye virtual image of a display, comprising:
a first lens array comprising a plurality of concave microlenses having a first pitch;
a second lens array positioned in front of the first lens array, the second lens array comprising a plurality of convex microlenses having a second pitch;
a transparent beam redirection element; and
a null lens,
wherein the display is positioned generally perpendicular to the first and second lens arrays,
wherein the first lens array is positioned on an optical path between the display and the second lens array, and
wherein the first lens array has a focal plane at the display and the second lens array has a focal plane at a virtual image plane of the first lens array;
wherein the transparent beam redirection element is positioned on the optical path between the display and the first lens array, and the first and second lens arrays are positioned between transparent beam redirection element and a user's eye.
19. The wearable apparatus of claim 18, wherein the transparent beam
redirection element is embedded within a transparent optical medium,
wherein the transparent beam redirection element is positioned on the optical path between the second lens array and a user's eye.
20. The wearable apparatus of claim 18, wherein the null lens is positioned on the opposite side the transparent beam redirection element from the first and second lens arrays and the null lens is configured to negate the optical effect of the first and lens arrays.
PCT/US2015/056296 2014-10-20 2015-10-20 Near-eye display system WO2016064773A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US15/510,283 US10241334B2 (en) 2014-10-20 2015-10-20 Near-eye display system
US16/363,275 US11307414B2 (en) 2014-10-20 2019-03-25 Near-eye display system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201462066256P 2014-10-20 2014-10-20
US62/066,256 2014-10-20

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US15/510,283 A-371-Of-International US10241334B2 (en) 2014-10-20 2015-10-20 Near-eye display system
US16/363,275 Continuation US11307414B2 (en) 2014-10-20 2019-03-25 Near-eye display system

Publications (1)

Publication Number Publication Date
WO2016064773A1 true WO2016064773A1 (en) 2016-04-28

Family

ID=55761377

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/056296 WO2016064773A1 (en) 2014-10-20 2015-10-20 Near-eye display system

Country Status (2)

Country Link
US (2) US10241334B2 (en)
WO (1) WO2016064773A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106199974A (en) * 2016-09-28 2016-12-07 京东方科技集团股份有限公司 A kind of nearly eye display device
US9880325B2 (en) 2013-08-14 2018-01-30 Nvidia Corporation Hybrid optics for near-eye displays
US10120194B2 (en) 2016-01-22 2018-11-06 Corning Incorporated Wide field personal display
CN109557666A (en) * 2017-09-27 2019-04-02 蒋晶 Nearly optics of the eye imaging system, nearly eye display device and head-mounted display apparatus
US10379266B2 (en) 2017-09-15 2019-08-13 Sung-Yang Wu Near-eye display device
CN110221433A (en) * 2019-04-13 2019-09-10 济南大学 A kind of visual field amplification mirror for virtual reality glasses
US10976551B2 (en) 2017-08-30 2021-04-13 Corning Incorporated Wide field personal display device

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016064773A1 (en) 2014-10-20 2016-04-28 Intel Corporation Near-eye display system
US10247941B2 (en) * 2015-01-19 2019-04-02 Magna Electronics Inc. Vehicle vision system with light field monitor
US10297180B2 (en) 2015-08-03 2019-05-21 Facebook Technologies, Llc Compensation of chromatic dispersion in a tunable beam steering device for improved display
US10338451B2 (en) 2015-08-03 2019-07-02 Facebook Technologies, Llc Devices and methods for removing zeroth order leakage in beam steering devices
US10274730B2 (en) 2015-08-03 2019-04-30 Facebook Technologies, Llc Display with an embedded eye tracker
US10459305B2 (en) 2015-08-03 2019-10-29 Facebook Technologies, Llc Time-domain adjustment of phase retardation in a liquid crystal grating for a color display
US10552676B2 (en) 2015-08-03 2020-02-04 Facebook Technologies, Llc Methods and devices for eye tracking based on depth sensing
US10416454B2 (en) 2015-10-25 2019-09-17 Facebook Technologies, Llc Combination prism array for focusing light
US10247858B2 (en) 2015-10-25 2019-04-02 Facebook Technologies, Llc Liquid crystal half-wave plate lens
US10203566B2 (en) 2015-12-21 2019-02-12 Facebook Technologies, Llc Enhanced spatial resolution using a segmented electrode array
CN107347129B (en) * 2016-05-05 2020-02-14 中强光电股份有限公司 Light field camera
CN114690431A (en) * 2016-10-04 2022-07-01 麦克赛尔株式会社 Head-up display device
US10634921B2 (en) 2017-06-01 2020-04-28 NewSight Reality, Inc. See-through near eye optical display
CN107608079A (en) * 2017-10-24 2018-01-19 歌尔科技有限公司 Wear display device
JP7374934B2 (en) * 2018-03-05 2023-11-07 ニューサイト リアリティ,インコーポレイテッド See-through near eye optical module
TWI666468B (en) * 2018-03-20 2019-07-21 友達光電股份有限公司 Display
CN110376734B (en) * 2018-04-12 2021-11-19 肥鲨技术 Single-panel head-mounted display
WO2020009819A1 (en) * 2018-07-05 2020-01-09 NewSight Reality, Inc. See-through near eye optical display
KR20200032467A (en) * 2018-09-18 2020-03-26 삼성전자주식회사 Electronic device having optical member for adjusting permeation rate of light and method for operating thereof
CN113168011A (en) * 2018-11-30 2021-07-23 株式会社小糸制作所 Head-up display
US10867538B1 (en) * 2019-03-05 2020-12-15 Facebook Technologies, Llc Systems and methods for transferring an image to an array of emissive sub pixels
CN112119342B (en) * 2019-04-22 2023-08-11 京东方科技集团股份有限公司 Display device
US11579425B1 (en) 2019-08-05 2023-02-14 Meta Platforms Technologies, Llc Narrow-band peripheral see-through pancake lens assembly and display device with same
US11586024B1 (en) 2019-08-05 2023-02-21 Meta Platforms Technologies, Llc Peripheral see-through pancake lens assembly and display device with same
CN112394512A (en) * 2019-08-16 2021-02-23 苏州苏大维格科技集团股份有限公司 Head-mounted display device
US11592608B2 (en) 2019-09-10 2023-02-28 Meta Platforms Technologies, Llc Switchable polarization retarder array for active zonal illumination of display
US11391948B2 (en) 2019-09-10 2022-07-19 Facebook Technologies, Llc Display illumination using a grating
US11726336B2 (en) 2019-09-10 2023-08-15 Meta Platforms Technologies, Llc Active zonal display illumination using a chopped lightguide
US11372247B2 (en) 2019-09-17 2022-06-28 Facebook Technologies, Llc Display device with diffusive display and see-through lens assembly
CN112987295B (en) * 2019-12-17 2023-02-28 京东方科技集团股份有限公司 Near-to-eye display device and virtual/augmented reality apparatus
US11360308B2 (en) 2020-01-22 2022-06-14 Facebook Technologies, Llc Optical assembly with holographic optics for folded optical path
CN112904658B (en) * 2021-03-25 2022-04-12 江西欧迈斯微电子有限公司 Lens assembly, illumination module and projection equipment
CN115917397A (en) * 2021-04-30 2023-04-04 京东方科技集团股份有限公司 Double-grid line array substrate and display panel

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20020034875A (en) * 2000-10-31 2002-05-09 존 비. 메이슨 Microelectrical mechanical structure optical modulator and optical display system
US20120212399A1 (en) * 2010-02-28 2012-08-23 Osterhout Group, Inc. See-through near-eye display glasses wherein image light is transmitted to and reflected from an optically flat film
US20120249537A1 (en) * 2011-03-31 2012-10-04 Bae Jung-Mok Three dimensional image display apparatus
US20140118829A1 (en) * 2012-10-26 2014-05-01 Qualcomm Incorporated See through near-eye display
US20140168783A1 (en) * 2012-07-02 2014-06-19 Nvidia Corporation Near-eye microlens array displays

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0785457A3 (en) * 1996-01-17 1998-10-14 Nippon Telegraph And Telephone Corporation Optical device and three-dimensional display device
WO2001009869A1 (en) * 1999-08-02 2001-02-08 Comoc Corporation Microlens array and display comprising microlens array
US20100328420A1 (en) * 2009-06-29 2010-12-30 Roman Kendyl A Optical adapters for mobile devices with a camera
DE102011007190A1 (en) * 2011-04-12 2012-10-18 Henke-Sass, Wolf Gmbh endoscope
US8508830B1 (en) * 2011-05-13 2013-08-13 Google Inc. Quantum dot near-to-eye display
US20130021226A1 (en) * 2011-07-21 2013-01-24 Jonathan Arnold Bell Wearable display devices
US9494797B2 (en) * 2012-07-02 2016-11-15 Nvidia Corporation Near-eye parallax barrier displays
CN102749717B (en) * 2012-07-27 2017-12-08 深圳超多维光电子有限公司 A kind of autostereoscopic display apparatus
JP6064467B2 (en) * 2012-09-11 2017-01-25 株式会社リコー Light diffusing element and image display device
WO2014053562A1 (en) * 2012-10-04 2014-04-10 Lemoptix Sa An optical assembly
US8773573B1 (en) * 2013-01-15 2014-07-08 Google Inc. Adjustable lens array with variable optical power
KR20150140815A (en) * 2013-05-10 2015-12-16 인텔 코포레이션 A projection device
CN103728678B (en) * 2013-12-26 2015-04-22 京东方科技集团股份有限公司 Cylindrical lens assembly and display device
WO2016064773A1 (en) 2014-10-20 2016-04-28 Intel Corporation Near-eye display system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20020034875A (en) * 2000-10-31 2002-05-09 존 비. 메이슨 Microelectrical mechanical structure optical modulator and optical display system
US20120212399A1 (en) * 2010-02-28 2012-08-23 Osterhout Group, Inc. See-through near-eye display glasses wherein image light is transmitted to and reflected from an optically flat film
US20120249537A1 (en) * 2011-03-31 2012-10-04 Bae Jung-Mok Three dimensional image display apparatus
US20140168783A1 (en) * 2012-07-02 2014-06-19 Nvidia Corporation Near-eye microlens array displays
US20140118829A1 (en) * 2012-10-26 2014-05-01 Qualcomm Incorporated See through near-eye display

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9880325B2 (en) 2013-08-14 2018-01-30 Nvidia Corporation Hybrid optics for near-eye displays
US10642311B2 (en) 2013-08-14 2020-05-05 Nvidia Corporation Hybrid optics for near-eye displays
US10838459B2 (en) 2013-08-14 2020-11-17 Nvidia Corporation Hybrid optics for near-eye displays
US10120194B2 (en) 2016-01-22 2018-11-06 Corning Incorporated Wide field personal display
US10649210B2 (en) 2016-01-22 2020-05-12 Corning Incorporated Wide field personal display
CN106199974A (en) * 2016-09-28 2016-12-07 京东方科技集团股份有限公司 A kind of nearly eye display device
US10976551B2 (en) 2017-08-30 2021-04-13 Corning Incorporated Wide field personal display device
US10379266B2 (en) 2017-09-15 2019-08-13 Sung-Yang Wu Near-eye display device
CN109557666A (en) * 2017-09-27 2019-04-02 蒋晶 Nearly optics of the eye imaging system, nearly eye display device and head-mounted display apparatus
WO2019062480A1 (en) * 2017-09-27 2019-04-04 蒋晶 Near-eye optical imaging system, near-eye display device and head-mounted display device
US11726325B2 (en) 2017-09-27 2023-08-15 Jing Jiang Near-eye optical imaging system, near-eye display device and head-mounted display device
CN110221433A (en) * 2019-04-13 2019-09-10 济南大学 A kind of visual field amplification mirror for virtual reality glasses

Also Published As

Publication number Publication date
US20190219827A1 (en) 2019-07-18
US11307414B2 (en) 2022-04-19
US20170293148A1 (en) 2017-10-12
US10241334B2 (en) 2019-03-26

Similar Documents

Publication Publication Date Title
US11307414B2 (en) Near-eye display system
CN109557666B (en) Near-eye optical imaging system, near-eye display device and head-mounted display device
JP7121116B2 (en) Waveguide-based optical system and method for augmented reality systems
JP7304874B2 (en) Ultra-High Index Eyepiece Substrate-Based Viewing Optics Assembly Architecture
JP7096253B2 (en) Eyepieces for virtual reality, augmented reality, and mixed reality systems
CN107111204B (en) Architecture and method for outputting light of different wavelengths from a waveguide
CA2994231C (en) Multibeam diffraction grating-based near-eye display
US10025093B2 (en) Waveguide-based displays with exit pupil expander
US9733475B1 (en) Curved waveguide combiner for head-mounted and helmet-mounted displays (HMDS), a collimated virtual window, or a head up display (HUD)
CN109791290B (en) Optical system for head-mounted display system
US8189263B1 (en) Image waveguide with mirror arrays
EP3610316B1 (en) Fixed focus image light guide with zoned diffraction gratings
US9442291B1 (en) Segmented diffractive optical elements for a head wearable display
CN107771297A (en) For virtual and augmented reality near-to-eye free form surface type nanostructured surface
CN1664649A (en) Novel optical system of helmet display unit
CN104216120A (en) Semitransparent film array flat-panel waveguide type head-mounted display optical system
WO2018156213A1 (en) Freeform head mounted display
CN111399321B (en) Small-size projection optical assembly and projection optical system suitable for near-eye display
US20170219824A1 (en) Micro-display having non-planar image surface and head-mounted displays including same
EP3887888A1 (en) Exit pupil expansion via curved waveguide
US10261332B1 (en) Eyepiece lens with protected Fresnel and diffractive surfaces
Hillenbrand et al. See-through near to eye displays: challenges and solution paths
CN115755387A (en) Augmented reality display lens and device
GB2591568A (en) Binocular optical display system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15852843

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 15510283

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15852843

Country of ref document: EP

Kind code of ref document: A1