US20210080719A1 - Low-obliquity beam scanner with polarization-selective grating - Google Patents
Low-obliquity beam scanner with polarization-selective grating Download PDFInfo
- Publication number
- US20210080719A1 US20210080719A1 US16/568,897 US201916568897A US2021080719A1 US 20210080719 A1 US20210080719 A1 US 20210080719A1 US 201916568897 A US201916568897 A US 201916568897A US 2021080719 A1 US2021080719 A1 US 2021080719A1
- Authority
- US
- United States
- Prior art keywords
- light beam
- grating
- pvh
- redirecting
- handedness
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000010287 polarization Effects 0.000 title claims abstract description 49
- 239000006185 dispersion Substances 0.000 claims description 30
- 239000004973 liquid crystal related substance Substances 0.000 claims description 22
- 230000003287 optical effect Effects 0.000 claims description 10
- 230000000737 periodic effect Effects 0.000 claims description 8
- 230000000644 propagated effect Effects 0.000 claims description 8
- 230000003098 cholesteric effect Effects 0.000 claims description 4
- 239000004988 Nematic liquid crystal Substances 0.000 claims description 2
- 238000011144 upstream manufacturing Methods 0.000 claims description 2
- 238000000926 separation method Methods 0.000 abstract description 2
- 230000009471 action Effects 0.000 description 15
- 238000012545 processing Methods 0.000 description 15
- 239000012530 fluid Substances 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 5
- 230000003190 augmentative effect Effects 0.000 description 4
- 238000000034 method Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000001419 dependent effect Effects 0.000 description 3
- 210000003128 head Anatomy 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 210000001747 pupil Anatomy 0.000 description 3
- 239000007787 solid Substances 0.000 description 3
- 229920001621 AMOLED Polymers 0.000 description 2
- 230000004075 alteration Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000007654 immersion Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 229920000642 polymer Polymers 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000000087 stabilizing effect Effects 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000002019 doping agent Substances 0.000 description 1
- 208000013057 hereditary mucoepithelial dysplasia Diseases 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 235000012771 pancakes Nutrition 0.000 description 1
- 230000000379 polymerizing effect Effects 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 230000003362 replicative effect Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000000392 somatic effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 239000013585 weight reducing agent Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
- G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
- G02B26/10—Scanning systems
- G02B26/101—Scanning systems with both horizontal and vertical deflecting means, e.g. raster or XY scanners
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/28—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for polarising
- G02B27/283—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for polarising used for beam splitting or combining
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/4205—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having a diffractive optical element [DOE] contributing to image formation, e.g. whereby modulation transfer function MTF or optical aberrations are relevant
- G02B27/4216—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having a diffractive optical element [DOE] contributing to image formation, e.g. whereby modulation transfer function MTF or optical aberrations are relevant correcting geometrical aberrations
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/18—Diffraction gratings
- G02B5/1814—Diffraction gratings structurally combined with one or more further optical elements, e.g. lenses, mirrors, prisms or other diffraction gratings
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/32—Holograms used as optical elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
- G02B2027/0174—Head mounted characterised by optical features holographic
Definitions
- the present disclosure relates to wearable headsets, and in particular to components and modules for wearable visual display headsets.
- Head mounted displays HMD
- helmet mounted displays near-eye displays
- NED near-eye displays
- VR virtual reality
- AR augmented reality
- MR mixed reality
- Such displays are finding applications in diverse fields including entertainment, education, training and biomedical science, to name just a few examples.
- the displayed VR/AR/MR content can be three-dimensional (3D) to enhance the experience and to match virtual objects to real objects observed by the user.
- Eye position and gaze direction, and/or orientation of the user may be tracked in real time, and the displayed imagery may be dynamically adjusted depending on the user's head orientation and gaze direction, to provide a better experience of immersion into a simulated or augmented environment.
- Compact display devices are desired for head-mounted displays. Because a display of HMD/NED is usually worn on the head of a user, a large, bulky, unbalanced, and/or heavy display device would be cumbersome and may be uncomfortable for the user to wear.
- Projector-based displays provide images in angular domain, which can be observed by a user directly, without an intermediate screen or a large display panel.
- a waveguide may be used to carry the image in angular domain to the user's eye.
- the lack of a screen or high numerical aperture collimating optics in a scanning projector display enables size and weight reduction of the display.
- a scanner for a projector display needs to be compact, fast, have a wide scanning range, and preserve the optical quality of the beam being scanned to form an image in angular domain.
- a beam scanner comprising a first redirecting diffraction grating configured to diffract an impinging first light beam to obtain a second light beam having a first handedness of polarization.
- a polarization volume hologram (PVH) grating is disposed and configured to receive and diffract the second light beam by reflective diffraction to obtain a third light beam.
- a chromatic dispersion of the first redirecting diffraction grating is opposite to a chromatic dispersion of the PVH grating.
- a tiltable reflector is disposed and configured to receive and reflect the third light beam at a variable angle back towards the PVH grating. The third light beam reflected by the tiltable reflector has a second handedness of polarization opposite to the first handedness, whereby the third light beam propagates through the PVH grating.
- the PVH grating comprises a liquid crystal layer comprising liquid crystal molecules in a periodic helical configuration.
- the liquid crystal molecules may have spatially varying azimuthal angle at a surface of the liquid crystal layer.
- the periodic helical configuration may be polymer-stabilized.
- the liquid crystal molecules may be nematic liquid crystal molecules in a cholesteric configuration including a plurality of helical periods between top and bottom surfaces of the liquid crystal layer.
- the beam scanner further includes a collimator upstream of the first redirecting diffraction grating.
- the collimator is configured to collimate the first light beam impinging onto the first redirecting diffraction grating.
- the beam scanner may further include a second redirecting diffraction grating configured to diffract an impinging fourth light beam to obtain a fifth light beam having the first handedness of polarization.
- the PVH grating may be disposed and configured to receive and diffract the fifth light beam by reflective diffraction to obtain a sixth light beam, where a chromatic dispersion of the second redirecting diffraction grating is opposite to the chromatic dispersion of the PVH grating.
- the tiltable reflector may be configured to receive and reflect the sixth light beam at a variable angle back towards the PVH grating.
- the sixth light beam reflected by the tiltable reflector has the second handedness of polarization opposite to the first handedness, whereby the sixth light beam propagates through the PVH grating.
- the first and second redirecting diffraction gratings may be disposed side-by-side.
- the tiltable reflector may include a 2D microelectromechanical system (MEMS) tiltable reflector, for example.
- MEMS microelectromechanical system
- a projector comprising a first light source for providing a first light beam.
- a first redirecting diffraction grating is disposed and configured to receive and diffract the first light beam to obtain a second light beam having a first handedness of polarization.
- a PVH grating is disposed and configured to receive and diffract the second light beam by reflective diffraction to obtain a third light beam.
- a chromatic dispersion of the first redirecting diffraction grating is opposite to a chromatic dispersion of the PVH grating.
- a tiltable reflector is disposed and configured to receive and reflect the third light beam at a variable angle back towards the PVH grating. The third light beam reflected by the tiltable reflector has a second handedness of polarization opposite to the first handedness, whereby the third light beam propagates through the PVH grating.
- the PVH grating comprises a liquid crystal layer comprising liquid crystal molecules in a periodic helical configuration.
- the liquid crystal molecules may have spatially varying azimuthal angle at a surface of the liquid crystal layer.
- the projector further includes a collimator in an optical path between the first light source and the first redirecting diffraction grating.
- the collimator is configured to collimate the first light beam impinging onto the first redirecting diffraction grating.
- the first light source may include a plurality of individually controllable emitters optically coupled to the collimator for providing a plurality of collimated sub-beams.
- the first light beam impinging onto the first redirecting diffraction grating comprises the plurality of collimated sub-beams.
- the plurality of individually controllable emitters may include an emitter of a red color channel, an emitter of a green color channel, and an emitter of a blue color channel of an image to be displayed by the projector.
- the projector further includes a second light source for providing a fourth light beam and a second redirecting diffraction grating configured to diffract an impinging fourth light beam to obtain a fifth light beam having the first handedness of polarization.
- the PVH grating may be disposed and configured to receive and diffract the fifth light beam by reflective diffraction to obtain a sixth light beam, wherein a chromatic dispersion of the second redirecting diffraction grating is opposite to the chromatic dispersion of the PVH grating.
- the tiltable reflector may be configured to receive and reflect the sixth light beam at a variable angle back towards the PVH grating.
- the sixth light beam reflected by the tiltable reflector has the second handedness of polarization opposite to the first handedness, whereby the sixth light beam propagates through the PVH grating.
- a near-eye display comprising a first light source for providing a first light beam, a first redirecting diffraction grating disposed and configured to receive and diffract the first light beam to obtain a second light beam having a first handedness of polarization, and a PVH grating disposed and configured to receive and diffract the second light beam by reflective diffraction to obtain a third light beam.
- a chromatic dispersion of the first redirecting diffraction grating is opposite to a chromatic dispersion of the PVH grating.
- the near-eye display further includes a tiltable reflector disposed and configured to receive and reflect the third light beam at a variable angle back towards the PVH grating.
- the third light beam reflected by the tiltable reflector has a second handedness of polarization opposite to the first handedness, whereby the third light beam propagates through the PVH grating.
- a controller isoperably coupled to the first light source and the tiltable reflector. The controller is configured to operate the tiltable reflector to cause the third light beam reflected from the tiltable reflector and propagated through the PVH grating to have a beam angle corresponding to a first pixel of an image to be displayed. The controller is further configured to operate the first light source in coordination with operating the tiltable reflector, such that the third light beam has brightness corresponding to the first pixel.
- the near-eye display further includes a pupil-replicating waveguide disposed proximate the PVH grating and configured to receive and propagate therein the third light beam propagated through the PVH grating.
- the near-eye display further includes a collimator in an optical path between the first light source and the first redirecting diffraction grating.
- the collimator is configured to collimate the first light beam impinging onto the first redirecting diffraction grating.
- the first light source may include a plurality of emitters optically coupled to the collimator for providing a plurality of collimated sub-beams each corresponding to a color channel of the image to be displayed.
- the first light beam impinging onto the first redirecting diffraction grating comprises the plurality of collimated sub-beams.
- the controller is operably coupled to the plurality of emitters and is configured to operate the plurality of emitters in coordination with operating the tiltable reflector, such that the third light beam has luminance and/or color corresponding to the first pixel.
- the near-eye display may further include a second light source for providing a fourth light beam, and a second redirecting diffraction grating configured to diffract an impinging fourth light beam to obtain a fifth light beam having the first handedness of polarization.
- the PVH grating may be disposed and configured to receive and diffract the fifth light beam by reflective diffraction to obtain a sixth light beam, wherein a chromatic dispersion of the second redirecting diffraction grating is opposite to the chromatic dispersion of the PVH grating.
- the tiltable reflector may be configured to receive and reflect the sixth light beam at a variable angle back towards the PVH grating.
- the sixth light beam reflected by the tiltable reflector has the second handedness of polarization opposite to the first handedness, whereby the sixth light beam propagates through the PVH grating.
- the controller may be operably coupled to the second light source and configured to operate the tiltable reflector to cause the sixth light beam reflected from the tiltable reflector and propagated through the PVH grating to have a beam angle corresponding to a second pixel of the image to be displayed.
- the controller may be further configured to operate the second light source in coordination with operating the tiltable reflector, such that the sixth light beam has brightness and/or color corresponding to the second pixel.
- FIG. 1A is a schematic cross-sectional view of a polarization volume hologram (PVH) grating of this disclosure
- FIG. 1B is a schematic diagram illustrating the principle of operation of the PVH grating of FIG. 1A ;
- FIG. 2 is a side cross-sectional view of a near-eye display (NED) of this disclosure including a low-obliquity beam scanner equipped with the PVH grating of FIGS. 1A and 1B ;
- NED near-eye display
- FIGS. 3A, 3B, and 3C are frontal views of multi-emitter light sources usable with the NED of FIG. 2 ;
- FIG. 4 is a side cross-sectional view of an NED of this disclosure including multiple light sources and a low-obliquity beam scanner coupling multiple light beams to a same tiltable reflector;
- FIG. 5A is a graph of aspect ratio of a field of view (FOV) of a scanning projector display as a function of beam obliquity;
- FOV field of view
- FIG. 5B is a schematic view of a FOV at zero obliquity in FIG. 5A ;
- FIG. 5C is a schematic view of a FOV at maximum obliquity in FIG. 5A ;
- FIG. 6 is a plan cross-sectional view of an NED including beam scanners/projectors of this disclosure
- FIG. 7A is an isometric view of a head-mounted display (headset) of this disclosure.
- FIG. 7B is a block diagram of a virtual reality system including the headset of FIG. 7A .
- a tiltable reflector may be used to scan a light beam emitted by a light source to form an image in angular domain for direct observation by a user.
- the brightness and/or color of the scanned light beam may be varied in coordination with the scanning, in accordance with pixels of the displayed image being pointed at by the scanner.
- the entire image is formed by a display when the light beam is scanned in two dimensions, e.g. over X- and Y-viewing angles, over the entire frame or field of view (FOV) of the display.
- FOV field of view
- FOV field of view
- the oblique angle may be required by the optical geometry used, e.g. to physically separate an impinging light beam from the scanned, i.e. reflected, light beam.
- the FOV reduction is caused by distortion of the solid angle representing the range of scanning at oblique angles of incidence of light beam at the tiltable reflector.
- the output (scanned) light beam may be spatially separated from the input optical beam by polarization. This obviates the need in geometrical separation of the beams by oblique angles of incidence, resulting in a compact configuration providing a nearly straight angle of incidence at the tiltable reflector when the latter is in a center (non-tilted) angular position. Low obliquity of the impinging light beam enables the scanning range to be utilized more efficiently.
- a polarization volume hologram (PVH) grating 100 includes an LC layer 104 bound by opposed top 105 and bottom 106 parallel surfaces.
- the LC layer 104 may include an LC fluid containing rod-like LC molecules 107 with positive dielectric anisotropy, e.g. nematic LC molecules.
- a chiral dopant may be added to the LC fluid, causing the LC molecules in the LC fluid to self-organize into a periodic helical configuration including helical structures 108 extending between the top 105 and bottom 106 parallel surfaces of the LC layer 104 .
- Such a configuration of the LC molecules 107 termed herein a cholesteric configuration, includes a plurality of helical periods p, e.g. at least two, at least five, at least ten, at least twenty, or at least fifty helical periods p between the top 105 and bottom 106 parallel surfaces of the LC layer 104 .
- Boundary LC molecules 107 b at the top surface 105 of the LC layer 104 may be oriented at an angle to the top surface 105 .
- the boundary LC molecules 107 b may have a spatially varying azimuthal angle, e.g. linearly varying along X-axis parallel to the top surface 105 , as shown in FIG. 1A .
- an alignment layer 112 may be provided at the top surface 105 of the LC layer 104 .
- the alignment layer 112 may be configured to provide the desired orientation pattern of the boundary LC molecules 107 b , such as the linear dependence of the azimuthal angle on the X-coordinate.
- a pattern of spatially varying polarization directions of the UV light may be selected to match a desired orientation pattern of the boundary LC molecules 107 a at the top surface 105 and/or the bottom surface 106 of the LC layer 104 .
- the boundary LC molecules 107 a are oriented along the photopolymerized chains of the alignment layer 112 , thus adopting the desired surface orientation pattern.
- Adjacent LC molecules adopt helical patterns extending from the top 105 to the bottom 106 surfaces of the LC layer 104 , as shown.
- the boundary LC molecules 107 b define relative phases of the helical structures 108 having the helical period p.
- the helical structures 108 form a volume grating comprising helical fringes 114 tilted at an angle ⁇ , as shown in FIG. 1A .
- the steepness of the tilt angle ⁇ depends on the rate of variation of the azimuthal angle of the boundary LC molecules 107 b at the top surface 105 and p.
- the tilt angle ⁇ is determined by the surface alignment pattern of the boundary LC molecules 107 A at the alignment layer 112 .
- the volume grating has a period ⁇ x along X-axis and ⁇ y along Y-axis.
- the periodic helical structures 108 of the LC molecules 107 may be polymer-stabilized by mixing in a stabilizing polymer into the LC fluid, and curing (polymerizing) the stabilizing polymer.
- the helical nature of the fringes 114 of the volume grating makes the PVH grating 100 preferably responsive to light of polarization having one particular handedness, e.g. left- or right-circular polarization, while being substantially non-responsive to light of the opposite handedness of polarization.
- the helical fringes 114 make the PVH grating 100 polarization-selective.
- FIG. 1B shows a light beam 120 impinging onto the PVH grating 100 .
- the light beam 120 includes a left circular polarized (LCP) beam component 121 and a right circular polarized (RCP) beam component 122 .
- LCP left circular polarized
- RCP right circular polarized
- the LCP beam component 121 propagates through the PVH grating 100 substantially without diffraction.
- substantially without diffraction means that, even though an insignificant portion of the beam (the LCP beam component 121 in this case) might diffract, the portion of the diffracted light energy is so small that it does not impact the intended performance of the PVH grating 100 .
- the RCP beam component 122 of the light beam 120 undergoes diffraction, producing a diffracted beam 122 ′.
- the polarization selectivity of the PVH grating 100 results from the effective refractive index of the grating being dependent on the relationship between the handedness, or chirality, of the impinging light beam and the handedness, or chirality, of the grating fringes 114 . It is further noted that the sensitivity of the PVH 100 to right circular polarized light in particular is only meant as an illustrative example. When handedness of the helical fringes 114 is reversed, the PVH 100 may be made sensitive to left circular polarized light.
- a near-eye display (NED) 200 includes a projector 202 optically coupled to a pupil-replicating waveguide 204 .
- the projector 202 includes a light source 206 for providing image light 208 of controllable brightness and/or color(s), and a beam scanner 210 for receiving scanning the image light 208 across an input grating 212 of the pupil-replicating waveguide 204 .
- An optional collimator 214 may be disposed in an optical path between the light source 208 and the beam scanner 210 , for collimating the image light 208 to obtain a first light beam 221 .
- the light source may provide polarized light of a pre-defined handedness, e.g. LCP or RCP light.
- a polarizer e.g. a circular polarizer, may be provided for this purpose.
- the beam scanner 210 includes a first redirecting diffraction grating 216 configured to diffract the impinging first light beam 221 to obtain a second light beam 222 , which is right circular polarized.
- the first redirecting diffraction grating 216 may, but does not have to be, a PVH grating.
- the PVH grating 100 is disposed in a path of the second light beam 222 and configured to receive and diffract the second light beam 222 by reflective diffraction to obtain a third light beam 223 .
- a chromatic dispersion of the first redirecting diffraction 216 grating is selected to be opposite to a chromatic dispersion of the PVH grating 100 , e.g.
- the chromatic dispersion may have the same amplitude but opposite sign.
- the chromatic dispersions of the first redirecting diffraction 216 and the PVH grating 100 at least partially offset each other or even completely cancel each other, and therefore, when the image light 208 includes light at multiple wavelengths, the reflected third light beam 223 will not be wavelength dispersed, i.e. the beam angle of the reflected third light beam 223 will not be dependent on wavelength.
- a tiltable reflector 218 e.g. a 2D microelectromechanical system (MEMS) tiltable reflector, is disposed in an optical path of the third light beam 223 , e.g. under the PVH grating 100 , and configured to receive and reflect the third light beam 223 at a variable angle back towards the PVH grating 100 .
- the third light beam 223 reflected by the tiltable reflector 218 changes the handedness of polarization upon reflection. This happens because the direction of propagation of the reflected third light beam 223 changes, while the phase relationship between x- and y-component of the light field of the third light beam 223 impinging onto the tiltable reflector 218 remains substantially the same.
- MEMS microelectromechanical system
- the handedness of the circular polarization is determined with the account of direction of propagation, the handedness of the reflected third light beam 223 changes as well.
- the third light beam 223 changes handedness of its polarization to an opposite handedness and, as a result, propagates through the PVH grating 100 substantially without diffraction.
- the third light beam 223 impinges onto the input grating 212 of the pupil-replicating waveguide 204 disposed over the PVH 100 at a location and angle depending on angle of tilt of the tiltable reflector 218 .
- the tiltable reflector 218 when the tiltable reflector 218 is in a left position 218 A, the third light beam 223 impinges into the input grating 212 at a first location and angle 220 A; and when the tiltable reflector 218 is in a right position 218 B, the third light beam 223 impinges into the input grating 212 at a second location and angle 220 B.
- the tiltable reflector 218 may oscillate between the left position 218 A and the right position 218 B.
- the tiltable reflector 218 may tilt/scan about two axes, i.e. about X and Y axes.
- an image in angular domain may be formed.
- the scanned third light beam 223 is in-coupled by the input grating 212 to propagate within the pupil-replicating waveguide 204 .
- the pupil-replicating waveguide 204 out-couples multiple laterally offset copies of the third light beam 223 while preserving the beam angle, thus replicating the image in the angular domain over an output area of the pupil-replicating waveguide 204 for direct observation by a user's eye, not shown.
- the light source 206 may include a plurality of individually controllable emitters, such as superluminescent light-emitting diodes (SLEDs), for example.
- SLEDs superluminescent light-emitting diodes
- Several emitters may be provided for each color channel.
- four red emitters 300 R may be provided for red (R) color channel (dark-shaded circles);
- four green emitters 300 G may be provided for green (G) color channel (medium-shaded circles);
- four blue emitters 300 B may be provided for blue (B) color channel (light-shaded circles).
- the emitters 300 R, 300 G, and 300 B may each be ridge emitters sharing a common semiconductor substrate.
- the emitters 300 R, 300 G, and 300 B may be disposed in a line pattern ( FIG. 3A ); in a zigzag pattern ( FIG. 3B ); or in a honeycomb pattern ( FIG. 3C ), to name just a few examples.
- the first light beam 221 impinging onto the first redirecting diffraction grating 216 includes the plurality of sub-beams collimated together by the collimator 214 and co-propagating at a slight angle w.r.t each other.
- Maximum angular cone of the sub-beams may be less than 5 degrees, or less than 2 degrees, or less than 1 degree in some embodiments.
- Multiple emitters and, in some cases, multiple light sources may be used to provide redundancy in case some of light sources fail, increase image resolution, increase overall image brightness, etc. Multiple light sources may each be equipped with its own collimator.
- an NED 400 of FIG. 4 is similar to the NED 200 of FIG. 2 , and includes similar elements.
- the NED 400 includes first 406 and second 408 light sources, e.g. those depicted in FIGS. 3A, 3B, and 3C , producing the first light beam 221 and a fourth light beam 224 , respectively.
- a beam scanner 410 of the NED 400 of FIG. 4 further includes a second redirecting diffraction grating 416 configured to diffract an impinging fourth light beam 224 provided by the second light source 408 .
- the diffracted fourth light beam 224 forms a fifth light beam 225 , which has the same handedness of polarization as the second light beam 222 , i.e. RCP in this example.
- the PVH grating 100 is disposed and configured to receive and diffract the fifth light beam 225 by reflective diffraction, to obtain a sixth light beam 226 .
- the first 216 and second 416 redirecting diffraction gratings may be disposed side-by-side and parallel to the PVH grating 100 , as shown.
- a small gap e.g. 0.5 mm-3 mm gap, may be provided to avoid image light propagating in the pupil-replicating waveguide 204 from entering the PVH 100 . This results in a compact configuration, and leaves room for the two light sources 406 and 408 to be disposed side-by-side.
- the chromatic dispersion of the second redirecting diffraction grating 416 may be selected to be opposite to the chromatic dispersion of the PVH grating 100 , such that the sixth light beam 226 is substantially not wavelength-dispersed, i.e. individual wavelengths sub-beams of the sixth light beam 226 all propagate substantially parallel to one another.
- the tiltable reflector 218 is configured to receive and reflect the sixth light beam 226 at a variable angle back towards the PVH grating 100 .
- the sixth light beam 226 reflected by the tiltable reflector 218 has the second handedness of polarization opposite to the first handedness, whereby the sixth light beam 226 propagates through the PVH grating 100 and impinges onto the input grating 212 of the pupil-replicating waveguide 204 .
- the angles of incidence of the third 223 and sixth 226 light beams may be selected to be different.
- Such a configuration enables different areas of a field of view (FOV) of the NED 400 to be powered by different light sources. This enables one to broaden the overall FOV of the NED 400 without expanding the scanning range of the tiltable reflector 218 .
- FOV field of view
- the FOV portions corresponding to different light sources may overlap at a central area of the FOV, which may provide means for increasing spatial resolution of the NED 400 in the central FOV area.
- the PVH grating 100 may include a plurality of PVH sub-gratings optimized for individual color channels.
- the NEDs 200 of FIG. 2 and 400 of FIG. 4 provide a low-obliquity coupling of light beam(s) to a tiltable reflector.
- the term “low obliquity” means a low angle of incidence, i.e. a normal incidence, at the tiltable reflector when in a nominal, e.g. a center or zero, angle of tilt.
- FIGS. 5A to 5C One advantage of having low obliquity is illustrated in FIGS. 5A to 5C . Referring first to FIG. 5A , an aspect ratio of a FOV of a projector using a tiltable reflector is plotted as a function of obliquity, i.e. angle of incidence at the tiltable reflector when in nominal or center position.
- the aspect ration is plotted for four cases: 75 degrees by 50 degrees on-axis FOV; 60 degrees by 40 degrees on-axis FOV; 45 degrees by 30 degrees on-axis FOV; and 30 degrees by 20 degrees on-axis FOV.
- the aspect ratio drops from 1.5 at zero obliquity, i.e. normal incidence, to about 1.1 at 40 degrees obliquity angle.
- FIG. 5B shows a zero-obliquity scanning angular area 500 B and an associated inscribed rectangular zero-obliquity FOV 502 B.
- the zero-obliquity FOV 502 B solid angle is covering most of the zero-obliquity scanning angular area 500 B.
- FIG. 5C shows a 40 degrees obliquity scanning angular area 500 C and an associated inscribed rectangular oblique FOV 502 C.
- the oblique FOV 502 C solid angle occupies a smaller percentage of the 40 degrees obliquity scanning angular area 500 C, and is almost 2 times less than the zero-obliquity FOV 502 B.
- the low-obliquity coupling improves the utilization of the scanning range of a tiltable reflector, enabling wider fields of view at the same scanning range of the tiltable reflector.
- a near-eye display (NED) 600 includes a frame 601 having a form factor of a pair of eyeglasses.
- the frame 601 may support, for each eye: a projector 602 for providing display light carrying an image in angular domain, an electronic driver 604 operably coupled to the projector 602 for powering the projector 602 , and a pupil replicator 632 optically coupled to the projector 602 .
- Each projector 602 may include beam scanners and light sources described herein, for example and without limitation the beam scanner 210 of FIG. 2 , or the beam scanner 410 of FIG. 4 .
- Light sources for these projectors may include a substrate supporting an array of single-mode or multimode semiconductor light sources.
- the light sources 206 ( FIG. 2 ) and 406 and 408 ( FIG. 4 ) may include side-emitting laser diodes, vertical-cavity surface-emitting laser diodes, SLEDs, or light-emitting diodes, for providing a plurality of light beams as described above with reference to FIGS. 3A, 3B, and 3C .
- Collimators for the light sources may include concave mirrors, bulk lenses, Fresnel lenses, holographic lenses, pancake lenses, etc.
- the pupil replicators 632 may include waveguides equipped with a plurality of surface relief and/or volume holographic gratings. The function of the pupil replicators 632 is to provide multiple laterally offset copies of the display light beams provided by the projectors 602 at respective eyeboxes 612 .
- a controller 605 is operably coupled to the light sources and tiltable reflectors of the projectors 602 .
- the controller 605 may be configured to determine the X- and Y-tilt angles of the tiltable reflectors of the projectors 602 .
- the controller 605 determines which pixel or pixels of the image to be displayed correspond to the determined X- and Y-tilt angles. Then, the controller 605 determines the brightness and/or color of these pixels, and operates the electronic drivers 604 accordingly for providing powering electric pulses to the light sources of the projectors 602 to produce light pulses at power level(s) corresponding to the determined pixel brightness and color.
- the controller 605 may be configured to operate, for each eye, the tiltable reflector 218 to cause the light beam reflected from the tiltable reflector 218 and propagated through the respective PVH grating 100 to have a beam angle corresponding to a pixel of an image to be displayed.
- the controller 605 may be further configured to operate the corresponding light source in coordination with operating the tiltable reflector 218 , such that the light beam has brightness and/or color(s) corresponding to the pixel being displayed.
- the controller 605 may be configured to operate the corresponding light sources in coordination, to provide a larger FOV, an improved scanning resolution, increased brightness of the display, etc., as described herein.
- the controller 605 may be configured to operate the tiltable reflector 218 to cause two light beams reflected from the tiltable reflector and propagated through the PVH grating to have beam angle corresponding to respective two pixels of an image to be displayed, and operate the light sources in coordination with operating the tiltable reflector 218 , such that the two light beam have brightness and/or color corresponding to the two respective pixels. More light sources than two may be provided, each light source including one or a plurality of emitters, for one or a plurality of color channels of the image being displayed.
- Embodiments of the present disclosure may include, or be implemented in conjunction with, an artificial reality system.
- An artificial reality system adjusts sensory information about outside world obtained through the senses such as visual information, audio, touch (somatosensation) information, acceleration, balance, etc., in some manner before presentation to a user.
- artificial reality may include virtual reality (VR), augmented reality (AR), mixed reality (MR), hybrid reality, or some combination and/or derivatives thereof.
- Artificial reality content may include entirely generated content or generated content combined with captured (e.g., real-world) content.
- the artificial reality content may include video, audio, somatic or haptic feedback, or some combination thereof.
- artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, for example, create content in artificial reality and/or are otherwise used in (e.g., perform activities in) artificial reality.
- the artificial reality system that provides the artificial reality content may be implemented on various platforms, including a wearable display such as an HMD connected to a host computer system, a standalone HMD, a near-eye display having a form factor of eyeglasses, a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.
- an HMD 700 is an example of an AR/VR wearable display system which encloses the user's face, for a greater degree of immersion into the AR/VR environment.
- the HMD 700 is an embodiment of the NED 200 of FIG. 2 or the NED 400 of FIG. 4 , for example.
- the function of the HMD 700 is to augment views of a physical, real-world environment with computer-generated imagery, and/or to generate the entirely virtual 3D imagery.
- the HMD 700 may include a front body 702 and a band 704 .
- the front body 702 is configured for placement in front of eyes of a user in a reliable and comfortable manner, and the band 704 may be stretched to secure the front body 702 on the user's head.
- a display system 780 may be disposed in the front body 702 for presenting AR/VR imagery to the user. Sides 706 of the front body 702 may be opaque or transparent.
- the front body 702 includes locators 708 and an inertial measurement unit (IMU) 710 for tracking acceleration of the HMD 700 , and position sensors 712 for tracking position of the HMD 700 .
- the IMU 710 is an electronic device that generates data indicating a position of the HMD 700 based on measurement signals received from one or more of position sensors 712 , which generate one or more measurement signals in response to motion of the HMD 700 .
- position sensors 712 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of the IMU 710 , or some combination thereof.
- the position sensors 712 may be located external to the IMU 710 , internal to the IMU 710 , or some combination thereof.
- the locators 708 are traced by an external imaging device of a virtual reality system, such that the virtual reality system can track the location and orientation of the entire HMD 700 .
- Information generated by the IMU 710 and the position sensors 712 may be compared with the position and orientation obtained by tracking the locators 708 , for improved tracking accuracy of position and orientation of the HMD 700 .
- Accurate position and orientation is important for presenting appropriate virtual scenery to the user as the latter moves and turns in 3D space.
- the HMD 700 may further include a depth camera assembly (DCA) 711 , which captures data describing depth information of a local area surrounding some or all of the HMD 700 .
- the DCA 711 may include a laser radar (LIDAR), or a similar device.
- LIDAR laser radar
- the depth information may be compared with the information from the IMU 710 , for better accuracy of determination of position and orientation of the HMD 700 in 3D space.
- the HMD 700 may further include an eye tracking system 714 for determining orientation and position of user's eyes in real time.
- the obtained position and orientation of the eyes also allows the HMD 700 to determine the gaze direction of the user and to adjust the image generated by the display system 780 accordingly.
- the vergence that is, the convergence angle of the user's eyes gaze
- the determined gaze direction and vergence angle may also be used for real-time compensation of visual artifacts dependent on the angle of view and eye position.
- the determined vergence and gaze angles may be used for interaction with the user, highlighting objects, bringing objects to the foreground, creating additional objects or pointers, etc.
- An audio system may also be provided including e.g. a set of small speakers built into the front body 702 .
- an AR/VR system 750 includes the HMD 700 of FIG. 7A , an external console 790 storing various AR/VR applications, setup and calibration procedures, 3D videos, etc., and an input/output (I/O) interface 715 for operating the console 790 and/or interacting with the AR/VR environment.
- the HMD 700 may be “tethered” to the console 790 with a physical cable, or connected to the console 790 via a wireless communication link such as Bluetooth®, Wi-Fi, etc.
- There may be multiple HMDs 700 each having an associated I/O interface 715 , with each HMD 700 and I/O interface(s) 715 communicating with the console 790 .
- FIGS. 7A and 7B functionality described in conjunction with one or more of the components shown in FIGS. 7A and 7B may be distributed among the components in a different manner than described in conjunction with FIGS. 7A and 7B in some embodiments.
- some or all of the functionality of the console 715 may be provided by the HMD 700 , and vice versa.
- the HMD 700 may be provided with a processing module capable of achieving such functionality.
- the HMD 700 may include the eye tracking system 714 ( FIG. 7B ) for tracking eye position and orientation, determining gaze angle and convergence angle, etc., the IMU 710 for determining position and orientation of the HMD 700 in 3D space, the DCA 711 for capturing the outside environment, the position sensor 712 for independently determining the position of the HMD 700 , and the display system 780 for displaying AR/VR content to the user.
- the display system 780 includes ( FIG.
- the display system 780 further includes an optics block 730 , whose function is to convey the images generated by the electronic display 725 to the user's eye.
- the optics block may include various lenses, e.g.
- the display system 780 may further include a varifocal module 735 , which may be a part of the optics block 730 .
- the function of the varifocal module 735 is to adjust the focus of the optics block 730 e.g. to compensate for vergence-accommodation conflict, to correct for vision defects of a particular user, to offset aberrations of the optics block 730 , etc.
- the I/O interface 715 is a device that allows a user to send action requests and receive responses from the console 790 .
- An action request is a request to perform a particular action.
- an action request may be an instruction to start or end capture of image or video data or an instruction to perform a particular action within an application.
- the I/O interface 715 may include one or more input devices, such as a keyboard, a mouse, a game controller, or any other suitable device for receiving action requests and communicating the action requests to the console 790 .
- An action request received by the I/O interface 715 is communicated to the console 790 , which performs an action corresponding to the action request.
- the I/O interface 715 includes an IMU that captures calibration data indicating an estimated position of the I/O interface 715 relative to an initial position of the I/O interface 715 .
- the I/O interface 715 may provide haptic feedback to the user in accordance with instructions received from the console 790 . For example, haptic feedback can be provided when an action request is received, or the console 790 communicates instructions to the I/O interface 715 causing the I/O interface 715 to generate haptic feedback when the console 790 performs an action.
- the console 790 may provide content to the HMD 700 for processing in accordance with information received from one or more of: the IMU 710 , the DCA 711 , the eye tracking system 714 , and the I/O interface 715 .
- the console 790 includes an application store 755 , a tracking module 760 , and a processing module 765 .
- Some embodiments of the console 790 may have different modules or components than those described in conjunction with FIG. 7B .
- the functions further described below may be distributed among components of the console 790 in a different manner than described in conjunction with FIGS. 7A and 7B .
- the application store 755 may store one or more applications for execution by the console 790 .
- An application is a group of instructions that, when executed by a processor, generates content for presentation to the user. Content generated by an application may be in response to inputs received from the user via movement of the HMD 700 or the I/O interface 715 . Examples of applications include: gaming applications, presentation and conferencing applications, video playback applications, or other suitable applications.
- the tracking module 760 may calibrate the AR/VR system 750 using one or more calibration parameters and may adjust one or more calibration parameters to reduce error in determination of the position of the HMD 700 or the I/O interface 715 . Calibration performed by the tracking module 760 also accounts for information received from the IMU 710 in the HMD 700 and/or an IMU included in the I/O interface 715 , if any. Additionally, if tracking of the HMD 700 is lost, the tracking module 760 may re-calibrate some or all of the AR/VR system 750 .
- the tracking module 760 may track movements of the HMD 700 or of the I/O interface 715 , the IMU 710 , or some combination thereof. For example, the tracking module 760 may determine a position of a reference point of the HMD 700 in a mapping of a local area based on information from the HMD 700 . The tracking module 760 may also determine positions of the reference point of the HMD 700 or a reference point of the I/O interface 715 using data indicating a position of the HMD 700 from the IMU 710 or using data indicating a position of the I/O interface 715 from an IMU included in the I/O interface 715 , respectively.
- the tracking module 760 may use portions of data indicating a position or the HMD 700 from the IMU 710 as well as representations of the local area from the DCA 711 to predict a future location of the HMD 700 .
- the tracking module 760 provides the estimated or predicted future position of the HMD 700 or the I/O interface 715 to the processing module 765 .
- the processing module 765 may generate a 3D mapping of the area surrounding some or all of the HMD 700 (“local area”) based on information received from the HMD 700 . In some embodiments, the processing module 765 determines depth information for the 3D mapping of the local area based on information received from the DCA 711 that is relevant for techniques used in computing depth. In various embodiments, the processing module 765 may use the depth information to update a model of the local area and generate content based in part on the updated model.
- the processing module 765 executes applications within the AR/VR system 750 and receives position information, acceleration information, velocity information, predicted future positions, or some combination thereof, of the HMD 700 from the tracking module 760 . Based on the received information, the processing module 765 determines content to provide to the HMD 700 for presentation to the user. For example, if the received information indicates that the user has looked to the left, the processing module 765 generates content for the HMD 700 that mirrors the user's movement in a virtual environment or in an environment augmenting the local area with additional content. Additionally, the processing module 765 performs an action within an application executing on the console 790 in response to an action request received from the I/O interface 715 and provides feedback to the user that the action was performed. The provided feedback may be visual or audible feedback via the HMD 700 or haptic feedback via the I/O interface 715 .
- the processing module 765 determines resolution of the content provided to the HMD 700 for presentation to the user on the electronic display 725 .
- the processing module 765 may provide the content to the HMD 700 having a maximum pixel resolution on the electronic display 725 in a foveal region of the user's gaze.
- the processing module 765 may provide a lower pixel resolution in other regions of the electronic display 725 , thus lessening power consumption of the AR/VR system 750 and saving computing resources of the console 790 without compromising a visual experience of the user.
- the processing module 765 can further use the eye tracking information to adjust where objects are displayed on the electronic display 725 to prevent vergence-accommodation conflict and/or to offset optical distortions and aberrations.
- DSP digital signal processor
- ASIC application specific integrated circuit
- FPGA field programmable gate array
- a general-purpose processor may be a microprocessor, but, in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine.
- a processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Alternatively, some steps or methods may be performed by circuitry that is specific to a given function.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Geometry (AREA)
Abstract
Description
- The present disclosure relates to wearable headsets, and in particular to components and modules for wearable visual display headsets.
- Head mounted displays (HMD), helmet mounted displays, near-eye displays (NED), and the like are being used increasingly for displaying virtual reality (VR) content, augmented reality (AR) content, mixed reality (MR) content, etc. Such displays are finding applications in diverse fields including entertainment, education, training and biomedical science, to name just a few examples. The displayed VR/AR/MR content can be three-dimensional (3D) to enhance the experience and to match virtual objects to real objects observed by the user. Eye position and gaze direction, and/or orientation of the user may be tracked in real time, and the displayed imagery may be dynamically adjusted depending on the user's head orientation and gaze direction, to provide a better experience of immersion into a simulated or augmented environment.
- Compact display devices are desired for head-mounted displays. Because a display of HMD/NED is usually worn on the head of a user, a large, bulky, unbalanced, and/or heavy display device would be cumbersome and may be uncomfortable for the user to wear.
- Projector-based displays provide images in angular domain, which can be observed by a user directly, without an intermediate screen or a large display panel. A waveguide may be used to carry the image in angular domain to the user's eye. The lack of a screen or high numerical aperture collimating optics in a scanning projector display enables size and weight reduction of the display. A scanner for a projector display needs to be compact, fast, have a wide scanning range, and preserve the optical quality of the beam being scanned to form an image in angular domain.
- In accordance with the present disclosure, there is provided a beam scanner comprising a first redirecting diffraction grating configured to diffract an impinging first light beam to obtain a second light beam having a first handedness of polarization. A polarization volume hologram (PVH) grating is disposed and configured to receive and diffract the second light beam by reflective diffraction to obtain a third light beam. A chromatic dispersion of the first redirecting diffraction grating is opposite to a chromatic dispersion of the PVH grating. A tiltable reflector is disposed and configured to receive and reflect the third light beam at a variable angle back towards the PVH grating. The third light beam reflected by the tiltable reflector has a second handedness of polarization opposite to the first handedness, whereby the third light beam propagates through the PVH grating.
- In some embodiments, the PVH grating comprises a liquid crystal layer comprising liquid crystal molecules in a periodic helical configuration. The liquid crystal molecules may have spatially varying azimuthal angle at a surface of the liquid crystal layer. The periodic helical configuration may be polymer-stabilized. The liquid crystal molecules may be nematic liquid crystal molecules in a cholesteric configuration including a plurality of helical periods between top and bottom surfaces of the liquid crystal layer.
- In some embodiments, the beam scanner further includes a collimator upstream of the first redirecting diffraction grating. The collimator is configured to collimate the first light beam impinging onto the first redirecting diffraction grating. The beam scanner may further include a second redirecting diffraction grating configured to diffract an impinging fourth light beam to obtain a fifth light beam having the first handedness of polarization. The PVH grating may be disposed and configured to receive and diffract the fifth light beam by reflective diffraction to obtain a sixth light beam, where a chromatic dispersion of the second redirecting diffraction grating is opposite to the chromatic dispersion of the PVH grating. The tiltable reflector may be configured to receive and reflect the sixth light beam at a variable angle back towards the PVH grating. The sixth light beam reflected by the tiltable reflector has the second handedness of polarization opposite to the first handedness, whereby the sixth light beam propagates through the PVH grating. The first and second redirecting diffraction gratings may be disposed side-by-side. The tiltable reflector may include a 2D microelectromechanical system (MEMS) tiltable reflector, for example.
- In accordance with the present disclosure, there is provided a projector comprising a first light source for providing a first light beam. A first redirecting diffraction grating is disposed and configured to receive and diffract the first light beam to obtain a second light beam having a first handedness of polarization. A PVH grating is disposed and configured to receive and diffract the second light beam by reflective diffraction to obtain a third light beam. A chromatic dispersion of the first redirecting diffraction grating is opposite to a chromatic dispersion of the PVH grating. A tiltable reflector is disposed and configured to receive and reflect the third light beam at a variable angle back towards the PVH grating. The third light beam reflected by the tiltable reflector has a second handedness of polarization opposite to the first handedness, whereby the third light beam propagates through the PVH grating.
- In some embodiments, the PVH grating comprises a liquid crystal layer comprising liquid crystal molecules in a periodic helical configuration. The liquid crystal molecules may have spatially varying azimuthal angle at a surface of the liquid crystal layer.
- In some embodiments, the projector further includes a collimator in an optical path between the first light source and the first redirecting diffraction grating. The collimator is configured to collimate the first light beam impinging onto the first redirecting diffraction grating. The first light source may include a plurality of individually controllable emitters optically coupled to the collimator for providing a plurality of collimated sub-beams. The first light beam impinging onto the first redirecting diffraction grating comprises the plurality of collimated sub-beams. The plurality of individually controllable emitters may include an emitter of a red color channel, an emitter of a green color channel, and an emitter of a blue color channel of an image to be displayed by the projector.
- In some embodiments, the projector further includes a second light source for providing a fourth light beam and a second redirecting diffraction grating configured to diffract an impinging fourth light beam to obtain a fifth light beam having the first handedness of polarization. The PVH grating may be disposed and configured to receive and diffract the fifth light beam by reflective diffraction to obtain a sixth light beam, wherein a chromatic dispersion of the second redirecting diffraction grating is opposite to the chromatic dispersion of the PVH grating. The tiltable reflector may be configured to receive and reflect the sixth light beam at a variable angle back towards the PVH grating. The sixth light beam reflected by the tiltable reflector has the second handedness of polarization opposite to the first handedness, whereby the sixth light beam propagates through the PVH grating.
- In accordance with the present disclosure, there is further provided a near-eye display comprising a first light source for providing a first light beam, a first redirecting diffraction grating disposed and configured to receive and diffract the first light beam to obtain a second light beam having a first handedness of polarization, and a PVH grating disposed and configured to receive and diffract the second light beam by reflective diffraction to obtain a third light beam. A chromatic dispersion of the first redirecting diffraction grating is opposite to a chromatic dispersion of the PVH grating. The near-eye display further includes a tiltable reflector disposed and configured to receive and reflect the third light beam at a variable angle back towards the PVH grating. The third light beam reflected by the tiltable reflector has a second handedness of polarization opposite to the first handedness, whereby the third light beam propagates through the PVH grating. A controller isoperably coupled to the first light source and the tiltable reflector. The controller is configured to operate the tiltable reflector to cause the third light beam reflected from the tiltable reflector and propagated through the PVH grating to have a beam angle corresponding to a first pixel of an image to be displayed. The controller is further configured to operate the first light source in coordination with operating the tiltable reflector, such that the third light beam has brightness corresponding to the first pixel. In some embodiments, the near-eye display further includes a pupil-replicating waveguide disposed proximate the PVH grating and configured to receive and propagate therein the third light beam propagated through the PVH grating.
- In some embodiments, the near-eye display further includes a collimator in an optical path between the first light source and the first redirecting diffraction grating. The collimator is configured to collimate the first light beam impinging onto the first redirecting diffraction grating. The first light source may include a plurality of emitters optically coupled to the collimator for providing a plurality of collimated sub-beams each corresponding to a color channel of the image to be displayed. The first light beam impinging onto the first redirecting diffraction grating comprises the plurality of collimated sub-beams. The controller is operably coupled to the plurality of emitters and is configured to operate the plurality of emitters in coordination with operating the tiltable reflector, such that the third light beam has luminance and/or color corresponding to the first pixel.
- The near-eye display may further include a second light source for providing a fourth light beam, and a second redirecting diffraction grating configured to diffract an impinging fourth light beam to obtain a fifth light beam having the first handedness of polarization. The PVH grating may be disposed and configured to receive and diffract the fifth light beam by reflective diffraction to obtain a sixth light beam, wherein a chromatic dispersion of the second redirecting diffraction grating is opposite to the chromatic dispersion of the PVH grating. The tiltable reflector may be configured to receive and reflect the sixth light beam at a variable angle back towards the PVH grating. The sixth light beam reflected by the tiltable reflector has the second handedness of polarization opposite to the first handedness, whereby the sixth light beam propagates through the PVH grating. The controller may be operably coupled to the second light source and configured to operate the tiltable reflector to cause the sixth light beam reflected from the tiltable reflector and propagated through the PVH grating to have a beam angle corresponding to a second pixel of the image to be displayed. The controller may be further configured to operate the second light source in coordination with operating the tiltable reflector, such that the sixth light beam has brightness and/or color corresponding to the second pixel.
- Exemplary embodiments will now be described in conjunction with the drawings, in which:
-
FIG. 1A is a schematic cross-sectional view of a polarization volume hologram (PVH) grating of this disclosure; -
FIG. 1B is a schematic diagram illustrating the principle of operation of the PVH grating ofFIG. 1A ; -
FIG. 2 is a side cross-sectional view of a near-eye display (NED) of this disclosure including a low-obliquity beam scanner equipped with the PVH grating ofFIGS. 1A and 1B ; -
FIGS. 3A, 3B, and 3C are frontal views of multi-emitter light sources usable with the NED ofFIG. 2 ; -
FIG. 4 is a side cross-sectional view of an NED of this disclosure including multiple light sources and a low-obliquity beam scanner coupling multiple light beams to a same tiltable reflector; -
FIG. 5A is a graph of aspect ratio of a field of view (FOV) of a scanning projector display as a function of beam obliquity; -
FIG. 5B is a schematic view of a FOV at zero obliquity inFIG. 5A ; -
FIG. 5C is a schematic view of a FOV at maximum obliquity inFIG. 5A ; -
FIG. 6 is a plan cross-sectional view of an NED including beam scanners/projectors of this disclosure; -
FIG. 7A is an isometric view of a head-mounted display (headset) of this disclosure; and -
FIG. 7B is a block diagram of a virtual reality system including the headset ofFIG. 7A . - While the present teachings are described in conjunction with various embodiments and examples, it is not intended that the present teachings be limited to such embodiments. On the contrary, the present teachings encompass various alternatives and equivalents, as will be appreciated by those of skill in the art. All statements herein reciting principles, aspects, and embodiments of this disclosure, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
- As used herein, the terms “first”, “second”, and so forth are not intended to imply sequential ordering, but rather are intended to distinguish one element from another, unless explicitly stated. Similarly, sequential ordering of method steps does not imply a sequential order of their execution, unless explicitly stated.
- A tiltable reflector may be used to scan a light beam emitted by a light source to form an image in angular domain for direct observation by a user. As the light beam is scanned, the brightness and/or color of the scanned light beam may be varied in coordination with the scanning, in accordance with pixels of the displayed image being pointed at by the scanner. The entire image is formed by a display when the light beam is scanned in two dimensions, e.g. over X- and Y-viewing angles, over the entire frame or field of view (FOV) of the display. When the frame rate is high enough, the eye integrates the scanned light beam, enabling the user to see the displayed imagery substantially without flicker.
- One problem associated with near-eye display image scanners is reduction of field of view (FOV) caused by an oblique angle of incidence of the light beam onto a tiltable reflector of the scanner. The oblique angle may be required by the optical geometry used, e.g. to physically separate an impinging light beam from the scanned, i.e. reflected, light beam. The FOV reduction is caused by distortion of the solid angle representing the range of scanning at oblique angles of incidence of light beam at the tiltable reflector.
- In accordance with the present disclosure, the output (scanned) light beam may be spatially separated from the input optical beam by polarization. This obviates the need in geometrical separation of the beams by oblique angles of incidence, resulting in a compact configuration providing a nearly straight angle of incidence at the tiltable reflector when the latter is in a center (non-tilted) angular position. Low obliquity of the impinging light beam enables the scanning range to be utilized more efficiently.
- Grating structures based on so-called polarization volume holograms may be used to separate the input and output light beams by polarization. By way of example, referring to
FIG. 1A , a polarization volume hologram (PVH) grating 100 includes anLC layer 104 bound by opposed top 105 and bottom 106 parallel surfaces. TheLC layer 104 may include an LC fluid containing rod-like LC molecules 107 with positive dielectric anisotropy, e.g. nematic LC molecules. A chiral dopant may be added to the LC fluid, causing the LC molecules in the LC fluid to self-organize into a periodic helical configuration includinghelical structures 108 extending between the top 105 and bottom 106 parallel surfaces of theLC layer 104. Such a configuration of theLC molecules 107, termed herein a cholesteric configuration, includes a plurality of helical periods p, e.g. at least two, at least five, at least ten, at least twenty, or at least fifty helical periods p between the top 105 and bottom 106 parallel surfaces of theLC layer 104.Boundary LC molecules 107 b at thetop surface 105 of theLC layer 104 may be oriented at an angle to thetop surface 105. Theboundary LC molecules 107 b may have a spatially varying azimuthal angle, e.g. linearly varying along X-axis parallel to thetop surface 105, as shown inFIG. 1A . To that end, analignment layer 112 may be provided at thetop surface 105 of theLC layer 104. Thealignment layer 112 may be configured to provide the desired orientation pattern of theboundary LC molecules 107 b, such as the linear dependence of the azimuthal angle on the X-coordinate. A pattern of spatially varying polarization directions of the UV light may be selected to match a desired orientation pattern of the boundary LC molecules 107 a at thetop surface 105 and/or thebottom surface 106 of theLC layer 104. When thealignment layer 112 is coated with the cholesteric LC fluid, the boundary LC molecules 107 a are oriented along the photopolymerized chains of thealignment layer 112, thus adopting the desired surface orientation pattern. Adjacent LC molecules adopt helical patterns extending from the top 105 to the bottom 106 surfaces of theLC layer 104, as shown. - The
boundary LC molecules 107 b define relative phases of thehelical structures 108 having the helical period p. Thehelical structures 108 form a volume grating comprisinghelical fringes 114 tilted at an angle ϕ, as shown inFIG. 1A . The steepness of the tilt angle ϕ depends on the rate of variation of the azimuthal angle of theboundary LC molecules 107 b at thetop surface 105 and p. Thus, the tilt angle ϕ is determined by the surface alignment pattern of the boundary LC molecules 107A at thealignment layer 112. The volume grating has a period Λx along X-axis and Λy along Y-axis. In some embodiments, the periodichelical structures 108 of theLC molecules 107 may be polymer-stabilized by mixing in a stabilizing polymer into the LC fluid, and curing (polymerizing) the stabilizing polymer. - The helical nature of the
fringes 114 of the volume grating makes the PVH grating 100 preferably responsive to light of polarization having one particular handedness, e.g. left- or right-circular polarization, while being substantially non-responsive to light of the opposite handedness of polarization. Thus, thehelical fringes 114 make the PVH grating 100 polarization-selective. This is illustrated inFIG. 1B , which shows alight beam 120 impinging onto the PVH grating 100. Thelight beam 120 includes a left circular polarized (LCP)beam component 121 and a right circular polarized (RCP)beam component 122. TheLCP beam component 121 propagates through the PVH grating 100 substantially without diffraction. Herein, the term “substantially without diffraction” means that, even though an insignificant portion of the beam (theLCP beam component 121 in this case) might diffract, the portion of the diffracted light energy is so small that it does not impact the intended performance of the PVH grating 100. TheRCP beam component 122 of thelight beam 120 undergoes diffraction, producing a diffractedbeam 122′. The polarization selectivity of the PVH grating 100 results from the effective refractive index of the grating being dependent on the relationship between the handedness, or chirality, of the impinging light beam and the handedness, or chirality, of thegrating fringes 114. It is further noted that the sensitivity of thePVH 100 to right circular polarized light in particular is only meant as an illustrative example. When handedness of thehelical fringes 114 is reversed, thePVH 100 may be made sensitive to left circular polarized light. - Referring to
FIG. 2 , a near-eye display (NED) 200 includes aprojector 202 optically coupled to a pupil-replicatingwaveguide 204. Theprojector 202 includes alight source 206 for providingimage light 208 of controllable brightness and/or color(s), and abeam scanner 210 for receiving scanning theimage light 208 across an input grating 212 of the pupil-replicatingwaveguide 204. Anoptional collimator 214 may be disposed in an optical path between thelight source 208 and thebeam scanner 210, for collimating theimage light 208 to obtain afirst light beam 221. The light source may provide polarized light of a pre-defined handedness, e.g. LCP or RCP light. A polarizer, e.g. a circular polarizer, may be provided for this purpose. - The
beam scanner 210 includes a first redirectingdiffraction grating 216 configured to diffract the impingingfirst light beam 221 to obtain a secondlight beam 222, which is right circular polarized. The first redirectingdiffraction grating 216 may, but does not have to be, a PVH grating. The PVH grating 100 is disposed in a path of the secondlight beam 222 and configured to receive and diffract the secondlight beam 222 by reflective diffraction to obtain a thirdlight beam 223. A chromatic dispersion of the first redirectingdiffraction 216 grating is selected to be opposite to a chromatic dispersion of the PVH grating 100, e.g. the chromatic dispersion may have the same amplitude but opposite sign. Thus, the chromatic dispersions of the first redirectingdiffraction 216 and the PVH grating 100 at least partially offset each other or even completely cancel each other, and therefore, when theimage light 208 includes light at multiple wavelengths, the reflected thirdlight beam 223 will not be wavelength dispersed, i.e. the beam angle of the reflected thirdlight beam 223 will not be dependent on wavelength. - A
tiltable reflector 218, e.g. a 2D microelectromechanical system (MEMS) tiltable reflector, is disposed in an optical path of the thirdlight beam 223, e.g. under the PVH grating 100, and configured to receive and reflect the thirdlight beam 223 at a variable angle back towards the PVH grating 100. The thirdlight beam 223 reflected by thetiltable reflector 218 changes the handedness of polarization upon reflection. This happens because the direction of propagation of the reflected thirdlight beam 223 changes, while the phase relationship between x- and y-component of the light field of the thirdlight beam 223 impinging onto thetiltable reflector 218 remains substantially the same. Since the handedness of the circular polarization is determined with the account of direction of propagation, the handedness of the reflected thirdlight beam 223 changes as well. The thirdlight beam 223 changes handedness of its polarization to an opposite handedness and, as a result, propagates through the PVH grating 100 substantially without diffraction. The thirdlight beam 223 impinges onto the input grating 212 of the pupil-replicatingwaveguide 204 disposed over thePVH 100 at a location and angle depending on angle of tilt of thetiltable reflector 218. For example, when thetiltable reflector 218 is in aleft position 218A, the thirdlight beam 223 impinges into the input grating 212 at a first location andangle 220A; and when thetiltable reflector 218 is in aright position 218B, the thirdlight beam 223 impinges into the input grating 212 at a second location andangle 220B. During scanning, thetiltable reflector 218 may oscillate between theleft position 218A and theright position 218B. Although the tilting is shown only about one axis inFIG. 2 , thetiltable reflector 218 may tilt/scan about two axes, i.e. about X and Y axes. - By coordinating the instantaneous brightness and/or color of the
image light 208 generated by thelight source 206 with an instantaneous angle of scanning provided by thebeam scanner 210, an image in angular domain may be formed. The scanned thirdlight beam 223 is in-coupled by the input grating 212 to propagate within the pupil-replicatingwaveguide 204. The pupil-replicatingwaveguide 204 out-couples multiple laterally offset copies of the thirdlight beam 223 while preserving the beam angle, thus replicating the image in the angular domain over an output area of the pupil-replicatingwaveguide 204 for direct observation by a user's eye, not shown. - Referring to
FIGS. 3A, 3B, and 3C , thelight source 206 may include a plurality of individually controllable emitters, such as superluminescent light-emitting diodes (SLEDs), for example. Several emitters may be provided for each color channel. In some embodiments, fourred emitters 300R may be provided for red (R) color channel (dark-shaded circles); fourgreen emitters 300G may be provided for green (G) color channel (medium-shaded circles); and fourblue emitters 300B may be provided for blue (B) color channel (light-shaded circles). Theemitters emitters FIG. 3A ); in a zigzag pattern (FIG. 3B ); or in a honeycomb pattern (FIG. 3C ), to name just a few examples. - Having a plurality of emitters illuminating a same tiltable reflector enables one to scan light beams generated by these emitters together as a group. When the
light source 206 includes a plurality of individual emitters, thefirst light beam 221 impinging onto the first redirectingdiffraction grating 216 includes the plurality of sub-beams collimated together by thecollimator 214 and co-propagating at a slight angle w.r.t each other. Maximum angular cone of the sub-beams may be less than 5 degrees, or less than 2 degrees, or less than 1 degree in some embodiments. Multiple emitters and, in some cases, multiple light sources may be used to provide redundancy in case some of light sources fail, increase image resolution, increase overall image brightness, etc. Multiple light sources may each be equipped with its own collimator. - Referring to
FIG. 4 with further reference toFIG. 2 , anNED 400 ofFIG. 4 is similar to theNED 200 ofFIG. 2 , and includes similar elements. TheNED 400 includes first 406 and second 408 light sources, e.g. those depicted inFIGS. 3A, 3B, and 3C , producing thefirst light beam 221 and a fourthlight beam 224, respectively. Abeam scanner 410 of theNED 400 ofFIG. 4 further includes a second redirectingdiffraction grating 416 configured to diffract an impinging fourthlight beam 224 provided by the secondlight source 408. The diffracted fourthlight beam 224 forms a fifthlight beam 225, which has the same handedness of polarization as the secondlight beam 222, i.e. RCP in this example. - The PVH grating 100 is disposed and configured to receive and diffract the fifth
light beam 225 by reflective diffraction, to obtain a sixthlight beam 226. The first 216 and second 416 redirecting diffraction gratings may be disposed side-by-side and parallel to the PVH grating 100, as shown. A small gap, e.g. 0.5 mm-3 mm gap, may be provided to avoid image light propagating in the pupil-replicatingwaveguide 204 from entering thePVH 100. This results in a compact configuration, and leaves room for the twolight sources diffraction grating 216, the chromatic dispersion of the second redirectingdiffraction grating 416 may be selected to be opposite to the chromatic dispersion of the PVH grating 100, such that the sixthlight beam 226 is substantially not wavelength-dispersed, i.e. individual wavelengths sub-beams of the sixthlight beam 226 all propagate substantially parallel to one another. Thetiltable reflector 218 is configured to receive and reflect the sixthlight beam 226 at a variable angle back towards the PVH grating 100. The sixthlight beam 226 reflected by thetiltable reflector 218 has the second handedness of polarization opposite to the first handedness, whereby the sixthlight beam 226 propagates through the PVH grating 100 and impinges onto the input grating 212 of the pupil-replicatingwaveguide 204. The angles of incidence of the third 223 and sixth 226 light beams may be selected to be different. Such a configuration enables different areas of a field of view (FOV) of theNED 400 to be powered by different light sources. This enables one to broaden the overall FOV of theNED 400 without expanding the scanning range of thetiltable reflector 218. The FOV portions corresponding to different light sources may overlap at a central area of the FOV, which may provide means for increasing spatial resolution of theNED 400 in the central FOV area. The PVH grating 100 may include a plurality of PVH sub-gratings optimized for individual color channels. - The
NEDs 200 ofFIG. 2 and 400 ofFIG. 4 provide a low-obliquity coupling of light beam(s) to a tiltable reflector. Herein, the term “low obliquity” means a low angle of incidence, i.e. a normal incidence, at the tiltable reflector when in a nominal, e.g. a center or zero, angle of tilt. One advantage of having low obliquity is illustrated inFIGS. 5A to 5C . Referring first toFIG. 5A , an aspect ratio of a FOV of a projector using a tiltable reflector is plotted as a function of obliquity, i.e. angle of incidence at the tiltable reflector when in nominal or center position. The aspect ration is plotted for four cases: 75 degrees by 50 degrees on-axis FOV; 60 degrees by 40 degrees on-axis FOV; 45 degrees by 30 degrees on-axis FOV; and 30 degrees by 20 degrees on-axis FOV. The aspect ratio drops from 1.5 at zero obliquity, i.e. normal incidence, to about 1.1 at 40 degrees obliquity angle. -
FIG. 5B shows a zero-obliquity scanningangular area 500B and an associated inscribed rectangular zero-obliquity FOV 502B. The zero-obliquity FOV 502B solid angle is covering most of the zero-obliquity scanningangular area 500B. By comparison,FIG. 5C shows a 40 degrees obliquity scanningangular area 500C and an associated inscribedrectangular oblique FOV 502C. Theoblique FOV 502C solid angle occupies a smaller percentage of the 40 degrees obliquity scanningangular area 500C, and is almost 2 times less than the zero-obliquity FOV 502B. Thus, the low-obliquity coupling improves the utilization of the scanning range of a tiltable reflector, enabling wider fields of view at the same scanning range of the tiltable reflector. - Referring to
FIG. 6 , a near-eye display (NED) 600 includes aframe 601 having a form factor of a pair of eyeglasses. Theframe 601 may support, for each eye: aprojector 602 for providing display light carrying an image in angular domain, anelectronic driver 604 operably coupled to theprojector 602 for powering theprojector 602, and apupil replicator 632 optically coupled to theprojector 602. - Each
projector 602 may include beam scanners and light sources described herein, for example and without limitation thebeam scanner 210 ofFIG. 2 , or thebeam scanner 410 ofFIG. 4 . Light sources for these projectors may include a substrate supporting an array of single-mode or multimode semiconductor light sources. For example, the light sources 206 (FIG. 2 ) and 406 and 408 (FIG. 4 ) may include side-emitting laser diodes, vertical-cavity surface-emitting laser diodes, SLEDs, or light-emitting diodes, for providing a plurality of light beams as described above with reference toFIGS. 3A, 3B, and 3C . Collimators for the light sources may include concave mirrors, bulk lenses, Fresnel lenses, holographic lenses, pancake lenses, etc. Thepupil replicators 632 may include waveguides equipped with a plurality of surface relief and/or volume holographic gratings. The function of thepupil replicators 632 is to provide multiple laterally offset copies of the display light beams provided by theprojectors 602 atrespective eyeboxes 612. - A
controller 605 is operably coupled to the light sources and tiltable reflectors of theprojectors 602. Thecontroller 605 may be configured to determine the X- and Y-tilt angles of the tiltable reflectors of theprojectors 602. Thecontroller 605 determines which pixel or pixels of the image to be displayed correspond to the determined X- and Y-tilt angles. Then, thecontroller 605 determines the brightness and/or color of these pixels, and operates theelectronic drivers 604 accordingly for providing powering electric pulses to the light sources of theprojectors 602 to produce light pulses at power level(s) corresponding to the determined pixel brightness and color. - In some embodiments, the
controller 605 may be configured to operate, for each eye, thetiltable reflector 218 to cause the light beam reflected from thetiltable reflector 218 and propagated through the respective PVH grating 100 to have a beam angle corresponding to a pixel of an image to be displayed. Thecontroller 605 may be further configured to operate the corresponding light source in coordination with operating thetiltable reflector 218, such that the light beam has brightness and/or color(s) corresponding to the pixel being displayed. In multi-light source embodiments, thecontroller 605 may be configured to operate the corresponding light sources in coordination, to provide a larger FOV, an improved scanning resolution, increased brightness of the display, etc., as described herein. For example, in embodiment where the projectors for both of user's eyes each include two light sources, thecontroller 605 may be configured to operate thetiltable reflector 218 to cause two light beams reflected from the tiltable reflector and propagated through the PVH grating to have beam angle corresponding to respective two pixels of an image to be displayed, and operate the light sources in coordination with operating thetiltable reflector 218, such that the two light beam have brightness and/or color corresponding to the two respective pixels. More light sources than two may be provided, each light source including one or a plurality of emitters, for one or a plurality of color channels of the image being displayed. - Embodiments of the present disclosure may include, or be implemented in conjunction with, an artificial reality system. An artificial reality system adjusts sensory information about outside world obtained through the senses such as visual information, audio, touch (somatosensation) information, acceleration, balance, etc., in some manner before presentation to a user. By way of non-limiting examples, artificial reality may include virtual reality (VR), augmented reality (AR), mixed reality (MR), hybrid reality, or some combination and/or derivatives thereof. Artificial reality content may include entirely generated content or generated content combined with captured (e.g., real-world) content. The artificial reality content may include video, audio, somatic or haptic feedback, or some combination thereof. Any of this content may be presented in a single channel or in multiple channels, such as in a stereo video that produces a three-dimensional effect to the viewer. Furthermore, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, for example, create content in artificial reality and/or are otherwise used in (e.g., perform activities in) artificial reality. The artificial reality system that provides the artificial reality content may be implemented on various platforms, including a wearable display such as an HMD connected to a host computer system, a standalone HMD, a near-eye display having a form factor of eyeglasses, a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.
- Referring to
FIG. 7A , anHMD 700 is an example of an AR/VR wearable display system which encloses the user's face, for a greater degree of immersion into the AR/VR environment. TheHMD 700 is an embodiment of theNED 200 ofFIG. 2 or theNED 400 ofFIG. 4 , for example. The function of theHMD 700 is to augment views of a physical, real-world environment with computer-generated imagery, and/or to generate the entirely virtual 3D imagery. TheHMD 700 may include afront body 702 and aband 704. Thefront body 702 is configured for placement in front of eyes of a user in a reliable and comfortable manner, and theband 704 may be stretched to secure thefront body 702 on the user's head. Adisplay system 780 may be disposed in thefront body 702 for presenting AR/VR imagery to the user.Sides 706 of thefront body 702 may be opaque or transparent. - In some embodiments, the
front body 702 includeslocators 708 and an inertial measurement unit (IMU) 710 for tracking acceleration of theHMD 700, andposition sensors 712 for tracking position of theHMD 700. TheIMU 710 is an electronic device that generates data indicating a position of theHMD 700 based on measurement signals received from one or more ofposition sensors 712, which generate one or more measurement signals in response to motion of theHMD 700. Examples ofposition sensors 712 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of theIMU 710, or some combination thereof. Theposition sensors 712 may be located external to theIMU 710, internal to theIMU 710, or some combination thereof. - The
locators 708 are traced by an external imaging device of a virtual reality system, such that the virtual reality system can track the location and orientation of theentire HMD 700. Information generated by theIMU 710 and theposition sensors 712 may be compared with the position and orientation obtained by tracking thelocators 708, for improved tracking accuracy of position and orientation of theHMD 700. Accurate position and orientation is important for presenting appropriate virtual scenery to the user as the latter moves and turns in 3D space. - The
HMD 700 may further include a depth camera assembly (DCA) 711, which captures data describing depth information of a local area surrounding some or all of theHMD 700. To that end, theDCA 711 may include a laser radar (LIDAR), or a similar device. The depth information may be compared with the information from theIMU 710, for better accuracy of determination of position and orientation of theHMD 700 in 3D space. - The
HMD 700 may further include aneye tracking system 714 for determining orientation and position of user's eyes in real time. The obtained position and orientation of the eyes also allows theHMD 700 to determine the gaze direction of the user and to adjust the image generated by thedisplay system 780 accordingly. In one embodiment, the vergence, that is, the convergence angle of the user's eyes gaze, is determined. The determined gaze direction and vergence angle may also be used for real-time compensation of visual artifacts dependent on the angle of view and eye position. Furthermore, the determined vergence and gaze angles may be used for interaction with the user, highlighting objects, bringing objects to the foreground, creating additional objects or pointers, etc. An audio system may also be provided including e.g. a set of small speakers built into thefront body 702. - Referring to
FIG. 7B , an AR/VR system 750 includes theHMD 700 ofFIG. 7A , anexternal console 790 storing various AR/VR applications, setup and calibration procedures, 3D videos, etc., and an input/output (I/O)interface 715 for operating theconsole 790 and/or interacting with the AR/VR environment. TheHMD 700 may be “tethered” to theconsole 790 with a physical cable, or connected to theconsole 790 via a wireless communication link such as Bluetooth®, Wi-Fi, etc. There may bemultiple HMDs 700, each having an associated I/O interface 715, with eachHMD 700 and I/O interface(s) 715 communicating with theconsole 790. In alternative configurations, different and/or additional components may be included in the AR/VR system 750. Additionally, functionality described in conjunction with one or more of the components shown inFIGS. 7A and 7B may be distributed among the components in a different manner than described in conjunction withFIGS. 7A and 7B in some embodiments. For example, some or all of the functionality of theconsole 715 may be provided by theHMD 700, and vice versa. TheHMD 700 may be provided with a processing module capable of achieving such functionality. - As described above with reference to
FIG. 7A , theHMD 700 may include the eye tracking system 714 (FIG. 7B ) for tracking eye position and orientation, determining gaze angle and convergence angle, etc., theIMU 710 for determining position and orientation of theHMD 700 in 3D space, theDCA 711 for capturing the outside environment, theposition sensor 712 for independently determining the position of theHMD 700, and thedisplay system 780 for displaying AR/VR content to the user. Thedisplay system 780 includes (FIG. 7B ) an electronic display 725, for example and without limitation, a liquid crystal display (LCD), an organic light emitting display (OLED), an inorganic light emitting display (ILED), an active-matrix organic light-emitting diode (AMOLED) display, a transparent organic light emitting diode (TOLED) display, a projector, or a combination thereof. Thedisplay system 780 further includes anoptics block 730, whose function is to convey the images generated by the electronic display 725 to the user's eye. The optics block may include various lenses, e.g. a refractive lens, a Fresnel lens, a diffractive lens, an active or passive Pancharatnam-Berry phase (PBP) lens, a liquid lens, a liquid crystal lens, etc., a pupil-replicating waveguide, grating structures, coatings, etc. Thedisplay system 780 may further include avarifocal module 735, which may be a part of the optics block 730. The function of thevarifocal module 735 is to adjust the focus of the optics block 730 e.g. to compensate for vergence-accommodation conflict, to correct for vision defects of a particular user, to offset aberrations of the optics block 730, etc. - The I/
O interface 715 is a device that allows a user to send action requests and receive responses from theconsole 790. An action request is a request to perform a particular action. For example, an action request may be an instruction to start or end capture of image or video data or an instruction to perform a particular action within an application. The I/O interface 715 may include one or more input devices, such as a keyboard, a mouse, a game controller, or any other suitable device for receiving action requests and communicating the action requests to theconsole 790. An action request received by the I/O interface 715 is communicated to theconsole 790, which performs an action corresponding to the action request. In some embodiments, the I/O interface 715 includes an IMU that captures calibration data indicating an estimated position of the I/O interface 715 relative to an initial position of the I/O interface 715. In some embodiments, the I/O interface 715 may provide haptic feedback to the user in accordance with instructions received from theconsole 790. For example, haptic feedback can be provided when an action request is received, or theconsole 790 communicates instructions to the I/O interface 715 causing the I/O interface 715 to generate haptic feedback when theconsole 790 performs an action. - The
console 790 may provide content to theHMD 700 for processing in accordance with information received from one or more of: theIMU 710, theDCA 711, theeye tracking system 714, and the I/O interface 715. In the example shown inFIG. 7B , theconsole 790 includes anapplication store 755, atracking module 760, and aprocessing module 765. Some embodiments of theconsole 790 may have different modules or components than those described in conjunction withFIG. 7B . Similarly, the functions further described below may be distributed among components of theconsole 790 in a different manner than described in conjunction withFIGS. 7A and 7B . - The
application store 755 may store one or more applications for execution by theconsole 790. An application is a group of instructions that, when executed by a processor, generates content for presentation to the user. Content generated by an application may be in response to inputs received from the user via movement of theHMD 700 or the I/O interface 715. Examples of applications include: gaming applications, presentation and conferencing applications, video playback applications, or other suitable applications. - The
tracking module 760 may calibrate the AR/VR system 750 using one or more calibration parameters and may adjust one or more calibration parameters to reduce error in determination of the position of theHMD 700 or the I/O interface 715. Calibration performed by thetracking module 760 also accounts for information received from theIMU 710 in theHMD 700 and/or an IMU included in the I/O interface 715, if any. Additionally, if tracking of theHMD 700 is lost, thetracking module 760 may re-calibrate some or all of the AR/VR system 750. - The
tracking module 760 may track movements of theHMD 700 or of the I/O interface 715, theIMU 710, or some combination thereof. For example, thetracking module 760 may determine a position of a reference point of theHMD 700 in a mapping of a local area based on information from theHMD 700. Thetracking module 760 may also determine positions of the reference point of theHMD 700 or a reference point of the I/O interface 715 using data indicating a position of theHMD 700 from theIMU 710 or using data indicating a position of the I/O interface 715 from an IMU included in the I/O interface 715, respectively. Furthermore, in some embodiments, thetracking module 760 may use portions of data indicating a position or theHMD 700 from theIMU 710 as well as representations of the local area from theDCA 711 to predict a future location of theHMD 700. Thetracking module 760 provides the estimated or predicted future position of theHMD 700 or the I/O interface 715 to theprocessing module 765. - The
processing module 765 may generate a 3D mapping of the area surrounding some or all of the HMD 700 (“local area”) based on information received from theHMD 700. In some embodiments, theprocessing module 765 determines depth information for the 3D mapping of the local area based on information received from theDCA 711 that is relevant for techniques used in computing depth. In various embodiments, theprocessing module 765 may use the depth information to update a model of the local area and generate content based in part on the updated model. - The
processing module 765 executes applications within the AR/VR system 750 and receives position information, acceleration information, velocity information, predicted future positions, or some combination thereof, of theHMD 700 from thetracking module 760. Based on the received information, theprocessing module 765 determines content to provide to theHMD 700 for presentation to the user. For example, if the received information indicates that the user has looked to the left, theprocessing module 765 generates content for theHMD 700 that mirrors the user's movement in a virtual environment or in an environment augmenting the local area with additional content. Additionally, theprocessing module 765 performs an action within an application executing on theconsole 790 in response to an action request received from the I/O interface 715 and provides feedback to the user that the action was performed. The provided feedback may be visual or audible feedback via theHMD 700 or haptic feedback via the I/O interface 715. - In some embodiments, based on the eye tracking information (e.g., orientation of the user's eyes) received from the
eye tracking system 714, theprocessing module 765 determines resolution of the content provided to theHMD 700 for presentation to the user on the electronic display 725. Theprocessing module 765 may provide the content to theHMD 700 having a maximum pixel resolution on the electronic display 725 in a foveal region of the user's gaze. Theprocessing module 765 may provide a lower pixel resolution in other regions of the electronic display 725, thus lessening power consumption of the AR/VR system 750 and saving computing resources of theconsole 790 without compromising a visual experience of the user. In some embodiments, theprocessing module 765 can further use the eye tracking information to adjust where objects are displayed on the electronic display 725 to prevent vergence-accommodation conflict and/or to offset optical distortions and aberrations. - The hardware used to implement the various illustrative logics, logical blocks, modules, and circuits described in connection with the aspects disclosed herein may be implemented or performed with a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor may be a microprocessor, but, in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Alternatively, some steps or methods may be performed by circuitry that is specific to a given function.
- The present disclosure is not to be limited in scope by the specific embodiments described herein. Indeed, other various embodiments and modifications, in addition to those described herein, will be apparent to those of ordinary skill in the art from the foregoing description and accompanying drawings. Thus, such other embodiments and modifications are intended to fall within the scope of the present disclosure. Further, although the present disclosure has been described herein in the context of a particular implementation in a particular environment for a particular purpose, those of ordinary skill in the art will recognize that its usefulness is not limited thereto and that the present disclosure may be beneficially implemented in any number of environments for any number of purposes. Accordingly, the claims set forth below should be construed in view of the full breadth and spirit of the present disclosure as described herein.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/568,897 US10935794B1 (en) | 2019-09-12 | 2019-09-12 | Low-obliquity beam scanner with polarization-selective grating |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/568,897 US10935794B1 (en) | 2019-09-12 | 2019-09-12 | Low-obliquity beam scanner with polarization-selective grating |
Publications (2)
Publication Number | Publication Date |
---|---|
US10935794B1 US10935794B1 (en) | 2021-03-02 |
US20210080719A1 true US20210080719A1 (en) | 2021-03-18 |
Family
ID=74682818
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/568,897 Active US10935794B1 (en) | 2019-09-12 | 2019-09-12 | Low-obliquity beam scanner with polarization-selective grating |
Country Status (1)
Country | Link |
---|---|
US (1) | US10935794B1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023287832A1 (en) * | 2021-07-13 | 2023-01-19 | Meta Platforms Technologies, Llc | Directional illuminator and display device with pupil steering by tiltable reflector |
WO2024012713A1 (en) * | 2022-07-13 | 2024-01-18 | VIAHOLO GmbH | Glasses-type display device for displaying a virtual image in a display device field of view which can be virtually supplemented and which tapers towards the bottom |
EP4414769A1 (en) * | 2023-02-10 | 2024-08-14 | Meta Platforms Technologies, LLC | Folded beam two-dimensional (2d) beam scanner |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20230045957A1 (en) | 2021-08-12 | 2023-02-16 | Facebook Technologies, Llc | Multi-source light-guiding illuminator |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110168419B (en) * | 2016-10-28 | 2021-11-12 | 奇跃公司 | Method and system for large field of view display with scanning reflector |
-
2019
- 2019-09-12 US US16/568,897 patent/US10935794B1/en active Active
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023287832A1 (en) * | 2021-07-13 | 2023-01-19 | Meta Platforms Technologies, Llc | Directional illuminator and display device with pupil steering by tiltable reflector |
US11852836B2 (en) | 2021-07-13 | 2023-12-26 | Meta Platforms Technologies, Llc | Directional illuminator and display device with pupil steering by tiltable reflector |
WO2024012713A1 (en) * | 2022-07-13 | 2024-01-18 | VIAHOLO GmbH | Glasses-type display device for displaying a virtual image in a display device field of view which can be virtually supplemented and which tapers towards the bottom |
EP4414769A1 (en) * | 2023-02-10 | 2024-08-14 | Meta Platforms Technologies, LLC | Folded beam two-dimensional (2d) beam scanner |
Also Published As
Publication number | Publication date |
---|---|
US10935794B1 (en) | 2021-03-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10935794B1 (en) | Low-obliquity beam scanner with polarization-selective grating | |
US11280997B1 (en) | Low-obliquity pupil relay for tiltable reflectors | |
US11294184B2 (en) | Foveated display system | |
US11774737B2 (en) | Folded-beam, low-obliquity beam scanner | |
US11668932B2 (en) | Switchable Pancharatnam-Berry phase grating stack | |
CN113646688B (en) | Scanning projector display with multiple light engines | |
US11237402B2 (en) | Multipass scanner for near-eye display | |
US11415794B2 (en) | Low-obliquity pupil relay for near-eye display | |
WO2023132966A1 (en) | Display systems with collection optics for disparity sensing detectors | |
US11199710B2 (en) | Low-obliquity beam scanner with reflective polarizer | |
US11822086B2 (en) | Lightguide based illuminator for reflective display panel | |
US20220350149A1 (en) | Waveguide configurations in a head-mounted display (hmd) for improved field of view (fov) | |
US20230221555A1 (en) | Transmissive optical element based on reflective volumetric gratings | |
US11513373B2 (en) | Anisotropic diffraction grating and waveguide | |
US11448803B1 (en) | Pancake lens including diffuser |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: FACEBOOK TECHNOLOGIES, LLC, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:AMIRSOLAIMANI, BABAK;WHEELWRIGHT, BRIAN;GENG, YING;AND OTHERS;REEL/FRAME:051645/0027 Effective date: 20191024 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: META PLATFORMS TECHNOLOGIES, LLC, CALIFORNIA Free format text: CHANGE OF NAME;ASSIGNOR:FACEBOOK TECHNOLOGIES, LLC;REEL/FRAME:062444/0855 Effective date: 20220318 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |