EP4544339A1 - Waveguides with dynamically addressable diffractive optical elements - Google Patents
Waveguides with dynamically addressable diffractive optical elementsInfo
- Publication number
- EP4544339A1 EP4544339A1 EP23739732.8A EP23739732A EP4544339A1 EP 4544339 A1 EP4544339 A1 EP 4544339A1 EP 23739732 A EP23739732 A EP 23739732A EP 4544339 A1 EP4544339 A1 EP 4544339A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- output
- waveguide
- light
- doe
- diffraction efficiency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0081—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. enlarging, the entrance or exit pupil
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/4272—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having plural diffractive elements positioned sequentially along the optical path
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0123—Head-up displays characterised by optical features comprising devices increasing the field of view
- G02B2027/0125—Field-of-view increase by wavefront division
Definitions
- the present disclosure relates generally to optical structures and more particularly to waveguides having input and output diffractive optical elements, such as diffraction gratings.
- Diffractive optical elements such as diffraction gratings
- DOE diffracting optical elements
- a typical augmented reality (AR) device includes a waveguide having an input coupler (IC) and output coupler (OC) formed on the waveguide, each of which is a DOE.
- a light source such as a projector or micro display, transmits light onto the IC, which diffracts this light at an angle within the waveguide so that the light propagates within the waveguide through total internal reflection (TIR).
- TIR total internal reflection
- FIG. 1 illustrates a cross-sectional view of light entering and reflecting within a waveguide having an input DOE and an output DOE, according to some examples.
- FIG. 2 illustrates a cross-sectional view of light entering and reflecting within a waveguide having an input DOE and multiple output DOEs, according to some examples.
- FIG. 3 is a block diagram of a waveguide having a controller, a DOE driver, and multiple dynamically addressable output DOEs, according to some examples.
- FIG. 4 illustrates a perspective view of a waveguide having multiple fold DOEs and multiple output DOEs, according to some examples.
- FIG. 5 illustrates the waveguide of FIG. 4 showing the fold DOEs and output DOEs stimulated to direct light out of a single output DOE toward the location of an eye, according to some examples.
- FIG. 6 illustrates the waveguide of FIG. 4 showing the fold DOEs and output DOEs stimulated to direct light out of a set of multiple output DOEs toward the location of an eye, according to some examples.
- FIG. 7 illustrates a perspective view of a waveguide having multiple adjacent fold DOEs and multiple adjacent output DOEs, according to some examples.
- FIG. 8 illustrates a cross-sectional view of light entering and reflecting within a waveguide having a plurality of stacked color-specific input DOEs and a plurality of stacked color-specific output DOEs, showing a first input DOE and a first output DOE corresponding to a first color stimulated, according to some examples.
- FIG. 9 illustrates a cross-sectional view of light entering and reflecting within the waveguide of FIG. 8, showing a second input DOE and a second output DOE corresponding to a second color stimulated, according to some examples.
- FIG. 10 illustrates a cross-sectional view of light entering and reflecting within the waveguide of FIG. 8, showing a third input DOE and a third output DOE corresponding to a third color stimulated, according to some examples.
- FIG. 11 is a diagrammatic representation of a machine in the form of a computer system within which a set of instructions may be executed to cause the machine to perform any one or more of the methodologies discussed herein, according to some examples.
- FIG. 13 illustrates a method, according to some examples.
- the position of a user’s eye may vary, and thus an AR device that creates, via the OC, a single image in a specific place would have limited utility.
- the user’s eye would have to be precisely at the required location or risk not seeing the image formed by the light from the OC.
- AR devices typically are formed so that the light propagating in the waveguide is incident on the OC multiple times at different locations of the OC. The light incident at each of these locations is diffracted out of the waveguide to provide a respective image that may be perceived by the user when the user’s eye is properly positioned relative to the location (the location where the light is coupled out of the waveguide may be referred to as “pupils” or “exit pupils” of the waveguide).
- the user’s eye may be positioned in multiple positions within an eye box defined in the space over the viewer’s eye and still be able to perceive the image.
- the eye box must be oversized to allow for different eye positions, as well as different face shapes and sizes.
- much or even most of the light may be wasted, because light is being directed into areas in the eye box where the user’s eye is not present.
- the dynamically adjustable DOEs are configured to direct light out of an OC only where needed given the position of the user’s eye or another target region where the light needs to be projected.
- the location of a user’s eye may be detected using eye-tracking techniques, and the diffraction efficiency of one or more DOEs, such as output DOEs (i.e., OCs), can be controlled so that only the output DOEs pointing toward the target region are made highly efficient. This causes light to be diffracted out of the waveguide toward the location of the user’s eye.
- the efficiency of other DOEs such as fold DOEs for redirecting light within a planar waveguide, may also be adjusted to direct a greater amount of the light traveling within the waveguide toward the desired output DOEs.
- some examples described herein may attempt to address one or more technical problems.
- Efficiency of an image projection system can be increased, and the intensity of light projected toward the user's eye increased, by only sending light to the portion of the eye box where the eye actually resides.
- the optical power needs of such a projection system can be decreased, because an entire large eye box no longer needs to be illuminated at full power.
- some examples may reduce stray light caused by diffraction from areas in output surface of the waveguide that are not needed for imaging at the user's eye location; this may have the effect of presenting a clearer, more distinct image to the user's eye.
- adjustable DOEs configured to selectively diffract light based on time-varying conditions, such as during different color sub frames
- some examples described herein may attempt to address one or more technical problems.
- the use of stacked adjustable DOEs may reduced light loss, ghosting, and/or stray lighting effects caused by light interacting with the wrong color-specific DOE (e.g., green light interacting with red and blue DOEs).
- Some examples may reduce the brightness of ambient stray light artifacts (e.g., rainbow effects), because each color-specific DOEs is only activated to diffract light for a portion of the frame time instead of the entire frame time (e.g., for a 30color system, each colorspecific DOE is only activated % of the time). Furthermore, some examples may eliminate the need to fabricate the waveguide with air gaps inserted in between each adjacent pair of stacked colors-specific DOEs.
- ambient stray light artifacts e.g., rainbow effects
- FIG. 1 illustrates a cross-sectional view of light entering and reflecting within a waveguide having an input DOE and an output DOE.
- the DOEs operate by diffracting light.
- Light propagation typically occurs in isotropic media (vacuum, air, plastic, glass) where the dielectric and absorption are equal and constant regardless of the direction of the light.
- a DOE provides a non-isotropic medium for the propagating light, which effectively changes the direction of the light as the light is scattered by the non- isotropic medium.
- the non-isotropic medium consists of periodic media having regions of differing index of refraction, resulting in conditions in which the waves of light are scattered and add up in phase (i.e., cause constructive interference) in certain directions.
- non-isotropic DOEs enable control or steering of the direction of propagation of the light.
- a projector 132 projects light, shown as input ray 102, toward a waveguide body 142 at incident angle 104 relative to a surface normal of the waveguide body 142.
- the waveguide body 142 which is made from a light-transmissive material having a different refractive index than the surrounding medium (e.g., air)
- the light refracts to travel at the waveguide refraction angle 106 as ray 108.
- Ray 108 encounters the input DOE 134, such as a diffraction grating.
- the input DOE 134 is configured to refract light such that it travels generally in direction 140, toward the right side of the waveguide body 142, by bouncing between the upper and lower surfaces of the waveguide body 142 via total internal reflection (TIR).
- TIR total internal reflection
- ray 108 is refracted by the input DOE 134 into ray 114 traveling at first angle 112.
- First angle 112 is an angle sufficient to maintain TIR as the light continues propagating down the waveguide body 142 in direction 140, as rays 116, 118, 120, 122, 124, and 126.
- Direction 140 is substantially parallel to the length of the waveguide body 142 (i.e., from left to right in the illustrated embodiment), and accordingly substantially tangential to an output surface 138 of the waveguide body 142 where the light entered the waveguide body 142, and where it will exit the waveguide body 142 after encountering the output DOE 136, as described below.
- the output DOE 136 Upon encountering the output DOE 136, such as a further diffraction grating, a portion of the light refracts out of the output surface 138 of the waveguide body 142.
- the output DOE 136 is configured to refract light such that it travels generally normal to the output surface 138, or at a sufficient angle to the output surface 138 to avoid TIR.
- the first encounter with the output DOE 136 outputs first output ray 128, representing a portion of the light from ray 120.
- This pattern continues as the light continues to propagate in direction 140 via TIR, with a portion of the light refracting out of the output surface 138 as further output rays upon each encounter with the output DOE 136.
- an output DOE 136 having a uniform diffraction efficiency of 50% will refract 50% of the light as first output ray 128, then 25% of the light (remaining 50% of light times diffraction efficiency of 50%) as second output ray 130, with further dimini shment by half at each subsequent encounter with the output DOE 136. Furthermore, when the light encounters the output DOE 136 fort the last time at the right-most end of the waveguide body 142, it will still have a portion of the light remaining inside the waveguide body 142, which may further reflect off elements at the right end of the waveguide body 142 and continue propagating in the opposite of direction 140, causing spurious images that interfere with image clarity.
- some approaches use static DOEs that are non-uniform in their refractive index along direction 140. If the output DOE 136 has a different refractive index at each point of encounter with the light, the amount of light refracted out of output surface 138 for each output ray can be varied based on the distance along direction 140. For example, the output DOE 136 at the first encounter (producing first output ray 128) may have a diffraction efficiency of 1/6 (17%), such that 17% of the light is output as first output ray 128 and 83% continues to propagate by TIR.
- This pattern continues, such that the third encounter is at a diffraction efficiency of 25%, the fourth encounter is at 33% efficiency, the fifth encounter is at 50% efficiency, and the sixth and final encounter is at 100% efficiency.
- Such a non-uniform configuration of the output DOE 136 results in six output rays, each having the same brightness (17% of the original light), with no light remaining inside the waveguide body 142.
- the diffraction efficiency of the output DOE 136 can be varied by various techniques, e.g., by gradually varying the shape of a diffraction grating in different regions along direction 140.
- FIG. 2 illustrates an example of a waveguide as in FIG. 1, but in which the single output DOE 136 is replaced by multiple discrete output DOEs 202, 204.
- the output DOEs 202, 204 are shown in FIG. 2 as separate elements, but it will be appreciated that they may be embodied in some examples as distinct regions of a continuous single output DOE, or as adjacent discrete output DOEs without gaps between them. An example of adjacent DOEs without gaps is described below with reference to FIG. 7; however, in FIG. 2 through FIG. 6, individual DOEs will be shown as discrete, spatially separated elements for visual clarity.
- first output DOE 202 and second output DOE 204 shown in FIG. 2 could be implemented as DOEs having different diffraction efficiencies, such as 17% for first output DOE 202 (thereby generating first output ray 206 as 17% of total projected light) and 20% for second output DOE 204 (thereby generating second output ray 208 as 17% of total projected light) to form the first two output DOEs of a chain of six output DOEs forming a row or column of exit pupils of an eye box.
- individual DOEs may be dynamically configurable to independently change their individual diffraction efficiency in response to a stimulus.
- This dynamic control of the diffraction efficiency of each of multiple DOEs of the waveguide allows a display system to direct light to a target region without wasting light (or creating unwanted ambient light) at locations outside of the target region.
- FIG. 3 is a block diagram of a waveguide having multiple dynamically addressable output DOEs 302, 304, 306, according to various examples described herein.
- the controller 316 processes the target region data 326 to identify which exit pupils of the waveguide 300 are likely to output light toward the target region and controls the DOE driver 318 (e.g., vie electrical control signals sent via a data bus) to generate and provide separate and independent stimuli to each adjustable DOE (e.g., first stimulus 320 provided to first output DOE 302, second stimulus 322 provided to second output DOE 304, and third stimulus 324 provided to third output DOE 306).
- the adjustable DOEs change their respective diffraction efficiencies to achieve the desired configuration of diffraction efficiencies across the waveguide body 142.
- a waveguide 300 that includes a waveguide body 142 comprising an optically transmissive material having a refractive index different from a surrounding medium (e.g., air).
- the waveguide body 142 defines an output surface 138 and is configured to propagate light by total internal reflection in one or more directions (e.g., direction 140) substantially tangential to the output surface 138.
- the waveguide 300 includes one or more diffractive optical elements (e.g., first output DOE 302, second output DOE 304, and third output DOE 306) each configured to change its diffraction efficiency in response to a respective stimulus (e.g., first stimulus 320, second stimulus 322, and third stimulus 324, respectively).
- the waveguide 300 also includes a DOE driver 318 configured to provide the stimuli to each of the DOEs independently.
- a dynamically addressable DOE can be implemented using various different techniques.
- a DOE can include a liquid crystal material, which may respond to a stimulus in the form of electrical stimulation in some examples.
- Holographic-Polymer Dispersed Liquid Crystals can be used in some examples: diffraction gratings may be recorded interferometrically on photosensitive polymer with liquid crystals (LCs) dispersed within the grating. The grating formation promotes LCs phase separation. In the absence of an electrical field (e.g., without electrical stimulation), the LCs are randomly aligned, and the diffraction efficiency of the DOE is highest.
- the LCs align, and the index of refraction is matched to the surroundings, hence the diffraction efficiency is reduced or minimal. Electrical field strengths anywhere in between can proportionally affect the diffraction efficiency.
- surface relief DOEs with LCs can be used: instead of a traditional surface relief structure where the gaps between the features are filled with air, LCs are used as filler. Like HPDLCs described above, alignment of the LCs causes the structure to be less efficient.
- non-LC materials and/or non-electrical stimuli may be used.
- Elastic physical deformation of a DOE can alter its diffraction efficiency.
- a diffraction grating can be deformed to the point that is not on-Bragg or otherwise at a high efficiency for the incident light, by applying mechanical compression and/or tension, or by applying thermal deformation and/or relaxation due to a change in temperature.
- the stimulus may include a physical deformation of at least one DOE and/or a change in temperature of at least one DOE.
- the DOE driver 318 may take different forms and/or may operate according to different principles.
- conductive channels may be provided through or adjacent to the waveguide body to enable selective electrical stimulation of each region or each DOE independently, in accordance with known LC control methodologies.
- mechanical actuators such as piezoelectric elements may be used to selectively deform different regions of a DOE (and/or distinct DOES).
- a heating element such as an electrothermal heating element, may be used to selectively heat DOEs or portions thereof.
- the DOE driver 318 may be configured to selectively provide electrical power to the various electrical, mechanical, and/or thermal components used to provide the stimuli to the various DOEs or regions thereof.
- the waveguide body 142 is formed from a optically transmissive material.
- the optically transmissive material includes a dielectric material.
- the optically transmissive material includes a plastic material.
- the optically transmissive material includes a glass material.
- the two-dimensional waveguide 400 includes a waveguide body 434 embodied as a substantially two- dimensional slab, such as a display surface of an AR display (e.g., a lens of a pair of glasses).
- the two-dimensional waveguide 400 includes an input DOE 402 for receiving projected light (shown as input ray 428).
- the light propagates by TIR within the waveguide body 434 in first direction 430, according to a similar pattern as shown in FIG. 1 above with respect to direction 140.
- the two-dimensional waveguide 400 includes a series of fold DOEs configured to redirect a portion of the light propagating via TIR in the first direction 430, via diffraction, to continue propagating within the waveguide body 434 via TIR in a second direction 432.
- a portion of the light (as determined by the diffraction efficiency of first fold DOE 420) is diffracted at a TIR- sufficient angle to propagate in second direction 432, thereafter encountering first output DOE 404, second output DOE 406, third output DOE 408, and fourth output DOE 410 in sequence.
- the longest path that light travels in the illustrated example is to encounter the input DOE 402, propagate in first direction 430 to encounter first fold DOE 420, second fold DOE 422, third fold DOE 424, and fourth fold DOE 426, being diffracted by fourth fold DOE 426 to propagate in second direction 432, and encountering 13th output DOE 412, 14th output DOE 414, 15th output DOE 416, and 16th output DOE 418, at which point it is diffracted out of the waveguide body 434.
- the fold DOEs are DOEs configured to split and fold propagating light, such as a diffraction grating formed internally to the waveguide body 434. Diffraction efficiency at the fold DOE can be dynamically adjusted as described above with reference to FIG. 3. Adjustment of the diffraction efficiency of the fold DOEs results in propagating light being folded and split only where, and only to the degree, necessary.
- rows of output DOEs projecting along second direction 432 can be selectively activated or deactivated so that light is not wasted by being directed to rows that do not include output DOEs oriented toward the target region. Examples of such operation are described below with reference to FIG. 5 and FIG. 6.
- FIG. 5 illustrates the two-dimensional waveguide 400 of FIG. 4 showing the fold DOEs and output DOEs stimulated to direct light (output ray 502) out of a single output DOE (12th output DOE 512) toward the location of an eye 504.
- the DOE driver stimulates the various fold DOEs and output DOEs such that first fold DOE 420 and second fold DOE 422 have minimal diffraction efficiency, causing most or all of the received light to propagated to the third fold DOE 424.
- Third fold DOE 424 is stimulated to have maximal diffraction efficiency, causing most or all of the remaining light to propagate in second direction 432 along the third row of output DOEs.
- the light encounters 9th output DOE 506, 10th output DOE 508, and 11th output DOE 510, all of which are stimulated to have minimal diffraction efficiency.
- 12th output DOE 512 stimulated to have maximal diffraction efficiency, most or all of the remaining light is diffracted out of the waveguide body 434 as output ray 502, to travel toward the target region, in this case the location of eye 504.
- This pattern of stimuli may be achieved, in some examples, by tracking the location of eye 504 using an eye-tracking system, thereby generating eye-tracking data.
- the eyetracking data is provided to the controller 316, with or without preprocessing, as target region data 326.
- the controller processes the target region data 326 and controls the DOE driver 318, based on the target region data 326, to drive the stimulus pattern described above.
- the DOEs include a first one or more output DOEs (e.g., 12th output DOE 512) configured to diffract light out of the output surface toward the target region, and a second one or more output DOEs (e.g., all other output DOEs of the device) configured to diffract light out of the output surface toward a location outside of the target region.
- the stimuli provided to the DOEs are configured to increase the diffraction efficiency of the first one or more output DOEs relative to the diffraction efficiency of the second one or more output DOEs.
- the waveguide (e.g., waveguide 300 or two-dimensional waveguide 400) includes a controller 316 configured to receive target region data 326, and control the DOE driver 318 to provide the stimuli based on the target region data 326.
- the stimuli provided to the DOEs are configured to direct the light toward a target region by diffracting the light out of the waveguide body 142 via the output surface 138.
- the one or more DOEs include a fold DOE (e.g., third fold DOE 424) configured to diffract light propagating in a first direction 430 to propagate in a second direction 432.
- the light propagating in the second direction 432 is more likely to reach the target region than the light propagating in the first direction 430, and the stimuli provided to the DOEs are configured to increase the diffraction efficiency of the fold DOE (e.g., third fold DOE 424) such that the amount of light diffracted to propagate in the second direction 432 is increased.
- the target region includes a location of an eye 504, and the target region data 326 includes eye tracking data representative of the location of the eye 504.
- FIG. 6 illustrates the two-dimensional waveguide 400 of FIG. 4 showing the fold DOEs and output DOEs stimulated to direct light out of a set of multiple output DOEs toward the location of the eye 504.
- the location of the eye may be uncertain enough, or may span more than one exit pupil, such that it is desirable to project light out of multiple exit pupils to ensure that the image is optimally presented to the eye.
- the eye 504 defines a target region that spans four of the output DOEs: 11th output DOE 510, 12th output DOE 512, 15th output DOE 416, and 16th output DOE 418.
- the diffraction efficiency of the various DOEs may be configured as follows in an ideal case (e.g., a case in which diffraction efficiency is perfectly controllable): all fold DOEs other than third fold DOE 424 and fourth fold DOE 426 are at minimal diffraction efficiency; third fold DOE 424 is at 50% diffraction efficiency; fourth fold DOE 426 is at 100% diffraction efficiency.
- the output DOEs in the first two rows are irrelevant, because (in the ideal case) no light is diffracted toward them; however, in a real- world non-ideal case, it may be preferable to minimize the diffraction efficiency of these output DOEs to avoid spurious light exiting the waveguide body 434.
- the first two output DOEs in series are stimulated to have minimal diffraction efficiency; the third output DOE in each row (i.e., 11th output DOE 510 and 15th output DOE 416) are set to 50% diffraction efficiency; and the final output DOE in each row (i.e., 12th output DOE 512 and 16th output DOE 418) are set to 100% diffraction efficiency.
- this stimulus pattern will result in four outputs of equal brightness at each of the four output DOEs 11th output DOE 510, 12th output DOE 512, 15th output DOE 416, and 16th output DOE 418. It will be appreciated that real -world implementations will likely have non-ideal optical characteristics and may need to be adjusted accordingly; furthermore, it will be appreciated that, in some intended applications, it may be desirable to have non-uniform brightness at different locations.
- FIG. 7 illustrates a continuous DOE waveguide 700 having a continuous DOE, which may be regarded as multiple adjacent fold DOEs and multiple adjacent output DOEs, each DOE defining a region of the single continuous DOE.
- the output DOEs may be adjacent, but not the fold DOEs, or vice versa.
- the various regions can be dynamically reconfigured such that a given diffraction efficiency can be applied via stimulus to a region of a dynamically defined shape and/or size, or a continuously-varying diffraction efficiency may be applied over the area of the continuous DOE.
- the continuous DOE waveguide 700 includes a continuous DOE divided into regions, such as first fold DOE 710 defining a first fold region, second fold DOE 712 defining a second fold region, third fold DOE 714 defining a third fold region, and fourth fold DOE 716 defining a fourth fold region, as well as 13th output DOE 702 defining a first output region, 14th output DOE 704 defining a second output region, fourth fold DOE 716 defining a third output region, and 16th output DOE 708 defining a fourth output region.
- the components of continuous DOE waveguide 700 are otherwise analogous to those of two-dimensional waveguide 400.
- a waveguide may provide multiple color-specific DOEs that can bee activated during different color sub frames of a color sequential display.
- a color-sequential display cycles through temporally separated sub frames for each of two or more colors (e.g., red, green, and blue).
- the vision persistence of the human eye fuses the sequence of color sub frames together into one image containing a mix of colors.
- FIG. 8 illustrates a cross-sectional view of light entering and reflecting within a color sequential waveguide 810 having a plurality of stacked color-specific input DOEs and a plurality of stacked color-specific output DOEs.
- the DOEs corresponding to each color can be activated during a corresponding color sub frame defining a time period in which light of the respective color is projected into the waveguide.
- the example shown in FIG. 8 shows a first input DOE 802 and a first output DOE 804 both corresponding to a first color (e.g., blue).
- the first input DOE 802 and first output DOE 804 are configured to optimize the diffraction of light of the first color (e.g., blue light having a wavelength below 495 nm).
- a projector 132 is configured to sequentially project light of each of three colors (e.g., red, green, and blue) during three respective color sub frames spanning three time periods.
- the projector control data 314 that controls the timing and color of the light projected by the projector 132 may be synchronized with control data provided to a controller (not shown) such that the controller drives the DOE driver 318 to stimulate each color-specific DOE appropriately during each time period.
- the DOE driver stimulates the first input DOE 802 and first output DOE 804 to have high diffraction efficiency relative to the other color specific DOEs in the stack (as described below with reference to FIG. 9 and FIG. 10). This causes the light of the first color (e.g., blue light) projected by the projector 132 to diffract at the first input DOE 802, thereby optimizing the amount of light propagating via TIR.
- the first output DOE 804 the light of the first color is again optimally diffracted as first output ray 806 and then second output ray 808.
- FIG. 9 illustrates the color sequential waveguide 810 of FIG. 8, showing an activated second input DOE 902 and an activated second output DOE 904, both optimized to diffract light of a second color (e.g., green), during a second period (e.g., a green color sub frame).
- a second color e.g., green
- a second period e.g., a green color sub frame
- the first input DOE 802 and first output DOE 804 are deactivated (e.g., have a minimal diffraction efficiency), while the second input DOE 902 and second output DOE 904 are activated, causing the light of the second color to optimally diffract into TIR upon encountering second input DOE 902, and to optimally diffract out of the waveguide as first output ray 906 and then second output ray 908 upon encountering the second output DOE 904.
- FIG. 10 illustrates the color sequential waveguide 810 of FIG. 8, showing an activated third input DOE 1002 and an activated third output DOE 1004, both optimized to diffract light of a third color (e.g., red), during a third period (e.g., a red color sub frame).
- a third color e.g., red
- a third period e.g., a red color sub frame
- the first input DOE 802, first output DOE 804, second input DOE 902, and second output DOE 904 are deactivated (e.g., have a minimal diffraction efficiency), while the third input DOE 1002 and third output DOE 1004 are activated, causing the light of the third color to optimally diffract into TIR upon encountering third input DOE 1002, and to optimally diffract out of the waveguide as first output ray 1006 and then second output ray 1008 upon encountering the third output DOE 1004.
- the third input DOE 1002 and third output DOE 1004 are activated, causing the light of the third color to optimally diffract into TIR upon encountering third input DOE 1002, and to optimally diffract out of the waveguide as first output ray 1006 and then second output ray 1008 upon encountering the third output DOE 1004.
- the DOEs selectively propagate light according to timevarying conditions, and the time-varying conditions comprise a temporal sequence of colorspecific periods includes a first period in which light of a first color propagates within the waveguide body, and a second period in which light of a second color propagates within the waveguide body.
- the one or more DOEs comprise a first one or more DOEs (e.g., first input DOE 802 and first output DOE 804) configured to diffract light of the first color, and a second one or more DOEs (e.g., second input DOE 902 and second output DOE 904) configured to diffract light of the second color.
- the stimuli are configured to increase the diffraction efficiency of the first one or more DOEs relative to the diffraction efficiency of the second one or more DOEs during the first period, and increase the diffraction efficiency of the second one or more DOEs relative to the diffraction efficiency of the first one or more DOEs during the second period.
- the first one or more output DOEs and the second one or more output DOEs may be arranged in a stacked configuration such that during the first period, relatively more light enters the first one or more output DOEs and is diffracted out of the output surface by the first one or more output DOEs, and during the second period, relatively more light passes through the first one or more output DOEs, enters the second one or more output DOEs, and is diffracted out of the output surface by the second one or more output DOEs.
- the first one or more DOEs further comprise a first one or more input DOEs (e.g., first input DOE 802) configured to diffract light of the first color into the waveguide body at an angle sufficient to achieve the total internal reflection.
- the second one or more DOEs further comprise a second one or more input DOEs (e.g., second input DOE 902) configured to diffract light of the second color into the waveguide body at an angle sufficient to achieve total internal reflection.
- the first one or more input DOEs and the second one or more input DOEs may be arranged in a stacked configuration such that during the first period, relatively more light enters the first one or more input DOEs and is diffracted into the waveguide body by the first one or more input DOEs, and during the second period, relatively more light passes through the first one or more input DOEs, enters the second one or more input DOEs, and is diffracted into the waveguide body by the second one or more output DOEs.
- the stacked arrangements do not include air gaps between the first one or more output DOEs and the second one or more output DOEs (e.g., between first output DOE 804 and second output DOE 904), or between the first one or more input DOEs and the second one or more input DOEs (e.g., between first input DOE 802 and second input DOE 902).
- FIG. 11 is a diagrammatic representation of the machine 1100 within which instructions 1102 (e.g., software, a program, an application, an applet, an app, or other executable code) for causing the machine 1100 to perform any one or more of the methodologies discussed herein may be executed.
- the instructions 1102 may cause the machine 1100 to execute any one or more of the methods described herein.
- the instructions 1102 transform the general, non-programmed machine 1100 into a particular machine 1100 programmed to carry out the described and illustrated functions in the manner described.
- the machine 1100 may operate as a standalone device or may be coupled (e.g., networked) to other machines.
- the machine 1100 may operate in the capacity of a server machine or a client machine in a server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment.
- the machine 1100 may comprise, but not be limited to, a server computer, a client computer, a personal computer (PC), a tablet computer, a laptop computer, a netbook, a set- top box (STB), a personal digital assistant (PDA), an entertainment media system, a cellular telephone, a smartphone, a mobile device, a wearable device (e.g., a smartwatch, a pair of augmented reality glasses), a smart home device (e.g., a smart appliance), other smart devices, a web appliance, a network router, a network switch, a network bridge, or any machine capable of executing the instructions 1102, sequentially or otherwise, that specify actions to be taken by the machine 1100.
- PC personal computer
- PDA personal digital assistant
- STB set- top box
- STB set
- machine shall also be taken to include a collection of machines that individually or jointly execute the instructions 1102 to perform any one or more of the methodologies discussed herein.
- the machine 1100 may comprise both client and server systems, with certain operations of a particular method or algorithm being performed on the server-side and with certain operations of the particular method or algorithm being performed on the client-side.
- the machine 1100 may include processors 1104, memory 1106, and input/output I/O components 1108, which may be configured to communicate with each other via a bus 1110.
- the processors 1104 may include, for example, a processor 1112 and a processor 1114 that execute the instructions 1102.
- processor is intended to include multi-core processors that may comprise two or more independent processors (sometimes referred to as “cores”) that may execute instructions contemporaneously.
- the machine 1100 may include a single processor with a single-core, a single processor with multiple cores (e.g., a multi-core processor), multiple processors with a single core, multiple processors with multiples cores, or any combination thereof.
- a single processor with a single-core e.g., a single processor with multiple cores
- multiple processors with a single core e.g., multiple processors with multiples cores, or any combination thereof.
- the memory 1106 includes a main memory 1116, a static memory 1118, and a storage unit 1120, both accessible to the processors 1104 via the bus 1110.
- the main memory 1106, the static memory 1118, and storage unit 1120 store the instructions 1102 embodying any one or more of the methodologies or functions described herein.
- the instructions 1102 may also reside, completely or partially, within the main memory 1116, within the static memory 1118, within machine-readable medium 1122 within the storage unit 1120, within at least one of the processors 1104 (e.g., within the processor’s cache memory), or any suitable combination thereof, during execution thereof by the machine 1100.
- the I/O components 1108 may include a wide variety of components to receive input, provide output, produce output, transmit information, exchange information, capture measurements, and so on.
- the specific I/O components 1108 that are included in a particular machine will depend on the type of machine. For example, portable machines such as mobile phones may include a touch input device or other such input mechanisms, while a headless server machine will likely not include such a touch input device. It will be appreciated that the I/O components 1108 may include many other components that are not shown in FIG. 11. In various examples, the I/O components 1108 may include user output components 1124 and user input components 1126.
- the user output components 1124 may include visual components (e.g., a display such as a waveguide and/or projector as described herein, a plasma display panel (PDP), a light-emitting diode (LED) display, a liquid crystal display (LCD), a projector, or a cathode ray tube (CRT)), acoustic components (e.g., speakers), haptic components (e.g., a vibratory motor, resistance mechanisms), other signal generators, and so forth.
- visual components e.g., a display such as a waveguide and/or projector as described herein, a plasma display panel (PDP), a light-emitting diode (LED) display, a liquid crystal display (LCD), a projector, or a cathode ray tube (CRT)
- acoustic components e.g., speakers
- haptic components e.g., a vibratory motor, resistance mechanisms
- the user input components 1126 may include alphanumeric input components (e.g., a keyboard, a touch screen configured to receive alphanumeric input, a photo-optical keyboard, or other alphanumeric input components), point-based input components (e.g., a mouse, a touchpad, a trackball, a joystick, a motion sensor, or another pointing instrument), tactile input components (e.g., a physical button, a touch screen that provides location and force of touches or touch gestures, or other tactile input components), audio input components (e.g., a microphone), and the like.
- alphanumeric input components e.g., a keyboard, a touch screen configured to receive alphanumeric input, a photo-optical keyboard, or other alphanumeric input components
- point-based input components e.g., a mouse, a touchpad, a trackball, a joystick, a motion sensor, or another pointing instrument
- tactile input components e.g., a physical button,
- the I/O components 1108 may include biometric components 1128, motion components 1130, environmental components 1132, or position components 1134, among a wide array of other components.
- the biometric components 1128 include components to detect expressions (e.g., hand expressions, facial expressions, vocal expressions, body gestures, or eye-tracking), measure biosignals (e.g., blood pressure, heart rate, body temperature, perspiration, or brain waves), identify a person (e.g., voice identification, retinal identification, facial identification, fingerprint identification, or electroencephalogram-based identification), and the like.
- the motion components 1130 include acceleration sensor components (e.g., accelerometer), gravitation sensor components, rotation sensor components (e.g., gyroscope).
- the environmental components 1132 include, for example, one or more cameras (with still image/photograph and video capabilities), illumination sensor components (e.g., photometer), temperature sensor components (e.g., one or more thermometers that detect ambient temperature), humidity sensor components, pressure sensor components (e.g., barometer), acoustic sensor components (e.g., one or more microphones that detect background noise), proximity sensor components (e.g., infrared sensors that detect nearby objects), gas sensors (e.g., gas detection sensors to detection concentrations of hazardous gases for safety or to measure pollutants in the atmosphere), depth sensors (such as one or more LIDAR arrays), or other components that may provide indications, measurements, or signals corresponding to a surrounding physical environment.
- illumination sensor components e.g., photometer
- temperature sensor components e.g., one or more thermometers that detect ambient temperature
- humidity sensor components e.g., pressure sensor components (e.g., barometer)
- acoustic sensor components e.g., one or more
- the machine 1100 may have a camera system comprising, for example, front cameras on a front surface of the machine 1100 and rear cameras on a rear surface of the machine 1100.
- the front cameras may, for example, be used to capture still images and video of a user of the machine 1100 (e.g., “selfies”), which may then be augmented with augmentation data (e.g., filters) described above.
- the rear cameras may, for example, be used to capture still images and videos in a more traditional camera mode, with these images similarly being augmented with augmentation data.
- the machine 1100 may also include a 360° camera for capturing 360° photographs and videos.
- the camera system of the machine 1100 may include dual rear cameras (e.g., a primary camera as well as a depth-sensing camera), or even triple, quad or penta rear camera configurations on the front and rear sides of the machine 1100.
- These multiple cameras systems may include a wide camera, an ultra-wide camera, a telephoto camera, a macro camera, and a depth sensor, for example.
- the system may additionally include infrared cameras to permit hand gesture tracking, eye position tracking or night vision, for example.
- the position components 1134 include location sensor components (e.g., a GPS receiver component), altitude sensor components (e.g., altimeters or barometers that detect air pressure from which altitude may be derived), orientation sensor components (e.g., magnetometers), and the like.
- location sensor components e.g., a GPS receiver component
- altitude sensor components e.g., altimeters or barometers that detect air pressure from which altitude may be derived
- orientation sensor components e.g., magnetometers
- the I/O components 1108 further include communication components 1136 operable to couple the machine 1100 to a network 1138 or devices 1140 via respective coupling or connections.
- the communication components 1136 may include a network interface component or another suitable device to interface with the network 1138.
- the communication components 1136 may include wired communication components, wireless communication components, cellular communication components, satellite communication, Near Field Communication (NFC) components, Bluetooth® components (e.g., Bluetooth® Low Energy), Wi-Fi® components, Zigbee, Ant+, and other communication components to provide communication via other modalities.
- the devices 1140 may be another machine or any of a wide variety of peripheral devices (e.g., a peripheral device coupled via a USB).
- the communication components 1136 may detect identifiers or include components operable to detect identifiers.
- the communication components 1136 may include Radio Frequency Identification (RFID) tag reader components, NFC smart tag detection components, optical reader components (e.g., an optical sensor to detect one-dimensional bar codes such as Universal Product Code (UPC) bar code, multidimensional bar codes such as Quick Response (QR) code, Aztec code, Data Matrix, DataglyphTM, MaxiCode, PDF417, Ultra Code, UCC RSS-2D bar code, and other optical codes), or acoustic detection components (e.g., microphones to identify tagged audio signals).
- a variety of information may be derived via the communication components 1136, such as location via Internet Protocol (IP) geolocation, location via Wi-Fi® signal triangulation, location via detecting an NFC beacon signal that may indicate a particular location, and so forth.
- IP Internet Protocol
- Wi-Fi® Wireless Fidelity
- the various memories may store one or more sets of instructions and data structures (e.g., software) embodying or used by any one or more of the methodologies or functions described herein.
- These instructions e.g., the instructions 1102
- processors 1104 when executed by processors 1104, cause various operations to implement the disclosed examples.
- the instructions 1102 may be transmitted or received over the network 1138, using a transmission medium, via a network interface device (e.g., a network interface component included in the communication components 1136) and using any one of several well-known transfer protocols (e.g., hypertext transfer protocol (HTTP)). Similarly, the instructions 1102 may be transmitted or received using a transmission medium via a coupling (e.g., a peer-to-peer coupling) to the devices 1140.
- a network interface device e.g., a network interface component included in the communication components 1136) and using any one of several well-known transfer protocols (e.g., hypertext transfer protocol (HTTP)
- HTTP hypertext transfer protocol
- the instructions 1102 may be transmitted or received using a transmission medium via a coupling (e.g., a peer-to-peer coupling) to the devices 1140.
- FIG. 12 is a block diagram 1200 illustrating a software architecture 1202, which can be installed on any one or more of the devices described herein.
- the software architecture 1202 is supported by hardware such as a machine 1204 that includes processors 1206, memory 1208, and I/O components 1210.
- the software architecture 1202 can be conceptualized as a stack of layers, where each layer provides a particular functionality.
- the software architecture 1202 includes layers such as an operating system 1212, libraries 1214, frameworks 1216, and applications 1218.
- the applications 1218 invoke API calls 1220 through the software stack and receive messages 1222 in response to the API calls 1220.
- the operating system 1212 manages hardware resources and provides common services.
- the operating system 1212 includes, for example, a kernel 1224, services 1226, and drivers 1228.
- the kernel 1224 acts as an abstraction layer between the hardware and the other software layers.
- the kernel 1224 provides memory management, processor management (e.g., scheduling), component management, networking, and security settings, among other functionalities.
- the services 1226 can provide other common services for the other software layers.
- the drivers 1228 are responsible for controlling or interfacing with the underlying hardware.
- the drivers 1228 can include display drivers, camera drivers, BLUETOOTH® or BLUETOOTH® Low Energy drivers, flash memory drivers, serial communication drivers (e.g., USB drivers), WI-FI® drivers, audio drivers, power management drivers, and so forth.
- the libraries 1214 provide a common low-level infrastructure used by the applications 1218.
- the libraries 1214 can include system libraries 1230 (e.g., C standard library) that provide functions such as memory allocation functions, string manipulation functions, mathematic functions, and the like.
- the libraries 1214 can include API libraries 1232 such as media libraries (e.g., libraries to support presentation and manipulation of various media formats such as Moving Picture Experts Group-4 (MPEG4), Advanced Video Coding (H.264 or AVC), Moving Picture Experts Group Layer-3 (MP3), Advanced Audio Coding (AAC), Adaptive Multi-Rate (AMR) audio codec, Joint Photographic Experts Group (JPEG or JPG), or Portable Network Graphics (PNG)), graphics libraries (e.g., an OpenGL framework used to render in two dimensions (2D) and three dimensions (3D) in a graphic content on a display), database libraries (e.g., SQLite to provide various relational database functions), web libraries (e.g., WebKit to provide web browsing functionality), and the like.
- the libraries 1214 can also include a wide variety of other libraries 1234 to provide many other APIs to the applications 1218.
- the frameworks 1216 provide a common high-level infrastructure that is used by the applications 1218.
- the frameworks 1216 provide various graphical user interface (GUI) functions, high-level resource management, and high-level location services.
- GUI graphical user interface
- the frameworks 1216 can provide a broad spectrum of other APIs that can be used by the applications 1218, some of which may be specific to a particular operating system or platform.
- the applications 1218 may include a home application 1236, a location application 1238, and a broad assortment of other applications such as a third-party application 1240.
- the applications 1218 are programs that execute functions defined in the programs.
- Various programming languages can be employed to create one or more of the applications 1218, structured in a variety of manners, such as object-oriented programming languages (e.g., Objective-C, Java, or C++) or procedural programming languages (e.g., C or assembly language).
- the third-party application 1240 may be mobile software running on a mobile operating system such as IOSTM, ANDROIDTM, WINDOWS® Phone, or another mobile operating system.
- the third-party application 1240 can invoke the API calls 1220 provided by the operating system 1212 to facilitate functionalities described herein.
- FIG. 13 shows steps of an example method 1300 of controlling adjustable DOEs of a waveguide as described above.
- light is propagated within a waveguide body 142 in one or more directions (e.g., direction 140, or directions 430, 432) substantially tangential to an output surface 138 of the waveguide body 142.
- method 1300 provides a respective stimulus to each of one or more diffractive optical elements (DOEs) independently.
- DOE diffractive optical elements
- Each DOE is configured to change its diffraction efficiency in response to the respective stimulus, such that at least a portion of the light propagating in the waveguide body 142 is diffracted by the one or more DOEs.
- examples described herein may address one or more technical problems associated with diffractive waveguides.
- Efficiency of an image projection system may be increased.
- the intensity of light projected toward the user's eye may be increased.
- the optical power needs of such a projection system may be decreased.
- Stray light may be reduced, thereby improving image quality.
- Light loss, ghosting, and/or stray lighting effects caused by color-specific DOEs may be reduced.
- the brightness of ambient stray light artifacts (e.g., rainbow effects) may be reduced.
- the need for air gaps inserted in between each adjacent pair of stacked colors-specific DOEs may be eliminated.
- a waveguide, method, and computer-readable medium may be provided.
- Example l is a waveguide, comprising: a waveguide body comprising an optically transmissive material having a refractive index different from a surrounding medium and defining an output surface, configured to propagate light by total internal reflection in one or more directions substantially tangential to the output surface; one or more diffractive optical elements (DOEs), each configured to change its diffraction efficiency in response to a respective stimulus; and a DOE driver configured to provide the respective stimuli to each of the DOEs independently.
- DOEs diffractive optical elements
- Example 2 the subject matter of Example 1 includes, wherein: the stimuli provided to the DOEs are configured to direct the light toward a target region by diffracting the light out of the waveguide body via the output surface.
- Example 3 the subject matter of Example 2 includes, wherein: the one or more DOEs comprise: a first one or more output DOEs configured to diffract light out of the output surface toward the target region; and a second one or more output DOEs configured to diffract light out of the output surface toward a location outside of the target region; and the stimuli provided to the DOEs are configured to increase the diffraction efficiency of the first one or more output DOEs relative to the diffraction efficiency of the second one or more output DOEs.
- the one or more DOEs comprise: a first one or more output DOEs configured to diffract light out of the output surface toward the target region; and a second one or more output DOEs configured to diffract light out of the output surface toward a location outside of the target region; and the stimuli provided to the DOEs are configured to increase the diffraction efficiency of the first one or more output DOEs relative to the diffraction efficiency of the second one or more output DOEs.
- Example 4 the subject matter of Example 3 includes, wherein increasing the diffraction efficiency of the first one or more output DOEs relative to the diffraction efficiency of the second one or more output DOEs comprises: increasing the diffraction efficiency of the first one or more output DOEs.
- Example 5 the subject matter of Examples 3-4 includes, wherein increasing the diffraction efficiency of the first one or more output DOEs relative to the diffraction efficiency of the second one or more output DOEs comprises: decreasing the diffraction efficiency of the second one or more output DOEs.
- Example 6 the subject matter of Examples 3-5 includes, a controller configured to: receive target region data; and control the DOE driver to provide the stimuli based on the target region data.
- Example 7 the subject matter of Example 6 includes, wherein: the target region comprises a location of an eye; and the target region data comprises eye tracking data representative of the location of the eye.
- Example 8 the subject matter of Examples 2-7 includes, wherein: the one or more DOEs comprise: a fold DOE configured to diffract light propagating in a first direction of the one or more directions to propagate in a second direction of the one or more directions; the light propagating in the second direction is more likely to reach the target region than the light propagating in the first direction; and the stimuli provided to the DOEs are configured to increase the diffraction efficiency of the fold DOE such that an amount of light diffracted to propagate in the second direction is increased.
- the one or more DOEs comprise: a fold DOE configured to diffract light propagating in a first direction of the one or more directions to propagate in a second direction of the one or more directions; the light propagating in the second direction is more likely to reach the target region than the light propagating in the first direction; and the stimuli provided to the DOEs are configured to increase the diffraction efficiency of the fold DOE such that an amount of light diffracted to propagate in the second direction is increased.
- Example 9 the subject matter of Examples 1-8 includes, wherein: the stimuli provided to the DOEs are configured to selectively propagate light according to timevarying conditions.
- Example 10 the subject matter of Example 9 includes, wherein: the time-varying conditions comprise a temporal sequence of color-specific periods comprising: a first period in which light of a first color propagates within the waveguide body; and a second period in which light of a second color propagates within the waveguide body; the one or more DOEs comprise: a first one or more DOEs configured to diffract light of the first color; and a second one or more DOEs configured to diffract light of the second color; and the stimuli are configured to: increase the diffraction efficiency of the first one or more DOEs relative to the diffraction efficiency of the second one or more DOEs during the first period; and increase the diffraction efficiency of the second one or more DOEs relative to the diffraction efficiency of the first one or more DOEs during the second period.
- the time-varying conditions comprise a temporal sequence of color-specific periods comprising: a first period in which light of a first color propagates within the waveguide body; and a second period in which light of a second
- Example 11 the subject matter of Example 10 includes, wherein: the first one or more DOEs comprise a first one or more output DOEs configured to diffract light of the first color out of the output surface; the second one or more DOEs comprise a second one or more output DOEs configured to diffract light of the second color out of the output surface; and the first one or more output DOEs and the second one or more output DOEs are arranged in a stacked configuration such that: during the first period, relatively more light enters the first one or more output DOEs and is diffracted out of the output surface by the first one or more output DOEs; and during the second period, relatively more light passes through the first one or more output DOEs, enters the second one or more output DOEs, and is diffracted out of the output surface by the second one or more output DOEs.
- Example 14 the subject matter of Examples 1-13 includes, wherein: the stimuli comprise a physical deformation of at least one DOE.
- Example 17 the subject matter of Example 16 includes, wherein: the at least one DOE comprises a liquid crystal material.
- Example 18 the subject matter of Examples 1-17 includes, wherein: the optically transmissive material comprises a dielectric material.
- Example 19 the subject matter of Examples 1-18 includes, wherein: the optically transmissive material comprises a plastic material.
- Example 20 the subject matter of Examples 1-19 includes, wherein: the optically transmissive material comprises a glass material.
- Example 21 is a method comprising: propagating light within a waveguide body in one or more directions substantially tangential to an output surface of the waveguide body; and providing a respective stimulus to each of one or more diffractive optical elements (DOEs) independently, each DOE being configured to change its diffraction efficiency in response to the respective stimulus, such that at least a portion of the light propagating in the waveguide body is diffracted by the one or more DOEs.
- DOEs diffractive optical elements
- Example 22 is a non-transitory computer-readable storage medium, the computer- readable storage medium including instructions that, when executed by a computer, cause the computer to perform operations including: providing a respective stimulus to each of one or more diffractive optical elements (DOEs) independently, each DOE being configured to change its diffraction efficiency in response to the respective stimulus, such that at least a portion of the light propagating in a waveguide body is diffracted by the one or more DOEs.
- DOEs diffractive optical elements
- Example 23 is at least one machine-readable medium including instructions that, when executed by processing circuitry, cause the processing circuitry to perform operations to implement of any of Examples 1-22.
- Example 24 is an apparatus comprising means to implement of any of Examples 1- 22.
- Example 25 is a system to implement of any of Examples 1-22.
- Example 26 is a method to implement of any of Examples 1-22.
- AR Augmented reality
- AR refers, for example, to an interactive experience of a real -world environment where physical objects that reside in the real -world are “augmented” or enhanced by computer-generated digital content (also referred to as virtual content or synthetic content).
- AR can also refer to a system that enables a combination of real and virtual worlds, real-time interaction, and 3D registration of virtual and real objects.
- a user of an AR system perceives virtual content that appear to be attached or interact with a real -world physical object.
- Component refers, for example, to a device, physical entity, or logic having boundaries defined by function or subroutine calls, branch points, APIs, or other technologies that provide for the partitioning or modularization of particular processing or control functions. Components may be combined via their interfaces with other components to carry out a machine process.
- a component may be a packaged functional hardware unit designed for use with other components and a part of a program that usually performs a particular function of related functions.
- Components may constitute either software components (e.g., code embodied on a machine-readable medium) or hardware components.
- a "hardware component” is a tangible unit capable of performing certain operations and may be configured or arranged in a certain physical manner.
- one or more computer systems may be configured by software (e.g., an application or application portion) as a hardware component that operates to perform certain operations as described herein.
- a hardware component may also be implemented mechanically, electronically, or any suitable combination thereof.
- a hardware component may include dedicated circuitry or logic that is permanently configured to perform certain operations.
- a hardware component may be a special-purpose processor, such as a field- programmable gate array (FPGA) or an application-specific integrated circuit (ASIC).
- FPGA field- programmable gate array
- ASIC application-specific integrated circuit
- a hardware component may also include programmable logic or circuitry that is temporarily configured by software to perform certain operations.
- a hardware component may include software executed by a general-purpose processor or other programmable processors. Once configured by such software, hardware components become specific machines (or specific components of a machine) uniquely tailored to perform the configured functions and are no longer general-purpose processors. It will be appreciated that the decision to implement a hardware component mechanically, in dedicated and permanently configured circuitry, or in temporarily configured circuitry (e.g., configured by software), may be driven by cost and time considerations.
- the phrase "hardware component”(or “hardware-implemented component”) should be understood to encompass a tangible entity, be that an entity that is physically constructed, permanently configured (e.g., hardwired), or temporarily configured (e.g., programmed) to operate in a certain manner or to perform certain operations described herein.
- hardware components are temporarily configured (e.g., programmed)
- each of the hardware components need not be configured or instantiated at any one instance in time.
- a hardware component comprises a general-purpose processor configured by software to become a special-purpose processor
- the general-purpose processor may be configured as respectively different special-purpose processors (e.g., comprising different hardware components) at different times.
- Hardware components can provide information to, and receive information from, other hardware components. Accordingly, the described hardware components may be regarded as being communicatively coupled. Where multiple hardware components exist contemporaneously, communications may be achieved through signal transmission (e.g., over appropriate circuits and buses) between or among two or more of the hardware components. In examples in which multiple hardware components are configured or instantiated at different times, communications between such hardware components may be achieved, for example, through the storage and retrieval of information in memory structures to which the multiple hardware components have access.
- one hardware component may perform an operation and store the output of that operation in a memory device to which it is communicatively coupled. A further hardware component may then, at a later time, access the memory device to retrieve and process the stored output. Hardware components may also initiate communications with input or output devices, and can operate on a resource (e.g., a collection of information).
- a resource e.g., a collection of information.
- the various operations of example methods described herein may be performed, at least partially, by one or more processors that are temporarily configured (e.g., by software) or permanently configured to perform the relevant operations. Whether temporarily or permanently configured, such processors may constitute processor-implemented components that operate to perform one or more operations or functions described herein.
- processor-implemented component refers to a hardware component implemented using one or more processors.
- the methods described herein may be at least partially processor-implemented, with a particular processor or processors being an example of hardware. For example, at least some of the operations of a method may be performed by one or more processors or processor-implemented components.
- the one or more processors may also operate to support performance of the relevant operations in a "cloud computing" environment or as a "software as a service” (SaaS).
- the operations may be performed by a group of computers (as examples of machines including processors), with these operations being accessible via a network (e.g., the Internet) and via one or more appropriate interfaces (e.g., an Application Programming Interface (API)).
- the performance of certain of the operations may be distributed among the processors, not only residing within a single machine, but deployed across a number of machines.
- the processors or processor-implemented components may be located in a single geographic location (e.g., within a home environment, an office environment, or a server farm). In other examples, the processors or processor-implemented components may be distributed across a number of geographic locations.
- Computer-readable storage medium refers, for example, to both machine-storage media and transmission media. Thus, the terms include both storage devices/media and carrier waves/modulated data signals.
- machine-readable medium “computer- readable medium” and “device-readable medium” mean the same thing and may be used interchangeably in this disclosure.
- Machine storage medium refers, for example, to a single or multiple storage devices and media (e.g., a centralized or distributed database, and associated caches and servers) that store executable instructions, routines and data.
- the term shall accordingly be taken to include, but not be limited to, solid-state memories, and optical and magnetic media, including memory internal or external to processors.
- machinestorage media, computer-storage media and device-storage media include non-volatile memory, including by way of example semiconductor memory devices, e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), FPGA, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; USB flash drives; and CD-ROM and DVD-ROM disks.
- semiconductor memory devices e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), FPGA, and flash memory devices
- magnetic disks such as internal hard disks and removable disks
- magneto-optical disks magneto-optical disks
- USB flash drives and CD-ROM and DVD-ROM disks.
- CD-ROM and DVD-ROM disks CD-ROM and DVD-ROM disks.
- Non-transitory computer-readable storage medium refers, for example, to a tangible medium that is capable of storing, encoding, or carrying the instructions for execution by a machine.
- User device refers, for example, to a device accessed, controlled or owned by a user and with which the user interacts perform an action, or an interaction with other users or computer systems.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Diffracting Gratings Or Hologram Optical Elements (AREA)
- Optical Integrated Circuits (AREA)
- Optical Couplings Of Light Guides (AREA)
Abstract
Description
Claims
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US202263354821P | 2022-06-23 | 2022-06-23 | |
| US18/305,953 US20230418071A1 (en) | 2022-06-23 | 2023-04-24 | Augmented reality waveguides with dynamically addressable diffractive optical elements |
| PCT/US2023/025222 WO2023249844A1 (en) | 2022-06-23 | 2023-06-13 | Waveguides with dynamically addressable diffractive optical elements c |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4544339A1 true EP4544339A1 (en) | 2025-04-30 |
Family
ID=87201994
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP23739732.8A Pending EP4544339A1 (en) | 2022-06-23 | 2023-06-13 | Waveguides with dynamically addressable diffractive optical elements |
Country Status (4)
| Country | Link |
|---|---|
| EP (1) | EP4544339A1 (en) |
| KR (1) | KR20250021389A (en) |
| CN (1) | CN119404129A (en) |
| WO (1) | WO2023249844A1 (en) |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013033274A1 (en) * | 2011-08-29 | 2013-03-07 | Vuzix Corporation | Controllable waveguide for near-eye display applications |
| US9411210B2 (en) * | 2013-03-28 | 2016-08-09 | Panasonic Intellectual Property Management Co., Ltd. | Image display device |
-
2023
- 2023-06-13 KR KR1020257001995A patent/KR20250021389A/en active Pending
- 2023-06-13 CN CN202380048678.4A patent/CN119404129A/en active Pending
- 2023-06-13 WO PCT/US2023/025222 patent/WO2023249844A1/en not_active Ceased
- 2023-06-13 EP EP23739732.8A patent/EP4544339A1/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| CN119404129A (en) | 2025-02-07 |
| KR20250021389A (en) | 2025-02-12 |
| WO2023249844A1 (en) | 2023-12-28 |
| WO2023249844A8 (en) | 2024-10-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11474395B2 (en) | Birefringent polymer based surface relief grating | |
| Koulieris et al. | Near‐eye display and tracking technologies for virtual and augmented reality | |
| US10110883B2 (en) | Bidirectional holographic lens | |
| KR102626911B1 (en) | Systems and methods for manipulating light from ambient light sources | |
| US10108014B2 (en) | Waveguide display with multiple focal depths | |
| US20210199873A1 (en) | Dual-side antireflection coatings for broad angular and wavelength bands | |
| EP4018243A1 (en) | Dispersion compensation in volume bragg grating-based waveguide display | |
| CN112346558A (en) | eye tracking system | |
| US11274807B2 (en) | Integrating point source for texture projecting bulb | |
| US20220291437A1 (en) | Light redirection feature in waveguide display | |
| US20230418071A1 (en) | Augmented reality waveguides with dynamically addressable diffractive optical elements | |
| Peddie et al. | Technology issues | |
| US20200257124A1 (en) | Electronic device | |
| US12512026B2 (en) | Adjustable light field for extended reality | |
| EP4544339A1 (en) | Waveguides with dynamically addressable diffractive optical elements | |
| US12174385B2 (en) | TIR prisms and use of backlight for LCoS microdisplay illumination | |
| WO2022192303A1 (en) | Light redirection feature in waveguide display | |
| US12529936B1 (en) | Waveguide combiner with multiple image planes | |
| WO2025096462A1 (en) | Dynamic push-pull lenses for xr displays |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20250123 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40124531 Country of ref document: HK |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |