WO2018014040A1 - Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays - Google Patents
Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays Download PDFInfo
- Publication number
- WO2018014040A1 WO2018014040A1 PCT/US2017/042462 US2017042462W WO2018014040A1 WO 2018014040 A1 WO2018014040 A1 WO 2018014040A1 US 2017042462 W US2017042462 W US 2017042462W WO 2018014040 A1 WO2018014040 A1 WO 2018014040A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- energy
- modulation element
- relay system
- waveguide relay
- waveguide
- Prior art date
Links
- 238000003491 array Methods 0.000 title description 4
- 239000002096 quantum dot Substances 0.000 claims description 12
- 230000006870 function Effects 0.000 abstract description 82
- 230000003190 augmentative effect Effects 0.000 abstract description 5
- 230000001953 sensory effect Effects 0.000 description 27
- 238000013461 design Methods 0.000 description 23
- 238000005516 engineering process Methods 0.000 description 21
- 238000000034 method Methods 0.000 description 21
- 230000000007 visual effect Effects 0.000 description 17
- 230000004807 localization Effects 0.000 description 14
- 238000013459 approach Methods 0.000 description 13
- 239000000463 material Substances 0.000 description 12
- 238000004519 manufacturing process Methods 0.000 description 11
- 230000000644 propagated effect Effects 0.000 description 11
- 238000005070 sampling Methods 0.000 description 9
- 210000002265 sensory receptor cell Anatomy 0.000 description 9
- 102000027509 sensory receptors Human genes 0.000 description 9
- 108091008691 sensory receptors Proteins 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 230000003287 optical effect Effects 0.000 description 8
- 239000013307 optical fiber Substances 0.000 description 8
- 230000001902 propagating effect Effects 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 7
- 230000008901 benefit Effects 0.000 description 5
- 230000004044 response Effects 0.000 description 5
- 230000003238 somatosensory effect Effects 0.000 description 5
- 230000004304 visual acuity Effects 0.000 description 5
- 230000002457 bidirectional effect Effects 0.000 description 4
- 239000000835 fiber Substances 0.000 description 4
- 238000005286 illumination Methods 0.000 description 4
- 230000002401 inhibitory effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000000926 separation method Methods 0.000 description 4
- 230000003595 spectral effect Effects 0.000 description 4
- 230000004888 barrier function Effects 0.000 description 3
- 230000004438 eyesight Effects 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 238000009434 installation Methods 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000000638 stimulation Effects 0.000 description 3
- 208000033962 Fontaine progeroid syndrome Diseases 0.000 description 2
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000005253 cladding Methods 0.000 description 2
- 230000001427 coherent effect Effects 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000001747 exhibiting effect Effects 0.000 description 2
- 230000001339 gustatory effect Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000001788 irregular Effects 0.000 description 2
- 230000000670 limiting effect Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 239000003973 paint Substances 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 230000010287 polarization Effects 0.000 description 2
- 230000035807 sensation Effects 0.000 description 2
- 229910052710 silicon Inorganic materials 0.000 description 2
- 239000010703 silicon Substances 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- 229910000497 Amalgam Inorganic materials 0.000 description 1
- 235000002566 Capsicum Nutrition 0.000 description 1
- 206010027646 Miosis Diseases 0.000 description 1
- 239000006002 Pepper Substances 0.000 description 1
- 235000016761 Piper aduncum Nutrition 0.000 description 1
- 235000017804 Piper guineense Nutrition 0.000 description 1
- 244000203593 Piper nigrum Species 0.000 description 1
- 235000008184 Piper nigrum Nutrition 0.000 description 1
- 230000004308 accommodation Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 210000002858 crystal cell Anatomy 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 230000005670 electromagnetic radiation Effects 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 239000000839 emulsion Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000035800 maturation Effects 0.000 description 1
- 238000010297 mechanical methods and process Methods 0.000 description 1
- 230000005226 mechanical processes and functions Effects 0.000 description 1
- 230000003547 miosis Effects 0.000 description 1
- 238000000059 patterning Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
- 238000005381 potential energy Methods 0.000 description 1
- 108090000623 proteins and genes Proteins 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 230000002207 retinal effect Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000021317 sensory perception Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000008685 targeting Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001720 vestibular Effects 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/0005—Adaptation of holography to specific applications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/50—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels
- G02B30/56—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels by projecting aerial or floating images
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2294—Addressing the hologram to an active spatial light modulator
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/0005—Adaptation of holography to specific applications
- G03H2001/0088—Adaptation of holography to specific applications for video-holography, i.e. integrating hologram acquisition, transmission and display
Definitions
- This disclosure generally relates to light field and 4D energy modulation systems, and more specifically, to holographic propagation through energy waveguide relay systems for superimposition of digital opacity into a real-world coordinate system.
- a transparent display system includes: a first energy waveguide relay system configured such that energy passing therethrough is directed according to a first 4D plenoptic function; a second energy waveguide relay system following the first energy waveguide relay system, the second energy waveguide relay system configured such that energy passing therethrough is directed according to a second 4D plenoptic function, the second 4D plenoptic function inverse of the first 4D plenoptic function; and a first energy modulation element disposed in a first location in the first energy waveguide relay system, in a second location in the second energy waveguide relay system or in a third location in between the first energy waveguide relay system and the second energy waveguide relay system, the first energy modulation element configured to modulate energy passing therethrough.
- the first energy waveguide relay system includes a first array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the first array are located at different spatial coordinates, and where each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the first 4D plenoptic function.
- the second energy waveguide relay system includes a second array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the second array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the second 4D plenoptic function.
- the system further includes a second energy modulation element located in one of the first, second, or third location, the second energy modulation element configured to modulate energy passing therethrough.
- the first and second energy modulation elements are located at the same location. In another embodiment, the first and second energy modulation elements are located at different locations.
- the system further includes third energy modulation element located in one of the first, second, or third location, the third energy modulation element configured to modulate energy passing therethrough.
- the third energy modulation elements and at least one of the first and second energy modulation elements are located at the same location.
- the first, second, and third energy modulation elements are located at the same location. In another embodiment, the first, second, and third energy modulation elements are located at different locations.
- each of the first, second and third energy modulation elements include LCD, LED, DLP, OLED, LCOS, quantum dot, or other suitable energy modulating elements.
- at least one of the first energy waveguide relay system and the second energy waveguide relay system is curved.
- both the first energy waveguide relay system and the second energy waveguide relay system are curved.
- a transparent system includes: a first energy waveguide relay system configured such that energy passing therethrough is directed according to a first 4D plenoptic function; a second energy waveguide relay system following the first energy waveguide relay system, the second energy waveguide relay system configured such that energy passing therethrough is directed according to a second 4D plenoptic function, the second 4D plenoptic function inverse of the first 4D plenoptic function; a first energy modulation element disposed in a first location in the first energy waveguide relay system, in a second location in the second energy waveguide relay system or in a third location in between the first energy waveguide relay system and the second energy waveguide relay system, the first energy modulation element configured to modulate energy passing therethrough; and a second energy modulation element located in one of the first, second, or third location, the second energy modulation element configured to modulate energy passing therethrough.
- the first energy waveguide relay system includes a first array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the first array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the first 4D plenoptic function.
- the second energy waveguide relay system includes a second array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the second array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the second 4D plenoptic function.
- the first and second energy modulation elements are located at the same location. In another embodiment, the first and second energy modulation elements are located at different locations. [0015] In some embodiments, the system further includes a third energy modulation element located in one of the first, second, or third location, the third energy modulation element configured to modulate energy passing therethrough. In one embodiment, the third energy modulation elements and at least one of the first and second energy modulation elements are located at the same location.
- the first, second, and third energy modulation elements are located at the same location. In other embodiments, the first, second, and third energy modulation elements are located at different locations.
- each of the first, second and third energy modulation elements include LCD, LED, DLP, OLED, LCOS, quantum dot, or other suitable energy modulating elements.
- at least one of the first energy waveguide relay system and the second energy waveguide relay system is curved.
- both the first energy waveguide relay system and the second energy waveguide relay system are curved.
- a transparent system includes: a first energy waveguide relay system configured such that energy passing therethrough is directed according to a first 4D plenoptic function; a second energy waveguide relay system following the first energy waveguide relay system, the second energy waveguide relay system configured such that energy passing therethrough is directed according to a second 4D plenoptic function, the second 4D plenoptic function inverse of the first 4D plenoptic function; a first energy modulation element disposed in a first location in the first energy waveguide relay system, in a second location in the second energy waveguide relay system or in a third location in between the first energy waveguide relay system and the second energy waveguide relay system, the first energy modulation element configured to modulate energy passing therethrough; a second energy modulation element located in one of the first, second, or third location, the second energy modulation element configured to modulate energy passing therethrough; and a third energy modulation element located in one of the first, second, or third location, the third energy modulation element configured to modulate energy passing therethrough; and a third
- the first energy waveguide relay system includes a first array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the first array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the first 4D plenoptic function.
- the second energy waveguide relay system includes a second array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the second array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the second 4D plenoptic function.
- the first and second energy modulation elements are located at the same location. In another embodiment, the first and second energy modulation elements are located at different locations. In some embodiments, the third energy modulation elements and at least one of the first and second energy modulation elements are located at the same location. In other embodiments, the first, second, and third energy modulation elements are located at the same location. In yet some other embodiments, the first, second, and third energy modulation elements are located at different locations.
- each of the first, second and third energy modulation elements include LCD, LED, DLP, OLED, LCOS, quantum dot, or other suitable energy modulating elements.
- at least one of the first energy waveguide relay system and the second energy waveguide relay system is curved.
- both the first energy waveguide relay system and the second energy waveguide relay system are curved.
- a transparent display system includes: a first energy waveguide relay system configured such that energy passing therethrough is directed according to a first 4D plenoptic function; a second energy waveguide relay system following the first energy waveguide relay system, the second energy waveguide relay system configured such that energy passing therethrough is directed according to a second 4D plenoptic function, the second 4D plenoptic function inverse of the first 4D plenoptic function; a first energy modulation element disposed in the first energy waveguide relay system; a second energy modulation element disposed in between the first energy waveguide relay system and the second energy waveguide relay system; and a third energy modulation element disposed in the second energy waveguide relay system, where the first, second and third energy modulation elements are configured to modulate energy passing therethrough.
- the first energy waveguide relay system includes a first array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the first array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the first 4D plenoptic function.
- the second energy waveguide relay system includes a second array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the second array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the second 4D plenoptic function.
- each of the first, second and third energy modulation elements include LCD, LED, DLP, OLED, LCOS, quantum dot, or other suitable energy modulating elements.
- the system further includes one or more additional energy modulation elements located in one of the first, second, or third location, the one or more additional energy modulation elements configured to modulate energy passing therethrough.
- the one or more additional energy modulation elements and at least one of the first, second and third energy modulation elements are located at the same location. In another embodiment, the one or more additional energy modulation elements and at least one of the first, second and third energy modulation elements are located at different locations. In one embodiment, at least one of the first energy waveguide relay system and the second energy waveguide relay system is curved. In another embodiment, both the first energy waveguide relay system and the second energy waveguide relay system are curved. [0028] In some embodiments, the first energy modulation element includes white opacity, the second energy modulation element includes an additional opacity or color, and the third energy modulation element includes black opacity.
- the first and third energy modulation element are both
- the second energy modulation element is an LCD such that to present an opaque black color the first modulation element is configured to an off state, the second modulation element is configured to an on state, and the third modulation element can be configured to an on state or an off state.
- the first and third energy modulation element are both
- the second energy modulation element is an LCD such that to present a transparent black color the first modulation element is configured to an off state, the second modulation element is configured to an off state, and the third modulation element is configured to an off state.
- the first and third energy modulation element are both
- the second energy modulation element is an LCD such that to present an opaque red color the first modulation element is configured to a red only on state, the second modulation element can be configured to an on state or an off state, and the third modulation element is configured to an off state.
- the first and third energy modulation element are both
- the second energy modulation element is an LCD such that to present a transparent red color the first modulation element is configured to a red only state at a first percentage, the second modulation element is configured to an off state, and the third modulation element is configured to a red only state at a second percentage, the second percentage different than the first percentage.
- the first and third energy modulation element are both
- the second energy modulation element is an LCD such that to present an opaque grey color the first modulation element is configured to an on state at a first percentage, the second modulation element is configured to an on state, and the third modulation element is configured to an off state.
- the first and third energy modulation element are both
- the second energy modulation element is an LCD such that to present a transparent grey color the first modulation element is configured to an on state at a first percentage, the second modulation element is configured to an off state, and the third modulation element is configured to an on state at a second percentage, the second percentage different than the first percentage.
- FIG. 1 is a schematic diagram illustrating design parameters for an energy directing system
- FIG. 2 is a schematic diagram illustrating an energy waveguide relay system having an active device area with a mechanical envelope
- FIG. 3 is a schematic diagram illustrating an energy relay system
- FIG. 4 is a schematic diagram illustrating an embodiment of energy relay elements adhered together and fastened to a base structure
- FIG. 5A is a schematic diagram illustrating an example of a relayed image through multi-core optical fibers
- FIG. 5B is a schematic diagram illustrating an example of a relayed image through an optical relay that exhibits the properties of the Transverse Anderson Localization principle
- FIG. 6 is a schematic diagram showing rays propagated from an energy surface to a viewer
- FIG. 7 illustrates an orthogonal view of an optical relay system consisting of multiple energy waveguide pairs, in accordance with one embodiment of the present disclosure
- FIG. 8 illustrates an orthogonal view of an increasing size of each energy waveguide pair to account for the scaling of the field of view from the eye relative to the distance from the eye, in accordance with one embodiment of the present disclosure
- FIG. 9 illustrates an orthogonal view of energy waveguides that are both scaled and cylindrically radiating about the rotational axis of the eye, in accordance with one embodiment of the present disclosure
- FIG. 10 illustrates an orthogonal view of a planar approach relative locations of each of three potential displays in reference to energy waveguide pairs, in accordance with one embodiment of the present disclosure
- FIG. 11A illustrates an orthogonal view of a configurations to bond two displays together to increase manufacturing and calibration efficiency, in accordance with one embodiment of the present disclosure
- FIG. 11B illustrates an orthogonal view of a configurations to bond two displays together to increase manufacturing and calibration efficiency, in accordance with one embodiment of the present disclosure
- FIG. 12 illustrates an orthogonal view of an alternative to a volumetric opacity generating display that directly inverts the rays of light such that one or more elements from system may be removed, in accordance with one embodiment of the present disclosure
- FIG. 13 illustrates an orthogonal view of ray propagation paths along a collection of individual elements within a waveguide relay system having multiple energy waveguide relay pairs, in accordance with one embodiment of the present disclosure.
- Holodeck Design An embodiment of a Holodeck (collectively called "Holodeck Design
- Parameters provide sufficient energy stimulus to fool the human sensory receptors into believing that received energy impulses within a virtual, social and interactive environment are real, providing: 1) binocular disparity without external accessories, head-mounted eyewear, or other peripherals; 2) accurate motion parallax, occlusion and opacity throughout a viewing volume simultaneously for any number of viewers; 3) visual focus through synchronous convergence, accommodation and miosis of the eye for all perceived rays of light; and 4) converging energy wave propagation of sufficient density and resolution to exceed the human sensory "resolution" for vision, hearing, touch, taste, smell, and/or balance.
- the terms light field and holographic may be used interchangeably to define the energy propagation for stimulation of any sensory receptor response. While initial disclosures may refer to examples of electromagnetic and mechanical energy propagation through energy surfaces for holographic imagery and volumetric haptics, all forms of sensory receptors are envisioned in this disclosure. Furthermore, the principles disclosed herein for energy propagation along propagation paths may be applicable to both energy emission and energy capture.
- the human acuity of each of the respective systems is studied and understood to propagate energy waves to sufficiently fool the human sensory receptors.
- the visual system is capable of resolving to approximately 1 arc min
- the auditory system may distinguish the difference in placement as little as three degrees
- the somatosensory system at the hands are capable of discerning points separated by 2 - 12mm. While there are various and conflicting ways to measure these acuities, these values are sufficient to understand the systems and methods to stimulate perception of energy propagation.
- a desired energy surface may be designed to include many gigapixels of effective energy location density.
- the design parameters of a desired energy surface may include hundreds of gigapixels or more of effective energy location density.
- a desired energy source may be designed to have 1 to 250 effective megapixels of energy location density for ultrasonic propagation of volumetric haptics or an array of 36 to 3,600 effective energy locations for acoustic propagation of holographic sound depending on input environmental variables.
- all components may be configured to form the appropriate structures for any energy domain to enable holographic propagation.
- the embodiments disclosed herein may provide a real-world path to building the Holodeck.
- Example embodiments will now be described hereinafter with reference to the accompanying drawings, which form a part hereof, and which illustrate example embodiments which may be practiced.
- the terms “embodiment”, “example embodiment”, and “exemplary embodiment” do not necessarily refer to a single embodiment, although they may, and various example embodiments may be readily combined and interchanged, without departing from the scope or spirit of example embodiments.
- the terminology as used herein is for the purpose of describing example embodiments only and is not intended to be limitations.
- the term “in” may include “in” and “on”, and the terms “a,” “an” and “the” may include singular and plural references.
- the term “by” may also mean “from”, depending on the context.
- the term “if” may also mean “when” or “upon,” depending on the context.
- the words “and/or” may refer to and encompass any and all possible combinations of one or more of the associated listed items.
- Light field and holographic display is the result of a plurality of projections where energy surface locations provide angular, color and intensity information propagated within a viewing volume.
- the disclosed energy surface provides opportunities for additional information to coexist and propagate through the same surface to induce other sensory system responses.
- the viewed position of the converged energy propagation paths in space do not vary as the viewer moves around the viewing volume and any number of viewers may simultaneously see propagated objects in real-world space as if it was truly there.
- the propagation of energy may be located in the same energy propagation path but in opposite directions. For example, energy emission and energy capture along an energy propagation path are both possible in some embodiments of the present disclosed.
- FIG. 1 is a schematic diagram illustrating variables relevant for stimulation of sensory receptor response. These variables may include surface diagonal 101, surface width 102, surface height 103, a determined target seating distance 118, the target seating field of view field of view from the center of the display 104, the number of intermediate samples demonstrated here as samples between the eyes 105, the average adult inter-ocular separation 106, the average resolution of the human eye in arcmin 107, the horizontal field of view formed between the target viewer location and the surface width 108, the vertical field of view formed between the target viewer location and the surface height 109, the resultant horizontal waveguide element resolution, or total number of elements, across the surface 110, the resultant vertical waveguide element resolution, or total number of elements, across the surface 111, the sample distance based upon the inter-ocular spacing between the eyes and the number of intermediate samples for angular projection between the eyes 112, the angular sampling may be based upon the sample distance and the target seating distance 113, the total resolution Horizontal per waveguide element derived from the angular sampling desired
- a method to understand the desired minimum resolution may be based upon the following criteria to ensure sufficient stimulation of visual (or other) sensory receptor response: surface size (e.g., 84" diagonal), surface aspect ratio (e.g., 16:9), seating distance (e.g., 128" from the display), seating field of view (e.g., 120 degrees or +/- 60 degrees about the center of the display), desired intermediate samples at a distance (e.g., one additional propagation path between the eyes), the average inter-ocular separation of an adult (approximately 65mm), and the average resolution of the human eye (approximately 1 arcmin).
- surface size e.g., 84" diagonal
- surface aspect ratio e.g., 16:9
- seating distance e.g., 128" from the display
- seating field of view e.g., 120 degrees or +/- 60 degrees about the center of the display
- desired intermediate samples at a distance e.g., one additional propagation path between the eyes
- each of the values attributed to the visual sensory receptors may be replaced with other systems to determine desired propagation path parameters.
- the auditory system's angular sensitivity as low as three degrees
- the somatosensory system's spatial resolution of the hands as small as 2 - 12mm.
- the total energy waveguide element density may be calculated such that the receiving sensory system cannot discern a single energy waveguide element from an adjacent element, given:
- the inter-ocular distance is leveraged to calculate the sample distance although any metric may be leveraged to account for appropriate number of samples at a given distance.
- any metric may be leveraged to account for appropriate number of samples at a given distance.
- the resultant energy surface may desirably include approximately 400k x 225k pixels of energy resolution locations, or 90 gigapixels holographic propagation density. These variables provided are for exemplary purposes only and many other sensory and energy metrology considerations should be considered for the optimization of holographic propagation of energy. In an additional embodiment, 1 gigapixel of energy resolution locations may be desired based upon the input variables. In an additional embodiment, 1,000 gigapixels of energy resolution locations may be desired based upon the input variables.
- FIG. 2 illustrates a device 200 having an active area 220 with a certain mechanical form factor.
- the device 200 may include drivers 230 and electronics 240 for powering and interface to the active area 220, the active area having a dimension as shown by the x and y arrows.
- This device 200 does not take into account the cabling and mechanical structures to drive, power and cool components, and the mechanical footprint may be further minimized by introducing a flex cable into the device 200.
- the minimum footprint for such a device 200 may also be referred to as a mechanical envelope 210 having a dimension as shown by the M:x and M:y arrows.
- This device 200 is for illustration purposes only and custom electronics designs may further decrease the mechanical envelope overhead, but in almost all cases may not be the exact size of the active area of the device.
- this device 200 illustrates the dependency of electronics as it relates to active image area 220 for a micro OLED, DLP chip or LCD panel, or any other technology with the purpose of image illumination.
- approximately 105 x 105 devices similar to those shown in FIG. 2 may be desired. It should be noted that many devices consist of various pixel structures that may or may not map to a regular grid. In the event that there are additional sub-pixels or locations within each full pixel, these may be exploited to generate additional resolution or angular density. Additional signal processing may be used to determine how to convert the light field into the correct (u,v) coordinates depending on the specified location of the pixel structure(s) and can be an explicit characteristic of each device that is known and calibrated. Further, other energy domains may involve a different handling of these ratios and device structures, and those skilled in the art will understand the direct intrinsic relationship between each of the desired frequency domains. This will be shown and discussed in more detail in subsequent disclosure.
- the resulting calculation may be used to understand how many of these individual devices may be desired to produce a full resolution energy surface. In this case, approximately 105 x 105 or approximately 11,080 devices may be desired to achieve the visual acuity threshold.
- the challenge and novelty exists within the fabrication of a seamless energy surface from these available energy locations for sufficient sensory holographic propagation.
- an energy propagating relay system may allow for an increase the effective size of the active device area to meet or exceed the mechanical dimensions to configure an array of relays and form a singular seamless energy surface.
- FIG. 3 illustrates an embodiment of such an energy relay system 300.
- the relay system 300 may include a device 310 mounted to a mechanical envelope 320, with an energy relay element 330 propagating energy from the device 310.
- the relay element 330 may be configured to provide the ability to mitigate any gaps 340 that may be produced when multiple mechanical envelopes 320 of the device are placed into an array of multiple devices 310.
- an energy relay element 330 may be designed with a magnification of 2: 1 to produce a tapered form that is approximately 20mm x 10mm on a minified end (arrow A) and 40mm x 20mm on a magnified end (arrow B), providing the ability to align an array of these elements 330 together seamlessly without altering or colliding with the mechanical envelope 320 of each device 310.
- the relay elements 330 may be bonded or fused together to align and polish ensuring minimal seam gap 340 between devices 310. In one such embodiment, it is possible to achieve a seam gap 340 smaller than the visual acuity limit of the eye.
- FIG. 4 illustrates an example of a base structure 400 having energy relay elements 410 formed together and securely fastened to an additional mechanical structure 430.
- the mechanical structure of the seamless energy surface 420 provides the ability to couple multiple energy relay elements 410, 450 in series to the same base structure through bonding or other mechanical processes to mount relay elements 410, 450.
- each relay element 410 may be fused, bonded, adhered, pressure fit, aligned or otherwise attached together to form the resultant seamless energy surface 420.
- a device 480 may be mounted to the rear of the relay element 410 and aligned passively or actively to ensure appropriate energy location alignment within the determined tolerance is maintained.
- the seamless energy surface comprises one or more energy locations and one or more energy relay element stacks comprise a first and second side and each energy relay element stack is arranged to form a singular seamless display surface directing energy along propagation paths extending between one or more energy locations and the seamless display surface, and where the separation between the edges of any two adjacent second sides of the terminal energy relay elements is less than the minimum perceptible contour as defined by the visual acuity of a human eye having better than 20/40 vision at a distance greater than the width of the singular seamless display surface.
- each of the seamless energy surfaces comprise one or more energy relay elements each with one or more structures forming a first and second surface with a transverse and longitudinal orientation.
- the first relay surface has an area different than the second resulting in positive or negative magnification and configured with explicit surface contours for both the first and second surfaces passing energy through the second relay surface to substantially fill a +/- 10 degree angle with respect to the normal of the surface contour across the entire second relay surface.
- multiple energy domains may be configured within a single, or between multiple energy relays to direct one or more sensory holographic energy propagation paths including visual, acoustic, tactile or other energy domains.
- the seamless energy surface is configured with energy relays that comprise two or more first sides for each second side to both receive and emit one or more energy domains simultaneously to provide bi-directional energy propagation throughout the system.
- the energy relays are provided as loose coherent elements.
- Transverse Anderson Localization is the propagation of a ray transported through a transversely disordered but longitudinally consistent material.
- Localization phenomena may be less impacted by total internal reflection than by the randomization between multiple- scattering paths where wave interference can completely limit the propagation in the transverse orientation while continuing in the longitudinal orientation.
- the cladding is to functionally eliminate the scatter of energy between fibers, but simultaneously act as a barrier to rays of energy thereby reducing transmission by at least the core to clad ratio (e.g., a core to clad ratio of 70:30 will transmit at best 70% of received energy transmission) and additionally forms a strong pixelated patterning in the propagated energy.
- FIG. 5A illustrates an end view of an example of one such non-Anderson
- Localization energy relay 500 wherein an image is relayed through multi-core optical fibers where pixilation and fiber noise may be exhibited due to the intrinsic properties of the optical fibers.
- relayed images may be intrinsically pixelated due to the properties of total internal reflection of the discrete array of cores where any cross-talk between cores will reduce the modulation transfer function and increase blurring.
- the resulting imagery produced with traditional multi-core optical fiber tends to have a residual fixed noise fiber pattern similar to those shown in FIG. 3.
- FIG. 5B illustrates an example of the same relayed image 550 through an energy relay comprising materials that exhibit the properties of Transverse Anderson Localization, where the relayed pattern has a greater density grain structures as compared to the fixed fiber pattern from FIG. 5A.
- relays comprising randomized microscopic component engineered structures induce Transverse Anderson Localization and transport light more efficiently with higher propagation of resolvable resolution than commercially available multi-mode glass optical fibers.
- Localization may comprise a plurality of at least two different component engineered structures in each of three orthogonal planes arranged in a dimensional lattice and the plurality of structures form randomized distributions of material wave propagation properties in a transverse plane within the dimensional lattice and channels of similar values of material wave propagation properties in a longitudinal plane within the dimensional lattice, wherein localized energy waves propagating through the energy relay have higher transport efficiency in the longitudinal orientation versus the transverse orientation.
- multiple energy domains may be configured within a single, or between multiple Transverse Anderson Localization energy relays to direct one or more sensory holographic energy propagation paths including visual, acoustic, tactile or other energy domains.
- the seamless energy surface is configured with
- Transverse Anderson Localization energy relays that comprise two or more first sides for each second side to both receive and emit one or more energy domains simultaneously to provide bi-directional energy propagation throughout the system.
- the Transverse Anderson Localization energy relays are configured as loose coherent or flexible energy relay elements.
- a light field display system generally includes an energy source (e.g., illumination source) and a seamless energy surface configured with sufficient energy location density as articulated in the above discussion.
- a plurality of relay elements may be used to relay energy from the energy devices to the seamless energy surface. Once energy has been delivered to the seamless energy surface with the requisite energy location density, the energy can be propagated in accordance with a 4D plenoptic function through a disclosed energy waveguide system. As will be appreciated by one of ordinary skill in the art, a 4D plenoptic function is well known in the art and will not be elaborated further herein.
- the energy waveguide system selectively propagates energy through a plurality of energy locations along the seamless energy surface representing the spatial coordinate of the 4D plenoptic function with a structure configured to alter an angular direction of the energy waves passing through representing the angular component of the 4D plenoptic function, wherein the energy waves propagated may converge in space in accordance with a plurality of propagation paths directed by the 4D plenoptic function.
- FIG. 6 illustrating an example of light field energy surface in 4D image space in accordance with a 4D plenoptic function.
- the figure shows ray traces of an energy surface 600 to a viewer 620 in describing how the rays of energy converge in space 630 from various positions within the viewing volume.
- each waveguide element 610 defines four dimensions of information describing energy propagation 640 through the energy surface 600.
- Two spatial dimensions (herein referred to as x and y) are the physical plurality of energy locations that can be viewed in image space, and the angular components theta and phi (herein referred to as u and v), which is viewed in virtual space when projected through the energy waveguide array.
- the plurality of waveguides are able to direct an energy location from the x, y dimension to a unique location in virtual space, along a direction defined by the u, v angular component, in forming the holographic or light field system described herein.
- an approach to selective energy propagation for addressing challenges associated with holographic display may include energy inhibiting elements and substantially filling waveguide apertures with near-collimated energy into an environment defined by a 4D plenoptic function.
- an array of energy waveguides may define a plurality of energy propagation paths for each waveguide element configured to extend through and substantially fill the waveguide element's effective aperture in unique directions defined by a prescribed 4D function to a plurality of energy locations along a seamless energy surface inhibited by one or more elements positioned to limit propagation of each energy location to only pass through a single waveguide element.
- multiple energy domains may be configured within a single, or between multiple energy waveguides to direct one or more sensory holographic energy propagations including visual, acoustic, tactile or other energy domains.
- the energy waveguides and seamless energy surface are configured to both receive and emit one or more energy domains to provide bi-directional energy propagation throughout the system.
- the energy waveguides are configured to propagate nonlinear or non-regular distributions of energy, including non-transmitting void regions, leveraging digitally encoded, diffractive, refractive, reflective, grin, holographic, Fresnel, or the like waveguide configurations for any seamless energy surface orientation including wall, table, floor, ceiling, room, or other geometry based environments.
- an energy waveguide element may be configured to produce various geometries that provide any surface profile and/or tabletop viewing allowing users to view holographic imagery from all around the energy surface in a 360-degree configuration.
- the energy waveguide array elements may be reflective surfaces and the arrangement of the elements may be hexagonal, square, irregular, semi- regular, curved, non-planar, spherical, cylindrical, tilted regular, tilted irregular, spatially varying and/or multi-layered.
- waveguide, or relay components may include, but not limited to, optical fiber, silicon, glass, polymer, optical relays, diffractive, holographic, refractive, or reflective elements, optical face plates, energy combiners, beam splitters, prisms, polarization elements, spatial light modulators, active pixels, liquid crystal cells, transparent displays, or any similar materials exhibiting Anderson localization or total internal reflection.
- Each energy surface system may comprise an assembly having a base structure, energy surface, relays, waveguide, devices, and electronics, collectively configured for bi-directional holographic energy propagation, emission, reflection, or sensing.
- an environment of tiled seamless energy waveguide relay systems are aggregated to form large seamless planar or curved walls including installations comprising up to all surfaces in a given environment, and configured as any combination of seamless, discontinuous planar, faceted, curved, cylindrical, spherical, geometric, or non-regular geometries.
- aggregated tiles of planar surfaces form wall-sized systems for theatrical or venue-based holographic entertainment.
- aggregated tiles of planar surfaces cover a room with four to six walls including both ceiling and floor for cave-based holographic installations.
- aggregated tiles of curved surfaces produce a cylindrical seamless environment for immersive holographic installations.
- aggregated tiles of seamless spherical surfaces form a holographic dome for immersive Holodeck-based experiences.
- aggregated tiles of seamless curved energy waveguides provide mechanical edges following the precise pattern along the boundary of energy inhibiting elements within the energy waveguide structure to bond, align, or fuse the adjacent tiled mechanical edges of the adjacent waveguide surfaces, resulting in a modular and seamless energy waveguide system.
- energy is propagated bi-directionally for multiple simultaneous energy domains.
- the energy surface provides the ability to both display and capture simultaneously from the same energy surface with waveguides designed such that light field data may be projected by an illumination source through the waveguide and simultaneously received through the same energy surface.
- additional depth sensing and active scanning technologies may be leveraged to allow for the interaction between the energy propagation and the viewer in correct world coordinates.
- the energy surface and waveguide are operable to emit, reflect or converge frequencies to induce tactile sensation or volumetric haptic feedback. In some embodiments, any combination of bi-directional energy propagation and aggregated surfaces are possible.
- the system comprises an energy waveguide capable of bi-directional emission and sensing of energy through the energy surface with one or more energy devices independently paired with two-or-more-path energy combiners to pair at least two energy devices to the same portion of the seamless energy surface, or one or more energy devices are secured behind the energy surface, proximate to an additional component secured to the base structure, or to a location in front and outside of the FOV of the waveguide for off-axis direct or reflective projection or sensing, and the resulting energy surface provides for bi-directional transmission of energy allowing the waveguide to converge energy, a first device to emit energy and a second device to sense energy, and where the information is processed to perform computer vision related tasks including, but not limited to, 4D plenoptic eye and retinal tracking or sensing of interference within propagated energy patterns, depth estimation, proximity, motion tracking, image, color, or sound formation, or other energy frequency analysis.
- the tracked positions actively calculate and modify positions of energy based upon the interference between the bi-directional captured data and
- a plurality of combinations of three energy devices comprising an ultrasonic sensor, a visible electromagnetic display, and an ultrasonic emitting device are configured together for each of three first relay surfaces propagating energy combined into a single second energy relay surface with each of the three first surfaces comprising engineered properties specific to each device's energy domain, and two engineered waveguide elements configured for ultrasonic and electromagnetic energy respectively to provide the ability to direct and converge each device's energy independently and substantially unaffected by the other waveguide elements that are configured for a separate energy domain.
- a calibration procedure to enable efficient manufacturing to remove system artifacts and produce a geometric mapping of the resultant energy surface for use with encoding/decoding technologies as well as dedicated integrated systems for the conversion of data into calibrated information appropriate for energy propagation based upon the calibrated configuration files.
- additional energy waveguides in series and one or more energy devices may be integrated into a system to produce opaque holographic pixels.
- additional waveguide elements may be integrated comprising energy inhibiting elements, beam-splitters, prisms, active parallax barriers or polarization technologies in order to provide spatial and/or angular resolutions greater than the diameter of the waveguide or for other super-resolution purposes.
- the disclosed energy waveguide relay system may also be configured as a wearable bi-directional device, such as virtual reality (VR) or augmented reality (AR).
- the energy waveguide relay system may include adjustment optical element(s) that cause the displayed or received energy to be focused proximate to a determined plane in space for a viewer.
- the waveguide array may be incorporated to holographic head-mounted-display.
- the system may include multiple optical paths to allow for the viewer to see both the energy waveguide relay system and a real-world environment (e.g., transparent holographic display). In these instances, the system may be presented as near field in addition to other methods.
- the transmission of data comprises encoding processes with selectable or variable compression ratios that receive an arbitrary dataset of information and metadata; analyze said dataset and receive or assign material properties, vectors, surface IDs, new pixel data forming a more sparse dataset, and wherein the received data may comprise: 2D, stereoscopic, multi-view, metadata, light field, holographic, geometry, vectors or vectorized metadata, and an encoder/decoder may provide the ability to convert the data in real-time or off-line comprising image processing for: 2D; 2D plus depth, metadata or other vectorized information; stereoscopic, stereoscopic plus depth, metadata or other vectorized information; multi-view; multi-view plus depth, metadata or other vectorized information; holographic; or light field content; through depth estimation algorithms, with or without depth metadata; and an inverse ray tracing methodology appropriately maps the resulting converted data produced by inverse ray tracing from the various 2D, stereoscopic, multi-view, volumetric, light field or
- a disclosed intermediate step comprises the integration between virtual and augmented reality devices to significantly limit data and processing requirements for the simultaneous propagation and rasterization of a complete sensory holographic dataset.
- the lack of modulated opacity states, resolution, and field of view dramatically limits the acuity of the sensory experience.
- a direct view bidirectional energy waveguide relay design capable of transmission of real world data with overlaid light field modulated attenuation of digital and real world illumination comprises HMD, holographic, sensory energy propagation, as well as traditional display applications.
- the energy waveguide relay design comprises multiple energy waveguides and energy modulation elements where there is a first pair and a second pair that may be separated by two focal lengths. The two pairs may be placed two focal lengths apart as well.
- the transparent energy waveguide pairs may be placed in front of the eye to relay external energy uninhibited or attenuated by opacity modulation, or at a visible location at a predetermined distance and may include additional waveguide elements.
- the rays from the second pair furthest from the eye relays an inverted propagation path and the introduction of an additional pair of energy waveguides at this distance rectifies these rays to the once again appropriate ray directionality.
- the 4D plenoptic function in combination with a plurality of energy modulating devices provides for the propagation of holographic near field or far field digital information over real world coordinates with true 4D opacity and other modulated electromagnetic or sensory energies.
- FIG. 7 illustrates an orthogonal view of a waveguide relay system 70 consisting of multiple energy waveguide pairs 72A, 72B, 72C, 72D, in accordance with one embodiment of the present disclosure.
- each energy waveguide pair may be a focal length / apart and may be viewed from either of left, at the location of a viewer's eye 74, to right, at an energy waveguide relay 76, or vice versa.
- additional waveguide elements, fewer waveguide elements and various separations are envisioned within the scope of this disclosure and the specified embodiments should not be considered limiting in any way.
- the waveguide relay system 70 may include: a first energy waveguide relay system 72A, 72B configured such that energy passing therethrough is directed according to a first 4D plenoptic function; a second energy waveguide relay system 72C, 72D following the first energy waveguide relay system 72A, 72B, the second energy waveguide relay system 72C, 72D configured such that energy passing therethrough is directed according to a second 4D plenoptic function, the second 4D plenoptic function inverse of the first 4D plenoptic function [00123]
- the system 70 includes a first energy modulation element (e.g., 102A, 102B, 102C as best shown in FIGS.
- the first energy modulation element configured to modulate energy passing therethrough.
- the first energy waveguide relay system 72A, 72B includes a first array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the first array are located at different spatial coordinates, and where each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the first 4D plenoptic function.
- the second energy waveguide relay system 72C, 72D includes a second array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the second array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the second 4D plenoptic function.
- the system 70 further includes a second energy modulation element (e.g., 102A, 102B, 102C as best shown in FIGS. 10 and 11) located in one of the first, second, or third location, the second energy modulation element configured to modulate energy passing therethrough.
- a second energy modulation element e.g., 102A, 102B, 102C as best shown in FIGS. 10 and 11
- the first and second energy modulation elements are located at the same location.
- the first and second energy modulation elements are located at different locations. This, too, will be described in more detail in subsequent figures and discussion.
- the system further includes third energy modulation element (e.g., 102A, 102B, 102C as best shown in FIGS. 10 and 11) located in one of the first, second, or third location, the third energy modulation element configured to modulate energy passing therethrough.
- the third energy modulation elements and at least one of the first and second energy modulation elements are located at the same location. This, too, will be described in more detail in subsequent figures and discussion.
- the first, second, and third energy modulation elements are identical to [00128] in one embodiment.
- first, second, and third energy modulation elements are located at different locations.
- each of the first, second and third energy modulation elements include LCD, LED, DLP, OLED, LCOS, quantum dot, or other suitable energy modulating elements.
- at least one of the first energy waveguide relay system 72A, 72B and the second energy waveguide relay system 72C, 72D is curved.
- both the first energy waveguide relay system 72A, 72B and the second energy waveguide relay system 72C, 72D are curved. This, too, will be described in more detail in subsequent figures and discussion.
- An additional embodiment of this fundamental approach provides tilted waveguides that optimize energy propagation quality as viewed by the eye.
- This may be implemented, but not limited to, regionally varying function, gradient based tilting, additional energy inhibiting elements, diffractive properties, refraction, reflection, gradient index, holographic optics, or the like, and/or may be incorporated into any potential designs above or below.
- a spatially varying energy waveguide design provides two or more regions with defined waveguide parameters to optimize for a specified design for the eye.
- the gradient-based function involves the generation of varying waveguide optimizations for each element.
- FIG. 8 illustrates an orthogonal view of a waveguide relay system 80 with increasing size of each energy waveguide pair 82A, 82B, 82C, 82D to account for the scaling of the field of view from the eye 84 relative to the distance from the eye 84, in accordance with one embodiment of the present disclosure.
- This embodiment provides for greater waveguiding efficiency to provide propagation functions more normal to the aperture of the visual system thereby more efficiently targeting a field of view of the eye 84 through each element within the system 86.
- the waveguide relay system 80 may include: a first energy waveguide relay system 82A, 82B configured such that energy passing therethrough is directed according to a first 4D plenoptic function; a second energy waveguide relay system 82C, 82D following the first energy waveguide relay system 82A, 82B, the second energy waveguide relay system 82C, 82D configured such that energy passing therethrough is directed according to a second 4D plenoptic function, the second 4D plenoptic function inverse of the first 4D plenoptic function.
- a first energy modulation element e.g., 102A, 102B,
- 102C as best shown in FIGS. 10 and 11
- the first energy modulation element configured to modulate energy passing therethrough. This will be described in more detail in subsequent figures and discussion.
- a second energy modulation element e.g., 102A,
- 102B, 102C as best shown in FIGS. 10 and 11 may be located in one of the first, second, or third location, the second energy modulation element configured to modulate energy passing therethrough.
- the first energy waveguide relay system 82A, 82B may include a first array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the first array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the first 4D plenoptic function.
- the 82D may include a second array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the second array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the second 4D plenoptic function.
- the first and second energy modulation elements e.g.,
- 102A, 102B, 102C as best shown in FIGS. 10 and 11) are located at the same location.
- the first and second energy modulation elements are located at different locations.
- the system 90 may further include a third energy modulation element (e.g., 102A, 102B, 102C as best shown in FIGS. 10 and 11) located in one of the first, second, or third location, the third energy modulation element configured to modulate energy passing therethrough.
- a third energy modulation element e.g., 102A, 102B, 102C as best shown in FIGS. 10 and 11
- the third energy modulation elements and at least one of the first and second energy modulation elements are located at the same location.
- the first, second, and third energy modulation elements are located at the same location.
- the first, second, and third energy modulation elements are located at different locations.
- each of the first, second and third energy modulation elements includes LCD, LED, DLP, OLED, LCOS, quantum dot, or other energy modulation elements.
- at least one of the first energy waveguide relay system and the second energy waveguide relay system is curved.
- both the first energy waveguide relay system and the second energy waveguide relay system are curved.
- FIG. 9 illustrates an orthogonal view of a waveguide relay system 90 of energy waveguides 92A, 92B, 92C, 92D that are both scaled and cylindrically radiating about the rotational axis of the eye, in accordance with one embodiment of the present disclosure.
- the energy waveguides 92A, 92B, 92C, 92D are curved to account for the rotational axis of a viewer's eye 94.
- This may be implemented as non- scaled or as a scaled and curved design.
- This curved design may be implemented as a horizontally or vertically cylindrical shape or may be formed as a concave or spherical shape.
- a cylindrical or spherical approach provides greater efficiency of the number of angular samples per waveguide as the normal of each waveguide are more correctly oriented towards the entrance pupil of the eye 94e, thereby more efficiently mimicking natural energy propagation rather than planar functions that propagate rays off axis for the periphery of the field of view of the eye 94.
- At least one of the first energy waveguide relay system 92A, 92B and the second energy waveguide relay system 92C, 92D may be curved.
- both energy waveguide relay systems 92 are shown to be curved, it will be appreciated by one skilled in the art that in one embodiment the first energy waveguide relay system 92A, 92B may be curved and the second energy waveguide relay system 92C, 92D may be planar.
- the first energy waveguide relay system 92A, 92B may be planar while the second energy waveguide relay system 92C, 92D may be curved.
- the curving of the energy waveguide relay systems 92 may similarly be applied to all the systems (e.g., FIGS. 7, 8 and 10-12) disclosed herein.
- the system 90 may include: a first energy waveguide relay system 92A, 92B configured such that energy passing therethrough is directed according to a first 4D plenoptic function; a second energy waveguide relay system 92C, 92D following the first energy waveguide relay system 92A, 92B, the second energy waveguide relay system 92C, 92D configured such that energy passing therethrough is directed according to a second 4D plenoptic function, the second 4D plenoptic function inverse of the first 4D plenoptic function.
- a first energy modulation element e.g., 102A,
- 102B, 102C as best shown in FIGS. 10 and 11 may be disposed in a first location in the first energy waveguide relay system 92A, 92B, in a second location in the second energy waveguide relay system 92C, 92D or in a third location in between the first energy waveguide relay system 92A, 92B and the second energy waveguide relay system 92C, 92D, the first energy modulation element configured to modulate energy passing therethrough.
- the first energy modulation element configured to modulate energy passing therethrough.
- a second energy modulation element e.g., a second energy modulation element
- 102A, 102B, 102C as best shown in FIGS. 10 and 11 may be located in one of the first, second, or third location, the second energy modulation element configured to modulate energy passing therethrough, and a third energy modulation element (e.g., 102A, 102B, 102C as best shown in FIGS. 10 and 11) may be located in one of the first, second, or third location, the third energy modulation element configured to modulate energy passing therethrough.
- a third energy modulation element e.g., 102A, 102B, 102C as best shown in FIGS. 10 and 11
- the first energy waveguide relay system 92A, 92B includes a first array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the first array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the first 4D plenoptic function.
- the second energy waveguide relay system 92C In another embodiment, the second energy waveguide relay system 92C,
- 92D includes a second array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, where the energy waveguides of the second array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the second 4D plenoptic function.
- the first and second energy modulation elements e.g., the first and second energy modulation elements
- each of the first, second and third energy modulation elements includes LCD, LED, DLP, OLED, LCOS, quantum dot, or other suitable energy modulating elements.
- FIG. 10 illustrates an orthogonal view of a waveguide relay system 100 showing the relative locations of each of three potential energy devices 102A, 102B, 102C in relation to energy waveguides 104A, 104B, 104C, 104D, in accordance with one embodiment of the present disclosure.
- each pair of energy waveguides e.g., 104A and 104B or 104C and 104D
- a first energy modulation device may comprise structures for volumetric spectral modulation of opaque energy propagations in an active state. Spectral modulation may additionally be propagated through combination of other energy modulation device pairs 102A, 102C.
- the specific modulation devices 102A, 102C may provide precise control over propagation of saturation and transparency.
- the addition of all three energy modulation devices 102A, 102B, 102C may or may not be used— only one energy modulation device is needed for energy propagation. Designs may be implemented in any combination, specifically referring to previous embodiments comprising planar waveguiding systems, curved, scaled, variable approaches as disclosed depending on the specific application.
- the system 100 may comprise a first energy waveguide relay system 104 A, 104B configured such that energy passing therethrough is directed according to a first 4D plenoptic function and a second energy waveguide relay system 104C, 104D following the first energy waveguide relay system 104 A, 102A, 104B, the second energy waveguide relay system 104C, 102C, 104D configured such that energy passing therethrough is directed according to a second 4D plenoptic function, the second 4D plenoptic function inverse of the first 4D plenoptic function.
- a first modulation element 102A may be an LCD
- the system may include a second modulation element 102B and a third modulation element 102C similar to that of the first modulation element 102A.
- a first energy modulation element 102A may be disposed in the first energy waveguide relay system 104A, 104B while a second energy modulation element 102B may be disposed in between the first energy waveguide relay system 104 A, 104B and the second energy waveguide relay system 104C, 104D.
- a third energy modulation element 102C may be disposed in the second energy waveguide relay system 104C, 104D.
- each of the first, second and third energy modulation elements 102A, 102B, 102C may be configured to modulate energy passing therethrough.
- the first modulation element 102A is shown to be in the first energy waveguide relay system 104 A, 104B
- the second modulation element 102B is shown to be in between the first energy waveguide relay system 104A, 104B and the second energy waveguide relay system 104C, 104D
- the third modulation element 102C is shown to be in the second energy waveguide relay system 104C, 104D
- the modulation elements 102A, 102B, 102C can be located anywhere throughout the system 100.
- all three modulation elements 102 may be located in the first energy waveguide relay system 104A, 104B.
- all three modulation elements 102 may be located in the second energy 104C, 104D.
- all three modulation elements 102 may be located in between the first energy waveguide relay system 104A, 104B and the second energy waveguide relay system 104C, 104D. It will be understood by one of ordinary skill in the art that various combinations and permutations may be utilized. In some embodiments, the system 100 may further include four or five or as many modulation elements 102 depending on the application.
- the first energy waveguide relay system 104A, 104B may be curved in one embodiment.
- the second energy waveguide relay system 104C, 104D may be curved.
- both the first energy waveguide relay system 104A, 104B and the second energy waveguide relay system 104C, 104D may be curved. It will be appreciated by one skilled in the art that although two energy waveguide relay systems 104 are shown, there can be three or four or many more energy waveguide relay systems 104 as necessary depending on the application. Furthermore, one or two or any number of these energy waveguide relay systems 104 may or may not be curved.
- the transparent display system 100 includes: a first energy waveguide relay system 104 A, 104B configured such that energy passing therethrough is directed according to a first 4D plenoptic function; a second energy waveguide relay system 104C, 104D following the first energy waveguide relay system 104A, 104B, the second energy waveguide relay system 104C, 104D configured such that energy passing therethrough is directed according to a second 4D plenoptic function, the second 4D plenoptic function inverse of the first 4D plenoptic function.
- a first energy modulation element 102A is disposed in the first energy waveguide relay system 104 A, 104B; a second energy modulation element 102B is disposed in between the first energy waveguide relay system 104A, 104B and the second energy waveguide relay system 104C, 104D; and a third energy modulation element 102C is disposed in the second energy waveguide relay system 104C, 104D, where the first, second and third energy modulation elements 102A, 102B, 102C are configured to modulate energy passing therethrough.
- the first energy waveguide relay system 104 A, 104B may include a first array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, wherein the energy waveguides of the first array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the first 4D plenoptic function.
- the second energy waveguide relay system 104C In another embodiment, the second energy waveguide relay system 104C,
- the 104D may include a second array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, wherein the energy waveguides of the second array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the second 4D plenoptic function.
- the system 100 may further include one or more additional energy modulation elements (not shown) located in one of the first, second, or third locations, the one or more additional energy modulation elements configured to modulate energy passing therethrough.
- the first location may be within the first energy waveguide relay system 104 A, 104B
- the second location may be between the first energy waveguide relay system 104A, 104B and the second energy waveguide relay system 104C, 104D
- the third location may be within the second energy waveguide relay system 104C, 104D.
- the one or more additional energy modulation elements (not shown) and at least one of the first, second and third energy modulation elements 102 may be located at the same location.
- the one or more additional energy modulation elements (not shown) and at least one of the first, second and third energy modulation elements 102 may be located at different locations.
- three energy modulation elements 102 cumulatively propagate electromagnetic energies, comprising modulated amalgams for color, transparency, intensity, opacity and a plurality of other holographic conditions.
- Table 1 is presented for reference of a few variable opacity and transmissive states for a plurality of spectral values and the commensurate exemplary value each of the three energy modulation elements would exhibit.
- Table 1 illustrates a matrix of potential color values for each of the respective modulation elements in the relay system to produce volumetric rays that include all color, intensity, transparency and opacity in full light field projection.
- the modulation of the energy waveguide relay systems comprise all sensory energy domains, and wherein the energy modulation devices may comprise other forms of sensory energy devices to include visual, auditory, gustatory, olfactory, somatosensory or other sensory systems as disclosed. Further, the scope of this system comprises bidirectional capabilities between and through the energy propagating waveguide relay system to be leveraged for additional embodiments comprising any such disclosures relating to the directing of holographic or sensory energy.
- the energy relay system is designed as a bidirectional large format energy directing device having both modulation and other energy devices to enable transparent and holographic superimposition of sensory energies through the waveguiding relay system, and wherein the systems may appear invisible through the transparent system, and may comprise energy sensors or any combination of sensory energy propagation, holodeck parameters, interactivity or otherwise leveraged for other applications not disclosed explicitly within this application.
- a first energy modulation element may include white opacity
- a second energy modulation element may include an additional opacity or color
- the third energy modulation element may include black opacity.
- first and third energy modulation elements may both be OLEDs 102A, 102C and the second energy modulation element may be an LCD 102B such that to present an opaque black color the first modulation element is configured to an off state, the second modulation element is configured to an on state, and the third modulation element can be configured to an on state or an off state.
- FIG. 13 illustrates a single energy waveguide relay element system 100, wherein a single effective collection of four waveguide element functions comprising waveguide relay element pair 104 A, 104B and 104C, 104D provide for efficient energy propagation.
- the functions prescribed by the energy waveguides when guided by a 4D function allows for the accurate convergence for given ray bundles propagating along the system, wherein, the knowledge of energy domain, frequency, or other environmental parameters provides for both the projection and sensing of energy in accordance with a 4D function.
- the bidirectional propagation of energy remains substantially similar throughout the energy waveguide relay system though location 131.
- first and third energy modulation element are both
- OLEDs 102A, 102C and the second energy modulation element may be an LCD 102B such that to present a transparent black color the first modulation element is configured to an off state, the second modulation element is configured to an off state, and the third modulation element is configured to an off state.
- first and third energy modulation elements are both
- OLEDs 102A, 102C and the second energy modulation element may be an LCD 102B such that to present an opaque red color the first modulation element is configured to a red only on state, the second modulation element can be configured to an on state or an off state, and the third modulation element is configured to an off state.
- first and third energy modulation elements are both
- OLEDs 102A, 102C and the second energy modulation element may be an LCD 102B such that to present a transparent red color the first modulation element is configured to a red only state at a first percentage, the second modulation element is configured to an off state, and the third modulation element is configured to a red only state at a second percentage, the second percentage different than the first percentage.
- first and third energy modulation elements are both
- OLEDs 102A, 102C and the second energy modulation element may be an LCD 102B such that to present an opaque grey color the first modulation element is configured to an on state at a first percentage, the second modulation element is configured to an on state, and the third modulation element is configured to an off state.
- first and third energy modulation elements are both
- OLEDs 102A, 102C and the second energy modulation element may be an LCD 102B such that to present a transparent grey color the first modulation element is configured to an on state at a first percentage, the second modulation element is configured to an off state, and the third modulation element is configured to an on state at a second percentage, the second percentage different than the first percentage.
- the present disclosures may be implemented for any size type explicitly to include displays that are not head mounted in any way. In this fashion, it is possible to "paint" transparency values with any form of light field, including visual or other sensory display systems, leveraging the method and systems presented herein.
- an additional embodiment proposes to bond together either energy modulation element 102A and 102B or 102C and 102B. This helps increase the efficiency of calibration and solve a number of mechanical alignment challenges.
- FIG. 11 A illustrates an orthogonal view of a configuration 110 to bond two energy modulation elements 102A, 102B together to increase manufacturing and calibration efficiency, in accordance with one embodiment of the present disclosure.
- FIG. 11B illustrates an orthogonal view of a configuration 116 to bond two energy modulation elements 102B, 102C together to increase manufacturing and calibration efficiency, in accordance with one embodiment of the present disclosure.
- first energy waveguide relay system 112A, 112B configured such that energy passing therethrough is directed according to a first 4D plenoptic function
- second energy waveguide relay system 112C, 112D following the first energy waveguide relay system 112A, 112B
- the second energy waveguide relay system 112C, 112D configured such that energy passing therethrough is directed according to a second 4D plenoptic function, the second 4D plenoptic function inverse of the first 4D plenoptic function.
- the system 110 may include an OLED modulation element 102A, a LCD modulation element 102B, and another OLED modulation element 102C, and any combinations thereof.
- the OLED modulation element 102A and the LCD modulation element 102B may be located in the first energy waveguide relay system 112A, 112B while the OLED modulation element 102C may be located in the second energy waveguide relay system 112C, 112D.
- the OLED modulation element 102A and the LCD modulation element 102B may be located in the first energy waveguide relay system 112A, 112B while the OLED modulation element 102C may be located in the second energy waveguide relay system 112C, 112D.
- the OLED modulation element 102A may be located in the first energy waveguide relay system 112A, 112B while the LCD modulation element 102B and the OLED modulation element 102C are located in the second energy waveguide relay system 112C, 112D. It will be appreciated by one skilled in the art that the modulation elements 102 maybe randomly distributed throughout the energy waveguide relay systems 112.
- a first energy modulation element may be disposed in a first location in the first energy waveguide relay system, in a second location in the second energy waveguide relay system or in a third location in between the first energy waveguide relay system and the second energy waveguide relay system, with the first energy modulation element configured to modulate energy passing therethrough.
- a second energy modulation element may be located in one of the first, second, or third locations, with the second energy modulation element configured to modulate energy passing therethrough.
- a third energy modulation element may be located in one of the first, second, or third locations, with the second energy modulation element configured to modulate energy passing therethrough.
- the third energy modulation element may be located at the same location of at least one of the first and second energy modulation elements.
- the third energy modulation element may be located at different locations from the at least one of the first and second energy modulation elements.
- the first energy waveguide relay system 112A, 112B may include a first array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, wherein the energy waveguides of the first array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the first 4D plenoptic function.
- the second energy waveguide relay system may include a second array of energy waveguides configured to direct energy therethrough along a plurality of energy propagation paths, wherein the energy waveguides of the second array are located at different spatial coordinates, and each energy waveguide directs energy from the respective spatial coordinate to the plurality of energy propagation paths along different directions according to the second 4D plenoptic function.
- the second energy modulation element may be located in one of the first, second, or third locations, with the second energy modulation element configured to modulate energy passing therethrough.
- the first and second energy modulation elements are located at the same location, but the first and second energy modulation elements may also be located at different locations.
- a third energy modulation element may be located in one of the first, second, or third locations, the third energy modulation element configured to modulate energy passing therethrough.
- the third energy modulation elements and at least one of the first and second energy modulation elements are located at the same location, while in other embodiments, the first, second, and third energy modulation elements are located at the same location or different locations.
- An additional embodiment provides the ability to manufacturer the energy waveguide relay optics through a multi-step wafer level bonding process. Due to the resolution requirements of near field display and the high pixel densities required, and approach similar to other disclosures discussed within this application for encoded energy waveguides for holographic super resolution may be additionally leveraged, with a sophisticated modification to the energy waveguide relay design. With high refresh rate synchronous energy modulation elements, two additional higher density energy waveguides are implemented at the center of each of the two original energy waveguide pairs. The ratio of the increased density may be the result of:
- D is the increased density ratio needed (squared for X and Y respectively)
- Nn is the new quantity of angular samples per waveguide element desired
- Nc is the current system angular samples value without the super resolution applied. For example, if the current sampling provided 9 samples along X in the current system, and 27 are desired, the density increase would be a factor of 3x 2 .
- FPSn is the resulting required frame rate
- FPSs is the native content frame rate
- D 2 is the ratio calculated from above. For example, if the source content frame rate is 24fps and D 2 equals 9, the new sampling frequency may comprise 216fps.
- FIG. 12 illustrates an orthogonal view of an alternative system 120 to the waveguide relay system that directly inverts the rays of light such that one or more elements from system may be removed, in accordance with one embodiment of the present disclosure.
- This system 120 may implement a hardware modification wherein leveraging a reflective waveguide relay system 122 provides a direct inversion of every presented propagation path to a viewer's eye 124. This may further be advantageous for the any of HMD systems or opacity generating devices such that waveguide relays may be removed from the overall system.
- A, B, C, or combinations thereof refers to all permutations and combinations of the listed items preceding the term.
- A, B, C, or combinations thereof is intended to include at least one of: A, B, C, AB, AC, BC, or ABC, and if order is important in a particular context, also BA, CA, CB, CBA, BCA, ACB, BAC, or CAB.
- expressly included are combinations that contain repeats of one or more item or term, such as BB, AAA, AB, BBC, AAABCCCC, CBBAAA, CAB ABB, and so forth.
- the skilled artisan will understand that typically there is no limit on the number of items or terms in any combination, unless otherwise apparent from the context.
- compositions and/or methods disclosed and claimed herein can be made and executed without undue experimentation in light of the present disclosure. While the compositions and methods of this disclosure have been described in terms of preferred embodiments, it will be apparent to those of skill in the art that variations may be applied to the compositions and/or methods and in the steps or in the sequence of steps of the method described herein without departing from the concept, spirit and scope of the disclosure. All such similar substitutes and modifications apparent to those skilled in the art are deemed to be within the spirit, scope and concept of the disclosure as defined by the appended claims.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Liquid Crystal (AREA)
Abstract
Description
Claims
Priority Applications (13)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/064,375 US11073657B2 (en) | 2016-07-15 | 2017-07-17 | Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays for light field, virtual and augmented reality |
KR1020197004035A KR20190026890A (en) | 2016-07-15 | 2017-07-17 | Holographic Overlap of Actual Plane Optic Opacity Modulation Through a Transparent Optical Waveguide Array for Light Field, Virtual and Augmented Reality |
KR1020237012371A KR20230054496A (en) | 2016-07-15 | 2017-07-17 | Holographic Superimposition of Real World Plenoptic Opacity Modulation Through Transparent Waveguide Arrays for Light Field, Virtual Reality and Augmented Reality |
CA3006523A CA3006523C (en) | 2016-07-15 | 2017-07-17 | Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays |
AU2017296238A AU2017296238B2 (en) | 2016-07-15 | 2017-07-17 | Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays |
EP17828624.1A EP3485323A4 (en) | 2016-07-15 | 2017-07-17 | Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays |
CN201780043907.8A CN109477973B (en) | 2016-07-15 | 2017-07-17 | Holographic superposition of real-world plenoptic opacity modulation through transparent waveguide arrays for light-field, virtual and augmented reality |
NZ743823A NZ743823A (en) | 2016-07-15 | 2017-07-17 | Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays |
JP2019501675A JP7069106B2 (en) | 2016-07-15 | 2017-07-17 | Holographic superimposition of real-world prenoptic opacity modulation via transparent waveguide arrays for light fields, virtual and augmented reality |
US17/345,693 US11668869B2 (en) | 2016-07-15 | 2021-06-11 | Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays for light field, virtual and augmented reality |
JP2022076343A JP7385202B2 (en) | 2016-07-15 | 2022-05-02 | system |
US18/137,586 US20230333310A1 (en) | 2016-07-15 | 2023-04-21 | Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays for light field, virtual and augmented reality |
JP2023186136A JP2024020258A (en) | 2016-07-15 | 2023-10-31 | Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays for light field, virtual and augmented reality |
Applications Claiming Priority (10)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201662362602P | 2016-07-15 | 2016-07-15 | |
US62/362,602 | 2016-07-15 | ||
US201662366076P | 2016-07-24 | 2016-07-24 | |
US62/366,076 | 2016-07-24 | ||
US201762507500P | 2017-05-17 | 2017-05-17 | |
US62/507,500 | 2017-05-17 | ||
PCT/US2017/042275 WO2018014009A1 (en) | 2016-07-15 | 2017-07-14 | Energy propagation and transverse anderson localization with two-dimensional, light field and holographic relays |
USPCT/US2017/042276 | 2017-07-14 | ||
USPCT/US2017/042275 | 2017-07-14 | ||
PCT/US2017/042276 WO2018014010A1 (en) | 2016-07-15 | 2017-07-14 | Selective propagation of energy in light field and holographic waveguide arrays |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/064,375 A-371-Of-International US11073657B2 (en) | 2016-07-15 | 2017-07-17 | Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays for light field, virtual and augmented reality |
US17/345,693 Continuation US11668869B2 (en) | 2016-07-15 | 2021-06-11 | Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays for light field, virtual and augmented reality |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018014040A1 true WO2018014040A1 (en) | 2018-01-18 |
Family
ID=60951945
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2017/042462 WO2018014040A1 (en) | 2016-07-15 | 2017-07-17 | Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays |
PCT/US2017/042468 WO2018014046A1 (en) | 2016-07-15 | 2017-07-17 | Encoded energy waveguides for holographic super resolution |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2017/042468 WO2018014046A1 (en) | 2016-07-15 | 2017-07-17 | Encoded energy waveguides for holographic super resolution |
Country Status (1)
Country | Link |
---|---|
WO (2) | WO2018014040A1 (en) |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10884251B2 (en) | 2018-01-14 | 2021-01-05 | Light Field Lab, Inc. | Systems and methods for directing multiple 4D energy fields |
US10898818B2 (en) | 2018-07-25 | 2021-01-26 | Light Field Lab, Inc. | Light field display system based amusement park attraction |
US10904479B2 (en) | 2019-03-12 | 2021-01-26 | Light Field Lab, Inc. | Video communication including holographic content |
US10901231B2 (en) | 2018-01-14 | 2021-01-26 | Light Field Lab, Inc. | System for simulation of environmental energy |
US10914957B1 (en) | 2017-05-30 | 2021-02-09 | Apple Inc. | Video compression methods and apparatus |
US10951875B2 (en) | 2018-07-03 | 2021-03-16 | Raxium, Inc. | Display processing circuitry |
US10981046B2 (en) | 2019-08-26 | 2021-04-20 | Light Field Lab, Inc. | Light field display system for sporting events |
US11212514B2 (en) | 2019-03-25 | 2021-12-28 | Light Field Lab, Inc. | Light field display system for cinemas |
US11428933B2 (en) | 2019-05-13 | 2022-08-30 | Light Field Lab, Inc. | Light field display system for performance events |
US11474597B2 (en) | 2019-11-01 | 2022-10-18 | Google Llc | Light field displays incorporating eye trackers and methods for generating views for a light field display using eye tracking information |
US11650354B2 (en) | 2018-01-14 | 2023-05-16 | Light Field Lab, Inc. | Systems and methods for rendering data from a 3D environment |
US11902500B2 (en) | 2019-08-09 | 2024-02-13 | Light Field Lab, Inc. | Light field display system based digital signage system |
US12022053B2 (en) | 2021-12-13 | 2024-06-25 | Light Field Lab, Inc. | Light field display system for cinemas |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3857290A4 (en) * | 2018-09-28 | 2022-07-06 | Light Field Lab, Inc. | Holographic object relay for light field display |
US11112691B2 (en) * | 2019-01-16 | 2021-09-07 | Kla Corporation | Inspection system with non-circular pupil |
US20200371472A1 (en) * | 2019-05-21 | 2020-11-26 | Light Field Lab, Inc. | Light Field Display System Based Commercial System |
WO2021097149A1 (en) | 2019-11-12 | 2021-05-20 | Light Field Lab, Inc. | Relay systems |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8442397B2 (en) * | 2009-09-22 | 2013-05-14 | Samsung Electronics Co., Ltd. | Modulator, apparatus for obtaining light field data using modulator, and apparatus and method for processing light field data using modulator |
US20130216123A1 (en) * | 2012-02-16 | 2013-08-22 | Ricoh Co., Ltd. | Design and Optimization of Plenoptic Imaging Systems |
US9179134B2 (en) * | 2011-01-18 | 2015-11-03 | Disney Enterprises, Inc. | Multi-layer plenoptic displays that combine multiple emissive and light modulating planes |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8736675B1 (en) | 2006-12-01 | 2014-05-27 | Zebra Imaging, Inc. | Multi-core processor architecture for active autostereoscopic emissive displays |
WO2010124028A2 (en) * | 2009-04-21 | 2010-10-28 | Vasylyev Sergiy V | Light collection and illumination systems employing planar waveguide |
EP3567416A1 (en) * | 2009-10-12 | 2019-11-13 | The Trustees of Columbia University in the City of New York | Photonic crystal spectrometer |
US10209517B2 (en) * | 2013-05-20 | 2019-02-19 | Digilens, Inc. | Holographic waveguide eye tracker |
EP3198192A1 (en) * | 2014-09-26 | 2017-08-02 | Milan Momcilo Popovich | Holographic waveguide opticaltracker |
US9544583B2 (en) * | 2015-01-09 | 2017-01-10 | Ricoh Company, Ltd. | Object space calibration of plenoptic imaging systems |
-
2017
- 2017-07-17 WO PCT/US2017/042462 patent/WO2018014040A1/en unknown
- 2017-07-17 WO PCT/US2017/042468 patent/WO2018014046A1/en unknown
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8442397B2 (en) * | 2009-09-22 | 2013-05-14 | Samsung Electronics Co., Ltd. | Modulator, apparatus for obtaining light field data using modulator, and apparatus and method for processing light field data using modulator |
US9179134B2 (en) * | 2011-01-18 | 2015-11-03 | Disney Enterprises, Inc. | Multi-layer plenoptic displays that combine multiple emissive and light modulating planes |
US20130216123A1 (en) * | 2012-02-16 | 2013-08-22 | Ricoh Co., Ltd. | Design and Optimization of Plenoptic Imaging Systems |
Non-Patent Citations (1)
Title |
---|
WETZSTEIN ET AL.: "On Plenoptic Multiplexing and Reconstruction", INTERNATIONAL JOURNAL ON COMPUTER VISION (IJCV, vol. 101, no. 2, 2013, pages 384 - 400, XP055452868, Retrieved from the Internet <URL:https://hal.inria.fr/hal-00876493> [retrieved on 20170926] * |
Cited By (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10914957B1 (en) | 2017-05-30 | 2021-02-09 | Apple Inc. | Video compression methods and apparatus |
US11914152B2 (en) | 2017-05-30 | 2024-02-27 | Apple Inc. | Video compression methods and apparatus |
US11243402B2 (en) | 2017-05-30 | 2022-02-08 | Apple Inc. | Video compression methods and apparatus |
US10967565B2 (en) | 2018-01-14 | 2021-04-06 | Light Field Lab, Inc. | Energy field three-dimensional printing system |
US10884251B2 (en) | 2018-01-14 | 2021-01-05 | Light Field Lab, Inc. | Systems and methods for directing multiple 4D energy fields |
US11163176B2 (en) | 2018-01-14 | 2021-11-02 | Light Field Lab, Inc. | Light field vision-correction device |
US11181749B2 (en) | 2018-01-14 | 2021-11-23 | Light Field Lab, Inc. | Systems and methods for transverse energy localization in energy relays using ordered structures |
US11650354B2 (en) | 2018-01-14 | 2023-05-16 | Light Field Lab, Inc. | Systems and methods for rendering data from a 3D environment |
US11237307B2 (en) | 2018-01-14 | 2022-02-01 | Light Field Lab, Inc. | Systems and methods for forming energy relays with transverse energy localization |
US10901231B2 (en) | 2018-01-14 | 2021-01-26 | Light Field Lab, Inc. | System for simulation of environmental energy |
US10951875B2 (en) | 2018-07-03 | 2021-03-16 | Raxium, Inc. | Display processing circuitry |
US11961431B2 (en) | 2018-07-03 | 2024-04-16 | Google Llc | Display processing circuitry |
US11452945B2 (en) | 2018-07-25 | 2022-09-27 | Light Field Lab, Inc. | Light field display system based amusement park attraction |
US11938410B2 (en) | 2018-07-25 | 2024-03-26 | Light Field Lab, Inc. | Light field display system based amusement park attraction |
US10898818B2 (en) | 2018-07-25 | 2021-01-26 | Light Field Lab, Inc. | Light field display system based amusement park attraction |
US11381775B2 (en) | 2019-03-12 | 2022-07-05 | Light Field Lab, Inc. | Light field display system for video communication including holographic content |
US10904479B2 (en) | 2019-03-12 | 2021-01-26 | Light Field Lab, Inc. | Video communication including holographic content |
US11212514B2 (en) | 2019-03-25 | 2021-12-28 | Light Field Lab, Inc. | Light field display system for cinemas |
US11428933B2 (en) | 2019-05-13 | 2022-08-30 | Light Field Lab, Inc. | Light field display system for performance events |
US11902500B2 (en) | 2019-08-09 | 2024-02-13 | Light Field Lab, Inc. | Light field display system based digital signage system |
US11691066B2 (en) | 2019-08-26 | 2023-07-04 | Light Field Lab, Inc. | Light field display system for sporting events |
US10981046B2 (en) | 2019-08-26 | 2021-04-20 | Light Field Lab, Inc. | Light field display system for sporting events |
US11474597B2 (en) | 2019-11-01 | 2022-10-18 | Google Llc | Light field displays incorporating eye trackers and methods for generating views for a light field display using eye tracking information |
US12022053B2 (en) | 2021-12-13 | 2024-06-25 | Light Field Lab, Inc. | Light field display system for cinemas |
Also Published As
Publication number | Publication date |
---|---|
WO2018014046A1 (en) | 2018-01-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11668869B2 (en) | Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays for light field, virtual and augmented reality | |
WO2018014040A1 (en) | Holographic superimposition of real world plenoptic opacity modulation through transparent waveguide arrays | |
WO2018014049A1 (en) | Method of calibration for holographic energy directing systems | |
NZ743819B (en) | Encoded energy waveguides for holographic super resolution | |
NZ743820B (en) | Method of calibration for holographic energy directing systems |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 3006523 Country of ref document: CA |
|
ENP | Entry into the national phase |
Ref document number: 2017296238 Country of ref document: AU Date of ref document: 20170717 Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17828624 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2019501675 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 20197004035 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2017828624 Country of ref document: EP Effective date: 20190215 |