US20230176368A1 - Grating-assisted field of view expansion - Google Patents
Grating-assisted field of view expansion Download PDFInfo
- Publication number
- US20230176368A1 US20230176368A1 US17/701,558 US202217701558A US2023176368A1 US 20230176368 A1 US20230176368 A1 US 20230176368A1 US 202217701558 A US202217701558 A US 202217701558A US 2023176368 A1 US2023176368 A1 US 2023176368A1
- Authority
- US
- United States
- Prior art keywords
- grating
- switchable
- view
- camera
- lightguide
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 claims abstract description 83
- 150000001875 compounds Chemical class 0.000 claims abstract description 43
- 230000001902 propagating effect Effects 0.000 claims abstract description 19
- 238000011144 upstream manufacturing Methods 0.000 claims abstract description 8
- 239000004973 liquid crystal related substance Substances 0.000 claims description 115
- 238000010168 coupling process Methods 0.000 claims description 87
- 238000005859 coupling reaction Methods 0.000 claims description 87
- 230000010287 polarization Effects 0.000 claims description 20
- 239000012780 transparent material Substances 0.000 claims description 4
- 239000012530 fluid Substances 0.000 description 33
- 239000000758 substrate Substances 0.000 description 23
- 230000005684 electric field Effects 0.000 description 16
- 230000003287 optical effect Effects 0.000 description 11
- XLOMVQKBTHCTTD-UHFFFAOYSA-N Zinc monoxide Chemical compound [Zn]=O XLOMVQKBTHCTTD-UHFFFAOYSA-N 0.000 description 6
- 229920000642 polymer Polymers 0.000 description 6
- 230000000007 visual effect Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 125000000524 functional group Chemical group 0.000 description 5
- 230000000737 periodic effect Effects 0.000 description 5
- 238000010897 surface acoustic wave method Methods 0.000 description 4
- 125000003118 aryl group Chemical group 0.000 description 3
- 230000003190 augmentative effect Effects 0.000 description 3
- 239000013078 crystal Substances 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 239000005276 holographic polymer dispersed liquid crystals (HPDLCs) Substances 0.000 description 3
- 230000002209 hydrophobic effect Effects 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 238000000034 method Methods 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 210000001747 pupil Anatomy 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 239000004094 surface-active agent Substances 0.000 description 3
- XOLBLPGZBRYERU-UHFFFAOYSA-N tin dioxide Chemical compound O=[Sn]=O XOLBLPGZBRYERU-UHFFFAOYSA-N 0.000 description 3
- 229910001887 tin oxide Inorganic materials 0.000 description 3
- 239000011787 zinc oxide Substances 0.000 description 3
- 229910019142 PO4 Inorganic materials 0.000 description 2
- VYPSYNLAJGMNEJ-UHFFFAOYSA-N Silicium dioxide Chemical compound O=[Si]=O VYPSYNLAJGMNEJ-UHFFFAOYSA-N 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000003098 cholesteric effect Effects 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 125000002887 hydroxy group Chemical group [H]O* 0.000 description 2
- 229910003437 indium oxide Inorganic materials 0.000 description 2
- PJXISJQVUVHSOJ-UHFFFAOYSA-N indium(iii) oxide Chemical compound [O-2].[O-2].[O-2].[In+3].[In+3] PJXISJQVUVHSOJ-UHFFFAOYSA-N 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000000178 monomer Substances 0.000 description 2
- 235000021317 phosphate Nutrition 0.000 description 2
- 229920003023 plastic Polymers 0.000 description 2
- 239000004033 plastic Substances 0.000 description 2
- 125000002924 primary amino group Chemical group [H]N([H])* 0.000 description 2
- 229920002545 silicone oil Polymers 0.000 description 2
- 230000000087 stabilizing effect Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- FOXSXNJTWXVMEA-UHFFFAOYSA-N 1,3-bis(phenylsulfanyl)benzene Chemical compound C=1C=CC(SC=2C=CC=CC=2)=CC=1SC1=CC=CC=C1 FOXSXNJTWXVMEA-UHFFFAOYSA-N 0.000 description 1
- NCGICGYLBXGBGN-UHFFFAOYSA-N 3-morpholin-4-yl-1-oxa-3-azonia-2-azanidacyclopent-3-en-5-imine;hydrochloride Chemical compound Cl.[N-]1OC(=N)C=[N+]1N1CCOCC1 NCGICGYLBXGBGN-UHFFFAOYSA-N 0.000 description 1
- 239000004986 Cholesteric liquid crystals (ChLC) Substances 0.000 description 1
- GYHNNYVSQQEPJS-UHFFFAOYSA-N Gallium Chemical compound [Ga] GYHNNYVSQQEPJS-UHFFFAOYSA-N 0.000 description 1
- 239000004983 Polymer Dispersed Liquid Crystal Substances 0.000 description 1
- 230000004308 accommodation Effects 0.000 description 1
- 125000001931 aliphatic group Chemical group 0.000 description 1
- 125000000129 anionic group Chemical group 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 125000002915 carbonyl group Chemical group [*:2]C([*:1])=O 0.000 description 1
- 125000003178 carboxy group Chemical group [H]OC(*)=O 0.000 description 1
- 150000007942 carboxylates Chemical group 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000002019 doping agent Substances 0.000 description 1
- 230000001747 exhibiting effect Effects 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 239000005350 fused silica glass Substances 0.000 description 1
- 229910052733 gallium Inorganic materials 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 229910052738 indium Inorganic materials 0.000 description 1
- APFVFJFRJDLVQX-UHFFFAOYSA-N indium atom Chemical compound [In] APFVFJFRJDLVQX-UHFFFAOYSA-N 0.000 description 1
- AMGQUBHHOARCQH-UHFFFAOYSA-N indium;oxotin Chemical compound [In].[Sn]=O AMGQUBHHOARCQH-UHFFFAOYSA-N 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 230000010355 oscillation Effects 0.000 description 1
- -1 oxide Substances 0.000 description 1
- 125000001997 phenyl group Chemical group [H]C1=C([H])C([H])=C(*)C([H])=C1[H] 0.000 description 1
- NBIIXXVUZAFLBC-UHFFFAOYSA-K phosphate Chemical compound [O-]P([O-])([O-])=O NBIIXXVUZAFLBC-UHFFFAOYSA-K 0.000 description 1
- 239000010452 phosphate Substances 0.000 description 1
- 150000003013 phosphoric acid derivatives Chemical group 0.000 description 1
- 230000000379 polymerizing effect Effects 0.000 description 1
- 229920013636 polyphenyl ether polymer Polymers 0.000 description 1
- 229920006389 polyphenyl polymer Polymers 0.000 description 1
- 239000010453 quartz Substances 0.000 description 1
- 238000007348 radical reaction Methods 0.000 description 1
- 229910052594 sapphire Inorganic materials 0.000 description 1
- 239000010980 sapphire Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000000392 somatic effect Effects 0.000 description 1
- 238000004611 spectroscopical analysis Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- QAOWNCQODCNURD-UHFFFAOYSA-L sulfate group Chemical group S(=O)(=O)([O-])[O-] QAOWNCQODCNURD-UHFFFAOYSA-L 0.000 description 1
- BDHFUVZGWQCTTF-UHFFFAOYSA-M sulfonate Chemical group [O-]S(=O)=O BDHFUVZGWQCTTF-UHFFFAOYSA-M 0.000 description 1
- 150000003568 thioethers Chemical class 0.000 description 1
- 125000003396 thiol group Chemical group [H]S* 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- YVTHLONGBIQYBO-UHFFFAOYSA-N zinc indium(3+) oxygen(2-) Chemical compound [O--].[Zn++].[In+3] YVTHLONGBIQYBO-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/22—Measuring arrangements characterised by the use of optical techniques for measuring depth
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
- G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/4865—Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
- G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
- G02B26/0816—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light by means of one or more reflecting elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0081—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. enlarging, the entrance or exit pupil
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/4205—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having a diffractive optical element [DOE] contributing to image formation, e.g. whereby modulation transfer function MTF or optical aberrations are relevant
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/44—Grating systems; Zone plate systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0013—Means for improving the coupling-in of light from the light source into the light guide
- G02B6/0015—Means for improving the coupling-in of light from the light source into the light guide provided on the surface of the light guide or in the bulk of it
- G02B6/0016—Grooves, prisms, gratings, scattering particles or rough surfaces
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0013—Means for improving the coupling-in of light from the light source into the light guide
- G02B6/0023—Means for improving the coupling-in of light from the light source into the light guide provided by one optical element, or plurality thereof, placed between the light guide and the light source, or around the light source
- G02B6/0031—Reflecting element, sheet or layer
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0033—Means for improving the coupling-out of light from the light guide
- G02B6/0035—Means for improving the coupling-out of light from the light guide provided on the surface of the light guide or in the bulk of it
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0033—Means for improving the coupling-out of light from the light guide
- G02B6/005—Means for improving the coupling-out of light from the light guide provided by one optical element, or plurality thereof, placed on the light output side of the light guide
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0066—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form characterised by the light source being coupled to the light guide
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/24—Coupling light guides
- G02B6/26—Optical coupling means
- G02B6/35—Optical coupling means having switching means
- G02B6/351—Optical coupling means having switching means involving stationary waveguides with moving interposed optical elements
- G02B6/3512—Optical coupling means having switching means involving stationary waveguides with moving interposed optical elements the optical element being reflective, e.g. mirror
- G02B6/3518—Optical coupling means having switching means involving stationary waveguides with moving interposed optical elements the optical element being reflective, e.g. mirror the reflective optical element being an intrinsic part of a MEMS device, i.e. fabricated together with the MEMS device
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
- G02F1/1333—Constructional arrangements; Manufacturing methods
- G02F1/1335—Structural association of cells with optical devices, e.g. polarisers or reflectors
- G02F1/133504—Diffusing, scattering, diffracting elements
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
- G02F1/1333—Constructional arrangements; Manufacturing methods
- G02F1/1335—Structural association of cells with optical devices, e.g. polarisers or reflectors
- G02F1/133526—Lenses, e.g. microlenses or Fresnel lenses
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/29—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection
- G02F1/292—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection by controlled diffraction or phased-array beam steering
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/29—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection
- G02F1/294—Variable focal length devices
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/29—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection
- G02F1/33—Acousto-optical deflection devices
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/29—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection
- G02F1/33—Acousto-optical deflection devices
- G02F1/335—Acousto-optical deflection devices having an optical waveguide structure
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/02—Details of features involved during the holographic process; Replication of holograms without interference recording
- G03H1/024—Hologram nature or properties
- G03H1/0248—Volume holograms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/163—Wearable computers, e.g. on a belt
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
- G09G3/002—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
- G09G3/3413—Details of control of colour illumination sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H04N5/23238—
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B27/0103—Head-up displays characterised by optical features comprising holographic elements
- G02B2027/0105—Holograms with particular structures
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
- G02B2027/0174—Head mounted characterised by optical features holographic
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2310/00—Command of the display device
- G09G2310/02—Addressing, scanning or driving the display screen or processing steps related thereto
- G09G2310/0235—Field-sequential colour display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H04N9/04—
Definitions
- the present disclosure relates to tunable optical devices, and in particular to ranging and imaging systems usable in visual displays, as well as components, modules, and methods for such ranging and imaging.
- Visual displays provide information to viewer(s) including still images, video, data, etc. Visual displays have applications in diverse fields including entertainment, education, engineering, science, professional training, advertising, to name just a few examples. Some visual displays, such as TV sets, display images to several users, and some visual display systems, such s near-eye displays (NEDs), are intended for individual users.
- NEDs near-eye displays
- An artificial reality system generally includes an NED (e.g., a headset or a pair of glasses) configured to present content to a user.
- the near-eye display may display virtual objects or combine images of real objects with virtual objects, as in virtual reality (VR), augmented reality (AR), or mixed reality (MR) applications.
- VR virtual reality
- AR augmented reality
- MR mixed reality
- a user may view images of virtual objects (e.g., computer-generated images (CGIs)) superimposed with the surrounding environment by seeing through a “combiner” component.
- the combiner component including its light routing optics may be transparent to external light.
- Head-mounted display devices can benefit from a compact and efficient elements and modules, including efficient light sources and illuminators, high-throughput combiner components and ocular lenses, wide-field cameras, eye trackers, depth sensors, and other optical elements.
- FIG. 1 is a schematic cross-sectional view of an imaging device having a compound field of view
- FIGS. 2 A and 2 B are schematic cross-sectional views of a lightguide embodiment of the imaging device of FIG. 1 at different grating periods of in-coupling and/or out-coupling gratings of the lightguide;
- FIG. 3 is a schematic cross-sectional view of a ranging device having a compound field of view
- FIG. 4 is a schematic cross-sectional view of an eye tracker having a compound field of view
- FIG. 5 is a schematic cross-sectional view of a ranging device having a compound ranging field of view
- FIG. 6 is a schematic cross-sectional view of a lightguide embodiment of the ranging device of FIG. 5 ;
- FIG. 7 is a schematic cross-sectional view of a diffraction grating structure including a stack of switchable gratings of different grating pitch;
- FIG. 8 shows side cross-sectional views of a tunable liquid crystal (LC) surface-relief grating of this disclosure
- FIG. 9 A is a frontal view of an active Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating usable in imaging and ranging devices of this disclosure;
- PBP Pancharatnam-Berry phase
- LC liquid crystal
- FIG. 9 B is a magnified schematic view of LC molecules in an LC layer of the active PBP LC grating of FIG. 9 A ;
- FIGS. 10 A and 10 B are side schematic views of the active PBP LC grating of FIGS. 9 A and 9 B , showing light propagation in OFF ( FIG. 10 A ) and ON ( FIG. 10 B ) states of the active PBP LC grating;
- FIG. 11 A is a side cross-sectional view of a switchable polarization volume grating (PVH) usable in imaging and ranging devices of this disclosure;
- PVH switchable polarization volume grating
- FIG. 11 B is a diagram illustrating optical performance of the PVH of FIG. 11 A ;
- FIG. 12 A is a side cross-sectional view of a fluidic grating usable in imaging and ranging devices of this disclosure, in an OFF state;
- FIG. 12 B is a side cross-sectional view of the fluidic grating of FIG. 12 A in an ON state
- FIG. 13 A is a side cross-sectional view of a lightguide including an acoustic actuator for creating a volume acoustic wave in the lightguide;
- FIG. 13 B is a side cross-sectional view of a lightguide including an acoustic actuator for creating a surface acoustic wave in the lightguide;
- FIG. 14 is a flow chart of an imaging method in accordance with this disclosure.
- FIG. 15 is a view of an augmented reality (AR) display having a form factor of a pair of eyeglasses.
- AR augmented reality
- FIG. 16 is a three-dimensional view of a head-mounted display (HMD) of this disclosure.
- HMD head-mounted display
- Near-eye displays use eye trackers to determine viewer's eyes position and orientation. This information is used to adjust the optical system's accommodation distance to account for the eye pupil position, to redirect light towards the pupil for better optical throughput, to adjust the displayed content, etc.
- eye trackers may employ a specialized imaging device to obtain real-time images of user's eyes.
- Near-eye displays may also use various types of imagers of outside environment, including a color camera, a depth sensing camera or a ranging device, and the like.
- switchable grating structures may be used to extend or multiply a field of view of a camera or a ranging device while preserving compactness, low weight, and spatial resolution.
- a diffraction grating structure may be placed upstream of a camera.
- the diffraction grating structure may have a switchable grating period for switching the camera field of view between a plurality of overlapping portions of a compound field of view, making the compound field of view significantly greater than the camera's inherent field of view.
- a similar approach may be adapted in respect of a ranging device, a scanner, etc.
- an imaging device comprising a camera for capturing an image within a camera field of view and a diffraction grating structure upstream of the camera.
- the diffraction grating structure has a switchable grating period for switching the camera field of view between a plurality of overlapping portions of a compound field of view, whereby the compound field of view is greater than the camera field of view, i.e. the switchable diffraction grating structure enables a broader field of view than an inherent field of view of the camera.
- the imaging device includes a lightguide for propagating a light beam therein by a series of internal reflections, the light beam carrying the image, and an in-coupling grating supported by the lightguide for in-coupling the light beam into the lightguide.
- the diffraction grating structure may be supported by the lightguide for out-coupling, towards the camera, portions of the light beam propagating in the lightguide.
- the imaging device includes an out-coupling grating supported by the lightguide for out-coupling portions of the light beam propagating in the lightguide towards the camera.
- the diffraction grating structure may be supported by the lightguide for in-coupling the light beam into the lightguide.
- the image may include a color image of outside environment of the near-eye display.
- the image may include depth information associated with pixels of the image.
- the image may include an image of an eye of a user of the near-eye display.
- the diffraction grating structure may include a stack of switchable gratings of differing grating pitch, each switchable grating being switchable between a high-efficiency state wherein efficiency of the switchable grating is above a first threshold, and a low-efficiency state wherein the efficiency of the switchable grating is below a second threshold, wherein the second threshold is lower than the first threshold, e.g. 10 or 100 or 1000 times lower.
- the diffraction grating may include, by way of non-limiting examples, a switchable polarization volume hologram (PVH) grating, a switchable Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating, a switchable surface relief liquid crystal (LC) grating, and/or a switchable fluidic grating.
- the image device comprises an acoustic actuator coupled to a slab of transparent material, and the diffraction grating structure may be formed by an acoustic wave generated by the acoustic actuator in the slab.
- the imaging device may include a controller operably coupled to the camera and the diffraction grating structure and configured to operate the diffraction grating structure to switch the camera field of view between the plurality of overlapping portions of the compound field of view, capture an image at each portion of the plurality of overlapping portions of the compound field of view, and optionally stitch the images captured at each portion of the plurality of overlapping portions to obtain a compound image corresponding to the compound field of view.
- a controller operably coupled to the camera and the diffraction grating structure and configured to operate the diffraction grating structure to switch the camera field of view between the plurality of overlapping portions of the compound field of view, capture an image at each portion of the plurality of overlapping portions of the compound field of view, and optionally stitch the images captured at each portion of the plurality of overlapping portions to obtain a compound image corresponding to the compound field of view.
- an imaging method comprising: switching a field of view of a camera between the plurality of overlapping portions of a compound field of view by switching a grating period of a diffraction grating structure upstream of the camera; at each portion of the plurality of overlapping portions of the compound field of view, capturing an image; and stitching the images captured at each portion of the plurality of overlapping portions to obtain a compound image corresponding to the compound field of view.
- the switching may include switching at least one of a stack of switchable gratings of differing grating pitch to a high-efficiency state above a first threshold, while the remaining switchable gratings of the stack are in a low-efficiency state below a second threshold lower than the first threshold, e.g. 10, 100, or even 1000 times lower.
- the switching may include switching at least one of: a switchable polarization volume hologram (PVH) grating; a switchable Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating; a switchable surface relief liquid crystal (LC) grating; or a fluidic grating
- PVH switchable polarization volume hologram
- PBP Pancharatnam-Berry phase
- LC liquid crystal
- LC switchable surface relief liquid crystal
- a ranging device comprising a transmitter for providing a ranging light beam within a ranging field of view, and a diffraction grating structure downstream of the transmitter, the diffraction grating structure having a switchable grating period for switching the ranging field of view between a plurality of overlapping portions of a compound field of view, whereby the compound field of view is greater than the ranging field of view.
- the ranging device may include a lightguide for propagating the light beam therein by a series of internal reflections, and an in-coupling grating supported by the lightguide for in-coupling the light beam into the lightguide.
- the diffraction grating structure may be supported by the lightguide for out-coupling portions of the light beam propagating in the lightguide.
- the diffraction grating structure may include a stack of switchable gratings of differing grating pitch, each switchable grating being switchable between a high-efficiency state wherein efficiency of the switchable grating is above a first threshold, and a low-efficiency state wherein the efficiency of the switchable grating is below a second threshold, wherein the second threshold is lower than the first threshold, e.g.
- the diffraction grating structure may include at least one of: a switchable polarization volume hologram (PVH) grating; a switchable Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating; a switchable surface relief liquid crystal (LC) grating; or a fluidic grating.
- PVH switchable polarization volume hologram
- PBP Pancharatnam-Berry phase
- LC liquid crystal
- LC switchable surface relief liquid crystal
- fluidic grating a fluidic grating.
- an imaging device 100 includes a camera 102 , e.g. a monochrome or color camera having a lens 104 optically coupled to a monochrome or color photodetector array 106 .
- the camera 102 can capture an image within a camera field of view, which is determined by the focal length of the lens 104 and linear size, i.e. width and height, of the photodetector array 106 .
- a diffraction grating structure 108 is disposed upstream of the camera 102 .
- the diffraction grating structure 108 has a switchable strength and/or grating period for switching the camera field of view between a plurality of overlapping FOV portions, in this example a left portion 111 shown with dashed lines, a middle portion 112 shown with solid lines, and a right portion 113 shown with dotted lines. There may be more than three portions. Together, the left 111 , middle 112 , and right 113 FOV portions form a compound field of view 110 . The field of view is switched by redirecting, by diffraction, the impinging light. An angle of redirection is defined by the period of the diffraction grating structure 108 . Examples of the diffraction grating structure 108 will be provided further below.
- the ability to switch the camera FOV enables the compound field of view 110 to be much larger than the camera FOV, thereby providing an effective FOV expansion without having to use a wide-angle lens coupled to a high pixel count photodetector array.
- FOV field of view
- FOV field of view
- the imaging device 100 may include a controller 150 operably coupled, e.g. electrically and/or mechanically connected, to the camera 102 and the diffraction grating structure 108 .
- the controller 150 may be configured, e.g. programmed, wired, etc., to operate the diffraction grating structure 108 to switch the camera 102 field of view between the overlapping portions 111 , 112 , 113 of the compound field of view 110 .
- the controller 150 may be configured to capture an image at each portion 111 , 112 , 113 of the compound field of view 110 , e.g. by going sequentially through each portion and taking one or several images at each FOV portion.
- the controller 150 may then stitch the partial images captured at each portion 111 , 112 , 113 to obtain a compound image corresponding to the compound field of view 110 . In this manner, a very wide field of view may be achieved.
- an imaging device 200 is an embodiment of the imaging device 100 of FIG. 1 , and includes similar elements.
- the camera 102 is coupled to a lightguide 214 .
- the lightguide 214 which may be e.g. a flat or curved plate or slab of a transparent material such as glass, plastic, oxide, crystal etc., supports an in-coupling grating 216 and an out-coupling grating 218 .
- a controller similar to the controller 150 of the imaging device 100 of FIG. 1 operates in a similar manner, and is omitted from FIGS. 2 A and 2 B for brevity.
- the in-coupling grating 216 in-couples a light beam 215 into the lightguide 214 .
- the light beam 215 carries an image to be captured by the camera 102 .
- the lightguide propagates the light beam 215 in the lightguide 214 by a series of internal reflections from its opposed surfaces.
- the light beam 215 propagates along a zigzag path 217 shown with dotted lines.
- the out-coupling grating 218 out-couples portions 219 of the light beam 215 propagating in the lightguide 214 towards the camera 102 .
- At least one of the in-coupling grating 216 or the out-coupling grating 218 includes the pitch-switchable diffraction grating structure 108 of FIG. 1 .
- the out-coupling grating 218 includes the diffraction grating structure 108
- the latter out-couples the light beam portions 219 towards the camera 102 at a switchable angle, effectively switching between different FOV portions.
- the in-coupling grating 216 that includes the diffraction grating structure 108
- the latter in-couples the light beam portions 219 towards the camera 102 at a switchable angle, thereby directly switching between different FOV portions. For instance, FIG.
- the imaging device 200 may be used in a near-eye display for imaging outside environment of a wearer of the near-eye display.
- the camera 102 may be a monochrome or color camera operating in the visible part of optical spectrum for capturing monochrome or color images of outside environment of the near-eye display, an infrared camera facilitating night-time vision, etc.
- the images of the outside environment may be used by a controller of the near-eye display for determining size and position of outside objects for various actions such as proximity warning, picking up objects, etc.
- the images of the outside environment may be projected or combined with virtual generated imagery displayed to a user of the virtual reality system, for a better situational awareness of the user.
- a depth sensing imaging device 300 is similar to the imaging device 200 of FIGS. 2 A and 2 B , and includes similar elements.
- the depth sensing imaging device 300 of FIG. 3 includes a depth sensing camera 302 coupled to a lightguide 314 , which may be similar to the lightguide 214 of FIG. 2 .
- the lightguide 314 of FIG. 3 supports an in-coupling grating 316 and an out-coupling grating 318 .
- a ranging light source 336 provides illuminating light 338 in form of a succession of short pulses or other form of an intensity-modulated light.
- the purpose of the ranging light source 336 is to illuminate the outside environment being imaged, e.g. an object 340 of the outside environment.
- a controller 350 may be operably coupled to the ranging light source 336 , the lightguide 314 , or more specifically to the switchable diffraction grating structure of the lightguide 314 , and the depth sensing camera 302 .
- the controller 350 causes the ranging light source 336 to emit the illuminating light 338 , which is modulated at a known frequency and phase.
- the illuminating light 338 may include a succession of short light pulses of known emission time.
- Light 315 reflected from the object 340 in the outside environment reaches the in-coupling grating 316 , which in-couples the light 315 into the lightguide 314 .
- the in-coupled light 315 propagates in the lightguide 314 along a light path 317 defined by reflections of the light 315 from opposed surfaces of the lightguide 314 , as illustrated. Portions 319 of the light 315 are out-coupled by the out-coupling grating 318 .
- the depth sensing camera 302 may detect the light 315 in a time-selective manner. Photons arriving at different time intervals from the pulse of the illuminating light 338 may be counted separately, and the distance to elements of the imagery received, e.g. the distance to the object 340 , may be determined from the time interval when the photons of the reflected light 315 are received relative to the moment of emission of the illuminating light 338 pulse.
- the illuminating light 338 may be periodically e.g. sinusoidally modulated, and the light 315 may be detected by the depth sensing camera 302 in a phase-sensitive manner.
- the distance to the object 340 may be determined from the phase delay between the illuminating light 338 and the received light 315 .
- the image detected by the depth sensing camera 302 includes depth information associated with pixels of the image. It is further noted that similar concepts are applicable to the imaging device 100 of FIG. 1 , i.e. the lightguide 314 may be replaced with the switchable diffraction grating structure 108 , without a lightguide.
- an eye tracking imaging device 400 includes an eye tracking camera 402 coupled to a lightguide 414 .
- the lightguide 414 supports an in-coupling grating 416 and an out-coupling grating 418 .
- One of these gratings, or both of these gratings, may include a switchable diffraction grating structure for switching FOV portions as explained above.
- the eye tracking imaging device 400 further includes a plurality of eye illuminators 438 , which may be supported by the lightguide 414 on its proximal side, i.e. on the side facing a user's eye 440 .
- the purpose of the eye illuminators 438 is to illuminate the eye 440 .
- Light 415 reflected by the eye 440 is in-coupled by the in-coupling grating 416 into the lightguide 414 .
- the in-coupled light 415 then propagates in the lightguide 414 by a series of internal reflections from opposed surfaces of the lightguide 414 , as indicated with a zigzag lightpath 417 .
- the eye tracking camera 402 detects the light 415 and obtains images of the eye 440 .
- the expansion of the FOV afforded by switchable diffraction grating structure in the in-coupling 416 and/or out-coupling 418 gratings enables the eye 440 to be detected at a plurality of locations, e.g. the first 440 A and second 440 B locations. Similar concepts are applicable to the imaging device 100 of FIG. 1 , i.e. the lightguide 414 may be replaced with the switchable diffraction grating structure 108 .
- a ranging device 500 includes a transmitter 536 optically coupled to a diffraction grating structure 508 downstream of the transmitter 536 .
- the transmitter 536 provides a ranging light beam 538 within a ranging field of view.
- the ranging light beam 538 may include, for example, a diverging (e.g. with a divergence of 40 degrees or more) modulated beam, a wide-angle pulsed beam, a collimated (e.g.
- the time characteristic of the ranging light beam 538 may be used as a basis for the distance determination by calculating time of flight of ranging light beam 538 to an object (not shown for brevity) and time of flight of a reflected or scattered light beam back to a photodetector or a camera 502 of the ranging device 500 .
- the purpose of the photodetector or camera 502 is to capture the reflected or scattered light beam.
- the diffraction grating structure 508 is disposed downstream of the transmitter 536 .
- the diffraction grating structure 508 has a switchable grating period for switching the ranging field of view between a plurality of overlapping portions 511 , 512 , 513 of a compound field of view 510 .
- the compound field of view 510 may be obtained by stitching the portions 511 , 512 , 513 , and may be far greater than the ranging field of view of the ranging device 500 .
- a ranging device 600 is an embodiment of the ranging device 500 of FIG. 5 , and includes similar elements.
- the transmitter 536 is coupled to a lightguide 614 .
- the lightguide 614 supports an in-coupling grating 616 and an out-coupling grating 618 .
- At least one of the in-coupling grating 216 or the out-coupling grating 218 includes a pitch-switchable diffraction grating structure, similar to the diffraction grating structure 108 of FIG. 1 described above.
- the in-coupling grating 616 in-couples the ranging light beam 538 emitted by the transmitter 536 into the lightguide 614 .
- the lightguide 614 includes a slab of transparent material such as glass, plastic, crystal, metal oxide, etc., that propagates the ranging light beam 538 in the lightguide 614 by a series of internal reflections from opposed surfaces of the slab.
- the ranging light beam 538 propagates along a zigzag light path 617 .
- the out-coupling grating 618 out-couples portions of the ranging light beam 538 towards an external object being imaged or ranged. Reflected light is detected by the photodetector or camera 502 ( FIG. 6 ).
- the distance to the object may be determined from the arrival time or phase of optical power modulation of the received light.
- a switchable diffraction grating structure 708 may be used in any of the imaging and ranging devices described herein.
- the switchable diffraction grating structure 708 includes a stack of switchable gratings of differing grating pitch or grating period, in this example first 771 and second 772 switchable gratings. More than two gratings may be provided.
- Each switchable grating 771 and 772 is switchable between a high-efficiency state when efficiency of the switchable grating is above a first threshold, and a low-efficiency state when the efficiency of the switchable grating is below a second threshold.
- the second threshold is lower than the first threshold, e.g. at least 10 times lower, at least 100 times lower, or at least 300 times lower.
- a tunable liquid crystal (LC) surface-relief grating 800 may be used e.g. in the diffraction grating structure 108 of the imaging device 100 of FIG. 1 , the in-coupling 216 and/or out-coupling 218 gratings of the imaging device 200 of FIGS. 2 A and 2 B , the in-coupling 316 and/or out-coupling 318 gratings of the depth sensing imaging device 300 of FIG. 3 , the in-coupling 416 and/or out-coupling 418 gratings of the eye tracking imaging device 400 of FIG.
- LC liquid crystal
- the tunable LC surface-relief grating 800 includes a first substrate 801 supporting a first conductive layer 811 and a surface-relief grating structure 804 having a plurality of ridges 806 extending from the first substrate 801 and/or the first conductive layer 811 .
- a second substrate 802 is spaced apart from the first substrate 801 .
- the second substrate 802 supports a second conductive layer 812 .
- a cell is formed by the first 811 and second 812 conductive layers.
- the cell is filled with a LC fluid, forming an LC layer 808 .
- the LC layer 808 includes nematic LC molecules 810 , which may be oriented by an electric field across the LC layer 808 .
- the electric field may be provided by applying a voltage V to the first 811 and second 812 conductive layers.
- the surface-relief grating structure 804 may be formed from a polymer with an isotropic refractive index n p of about 1.5, for example.
- the LC fluid has an anisotropic refractive index.
- the LC fluid For light polarization parallel to a director of the LC fluid, i.e. to the direction of orientation of the nematic LC molecules 810 , the LC fluid has an extraordinary refractive index n e , which may be higher than an ordinary refractive index n o of the LC fluid for light polarization perpendicular to the director.
- the extraordinary refractive index n e may be about 1.7
- the ordinary refractive index n o may be about 1.5, i.e. matched to the refractive index n p of the surface-relief grating structure 804 .
- the LC molecules 810 are aligned approximately parallel to the grooves of the surface-relief grating structure 804 .
- a linearly polarized light beam 821 with e-vector oriented along the grooves of the surface-relief grating structure 804 will undergo diffraction, since the surface-relief grating structure 804 will have a non-zero refractive index contrast.
- the LC molecules 810 are aligned approximately perpendicular to the grooves of the surface-relief grating structure 804 .
- a linearly polarized light beam 821 with e-vector oriented along the grooves of the surface-relief grating structure 804 will not undergo diffraction because the surface-relief grating structure 804 will appear to be index-matched and, accordingly, will have a substantially zero refractive index contrast.
- the linearly polarized light beam 821 with e-vector oriented perpendicular to the grooves of the surface-relief grating structure 804 no diffraction will occur in either case (i.e. when the voltage is applied and when it is not), because at this polarization of the linearly polarized light beam 821 , the surface-relief grating structure 804 are index-matched.
- the tunable LC surface-relief grating 800 can be switched on and off (for polarized light) by controlling the voltage across the LC layer 808 .
- Several such gratings with differing pitch/slant angle/refractive index contrast may be used to switch between several grating configurations.
- the surface-relief grating structure 804 may include a birefringent material, as well.
- a Pancharatnam-Berry phase (PBP) LC switchable grating 900 may be used e.g. in the diffraction grating structure 108 of the imaging device 100 of FIG. 1 , the in-coupling 216 and/or out-coupling 218 gratings of the imaging device 200 of FIGS. 2 A and 2 B , the in-coupling 316 and/or out-coupling 318 gratings of the depth sensing imaging device 300 of FIG. 3 , the in-coupling 416 and/or out-coupling 418 gratings of the eye tracking imaging device 400 of FIG. 4 , the diffraction grating structure 508 of the ranging device 500 of FIG.
- PBP Pancharatnam-Berry phase
- the PBP LC switchable grating 900 of FIG. 9 A includes LC molecules 902 in an LC layer 904 .
- the LC molecules 902 are disposed in XY plane at a varying in-plane orientation depending on the X coordinate.
- the orientation angle ⁇ ( x ) of the LC molecules 902 in the PBP LC switchable grating 900 is given by
- ⁇ o is the wavelength of impinging light
- T is a pitch of the PBP LC switchable grating 900
- ⁇ is a diffraction angle given by
- the azimuthal angle ⁇ varies continuously across the surface of an LC layer 904 parallel to XY plane as illustrated in FIG. 9 B .
- the variation has a constant period equal to T.
- FIGS. 10 A and 10 B illustrate the operation of the PBP LC switchable grating 900 of FIG. 9 A .
- the PBP LC switchable grating 900 includes the LC layer 904 ( FIG. 9 A ) disposed between parallel substrates configured for applying an electric field across the LC layer 904 .
- the LC molecules 902 are oriented substantially parallel to the substrates in absence of the electric field, and substantially perpendicular to the substrates in presence of the electric field.
- the PBP LC switchable grating 900 is in OFF state, such that its LC molecules 902 ( FIGS. 9 A, 9 B ) are disposed predominantly parallel to the substrate plane, that is, parallel to XY plane in FIG. 10 A .
- LCP left-circular polarized
- the PBP LC switchable grating 900 redirects the light beam 1015 upwards by a pre-determined non-zero angle, and the beam 1015 becomes right-circular polarized (RCP).
- the RCP deflected beam 1015 is shown with solid lines.
- the PBP LC switchable grating 900 redirects the beam 1015 downwards by a pre-determined non-zero angle, and the beam 1015 becomes left-circular polarized (LCP).
- LCP left-circular polarized
- the LCP deflected beam 1015 is shown with dashed lines.
- Applying a voltage V to the PBP LC switchable grating 900 reorients the LC molecules along Z-axis, i.e. perpendicular to the substrate plane as shown in FIG. 10 B .
- the PBP structure is erased, and the light beam 1015 retains its original direction, whether it is LCP or RCP.
- the active PBP LC grating 900 is a tunable grating, i.e. it has a variable beam steering property. Furthermore, the operation of the active PBP LC grating 900 may be controlled by controlling the polarization state of the impinging light beam 1015 .
- a polarization volume hologram (PVH) grating 1100 may be used e.g. in the diffraction grating structure 108 of the imaging device 100 of FIG. 1 , the in-coupling 216 and/or out-coupling 218 gratings of the imaging device 200 of FIGS. 2 A and 2 B , the in-coupling 316 and/or out-coupling 318 gratings of the depth sensing imaging device 300 of FIG. 3 , the in-coupling 416 and/or out-coupling 418 gratings of the eye tracking imaging device 400 of FIG. 4 , the diffraction grating structure 508 of the ranging device 500 of FIG.
- PVH polarization volume hologram
- the PVH grating 1100 of FIG. 11 A includes an LC layer 1104 bound by opposed top 1105 and bottom 1106 parallel surfaces.
- the LC layer 1104 may include an LC fluid containing rod-like LC molecules 1107 with positive dielectric anisotropy, i.e. nematic LC molecules.
- a chiral dopant may be added to the LC fluid, causing the LC molecules in the LC fluid to self-organize into a periodic helical configuration including helical structures 1108 extending between the top 1105 and bottom 1106 parallel surfaces of the LC layer 1104 .
- Such a configuration of the LC molecules 1107 termed herein a cholesteric configuration, includes a plurality of helical periods p, e.g. at least two, at least five, at least ten, at least twenty, or at least fifty helical periods p between the top 1105 and bottom 1106 parallel surfaces of the LC layer 1104 .
- Boundary LC molecules 1107 b at the top surface 1105 of the LC layer 1104 may be oriented at an angle to the top surface 1105 .
- the boundary LC molecules 1107 b may have a spatially varying azimuthal angle, e.g. linearly varying along X-axis parallel to the top surface 1105 , as shown in FIG. 11 A .
- an alignment layer 1112 may be provided at the top surface 1105 of the LC layer 1104 .
- the alignment layer 1112 may be configured to provide the desired orientation pattern of the boundary LC molecules 1107 b , such as the linear dependence of the azimuthal angle on the X-coordinate.
- a pattern of spatially varying polarization directions of the UV light may be selected to match a desired orientation pattern of the boundary LC molecules 1107 b at the top surface 1105 and/or the bottom surface 1106 of the LC layer 1104 .
- the boundary LC molecules 1107 b are oriented along the photopolymerized chains of the alignment layer 1112 , thus adopting the desired surface orientation pattern.
- Adjacent LC molecules adopt helical patterns extending from the top 1105 to the bottom 1106 surfaces of the LC layer 1104 , as shown.
- the boundary LC molecules 1107 b define relative phases of the helical structures 1108 having the helical period p.
- the helical structures 1108 form a volume grating comprising helical fringes 1114 tilted at an angle , as shown in FIG. 11 A .
- the steepness of the tilt angle depends on the rate of variation of the azimuthal angle of the boundary LC molecules 1107 b at the top surface 1105 and p.
- the tilt angle is determined by the surface alignment pattern of the boundary LC molecules 1107 b at the alignment layer 1112 .
- the volume grating has a period ⁇ x along X-axis and ⁇ y along Y-axis.
- the periodic helical structures 1108 of the LC molecules 1107 may be polymer-stabilized by mixing in a stabilizing polymer into the LC fluid, and curing (polymerizing) the stabilizing polymer.
- the helical nature of the fringes 1114 of the volume grating makes the PVH grating 1100 preferably responsive to light of polarization having one particular handedness, e.g. left- or right-circular polarization, while being substantially non-responsive to light of the opposite handedness of polarization.
- the helical fringes 1114 make the PVH grating 1100 polarization-selective, causing the PVH grating 1100 to diffract light of only one handedness of circular polarization. This is illustrated in FIG. 11 B , which shows a light beam 1120 impinging onto the PVH grating 1100 .
- the light beam 1120 includes a left circular polarized (LCP) beam component 1121 and a right circular polarized (RCP) beam component 1122 .
- the LCP beam component 1121 propagates through the PVH grating 1100 substantially without diffraction.
- substantially without diffraction means that, even though an insignificant portion of the beam (the LCP beam component 1121 in this case) might diffract, the portion of the diffracted light energy is so small that it does not impact the intended performance of the PVH grating 1100 .
- the RCP beam component 1122 of the light beam 1120 undergoes diffraction, producing a diffracted beam 1122 ′.
- the polarization selectivity of the PVH grating 1100 results from the effective refractive index of the grating being dependent on the relationship between the handedness, or chirality, of the impinging light beam and the handedness, or chirality, of the grating fringes 1114 . Changing the handedness of the impinging light may be used to switch the performance of the PVH grating 1100 .
- the PVH grating 1100 may also be made switchable or tunable (both terms are used interchangeably in this specification) by applying voltage to the LC layer 1104 , which distorts or erases the above-described helical structure.
- sensitivity of the PVH 1100 to right circular polarized light in particular is only meant as an illustrative example.
- the PVH 1100 may be made sensitive to left circular polarized light.
- the operation of the PVH 1100 may be controlled by controlling the polarization state of the impinging light beam 1120 .
- the PVH 1100 may be made tunable by application of electric field across the LC layer 1104 , which erases the periodic helical structures 1108 .
- a fluidic grating 1200 may be used e.g. in the diffraction grating structure 108 of the imaging device 100 of FIG. 1 , the in-coupling 216 and/or out-coupling 218 gratings of the imaging device 200 of FIGS. 2 A and 2 B , the in-coupling 316 and/or out-coupling 318 gratings of the depth sensing imaging device 300 of FIG. 3 , the in-coupling 416 and/or out-coupling 418 gratings of the eye tracking imaging device 400 of FIG. 4 , the diffraction grating structure 508 of the ranging device 500 of FIG.
- the fluidic grating 1200 includes first 1201 and second 1202 immiscible fluids separated by an inter-fluid boundary 1203 .
- One of the fluids may be a hydrophobic fluid such as oil, e.g. silicone oil, while the other fluid may be water-based.
- One of the first 1201 and second 1202 fluids may be a gas in some embodiments.
- the first 1201 and second 1202 fluids may be contained in a cell formed by first 1211 and second 1212 substrates supporting first 1221 and second 1222 electrode structures.
- the first 1221 and/or second 1222 electrode structures may be at least partially transparent, absorptive, and/or reflective.
- At least one of the first 1221 and second 1222 electrode structures may be patterned for imposing a spatially variant electric field onto the 1201 and second 1202 fluids.
- the first electrode 1221 is patterned, and the second electrodes 1222 is not patterned, i.e. the second electrodes 1222 is a backplane electrode.
- both the first 1221 and second 1222 electrodes are substantially transparent.
- the first 1221 and second 1222 electrodes may be indium tin oxide (ITO) electrodes.
- ITO indium tin oxide
- the individual portions of a patterned electrode may be individually addressable.
- the patterned electrode 1221 may be replaced with a continuous, non-patterned electrode coupled to a patterned dielectric layer for creating a spatially non-uniform electric field across the first 1201 and second 1202 fluids.
- FIG. 12 A shows the fluidic grating 1200 in a non-driven state when no electric field is applied across the inter-fluid boundary 1203 .
- the inter-fluid boundary 1203 is straight and smooth; accordingly, a light beam 1205 impinging onto the fluidic grating 1200 does not diffract, propagating right through as illustrated.
- FIG. 12 B shows the fluidic grating 1200 in a driven state when a voltage V is applied between the first 1221 and second 1222 electrodes, producing a spatially variant electric field across the first 1201 and second 1202 fluids separated by the inter-fluid boundary 1203 .
- the application of the spatially variant electric field causes the inter-fluid boundary 1203 to distort as illustrated in FIG.
- a periodic variation of effective refractive index i.e. a switchable or tunable surface-relief diffraction grating.
- the light beam 1205 impinging onto the fluidic grating 1200 will diffract, forming first 1231 and second 1232 diffracted sub-beams.
- the strength of the fluidic grating 1200 may be varied.
- the grating period and, accordingly, the diffraction angle may be varied.
- varying the effective voltage between separate sub-electrodes or pixels of the first electrode 1221 may result in a three-dimensional conformal change of the fluidic interface i.e. the inter-fluid boundary 1203 inside the fluidic volume to impart a desired optical response to the fluidic grating 1200 .
- the applied voltage pattern may be pre-biased to compensate or offset gravity effects, i.e. gravity-caused distortions of the inter-fluid boundary 1203 .
- the thickness of the first 1221 and second 1222 electrodes may be e.g. between 10 nm and 50 nm.
- the materials of the first 1221 and second 1222 electrodes besides ITO may be e.g. indium zinc oxide (IZO), zinc oxide (ZO), indium oxide (IO), tin oxide (TO), indium gallium zinc oxide (IGZO), etc.
- the first 1201 and second 1202 fluids may have a refractive index difference of at least 0.1, and may be as high as 0.2 and higher.
- One of the first 1201 or second 1202 fluids may include polyphenylether, 1,3-bis(phenylthio)benzene, etc.
- the first 1211 and/or second 1212 substrates may include e.g.
- the first 1211 and/or second 1212 substrates may be straight or curved, and may include vias and other electrical interconnects.
- the applied voltage may be varied in amplitude and/or duty cycle when applied at a frequency of between 100 Hz and 100 kHz.
- the applied voltage can change polarity and/or be bipolar.
- Individual first 1201 and/r second 1202 fluid layers may have a thickness of between 0.5-5 micrometers, more preferably between 0.5-2 micrometer.
- surfactants containing one hydrophilic end functional group and one hydrophobic end functional group may be used.
- the examples of a hydrophilic end functional group are hydroxyl, carboxyl, carbonyl, amino, phosphate, sulfhydryl.
- the hydrophilic functional groups may also be anionic groups such as sulfate, sulfonate, carboxylates, phosphates, for example.
- Non-limiting examples of a hydrophobic end functional group are aliphatic groups, aromatic groups, fluorinated groups.
- a surfactant containing aromatic end group and fluronirated end group may be used.
- phenyl silicone oil and water are selected as the fluid pair, a surfactant containing aromatic end group and hydroxyl (or amino, or ionic) end group may be used.
- a pupil-replicating lightguide 1300 A of this disclosure includes a body 1306 A having two portions, a substrate 1328 for propagating image light 1304 , and a volume-wave acoustic actuator 1330 A mechanically coupled at a side of the substrate 1328 joining its top 1315 and bottom 1316 surfaces.
- the volume-wave acoustic actuator 1330 A includes an electrically responsive layer 1332 A, e.g. a piezoelectric layer, disposed between electrodes 1307 A, 1308 A.
- an electrical signal at a high frequency is applied to the electrodes 1307 A, 1308 A causing the electrically responsive layer 1332 A to oscillate, typically at a frequency of a mechanical resonance of the electrically responsive layer 1332 A.
- the oscillating thickness of the electrically responsive layer 1332 A creates a volume acoustic wave 1334 A propagating in the substrate 1328 in a direction 1335 , i.e. along the X-axis.
- the volume acoustic wave 1334 A modulates the refractive index of the substrate 1328 due to the effect of photoelasticity.
- the modulated refractive index creates a diffraction grating that out-couples portions 1312 , 1313 of the image light 1304 from the pupil-replicating lightguide 1300 A.
- the out-coupling grating may be switched ON and OFF by switching ON and OFF the oscillating electric signal.
- the grating period may be changed by changing the frequency of the oscillating electric signal.
- an acoustic wave terminator 1336 A can be coupled to an opposite side of the substrate 1328 to absorb the volume acoustic wave 1334 A and thus prevent a standing acoustic wave formation in the substrate 1328 .
- a pupil-replicating waveguide 1300 B of the present disclosure includes a waveguide body 1306 B having two portions, the substrate 1328 for propagating the beam of image light 1304 , and a surface-wave acoustic actuator 1330 B mechanically coupled at the top surface 1315 .
- the surface-wave acoustic actuator 1330 B may also be coupled at the bottom surface 1316 .
- the surface-wave acoustic actuator 1330 B includes an electrically responsive layer 1332 B, e.g. a piezoelectric layer, disposed between electrodes 1307 B, 1308 B.
- an electrical signal at a high frequency is applied to the electrodes 1307 B, 1308 B causing the electrically responsive layer 1332 B to oscillate.
- the oscillation of the electrically responsive layer 1332 A creates a surface acoustic wave 1334 B propagating in the substrate 1328 in the direction 1335 , i.e. along the X-axis.
- the surface acoustic wave 1334 B forms a diffraction grating that out-couples the portions 1312 , 1313 of the image light 1304 from the pupil-replicating lightguide 1300 B.
- an acoustic wave terminator 1336 B can be coupled to an opposite side of the substrate 1328 at the same surface, i.e. at the top surface 1315 in FIG. 13 B , to absorb the surface acoustic wave 1334 B and thus prevent a standing acoustic wave formation.
- the pupil-replicating lightguides 1300 A and 1300 B may be used e.g.
- the in-coupling 216 and/or out-coupling 218 gratings of the imaging device 200 of FIGS. 2 A and 2 B the in-coupling 316 and/or out-coupling 318 gratings of the depth sensing imaging device 300 of FIG. 3
- the in-coupling 416 and/or out-coupling 418 gratings of the eye tracking imaging device 400 of FIG. 4 the diffraction grating structure 508 of the ranging device 500 of FIG. 5
- the in-coupling 616 and/or out-coupling 618 gratings of the ranging device 600 of FIG. 6 the switchable diffraction grating structure 708 of FIG. 7 .
- Some switchable gratings include a material with tunable refractive index.
- a holographic polymer-dispersed liquid crystal (H-PDLC) grating may be manufactured by causing interference between two coherent laser beams in a photosensitive monomer/liquid crystal (LC) mixture contained between two substrates coated with a conductive layer. Upon irradiation, a photoinitiator contained within the mixture initiates a free-radical reaction, causing the monomer to polymerize. As the polymer network grows, the mixture phase separates into polymer-rich and liquid-crystal rich regions.
- H-PDLC holographic polymer-dispersed liquid crystal
- the refractive index modulation between the two phases causes light passing through the cell to be scattered in the case of traditional PDLC or diffracted in the case of H-PDLC.
- an electric field is applied across the cell, the index modulation is removed and light passing through the cell is unaffected. This is described in an article entitled “Electrically Switchable Bragg Gratings from Liquid Crystal/Polymer Composites” by Pogue et al., Applied Spectroscopy, v. 54 No. 1, 2000, which is incorporated herein by reference in its entirety.
- Tunable or switchable gratings with a variable grating period may be produced e.g. by using flexoelectric LC.
- flexoelectric LC For LCs with a non-zero flexoelectric coefficient difference (e1 ⁇ e3) and low dielectric anisotropy, electric fields exceeding certain threshold values result in transitions from the homogeneous planar state to a spatially periodic one.
- Field-induced grating is characterized by rotation of the LC director about the alignment axis with the wavevector of the grating oriented perpendicular to the initial alignment direction. The rotation sign is defined by both the electric field vector and the sign of the (e1 ⁇ e3) difference.
- the wavenumber characterizing the field-induced periodicity is increased linearly with the applied voltage starting from a threshold value of about it/d, where d is the thickness of the layer.
- d is the thickness of the layer.
- Tunable gratings with a variable grating period or a slant angle may be provided e.g. by using helicoidal LC.
- Tunable gratings with helicoidal LCs have been described e.g. in an article entitled “Electrooptic Response of Chiral Nematic Liquid Crystals with Oblique Helicoidal Director” by Xiang et al. Phys. Rev. Lett. 112, 217801, 2014, which is incorporated herein by reference in its entirety.
- VBG volumetric Bragg grating
- an imaging method 1400 of the present disclosure may be implemented e.g. in the controller 150 of the imaging device 100 of FIG. 1 , or in a controller of any other imaging/ranging devices disclosed herein.
- the imaging method 1400 includes switching ( FIG. 4 ; 1402 ) a field of view of a camera, e.g. the camera 102 of FIG. 1 , between the plurality of overlapping FOV portions 111 , 112 , 113 of a compound field of view 110 by switching a grating period of a diffraction grating structure, e.g. the diffraction grating structure 108 grating period.
- the diffraction grating structure is disposed upstream of the camera 102 .
- An image is captured ( 1404 ) at each portion of the plurality of overlapping portions of the compound field of view.
- the images captured at each portion of the plurality of overlapping portions are stitched together ( 1406 ) to obtain a compound image corresponding to the compound field of view.
- the switching 1402 may include switching at least one of a stack of switchable gratings of differing grating pitch, e.g. a first grating, to a high-efficiency state above a first threshold.
- the remaining switchable gratings of the stack may be in a low-efficiency state below a second threshold lower than the first threshold, such that only the first grating is activated.
- Any of the switchable/tunable gratings considered above with reference to FIGS. 8 - 13 may be used in the method 1400 , including e.g. the switchable surface relief LC grating 800 of FIG. 8 , the switchable PBP LC grating 900 of FIG. 9 , the switchable PVH grating 1100 of FIG. 11 , the fluidic grating 1200 of FIG. 12 , etc.
- a near-eye display 1500 includes a frame 1503 supporting, for each eye: an image projector 1530 for providing an image light beam carrying an image in angular domain, a pupil-replicating lightguide 1506 including any of the waveguides disclosed herein, for providing multiple offset portions of the image light beam to spread the image in angular domain across an eyebox 1512 , and a an eye tracker 1504 that may include the eye tracking imaging device 300 of FIG. 3 , for example.
- the purpose of the eye trackers 1504 is to determine position and/or orientation of both eyes of the user.
- the near-eye display 1500 may further include an imaging or ranging device 1580 for scanning or imaging surrounding environment, which may include any of imaging or ranging devices disclosed herein.
- an HMD 1600 is a non-limiting illustrative example of an AR/VR wearable display system which encloses the user's face, for a greater degree of immersion into the AR/VR environment.
- the HMD 1600 may include any of the imaging and ranging systems disclosed herein.
- the HMD 1600 may generate the entirely virtual 3D imagery.
- the HMD 1600 may include a front body 1602 and a band 1604 that can be secured around the user's head.
- the front body 1602 is configured for placement in front of eyes of a user in a reliable and comfortable manner.
- a display system 1680 may be disposed in the front body 1602 for presenting AR/VR imagery to the user.
- the display system 1680 may include any of the display devices and waveguides disclosed herein. Sides 1606 of the front body 1602 may be opaque or transparent.
- the front body 1602 includes locators 1608 and an inertial measurement unit (IMU) 1610 for tracking acceleration of the HMD 1600 , and position sensors 1612 for tracking position of the HMD 1600 .
- the IMU 1610 is an electronic device that generates data indicating a position of the HMD 1600 based on measurement signals received from one or more of position sensors 1612 , which generate one or more measurement signals in response to motion of the HMD 1600 .
- position sensors 1612 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of the IMU 1610 , or some combination thereof.
- the position sensors 1612 may be located external to the IMU 1610 , internal to the IMU 1610 , or some combination thereof.
- the locators 1608 are traced by an external imaging device of a virtual reality system, such that the virtual reality system can track the location and orientation of the entire HMD 1600 .
- Information generated by the IMU 1610 and the position sensors 1612 may be compared with the position and orientation obtained by tracking the locators 1608 , for improved tracking accuracy of position and orientation of the HMD 1600 .
- Accurate position and orientation is important for presenting appropriate virtual scenery to the user as the latter moves and turns in 3D space.
- the HMD 1600 may further include a depth camera assembly (DCA) 1611 , which may include e.g. the depth sensing imaging device 300 of FIG. 3 , the ranging device 500 of FIG. 5 , etc.
- the DCA 1611 captures data describing depth information of a local area surrounding some or all of the HMD 1600 .
- the depth information may be compared with the information from the IMU 1610 , for better accuracy of determination of position and orientation of the HMD 1600 in 3D space.
- the HMD 1600 may further include an eye tracking system 1614 for determining orientation and position of user's eyes in real time.
- the eye tracking system 1614 may include the eye tracking imaging device 400 of FIG. 4 , for example.
- the obtained position and orientation of the eyes also allows the HMD 1600 to determine the gaze direction of the user and to adjust the image generated by the display system 1680 accordingly.
- the determined gaze direction and vergence angle may be used to adjust the display system 1680 to reduce the vergence-accommodation conflict.
- the direction and vergence may also be used for displays' exit pupil steering as disclosed herein.
- the determined vergence and gaze angles may be used for interaction with the user, highlighting objects, bringing objects to the foreground, creating additional objects or pointers, etc.
- An audio system may also be provided including e.g. a set of small speakers built into the front body 1602 .
- Embodiments of the present disclosure may include, or be implemented in conjunction with, an artificial reality system.
- An artificial reality system adjusts sensory information about outside world obtained through the senses such as visual information, audio, touch (somatosensation) information, acceleration, balance, etc., in some manner before presentation to a user.
- artificial reality may include virtual reality (VR), augmented reality (AR), mixed reality (MR), hybrid reality, or some combination and/or derivatives thereof.
- Artificial reality content may include entirely generated content or generated content combined with captured (e.g., real-world) content.
- the artificial reality content may include video, audio, somatic or haptic feedback, or some combination thereof.
- artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, for example, create content in artificial reality and/or are otherwise used in (e.g., perform activities in) artificial reality.
- the artificial reality system that provides the artificial reality content may be implemented on various platforms, including a wearable display such as an HMD connected to a host computer system, a standalone HMD, a near-eye display having a form factor of eyeglasses, a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Optics & Photonics (AREA)
- Nonlinear Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Remote Sensing (AREA)
- Electromagnetism (AREA)
- Radar, Positioning & Navigation (AREA)
- Computer Networks & Wireless Communication (AREA)
- Crystallography & Structural Chemistry (AREA)
- Mathematical Physics (AREA)
- Chemical & Material Sciences (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Liquid Crystal (AREA)
- Optical Integrated Circuits (AREA)
- Optical Elements Other Than Lenses (AREA)
- Photometry And Measurement Of Optical Pulse Characteristics (AREA)
- Diffracting Gratings Or Hologram Optical Elements (AREA)
- Eye Examination Apparatus (AREA)
Abstract
A field of view of an imaging or ranging device may be increased multiple times by providing a switchable diffraction grating structure upstream of an imaging camera or ranging light source. The switchable diffraction grating changes the angle of propagating of incoming light by a fixed step, enabling the device to switch between several portions of a compound field of view. The switchable diffraction grating structure may be supported by a lightguide that guides the image light or ranging light by a series of reflections from opposed surfaces of the lightguide.
Description
- This application claims priority from U.S. Provisional Patent Application No. 63/286,381 entitled “Display Applications for Switchable Gratings”, and U.S. Provisional Patent Application No. 63/286,230 entitled “Active Fluidic Optical Element”, both filed on Dec. 6, 2021 and incorporated herein by reference in their entireties.
- The present disclosure relates to tunable optical devices, and in particular to ranging and imaging systems usable in visual displays, as well as components, modules, and methods for such ranging and imaging.
- Visual displays provide information to viewer(s) including still images, video, data, etc. Visual displays have applications in diverse fields including entertainment, education, engineering, science, professional training, advertising, to name just a few examples. Some visual displays, such as TV sets, display images to several users, and some visual display systems, such s near-eye displays (NEDs), are intended for individual users.
- An artificial reality system generally includes an NED (e.g., a headset or a pair of glasses) configured to present content to a user. The near-eye display may display virtual objects or combine images of real objects with virtual objects, as in virtual reality (VR), augmented reality (AR), or mixed reality (MR) applications. For example, in an AR system, a user may view images of virtual objects (e.g., computer-generated images (CGIs)) superimposed with the surrounding environment by seeing through a “combiner” component. The combiner component including its light routing optics may be transparent to external light.
- An NED is usually worn on the head of a user. Consequently, a large, bulky, unbalanced, and heavy display device with a heavy battery would be cumbersome and uncomfortable for the user to wear. Head-mounted display devices can benefit from a compact and efficient elements and modules, including efficient light sources and illuminators, high-throughput combiner components and ocular lenses, wide-field cameras, eye trackers, depth sensors, and other optical elements.
- Exemplary embodiments will now be described in conjunction with the drawings, in which:
-
FIG. 1 is a schematic cross-sectional view of an imaging device having a compound field of view; -
FIGS. 2A and 2B are schematic cross-sectional views of a lightguide embodiment of the imaging device ofFIG. 1 at different grating periods of in-coupling and/or out-coupling gratings of the lightguide; -
FIG. 3 is a schematic cross-sectional view of a ranging device having a compound field of view; -
FIG. 4 is a schematic cross-sectional view of an eye tracker having a compound field of view; -
FIG. 5 is a schematic cross-sectional view of a ranging device having a compound ranging field of view; -
FIG. 6 is a schematic cross-sectional view of a lightguide embodiment of the ranging device ofFIG. 5 ; -
FIG. 7 is a schematic cross-sectional view of a diffraction grating structure including a stack of switchable gratings of different grating pitch; -
FIG. 8 shows side cross-sectional views of a tunable liquid crystal (LC) surface-relief grating of this disclosure; -
FIG. 9A is a frontal view of an active Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating usable in imaging and ranging devices of this disclosure; -
FIG. 9B is a magnified schematic view of LC molecules in an LC layer of the active PBP LC grating ofFIG. 9A ; -
FIGS. 10A and 10B are side schematic views of the active PBP LC grating ofFIGS. 9A and 9B , showing light propagation in OFF (FIG. 10A ) and ON (FIG. 10B ) states of the active PBP LC grating; -
FIG. 11A is a side cross-sectional view of a switchable polarization volume grating (PVH) usable in imaging and ranging devices of this disclosure; -
FIG. 11B is a diagram illustrating optical performance of the PVH ofFIG. 11A ; -
FIG. 12A is a side cross-sectional view of a fluidic grating usable in imaging and ranging devices of this disclosure, in an OFF state; -
FIG. 12B is a side cross-sectional view of the fluidic grating ofFIG. 12A in an ON state; -
FIG. 13A is a side cross-sectional view of a lightguide including an acoustic actuator for creating a volume acoustic wave in the lightguide; -
FIG. 13B is a side cross-sectional view of a lightguide including an acoustic actuator for creating a surface acoustic wave in the lightguide; -
FIG. 14 is a flow chart of an imaging method in accordance with this disclosure; -
FIG. 15 is a view of an augmented reality (AR) display having a form factor of a pair of eyeglasses; and -
FIG. 16 is a three-dimensional view of a head-mounted display (HMD) of this disclosure. - While the present teachings are described in conjunction with various embodiments and examples, it is not intended that the present teachings be limited to such embodiments. On the contrary, the present teachings encompass various alternatives and equivalents, as will be appreciated by those of skill in the art. All statements herein reciting principles, aspects, and embodiments of this disclosure, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
- As used herein, the terms “first”, “second”, and so forth are not intended to imply sequential ordering, but rather are intended to distinguish one element from another, unless explicitly stated. Similarly, sequential ordering of method steps does not imply a sequential order of their execution, unless explicitly stated. Throughout the specification, the terms “switchable” and “tunable” are used interchangeably. In
FIGS. 1 to 7 , similar reference numerals denote similar elements. - Near-eye displays use eye trackers to determine viewer's eyes position and orientation. This information is used to adjust the optical system's accommodation distance to account for the eye pupil position, to redirect light towards the pupil for better optical throughput, to adjust the displayed content, etc. To determine eye position/orientation/gaze direction, eye trackers may employ a specialized imaging device to obtain real-time images of user's eyes. Near-eye displays may also use various types of imagers of outside environment, including a color camera, a depth sensing camera or a ranging device, and the like.
- One characteristic of camera and ranging devices used in near-eye displays is a requirement to have a wide field of view (FOV). Such a requirement often represents a significant technical challenge, especially when combined with a requirement of low weight, small size, and high spatial resolution.
- In accordance with this disclosure, switchable grating structures may be used to extend or multiply a field of view of a camera or a ranging device while preserving compactness, low weight, and spatial resolution. In some embodiments, a diffraction grating structure may be placed upstream of a camera. The diffraction grating structure may have a switchable grating period for switching the camera field of view between a plurality of overlapping portions of a compound field of view, making the compound field of view significantly greater than the camera's inherent field of view. A similar approach may be adapted in respect of a ranging device, a scanner, etc.
- In accordance with the present disclosure, there is provided an imaging device comprising a camera for capturing an image within a camera field of view and a diffraction grating structure upstream of the camera. The diffraction grating structure has a switchable grating period for switching the camera field of view between a plurality of overlapping portions of a compound field of view, whereby the compound field of view is greater than the camera field of view, i.e. the switchable diffraction grating structure enables a broader field of view than an inherent field of view of the camera.
- In some embodiments, the imaging device includes a lightguide for propagating a light beam therein by a series of internal reflections, the light beam carrying the image, and an in-coupling grating supported by the lightguide for in-coupling the light beam into the lightguide. In such embodiments, the diffraction grating structure may be supported by the lightguide for out-coupling, towards the camera, portions of the light beam propagating in the lightguide. In some embodiments, the imaging device includes an out-coupling grating supported by the lightguide for out-coupling portions of the light beam propagating in the lightguide towards the camera. In such embodiments, the diffraction grating structure may be supported by the lightguide for in-coupling the light beam into the lightguide.
- In embodiments where the camera comprises a color camera for a near-eye display, the image may include a color image of outside environment of the near-eye display. In embodiments where the camera comprises a depth sensing camera for a near-eye display, the image may include depth information associated with pixels of the image. In embodiments where the camera comprises an eye tracking camera for a near-eye display, the image may include an image of an eye of a user of the near-eye display.
- The diffraction grating structure may include a stack of switchable gratings of differing grating pitch, each switchable grating being switchable between a high-efficiency state wherein efficiency of the switchable grating is above a first threshold, and a low-efficiency state wherein the efficiency of the switchable grating is below a second threshold, wherein the second threshold is lower than the first threshold, e.g. 10 or 100 or 1000 times lower. The diffraction grating may include, by way of non-limiting examples, a switchable polarization volume hologram (PVH) grating, a switchable Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating, a switchable surface relief liquid crystal (LC) grating, and/or a switchable fluidic grating. In some embodiments, the image device comprises an acoustic actuator coupled to a slab of transparent material, and the diffraction grating structure may be formed by an acoustic wave generated by the acoustic actuator in the slab.
- The imaging device may include a controller operably coupled to the camera and the diffraction grating structure and configured to operate the diffraction grating structure to switch the camera field of view between the plurality of overlapping portions of the compound field of view, capture an image at each portion of the plurality of overlapping portions of the compound field of view, and optionally stitch the images captured at each portion of the plurality of overlapping portions to obtain a compound image corresponding to the compound field of view.
- In accordance with the present disclosure, there is provided an imaging method comprising: switching a field of view of a camera between the plurality of overlapping portions of a compound field of view by switching a grating period of a diffraction grating structure upstream of the camera; at each portion of the plurality of overlapping portions of the compound field of view, capturing an image; and stitching the images captured at each portion of the plurality of overlapping portions to obtain a compound image corresponding to the compound field of view.
- The switching may include switching at least one of a stack of switchable gratings of differing grating pitch to a high-efficiency state above a first threshold, while the remaining switchable gratings of the stack are in a low-efficiency state below a second threshold lower than the first threshold, e.g. 10, 100, or even 1000 times lower. The switching may include switching at least one of: a switchable polarization volume hologram (PVH) grating; a switchable Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating; a switchable surface relief liquid crystal (LC) grating; or a fluidic grating
- In accordance with the present disclosure, there is further provided a ranging device comprising a transmitter for providing a ranging light beam within a ranging field of view, and a diffraction grating structure downstream of the transmitter, the diffraction grating structure having a switchable grating period for switching the ranging field of view between a plurality of overlapping portions of a compound field of view, whereby the compound field of view is greater than the ranging field of view.
- The ranging device may include a lightguide for propagating the light beam therein by a series of internal reflections, and an in-coupling grating supported by the lightguide for in-coupling the light beam into the lightguide. The diffraction grating structure may be supported by the lightguide for out-coupling portions of the light beam propagating in the lightguide. The diffraction grating structure may include a stack of switchable gratings of differing grating pitch, each switchable grating being switchable between a high-efficiency state wherein efficiency of the switchable grating is above a first threshold, and a low-efficiency state wherein the efficiency of the switchable grating is below a second threshold, wherein the second threshold is lower than the first threshold, e.g. 10, 100, or 1000 times lower. The diffraction grating structure may include at least one of: a switchable polarization volume hologram (PVH) grating; a switchable Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating; a switchable surface relief liquid crystal (LC) grating; or a fluidic grating.
- Illustrative embodiments of using switchable gratings for field of view expansion will now be considered. Referring to
FIG. 1 , animaging device 100 includes acamera 102, e.g. a monochrome or color camera having alens 104 optically coupled to a monochrome orcolor photodetector array 106. Thecamera 102 can capture an image within a camera field of view, which is determined by the focal length of thelens 104 and linear size, i.e. width and height, of thephotodetector array 106. A diffractiongrating structure 108 is disposed upstream of thecamera 102. The diffractiongrating structure 108 has a switchable strength and/or grating period for switching the camera field of view between a plurality of overlapping FOV portions, in this example aleft portion 111 shown with dashed lines, amiddle portion 112 shown with solid lines, and aright portion 113 shown with dotted lines. There may be more than three portions. Together, the left 111, middle 112, and right 113 FOV portions form a compound field ofview 110. The field of view is switched by redirecting, by diffraction, the impinging light. An angle of redirection is defined by the period of the diffractiongrating structure 108. Examples of the diffractiongrating structure 108 will be provided further below. The ability to switch the camera FOV enables the compound field ofview 110 to be much larger than the camera FOV, thereby providing an effective FOV expansion without having to use a wide-angle lens coupled to a high pixel count photodetector array. Herein and throughout the rest of the specification, the term “field of view” or “FOV” is related to both a one-dimensional (i.e. in-plane) FOV and a two-dimensional (solid) FOV. - The
imaging device 100 may include acontroller 150 operably coupled, e.g. electrically and/or mechanically connected, to thecamera 102 and the diffractiongrating structure 108. Thecontroller 150 may be configured, e.g. programmed, wired, etc., to operate the diffractiongrating structure 108 to switch thecamera 102 field of view between the overlappingportions view 110. Thecontroller 150 may be configured to capture an image at eachportion view 110, e.g. by going sequentially through each portion and taking one or several images at each FOV portion. Thecontroller 150 may then stitch the partial images captured at eachportion view 110. In this manner, a very wide field of view may be achieved. - Referring to
FIGS. 2A and 2B , animaging device 200 is an embodiment of theimaging device 100 ofFIG. 1 , and includes similar elements. In theimaging device 200 ofFIGS. 2A and 2B , thecamera 102 is coupled to alightguide 214. Thelightguide 214, which may be e.g. a flat or curved plate or slab of a transparent material such as glass, plastic, oxide, crystal etc., supports an in-coupling grating 216 and an out-coupling grating 218. A controller, similar to thecontroller 150 of theimaging device 100 ofFIG. 1 operates in a similar manner, and is omitted fromFIGS. 2A and 2B for brevity. - In operation, the in-
coupling grating 216 in-couples alight beam 215 into thelightguide 214. Thelight beam 215 carries an image to be captured by thecamera 102. The lightguide propagates thelight beam 215 in thelightguide 214 by a series of internal reflections from its opposed surfaces. Thelight beam 215 propagates along azigzag path 217 shown with dotted lines. The out-coupling grating 218 out-couples portions 219 of thelight beam 215 propagating in thelightguide 214 towards thecamera 102. - At least one of the in-
coupling grating 216 or the out-coupling grating 218 includes the pitch-switchable diffractiongrating structure 108 ofFIG. 1 . In embodiments where the out-coupling grating 218 includes the diffractiongrating structure 108, the latter out-couples thelight beam portions 219 towards thecamera 102 at a switchable angle, effectively switching between different FOV portions. In embodiments where it is the in-coupling grating 216 that includes the diffractiongrating structure 108, the latter in-couples thelight beam portions 219 towards thecamera 102 at a switchable angle, thereby directly switching between different FOV portions. For instance,FIG. 2B shows that when the pitch (fringe period) of the in-coupling grating 216 is switched, the same out-coupling angle of the out-coupledlight beam portions 219 is achieved at the tiltedlight beam 215, thus providing input FOV portions switching. - The
imaging device 200 may be used in a near-eye display for imaging outside environment of a wearer of the near-eye display. Thecamera 102 may be a monochrome or color camera operating in the visible part of optical spectrum for capturing monochrome or color images of outside environment of the near-eye display, an infrared camera facilitating night-time vision, etc. The images of the outside environment may be used by a controller of the near-eye display for determining size and position of outside objects for various actions such as proximity warning, picking up objects, etc. In virtual reality or mixed reality applications, the images of the outside environment may be projected or combined with virtual generated imagery displayed to a user of the virtual reality system, for a better situational awareness of the user. - Some implementations of the
imaging device 100 ofFIG. 1 usable in near-eye display applications may include depth sensing systems. Referring toFIG. 3 for a non-limiting illustrative example, a depthsensing imaging device 300 is similar to theimaging device 200 ofFIGS. 2A and 2B , and includes similar elements. The depthsensing imaging device 300 ofFIG. 3 includes adepth sensing camera 302 coupled to alightguide 314, which may be similar to thelightguide 214 ofFIG. 2 . Thelightguide 314 ofFIG. 3 supports an in-coupling grating 316 and an out-coupling grating 318. One of these gratings, or both of these gratings, may include a switchable diffraction grating structure for switching FOV portions as explained above. A ranginglight source 336 provides illuminating light 338 in form of a succession of short pulses or other form of an intensity-modulated light. The purpose of the ranginglight source 336 is to illuminate the outside environment being imaged, e.g. anobject 340 of the outside environment. - A
controller 350 may be operably coupled to the ranginglight source 336, thelightguide 314, or more specifically to the switchable diffraction grating structure of thelightguide 314, and thedepth sensing camera 302. In operation, thecontroller 350 causes the ranginglight source 336 to emit the illuminating light 338, which is modulated at a known frequency and phase. For definiteness, the illuminating light 338 may include a succession of short light pulses of known emission time.Light 315 reflected from theobject 340 in the outside environment reaches the in-coupling grating 316, which in-couples the light 315 into thelightguide 314. The in-coupledlight 315 propagates in thelightguide 314 along alight path 317 defined by reflections of the light 315 from opposed surfaces of thelightguide 314, as illustrated.Portions 319 of the light 315 are out-coupled by the out-coupling grating 318. - The
depth sensing camera 302 may detect the light 315 in a time-selective manner. Photons arriving at different time intervals from the pulse of the illuminating light 338 may be counted separately, and the distance to elements of the imagery received, e.g. the distance to theobject 340, may be determined from the time interval when the photons of the reflected light 315 are received relative to the moment of emission of the illuminating light 338 pulse. In other embodiments, the illuminating light 338 may be periodically e.g. sinusoidally modulated, and the light 315 may be detected by thedepth sensing camera 302 in a phase-sensitive manner. The distance to theobject 340 may be determined from the phase delay between the illuminating light 338 and the receivedlight 315. In both of these examples, the image detected by thedepth sensing camera 302 includes depth information associated with pixels of the image. It is further noted that similar concepts are applicable to theimaging device 100 ofFIG. 1 , i.e. thelightguide 314 may be replaced with the switchable diffractiongrating structure 108, without a lightguide. - Turning to
FIG. 4 as another example implementation of theimaging device 100 ofFIG. 1 , an eye trackingimaging device 400 includes aneye tracking camera 402 coupled to alightguide 414. Thelightguide 414 supports an in-coupling grating 416 and an out-coupling grating 418. One of these gratings, or both of these gratings, may include a switchable diffraction grating structure for switching FOV portions as explained above. The eye trackingimaging device 400 further includes a plurality ofeye illuminators 438, which may be supported by thelightguide 414 on its proximal side, i.e. on the side facing a user'seye 440. The purpose of theeye illuminators 438 is to illuminate theeye 440.Light 415 reflected by theeye 440 is in-coupled by the in-coupling grating 416 into thelightguide 414. The in-coupled light 415 then propagates in thelightguide 414 by a series of internal reflections from opposed surfaces of thelightguide 414, as indicated with azigzag lightpath 417. Theeye tracking camera 402 detects the light 415 and obtains images of theeye 440. The expansion of the FOV afforded by switchable diffraction grating structure in the in-coupling 416 and/or out-coupling 418 gratings enables theeye 440 to be detected at a plurality of locations, e.g. the first 440A and second 440B locations. Similar concepts are applicable to theimaging device 100 ofFIG. 1 , i.e. thelightguide 414 may be replaced with the switchable diffractiongrating structure 108. - The principles of FOV expansion by using a diffraction grating structure to switch between several FOV portions can be extended not only to reception devices such as cameras but also to transmission devices. Referring to
FIG. 5 for a non-limiting illustrative example, a rangingdevice 500 includes atransmitter 536 optically coupled to a diffractiongrating structure 508 downstream of thetransmitter 536. In operation, thetransmitter 536 provides a ranginglight beam 538 within a ranging field of view. The ranginglight beam 538 may include, for example, a diverging (e.g. with a divergence of 40 degrees or more) modulated beam, a wide-angle pulsed beam, a collimated (e.g. with a divergence of 4 degrees or less) modulated beam, a collimated pulsed beam, etc. The time characteristic of the ranginglight beam 538 may be used as a basis for the distance determination by calculating time of flight of ranginglight beam 538 to an object (not shown for brevity) and time of flight of a reflected or scattered light beam back to a photodetector or acamera 502 of the rangingdevice 500. The purpose of the photodetector orcamera 502 is to capture the reflected or scattered light beam. - The diffraction
grating structure 508 is disposed downstream of thetransmitter 536. The diffractiongrating structure 508 has a switchable grating period for switching the ranging field of view between a plurality of overlappingportions view 510. The compound field ofview 510 may be obtained by stitching theportions device 500. - Turning to
FIG. 6 , a rangingdevice 600 is an embodiment of the rangingdevice 500 ofFIG. 5 , and includes similar elements. In the rangingdevice 600 ofFIG. 6 , thetransmitter 536 is coupled to alightguide 614. Thelightguide 614 supports an in-coupling grating 616 and an out-coupling grating 618. At least one of the in-coupling grating 216 or the out-coupling grating 218 includes a pitch-switchable diffraction grating structure, similar to the diffractiongrating structure 108 ofFIG. 1 described above. - In operation, the in-
coupling grating 616 in-couples the ranginglight beam 538 emitted by thetransmitter 536 into thelightguide 614. Thelightguide 614 includes a slab of transparent material such as glass, plastic, crystal, metal oxide, etc., that propagates the ranginglight beam 538 in thelightguide 614 by a series of internal reflections from opposed surfaces of the slab. The ranginglight beam 538 propagates along a zigzaglight path 617. The out-coupling grating 618 out-couples portions of the ranginglight beam 538 towards an external object being imaged or ranged. Reflected light is detected by the photodetector or camera 502 (FIG. 6 ). The distance to the object may be determined from the arrival time or phase of optical power modulation of the received light. - Referring now to
FIG. 7 , a switchable diffractiongrating structure 708 may be used in any of the imaging and ranging devices described herein. The switchable diffractiongrating structure 708 includes a stack of switchable gratings of differing grating pitch or grating period, in this example first 771 and second 772 switchable gratings. More than two gratings may be provided. Eachswitchable grating - Non-limiting examples of switchable/tunable grating structures usable in lightguides and imaging/ranging devices of this disclosure will now be presented. Referring first to
FIG. 8 , a tunable liquid crystal (LC) surface-relief grating 800 may be used e.g. in the diffractiongrating structure 108 of theimaging device 100 ofFIG. 1 , the in-coupling 216 and/or out-coupling 218 gratings of theimaging device 200 ofFIGS. 2A and 2B , the in-coupling 316 and/or out-coupling 318 gratings of the depthsensing imaging device 300 ofFIG. 3 , the in-coupling 416 and/or out-coupling 418 gratings of the eye trackingimaging device 400 ofFIG. 4 , the diffractiongrating structure 508 of the rangingdevice 500 ofFIG. 5 , the in-coupling 616 and/or out-coupling 618 gratings of the rangingdevice 600 ofFIG. 6 , and the switchable diffractiongrating structure 708 ofFIG. 7 . The tunable LC surface-relief grating 800 includes afirst substrate 801 supporting a firstconductive layer 811 and a surface-reliefgrating structure 804 having a plurality ofridges 806 extending from thefirst substrate 801 and/or the firstconductive layer 811. - A
second substrate 802 is spaced apart from thefirst substrate 801. Thesecond substrate 802 supports a secondconductive layer 812. A cell is formed by the first 811 and second 812 conductive layers. The cell is filled with a LC fluid, forming anLC layer 808. TheLC layer 808 includesnematic LC molecules 810, which may be oriented by an electric field across theLC layer 808. The electric field may be provided by applying a voltage V to the first 811 and second 812 conductive layers. - The surface-relief
grating structure 804 may be formed from a polymer with an isotropic refractive index np of about 1.5, for example. The LC fluid has an anisotropic refractive index. For light polarization parallel to a director of the LC fluid, i.e. to the direction of orientation of thenematic LC molecules 810, the LC fluid has an extraordinary refractive index ne, which may be higher than an ordinary refractive index no of the LC fluid for light polarization perpendicular to the director. For example, the extraordinary refractive index ne may be about 1.7, and the ordinary refractive index no may be about 1.5, i.e. matched to the refractive index np of the surface-reliefgrating structure 804. - When the voltage Vis not applied (left side of
FIG. 8 ), theLC molecules 810 are aligned approximately parallel to the grooves of the surface-reliefgrating structure 804. At this configuration, a linearlypolarized light beam 821 with e-vector oriented along the grooves of the surface-reliefgrating structure 804 will undergo diffraction, since the surface-reliefgrating structure 804 will have a non-zero refractive index contrast. When the voltage V is applied (right side ofFIG. 8 ), theLC molecules 810 are aligned approximately perpendicular to the grooves of the surface-reliefgrating structure 804. At this configuration, a linearlypolarized light beam 821 with e-vector oriented along the grooves of the surface-reliefgrating structure 804 will not undergo diffraction because the surface-reliefgrating structure 804 will appear to be index-matched and, accordingly, will have a substantially zero refractive index contrast. For the linearlypolarized light beam 821 with e-vector oriented perpendicular to the grooves of the surface-reliefgrating structure 804, no diffraction will occur in either case (i.e. when the voltage is applied and when it is not), because at this polarization of the linearlypolarized light beam 821, the surface-reliefgrating structure 804 are index-matched. Thus, the tunable LC surface-relief grating 800 can be switched on and off (for polarized light) by controlling the voltage across theLC layer 808. Several such gratings with differing pitch/slant angle/refractive index contrast may be used to switch between several grating configurations. In some embodiments, the surface-reliefgrating structure 804 may include a birefringent material, as well. - Referring now to
FIG. 9A , a Pancharatnam-Berry phase (PBP) LC switchable grating 900 may be used e.g. in the diffractiongrating structure 108 of theimaging device 100 ofFIG. 1 , the in-coupling 216 and/or out-coupling 218 gratings of theimaging device 200 ofFIGS. 2A and 2B , the in-coupling 316 and/or out-coupling 318 gratings of the depthsensing imaging device 300 ofFIG. 3 , the in-coupling 416 and/or out-coupling 418 gratings of the eye trackingimaging device 400 ofFIG. 4 , the diffractiongrating structure 508 of the rangingdevice 500 ofFIG. 5 , the in-coupling 616 and/or out-coupling 618 gratings of the rangingdevice 600 ofFIG. 6 , and the switchable diffractiongrating structure 708 ofFIG. 7 . The PBP LC switchable grating 900 ofFIG. 9A includesLC molecules 902 in anLC layer 904. TheLC molecules 902 are disposed in XY plane at a varying in-plane orientation depending on the X coordinate. The orientation angle ϕ(x) of theLC molecules 902 in the PBP LC switchable grating 900 is given by -
ϕ(x)=πx/T=πx sin θ/λo (1) - where λo is the wavelength of impinging light, T is a pitch of the PBP LC switchable grating 900, and θ is a diffraction angle given by
-
θ=sin−1(λo /T) (2) - The azimuthal angle ϕ varies continuously across the surface of an
LC layer 904 parallel to XY plane as illustrated inFIG. 9B . The variation has a constant period equal to T. The optical phase delay P in the PBP LC grating 900 ofFIG. 9A is due to the PBP effect, which manifests P(x)=2ϕ(x) when the optical retardation R of theLC layer 904 is equal to Δo/2. -
FIGS. 10A and 10B illustrate the operation of the PBP LC switchable grating 900 ofFIG. 9A . The PBP LC switchable grating 900 includes the LC layer 904 (FIG. 9A ) disposed between parallel substrates configured for applying an electric field across theLC layer 904. TheLC molecules 902 are oriented substantially parallel to the substrates in absence of the electric field, and substantially perpendicular to the substrates in presence of the electric field. - In
FIG. 10A , the PBP LC switchable grating 900 is in OFF state, such that its LC molecules 902 (FIGS. 9A, 9B ) are disposed predominantly parallel to the substrate plane, that is, parallel to XY plane inFIG. 10A . When anincoming light beam 1015 is left-circular polarized (LCP), the PBP LC switchable grating 900 redirects thelight beam 1015 upwards by a pre-determined non-zero angle, and thebeam 1015 becomes right-circular polarized (RCP). The RCP deflectedbeam 1015 is shown with solid lines. When theincoming light beam 1015 is right-circular polarized (RCP), the PBP LC switchable grating 900 redirects thebeam 1015 downwards by a pre-determined non-zero angle, and thebeam 1015 becomes left-circular polarized (LCP). The LCP deflectedbeam 1015 is shown with dashed lines. Applying a voltage V to the PBP LC switchable grating 900 reorients the LC molecules along Z-axis, i.e. perpendicular to the substrate plane as shown inFIG. 10B . At this orientation of theLC molecules 902, the PBP structure is erased, and thelight beam 1015 retains its original direction, whether it is LCP or RCP. Thus, the active PBP LC grating 900 is a tunable grating, i.e. it has a variable beam steering property. Furthermore, the operation of the active PBP LC grating 900 may be controlled by controlling the polarization state of the impinginglight beam 1015. - Turning to
FIG. 11A , a polarization volume hologram (PVH) grating 1100 may be used e.g. in the diffractiongrating structure 108 of theimaging device 100 ofFIG. 1 , the in-coupling 216 and/or out-coupling 218 gratings of theimaging device 200 ofFIGS. 2A and 2B , the in-coupling 316 and/or out-coupling 318 gratings of the depthsensing imaging device 300 ofFIG. 3 , the in-coupling 416 and/or out-coupling 418 gratings of the eye trackingimaging device 400 ofFIG. 4 , the diffractiongrating structure 508 of the rangingdevice 500 ofFIG. 5 , the in-coupling 616 and/or out-coupling 618 gratings of the rangingdevice 600 ofFIG. 6 , and the switchable diffractiongrating structure 708 ofFIG. 7 . ThePVH grating 1100 ofFIG. 11A includes anLC layer 1104 bound by opposed top 1105 and bottom 1106 parallel surfaces. TheLC layer 1104 may include an LC fluid containing rod-like LC molecules 1107 with positive dielectric anisotropy, i.e. nematic LC molecules. A chiral dopant may be added to the LC fluid, causing the LC molecules in the LC fluid to self-organize into a periodic helical configuration includinghelical structures 1108 extending between the top 1105 and bottom 1106 parallel surfaces of theLC layer 1104. Such a configuration of theLC molecules 1107, termed herein a cholesteric configuration, includes a plurality of helical periods p, e.g. at least two, at least five, at least ten, at least twenty, or at least fifty helical periods p between the top 1105 and bottom 1106 parallel surfaces of theLC layer 1104. -
Boundary LC molecules 1107 b at thetop surface 1105 of theLC layer 1104 may be oriented at an angle to thetop surface 1105. Theboundary LC molecules 1107 b may have a spatially varying azimuthal angle, e.g. linearly varying along X-axis parallel to thetop surface 1105, as shown inFIG. 11A . To that end, analignment layer 1112 may be provided at thetop surface 1105 of theLC layer 1104. Thealignment layer 1112 may be configured to provide the desired orientation pattern of theboundary LC molecules 1107 b, such as the linear dependence of the azimuthal angle on the X-coordinate. A pattern of spatially varying polarization directions of the UV light may be selected to match a desired orientation pattern of theboundary LC molecules 1107 b at thetop surface 1105 and/or thebottom surface 1106 of theLC layer 1104. When thealignment layer 1112 is coated with the cholesteric LC fluid, theboundary LC molecules 1107 b are oriented along the photopolymerized chains of thealignment layer 1112, thus adopting the desired surface orientation pattern. Adjacent LC molecules adopt helical patterns extending from the top 1105 to the bottom 1106 surfaces of theLC layer 1104, as shown. - The
boundary LC molecules 1107 b define relative phases of thehelical structures 1108 having the helical period p. Thehelical structures 1108 form a volume grating comprisinghelical fringes 1114 tilted at an angle , as shown inFIG. 11A . The steepness of the tilt angle depends on the rate of variation of the azimuthal angle of theboundary LC molecules 1107 b at thetop surface 1105 and p. Thus, the tilt angle is determined by the surface alignment pattern of theboundary LC molecules 1107 b at thealignment layer 1112. The volume grating has a period Λx along X-axis and Λy along Y-axis. In some embodiments, the periodichelical structures 1108 of theLC molecules 1107 may be polymer-stabilized by mixing in a stabilizing polymer into the LC fluid, and curing (polymerizing) the stabilizing polymer. - The helical nature of the
fringes 1114 of the volume grating makes the PVH grating 1100 preferably responsive to light of polarization having one particular handedness, e.g. left- or right-circular polarization, while being substantially non-responsive to light of the opposite handedness of polarization. Thus, thehelical fringes 1114 make the PVH grating 1100 polarization-selective, causing the PVH grating 1100 to diffract light of only one handedness of circular polarization. This is illustrated inFIG. 11B , which shows alight beam 1120 impinging onto thePVH grating 1100. Thelight beam 1120 includes a left circular polarized (LCP)beam component 1121 and a right circular polarized (RCP)beam component 1122. TheLCP beam component 1121 propagates through the PVH grating 1100 substantially without diffraction. Herein, the term “substantially without diffraction” means that, even though an insignificant portion of the beam (theLCP beam component 1121 in this case) might diffract, the portion of the diffracted light energy is so small that it does not impact the intended performance of thePVH grating 1100. TheRCP beam component 1122 of thelight beam 1120 undergoes diffraction, producing a diffractedbeam 1122′. The polarization selectivity of the PVH grating 1100 results from the effective refractive index of the grating being dependent on the relationship between the handedness, or chirality, of the impinging light beam and the handedness, or chirality, of thegrating fringes 1114. Changing the handedness of the impinging light may be used to switch the performance of thePVH grating 1100. ThePVH grating 1100 may also be made switchable or tunable (both terms are used interchangeably in this specification) by applying voltage to theLC layer 1104, which distorts or erases the above-described helical structure. It is further noted that sensitivity of thePVH 1100 to right circular polarized light in particular is only meant as an illustrative example. When the handedness of thehelical fringes 1114 is reversed, thePVH 1100 may be made sensitive to left circular polarized light. Thus, the operation of thePVH 1100 may be controlled by controlling the polarization state of the impinginglight beam 1120. Furthermore, in some embodiments thePVH 1100 may be made tunable by application of electric field across theLC layer 1104, which erases the periodichelical structures 1108. - Referring now to
FIGS. 12A and 12B , afluidic grating 1200 may be used e.g. in the diffractiongrating structure 108 of theimaging device 100 ofFIG. 1 , the in-coupling 216 and/or out-coupling 218 gratings of theimaging device 200 ofFIGS. 2A and 2B , the in-coupling 316 and/or out-coupling 318 gratings of the depthsensing imaging device 300 ofFIG. 3 , the in-coupling 416 and/or out-coupling 418 gratings of the eye trackingimaging device 400 ofFIG. 4 , the diffractiongrating structure 508 of the rangingdevice 500 ofFIG. 5 , the in-coupling 616 and/or out-coupling 618 gratings of the rangingdevice 600 ofFIG. 6 , and the switchable diffractiongrating structure 708 ofFIG. 7 . Thefluidic grating 1200 includes first 1201 and second 1202 immiscible fluids separated by aninter-fluid boundary 1203. One of the fluids may be a hydrophobic fluid such as oil, e.g. silicone oil, while the other fluid may be water-based. One of the first 1201 and second 1202 fluids may be a gas in some embodiments. The first 1201 and second 1202 fluids may be contained in a cell formed by first 1211 and second 1212 substrates supporting first 1221 and second 1222 electrode structures. The first 1221 and/or second 1222 electrode structures may be at least partially transparent, absorptive, and/or reflective. - At least one of the first 1221 and second 1222 electrode structures may be patterned for imposing a spatially variant electric field onto the 1201 and second 1202 fluids. For example, in 12A and 12B, the
first electrode 1221 is patterned, and thesecond electrodes 1222 is not patterned, i.e. thesecond electrodes 1222 is a backplane electrode. In the embodiment shown, both the first 1221 and second 1222 electrodes are substantially transparent. For example, the first 1221 and second 1222 electrodes may be indium tin oxide (ITO) electrodes. The individual portions of a patterned electrode may be individually addressable. In some embodiments, the patternedelectrode 1221 may be replaced with a continuous, non-patterned electrode coupled to a patterned dielectric layer for creating a spatially non-uniform electric field across the first 1201 and second 1202 fluids. -
FIG. 12A shows thefluidic grating 1200 in a non-driven state when no electric field is applied across theinter-fluid boundary 1203. When no electric field is present, theinter-fluid boundary 1203 is straight and smooth; accordingly, alight beam 1205 impinging onto thefluidic grating 1200 does not diffract, propagating right through as illustrated.FIG. 12B shows thefluidic grating 1200 in a driven state when a voltage V is applied between the first 1221 and second 1222 electrodes, producing a spatially variant electric field across the first 1201 and second 1202 fluids separated by theinter-fluid boundary 1203. The application of the spatially variant electric field causes theinter-fluid boundary 1203 to distort as illustrated inFIG. 12B , forming a periodic variation of effective refractive index, i.e. a switchable or tunable surface-relief diffraction grating. Thelight beam 1205 impinging onto thefluidic grating 1200 will diffract, forming first 1231 and second 1232 diffracted sub-beams. By varying the amplitude of the applied voltage V, the strength of thefluidic grating 1200 may be varied. By applying different patterns of the electric field e.g. with individually addressable sub-electrodes or pixels of thefirst electrode 1221, the grating period and, accordingly, the diffraction angle, may be varied. More generally, varying the effective voltage between separate sub-electrodes or pixels of thefirst electrode 1221 may result in a three-dimensional conformal change of the fluidic interface i.e. theinter-fluid boundary 1203 inside the fluidic volume to impart a desired optical response to thefluidic grating 1200. The applied voltage pattern may be pre-biased to compensate or offset gravity effects, i.e. gravity-caused distortions of theinter-fluid boundary 1203. - The thickness of the first 1221 and second 1222 electrodes may be e.g. between 10 nm and 50 nm. The materials of the first 1221 and second 1222 electrodes besides ITO may be e.g. indium zinc oxide (IZO), zinc oxide (ZO), indium oxide (IO), tin oxide (TO), indium gallium zinc oxide (IGZO), etc. The first 1201 and second 1202 fluids may have a refractive index difference of at least 0.1, and may be as high as 0.2 and higher. One of the first 1201 or second 1202 fluids may include polyphenylether, 1,3-bis(phenylthio)benzene, etc. The first 1211 and/or second 1212 substrates may include e.g. fused silica, quartz, sapphire, etc. The first 1211 and/or second 1212 substrates may be straight or curved, and may include vias and other electrical interconnects. The applied voltage may be varied in amplitude and/or duty cycle when applied at a frequency of between 100 Hz and 100 kHz. The applied voltage can change polarity and/or be bipolar. Individual first 1201 and/r second 1202 fluid layers may have a thickness of between 0.5-5 micrometers, more preferably between 0.5-2 micrometer.
- To separate the first 1201 and second 1202 fluids, surfactants containing one hydrophilic end functional group and one hydrophobic end functional group may be used. The examples of a hydrophilic end functional group are hydroxyl, carboxyl, carbonyl, amino, phosphate, sulfhydryl. The hydrophilic functional groups may also be anionic groups such as sulfate, sulfonate, carboxylates, phosphates, for example. Non-limiting examples of a hydrophobic end functional group are aliphatic groups, aromatic groups, fluorinated groups. For example, when polyphenyl thioether and fluorinated fluid may be selected as a fluid pair, a surfactant containing aromatic end group and fluronirated end group may be used. When phenyl silicone oil and water are selected as the fluid pair, a surfactant containing aromatic end group and hydroxyl (or amino, or ionic) end group may be used. These are only non-limiting examples.
- Referring to
FIG. 13A , a pupil-replicatinglightguide 1300A of this disclosure includes abody 1306A having two portions, asubstrate 1328 for propagating image light 1304, and a volume-waveacoustic actuator 1330A mechanically coupled at a side of thesubstrate 1328 joining its top 1315 and bottom 1316 surfaces. In the embodiment shown, the volume-waveacoustic actuator 1330A includes an electricallyresponsive layer 1332A, e.g. a piezoelectric layer, disposed betweenelectrodes electrodes responsive layer 1332A to oscillate, typically at a frequency of a mechanical resonance of the electricallyresponsive layer 1332A. The oscillating thickness of the electricallyresponsive layer 1332A creates a volumeacoustic wave 1334A propagating in thesubstrate 1328 in adirection 1335, i.e. along the X-axis. The volumeacoustic wave 1334A modulates the refractive index of thesubstrate 1328 due to the effect of photoelasticity. The modulated refractive index creates a diffraction grating that out-couples portions lightguide 1300A. By changing the strength of the electric signal applied to the volume-waveacoustic actuator 1330A, the strength of the out-coupling grating may be changed. The out-coupling grating may be switched ON and OFF by switching ON and OFF the oscillating electric signal. The grating period may be changed by changing the frequency of the oscillating electric signal. In some embodiments, anacoustic wave terminator 1336A can be coupled to an opposite side of thesubstrate 1328 to absorb the volumeacoustic wave 1334A and thus prevent a standing acoustic wave formation in thesubstrate 1328. - Turning to
FIG. 13B , a pupil-replicatingwaveguide 1300B of the present disclosure includes awaveguide body 1306B having two portions, thesubstrate 1328 for propagating the beam of image light 1304, and a surface-waveacoustic actuator 1330B mechanically coupled at thetop surface 1315. Alternatively, the surface-waveacoustic actuator 1330B may also be coupled at thebottom surface 1316. In the embodiment shown, the surface-waveacoustic actuator 1330B includes an electricallyresponsive layer 1332B, e.g. a piezoelectric layer, disposed betweenelectrodes electrodes responsive layer 1332B to oscillate. The oscillation of the electricallyresponsive layer 1332A creates a surfaceacoustic wave 1334B propagating in thesubstrate 1328 in thedirection 1335, i.e. along the X-axis. The surfaceacoustic wave 1334B forms a diffraction grating that out-couples theportions lightguide 1300B. By changing the strength of the electric signal applied to the surface-waveacoustic actuator 1330B, the strength of the surface grating may be changed. The surface grating may be switched ON and OFF by switching ON and OFF the oscillating electric signal. The grating period may be changed by changing the frequency of the oscillating electric signal. In some embodiments, anacoustic wave terminator 1336B can be coupled to an opposite side of thesubstrate 1328 at the same surface, i.e. at thetop surface 1315 inFIG. 13B , to absorb the surfaceacoustic wave 1334B and thus prevent a standing acoustic wave formation. The pupil-replicatinglightguides grating structure 108 of theimaging device 100 ofFIG. 1 , the in-coupling 216 and/or out-coupling 218 gratings of theimaging device 200 ofFIGS. 2A and 2B , the in-coupling 316 and/or out-coupling 318 gratings of the depthsensing imaging device 300 ofFIG. 3 , the in-coupling 416 and/or out-coupling 418 gratings of the eye trackingimaging device 400 ofFIG. 4 , the diffractiongrating structure 508 of the rangingdevice 500 ofFIG. 5 , the in-coupling 616 and/or out-coupling 618 gratings of the rangingdevice 600 ofFIG. 6 , and the switchable diffractiongrating structure 708 ofFIG. 7 . - Some switchable gratings include a material with tunable refractive index. By way of a non-limiting example, a holographic polymer-dispersed liquid crystal (H-PDLC) grating may be manufactured by causing interference between two coherent laser beams in a photosensitive monomer/liquid crystal (LC) mixture contained between two substrates coated with a conductive layer. Upon irradiation, a photoinitiator contained within the mixture initiates a free-radical reaction, causing the monomer to polymerize. As the polymer network grows, the mixture phase separates into polymer-rich and liquid-crystal rich regions. The refractive index modulation between the two phases causes light passing through the cell to be scattered in the case of traditional PDLC or diffracted in the case of H-PDLC. When an electric field is applied across the cell, the index modulation is removed and light passing through the cell is unaffected. This is described in an article entitled “Electrically Switchable Bragg Gratings from Liquid Crystal/Polymer Composites” by Pogue et al., Applied Spectroscopy, v. 54 No. 1, 2000, which is incorporated herein by reference in its entirety.
- Tunable or switchable gratings with a variable grating period may be produced e.g. by using flexoelectric LC. For LCs with a non-zero flexoelectric coefficient difference (e1−e3) and low dielectric anisotropy, electric fields exceeding certain threshold values result in transitions from the homogeneous planar state to a spatially periodic one. Field-induced grating is characterized by rotation of the LC director about the alignment axis with the wavevector of the grating oriented perpendicular to the initial alignment direction. The rotation sign is defined by both the electric field vector and the sign of the (e1−e3) difference. The wavenumber characterizing the field-induced periodicity is increased linearly with the applied voltage starting from a threshold value of about it/d, where d is the thickness of the layer. A description of flexoelectric LC gratings may be found e.g. in an article entitled “Dynamic and Photonic Properties of Field-Induced Gratings in Flexoelectric LC Layers” by Palto in Crystals 2021, 11, 894, which is incorporated herein by reference in its entirety.
- Tunable gratings with a variable grating period or a slant angle may be provided e.g. by using helicoidal LC. Tunable gratings with helicoidal LCs have been described e.g. in an article entitled “Electrooptic Response of Chiral Nematic Liquid Crystals with Oblique Helicoidal Director” by Xiang et al. Phys. Rev. Lett. 112, 217801, 2014, which is incorporated herein by reference in its entirety.
- For gratings exhibiting strong wavelength dependence of grating efficiency, several gratings, e.g. several volumetric Bragg grating (VBG) gratings, may be provided in the lightguide. The gratings that diffract light at any given moment of time may be switched by switching the VBG grating on and off, and/or by switching the wavelength of the light propagating in the waveguide.
- Turning to
FIG. 14 with further reference toFIG. 1 , animaging method 1400 of the present disclosure may be implemented e.g. in thecontroller 150 of theimaging device 100 ofFIG. 1 , or in a controller of any other imaging/ranging devices disclosed herein. Theimaging method 1400 includes switching (FIG. 4 ; 1402) a field of view of a camera, e.g. thecamera 102 ofFIG. 1 , between the plurality of overlappingFOV portions view 110 by switching a grating period of a diffraction grating structure, e.g. the diffractiongrating structure 108 grating period. The diffraction grating structure is disposed upstream of thecamera 102. An image is captured (1404) at each portion of the plurality of overlapping portions of the compound field of view. The images captured at each portion of the plurality of overlapping portions are stitched together (1406) to obtain a compound image corresponding to the compound field of view. - In some embodiments, the switching 1402 may include switching at least one of a stack of switchable gratings of differing grating pitch, e.g. a first grating, to a high-efficiency state above a first threshold. The remaining switchable gratings of the stack may be in a low-efficiency state below a second threshold lower than the first threshold, such that only the first grating is activated. Any of the switchable/tunable gratings considered above with reference to
FIGS. 8-13 may be used in themethod 1400, including e.g. the switchable surface relief LC grating 800 ofFIG. 8 , the switchable PBP LC grating 900 ofFIG. 9 , the switchable PVH grating 1100 ofFIG. 11 , thefluidic grating 1200 ofFIG. 12 , etc. - Referring now to
FIG. 15 , a near-eye display 1500 includes aframe 1503 supporting, for each eye: animage projector 1530 for providing an image light beam carrying an image in angular domain, a pupil-replicatinglightguide 1506 including any of the waveguides disclosed herein, for providing multiple offset portions of the image light beam to spread the image in angular domain across aneyebox 1512, and a aneye tracker 1504 that may include the eye trackingimaging device 300 ofFIG. 3 , for example. The purpose of theeye trackers 1504 is to determine position and/or orientation of both eyes of the user. The near-eye display 1500 may further include an imaging or rangingdevice 1580 for scanning or imaging surrounding environment, which may include any of imaging or ranging devices disclosed herein. - Turning to
FIG. 16 , anHMD 1600 is a non-limiting illustrative example of an AR/VR wearable display system which encloses the user's face, for a greater degree of immersion into the AR/VR environment. TheHMD 1600 may include any of the imaging and ranging systems disclosed herein. TheHMD 1600 may generate the entirely virtual 3D imagery. TheHMD 1600 may include afront body 1602 and aband 1604 that can be secured around the user's head. Thefront body 1602 is configured for placement in front of eyes of a user in a reliable and comfortable manner. Adisplay system 1680 may be disposed in thefront body 1602 for presenting AR/VR imagery to the user. Thedisplay system 1680 may include any of the display devices and waveguides disclosed herein.Sides 1606 of thefront body 1602 may be opaque or transparent. - In some embodiments, the
front body 1602 includeslocators 1608 and an inertial measurement unit (IMU) 1610 for tracking acceleration of theHMD 1600, andposition sensors 1612 for tracking position of theHMD 1600. TheIMU 1610 is an electronic device that generates data indicating a position of theHMD 1600 based on measurement signals received from one or more ofposition sensors 1612, which generate one or more measurement signals in response to motion of theHMD 1600. Examples ofposition sensors 1612 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of theIMU 1610, or some combination thereof. Theposition sensors 1612 may be located external to theIMU 1610, internal to theIMU 1610, or some combination thereof. - The
locators 1608 are traced by an external imaging device of a virtual reality system, such that the virtual reality system can track the location and orientation of theentire HMD 1600. Information generated by theIMU 1610 and theposition sensors 1612 may be compared with the position and orientation obtained by tracking thelocators 1608, for improved tracking accuracy of position and orientation of theHMD 1600. Accurate position and orientation is important for presenting appropriate virtual scenery to the user as the latter moves and turns in 3D space. - The
HMD 1600 may further include a depth camera assembly (DCA) 1611, which may include e.g. the depthsensing imaging device 300 ofFIG. 3 , the rangingdevice 500 ofFIG. 5 , etc. TheDCA 1611 captures data describing depth information of a local area surrounding some or all of theHMD 1600. The depth information may be compared with the information from theIMU 1610, for better accuracy of determination of position and orientation of theHMD 1600 in 3D space. - The
HMD 1600 may further include aneye tracking system 1614 for determining orientation and position of user's eyes in real time. Theeye tracking system 1614 may include the eye trackingimaging device 400 ofFIG. 4 , for example. The obtained position and orientation of the eyes also allows theHMD 1600 to determine the gaze direction of the user and to adjust the image generated by thedisplay system 1680 accordingly. The determined gaze direction and vergence angle may be used to adjust thedisplay system 1680 to reduce the vergence-accommodation conflict. The direction and vergence may also be used for displays' exit pupil steering as disclosed herein. Furthermore, the determined vergence and gaze angles may be used for interaction with the user, highlighting objects, bringing objects to the foreground, creating additional objects or pointers, etc. An audio system may also be provided including e.g. a set of small speakers built into thefront body 1602. - Embodiments of the present disclosure may include, or be implemented in conjunction with, an artificial reality system. An artificial reality system adjusts sensory information about outside world obtained through the senses such as visual information, audio, touch (somatosensation) information, acceleration, balance, etc., in some manner before presentation to a user. By way of non-limiting examples, artificial reality may include virtual reality (VR), augmented reality (AR), mixed reality (MR), hybrid reality, or some combination and/or derivatives thereof. Artificial reality content may include entirely generated content or generated content combined with captured (e.g., real-world) content. The artificial reality content may include video, audio, somatic or haptic feedback, or some combination thereof. Any of this content may be presented in a single channel or in multiple channels, such as in a stereo video that produces a three-dimensional effect to the viewer. Furthermore, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, for example, create content in artificial reality and/or are otherwise used in (e.g., perform activities in) artificial reality. The artificial reality system that provides the artificial reality content may be implemented on various platforms, including a wearable display such as an HMD connected to a host computer system, a standalone HMD, a near-eye display having a form factor of eyeglasses, a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.
- The present disclosure is not to be limited in scope by the specific embodiments described herein. Indeed, other various embodiments and modifications, in addition to those described herein, will be apparent to those of ordinary skill in the art from the foregoing description and accompanying drawings. Thus, such other embodiments and modifications are intended to fall within the scope of the present disclosure. Further, although the present disclosure has been described herein in the context of a particular implementation in a particular environment for a particular purpose, those of ordinary skill in the art will recognize that its usefulness is not limited thereto and that the present disclosure may be beneficially implemented in any number of environments for any number of purposes. Accordingly, the claims set forth below should be construed in view of the full breadth and spirit of the present disclosure as described herein.
Claims (20)
1. An imaging device comprising:
a camera for capturing an image within a camera field of view; and
a diffraction grating structure upstream of the camera, the diffraction grating structure having a switchable grating period for switching the camera field of view between a plurality of overlapping portions of a compound field of view, whereby the compound field of view is greater than the camera field of view.
2. The imaging device of claim 1 , further comprising:
a lightguide for propagating a light beam therein by a series of internal reflections, the light beam carrying the image; and
an in-coupling grating supported by the lightguide for in-coupling the light beam into the lightguide;
wherein the diffraction grating structure is supported by the lightguide for out-coupling, towards the camera, portions of the light beam propagating in the lightguide.
3. The imaging device of claim 1 , further comprising:
a lightguide for propagating a light beam therein by a series of internal reflections, the light beam carrying the image; and
an out-coupling grating supported by the lightguide for out-coupling portions of the light beam propagating in the lightguide towards the camera;
wherein the diffraction grating structure is supported by the lightguide for in-coupling the light beam into the lightguide.
4. The imaging device of claim 1 , wherein: the camera comprises a color camera for a near-eye display; and
the image comprises a color image of outside environment of the near-eye display.
5. The imaging device of claim 1 , wherein:
the camera comprises a depth sensing camera for a near-eye display; and
the image comprises depth information associated with pixels of the image.
6. The imaging device of claim 1 , wherein:
the camera comprises an eye tracking camera for a near-eye display; and
the image comprises an image of an eye of a user of the near-eye display.
7. The imaging device of claim 1 , wherein the diffraction grating structure comprises a stack of switchable gratings of differing grating pitch, each switchable grating being switchable between a high-efficiency state wherein efficiency of the switchable grating is above a first threshold, and a low-efficiency state wherein the efficiency of the switchable grating is below a second threshold, wherein the second threshold is lower than the first threshold.
8. The imaging device of claim 1 , wherein the diffraction grating structure comprises a switchable polarization volume hologram (PVH) grating.
9. The imaging device of claim 1 , wherein the diffraction grating structure comprises a switchable Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating.
10. The imaging device of claim 1 , wherein the diffraction grating structure comprises a switchable surface relief liquid crystal (LC) grating.
11. The imaging device of claim 1 , wherein the diffraction grating structure comprises a switchable fluidic grating.
12. The imaging device of claim 1 , further comprising an acoustic actuator coupled to a slab of transparent material, wherein the diffraction grating structure is formed by an acoustic wave generated by the acoustic actuator in the slab.
13. The imaging device of claim 1 , further comprising a controller operably coupled to the camera and the diffraction grating structure and configured to:
operate the diffraction grating structure to switch the camera field of view between the plurality of overlapping portions of the compound field of view;
capture an image at each portion of the plurality of overlapping portions of the compound field of view; and
stitch the images captured at each portion of the plurality of overlapping portions to obtain a compound image corresponding to the compound field of view.
14. An imaging method comprising:
switching a field of view of a camera between the plurality of overlapping portions of a compound field of view by switching a grating period of a diffraction grating structure upstream of the camera;
at each portion of the plurality of overlapping portions of the compound field of view, capturing an image; and
stitching the images captured at each portion of the plurality of overlapping portions to obtain a compound image corresponding to the compound field of view.
15. The imaging method of claim 14 , wherein the switching comprises switching at least one of a stack of switchable gratings of differing grating pitch to a high-efficiency state above a first threshold, while the remaining switchable gratings of the stack are in a low-efficiency state below a second threshold lower than the first threshold.
16. The imaging method of claim 14 , wherein the switching comprises switching at least one of: a switchable polarization volume hologram (PVH) grating; a switchable Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating; a switchable surface relief liquid crystal (LC) grating; or a fluidic grating.
17. A ranging device comprising:
a transmitter for providing a ranging light beam within a ranging field of view; and
a diffraction grating structure downstream of the transmitter, the diffraction grating structure having a switchable grating period for switching the ranging field of view between a plurality of overlapping portions of a compound field of view, whereby the compound field of view is greater than the ranging field of view.
18. The ranging device of claim 17 , further comprising:
a lightguide for propagating the light beam therein by a series of internal reflections; and
an in-coupling grating supported by the lightguide for in-coupling the light beam into the lightguide;
wherein the diffraction grating structure is supported by the lightguide for out-coupling portions of the light beam propagating in the lightguide.
19. The ranging device of claim 17 , wherein the diffraction grating structure comprises a stack of switchable gratings of differing grating pitch, each switchable grating being switchable between a high-efficiency state wherein efficiency of the switchable grating is above a first threshold, and a low-efficiency state wherein the efficiency of the switchable grating is below a second threshold, wherein the second threshold is lower than the first threshold.
20. The ranging device of claim 17 , wherein the diffraction grating structure comprises at least one of: a switchable polarization volume hologram (PVH) grating; a switchable Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating; a switchable surface relief liquid crystal (LC) grating; or a fluidic grating.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/701,558 US20230176368A1 (en) | 2021-12-06 | 2022-03-22 | Grating-assisted field of view expansion |
TW111136400A TW202340792A (en) | 2021-12-06 | 2022-09-26 | Grating-assisted field of view expansion |
PCT/US2022/051814 WO2023107373A1 (en) | 2021-12-06 | 2022-12-05 | Grating-assisted field of view expansion |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202163286230P | 2021-12-06 | 2021-12-06 | |
US202163286381P | 2021-12-06 | 2021-12-06 | |
US17/701,558 US20230176368A1 (en) | 2021-12-06 | 2022-03-22 | Grating-assisted field of view expansion |
Publications (1)
Publication Number | Publication Date |
---|---|
US20230176368A1 true US20230176368A1 (en) | 2023-06-08 |
Family
ID=85017913
Family Applications (6)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/671,446 Pending US20230176377A1 (en) | 2021-12-06 | 2022-02-14 | Directional illuminator and display apparatus with switchable diffuser |
US17/697,592 Active US11846774B2 (en) | 2021-12-06 | 2022-03-17 | Eye tracking with switchable gratings |
US17/697,600 Pending US20230176444A1 (en) | 2021-12-06 | 2022-03-17 | Eye tracking with switchable gratings |
US17/698,996 Pending US20230176380A1 (en) | 2021-12-06 | 2022-03-18 | Pupil-replicating lightguide with switchable out-coupling efficiency distribution and display based thereon |
US17/699,012 Pending US20230176274A1 (en) | 2021-12-06 | 2022-03-18 | Adjustable focal length illuminator for a display panel |
US17/701,558 Pending US20230176368A1 (en) | 2021-12-06 | 2022-03-22 | Grating-assisted field of view expansion |
Family Applications Before (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/671,446 Pending US20230176377A1 (en) | 2021-12-06 | 2022-02-14 | Directional illuminator and display apparatus with switchable diffuser |
US17/697,592 Active US11846774B2 (en) | 2021-12-06 | 2022-03-17 | Eye tracking with switchable gratings |
US17/697,600 Pending US20230176444A1 (en) | 2021-12-06 | 2022-03-17 | Eye tracking with switchable gratings |
US17/698,996 Pending US20230176380A1 (en) | 2021-12-06 | 2022-03-18 | Pupil-replicating lightguide with switchable out-coupling efficiency distribution and display based thereon |
US17/699,012 Pending US20230176274A1 (en) | 2021-12-06 | 2022-03-18 | Adjustable focal length illuminator for a display panel |
Country Status (3)
Country | Link |
---|---|
US (6) | US20230176377A1 (en) |
TW (4) | TW202340801A (en) |
WO (1) | WO2023107351A1 (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160085300A1 (en) * | 2014-09-24 | 2016-03-24 | Steven Robbins | Waveguide eye tracking employing switchable diffraction gratings |
US20190147564A1 (en) * | 2017-11-16 | 2019-05-16 | Axis Ab | Method, device, and camera for blending a first and a second image having overlapping fields of view |
US20200041787A1 (en) * | 2012-05-11 | 2020-02-06 | Digilens Inc. | Apparatus for Eye Tracking |
US20210333402A1 (en) * | 2020-04-27 | 2021-10-28 | Facebook Technologies, Llc | Time-to-digital converter for depth sensing |
Family Cites Families (118)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB422680A (en) | 1933-06-09 | 1935-01-16 | Neyret Beylier Atel | Improvements in apparatus for grinding, refining and hydrating fibrous substances |
JP3323548B2 (en) | 1992-09-07 | 2002-09-09 | レーザーテック株式会社 | Beam deflector |
US6400885B1 (en) | 2000-08-18 | 2002-06-04 | Agilent Technologies, Inc. | Controllable optical attenuator |
DE602004032021D1 (en) | 2003-05-15 | 2011-05-12 | Konica Minolta Opto Inc | OPTICAL SYSTEM AND PICTURE DEVICE |
GB2422680B (en) | 2005-01-27 | 2010-04-14 | Univ Nottingham Trent | Switchable phase grating |
IL166799A (en) | 2005-02-10 | 2014-09-30 | Lumus Ltd | Substrate-guided optical device utilizing beam splitters |
JP4655771B2 (en) | 2005-06-17 | 2011-03-23 | ソニー株式会社 | Optical device and virtual image display device |
FR2889633A1 (en) | 2005-08-08 | 2007-02-09 | Commissariat Energie Atomique | FLEXIBLE MEMBRANE ACTUATING DEVICE CONTROLLED BY ELECTROMOUILLAGE |
JP2007219106A (en) | 2006-02-16 | 2007-08-30 | Konica Minolta Holdings Inc | Optical device for expanding diameter of luminous flux, video display device and head mount display |
JP4333708B2 (en) * | 2006-08-02 | 2009-09-16 | コニカミノルタビジネステクノロジーズ株式会社 | Method, apparatus, and computer program for processing input data related to generation of electronic file |
US8086044B2 (en) * | 2006-08-25 | 2011-12-27 | Ricoh Co., Ltd. | Block-based iterative multi-pass data filling technique for compound document compression |
US8368720B2 (en) | 2006-12-13 | 2013-02-05 | Adobe Systems Incorporated | Method and apparatus for layer-based panorama adjustment and editing |
US20080212942A1 (en) | 2007-01-12 | 2008-09-04 | Ictv, Inc. | Automatic video program recording in an interactive television environment |
JP2008310076A (en) | 2007-06-15 | 2008-12-25 | Panasonic Corp | Current driving device |
US20090196460A1 (en) * | 2008-01-17 | 2009-08-06 | Thomas Jakobs | Eye tracking system and method |
WO2011014743A2 (en) | 2009-07-31 | 2011-02-03 | North Carolina State University | Beam steering devices including stacked liquid crystal polarization gratings and related methods of operation |
WO2011051660A1 (en) | 2009-10-27 | 2011-05-05 | Milan Momcilo Popovich | Compact holographic edge illuminated eyeglass display |
US20110234750A1 (en) | 2010-03-24 | 2011-09-29 | Jimmy Kwok Lap Lai | Capturing Two or More Images to Form a Panoramic Image |
DE102010019667B4 (en) * | 2010-04-28 | 2014-02-20 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Circuit arrangement for arranged in a two-dimensional matrix organic light-emitting diodes |
US8878773B1 (en) * | 2010-05-24 | 2014-11-04 | Amazon Technologies, Inc. | Determining relative motion as input |
US9557812B2 (en) * | 2010-07-23 | 2017-01-31 | Gregory A. Maltz | Eye gaze user interface and calibration method |
JP5269026B2 (en) | 2010-09-29 | 2013-08-21 | 日立建機株式会社 | Work machine ambient monitoring device |
US9618746B2 (en) * | 2010-11-19 | 2017-04-11 | SA Photonics, Inc. | High resolution wide field of view digital night vision system |
GB2489675A (en) * | 2011-03-29 | 2012-10-10 | Sony Corp | Generating and viewing video highlights with field of view (FOV) information |
GB2489674A (en) | 2011-03-29 | 2012-10-10 | Sony Corp | 3D image generation |
JP5845608B2 (en) * | 2011-03-31 | 2016-01-20 | 株式会社ニデック | Ophthalmic imaging equipment |
US20140037213A1 (en) * | 2011-04-11 | 2014-02-06 | Liberovision Ag | Image processing |
CN104040410B (en) | 2011-08-29 | 2017-06-09 | 伊奎蒂公司 | For the controllable waveguide of near-to-eye application |
US9274597B1 (en) * | 2011-12-20 | 2016-03-01 | Amazon Technologies, Inc. | Tracking head position for rendering content |
US10025089B2 (en) | 2012-10-05 | 2018-07-17 | Microsoft Technology Licensing, Llc | Backlight for viewing three-dimensional images from a display from variable viewing angles |
JP2014106368A (en) | 2012-11-27 | 2014-06-09 | Fujifilm Corp | Electrowetting display dye composition, and electrowetting display device |
WO2014091204A1 (en) | 2012-12-10 | 2014-06-19 | Bae Systems Plc | Display comprising an optical waveguide and switchable diffraction gratings and method of producing the same |
EP2767852A1 (en) | 2013-02-15 | 2014-08-20 | BAE Systems PLC | Display comprising an optical waveguide and switchable diffraction gratings and method of producing the same |
GB201305726D0 (en) | 2013-03-28 | 2013-05-15 | Eye Tracking Analysts Ltd | A method for calibration free eye tracking |
US9785235B2 (en) * | 2014-02-19 | 2017-10-10 | Mitsubishi Electric Corporation | Display control apparatus, display control method of display control apparatus, and eye gaze direction detection system |
US9449994B2 (en) * | 2014-02-25 | 2016-09-20 | Lg Display Co., Ltd. | Display backplane having multiple types of thin-film-transistors |
US10852838B2 (en) | 2014-06-14 | 2020-12-01 | Magic Leap, Inc. | Methods and systems for creating virtual and augmented reality |
WO2016046514A1 (en) | 2014-09-26 | 2016-03-31 | LOKOVIC, Kimberly, Sun | Holographic waveguide opticaltracker |
KR20170094350A (en) | 2014-12-09 | 2017-08-17 | 바스프 에스이 | Optical detector |
CA2977051C (en) * | 2015-02-17 | 2023-02-07 | Nextvr Inc. | Methods and apparatus for generating and using reduced resolution images and/or communicating such images to a playback or content distribution device |
EP3062142B1 (en) | 2015-02-26 | 2018-10-03 | Nokia Technologies OY | Apparatus for a near-eye display |
US20180237696A1 (en) | 2015-08-11 | 2018-08-23 | Merck Patent Gmbh | Material combination |
WO2017039718A1 (en) | 2015-09-03 | 2017-03-09 | 3M Innovative Properties Company | Magnifying device |
US10217286B1 (en) | 2015-09-21 | 2019-02-26 | Amazon Technologies, Inc. | Realistic rendering for virtual reality applications |
WO2017134412A1 (en) | 2016-02-04 | 2017-08-10 | Milan Momcilo Popovich | Holographic waveguide optical tracker |
US10197804B2 (en) | 2016-04-25 | 2019-02-05 | Microsoft Technology Licensing, Llc | Refractive coating for diffractive optical elements |
US20180073686A1 (en) | 2016-09-14 | 2018-03-15 | Osram Sylvania Inc. | Solid state lighting device with electronically adjustable light beam distribution |
US10108144B2 (en) | 2016-09-16 | 2018-10-23 | Microsoft Technology Licensing, Llc | Holographic wide field of view display |
CN108235739B (en) | 2016-10-09 | 2021-03-16 | 鲁姆斯有限公司 | Aperture multiplier using rectangular waveguides |
US20180143586A1 (en) | 2016-11-22 | 2018-05-24 | United States Of America As Represented By The Secretary Of The Navy | Volume Phase Holographic Grating |
US10108014B2 (en) | 2017-01-10 | 2018-10-23 | Microsoft Technology Licensing, Llc | Waveguide display with multiple focal depths |
KR20180092362A (en) | 2017-02-09 | 2018-08-20 | 엘지이노텍 주식회사 | Camera module and optical device including liquid lens |
IL301881B1 (en) | 2017-02-23 | 2024-04-01 | Magic Leap Inc | Display system with variable power reflector |
CN106597658B (en) | 2017-03-09 | 2020-05-22 | 京东方科技集团股份有限公司 | Display panel and display device |
IL269317B2 (en) * | 2017-03-21 | 2023-11-01 | Magic Leap Inc | Eye-imaging apparatus using diffractive optical elements |
US20180307047A1 (en) | 2017-04-19 | 2018-10-25 | Thalmic Labs Inc. | Systems, devices, and methods for holographic optical elements |
KR102337620B1 (en) * | 2017-05-17 | 2021-12-08 | 애플 인크. | Head-mounted display device with vision correction |
GB201709199D0 (en) | 2017-06-09 | 2017-07-26 | Delamont Dean Lindsay | IR mixed reality and augmented reality gaming system |
KR102365726B1 (en) | 2017-06-13 | 2022-02-22 | 한국전자통신연구원 | Method for providing composite image based on optical see-through and apparatus using the same |
US10571699B1 (en) | 2017-06-14 | 2020-02-25 | Facebook Technologies, Llc | Multi-layered substrates for waveguide displays |
WO2018236725A1 (en) | 2017-06-19 | 2018-12-27 | Magic Leap, Inc. | Dynamically actuable diffractive optical element |
US10466779B1 (en) * | 2017-07-24 | 2019-11-05 | Facebook Technologies, Llc | Event camera for eye tracking |
US20190079293A1 (en) | 2017-09-12 | 2019-03-14 | Thalmic Labs Inc. | Systems, devices, and methods for optical waveguides |
IL273397B1 (en) | 2017-09-21 | 2024-05-01 | Magic Leap Inc | Augmented reality display with waveguide configured to capture images of eye and/or environment |
US10712576B1 (en) | 2017-10-24 | 2020-07-14 | Facebook Technologies, Llc | Pupil steering head-mounted display |
US10466484B1 (en) * | 2017-12-14 | 2019-11-05 | Facebook Technologies, Llc | Compact head-mounted display for artificial reality |
US11314083B2 (en) | 2018-02-06 | 2022-04-26 | Google Llc | Beam steering optics for near-eye and head mounted displays |
CN111742254B (en) * | 2018-02-09 | 2022-09-02 | 伊奎蒂公司 | Image light guide with circular polarizer |
US11175507B2 (en) | 2018-03-15 | 2021-11-16 | Facebook Technologies, Llc | Polarization-sensitive components in optical systems for large pupil acceptance angles |
US20190285891A1 (en) | 2018-03-15 | 2019-09-19 | Oculus Vr, Llc | Image quality of pancharatnam berry phase components using polarizers |
US10775633B1 (en) | 2018-04-10 | 2020-09-15 | Facebook Technologies, Llc | Exit pupil steering for near-eye displays |
US11561507B2 (en) | 2018-04-17 | 2023-01-24 | Meta Platforms Technologies, Llc | Methods for three-dimensional arrangement of anisotropic molecules, patterned anisotropic films, and optical elements therewith |
US10295723B1 (en) | 2018-05-01 | 2019-05-21 | Facebook Technologies, Llc | 2D pupil expander using holographic Bragg grating |
US10502963B1 (en) * | 2018-07-16 | 2019-12-10 | Facebook Technologies, Llc | Immersed fresnel structure with curable liquid polymer |
US20200043398A1 (en) | 2018-08-01 | 2020-02-06 | David Viveros Salazar | Photoexcited Quantum Dot Based Augmented Reality Displays |
US10838132B1 (en) * | 2018-08-21 | 2020-11-17 | Facebook Technologies, Llc | Diffractive gratings for eye-tracking illumination through a light-guide |
US10725291B2 (en) | 2018-10-15 | 2020-07-28 | Facebook Technologies, Llc | Waveguide including volume Bragg gratings |
US20200116996A1 (en) | 2018-10-16 | 2020-04-16 | Facebook Technologies, Llc | Display waveguide assembly with color cross-coupling |
US11087680B2 (en) | 2018-11-07 | 2021-08-10 | Canon Kabushiki Kaisha | Display device, image capturing device, illumination device, mobile body, and electronic apparatus |
TWM642752U (en) | 2018-11-08 | 2023-06-21 | 以色列商魯姆斯有限公司 | Light-guide display with reflector |
JP2020076926A (en) | 2018-11-09 | 2020-05-21 | キヤノン株式会社 | Display device and imaging device |
JP2022514489A (en) * | 2018-12-10 | 2022-02-14 | フェイスブック・テクノロジーズ・リミテッド・ライアビリティ・カンパニー | Adaptive viewport for hypervocal viewport (HVP) displays |
EP3908876A4 (en) | 2019-01-11 | 2022-03-09 | Magic Leap, Inc. | Time-multiplexed display of virtual content at various depths |
US11372246B2 (en) | 2019-02-22 | 2022-06-28 | Facebook Technologies, Llc | Near-eye display system having optical combiner |
JP7365133B2 (en) | 2019-04-19 | 2023-10-19 | キヤノン株式会社 | Communication device, its control method, and program |
US11176367B1 (en) | 2019-05-01 | 2021-11-16 | Facebook Technologies, Llc | Apparatuses, systems, and methods for mapping a surface of an eye via an event camera |
US11099412B2 (en) | 2019-05-20 | 2021-08-24 | Facebook Technologies, Llc | Optical waveguide beam splitter with plural partial extraction features for display |
CN210323583U (en) | 2019-06-13 | 2020-04-14 | 句容福芯电子有限公司 | Near-eye display based on holographic waveguide |
EP3987340B1 (en) * | 2019-06-23 | 2024-03-13 | Lumus Ltd. | Display with foveated optical correction |
JP2021005053A (en) | 2019-06-27 | 2021-01-14 | キヤノン株式会社 | Display control device and method for controlling the same, imaging apparatus, program, and storage medium |
GB2585211B (en) | 2019-07-02 | 2021-12-08 | Dualitas Ltd | Spatial light modulation |
KR20210004776A (en) | 2019-07-04 | 2021-01-13 | 삼성전자주식회사 | Apparatus and method of displaying augmented reality |
US11609424B2 (en) | 2019-07-08 | 2023-03-21 | Meta Platforms Technologies, Llc | Apodized reflective optical elements for eye-tracking and optical artifact reduction |
US11360557B2 (en) * | 2019-08-06 | 2022-06-14 | Apple Inc. | Eye tracking system |
CN113302547A (en) | 2019-08-13 | 2021-08-24 | 苹果公司 | Display system with time interleaving |
US20210055551A1 (en) | 2019-08-23 | 2021-02-25 | Facebook Technologies, Llc | Dispersion compensation in volume bragg grating-based waveguide display |
WO2021040106A1 (en) | 2019-08-30 | 2021-03-04 | 엘지전자 주식회사 | Ar device and control method therefor |
US10890823B1 (en) | 2019-10-18 | 2021-01-12 | Facebook Technologies, Llc | Pitch variable optical devices and systems containing the same |
WO2021091622A1 (en) | 2019-11-06 | 2021-05-14 | Arizona Board Of Regents On Behalf Of The University Of Arizona | Augmented near to eye display |
US20220394234A1 (en) | 2019-11-08 | 2022-12-08 | Evolution Optiks Limited | System and method for implementing a viewer-specific image perception adjustment within a defined view zone, and vision correction system and method using same |
WO2021118850A1 (en) | 2019-12-12 | 2021-06-17 | Akalana Management Llc | Optical systems with resolution-enhancing holographic elements |
US11428938B2 (en) | 2019-12-23 | 2022-08-30 | Meta Platforms Technologies, Llc | Switchable diffractive optical element and waveguide containing the same |
US11415805B2 (en) * | 2019-12-30 | 2022-08-16 | Meta Platforms Technologies, Llc | Optical system and method for providing compressed eyebox |
US11294184B2 (en) | 2020-01-06 | 2022-04-05 | Facebook Technologies, Llc | Foveated display system |
US11668932B2 (en) | 2020-01-06 | 2023-06-06 | Meta Platforms Technologies, Llc | Switchable Pancharatnam-Berry phase grating stack |
US10885843B1 (en) | 2020-01-13 | 2021-01-05 | Sharp Kabushiki Kaisha | TFT pixel threshold voltage compensation circuit with a source follower |
JP2023518421A (en) | 2020-03-20 | 2023-05-01 | マジック リープ, インコーポレイテッド | Systems and methods for retinal imaging and tracking |
WO2021242667A1 (en) | 2020-05-28 | 2021-12-02 | Arizona Board Of Regents On Behalf Of The University Of Arizona | Optical see-through head-mounted lightfield displays based on substrate-guided combiners |
JP2021189278A (en) | 2020-05-28 | 2021-12-13 | キヤノン株式会社 | Light-emitting device and electronic apparatus |
CN114167606B (en) | 2020-09-11 | 2023-11-10 | 宁波舜宇光电信息有限公司 | Optical waveguide assembly and display apparatus including the same |
CA3205624A1 (en) | 2020-12-17 | 2022-06-23 | Zinn Labs, Inc. | Event camera system for pupil detection and eye tracking |
US20220299754A1 (en) | 2021-03-18 | 2022-09-22 | Facebook Technologies, Llc | Mems with polarization conversion and optical beam scanner based thereon |
CN113075793B (en) | 2021-04-06 | 2023-06-02 | 业成科技(成都)有限公司 | Display device and method of operating the same |
US20220382064A1 (en) | 2021-06-01 | 2022-12-01 | Microsoft Technology Licensing, Llc | Metalens for use in an eye-tracking system of a mixed-reality display device |
US11972042B2 (en) | 2021-06-15 | 2024-04-30 | Microsoft Technology Licensing, Llc | Variable intensity distributions for gaze detection assembly |
US20220413603A1 (en) | 2021-06-25 | 2022-12-29 | Microsoft Technology Licensing, Llc | Multiplexed diffractive elements for eye tracking |
US11852836B2 (en) | 2021-07-13 | 2023-12-26 | Meta Platforms Technologies, Llc | Directional illuminator and display device with pupil steering by tiltable reflector |
US20230055268A1 (en) | 2021-08-18 | 2023-02-23 | Meta Platforms Technologies, Llc | Binary-encoded illumination for corneal glint detection |
-
2022
- 2022-02-14 US US17/671,446 patent/US20230176377A1/en active Pending
- 2022-03-17 US US17/697,592 patent/US11846774B2/en active Active
- 2022-03-17 US US17/697,600 patent/US20230176444A1/en active Pending
- 2022-03-18 US US17/698,996 patent/US20230176380A1/en active Pending
- 2022-03-18 US US17/699,012 patent/US20230176274A1/en active Pending
- 2022-03-22 US US17/701,558 patent/US20230176368A1/en active Pending
- 2022-09-23 TW TW111136163A patent/TW202340801A/en unknown
- 2022-09-23 TW TW111136183A patent/TW202328766A/en unknown
- 2022-09-26 TW TW111136400A patent/TW202340792A/en unknown
- 2022-09-26 TW TW111136402A patent/TW202328726A/en unknown
- 2022-12-03 WO PCT/US2022/051755 patent/WO2023107351A1/en unknown
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200041787A1 (en) * | 2012-05-11 | 2020-02-06 | Digilens Inc. | Apparatus for Eye Tracking |
US20160085300A1 (en) * | 2014-09-24 | 2016-03-24 | Steven Robbins | Waveguide eye tracking employing switchable diffraction gratings |
US20190147564A1 (en) * | 2017-11-16 | 2019-05-16 | Axis Ab | Method, device, and camera for blending a first and a second image having overlapping fields of view |
US20210333402A1 (en) * | 2020-04-27 | 2021-10-28 | Facebook Technologies, Llc | Time-to-digital converter for depth sensing |
Also Published As
Publication number | Publication date |
---|---|
US20230176444A1 (en) | 2023-06-08 |
WO2023107351A1 (en) | 2023-06-15 |
TW202328726A (en) | 2023-07-16 |
US20230176380A1 (en) | 2023-06-08 |
US11846774B2 (en) | 2023-12-19 |
US20230176274A1 (en) | 2023-06-08 |
US20230176377A1 (en) | 2023-06-08 |
TW202328766A (en) | 2023-07-16 |
TW202340801A (en) | 2023-10-16 |
US20230176370A1 (en) | 2023-06-08 |
TW202340792A (en) | 2023-10-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10591989B2 (en) | Waveguide display with spatially switchable grating | |
US10935794B1 (en) | Low-obliquity beam scanner with polarization-selective grating | |
JP2022547252A (en) | Magnetic field-driven liquid crystal patterning control system | |
US20230176368A1 (en) | Grating-assisted field of view expansion | |
US11822086B2 (en) | Lightguide based illuminator for reflective display panel | |
WO2023107373A1 (en) | Grating-assisted field of view expansion | |
US20230367124A1 (en) | Lightguide assembly with switchable inputs | |
US20230176376A1 (en) | Lightguides with color- and time-sequential gratings | |
US20240094568A1 (en) | Optical modulator and image projector based on leaky-mode waveguide with spatial multiplexing | |
US20230176273A1 (en) | Display device with running out-coupling grating | |
KR20220141278A (en) | resonant liquid crystal devices | |
WO2021112982A1 (en) | Anisotropic diffraction grating and waveguide | |
WO2023107367A1 (en) | Eye tracking with switchable gratings | |
WO2023107309A1 (en) | Pupil-replicating lightguide with switchable out-coupling efficiency distribution and display based thereon | |
WO2023107360A1 (en) | Display device with running out-coupling grating | |
WO2023107319A1 (en) | Lightguides with color- and time-sequential gratings | |
WO2023107348A1 (en) | Directional illuminator and display apparatus with switchable diffuser | |
WO2023107336A1 (en) | Lightguides with color- and time-sequential gratings | |
TW202409650A (en) | Field of view expansion by image light redirection | |
WO2023107370A1 (en) | Lightguides with tunable gratings for dynamically variable field-of-view | |
WO2023220353A1 (en) | Field of view expansion by image light redirection | |
US20240175676A1 (en) | Polarization interference pattern generation for depth sensing | |
US20230367073A1 (en) | Waveguide with tunable bulk reflectors | |
WO2023137066A1 (en) | Transmissive optical element based on reflective volumetric gratings | |
CN116762024A (en) | Display device with transparent illuminator |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |