WO2021178287A1 - Projecteur à modulateur d'hologramme en phase - Google Patents

Projecteur à modulateur d'hologramme en phase Download PDF

Info

Publication number
WO2021178287A1
WO2021178287A1 PCT/US2021/020237 US2021020237W WO2021178287A1 WO 2021178287 A1 WO2021178287 A1 WO 2021178287A1 US 2021020237 W US2021020237 W US 2021020237W WO 2021178287 A1 WO2021178287 A1 WO 2021178287A1
Authority
WO
WIPO (PCT)
Prior art keywords
phase
image
amplitude
goal
hologram
Prior art date
Application number
PCT/US2021/020237
Other languages
English (en)
Inventor
Muralidhar Madabhushi Balaji
Jeffrey Matthew Kempf
Terry Alan Bartlett
Original Assignee
Texas Instruments Incorporated
Texas Instruments Japan Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/160,060 external-priority patent/US20210232093A1/en
Application filed by Texas Instruments Incorporated, Texas Instruments Japan Limited filed Critical Texas Instruments Incorporated
Publication of WO2021178287A1 publication Critical patent/WO2021178287A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3102—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM] using two-dimensional electronic spatial light modulators
    • H04N9/312—Driving therefor
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22—Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2294—Addressing the hologram to an active spatial light modulator
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3102—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM] using two-dimensional electronic spatial light modulators
    • H04N9/3111—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM] using two-dimensional electronic spatial light modulators for displaying the colours sequentially, e.g. by using sequentially activated light sources
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G03B21/005—Projectors using an electronic spatial light modulator but not peculiar thereto
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/16—Processes or apparatus for producing holograms using Fourier transform
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
    • G03H2001/0816—Iterative algorithms
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2225/00—Active addressable light modulator
    • G03H2225/20—Nature, e.g. e-beam addressed
    • G03H2225/22—Electrically addressed SLM [EA-SLM]
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2225/00—Active addressable light modulator
    • G03H2225/20—Nature, e.g. e-beam addressed
    • G03H2225/24—Having movable pixels, e.g. microelectromechanical systems [MEMS]

Definitions

  • a projection system includes: an illumination source configured to output illumination light; a phase light modulator (PLM) optically coupled to the illumination source, the PLM configured to: receive the illumination light; phase modulate the illumination light while displaying a phase hologram, to produce modulated light; and projection optics coupled to the PLM, the projection optics configured to receive the modulated light and to project an image responsive to the modulated light; wherein both a mean in intensity and a variance in intensity in bright regions of the projected image is greater than the mean intensity and the variance in intensity in dark regions of the projected image.
  • PLM phase light modulator
  • FIG. 1 is a block diagram illustrating elements of a phase light modulation projection system.
  • FIG. 2A is a block diagram illustrating projection of an image using a phase light modulator
  • FIG. 2B illustrates destructive and constructive interference for in phase and out of phase light.
  • FIG. 3 is a projection view illustrating a picture element of a micro-electro-mechanical (MEMS) device phase light modulator that is useful with the arrangements.
  • MEMS micro-electro-mechanical
  • FIG. 4 is a cross-sectional view of a liquid crystal on silicon (LCOS) phase light modulator that is useful with the arrangements.
  • LCOS liquid crystal on silicon
  • FIG. 5 is a block diagram for an example arrangement for a projection system with a phase light modulator.
  • FIG. 6 illustrates a sample image projected using an algorithm of an arrangement.
  • FIG. 7 is a flow diagram illustrating an iterative algorithm of an arrangement that determines phase holograms for use in projecting images with a phase light modulator.
  • FIG. 8 is a flow diagram illustrating a method arrangement.
  • FIG. 9 is a flow diagram illustrating a method for an algorithm of an arrangement.
  • FIG. 10 is a block diagram for a circuit useful with the arrangements.
  • Coupled when the term “coupled” is used herein to describe the relationships between elements, the term as used in the specification and the appended claims is to be interpreted broadly, and is not to be limited to “connected” or “directly connected” but instead the term “coupled” may include connections made with intervening elements, and additional elements and various connections may be used between any elements that are “coupled.”
  • the term “optically coupled” is used herein. Elements that are “optically coupled” have an optical connection between the elements but various intervening elements may be between elements that are “optically coupled.”
  • phase hologram is a pattern containing phase information that is generated for display on a phase light modulator when amplitude is made constant.
  • the phase hologram is transmitted to a phase light modulator as a two dimensional bitmap.
  • An array of picture elements (pixels) of the phase light modulator move in correspondence with the bitmap, which is stored in storage cells associated with the pixels.
  • the pixels phase modulate illuminating light.
  • a “bright region” of a projected image is a region with greater intensity, where more light is visible, and the bright regions are regions that have an intensity at least 50% of the maximum intensity, while the maximum brightness that could be found in a bright region is where the maximum possible amplitude of the light is projected.
  • a dark region in a projected image is a region with lesser intensity, a dark region is one with intensity of less than 50% of the maximum intensity. The maximum darkness that could be found in a dark region is where the minimum possible amplitude of the light is projected, which could be zero.
  • the image intensity is binary, so that the goal amplitude for a particular pixel in the projected image is either 0 (dark region) or 1 (bright region).
  • noise is a variance in intensity of light in a region in a projected image.
  • the noise is introduced, in part, by algorithms used to generate a phase hologram that is used to modulate illumination light, and the modulated light is used to project an image.
  • noise that occurs in projecting an image from a phase light modulator is distributed in the bright regions (amplitude is 1 in the binary case) of a projected image, and noise is reduced or eliminated from the dark regions (amplitude is zero in the binary case) of the projected image.
  • the noise reduction in the dark regions is achieved by the methods used to generate phase holograms used in the arrangements.
  • the images projected using the arrangements have high contrast, as the noise is excluded or minimized in the dark regions, increasing the contrast.
  • SLMs spatial light modulators
  • Examples of SLMs include projectors using liquid crystal on silicon (LCOS) light modulators and digital micromirror device (DMD) light modulators.
  • Applications for spatial light modulators include heads up displays (HUD), cinema, television, presentation projectors, headlights, near eye displays, light detection and ranging (LIDAR), automotive console displays, forward looking infrared (FLIR), structured light, spectroscopy, 3D printing, light field displays, communications, and high dynamic range projectors.
  • HUD heads up displays
  • LIDAR light detection and ranging
  • FLIR forward looking infrared
  • structured light spectroscopy
  • 3D printing light field displays
  • communications and high dynamic range projectors.
  • amplitude modulation is used with SLMs.
  • SLMs display patterns corresponding to an image, and an illumination source provides light to illuminate the pattern on the SLM. Modulated light is reflected from the SLM to projection optics which projects an image on a screen or a surface for viewing. Amplitude modulation using SLMs is subtractive. To obtain variable light intensity in the projected images, the SLM either reflects all, or less than all, of the illumination light to the projected image. The light that is not reflected for projection is reflected instead at another direction away from the projection optics and into a light dump. For color images, multiple color light sources are used to illuminate different corresponding images displayed on the SLM in a sequence in the different colors that are projected during a frame display time. Because the human viewing system integrates the light, the viewed image is a color image containing all of the colors.
  • Images may be projected at a screen, onto the human retina, or for viewing in a far field using phase light modulators (PLMs).
  • PLMs phase light modulators
  • a modulated wavefront is produced in the light that is projected towards a screen or to another far field distance for viewing.
  • Phase information displayed on the phase light modulator is a hologram. Due to constructive and destructive interference of light in the traveling wavefront as it traverses the path from the phase light modulator, the projected image appears at the screen, on the human retina, or at a selected far field distance for viewing.
  • PLMs are optically efficient when compared to amplitude modulators, because all of the illumination light is directed for projection, and no light dump is used for any of the illumination light.
  • the PLM device displays phase holograms, which may appear as a randomized pattern when viewed at the PLM, but when the PLM is illuminated, phase modulated light is projected to the screen or at a far field distance, and the projected image appears for viewing due to constructive and destructive interference.
  • PLMs have physical characteristics that result in noise in a projected image. The contrast ratio of the projected image is limited in part because the phase modulator has a physical bit depth (number of bits per pixel corresponding to physical operation of the pixels of the phase modulator). Using the phase light modulator to modulate light introduces quantization noise, due to a fixed number of positions of the pixels on the phase modulator. Additional noise results when an optimization approach is used to generate phase holograms.
  • phase holograms are generated in an algorithm that starts from a random initial phase image, which may introduce some noise.
  • the amplitude in the phase plane is fixed, which also introduces noise.
  • phase holograms are generated for display on the phase light modulator.
  • the phase holograms when illuminated, cause a projected image to appear at a target surface or target plane. Intensity in the image varies due to constructive and destructive interference of the phase modulated light waves reflected from the PLM.
  • the projection of the modulated light from the PLM to the screen or far field imaging plane corresponds to a Fourier transform between a source plane (where the PLM is located) and a target plane (where the projected image appears).
  • the projection path from a phase representation (intensity or amplitude is uniform) at the source plane (where the PLM device is located) transforms the phase hologram to a transformed amplitude and phase image representation corresponding to the projected image in the target plane.
  • a projector system using a PLM generates phase holograms from amplitude images.
  • the amplitude images may be provided as digital video images retrieved from a memory, received from a computer executing an internet browser, received from a video streaming device, video player, camera, camcorder, game console, or other image source.
  • An algorithm is used for generating the phase holograms to provide bitmap patterns to the PLM.
  • An iterative algorithm that uses Fourier transforms to determine phase information for an image is described in a paper titled “A Practical Algorithm for the Determination of Phase from Image and Diffraction Pictures”, R.W. Gerchberg and W. O.
  • the G-S algorithm uses an iterative loop to optimize the phase information so that the transformed image obtained by the algorithm is within an error threshold from the image to be reproduced.
  • the phase information is updated at each iteration, and the projected image is optimized repeatedly in an iterative loop, until the transformed image that results from the generated phase information is within an error threshold from the image to be reproduced.
  • the phase information algorithm has inherent noise due to the fact that in the source plane of the transforms, where the phase representation information is present, the amplitude is fixed.
  • the reconstructed image in the target plane becomes a convolution of the image with the Fourier transform of the inverse of the amplitude in the phase plane, which is a source of noise in the projected images.
  • some noise is introduced by the algorithm’s use of a random initial phase image.
  • the random initial phase image can be obtained using a pseudo-random pattern generator, for example.
  • the G-S algorithm distributes noise in both the dark and bright regions of the projected image as the algorithm iteratively moves the transformed image towards the image to be reproduced by repeatedly modifying the phase information.
  • the presence of this noise reduces the image contrast.
  • the noise can be expressed as the mean of the intensity in a region, and as variance in the intensity of the region. When noise increases, both the intensity mean and the intensity variance increase. When noise decreases, both the intensity mean and the intensity variance in a region decreases.
  • An approach to improving the contrast in images projected using phase modulation is to allow the amplitude to vary, increasing the number of free variables in the reconstruction plane.
  • regions of the projected image are identified as “don’t care” areas where both amplitude and phase may take any arbitrary value.
  • the cost for using these approaches is a reduction in the field of view.
  • the algorithm puts a “don’t care” band around the image, reducing the size of the image, and the Fidoc algorithm directs the noise into the unused band. While effective in increasing the contrast in the viewed images, the Fidoc algorithm, and other similar approaches, results in less usable field of view, as the usable field of view is reduced by the unused band area.
  • an iterative algorithm generates phase holograms that result in increased contrast in projected images.
  • noise in the projected image is allowed in bright regions of the projected image and noise is reduced or eliminated in the dark regions of the projected image.
  • the intensity mean and the intensity variance in the dark regions is reduced (compared to the G-S approach without the arrangements); while the intensity variance and intensity mean in the bright regions is allowed to increase, and both values are greater in the brighter regions than in the dark regions.
  • the algorithm of the arrangements generates phase holograms which, when used to project an image, use the entire field of view in the projected image.
  • an illumination source provides coherent illumination light.
  • the coherent illumination light is optically coupled to a PLM.
  • the PLM displays phase holograms.
  • the PLM phase modulates the illumination light.
  • the phase modulated light is directed from the PLM to projection optics.
  • a Fourier optical element optically couples the modulated light from the PLM to an output for the projector.
  • the projected image corresponds to a Fourier transform from the phase hologram displayed on the PLM.
  • an iterative algorithm generates a phase hologram for display on the PLM.
  • the algorithm weighs the dark regions of the projected target plane image heavier than the bright regions, allowing noise (increased intensity variance and increased mean intensity) in the bright regions of the projected image while reducing or excluding it in the dark regions.
  • phase holograms determined by the algorithm result in increased contrast in the projected images.
  • the noise that is present in the bright regions of the projected image may be temporally averaged, and therefore reduced, by projecting the image using several different phase holograms in rapid succession. This approach averages random noise in the bright regions, so that the perceived noise in the projected image is reduced.
  • a MEMS PLM is used.
  • the MEMS device has a high rate of operation, making temporal averaging in the bright regions of the projected images expedient.
  • an LCOS PLM is used.
  • FIG. 1 is a block diagram illustrating a projector 100 using a PLM to project images.
  • illumination light is provided by illumination source 101, for example a laser.
  • the illumination light is coherent light.
  • a laser with light output between 405 nanometers and 632 nanometers in wavelength is used.
  • a laser with visible light is used.
  • An optical element 103 represents illumination optics, which may include collimators, integrators, fly’s eye integrators, optical path extenders, and other optics to provide approximately uniform light to the surface of the PLM 105.
  • a processing element 111 and a digital PLM controller 109 provide phase holograms as bitmaps for display by the PLM.
  • the processing element 111 may be implemented as a processor or microcontroller executing a software program, a digital signal processor or mixed signal processor executing a software program, a dedicated integrated circuit such as an application specific integrated circuit (ASIC), field programmable gate array (FPGA), or complex programmable logic device (CPLD), or a combination of these.
  • the processing element may include volatile or non-volatile memory internally, or may include external memory devices for storing executable code, for storing data for use in generating the phase holograms, or for storing the phase holograms produced by the algorithm.
  • the processing element 111 outputs a phase hologram 102 in a form such as a bitmap pattern, which when used with a PLM to project an image, corresponds to a projected image 107 that is output by the projector 100.
  • the PLM 105 is a MEMS PLM device.
  • the MEMS PLM includes an array of addressable storage elements associated with individual MEMS micromirrors that have multiple vertical positions (vertical with respect to a reflective surface of the device when the device is facing upwards).
  • the micromirrors may be used to modulate the phase of illumination light and, when illuminated, output phase modulated light.
  • the PLM 105 is reflective and the phase modulated light is directed to projection optics 106.
  • the projection optics 106 is arranged to display an image 107 at a viewing distance, for example by projecting the image onto a screen, onto a human retina, onto a display medium, a wall or at a far field in a field of view.
  • the relationship between the phase hologram at the PLM and the projected image may be expressed as Fourier transforms, and the projection optics 106 is sometimes referred to as a “Fourier lens.”
  • the projected image 107 has amplitude and phase even though the bitmap displayed on the PLM is a phase hologram.
  • the phase hologram may appear as a random bitmap or as noise when viewed on the PLM.
  • phase hologram displayed on the PLM The intensity observed in the projected image resembles a natural image to the human vision system, despite the stochastic nature of the phase hologram displayed on the PLM.
  • Alternative illumination sources may be used, such as a super luminescent diode.
  • multiple color light sources may be used to illuminate phase holograms displayed by the PLM in a sequence to provide a color image.
  • red, green and blue lasers may be used to independently illuminate the PLM in a sequence of sub frames while the PLM displays phase holograms for each color.
  • the projected image is then a color image.
  • a single illumination source 101 is used, for example a blue-violet laser diode may be used.
  • the laser diode for blue color may have an output of wavelength around 400 nanometers, for example 405 nanometers.
  • Blue laser diodes are commercially available in TO-can packages and may include a cover lens, such as a collimator, to improve the coherence of the output beam.
  • laser diodes having other color outputs of differing colors and at different wavelengths may be used.
  • Visible laser light of any color may be used. Light that is not visible to the human vision system, such as infrared light, may be used for projecting signals, and for ranging applications.
  • FIGS. 2A-2B illustrate the operation of a PLM device to project an image.
  • a MEMS PLM 205 is shown with micromirrors 206 arranged as pixels that have programmable vertical (as oriented in FIG. 2A) displacement.
  • MEMS PLM 205 phase modulates the light from illumination source 201.
  • the phase modulated light is reflected from the PLM and is projected to provide a projected image 107 at a target plane.
  • the wavefront produced by modulating the illumination light may exhibit destructive interference (see block 210 in FIG. 2B) at a target plane, a plane where the projected image is to be viewed.
  • the projected image has dark regions, the waves cancelling out at the target plane to provide black lines (dark regions have lesser or minimum intensity).
  • the wavefront of phase modulated light may have constructive interference, as shown (see block 212 in FIG. 2B) where the waves are in phase and add together to provide white lines in the image at the target plane (bright regions have greater or maximum intensity).
  • FIG. 3 illustrates a single pixel 305 for a MEMS PLM device, for example the MEMS PLM 205 illustrated in FIG. 2A.
  • a micromirror 307 is formed over pistons 308 that move in response to a stored voltage from corresponding storage cells (not shown).
  • the storage cells are located in a semiconductor substrate 310 beneath the micromirror 307.
  • the micromirror 307 may have a surface of aluminum, for example. Aluminum, gold, silver, copper and other metal or dielectric reflective coatings may be used.
  • Storage cells in the semiconductor device formed on the semiconductor substrate 310 beneath the micromirror 307 (not shown) store one or more bits of information.
  • a voltage output from the storage cells drives the pistons 308 to cause the MEMS device to vertically displace the micromirror 307 to one of several positions.
  • the bit depth of the storage cells, and the type of MEMS device for pixel 305 will determine the number of different positions the micromirror may take, and thus determine the resolution the pixel may provide.
  • Quantization noise will result when the pixel 305 is used to phase modulate light, because the micromirror 307 does not move continuously to a range of positions, but instead moves in steps corresponding to levels of the voltage output by the storage cells.
  • a MEMS PLM device which has thousands, hundreds of thousands, or even more micromirror pixel elements arranged in rows and columns, stores patterns in individually addressable storage cells arranged in an array to correspond with the pixels.
  • Bitmap patterns for phase holograms may be loaded into the storage cells from a device controller.
  • the PLM is then updated to display a phase hologram based on the stored pattern.
  • the PLM is used to phase modulate illumination light to produce the projected image to be viewed in the target plane. This operation is repeated for each projected image.
  • Pulse width modulation (PWM) of the illumination source may be used with the PLM to display sub-frame images in a sequence to further improve the projected image, reduce heat in the system, and reduce stress on the pixels.
  • Multiple colors can be used with sub-frame images of differing weight (longer or shorter display times) to produce color projected images by using multiple color illumination sources, for example red, green and blue color sources, to form color projected images.
  • FIG. 4 illustrates in a cross sectional view a liquid crystal on silicon (LCOS) PLM device 405.
  • Liquid crystals 409 are sealed by glue and spacers 421 in a liquid crystal layer 411 between a glass layer 413 and a semiconductor layer 415.
  • An aluminum pixel array layer 417 between the liquid crystal layer 411 and the semiconductor layer 415 has electrodes arranged in rows and columns beneath the liquid crystal layer 411.
  • a phase hologram pattern is stored in an array of addressable storage cells (not shown) in the semiconductor layer 415. Pixels in the aluminum pixel array layer 417 conduct voltages based on the data stored in the storage cells.
  • the liquid crystals 409 twist (or don’t twist) in response to voltages conducted by the pixels in the aluminum pixel array layer 417 from the storage cells in the semiconductor layer 415.
  • a transparent conductive layer 419 of indium- tin-oxide (ITO) provides a light path and forms an electric conductor.
  • the LCOS PLM modulates illumination light by displaying a phase hologram and reflects the modulated light. The modulated light is then projected to form an image in the target plane.
  • FIG. 5 illustrates in a block diagram a detailed view of a PLM projector system 500.
  • illumination source 101 for example a laser
  • Optical element 103 optically couples the laser to an optical steering element 504.
  • Optical steering element 504 is reflective and transmissive.
  • the optical steering element 504 has a surface that is reflective to light that comes from illumination source 101 striking the optical steering element 504 at an acute angle, and that is transmissive to phase modulated light from the PLM 105 which strikes the optical steering element at a different angle.
  • PLM 105 displays phase hologram 102.
  • a polarizer, quarter wave plate 505 receives light from the illumination source 101 and illumination optics (optical element 103) that is reflected by the optical steering element 504.
  • the quarter wave plate 505 By rotating the polarization of the light that is coupled to the pixels of the PLM 105, the quarter wave plate 505 contributes to separating the illumination light to the PLM 105, which traverses the quarter wave plate one time, and from the phase modulated light leaving the PLM, which traverses the quarter wave plate a second time.
  • the phase modulated light traverses the quarter wave plate 505, is transmitted through the optical steering element 504, and is coupled by the projection opticsl06 to project image 107.
  • phase holograms are generated for images to be projected for display on the PLM.
  • Using these phase holograms to modulate the illumination light creates projected images output by the projector system (see 500 in FIG. 5, or 100 in FIG. 1).
  • the intensity images are stored and available to the system, for example, as digital video images.
  • the digital video images may be part of a presentation, movie, television show, game, or streaming video stored as a sequence of digital video images.
  • one prior approach to generating phase information for images is to use the G-S algorithm.
  • the G-S algorithm performs an iterative approach that takes advantage of the fact that a change in either the amplitude or phase in one domain of the Fourier transform, for example a source plane corresponding to where the PLM is located, results in changing both amplitude and phase distributions in the opposite domain of the Fourier transform, for example the target plane where a projected image is shown. Therefore changes in the phase hologram in a source plane (corresponding to where the PLM modulates illumination light) may affect changes in both amplitude and phase in the image at a target plane (where a screen or other display plane receives the projected image).
  • phase hologram for a projected image may be determined, and phase light modulators may produce arbitrary images projected in the target plane. More than one phase hologram may be used to project a given target image.
  • a random phase hologram is used as a starting point in the phase plane. Differences in the random starting phase information may result in different solutions for the phase hologram for a given target image.
  • the G-S algorithm error (a difference between an image generated using the phase information from the algorithm, and the target image) decreases with iterations, and so the algorithm converges.
  • a random initial phase hologram is generated for the first iteration of the algorithm. This can be done using a pseudo-random pattern generator, for example.
  • the phase term e j ⁇ source,k is transformed to a transformed target image by a Fourier transform.
  • the Fourier transform corresponds to the operation of a lens and transmissive paths in a projector from a phase light modulator to the projected image.
  • the resulting expression after the Fourier transform has amplitude and phase .
  • an error threshold comparison may be made using the transformed amplitude or intensity image obtained by the algorithm after the current Mi iteration.
  • the error is determined by comparing the transformed image obtained by the algorithm in the target plane to the goal image. If the error exceeds a selected threshold, the algorithm continues.
  • the G-S algorithm replaces the amplitude in the transformed image term with the amplitude I update .
  • the expression in the target plane is now modified to .
  • the replacement amplitude I Update I goal , so the amplitude term is in the transformed image is updated with the intensity of the goal image, which is the image to be projected.
  • An inverse Fourier transform then returns the updated terms to the source plane, resulting in the expression .
  • the phase term e j ⁇ source,k of this expression now becomes the phase hologram for the M iteration.
  • the index k is incremented, and the algorithm iterates again. In this iteration, the algorithm uses the new phase term e j ⁇ source,k for the phase hologram.
  • the final phase term e j ⁇ source,k is a phase hologram that may be used to project the image in a phase modulation projector system.
  • the G-S algorithm is an optimization algorithm.
  • the amplitude of the image obtained from the algorithm is made to be within an error threshold of the goal image intensity.
  • Noise in the projected image produced by the G-S algorithm is distributed in both the dark and bright regions of the projected image. This noise, which is caused in part by the variable phase with uniform amplitude nature of the source plane information in the G-S optimization, results in reduced contrast in the projected image.
  • high contrast is very advantageous. Improvement in the contrast ratio obtained in the projected image is beneficial, particularly for these applications.
  • FIG. 6 illustrates a sample projected image 650 obtained from a method arrangement for generating phase holograms.
  • noise (variance in intensity) is restricted to the bright regions of the projected images, increasing the contrast ratio.
  • a phase hologram is generated by an algorithm so that in the corresponding projected image, noise is allowed in the bright regions, and at least partially excluded from the dark regions, increasing the darkness of the dark regions, and thus, increasing the contrast in the projected image.
  • the noise that is present in the bright regions of the projected image obtained using the arrangements may be further compensated by displaying multiple phase holograms generated for a projected image by the method in succession. These differing phase holograms result in projected images with differing noise patterns in the bright regions, the noise in the projected images is time averaged so that in the projected images the noise in the bright regions is reduced.
  • FIG. 7 illustrates in a diagram the operation of a phase hologram generation algorithm of the arrangements.
  • the steps of FIG. 7 may be performed by the processing element 111 illustrated in FIG. 1.
  • a phase hologram is in a source plane (the plane where, in a projector, the PLM is located) and an amplitude image is present in a target plane where a screen or display is located.
  • the amplitude image is related to the phase hologram by Fourier transforms.
  • a random initial phase hologram is produced at step 702, expressed as e j ⁇ source,k .
  • the random initial phase hologram may be produced using a pseudo random pattern generator, for example.
  • an iterative algorithm begins.
  • the random initial phase hologram from step 702 is used, while in subsequent iterations, the phase term used is the output from the previous iteration.
  • a Fourier transform is performed on the phase hologram produced in the step 702 (in the first iteration, and the output phase hologram 710 in later iterations).
  • the transformed amplitude and phase expression obtained from the Fourier transform in step 703 is shown as , the corresponding amplitude image 707 is shown.
  • the amplitude term is updated.
  • the expression used to update the amplitude is: where I goal is a binary (0, 1) amplitude image corresponding to the image that is to be projected, the goal image, and b is a weighting factor between 0 and 1.
  • the new amplitude term I Update iS a weighted sum of the goal image amplitude (715) and the Mi target image (shown as 707) output by the algorithm.
  • the term l target,k is the amplitude 707 obtained at 705 for the current iteration in the target plane.
  • the intensity image l goai is a binary (0, 1) amplitude image, so that for dark regions with amplitude 0, the updated intensity I update is always 0; in contrast for regions in the intensity image l goal with amplitude 1, the updated intensity l update is the product of the amplitude of the goal image (1 for bright regions) with the weighted sum of the intensity in the current image obtained from the algorithm and the intensity of the goal image.
  • the algorithm insures that noise is at least partially excluded from dark regions of the projected image in the target plane, while in the bright regions; the weighted sum allows noise to exist. This approach results in higher contrast in the projected images.
  • step 713 the inverse Fourier transform is performed, and this returns the source plane expression with amplitude and phase shown at goal image amplitude 715.
  • step 701 the updated phase term e j ⁇ source,k (710) is used to perform the next iteration, and the integer index k is incremented.
  • the algorithm shown in FIG. 7 generates a phase hologram shown as 710.
  • the phase hologram results in an image in the target plane with noise at least partially excluded from the dark regions, and with noise allowed in the bright regions.
  • the algorithm of FIG. 7 compares the current amplitude image 707 to the goal image amplitude 715, and when the current amplitude image 707 is within an error threshold of the amplitude of the goal image 715, the algorithm is complete. Convergence may take several or even many iterations. By weighting the dark regions heavier in the optimization algorithm, the noise is directed to the bright regions.
  • phase holograms for a single projected image are generated using the algorithm, and these phase holograms are displayed in a sequence to use temporal averaging to reduce the visible noise in the bright regions. Because the noise in the bright regions is random due to the random initial phase holograms used, these multiple projected images will have noise distributed differently in the bright regions, and time averaging of these images may cancel the perceived noise in the visible image.
  • FIG. 8 is a flow diagram that illustrates a method for projecting images using an arrangement. The steps may be performed by the projector system shown in FIG. 1, for example.
  • the phase hologram generation algorithm of FIG. 7 is performed.
  • the algorithm is performed, for example, by processing element 111 shown in FIG. 1.
  • the algorithm generates a phase hologram that, when projected by modulating illumination light at a PLM while displaying the phase hologram, results in a projected image that at least partially excludes noise from the dark regions in the projected image, while noise is permitted in the bright regions.
  • the phase hologram is stored in a memory for later retrieval and use.
  • the phase hologram developed by the algorithm is displayed on the PLM.
  • the phase hologram is obtained, for example, by receiving the phase hologram from the processing element 111 performing step 801, or the phase hologram may be read from memory by the digital PLM controller 109 (see FIG. 1).
  • illumination light is directed onto the PLM while the phase hologram image is displayed.
  • the illumination source see 101 in FIG. 1, for example a laser, provides coherent light to the PLM 105 in FIG. 1.
  • phase modulated light is directed into Fourier optics.
  • projection optics 106 receives the phase modulated light from the PLM 105.
  • the light from the projection optics 106 is projected to the target plane and an image is displayed.
  • a projected image 107 is shown projected by the system 100.
  • the method determines whether additional images are to be displayed, and if the determination is yes, the method returns to step 801 and repeats for each image to be displayed. If the determination is that additional images are not to be displayed, the method ends at block 813.
  • phase hologram generation in step 801 may be done before the rest of the steps of FIG. 8 starting with 803 are performed.
  • the phase holograms are generated offline, and the resulting phase holograms may be stored in a memory to be retrieved by the digital PLM controller 109 in FIG. 1, for example.
  • the phase holograms may then be retrieved for display on the PLM at step 803.
  • digital video images to be projected may be stored, and as the digital video images are retrieved from storage by the digital PLM controller 109, phase holograms may be generated one by one by the processing element 111, as shown at step 801.
  • phase holograms are not unique with respect to the projected images, as described above the algorithm for generating the phase holograms begins with a random initial phase hologram, so that many different phase holograms may be generated that may be used to project a given image.
  • FIG. 9 illustrates in a flow diagram a method for performing the phase hologram generation of step 801 in FIG. 8, and as shown in FIG. 7.
  • the steps of FIG. 9 can be performed by the processing element 111 illustrated in FIG. 1, for example.
  • a random initial phase hologram is generated.
  • the index k is then set to 1.
  • step 903 the iterative algorithm starts by performing a Fourier transform to obtain the transformed amplitude and phase terms .
  • the amplitude of the current image generated by the algorithm is compared to the amplitude of the goal image to be projected in step 905. If an error threshold is met, the algorithm ends at step 912. If the error threshold is not met, the algorithm continues to step 907.
  • the updated amplitude is used with the phase term, and an inverse Fourier transform is performed to return the expression to the source plane, so the expression with amplitude and phase is:
  • step 911 the index k is incremented, and the algorithm returns to step 903, the Fourier transform using the updated phase hologram to begin the next iteration.
  • the algorithm continues iteratively, updating the phase hologram in the source plane, performing Fourier transform on the source plane phase hologram to a transformed phase and amplitude term, and checking the error in the amplitude by comparing to the goal image amplitude and comparing the error to an error threshold, until the error is less than the error threshold.
  • the algorithm ends at step 912, the final phase hologram is ready for use in projecting the goal image.
  • FIG. 10 is a circuit diagram of an example arrangement 1000 phase modulated projection system as described above ( see projector 100 in FIG. 1, for example and the text at paragraphs 0042-0051, and for using the methods of FIGS. 7, 8 and 9.
  • a processing element 111 performs the algorithm shown in FIG. 7 and the steps in the flow diagram of FIG. 9 to generate phase holograms from digital video images received on input digital video input (DVI).
  • the processing element 111 may be controlled by the digital PLM controller 109 using the signal CONTROL.
  • the processing element 111 may store phase holograms in memory 1010 for later retrieval by the digital PLM controller 109.
  • the memory 1010 is optional; in an alternative arrangement the processing element 111 generates the phase holograms and transmits the phase holograms on signal PH to the digital PLM controller 109 on a one by one basis.
  • sources may provide the DVI signal in FIG. 10, such as Internet browsers, stored files in video cards, flash cards, universal serial bus (USB) drives, solid state drives (SSDs), cameras, personal computers, game consoles, smartphones, and camcorders.
  • a processor for example a microprocessor, a mixed signal processor, a digital signal processor (DSP), a microcontroller unit (MCU) or other programmable device executes instructions that cause it to perform the algorithm to implement the processing element 111 and to generate phase holograms.
  • a dedicated integrated circuit such as an application specific integrated circuit (ASIC), field programmable gate array (FPGA), or complex programmable logic device (CPLD) may be used as processing element 111.
  • the processing element 111 outputs the phase holograms as digital bitmap signals “PH” for display on the PLM 105.
  • the processing element 111 is coupled to a digital PLM controller 109, which may be a digital video processing integrated circuit.
  • An analog PLM controller 1107 controls intensity and power of the illumination source 101.
  • the digital PLM controller 109 provides digital data to the PLM 105.
  • the PLM 105 modulates phase of the illumination light that strikes the surface of the PLM, which is reflective, and the analog PLM controller 1107 provides power and analog signals to the PLM 105.
  • the light from the illumination source 101 such as a laser is coupled to the PLM 105 by illumination optics (optical element 103).
  • the reflected phase modulated light for projection leaves the surface of the PLM 105 and travels into the projection optics 106 for projection by the system 1100.
  • the phase light modulator PLM 105 may be an LCOS SLM. PLM 105 may also be implemented using a MEMS PLM device.
  • the PLMs have individually addressable pixels that modulate phase of illumination light, and output the phase modulated light.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Holo Graphy (AREA)

Abstract

L'invention concerne un système de projection (100) qui comprend : une source d'éclairage (101) conçue pour émettre une lumière d'éclairage; un modulateur de lumière de phase (PLM) (105) optiquement couplé à la source d'éclairage, le PLM étant conçu pour : recevoir la lumière d'éclairage; moduler en phase la lumière d'éclairage tout en affichant un hologramme de phase, de façon à produire une lumière modulée; et une optique de projection (106) couplée au PLM, l'optique de projection étant conçue pour recevoir la lumière modulée et pour projeter une image (107) en réponse à la lumière modulée. Une moyenne d'intensité et une variance d'intensité dans des régions lumineuses de l'image projetée sont supérieures à l'intensité moyenne et à la variance d'intensité dans les régions sombres de l'image projetée.
PCT/US2021/020237 2020-03-02 2021-03-01 Projecteur à modulateur d'hologramme en phase WO2021178287A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US202062983790P 2020-03-02 2020-03-02
US62/983,790 2020-03-02
US17/160,060 US20210232093A1 (en) 2020-01-27 2021-01-27 Projector with phase hologram modulator
US17/160,060 2021-01-27

Publications (1)

Publication Number Publication Date
WO2021178287A1 true WO2021178287A1 (fr) 2021-09-10

Family

ID=77612798

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2021/020237 WO2021178287A1 (fr) 2020-03-02 2021-03-01 Projecteur à modulateur d'hologramme en phase

Country Status (1)

Country Link
WO (1) WO2021178287A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010050787A1 (en) * 2000-05-22 2001-12-13 Intelligent Pixels, Inc. Electro-optical component having a reconfigurable phase state
US20020101644A1 (en) * 2000-11-22 2002-08-01 Wenhui Mei Light modulation device and system
US20030194132A1 (en) * 2002-04-10 2003-10-16 Nec Corporation Picture region extraction method and device
US20090002787A1 (en) * 2005-06-15 2009-01-01 Adrian Cable Holographic Display Devices

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010050787A1 (en) * 2000-05-22 2001-12-13 Intelligent Pixels, Inc. Electro-optical component having a reconfigurable phase state
US20020101644A1 (en) * 2000-11-22 2002-08-01 Wenhui Mei Light modulation device and system
US20030194132A1 (en) * 2002-04-10 2003-10-16 Nec Corporation Picture region extraction method and device
US20090002787A1 (en) * 2005-06-15 2009-01-01 Adrian Cable Holographic Display Devices

Similar Documents

Publication Publication Date Title
US20210232093A1 (en) Projector with phase hologram modulator
US11635621B2 (en) 2D/3D holographic display system
US11558590B2 (en) Efficient, dynamic, high contrast lensing with applications to imaging, illumination and projection
CN106415365B (zh) 用于平视显示器的漫射器
CN112154379B (zh) 平视显示器
Damberg et al. High brightness HDR projection using dynamic freeform lensing
JP7203758B2 (ja) 画像を形成するべく光を投影する画像投影システム及び画像投影方法
US10248081B2 (en) Holographic phase and amplitude spatial light modulation
CN111176092B (zh) 全息投影显示设备上的像素映射
US11640138B2 (en) Laser modulation
Collings et al. Real-time phase-only spatial light modulators for 2D holographic display
EP3817377A1 (fr) Dispositif, système et procédé de modulation de la lumière utilisant un modulateur de lumière de phase et un modulateur spatial de lumière
WO2021178287A1 (fr) Projecteur à modulateur d'hologramme en phase
EP3939255B1 (fr) Système de projection et procédé de commande d'un système de projection
Sun et al. Correcting the proximity effect in nanophotonic phased arrays
JP2024512054A (ja) フィールドマッピングを備えた投影システム及び投影システムの駆動方法
US20230400811A1 (en) Hologram profile optimization method, hologram profile generation device, and holographic display device to which hologram profile optimization method is applied
CN116965013A (zh) 投影系统和利用场映射驱动投影系统的方法
US20220137556A1 (en) Operation method for digital hologram implementation device
US20240168435A1 (en) Holographic displays and methods
CN114384781B (zh) 全息投影
Damberg Computational projection display: towards efficient high brightness projection in cinema
AK Patch scanning displays: spatiotemporal enhancement for displays
CN116710853A (zh) 显示设备和方法
KR20030076907A (ko) 빔 프로젝터를 개조하여 고해상도 공간 광 변조기를제조하는 방법 및 이를 이용한 공간 광 변조기

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21765280

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21765280

Country of ref document: EP

Kind code of ref document: A1