EP2593838B1 - 2d/3d holographic display system - Google Patents
2d/3d holographic display system Download PDFInfo
- Publication number
- EP2593838B1 EP2593838B1 EP11735689.9A EP11735689A EP2593838B1 EP 2593838 B1 EP2593838 B1 EP 2593838B1 EP 11735689 A EP11735689 A EP 11735689A EP 2593838 B1 EP2593838 B1 EP 2593838B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- lens
- image
- holographic
- data
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003287 optical effect Effects 0.000 claims description 29
- 238000000034 method Methods 0.000 claims description 27
- 238000001914 filtration Methods 0.000 claims description 3
- 238000004422 calculation algorithm Methods 0.000 description 9
- 239000004973 liquid crystal related substance Substances 0.000 description 9
- 230000008901 benefit Effects 0.000 description 8
- 239000000758 substrate Substances 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 4
- 229910052710 silicon Inorganic materials 0.000 description 4
- 239000010703 silicon Substances 0.000 description 4
- 239000003086 colorant Substances 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 229910052782 aluminium Inorganic materials 0.000 description 2
- XAGFODPZIPBFFR-UHFFFAOYSA-N aluminium Chemical compound [Al] XAGFODPZIPBFFR-UHFFFAOYSA-N 0.000 description 2
- 239000004411 aluminium Substances 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 238000001093 holography Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001010 compromised effect Effects 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 230000001066 destructive effect Effects 0.000 description 1
- 238000010304 firing Methods 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- AMGQUBHHOARCQH-UHFFFAOYSA-N indium;oxotin Chemical compound [In].[Sn]=O AMGQUBHHOARCQH-UHFFFAOYSA-N 0.000 description 1
- 229910021421 monocrystalline silicon Inorganic materials 0.000 description 1
- 238000010845 search algorithm Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/26—Processes or apparatus specially adapted to produce multiple sub- holograms or to obtain images from them, e.g. multicolour technique
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B27/0103—Head-up displays characterised by optical features comprising holographic elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
- G03H1/0891—Processes or apparatus adapted to convert digital holographic data into a hologram
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2202—Reconstruction geometries or arrangements
- G03H1/2205—Reconstruction geometries or arrangements using downstream optical component
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2249—Holobject properties
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2294—Addressing the hologram to an active spatial light modulator
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0127—Head-up displays characterised by optical features comprising devices increasing the depth of field
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
- G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/02—Details of features involved during the holographic process; Replication of holograms without interference recording
- G03H2001/0208—Individual components other than the hologram
- G03H2001/0224—Active addressable light modulator, i.e. Spatial Light Modulator [SLM]
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
- G03H1/0841—Encoding method mapping the synthesized field into a restricted set of values representative of the modulator parameters, e.g. detour phase coding
- G03H2001/085—Kinoform, i.e. phase only encoding wherein the computed field is processed into a distribution of phase differences
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2249—Holobject properties
- G03H2001/2252—Location of the holobject
- G03H2001/2255—Holobject out of Fourier or hologram planes
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2294—Addressing the hologram to an active spatial light modulator
- G03H2001/2297—Addressing the hologram to an active spatial light modulator using frame sequential, e.g. for reducing speckle noise
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2210/00—Object characteristics
- G03H2210/20—2D object
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2210/00—Object characteristics
- G03H2210/30—3D object
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2210/00—Object characteristics
- G03H2210/30—3D object
- G03H2210/33—3D/2D, i.e. the object is formed of stratified 2D planes, e.g. tomographic data
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2210/00—Object characteristics
- G03H2210/40—Synthetic representation, i.e. digital or optical object decomposition
- G03H2210/45—Representation of the decomposed object
- G03H2210/454—Representation of the decomposed object into planes
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2225/00—Active addressable light modulator
- G03H2225/20—Nature, e.g. e-beam addressed
- G03H2225/22—Electrically addressed SLM [EA-SLM]
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2225/00—Active addressable light modulator
- G03H2225/30—Modulation
- G03H2225/32—Phase only
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2225/00—Active addressable light modulator
- G03H2225/52—Reflective modulator
Definitions
- the present invention relates a display system and a method of displaying images.
- Embodiments relate to virtual image display systems and methods, and some embodiments relate to head-up display systems.
- Light scattered from an object contains both amplitude and phase information.
- This amplitude and phase information can be captured on, for example, a photosensitive plate by well known interference techniques to form a hologram comprising interference fringes.
- the hologram may be reconstructed to form an image, or holographic reconstruction, representative of the original object by illuminating the hologram with suitable light.
- Computer-generated holography may numerically simulate the interference process using Fourier techniques.
- a light source 100 which applies light via a Fourier lens (120) onto a spatial light modulator (140) in this case as a generally planar wavefront.
- the spatial light modulator is reflective and consists of an array of a large number of phase-modulating elements.
- Light is reflected by the spatial light modulator and consists of two parts, a first specularly reflected portion (known as the zero order) and a second portion that has been modulated by the phase-modulating elements to form a wavefront of spatially varying phase. Due to the reflection by the spatial light modulator all of the light is reflected generally back towards the light source (100) where it impinges on a mirror with aperture (160) disposed at 45° to the axis of the system.
- All of the image part of the light is reflected by the mirror towards a screen (180) that is generally parallel to the axis of the system. Due to the action of the Fourier lens (120), the light that impinges on the screen (180) forms a real image that is a reconstruction of an image from which the information applied to the phase modulating elements was derived.
- WO2009156752 discloses various holographic systems using Fresnel holography.
- Embodiments relate to an improved 2D real-time projector for forming virtual images of holographic reconstructions and providing adaptive positional control of the virtual image in space, and allow for spatial filtering of the reconstruction.
- a spatial light modulator forms an array of phase-modulating elements that collectively represent a phase-only Fourier transform of a desired image which can be reconstructed by correctly illuminating the SLM, to form a projector.
- the phase-only distribution may be referred to as a hologram.
- the image may be described as the holographic reconstruction.
- the elements of the SLM may be referred to as pixels.
- the holographic reconstruction is imaged by an optical viewing system to form a virtual image.
- the inventor has recognised that by providing variable lensing data to the hologram, the position of the virtual image relative to a viewer can be changed. This can provide a "depth" to the display system and allow virtual images to be presented at different distances from the viewer to provide a pseudo 3D system in real-time.
- the inventor has recognised that by forming an intermediate reconstruction, spatial filtering may be performed to remove higher diffracted orders produced by the hologram. This gives rise to an improved viewing system particular for real-time applications such as head-up displays.
- phase information alone is sufficient to generate a hologram which can give rise to a holographic reconstruction of acceptable quality. That is, the amplitude information in the hologram can be discarded. This can reduce the power of the required laser light sources but has other advantages too. Fourier-based computer generated holographic techniques have therefore been developed using only the phase information.
- the image reconstructed by a hologram is given by the Fourier transform of the hologram.
- the hologram is therefore a phase-only pattern representative of the Fourier transform of the object whereas the reconstructed image (or holographic reconstruction) may contain both amplitude and phase information.
- Gerchberg-Saxton is one example of an iterative algorithm for calculating a phase only hologram from input image data comprising only amplitude information.
- the algorithm starts from a random phase pattern and couples this with amplitude data to form complex data.
- a discrete Fourier transform is performed on the complex data and the resultant dataset is the Fourier components, which are made up of magnitude and phase.
- the magnitude information is set to a uniform value, and the phase is quantised, to match the phase values available.
- An inverse discrete Fourier transform is then performed.
- the result is another complex dataset, where the magnitude information is overwritten by the target image and the process is repeated.
- the Gerchberg-Saxton algorithm therefore iteratively applies spatial and spectral constraints while repeatedly transferring a data set (amplitude and phase), between the spatial domain and the Fourier (spectral) domain.
- Gerchberg-Saxton algorithm and derivatives thereof are often much faster than other "non-Fourier transform" algorithms such as direct binary search algorithms. Modified algorithms based on Gerchberg-Saxton have been developed - see, for example, co-pending published PCT application WO 2007/131650 .
- Embodiments described herein relate to 2D video projection using a computer-generated hologram calculated using such a modified Gerchberg-Saxton algorithm
- Holographically generated 2D video images are known to possess significant advantages over their conventionally projected counterparts, especially in terms of definition and efficiency.
- the computational and hardware complexity of the current hologram generation algorithms preclude their use in real-time applications.
- Recently these problems have been solved - see, for example, published PCT application WO 2005/059881 .
- phase modulating device To display the phase only holographic data, a phase modulating device is required. Since these devices do not modulate the amplitude, they are optically transparent, in general. Therefore no light is lost to absorption, for example. This has the major advantage that all of the reconstruction light is used in the creation of the holographic reconstruction. This translates to a more energy efficient display system.
- the phase modulating device may be pixellated and each pixel will act as a diffractive element.
- the diffraction pattern from each pixel will give rise to a complex interference pattern referred to as a replay field. Due to this complex relationship, each pixel on the hologram contributes to multiple parts of the reconstructed image.
- phase modulating device is a spatial light modulator (SLM).
- SLM spatial light modulator
- a SLM has a field of addressable phase-modulating elements.
- the phase-modulating elements are a linear or one-dimensional array of elements; in others a two dimensional array are provided.
- many SLMs have a regular 2-D array of like, generally square, phase-modulating elements; it is however not necessary for the phase-modulating elements to be alike in size or shape.
- Figure 2 shows an example of using a reflective SLM, such as a LCOS, to produce a holographic reconstruction at a replay field location, to understand the present disclosure.
- a reflective SLM such as a LCOS
- the collimating lens causes a generally planar wavefront of light to become incident on the SLM.
- the direction of the wavefront is slightly off-normal (i.e. two or three degrees away from being truly orthogonal to the plane of the transparent layer).
- the arrangement is such that light from the light source is reflected off a mirrored rear surface of the SLM and interacts with a phase-modulating layer to form an exiting wavefront (212).
- the exiting wavefront (212) is applied to optics including a Fourier transform lens (220), having its focus at a screen (225).
- the Fourier transform lens receives light from the SLM and performs a frequency-space transformation to produce a holographic reconstruction at the screen (225) in the spatial domain.
- the light from the light source is generally evenly distributed across the SLM (240), and across the phase modulating layer.
- Light exiting the phase-modulating layer may be distributed across the screen. There is no correspondence between a specific image region of the screen and any one phase-modulating element.
- Figure 3 there is shown an embodiment in accordance with the present invention using the SLM based system described above.
- Figure 3 shows a head-up display (300) having an SLM based system (305) for providing a real image of a holographic reconstruction (310).
- the holographic reconstruction is formed at a so-called replay field.
- the spatial position of the replay field may be varied in accordance with embodiments described herein.
- the display consists of an optical combiner (320) and a lens (330) disposed between the holographic reconstruction (310) and the combiner (320).
- the arrangement is such that a viewer (340) looking towards the combiner (320) will see a virtual image (350) of the holographic reconstruction (310) at a distance d from the viewer and behind the combiner (320).
- a system can be used for example in a head-up display or head-mounted display.
- the optical system (335) comprises a lens having a focal length f , and located at distance ed from the viewer.
- the holographic reconstruction (310) is at a real distance od behind the lens. If the holographic reconstruction (310) is disposed in the focal plane of the lens (330) then the viewer (340) will perceive the image (350) to be at infinity.
- the holographic reconstruction (310) is closer to the lens (330) than the focal length of the lens (330) the image (350) will no longer be at infinity.
- the holographic reconstruction is closer to the lens (330) than the focal length of the lens then the image (350) can be arranged to appear closer than at infinity, and appear at a virtual distance vd.
- the above-mentioned replay field location may be varied by varying the lensing characteristic of phase only lensing data applied to the spatial light modulator (380).
- the lensing characteristic of phase only lensing data applied to the spatial light modulator (380) For a first lensing characteristic the position of the real image (310) can be relatively close to the lens (330) and for a second value of lensing data the real image 310 is relatively more distant from the lens (330). This means that the image (350) created by the virtual image display can be varied in apparent depth.
- the information that is applied to the phase modulating elements of the SLM (380) consists of two parts, a first part that comprises the information representative of the final image and a second part which has the effect of providing a negative lensing and adjustment characteristic.
- a first part that comprises the information representative of the final image
- a second part which has the effect of providing a negative lensing and adjustment characteristic.
- the SLM must be sufficiently fast to allow information to be electrically written and optically read-out multiple times in a standard video frame. If the sub-frames are displayed sufficiently quickly, they may appear to a human viewer to be present simultaneously.
- a general image can appear to be 2.5 metres from the viewer (340) but a part of the image - for example an image of especial importance to the viewer - can, by providing its imaging data in a different sub-frame and by changing the lensing data for that sub-frame - cause that image to appear in front of the general image plane.
- Figure 4 shows four different subframe image positions, denoted 501, 502, 503 and 504.
- the arrangement of figure 3 should be distinguished from configurations in which the viewer is positioned at the real image (310). Such configurations may be referred to as "direct view”. In such cases, the viewer's eyes are the Fourier lens.
- the present disclosure relates to a virtual image display in which a holographic reconstruction (310) is first formed as a real image in space.
- the real image (310) forms the "object" for lens (330) which produces a virtual image of the real image (310).
- the virtual image may be seen by the viewer by looking through the optical combiner (320) as shown in figure 3 .
- the position of the real image (310) can be changed. Accordingly, the position of the virtual image (350) can also be changed.
- the viewer when the viewer is positioned at the real image (310) the viewer functions as the Fourier lens and so sees all diffracted orders of the reconstruction field. That is, the viewer would see multiple replicas of the primary reconstruction - in order words, multiple reconstructions. The presence of multiple orders may lead to confusion particularly in a head-up display, for example.
- the quality of the reconstructed hologram is also affected by the so-called zero order problem which is a consequence of the diffractive nature of the reconstruction.
- Such zero-order light can be regarded as "noise” and includes for example specularly reflected light, and other light that is undiffracted by the patterns on the spatial light modulator.
- This "noise" is generally focussed at the focal point of the Fourier lens, leading to a bright spot at the centre of a reconstructed hologram. In a direct view application the zero order would be a substantial distraction when looking at the virtual image.
- the intermediate reconstruction by imaging the intermediate reconstruction it is possible to filter out the zero order and the higher diffracted orders of the reconstruction field at the intermediate reconstruction.
- This may be achieved, for example, by positioning a spatial filter at the real image (310) to provide a physical aperture through which only preferred orders such as the primary order can pass.
- the hologram contains three dimensional information, it is possible to displace the reconstruction into a different plane in space - see, for example, published PCT application WO 2007/131649 .
- the application of the present invention includes head up displays and head mounted displays, inter alia.
- the invention allows for full colour holograms with different information at different distances or depths from the viewer, full 3D with a very limited volume by stacking multiple sub-frames, a large number of different images at different distances, perspective tracking of objects and enhance reality, for example a near-eye augmented-reality system with the ability to overlay different information at different depths.
- the spatial light modulator is a Liquid Crystal over silicon (LCOS) device.
- LCOS Liquid Crystal over silicon
- LCOS devices are a hybrid of traditional transmissive liquid crystal display devices, where the front substrate is glass coated with Indium Tin Oxide to act as a common electrical conductor.
- the lower substrate is created using a silicon semiconductor process with an additional final aluminium evaporative process being used to create a mirrored surface, these mirrors then act as the pixel counter electrode.
- LCOS devices are now available with pixels between 4.5 ⁇ m and 12 ⁇ m, this size is determined by the mode of operation and therefore amount of circuitry that is required at each pixel.
- a LCOS device is formed using a single crystal silicon substrate (402). It has a 2D array of square planar aluminium electrodes (401), spaced apart by a gap (401a), arranged on the upper surface of the substrate. Each of the electrodes (401) can be addressed via circuitry (402a) buried in the substrate (402). Each of the electrodes forms a respective planar mirror.
- An alignment layer (403) is disposed on the array of electrodes, and a liquid crystal layer (404) is disposed on the alignment layer (403).
- a second alignment layer (405) is disposed on the liquid crystal layer (404) and a planar transparent layer (406), e.g. of glass, is disposed on the second alignment layer (405).
- a single transparent electrode (407) e.g. of ITO is disposed between the transparent layer (406) and the second alignment layer (405).
- Each of the square electrodes (401) defines, together with the overlying region of the transparent electrode (407) and the intervening liquid crystal material, a controllable phase-modulating element (408), often referred to as a pixel.
- the effective pixel area, or fill factor is the percentage of the total pixel which is optically active, taking into account the space between pixels (401a).
- a major advantage of using a reflective LCOS spatial light modulator is that the liquid crystal layer is half the thickness that it would be if a transmissive device were used. This greatly improves the switching speed of the liquid crystal (a key point for projection of moving video images).
- a LCOS device is also uniquely capable of displaying large arrays of phase only elements in a small aperture. Small elements (typically approximately 10 microns) result in a practical diffraction angle (a few degrees) so that the optical system does not require a very long optical path.
- LCOS SLMs also have a large aperture ratio, there is very little dead space between the pixels (as the circuitry to drive them is buried under the mirrors). This is an important issue to lowering the optical noise in the replay field.
- the above device typically operates within a temperature range of 10°C to around 50°C, with the optimum device operating temperature being around 40°C to 50°C.
- the Fill factor of the pixels is higher, leading to less unscattered light leaving the device.
- Using a silicon backplane has the advantage that the pixels are optically flat, which is important for a phase modulating device.
- a colour 2D holographic reconstruction can be produced and there are two main methods of achieving this.
- One of these methods is known as "frame-sequential colour" (FSC).
- FSC frame-sequential colour
- three lasers are used (red, green and blue) and each laser is fired in succession at the SLM to produce each frame of the video.
- the colours are cycled (red, green, blue, red, green, blue, etc.) at a fast enough rate such that a human viewer sees a polychromatic image from a combination of the three lasers.
- Each hologram is therefore colour specific.
- the first frame would be produced by firing the red laser for 1/75 th of a second, then the green laser would be fired for 1/75 th of a second, and finally the blue laser would be fired for 1/75 th of a second.
- the next frame would then be produced, starting with the red laser, and so on.
- SSC spatially separated colours
- An advantage of the frame-sequential colour (FSC) method is that the whole SLM is used for each colour. This means that the quality of the three colour images produced will not be compromised because all pixels on the SLM are used for each of the colour images.
- a disadvantage of the FSC method is that the overall image produced will not be as bright as a corresponding image produced by the SSC method by a factor of about 3, because each laser is only used for a third of the time. This drawback could potentially be addressed by overdriving the lasers, or by using more powerful lasers, but this would require more power to be used, would involve higher costs and would make the system less compact.
- An advantage of the SSC (spatially separated colours) method is that the image is brighter due to all three lasers being fired at the same time.
- the surface area of the SLM can be divided into three equal parts, acting in effect as three separate SLMs.
- the drawback of this is that the quality of each single-colour image is decreased, due to the decrease of SLM surface area available for each monochromatic image.
- the quality of the polychromatic image is therefore decreased accordingly.
- the decrease of SLM surface area available means that fewer pixels on the SLM can be used, thus reducing the quality of the image.
- the quality of the image is reduced because its resolution is reduced.
- Embodiments implement the technique of "tiling", in which the surface area of the SLM is further divided up into a number of tiles, each of which is set in a phase distribution similar or identical to that of the original tile. Each tile is therefore of a smaller surface area than if the whole allocated area of the SLM were used as one large phase pattern.
- the smaller the number of frequency component in the tile the further apart the reconstructed pixels are separated when the image is produced.
- the image is created within the zeroth diffraction order, and it is preferred that the first and subsequent orders are displaced far enough so as not to overlap with the image and may be blocked by way of a spatial filter.
- the image produced by this method (whether with tiling or without) comprises spots that form image pixels.
- a Fourier transform of an infinite sine wave a single frequency is produced. This is the optimum output. In practice, if just one tile is used, this corresponds to an input of a single phase of a sine wave, with a zero values extending in the positive and negative directions from the end nodes of the sine wave to infinity.
- the principle frequency component is produced with a series of adjacent frequency components on either side of it. The use of tiling reduces the magnitude of these adjacent frequency components and as a direct result of this, less interference (constructive or destructive) occurs between adjacent image pixels, thereby improving the image quality.
- each tile is a whole tile, although it is possible to use fractions of a tile.
- Some examples of a method of displaying images comprises varying lensing data on a spatial light modulator while varying imaging data applied to the spatial light modulator, whereby images of objects may be formed at different depths with regard to an image plane.
- the step of varying data may be carried out in such a way that the plural images formed at different depths appear to the human eye to be simultaneously present.
- Some examples of a method of displaying images comprise applying data for forming an image to a SLM, illuminating the SLM, applying the resultant light to an optical system for forming a virtual image, wherein the data applied to the SLM includes first data and second data, the first data related to the content of the image and the second data determined to provide at least a lensing function by the SLM, the method further comprising varying the second data in such a way that plural images formed at different depths appear to the human eye to be simultaneously present, whereby the plural images may differ from one another.
- a display for example a head-up display, comprise an SLM, circuitry for operating the SLM, an illumination device for illuminating the SLM and an optical system adapted to form a virtual image reconstructed from data on the SLM, wherein the circuitry is adapted to apply data for forming an image to the SLM, the data applied including first data and second data, the first data related to the content of the image and the second data determined to provide a lensing function by the SLM, and the circuitry adapted to vary the second data in such a way that plural images formed at different depths appear to the human eye to be simultaneously present.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Holo Graphy (AREA)
- Diffracting Gratings Or Hologram Optical Elements (AREA)
- Transforming Electric Information Into Light Information (AREA)
Description
- The present invention relates a display system and a method of displaying images. Embodiments relate to virtual image display systems and methods, and some embodiments relate to head-up display systems.
- Light scattered from an object contains both amplitude and phase information. This amplitude and phase information can be captured on, for example, a photosensitive plate by well known interference techniques to form a hologram comprising interference fringes. The hologram may be reconstructed to form an image, or holographic reconstruction, representative of the original object by illuminating the hologram with suitable light.
- Computer-generated holography may numerically simulate the interference process using Fourier techniques.
- It has been proposed to use holographic techniques in a two-dimensional image projector.
- Referring to
Figure 1 , there is shown alight source 100 which applies light via a Fourier lens (120) onto a spatial light modulator (140) in this case as a generally planar wavefront. The spatial light modulator is reflective and consists of an array of a large number of phase-modulating elements. Light is reflected by the spatial light modulator and consists of two parts, a first specularly reflected portion (known as the zero order) and a second portion that has been modulated by the phase-modulating elements to form a wavefront of spatially varying phase. Due to the reflection by the spatial light modulator all of the light is reflected generally back towards the light source (100) where it impinges on a mirror with aperture (160) disposed at 45° to the axis of the system. All of the image part of the light is reflected by the mirror towards a screen (180) that is generally parallel to the axis of the system. Due to the action of the Fourier lens (120), the light that impinges on the screen (180) forms a real image that is a reconstruction of an image from which the information applied to the phase modulating elements was derived. -
WO2009156752 discloses various holographic systems using Fresnel holography. Embodiments relate to an improved 2D real-time projector for forming virtual images of holographic reconstructions and providing adaptive positional control of the virtual image in space, and allow for spatial filtering of the reconstruction. - The invention is defined in the appended independent claims.
- In summary, a spatial light modulator (SLM) forms an array of phase-modulating elements that collectively represent a phase-only Fourier transform of a desired image which can be reconstructed by correctly illuminating the SLM, to form a projector. The phase-only distribution may be referred to as a hologram. The image may be described as the holographic reconstruction. The elements of the SLM may be referred to as pixels.
- The holographic reconstruction is imaged by an optical viewing system to form a virtual image. The inventor has recognised that by providing variable lensing data to the hologram, the position of the virtual image relative to a viewer can be changed. This can provide a "depth" to the display system and allow virtual images to be presented at different distances from the viewer to provide a pseudo 3D system in real-time. In particular, the inventor has recognised that by forming an intermediate reconstruction, spatial filtering may be performed to remove higher diffracted orders produced by the hologram. This gives rise to an improved viewing system particular for real-time applications such as head-up displays.
- Embodiments of the present invention will now be described to the accompanying drawings in which:-
-
Figure 1 shows the basic principle of a conventional holographic image display; -
Figure 2 shows a schematic drawing of an example of a reflective SLM; -
Figure 3 shows a schematic drawing of a display according to the invention; -
Figure 4 shows the effect of varying lensing information at the position of the virtual image. -
Figure 5 shows a schematic drawing of a LCOS SLM device; - In the figures like reference numerals referred to like parts.
- It is found that the phase information alone is sufficient to generate a hologram which can give rise to a holographic reconstruction of acceptable quality. That is, the amplitude information in the hologram can be discarded. This can reduce the power of the required laser light sources but has other advantages too. Fourier-based computer generated holographic techniques have therefore been developed using only the phase information.
- The image reconstructed by a hologram is given by the Fourier transform of the hologram. The hologram is therefore a phase-only pattern representative of the Fourier transform of the object whereas the reconstructed image (or holographic reconstruction) may contain both amplitude and phase information.
- Gerchberg-Saxton is one example of an iterative algorithm for calculating a phase only hologram from input image data comprising only amplitude information. The algorithm starts from a random phase pattern and couples this with amplitude data to form complex data. A discrete Fourier transform is performed on the complex data and the resultant dataset is the Fourier components, which are made up of magnitude and phase. The magnitude information is set to a uniform value, and the phase is quantised, to match the phase values available. An inverse discrete Fourier transform is then performed. The result is another complex dataset, where the magnitude information is overwritten by the target image and the process is repeated. The Gerchberg-Saxton algorithm therefore iteratively applies spatial and spectral constraints while repeatedly transferring a data set (amplitude and phase), between the spatial domain and the Fourier (spectral) domain.
- The Gerchberg-Saxton algorithm and derivatives thereof are often much faster than other "non-Fourier transform" algorithms such as direct binary search algorithms. Modified algorithms based on Gerchberg-Saxton have been developed - see, for example, co-pending published
PCT application WO 2007/131650 - These improved techniques are able to calculate holograms at a sufficient speed that 2D video projection is realised. Embodiments described herein relate to 2D video projection using a computer-generated hologram calculated using such a modified Gerchberg-Saxton algorithm
- Holographically generated 2D video images are known to possess significant advantages over their conventionally projected counterparts, especially in terms of definition and efficiency. However, the computational and hardware complexity of the current hologram generation algorithms preclude their use in real-time applications. Recently these problems have been solved - see, for example, published
PCT application WO 2005/059881 - To display the phase only holographic data, a phase modulating device is required. Since these devices do not modulate the amplitude, they are optically transparent, in general. Therefore no light is lost to absorption, for example. This has the major advantage that all of the reconstruction light is used in the creation of the holographic reconstruction. This translates to a more energy efficient display system.
- The phase modulating device may be pixellated and each pixel will act as a diffractive element. The diffraction pattern from each pixel will give rise to a complex interference pattern referred to as a replay field. Due to this complex relationship, each pixel on the hologram contributes to multiple parts of the reconstructed image.
- An example phase modulating device is a spatial light modulator (SLM). Typically a SLM has a field of addressable phase-modulating elements. In some SLMs the phase-modulating elements are a linear or one-dimensional array of elements; in others a two dimensional array are provided. For simplicity many SLMs have a regular 2-D array of like, generally square, phase-modulating elements; it is however not necessary for the phase-modulating elements to be alike in size or shape.
-
Figure 2 shows an example of using a reflective SLM, such as a LCOS, to produce a holographic reconstruction at a replay field location, to understand the present disclosure. - A light source (210), for example a laser or laser diode, is disposed to illuminate the SLM (240) via a collimating lens (211). The collimating lens causes a generally planar wavefront of light to become incident on the SLM. The direction of the wavefront is slightly off-normal (i.e. two or three degrees away from being truly orthogonal to the plane of the transparent layer). The arrangement is such that light from the light source is reflected off a mirrored rear surface of the SLM and interacts with a phase-modulating layer to form an exiting wavefront (212). The exiting wavefront (212) is applied to optics including a Fourier transform lens (220), having its focus at a screen (225).
- The Fourier transform lens receives light from the SLM and performs a frequency-space transformation to produce a holographic reconstruction at the screen (225) in the spatial domain.
- In this process, the light from the light source is generally evenly distributed across the SLM (240), and across the phase modulating layer. Light exiting the phase-modulating layer may be distributed across the screen. There is no correspondence between a specific image region of the screen and any one phase-modulating element.
- Referring to
Figure 3 , there is shown an embodiment in accordance with the present invention using the SLM based system described above.Figure 3 shows a head-up display (300) having an SLM based system (305) for providing a real image of a holographic reconstruction (310). The holographic reconstruction is formed at a so-called replay field. The spatial position of the replay field may be varied in accordance with embodiments described herein. - The display consists of an optical combiner (320) and a lens (330) disposed between the holographic reconstruction (310) and the combiner (320). The arrangement is such that a viewer (340) looking towards the combiner (320) will see a virtual image (350) of the holographic reconstruction (310) at a distance d from the viewer and behind the combiner (320). Such a system can be used for example in a head-up display or head-mounted display.
- The optical system (335) comprises a lens having a focal length f, and located at distance ed from the viewer. The holographic reconstruction (310) is at a real distance od behind the lens. If the holographic reconstruction (310) is disposed in the focal plane of the lens (330) then the viewer (340) will perceive the image (350) to be at infinity.
- However if the holographic reconstruction (310) is closer to the lens (330) than the focal length of the lens (330) the image (350) will no longer be at infinity.
-
- The above-mentioned replay field location may be varied by varying the lensing characteristic of phase only lensing data applied to the spatial light modulator (380). Thus for a first lensing characteristic the position of the real image (310) can be relatively close to the lens (330) and for a second value of lensing data the
real image 310 is relatively more distant from the lens (330). This means that the image (350) created by the virtual image display can be varied in apparent depth. - In summary the information that is applied to the phase modulating elements of the SLM (380) consists of two parts, a first part that comprises the information representative of the final image and a second part which has the effect of providing a negative lensing and adjustment characteristic. By varying this latter part it is possible to cause the position of the holographic reconstruction and therefore virtual image (350) to be varied.
- By using a sufficiently fast spatial light modulator, an appropriate computational algorithm and by writing data appropriately to the spatial light modulator it is possible to image different sub-frames of data at different apparent depths. The SLM must be sufficiently fast to allow information to be electrically written and optically read-out multiple times in a standard video frame. If the sub-frames are displayed sufficiently quickly, they may appear to a human viewer to be present simultaneously.
- For example a general image can appear to be 2.5 metres from the viewer (340) but a part of the image - for example an image of especial importance to the viewer - can, by providing its imaging data in a different sub-frame and by changing the lensing data for that sub-frame - cause that image to appear in front of the general image plane. This is shown schematically in
Figure 4 which shows four different subframe image positions, denoted 501, 502, 503 and 504. - The arrangement of
figure 3 should be distinguished from configurations in which the viewer is positioned at the real image (310). Such configurations may be referred to as "direct view". In such cases, the viewer's eyes are the Fourier lens. - In summary the present disclosure relates to a virtual image display in which a holographic reconstruction (310) is first formed as a real image in space. The real image (310) forms the "object" for lens (330) which produces a virtual image of the real image (310). The virtual image may be seen by the viewer by looking through the optical combiner (320) as shown in
figure 3 . - By modifying the lensing data applied to the spatial light modulator (380), the position of the real image (310) can be changed. Accordingly, the position of the virtual image (350) can also be changed.
- In contrast, when the viewer is positioned at the real image (310) the viewer functions as the Fourier lens and so sees all diffracted orders of the reconstruction field. That is, the viewer would see multiple replicas of the primary reconstruction - in order words, multiple reconstructions. The presence of multiple orders may lead to confusion particularly in a head-up display, for example.
- Additionally the quality of the reconstructed hologram is also affected by the so-called zero order problem which is a consequence of the diffractive nature of the reconstruction.
- Such zero-order light can be regarded as "noise" and includes for example specularly reflected light, and other light that is undiffracted by the patterns on the spatial light modulator.
- This "noise" is generally focussed at the focal point of the Fourier lens, leading to a bright spot at the centre of a reconstructed hologram. In a direct view application the zero order would be a substantial distraction when looking at the virtual image.
- Advantageously, by imaging the intermediate reconstruction it is possible to filter out the zero order and the higher diffracted orders of the reconstruction field at the intermediate reconstruction. This may be achieved, for example, by positioning a spatial filter at the real image (310) to provide a physical aperture through which only preferred orders such as the primary order can pass.
- Conventionally, the zero order light is simply blocked out however this would clearly mean replacing the bright spot with a dark spot.
- However as the hologram contains three dimensional information, it is possible to displace the reconstruction into a different plane in space - see, for example, published
PCT application WO 2007/131649 - The application of the present invention includes head up displays and head mounted displays, inter alia. The invention allows for full colour holograms with different information at different distances or depths from the viewer, full 3D with a very limited volume by stacking multiple sub-frames, a large number of different images at different distances, perspective tracking of objects and enhance reality, for example a near-eye augmented-reality system with the ability to overlay different information at different depths.
- In embodiments, the spatial light modulator is a Liquid Crystal over silicon (LCOS) device. The image quality is, of course, affected by the number of pixels and the number of possible phase levels per pixel.
- LCOS devices are a hybrid of traditional transmissive liquid crystal display devices, where the front substrate is glass coated with Indium Tin Oxide to act as a common electrical conductor. The lower substrate is created using a silicon semiconductor process with an additional final aluminium evaporative process being used to create a mirrored surface, these mirrors then act as the pixel counter electrode.
- Compared with conventional glass substrates these devices have the advantage that the signal lines, gate lines and transistors are below the mirrored surface, which results in much higher fill factors (typically greater than 90%) and higher resolutions.
- LCOS devices are now available with pixels between 4.5 µm and 12 µm, this size is determined by the mode of operation and therefore amount of circuitry that is required at each pixel.
- The structure of an LCOS device is shown in
Figure 5 . - A LCOS device is formed using a single crystal silicon substrate (402). It has a 2D array of square planar aluminium electrodes (401), spaced apart by a gap (401a), arranged on the upper surface of the substrate. Each of the electrodes (401) can be addressed via circuitry (402a) buried in the substrate (402). Each of the electrodes forms a respective planar mirror. An alignment layer (403) is disposed on the array of electrodes, and a liquid crystal layer (404) is disposed on the alignment layer (403). A second alignment layer (405) is disposed on the liquid crystal layer (404) and a planar transparent layer (406), e.g. of glass, is disposed on the second alignment layer (405). A single transparent electrode (407) e.g. of ITO is disposed between the transparent layer (406) and the second alignment layer (405).
- Each of the square electrodes (401) defines, together with the overlying region of the transparent electrode (407) and the intervening liquid crystal material, a controllable phase-modulating element (408), often referred to as a pixel. The effective pixel area, or fill factor, is the percentage of the total pixel which is optically active, taking into account the space between pixels (401a). By control of the voltage applied to each electrode (401) with respect to the transparent electrode (407), the properties of the liquid crystal material of the respective phase modulating element may be varied, thereby to provide a variable delay to light incident thereon. The effect is to provide phase-only modulation to the wavefront, i.e. no amplitude effect occurs.
- A major advantage of using a reflective LCOS spatial light modulator is that the liquid crystal layer is half the thickness that it would be if a transmissive device were used. This greatly improves the switching speed of the liquid crystal (a key point for projection of moving video images). A LCOS device is also uniquely capable of displaying large arrays of phase only elements in a small aperture. Small elements (typically approximately 10 microns) result in a practical diffraction angle (a few degrees) so that the optical system does not require a very long optical path.
- It is easier to adequately illuminate the small aperture (a few square centimetres) of a LCOS SLM than it would be for the aperture of a larger liquid crystal device. LCOS SLMs also have a large aperture ratio, there is very little dead space between the pixels (as the circuitry to drive them is buried under the mirrors). This is an important issue to lowering the optical noise in the replay field.
- The above device typically operates within a temperature range of 10°C to around 50°C, with the optimum device operating temperature being around 40°C to 50°C.
- As a LCOS device has the control electronics embedded in the silicon backplane, the Fill factor of the pixels is higher, leading to less unscattered light leaving the device.
- Using a silicon backplane has the advantage that the pixels are optically flat, which is important for a phase modulating device.
- A colour 2D holographic reconstruction can be produced and there are two main methods of achieving this. One of these methods is known as "frame-sequential colour" (FSC). In an FSC system, three lasers are used (red, green and blue) and each laser is fired in succession at the SLM to produce each frame of the video. The colours are cycled (red, green, blue, red, green, blue, etc.) at a fast enough rate such that a human viewer sees a polychromatic image from a combination of the three lasers. Each hologram is therefore colour specific. For example, in a video at 25 frames per second, the first frame would be produced by firing the red laser for 1/75th of a second, then the green laser would be fired for 1/75th of a second, and finally the blue laser would be fired for 1/75th of a second. The next frame would then be produced, starting with the red laser, and so on.
- An alternative method, that will be referred to as "spatially separated colours" (SSC) involves all three lasers being fired at the same time, but taking different optical paths, e.g. each using a different SLM, and then combining to form the colour image.
- An advantage of the frame-sequential colour (FSC) method is that the whole SLM is used for each colour. This means that the quality of the three colour images produced will not be compromised because all pixels on the SLM are used for each of the colour images. However, a disadvantage of the FSC method is that the overall image produced will not be as bright as a corresponding image produced by the SSC method by a factor of about 3, because each laser is only used for a third of the time. This drawback could potentially be addressed by overdriving the lasers, or by using more powerful lasers, but this would require more power to be used, would involve higher costs and would make the system less compact.
- An advantage of the SSC (spatially separated colours) method is that the image is brighter due to all three lasers being fired at the same time. However, if due to space limitations it is required to use only one SLM, the surface area of the SLM can be divided into three equal parts, acting in effect as three separate SLMs. The drawback of this is that the quality of each single-colour image is decreased, due to the decrease of SLM surface area available for each monochromatic image. The quality of the polychromatic image is therefore decreased accordingly. The decrease of SLM surface area available means that fewer pixels on the SLM can be used, thus reducing the quality of the image. The quality of the image is reduced because its resolution is reduced.
- Embodiments implement the technique of "tiling", in which the surface area of the SLM is further divided up into a number of tiles, each of which is set in a phase distribution similar or identical to that of the original tile. Each tile is therefore of a smaller surface area than if the whole allocated area of the SLM were used as one large phase pattern. The smaller the number of frequency component in the tile, the further apart the reconstructed pixels are separated when the image is produced. The image is created within the zeroth diffraction order, and it is preferred that the first and subsequent orders are displaced far enough so as not to overlap with the image and may be blocked by way of a spatial filter.
- As mentioned above, the image produced by this method (whether with tiling or without) comprises spots that form image pixels. The higher the number of tiles used, the smaller these spots become. If one takes the example of a Fourier transform of an infinite sine wave, a single frequency is produced. This is the optimum output. In practice, if just one tile is used, this corresponds to an input of a single phase of a sine wave, with a zero values extending in the positive and negative directions from the end nodes of the sine wave to infinity. Instead of a single frequency being produced from its Fourier transform, the principle frequency component is produced with a series of adjacent frequency components on either side of it. The use of tiling reduces the magnitude of these adjacent frequency components and as a direct result of this, less interference (constructive or destructive) occurs between adjacent image pixels, thereby improving the image quality.
- Preferably, each tile is a whole tile, although it is possible to use fractions of a tile.
- Some examples of a method of displaying images comprises varying lensing data on a spatial light modulator while varying imaging data applied to the spatial light modulator, whereby images of objects may be formed at different depths with regard to an image plane.
- The step of varying data may be carried out in such a way that the plural images formed at different depths appear to the human eye to be simultaneously present.
- Some examples of a method of displaying images comprise applying data for forming an image to a SLM, illuminating the SLM, applying the resultant light to an optical system for forming a virtual image, wherein the data applied to the SLM includes first data and second data, the first data related to the content of the image and the second data determined to provide at least a lensing function by the SLM, the method further comprising varying the second data in such a way that plural images formed at different depths appear to the human eye to be simultaneously present, whereby the plural images may differ from one another.
- Some examples of a display, for example a head-up display, comprise an SLM, circuitry for operating the SLM, an illumination device for illuminating the SLM and an optical system adapted to form a virtual image reconstructed from data on the SLM, wherein the circuitry is adapted to apply data for forming an image to the SLM, the data applied including first data and second data, the first data related to the content of the image and the second data determined to provide a lensing function by the SLM, and the circuitry adapted to vary the second data in such a way that plural images formed at different depths appear to the human eye to be simultaneously present.
Claims (13)
- A display system comprising an optical system (300), and a processing system,
the processing system arranged to:combine, to produce first holographic data, first Fourier domain data representative of a first 2D image with first phase-only data representative of a first numerical lens; andprovide the first holographic data to a spatial light modulator (380);the optical system (300) comprising,the spatial light modulator (380) arranged to display the first holographic data received from the processing system;a light source arranged to illuminate the spatial light modulator to form spatially modulated light in accordance with the first holographic data;a Fourier transform lens arranged to Fourier transform the spatially modulated light to produce, in the spatial domain, a first real 2D holographic reconstruction image (310) corresponding to the first holographic data at a first replay field location; anda viewing system arranged to produce a first virtual image (350) of the first real 2D holographic reconstruction image, wherein the viewing system comprises:an optical combiner (320), anda viewing lens (330) disposed between the first replay field location and the optical combiner (320),wherein the processing system is arranged to vary a lensing characteristic of the first phase-only data representative of the first numerical lens to thereby cause a change in the first replay field location along the optical axis and wherein the viewing lens (330) and the lensing characteristic of the first phase only data representative of the first numerical lens are arranged such that the distance between the first real 2D holographic reconstruction image and the viewing lens (330) is less than the focal length of the viewing lens (330), whereby the viewing lens (330) forms a first virtual image of the first real 2D holographic reconstruction image and said first virtual image is perceivable through the combiner. - A display system according to claim 1, wherein the processing system is arranged to:combine, to produce second holographic data, second Fourier domain data representative of a second 2D image with second phase-only data representative of a second numerical lens, andprovide the second holographic data to the optical system to produce, in the spatial domain, a second real 2D holographic reconstruction image at a second replay field location, wherein the optical power of the second numerical lens and the optical power of the first numerical lens differ such that the first and second replay field locations are spatially displaced relative to each other along the optical axis.
- A display system according to claim 1, wherein the spatial light modulator (380) comprises an array of pixellated diffractive elements.
- A display system according to claim 2, wherein the first virtual image (350) and a second virtual image of the second real 2D holographic reconstruction image appear to a viewer to be simultaneously present.
- A display system according to any preceding claim, wherein the spatial light modulator (380) is a reflective LCOS spatial light modulator.
- A display system according to any preceding claim, wherein the optical power of the first numerical lens is controllable by a user.
- A display system according to any preceding claim, wherein the display comprises a head up display.
- A display system according to any preceding claim, further comprising a spatial filter configured to selectively block at least one diffraction order of the first real 2D holographic reconstruction image and, optionally, the zero order.
- A display system according to claim 2, wherein the first and second 2D images are sequential frames of a 2D video.
- A display system according to claim 3, wherein the pixellated array consists of pixels having a diameter less than 15µm.
- A method of displaying images comprising,
combining, to produce first holographic data, first Fourier domain data representative of a first 2D image and first phase-only data representative of a first numerical lens;
writing the first holographic data to a spatial light modulator (380); illuminating the spatial light modulator (380) to spatially modulate light in accordance with the first holographic data;
applying the spatially modulated light to an optical system comprising a Fourier transform lens;
performing, using the Fourier transform lens, an optical Fourier transform of the spatially modulated light to produce, in the spatial domain, a first real 2D holographic reconstruction image (310) corresponding to the first holographic data at a first replay field location;
varying a lensing characteristic of the first phase-only data representative of the first numerical lens to cause a change of the first replay field location along the optical axis; and
forming a first virtual image (350) of the first real 2D holographic reconstruction image using a viewing system, wherein the viewing system comprises an optical combiner (320) and a viewing lens (330) disposed between the first replay field location and the optical combiner (320) and wherein the viewing lens (330) and the lensing characteristic of the first phase only data representative of the first numerical lens are arranged such that the distance between the first real 2D holographic reconstruction image and the viewing lens (330) is less than the focal length of the viewing lens (330), whereby the viewing lens (330) forms a first virtual image of the first real 2D holographic reconstruction image and said first virtual image is perceivable through the combiner. - A method of displaying images as claimed in claim 11, further comprising:combining, to produce second holographic data, second Fourier domain data representative of a second 2D image and second phase-only data representative of a second numerical lens;writing the second holographic data to the spatial light modulator;illuminating the spatial light modulator to spatially modulate light in accordance with the second holographic data; andapplying the spatially modulated light to the optical system, therebyperforming a Fourier transform of the spatially modulated light to produce, in the spatial domain, a second real 2D holographic reconstruction image corresponding to the second holographic data at a second replay field location, wherein the optical power of the first numerical lens and the optical power of the second numerical lens differ such that the first and second replay field locations are spatially displaced relative to each other along the optical axis.
- A method according to claim 11, further comprising spatially filtering the resultant light from the spatial light modulator (350) to selectively block at least one diffraction order of the first real 2D holographic reconstruction image.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GBGB1011829.7A GB201011829D0 (en) | 2010-07-14 | 2010-07-14 | Display system |
PCT/GB2011/051328 WO2012007762A1 (en) | 2010-07-14 | 2011-07-14 | 2d/3d holographic display system |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2593838A1 EP2593838A1 (en) | 2013-05-22 |
EP2593838B1 true EP2593838B1 (en) | 2018-07-04 |
Family
ID=42734922
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP11735689.9A Active EP2593838B1 (en) | 2010-07-14 | 2011-07-14 | 2d/3d holographic display system |
Country Status (5)
Country | Link |
---|---|
US (3) | US9715215B2 (en) |
EP (1) | EP2593838B1 (en) |
JP (2) | JP6154321B2 (en) |
GB (2) | GB201011829D0 (en) |
WO (1) | WO2012007762A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2604890A (en) * | 2021-03-17 | 2022-09-21 | Envisics Ltd | Image projection |
Families Citing this family (106)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB201011829D0 (en) | 2010-07-14 | 2010-09-01 | Two Trees Photonics Ltd | Display system |
GB2498170B (en) | 2011-10-26 | 2014-01-08 | Two Trees Photonics Ltd | Frame inheritance |
GB2499579B (en) | 2012-02-07 | 2014-11-26 | Two Trees Photonics Ltd | Lighting device |
GB2501112B (en) | 2012-04-12 | 2014-04-16 | Two Trees Photonics Ltd | Phase retrieval |
JP6323676B2 (en) * | 2012-11-08 | 2018-05-16 | パナソニックIpマネジメント株式会社 | Display device using computer generated hologram |
GB2509180B (en) * | 2012-12-21 | 2015-04-08 | Two Trees Photonics Ltd | Projector |
GB2515460B (en) * | 2013-04-12 | 2016-01-06 | Two Trees Photonics Ltd | Near-eye device |
US20160202488A1 (en) * | 2013-08-06 | 2016-07-14 | Bae Systems Plc | Display system |
GB201314029D0 (en) * | 2013-08-06 | 2013-09-18 | Bae Systems Plc | Display system |
EP2835679A1 (en) * | 2013-08-06 | 2015-02-11 | BAE Systems PLC | Display system |
EP3657265B1 (en) * | 2013-09-04 | 2023-05-03 | Essilor International | Method for augmented reality using head-mounted holographic image displaying device |
JP6068303B2 (en) * | 2013-09-17 | 2017-01-25 | アルプス電気株式会社 | Image projection device |
CA2884903C (en) * | 2013-10-20 | 2015-09-22 | Gerwin Damberg | Light field projectors and methods |
WO2015064497A1 (en) * | 2013-10-31 | 2015-05-07 | アルプス電気株式会社 | In-vehicle projection device |
JP6087788B2 (en) * | 2013-10-31 | 2017-03-01 | アルプス電気株式会社 | In-vehicle projector |
WO2015172236A1 (en) | 2014-05-15 | 2015-11-19 | Mtt Innovation Incorporated | Optimizing drive schemes for multiple projector systems |
GB2526158B (en) * | 2014-05-16 | 2017-12-20 | Two Trees Photonics Ltd | Imaging device for moving a virtual image |
GB2526159B (en) * | 2014-05-16 | 2017-12-20 | Two Trees Photonics Ltd | Diffuser for head-up display |
TWI578119B (en) * | 2014-12-15 | 2017-04-11 | 國立交通大學 | Image display device |
FR3033904B1 (en) * | 2015-03-17 | 2018-04-27 | Valeo Comfort And Driving Assistance | HEAD DISPLAY DEVICE, IN PARTICULAR FOR A MOTOR VEHICLE |
JP2016176996A (en) * | 2015-03-18 | 2016-10-06 | アルプス電気株式会社 | Image projection device |
JP2016177196A (en) * | 2015-03-20 | 2016-10-06 | アルプス電気株式会社 | Image display device |
US10571862B1 (en) | 2015-05-21 | 2020-02-25 | Real View Imaging Ltd. | Producing a computer generated holographic image |
US9798147B1 (en) | 2015-05-28 | 2017-10-24 | Verily Life Sciences Llc | Near-eye display with phase map |
US9810910B1 (en) | 2015-05-28 | 2017-11-07 | Verily Life Sciences Llc | Contact lens with phase map display |
WO2017035053A1 (en) * | 2015-08-24 | 2017-03-02 | Finisar Corporation | Image projection system |
JP6793297B2 (en) * | 2015-10-05 | 2020-12-02 | パナソニックIpマネジメント株式会社 | Projection type image display device |
WO2017074951A1 (en) | 2015-10-26 | 2017-05-04 | Reald Inc. | Intelligent privacy system, apparatus, and method thereof |
JP6607489B2 (en) * | 2015-10-26 | 2019-11-20 | 国立研究開発法人情報通信研究機構 | Hologram data generation device and program thereof |
US10802440B2 (en) | 2015-12-30 | 2020-10-13 | Dualitas Ltd. | Dynamic holography non-scanning printing device |
US10092177B1 (en) * | 2015-12-30 | 2018-10-09 | Verily Life Sciences Llc | Device, system and method for image display with a programmable phase map |
KR102047545B1 (en) | 2015-12-30 | 2019-11-21 | 듀얼리타스 리미티드 | Dynamic Holography Focus-Depth Printing Equipment |
WO2017115081A1 (en) | 2015-12-30 | 2017-07-06 | Daqri Holographics Ltd | Near eye dynamic holography |
US10795316B2 (en) | 2016-02-22 | 2020-10-06 | Real View Imaging Ltd. | Wide field of view hybrid holographic display |
WO2017145158A1 (en) | 2016-02-22 | 2017-08-31 | Real View Imaging Ltd. | Zero order blocking and diverging for holographic imaging |
US11663937B2 (en) | 2016-02-22 | 2023-05-30 | Real View Imaging Ltd. | Pupil tracking in an image display system |
US10788791B2 (en) | 2016-02-22 | 2020-09-29 | Real View Imaging Ltd. | Method and system for displaying holographic images within a real object |
GB2547929B (en) | 2016-03-03 | 2018-02-21 | Daqri Holographics Ltd | Display system |
GB2547926B (en) | 2016-03-03 | 2020-04-29 | Dualitas Ltd | Display system |
EP3458897A4 (en) * | 2016-05-19 | 2019-11-06 | RealD Spark, LLC | Wide angle imaging directional backlights |
JP6676782B2 (en) | 2016-12-15 | 2020-04-08 | アルプスアルパイン株式会社 | Image display device |
KR101921798B1 (en) * | 2016-12-26 | 2018-11-26 | 경북대학교 산학협력단 | Apparatus for generating 3-dimensional picture |
US10317674B2 (en) * | 2017-01-31 | 2019-06-11 | City University Of Hong Kong | Augmented reality systems and methods |
US20200195895A1 (en) * | 2017-03-17 | 2020-06-18 | Compound Photonics Limited | Imaging systems and methods |
CN106896506B (en) | 2017-04-28 | 2019-07-26 | 京东方科技集团股份有限公司 | A kind of head-up display, head-up display method and vehicle |
US10126575B1 (en) | 2017-05-08 | 2018-11-13 | Reald Spark, Llc | Optical stack for privacy display |
CN110785694B (en) | 2017-05-08 | 2023-06-23 | 瑞尔D斯帕克有限责任公司 | Optical stack for directional display |
US10347030B2 (en) | 2017-05-15 | 2019-07-09 | Envisics Ltd | Adjusting depth of augmented reality content on a heads up display |
JP2020521170A (en) * | 2017-05-19 | 2020-07-16 | シーリアル テクノロジーズ ソシエテ アノニムSeereal Technologies S.A. | Display device with light guide |
JP2018197844A (en) * | 2017-05-23 | 2018-12-13 | ヘ−ヨン・チョイ | Apparatus for spatially separated images |
CN109031676B (en) * | 2017-06-08 | 2020-05-26 | 京东方科技集团股份有限公司 | Projection device, head-up display equipment and vehicle-mounted vision auxiliary system |
GB2563873B (en) * | 2017-06-28 | 2022-03-02 | Yang Fan | Holographic image display apparatus |
GB2567408B (en) | 2017-08-02 | 2020-12-02 | Dualitas Ltd | Holographic projector |
US11231583B2 (en) * | 2017-08-02 | 2022-01-25 | Envisics Ltd. | Display device and system |
GB2568021B (en) | 2017-09-08 | 2021-12-01 | Dualitas Ltd | Holographic projector |
TW201921060A (en) | 2017-09-15 | 2019-06-01 | 美商瑞爾D斯帕克有限責任公司 | Optical stack for switchable directional display |
US10948648B2 (en) | 2017-09-29 | 2021-03-16 | Reald Spark, Llc | Backlights having stacked waveguide and optical components with different coefficients of friction |
EP3707554B1 (en) | 2017-11-06 | 2023-09-13 | RealD Spark, LLC | Privacy display apparatus |
CN111448503A (en) | 2017-12-07 | 2020-07-24 | 视瑞尔技术公司 | Head-up display |
WO2019116526A1 (en) * | 2017-12-15 | 2019-06-20 | 日本電気株式会社 | Projection device, interface device, and projection method |
KR102455583B1 (en) * | 2017-12-29 | 2022-10-17 | 엘지디스플레이 주식회사 | Stereoscopic Display apparatus |
WO2019143729A1 (en) | 2018-01-16 | 2019-07-25 | Pacific Light & Hologram, Inc. | Three-dimensional displays using electromagnetic field computations |
CN111919162B (en) | 2018-01-25 | 2024-05-24 | 瑞尔D斯帕克有限责任公司 | Touch screen for privacy display |
JP7291444B2 (en) | 2018-01-25 | 2023-06-15 | リアルディー スパーク エルエルシー | Display device and viewing angle control optical element |
JP7495027B2 (en) | 2018-03-22 | 2024-06-04 | リアルディー スパーク エルエルシー | Optical waveguide, backlight device and display device |
MX2020008973A (en) * | 2018-04-02 | 2020-10-05 | Dolby Laboratories Licensing Corp | Systems and methods for digital laser projection with increased contrast using fourier filter. |
EP3567419A1 (en) * | 2018-05-11 | 2019-11-13 | Essilor International (Compagnie Generale D'optique) | A system for generating a virtual image for a wearer |
JP7026325B2 (en) * | 2018-06-21 | 2022-02-28 | パナソニックIpマネジメント株式会社 | Video display system, video display method, program, and mobile |
EP3814680A4 (en) | 2018-06-29 | 2022-05-04 | RealD Spark, LLC | Optical stack for privacy display |
US11073735B2 (en) | 2018-07-18 | 2021-07-27 | Reald Spark, Llc | Optical stack for switchable directional display |
GB2569208B (en) | 2018-07-19 | 2019-12-04 | Envisics Ltd | A head-up display |
GB2580012A (en) | 2018-09-28 | 2020-07-15 | Envisics Ltd | Head-up display |
WO2020072643A1 (en) | 2018-10-03 | 2020-04-09 | Reald Spark, Llc | Privacy display control apparatus |
CN117311038A (en) | 2018-11-07 | 2023-12-29 | 瑞尔D斯帕克有限责任公司 | Directional display device |
GB2578785C (en) | 2018-11-09 | 2023-08-09 | Dualitas Ltd | Pixel mapping onto a display device for holographic projection |
GB2580298B (en) | 2018-11-12 | 2021-08-11 | Dualitas Ltd | A spatial light modulator for holographic projection |
GB2579234B (en) | 2018-11-27 | 2023-07-19 | Dualitas Ltd | Hologram calculation |
US11287677B2 (en) | 2019-01-07 | 2022-03-29 | Reald Spark, Llc | Optical stack for privacy display |
GB2580696B (en) | 2019-01-25 | 2022-04-27 | Dualitas Ltd | A method for a holographic projector |
WO2020167680A1 (en) | 2019-02-12 | 2020-08-20 | Reald Spark, Llc | Diffuser for privacy display |
JP7486822B2 (en) * | 2019-02-12 | 2024-05-20 | シーワイ・ビジョン・インコーポレイテッド | Holographic head-up display device |
GB2580441B (en) | 2019-03-14 | 2022-03-16 | Dualitas Ltd | Laser modulation |
GB2582370B (en) | 2019-03-22 | 2022-11-02 | Dualitas Ltd | Holographic projector |
GB2582965B (en) | 2019-04-11 | 2021-09-15 | Dualitas Ltd | A diffuser assembly |
GB2583483B (en) * | 2019-04-29 | 2021-05-19 | Envisics Ltd | Image capture and display system |
TW202102883A (en) | 2019-07-02 | 2021-01-16 | 美商瑞爾D斯帕克有限責任公司 | Directional display apparatus |
WO2021026018A1 (en) | 2019-08-02 | 2021-02-11 | Reald Spark, Llc | Optical stack for privacy display |
GB2586511B (en) | 2019-08-23 | 2021-12-01 | Dualitas Ltd | Holographic projector |
GB2586512B (en) | 2019-08-23 | 2021-12-08 | Dualitas Ltd | Holographic projection |
KR20210030072A (en) * | 2019-09-09 | 2021-03-17 | 삼성전자주식회사 | Multi-image display apparatus using holographic projection |
GB2578523B (en) | 2019-09-25 | 2021-08-11 | Dualitas Ltd | Holographic projection |
GB2587400B (en) | 2019-09-27 | 2022-02-16 | Dualitas Ltd | Hologram display using a liquid crystal display device |
KR20220074941A (en) | 2019-10-02 | 2022-06-03 | 리얼디 스파크, 엘엘씨 | privacy display device |
EP4058830A4 (en) | 2019-11-13 | 2024-01-24 | RealD Spark, LLC | Display device with uniform off-axis luminance reduction |
EP4073560A4 (en) | 2019-12-10 | 2024-02-21 | RealD Spark, LLC | Control of reflections of a display device |
US11191146B2 (en) | 2019-12-18 | 2021-11-30 | Reald Spark, Llc | Control of ambient light for a privacy display |
WO2021222606A1 (en) | 2020-04-30 | 2021-11-04 | Reald Spark, Llc | Directional display apparatus |
EP4143631A4 (en) | 2020-04-30 | 2024-05-29 | RealD Spark, LLC | Directional display apparatus |
EP4143632A1 (en) | 2020-04-30 | 2023-03-08 | RealD Spark, LLC | Directional display apparatus |
CN116209945A (en) | 2020-07-29 | 2023-06-02 | 瑞尔D斯帕克有限责任公司 | Backlight for switchable directional display |
TW202204818A (en) | 2020-07-29 | 2022-02-01 | 美商瑞爾D斯帕克有限責任公司 | Pupillated illumination apparatus |
CN113703166A (en) * | 2021-07-30 | 2021-11-26 | 的卢技术有限公司 | AR-HUD method and system through diffraction holographic imaging |
US11892717B2 (en) | 2021-09-30 | 2024-02-06 | Reald Spark, Llc | Marks for privacy display |
WO2023154217A1 (en) | 2022-02-09 | 2023-08-17 | Reald Spark, Llc | Observer-tracked privacy display |
US11892718B2 (en) | 2022-04-07 | 2024-02-06 | Reald Spark, Llc | Directional display apparatus |
WO2024004739A1 (en) * | 2022-06-28 | 2024-01-04 | ソニーグループ株式会社 | Information processing device, information processing method, and computer-readable non-transitory storage medium |
Family Cites Families (46)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4275454A (en) | 1978-12-01 | 1981-06-23 | Environmental Research Institute Of Michigan | Optical system phase error compensator |
JP2868369B2 (en) | 1992-07-08 | 1999-03-10 | シャープ株式会社 | Writing method of programmable optical element and hologram optical element and software development support device |
JP3798511B2 (en) * | 1997-06-11 | 2006-07-19 | 浜松ホトニクス株式会社 | Computer generated hologram display |
US7127109B1 (en) * | 1999-09-27 | 2006-10-24 | University Of South Florida | Digital interference holographic microscope and methods |
WO2001035155A1 (en) | 1999-11-08 | 2001-05-17 | Wavefront Analysis Inc. | System and method for recovering phase information of a wave front |
US6545790B2 (en) | 1999-11-08 | 2003-04-08 | Ralph W. Gerchberg | System and method for recovering phase information of a wave front |
US20010050787A1 (en) | 2000-05-22 | 2001-12-13 | Intelligent Pixels, Inc. | Electro-optical component having a reconfigurable phase state |
GB0027103D0 (en) | 2000-11-07 | 2000-12-20 | Secr Defence | Improved 3D display |
CN100527018C (en) | 2001-07-26 | 2009-08-12 | 特萨斯克里伯斯有限公司 | Methods for calculating mutilayer holograms, method for producing multilayer holograms and storage medium comprising a multilayer hologram |
US20050041271A1 (en) | 2002-01-16 | 2005-02-24 | Ito Tomoyoshi | Moving image holography reproducing device and color moving image holography reproducing device |
US6961159B2 (en) | 2002-08-02 | 2005-11-01 | Dai Nippon Printing Co, Ltd. | Holographic viewing device, and computer-generated hologram for the same |
FR2857454B1 (en) | 2003-07-08 | 2006-08-11 | Aventis Pasteur | DOSAGE OF TECHIC ACIDS OF BACTERIA GRAM + |
GB0329012D0 (en) | 2003-12-15 | 2004-01-14 | Univ Cambridge Tech | Hologram viewing device |
JP4497912B2 (en) * | 2003-12-17 | 2010-07-07 | 富士フイルム株式会社 | Camera and zoom control method of camera |
JP2005181854A (en) | 2003-12-22 | 2005-07-07 | Sanyo Electric Co Ltd | Method for generating computer hologram |
JP3760943B2 (en) | 2004-01-20 | 2006-03-29 | コニカミノルタフォトイメージング株式会社 | Imaging apparatus and moving image noise processing method |
US7227611B2 (en) | 2004-08-23 | 2007-06-05 | The Boeing Company | Adaptive and interactive scene illumination |
JP2006301020A (en) | 2005-04-15 | 2006-11-02 | Ricoh Co Ltd | Stereoscopic image display device, telephone call system equipped therewith and mobile object for transportation |
JP4747296B2 (en) * | 2005-06-15 | 2011-08-17 | 国立大学法人九州工業大学 | How to visualize occluded space |
GB0512179D0 (en) * | 2005-06-15 | 2005-07-20 | Light Blue Optics Ltd | Holographic dispaly devices |
GB0525336D0 (en) | 2005-12-13 | 2006-01-18 | Univ Cambridge Tech | Hologram viewing device |
GB2436676B (en) | 2006-03-28 | 2008-02-20 | Light Blue Optics Ltd | Holographic display devices |
GB2438026A (en) | 2006-05-11 | 2007-11-14 | Univ Cambridge Tech | Phase retrevial in hologram generation using amplitude and phase feedback |
GB2438458A (en) | 2006-05-11 | 2007-11-28 | Univ Cambridge Tech | Blocking zero-order light in phase shift hologram generation |
US8121724B2 (en) | 2006-05-12 | 2012-02-21 | Murata Kikai Kabushiki Kaisha | Transfer system, and transfer method |
DE102006043402B4 (en) | 2006-09-15 | 2019-05-09 | Osram Gmbh | Lighting unit with an optical element |
US20080106653A1 (en) | 2006-11-06 | 2008-05-08 | Harris Scott C | Spatial Light Modulator Techniques for Stage Lighting |
DE102006055480A1 (en) * | 2006-11-24 | 2008-05-29 | Bayer Innovation Gmbh | Coding method, decoding method, codec and data carrier for holographic storage |
DE102007007162A1 (en) | 2007-02-09 | 2008-08-14 | GM Global Technology Operations, Inc., Detroit | Holographic information display |
GB2446852B (en) | 2007-02-12 | 2009-12-09 | Light Blue Optics Ltd | Data communication and processing system |
US20080198372A1 (en) | 2007-02-21 | 2008-08-21 | Spatial Photonics, Inc. | Vehicle headlight with image display |
GB2448132B (en) | 2007-03-30 | 2012-10-10 | Light Blue Optics Ltd | Optical Systems |
DE102007052643B4 (en) | 2007-11-05 | 2016-02-04 | Ivoclar Vivadent Ag | Light measuring device |
GB2456170B (en) * | 2008-01-07 | 2012-11-21 | Light Blue Optics Ltd | Holographic image display systems |
GB2461294B (en) * | 2008-06-26 | 2011-04-06 | Light Blue Optics Ltd | Holographic image display systems |
JP5047090B2 (en) * | 2008-07-31 | 2012-10-10 | キヤノン株式会社 | system |
KR101497511B1 (en) * | 2008-09-19 | 2015-03-02 | 삼성전자주식회사 | APPARATUS FOR MULTIPLEXING 2 DIMENSIONAL and 3 DIMENSIONAL IMAGE AND VIDEO |
JP2010079121A (en) * | 2008-09-29 | 2010-04-08 | Brother Ind Ltd | See-through display |
GB0907965D0 (en) | 2009-05-08 | 2009-06-24 | King S College London | Imaging system |
WO2011121130A2 (en) | 2010-04-01 | 2011-10-06 | Seereal Technologies S.A. | Method and device for encoding three-dimensional scenes which include transparent objects in a holographic system |
GB201011829D0 (en) | 2010-07-14 | 2010-09-01 | Two Trees Photonics Ltd | Display system |
GB2498170B (en) | 2011-10-26 | 2014-01-08 | Two Trees Photonics Ltd | Frame inheritance |
GB2499579B (en) | 2012-02-07 | 2014-11-26 | Two Trees Photonics Ltd | Lighting device |
GB2501112B (en) | 2012-04-12 | 2014-04-16 | Two Trees Photonics Ltd | Phase retrieval |
GB2509180B (en) | 2012-12-21 | 2015-04-08 | Two Trees Photonics Ltd | Projector |
GB2576738B (en) * | 2018-08-29 | 2020-08-19 | Envisics Ltd | Head-up display |
-
2010
- 2010-07-14 GB GBGB1011829.7A patent/GB201011829D0/en not_active Ceased
-
2011
- 2011-07-14 EP EP11735689.9A patent/EP2593838B1/en active Active
- 2011-07-14 JP JP2013519160A patent/JP6154321B2/en active Active
- 2011-07-14 GB GB1112128.2A patent/GB2482065B/en active Active
- 2011-07-14 US US13/810,001 patent/US9715215B2/en active Active
- 2011-07-14 WO PCT/GB2011/051328 patent/WO2012007762A1/en active Application Filing
-
2017
- 2017-03-02 JP JP2017039851A patent/JP6711769B2/en active Active
- 2017-07-24 US US15/658,052 patent/US10928776B2/en active Active
-
2021
- 2021-02-16 US US17/176,355 patent/US11635621B2/en active Active
Non-Patent Citations (1)
Title |
---|
None * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2604890A (en) * | 2021-03-17 | 2022-09-21 | Envisics Ltd | Image projection |
EP4060423A1 (en) * | 2021-03-17 | 2022-09-21 | Envisics Ltd. | Image projection |
GB2604890B (en) * | 2021-03-17 | 2024-01-31 | Envisics Ltd | Image projection |
Also Published As
Publication number | Publication date |
---|---|
US20210341879A1 (en) | 2021-11-04 |
US9715215B2 (en) | 2017-07-25 |
US11635621B2 (en) | 2023-04-25 |
JP6711769B2 (en) | 2020-06-17 |
JP2013540278A (en) | 2013-10-31 |
WO2012007762A1 (en) | 2012-01-19 |
US20170364028A1 (en) | 2017-12-21 |
US10928776B2 (en) | 2021-02-23 |
GB201011829D0 (en) | 2010-09-01 |
GB201112128D0 (en) | 2011-08-31 |
EP2593838A1 (en) | 2013-05-22 |
GB2482065A (en) | 2012-01-18 |
US20130265622A1 (en) | 2013-10-10 |
JP2017142506A (en) | 2017-08-17 |
GB2482065B (en) | 2014-01-08 |
JP6154321B2 (en) | 2017-06-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11635621B2 (en) | 2D/3D holographic display system | |
US12013533B2 (en) | Holographic image projection with holographic correction | |
US11803156B2 (en) | Near-eye device | |
JP6745793B2 (en) | Imaging device for moving virtual images | |
EP2748681B1 (en) | Iterative phase retrieval with parameter inheritance | |
GB2496108A (en) | Image colour frequency-based pixel number allocation | |
GB2554575A (en) | Diffuser for head-up display | |
CN111176092B (en) | Pixel mapping on holographic projection display devices | |
CN113009710B (en) | Projector for forming images on multiple planes |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20130214 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAX | Request for extension of the european patent (deleted) | ||
17Q | First examination report despatched |
Effective date: 20161027 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20180125 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: TWO TREES PHOTONICS LIMITED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1015151 Country of ref document: AT Kind code of ref document: T Effective date: 20180715 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602011049753 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: FP |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 8 |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: TWO TREES PHOTONICS LTD |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1015151 Country of ref document: AT Kind code of ref document: T Effective date: 20180704 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181104 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181004 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181004 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181005 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180714 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20180731 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602011049753 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180714 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180731 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 |
|
26N | No opposition filed |
Effective date: 20190405 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180714 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20110714 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180704 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180704 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602011049753 Country of ref document: DE Representative=s name: EGE LEE & PARTNER PATENTANWAELTE PARTGMBB, DE Ref country code: DE Ref legal event code: R081 Ref document number: 602011049753 Country of ref document: DE Owner name: DUALITAS LTD., GB Free format text: FORMER OWNER: TWO TREES PHOTONICS LIMITED, MILTON KEYNES, BUCKINGHAMSHIRE, GB |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20210107 AND 20210113 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: PD Owner name: DUALITAS LTD.; GB Free format text: DETAILS ASSIGNMENT: CHANGE OF OWNER(S), ASSIGNMENT; FORMER OWNER NAME: TWO TREES PHOTONICS LIMITED Effective date: 20210302 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230504 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20230619 Year of fee payment: 13 Ref country code: FR Payment date: 20230616 Year of fee payment: 13 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20230712 Year of fee payment: 13 Ref country code: GB Payment date: 20230614 Year of fee payment: 13 Ref country code: CH Payment date: 20230801 Year of fee payment: 13 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230614 Year of fee payment: 13 |