WO2008096344A2 - A method and system for obtaining digital holograms in a single camera shot using white-light - Google Patents

A method and system for obtaining digital holograms in a single camera shot using white-light Download PDF

Info

Publication number
WO2008096344A2
WO2008096344A2 PCT/IL2008/000142 IL2008000142W WO2008096344A2 WO 2008096344 A2 WO2008096344 A2 WO 2008096344A2 IL 2008000142 W IL2008000142 W IL 2008000142W WO 2008096344 A2 WO2008096344 A2 WO 2008096344A2
Authority
WO
WIPO (PCT)
Prior art keywords
hologram
scene
projections
mla
digital
Prior art date
Application number
PCT/IL2008/000142
Other languages
French (fr)
Other versions
WO2008096344A3 (en
Inventor
Joseph Rosen
Natan Tzvi Shaked
Adrian Stern
Original Assignee
Ben-Gurion University Of The Negev Research And Development Authority
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ben-Gurion University Of The Negev Research And Development Authority filed Critical Ben-Gurion University Of The Negev Research And Development Authority
Publication of WO2008096344A2 publication Critical patent/WO2008096344A2/en
Publication of WO2008096344A3 publication Critical patent/WO2008096344A3/en

Links

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/08Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0808Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005Adaptation of holography to specific applications
    • G03H1/0011Adaptation of holography to specific applications for security or authentication
    • G03H2001/0016Covert holograms or holobjects requiring additional knowledge to be perceived, e.g. holobject reconstructed only under IR illumination
    • G03H2001/0022Deciphering being performed with numerical or optical key, e.g. with the optical scrambler used during recording
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005Adaptation of holography to specific applications
    • G03H2001/0088Adaptation of holography to specific applications for video-holography, i.e. integrating hologram acquisition, transmission and display
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/08Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0808Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
    • G03H2001/0816Iterative algorithms
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2210/00Object characteristics
    • G03H2210/303D object
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2210/00Object characteristics
    • G03H2210/40Synthetic representation, i.e. digital or optical object decomposition
    • G03H2210/42Synthetic representation, i.e. digital or optical object decomposition from real object, e.g. using 3D scanner
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2210/00Object characteristics
    • G03H2210/40Synthetic representation, i.e. digital or optical object decomposition
    • G03H2210/45Representation of the decomposed object
    • G03H2210/454Representation of the decomposed object into planes
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2223/00Optical components
    • G03H2223/19Microoptic array, e.g. lens array
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2240/00Hologram nature or properties
    • G03H2240/50Parameters or numerical values associated with holography, e.g. peel strength
    • G03H2240/56Resolution

Definitions

  • the present invention relates to the field of holograms, specifically this invention relates to a method and system for obtaining digital holograms, under spatially incoherent white-light illumination and in a single camera shot.
  • Conventional holography involves the acquisition of an interference pattern created by interfering beams coming from a three dimensional (3- D) scene and a reference beam.
  • the creation of this interference pattern requires a meticulous stability of the optical system, high intensity and narrow bandwidth of the light source used. These strict requirements inhibit the usage of conventional holography for many practical applications.
  • a digital Fresnel hologram can be obtained, under spatially incoherent illumination conditions, by scanning the 3-D scene with a pattern of a Fresnel zone plate, so that the light intensity at each scanning position is integrated by a point detector.
  • the scanning process in this method is performed by mechanical movements, and thus the hologram acquisition is relatively slow.
  • this hologram technique is not suitable for moving objects.
  • the 3-D scene is illuminated by spatially incoherent white light and viewed from multiple angles. For each view angle, the projection of the 3-D scene is acquired by a camera and processed in the computer. The result is a 2-D complex function which represents a digital hologram of the 3-D scene.
  • This function can be encoded into a computer generated hologram (CGH) with real and positive transparency values.
  • CGH computer generated hologram
  • the recorded 3-D scene can be reconstructed by illuminating the CGH transparency with a plane wave.
  • a digital holography technique can be employed in order to digitally reconstruct the 3-D scene.
  • the present invention is a method of obtaining a digital hologram of a 3-D scene comprising the steps of: (i) illuminating the scene with incoherent white-light; (ii) recording multiple projections of the 3-D scene; and (iii) computer processing of the projections by the performance of a predetermined sequence of mathematical operations.
  • the method of the current invention is characterized in that a microlens array (MLA) is used to create the multiple projections in its image plane. This MLA image plane is projected onto the imaging sensor of a camera. This allows the obtaining of all of the multiple projections in a single camera shot.
  • MLA microlens array
  • the predetermined sequence of mathematical operations comprises the steps of (i) cutting the single shot image received from the camera into a set of projections of the 3-D scene; (ii) centering the projections on the same reference point; (iii) multiplying the centered projections by linear phase functions; and (iv) summing each of the multiplied results into a single complex value. These steps yield a complex matrix which represents a digital hologram.
  • the predetermined sequence of mathematical operations comprises the digital incoherent modified Fresnel hologram (DIMFH) method.
  • DIMFH digital incoherent modified Fresnel hologram
  • the predetermined sequence of mathematical operations comprises the digital incoherent protected correlation hologram (DIPCH) method.
  • DIPCH digital incoherent protected correlation hologram
  • the present invention is a system for obtaining a digital hologram of a 3-D scene comprising a source of incoherent white-light; a collimating lens; a microlens array (MLA); a focusing lens; a camera; and a computer.
  • MLA creates multiple images of the scene in the image plane of said MLA.
  • the image plane is projected by the focusing lens onto the imaging sensor of the camera, thereby allowing the obtaining of all of the multiple projections of the scene in a single camera shot.
  • the multiple projections are transferred to the computer, and finally a predetermined sequence of mathematical operations is preformed on these projections to obtain the digital hologram.
  • Fig. 1 schematically shows the integral holography (IH) optical system used for capturing the multiple projections of the 3-D scene
  • Fig. 2 schematically illustrates one embodiment of the IH processing stage
  • Fig. 3 is a cross section of part of the optical system shown in Fig. 1
  • Fig. 4 is a contrast-inverted picture showing several projections taken from different parts of the microlens array (MLA) image plan captured by the camera;
  • MLA microlens array
  • Fig. 5A is a contrast-inverted picture showing the magnitude of the Fourier hologram obtained after performing the processing stage on the captured projections
  • Fig. 5B is a contrast-inverted picture showing the phase of the Fourier hologram obtained after performing the processing stage on the captured projections
  • Fig. 5C is a contrast-inverted picture showing the reconstruction of the hologram at the best focus distance of the letter T
  • Fig. 5D is a contrast-inverted picture showing reconstruction of the hologram at the best focus distance of the letter ⁇ ';
  • Fig. 6 is a schematic illustration of the projection onto the constraint sets (POCS) algorithms for finding the point spread function (PSF) used for the digital incoherent protected correlation hologram (DIPCH);
  • Fig. 7A shows the generating constrained random PSFs used for the 1-D
  • Fig. 7B shows the generating constrained random PSFs used for the 2-D DIPCH.
  • the overall process of obtaining the hologram according to the present invention can be divided into two main stages: the recording stage and the processing stage.
  • the recording stage multiple projections of the 3-D scene are captured in a single camera shot, whereas in the processing stage, mathematical operations are performed on these projections in order to yield a digital two-dimensional (2-D) hologram or one-dimensional (1-D) hologram.
  • Fig. 1 shows the integral holography (IH) optical system of the present invention used for capturing the multiple projections of the 3-D scene 10, which is illuminated by white-light.
  • a microlens array (MLA) 14 is employed in order to create these multiple projections.
  • plano-convex lens 12 and the MLA 14 together can be considered as a new equivalent MLA 14' which sees the 3-D scene 10 at a larger distance from the MLA 14 than the distance to the scene without the plano-convex lens 12.
  • a spherical lens 18, with a focal length of /2, projects the MLA image plane 16 onto the camera 20 with the magnification of -Z ⁇ z 1 . Then, the camera 20 captures the entire MLA image plane 16 in a single shot and sends it to the computer 22 for the processing stage.
  • the MLA contains (2K + 1) x (2K + 1) microlenses.
  • P m ,, (X p , Y p ) be the projection created by the (m,n)-th. microlens, where X p and Y p are the axes of this projection.
  • the MLA image plane 16 captured by a single camera shot in the recording stage of the present invention, consists of an array of small elemental images, each obtained by a different microlens in the MLA and thus representing another projection P m n (X p ,Y p ) of the 3-D scene 10 from a different point of view.
  • Fig. 2 illustrates one method of carrying out the processing stage of the present invention.
  • each projection of the MLA image is cut, as shown in stages 102 and 104, after detecting the first and last elemental image in each row of the MLA plane.
  • step 106 each of the elemental images taken from the MLA image plane is centered on the same reference point, which yields a set of new projections P ⁇ n (X p c , Y p ), shown in stage 108.
  • P ⁇ n (X p c , Y p ) shown in stage 108.
  • each of the centered projections is multiplied by a linear phase function, which is dependent on the relative position of the projection in the entire projection set.
  • the result of each multiplication is summed up into a single complex value.
  • D is the distance between the centers of two adjacent microlenses in the array and b is an adjustable parameter.
  • the process is performed for each of the centered projections, which yields, as shown in stage 114, a 2- D complex matrix H representing the digital 2-D Fourier hologram of the 3-D scene.
  • This hologram is equivalent to the complex amplitude in the rear focal plane of a spherical lens due to a coherent light diffracting from the same 3-D scene and propagating through this lens.
  • each projection P m n (X p ,Y p ) is centered on the same
  • MmD and MnD are subtracted from x p and y p , respectively.
  • 3-D scene is given by: -x;, ⁇ ; - y p c )]E m,n (x;,r p )dx;d ⁇ ;
  • transversal minimal distance Ax 9 and the axial minimal distance Az 5 that can be resolved through the optical system are given as follows:
  • is the average wavelength used ( ⁇ 0.5 ⁇ ri) and p c is the pixel size of the recording camera.
  • the axial optical resolution given in Eq. (10) is determined by projecting the axial minimal resolved distance Az s on the transverse object plane of the most extreme microlens in the MLA.
  • the optical system shown in Fig. 1 was experimentally implemented. Two bright letters, T and 'H', were positioned in a dark environment and illuminated by a spatially incoherent white-light source. The size of the letters was 2 cm x 2 cm each, and the distances between them on the optical axis Z, the vertical axis Y and the horizontal axis X were 10 cm, 1 cm and 3 cm, respectively.
  • the plano-convex lens 12, attached to the MLA 14 on the side of the 3-D scene 10, had a diameter of 10 cm and a focal length of /i 40 cm. Therefore, the distance between the 3-D scene 10 and the MLA 14 was about 40 cm as well.
  • a hexagonal-format MLA, 5 cm in diameter, with a pitch of 500 ⁇ m and with 115x110 microlenses was used. However, only the 65x65 middle microlenses were employed in the experiment.
  • a spherical imaging lens 18 with a focal length of / 2 10 cm was used.
  • Fig. 4 shows several chosen projections cut from different parts of the overall MLA image plane 16 which was captured by the camera. As shown in this figure, the relative positions of the two letters change as a function of the location of the projection on the entire MLA image plane 16. This is the effect that leads to the 3-D properties of the hologram obtained at the end of the process.
  • the processing stage was started by cutting each of the projections from the MLA image plane 16 and centering the projections on a chosen reference point.
  • the cutting process was performed semi- automatically by detecting the first and the last elemental images in each row of the MLA image plane 16. Then, the distance between these two extreme elemental images was divided by the number of microlenses utilized in each row of the MLA 14 and the elemental images were cut from the MLA image plane 16 accordingly. Afterward, digital correlation with a known pattern taken from any of the elemental images was employed in order to fix a common reference point for all the elemental images. It is envisaged by the inventors that completely automatic cutting and centering methods may be possible.
  • the common reference point was chosen to be the center of the letter T.
  • the meaning of this process was setting the origin of the 3-D scene on the plane of the letter T.
  • Each of the projections was normalized (divided by its maximal value), multiplied, according to Eqs. (1) and (2), by a linear phase function dependent on the position of this projection in the entire set of projections and then summed up into a single complex value in the Fourier hologram H.
  • the magnitude and the phase of the Fourier hologram obtained in the experiment are shown in Figs. 5A and 5B, respectively.
  • a 2-D inverse Fourier transform was first applied to the 2-D complex matrix representing the hologram.
  • Fig. 5C shows the results of this inverse Fourier transform according to the present invention.
  • the letter T is in focus, whereas the letter ⁇ ' is out of focus.
  • a Fresnel propagation was applied to this reconstruction plane by convolving it with a quadratic phase [6]. The purpose of this propagation was to reveal other planes along the optical axis of the 3-D scene reconstruction.
  • Fig. 5D shows the reconstruction in the best focus plane of the letter 'H'. In this figure, the letter T is out of focus. This validates the fact that volumetric information is indeed encoded inside the hologram synthesized by the method of the present invention.
  • MVP holograms One disadvantage of MVP holograms is the complication of acquiring the large number of viewpoint projections of the 3-D scene needed for generating a high resolution hologram. Another difficulty is the numerical complexity and the inaccuracy of the digital process carried out on the acquired projections.
  • the method of the present invention provides a solution to both of the disadvantages.
  • the multiple images of the 3-D scene are acquired by the use of a microlens array which acquires the entire set of viewpoint projections in a single camera shot.
  • processing stage of the invention is carried out to yield a 2-D Fourier hologram of the 3-D scene.
  • both 1-D and 2-D MVP holograms can be generated.
  • the projections are acquired along a single axis only, and a multiplication by a 1-D phase function is performed, where the inner product sum is the corresponding column in the hologram matrix.
  • the projections are acquired along a two axes (2-D grid), and a multiplication by a 2-D phase function is performed, where the inner product sum is the corresponding pixel in the hologram matrix.
  • the hologram of the present invention is produced under incoherent white light illumination. It is possible to define new types of digital holograms with certain advantages over the known types of holograms.
  • the inventors have recently proposed a new MVP hologram called a digital incoherent Fresnel hologram (DIMFH) [9,10].
  • DIMFH digital incoherent Fresnel hologram
  • the DIMFH is generated by processing the MVPs directly, rather than performing a Fresnel propagation on the reconstruction of a Fourier hologram as done in the past [4,11]. Therefore, redundant calculations and digital errors during the various transformations are avoided.
  • this direct Fresnel holography method is not limited to small angles and hence the hologram reconstruction is more accurate.
  • DIPCH digital incoherent protected correlation hologram
  • the reconstructed 3-D scene obtained from the DIPCH has a significantly improved transverse resolution compared to the 3-D scene reconstructed from the DIMFH, especially for the far objects in the scene.
  • the 3-D information encoded into the DIPCH is scrambled with a random PSF and thus the hologram can be used for encrypting the recorded 3-D scene.
  • the general theoretical framework presented in this invention can be used for defining other types of new digital holograms for obtaining other advantages over the known types of digital holograms.
  • any type of incoherent correlation holograms can be generated from the acquired projections and for each of the hologram types, both 1-D and 2-D correlation holograms can be synthesized.
  • each horizontal line of the /M-th projection P m ⁇ x p ,y p ) is multiplied by the same 1-D PSF and the product is summed into the (m,n)-th.
  • a x and g x are general functions dependent on x p only and may be defined differently for every type of the incoherent correlation hologram as shown below, b is an adjustable parameter (with units that preserve the arguments of A 1 and ⁇ 1 as unitless quantities), ⁇ is Dirac delta function. Additionally, the function A ⁇ (bx p )exp[-ig ⁇ (bx p )] has the property that its
  • each projection contributes a different column to the complex matrix H x ⁇ m, ⁇ ) , which, as confirmed herein below, represents the 1-D incoherent correlation hologram of the 3-D scene.
  • a ⁇ and g are the same functions used for generating the PSF of the 1-D hologram [Eq. (13)].
  • the 2-D incoherent correlation hologram is synthesized from (2K+ ⁇ ) horizontal by (2K+ ⁇ ) vertical projections of the 3-D scene.
  • a 1 and g 2 are general functions depending on (x p , y p ) and may be defined differently for every type of incoherent correlation hologram as discussed below.
  • the function E 2 [x p ,y p ) has the property that its Fourier transform is a pure phase function in order to enable a proper reconstruction as it is in the case of the 1-D hologram.
  • the process manifested by Eq. (16) is repeated for all the projections, but in contrast to the 1-D case presented herein above, in the 2-D case, each projection contributes a single pixel to the hologram, rather than a column of pixels.
  • the obtained 2-D complex matrix H 2 (m,n) represents the 2-D incoherent correlation hologram of the 3-D scene.
  • the reconstructed plane s 2 ⁇ m,n;z r located a distance z ⁇ from the 2-D incoherent correlation hologram, is obtained by digitally convolving the hologram with a reconstructing PSF as follows:
  • a 2 and g 2 are the same functions used in the generating PSF of the 2-D hologram in Eq. (17).
  • PSFs used in the generation and reconstruction of the hologram More types of incoherent correlation holograms may be defined for gaining other advantages over the regular types of digital holograms, by using other
  • DIMFH Digital Incoherent Modified Fresnel Hologram
  • the DIMFH is actually an incoherent Fresnel hologram generated directly by processing the MVPs of the 3-D scene. This direct method is faster and more accurate than the Fourier-based Fresnel holography methods [4,11], since redundant calculations and approximation errors are avoided.
  • the generation and the reconstruction of the 1-D DIMFH is performed by Eqs. (12) and (14), respectively, where the generating PSF is a 1-D quadratic phase function given by:
  • DIPCH Digital Incoherent Protected Correlation Hologram
  • the DIPCH is a new type of incoherent correlation hologram which has two advantages over the Fresnel hologram in general and over the DIMFH in particular.
  • the reconstruction obtained from the DIPCH has a significantly higher transverse resolution for far objects in the 3-D scene compared to the Fresnel hologram in general and to the DIMFH in particular.
  • far objects recorded by the DIMFH are reconstructed with a reduced transverse resolution because of two reasons: (a) Due to the parallax effect, far objects 'moves' slower throughout the projections, and therefore they sample a magnified version of the generating PSF. This magnified version has narrower bandwidth and therefore the reconstruction transverse resolution of far objects decreases in comparison to the closest object, (b)
  • the quadratic phase used in the DIMFH has lower frequencies as one approaches its origin. Since far objects are correlated with the central part of the quadratic phase function along a range that becomes shorter as much as the object is more far away, the bandwidth of the DIMFH of far objects becomes even narrower beyond the bandwidth reduction mentioned in (a).
  • the spatial frequencies of the DIPCH are distributed uniformly all over its area. Therefore, the DIPCH suffers from resolution reduction of far objects only due the reason (a). Hence, the images of far objects reconstructed from the DIPCH, besides of being protected by the constrained random PSF, also have higher transverse resolution.
  • the 1-D DIPCH process is still defined by Eqs. (12) and (14). However, this time, the generating PSF is a random function which fulfills the constraint that its Fourier transform is a pure phase function. In order to find this PSF, the projection is used onto the constraint sets (POCS) algorithm [12,13].
  • the POCS algorithm used for finding this PSF is illustrated in Fig. 6.
  • the POCS is an iterative algorithm which bounces from the PSF domain to its spatial spectrum domain and backward, using Fourier transform and its inverse transform. In each domain, the function is projected onto the constraint set.
  • the two constraints of the POCS express the two properties required for the PSF of the DIPCH. First, the Fourier transform of the PSF should be a phase-only function.
  • the constraint of the POCS in the spectral domain is the set of all phase-only functions and each transfer function is projected onto this constraint by setting its magnitude distribution to the constant 1.
  • the other property of the PSF is that it should be space limited into a relatively narrow region close to but outside of the origin. This condition reduces the reconstruction noise from the out-of-focus objects because the overlap during the correlation between the resampled space-limited reconstructing PSF and the hologram at out- of-focus regions is lower than the case of using a wide-spread PSF. Of course, this noise is lower by as much as the existence region of the PSF is narrower.
  • the constraint set in the PSF domain is all of the complex functions that identically equal zero in any pixel outside the predefined narrow existence region.
  • the projection onto the constraint set in the PSF domain is performed by multiplying the PSFs by a function that is equal to 1 inside the narrow existence region of the PSF and 0 elsewhere.
  • the constrained PSF looks like a narrow strip of columns, whereas in the case of the 2-D DIPCH this PSF looks like a narrow ring.
  • the POCS algorithm yields the suitable constrained random PSF that can be used in the hologram generation process.
  • Figs 7A and 7B show the resulting PSFs that can be used for generating the 1-D and the 2-D DIPCHs, respectively.
  • the width of the recorded hologram is 2Kaf/z Stm ⁇ n , and the smallest resolved detail, as mentioned herein above, is af/(Mz s , m m)- Now, for a point located a distance z s from the imaging system, the width of the recorded hologram is 2Kaf/z s . Since, as explained above, the DIMFH of an object point located in a distance z s from the imaging system, is equivalent to a lens, the hologram resolving power is linear dependent on its width.
  • the resolved detail of an object at some distance z s is the smallest ever resolved detail multiplied by the ratio between the maximum hologram width, 2Kaf/z Stm ⁇ n , and the actual hologram width, 2Kaf/z s .
  • the resolved detail of an object at some distance z s is The recalled size of the resolved object's detail in the case of DIPCH is af/(Mz s,mn ). Therefore, the ratio between the resolving power of the DIPCH and the DIMFH is (z/z s,mm ). Again, this means that as much as the object is far from z sjn ⁇ n , the resolution power of the DIPCH over the DIMFH is better.

Abstract

The present invention is a method and a system for obtaining a digital hologram of a three-dimensional (3-D) scene. The method is performed by illuminating the scene (10) with incoherent white-light, recording multiple projections of the 3-D scene, and finally, computer processing of the projections by the performance of a predetermined sequence of mathematical operations. The method and the system of the current invention are characterized in that a microlens array (MLA, 14) is used to create the multiple projections in an image plane (16) which is projected onto the imaging sensor of a camera (20). This allows the obtaining of all of the multiple projections in a single camera shot.

Description

A METHOD AND SYSTEM FOR OBTAINING DIGITAL HOLOGRAMS IN A SINGLE CAMERA SHOT USING
WHITE-LIGHT
Field of the Invention
The present invention relates to the field of holograms, specifically this invention relates to a method and system for obtaining digital holograms, under spatially incoherent white-light illumination and in a single camera shot.
Background of the Invention
Conventional holography involves the acquisition of an interference pattern created by interfering beams coming from a three dimensional (3- D) scene and a reference beam. The creation of this interference pattern requires a meticulous stability of the optical system, high intensity and narrow bandwidth of the light source used. These strict requirements inhibit the usage of conventional holography for many practical applications.
A partial solution to these problems is suggested by the scanning holography method [I]. According to this method, a digital Fresnel hologram can be obtained, under spatially incoherent illumination conditions, by scanning the 3-D scene with a pattern of a Fresnel zone plate, so that the light intensity at each scanning position is integrated by a point detector. However, the scanning process in this method is performed by mechanical movements, and thus the hologram acquisition is relatively slow. In addition, this hologram technique is not suitable for moving objects.
In order to avoid these mechanical movements, another method for obtaining digital Fresnel holograms, named FINCH (Fresnel incoherent correlation holography), is proposed in Ref. [2]. According to this method, the spatially incoherent light coming from the 3-D scene propagates through a diffractive optical element (DOE) and is recorded by a camera. Then, three different holograms, each with a different phase factor of the DOE, are recorded sequentially and superposed in the computer into a digital Fresnel hologram.
A fundamentally different solution is suggested in Refs. [3,4]. According to the methods presented there, the 3-D scene is illuminated by spatially incoherent white light and viewed from multiple angles. For each view angle, the projection of the 3-D scene is acquired by a camera and processed in the computer. The result is a 2-D complex function which represents a digital hologram of the 3-D scene. This function can be encoded into a computer generated hologram (CGH) with real and positive transparency values. Then, the recorded 3-D scene can be reconstructed by illuminating the CGH transparency with a plane wave. Alternatively, a digital holography technique can be employed in order to digitally reconstruct the 3-D scene.
In spite of the great advantages presented by the above described methods and their potential of making holography attractive for many practical applications, the 3-D scene recording process in these methods is still considered long and quite complicated. This occurs because the camera has to be repositioned many times in order to obtain enough 3-D scene projections, required for the synthesis of a hologram with an acceptable resolution and also because the former methods are not suitable for holography of moving objects.
It is therefore an object of this invention to provide an improved method for obtaining digital holograms.
Other objects and advantages of present invention will appear as description proceeds.
Summary of the Invention
In a first aspect, the present invention is a method of obtaining a digital hologram of a 3-D scene comprising the steps of: (i) illuminating the scene with incoherent white-light; (ii) recording multiple projections of the 3-D scene; and (iii) computer processing of the projections by the performance of a predetermined sequence of mathematical operations. The method of the current invention is characterized in that a microlens array (MLA) is used to create the multiple projections in its image plane. This MLA image plane is projected onto the imaging sensor of a camera. This allows the obtaining of all of the multiple projections in a single camera shot.
In one embodiment, the predetermined sequence of mathematical operations comprises the steps of (i) cutting the single shot image received from the camera into a set of projections of the 3-D scene; (ii) centering the projections on the same reference point; (iii) multiplying the centered projections by linear phase functions; and (iv) summing each of the multiplied results into a single complex value. These steps yield a complex matrix which represents a digital hologram.
In another embodiment the predetermined sequence of mathematical operations comprises the digital incoherent modified Fresnel hologram (DIMFH) method.
In another embodiment the predetermined sequence of mathematical operations comprises the digital incoherent protected correlation hologram (DIPCH) method. In another aspect the present invention is a system for obtaining a digital hologram of a 3-D scene comprising a source of incoherent white-light; a collimating lens; a microlens array (MLA); a focusing lens; a camera; and a computer. The system is characterized in that the MLA creates multiple images of the scene in the image plane of said MLA. The image plane is projected by the focusing lens onto the imaging sensor of the camera, thereby allowing the obtaining of all of the multiple projections of the scene in a single camera shot. Next, the multiple projections are transferred to the computer, and finally a predetermined sequence of mathematical operations is preformed on these projections to obtain the digital hologram.
Brief Description of the Drawings
The above and other characteristics and advantages of the invention will be more readily apparent through the following examples, and with reference to the appended drawings, wherein:
Fig. 1 schematically shows the integral holography (IH) optical system used for capturing the multiple projections of the 3-D scene; Fig. 2 schematically illustrates one embodiment of the IH processing stage; Fig. 3 is a cross section of part of the optical system shown in Fig. 1; Fig. 4 is a contrast-inverted picture showing several projections taken from different parts of the microlens array (MLA) image plan captured by the camera;
Fig. 5A is a contrast-inverted picture showing the magnitude of the Fourier hologram obtained after performing the processing stage on the captured projections; Fig. 5B is a contrast-inverted picture showing the phase of the Fourier hologram obtained after performing the processing stage on the captured projections; Fig. 5C is a contrast-inverted picture showing the reconstruction of the hologram at the best focus distance of the letter T; Fig. 5D is a contrast-inverted picture showing reconstruction of the hologram at the best focus distance of the letter Η';
Fig. 6 is a schematic illustration of the projection onto the constraint sets (POCS) algorithms for finding the point spread function (PSF) used for the digital incoherent protected correlation hologram (DIPCH); Fig. 7A shows the generating constrained random PSFs used for the 1-D
DIPCH;
Fig. 7B shows the generating constrained random PSFs used for the 2-D DIPCH. Detailed Description of the Invention
Description of the method
The overall process of obtaining the hologram according to the present invention can be divided into two main stages: the recording stage and the processing stage. In the recording stage, multiple projections of the 3-D scene are captured in a single camera shot, whereas in the processing stage, mathematical operations are performed on these projections in order to yield a digital two-dimensional (2-D) hologram or one-dimensional (1-D) hologram.
Fig. 1 shows the integral holography (IH) optical system of the present invention used for capturing the multiple projections of the 3-D scene 10, which is illuminated by white-light. As shown in this figure, a microlens array (MLA) 14 is employed in order to create these multiple projections. A plano-convex lens 12, positioned at a distance of its focal length f\ from the 3-D scene 10 and attached to the MLA 14, is used in order to collimate the light coming from the 3-D scene 10 and thus to increase the number of microlenses participating in the process. In fact, the plano-convex lens 12 and the MLA 14 together can be considered as a new equivalent MLA 14' which sees the 3-D scene 10 at a larger distance from the MLA 14 than the distance to the scene without the plano-convex lens 12. A spherical lens 18, with a focal length of /2, projects the MLA image plane 16 onto the camera 20 with the magnification of -Z^z1. Then, the camera 20 captures the entire MLA image plane 16 in a single shot and sends it to the computer 22 for the processing stage.
Assume that the MLA contains (2K + 1) x (2K + 1) microlenses. The microlenses are numbered by the indices m and n, so that the middle microlens is denoted by (m,n) = (0,0), the upper right microlens by (m,ή) = (-K-K) and the lower left microlens by (m,ή) = (KJC). Let Pm,, (Xp , Yp) be the projection created by the (m,n)-th. microlens, where X p and Yp are the axes of this projection. The MLA image plane 16, captured by a single camera shot in the recording stage of the present invention, consists of an array of small elemental images, each obtained by a different microlens in the MLA and thus representing another projection Pm n(Xp,Yp) of the 3-D scene 10 from a different point of view.
Fig. 2 illustrates one method of carrying out the processing stage of the present invention. After capturing the MLA image plane from the CCD camera in stage 100, each projection of the MLA image is cut, as shown in stages 102 and 104, after detecting the first and last elemental image in each row of the MLA plane. In step 106 each of the elemental images taken from the MLA image plane is centered on the same reference point, which yields a set of new projections P^n(Xp c, Yp ), shown in stage 108. As a result of this centering the radial distance from the reference point is the same for all of the projections. Afterward, as seen in stage 110, each of the centered projections is multiplied by a linear phase function, which is dependent on the relative position of the projection in the entire projection set. Finally, in stage 112, the result of each multiplication is summed up into a single complex value. Mathematically, this process can be described as follows:
Hm,n
Figure imgf000010_0001
(D where:
Figure imgf000010_0002
where D is the distance between the centers of two adjacent microlenses in the array and b is an adjustable parameter. The process is performed for each of the centered projections, which yields, as shown in stage 114, a 2- D complex matrix H representing the digital 2-D Fourier hologram of the 3-D scene. This hologram is equivalent to the complex amplitude in the rear focal plane of a spherical lens due to a coherent light diffracting from the same 3-D scene and propagating through this lens.
Recently, Mishina et al. [5] have demonstrated a method of calculating a CGH from elemental images captured by integral photography. Their CGH is a composite of many elemental Fresnel holograms, each created by a different microlens. Unlike the Mishina et al. [5] method, in the IH method of the present invention, each (m,n)-th. pixel in the hologram is contributed only from the (m,ή)-th. microlens. Therefore, the entire information of the elemental images is compressed into a matrix with a number of elements which is equal to the number of microlens. Another difference from the composite computer generated hologram (CGH) method is that according to the processing stage of the present invention, the IH hologram is of a Fourier type, and this opens many possibilities of spatial filtering and correlation on the captured images.
Equivalence between the first digital process and a digital Fourier hologram
In order to show that the complex matrix H indeed represents the digital Fourier hologram of the 3-D scene in the present invention, the mathematical relations between point (xs ,.ys,zv) in the 3-D scene 10 and its projected point (xp,yp) located on the (w,n)-th projection plane (Xp,Yp) obtained by the MLA 14 is first defined. Fig. 3 shows certain geometric relationships of the optical system shown in Fig. 1. Simple geometric relationships in this figure yield the following: (3)
Figure imgf000011_0001
where M is the magnification of each of the microlenses in the array, L is the distance between the origin of the 3-D scene 10 and the equivalent MLA 14' (taking into account the effect of the plano-convex lens 12). By assuming that the maximal value of zs is much smaller than L, the
approximation (1 - a/β) = \ + a/β , where a « β , can be applied to Eq. (3)
to yield:
xp = M(mD + x, + zsmD I L + z^xJ L); yp = M(nD + y, + z,nD / L + z,y, / L). (4)
As explained above, each projection Pm n(Xp,Yp) is centered on the same
reference point, which yields the centered projection P^n(X p,Yp ). Due to
this centering, MmD and MnD are subtracted from xp and yp , respectively,
in order to get xp and yp c located on the centered projection Pm°n (X p ,Yp ) .
This means that the point (xs,y^ ,zs) in the 3-D scene 10 is projected to
the point (xp c ,yp c ) in the centered projection according to the following
formula:
Figure imgf000012_0001
= M(ys + zsnD I L + z,y, I L). (5)
An infinitesimal element with the size of (Δxs , Ay s , AzJ , located on the 3-D
object surface at coordinates (xs,y^ , zs) and having the value of
h(x^ ,ys,zs), is now considered. This infinitesimal element should appear
on all of the centered projections planes, but at a different location on each
plane. Therefore, based on Eq. (1), the amplitude distribution on the (m,n)-
th centered projection plane, caused by a single source point (SSP) in the
3-D scene, is given by:
Figure imgf000012_0002
-x;,γ; - yp c)]Em,n(x;,rp)dx;dγ;
= h(x^y^zs)Em n(xρ,yp c ) AxsAysAzi, (6) where δ is the Dirac delta impulse. Substituting Eqs. (2) and (5) into Eq. (6) yields:
Figure imgf000013_0001
I D)[m(x, + z,mD I L + z,xJ L) (7) + n(ys + zsnD I L + zsys I L)]} Ax4Ay1Az1.
Taking into account the fact that the overall distribution of the hologram is a volume integral of all points on the 3-D object, the following is obtained:
Hm,n
Figure imgf000013_0002
I D) x [mXs + nYs + (ZxD I L)(m2 + n2) + (Z5 / L)(mXs + nYs)]}dXsdYsdZ, . (8)
Using the continuous variables (u / D,v / D) instead of the discrete variables (m,ή) and assuming that L » 2πMum7ΑδZiδXs and
L » 2πMvm∞iδZsδYs , where (δXs, δY ^ SZx) is the size of the 3-D scene, and wmax and vmax are the maximal horizontal and vertical coordinate values on the Fourier plane, respectively, then the last term inside the integral of Eq. (8) can be neglected, yielding the following equation:
+vYs +(Zs /L)(u2 +v2)]ldXsdYsdZs.
Figure imgf000013_0003
(9) Eq. (9) has the same functional behavior of the complex amplitude obtained for a Fourier hologram [3] and therefore the proposed IH system indeed creates a digital Fourier hologram.
The transversal minimal distance Ax9 and the axial minimal distance Az5 that can be resolved through the optical system are given as follows:
Ax ^ = max {l .22 λL / D, p cZ] /(Mz2) ]; Az9 = Ax9L I(KD), (10)
where λ is the average wavelength used (λ∞0.5μri) and pc is the pixel size of the recording camera. The axial optical resolution given in Eq. (10) is determined by projecting the axial minimal resolved distance Az s on the transverse object plane of the most extreme microlens in the MLA. The parameter b is determined so that the computed Fourier hologram given by Eq. (9) maintains the maximum possible resolution of the system given by Eq. (10). Thejrefore, the parameter b is given as follows: b = D /(MKAx,). (11)
This embodiment of the invention will be further described and illustrated in the following example.
Example
The optical system shown in Fig. 1 was experimentally implemented. Two bright letters, T and 'H', were positioned in a dark environment and illuminated by a spatially incoherent white-light source. The size of the letters was 2 cm x 2 cm each, and the distances between them on the optical axis Z, the vertical axis Y and the horizontal axis X were 10 cm, 1 cm and 3 cm, respectively. The plano-convex lens 12, attached to the MLA 14 on the side of the 3-D scene 10, had a diameter of 10 cm and a focal length of /i = 40 cm. Therefore, the distance between the 3-D scene 10 and the MLA 14 was about 40 cm as well. A hexagonal-format MLA, 5 cm in diameter, with a pitch of 500 μm and with 115x110 microlenses was used. However, only the 65x65 middle microlenses were employed in the experiment. The focal length of each of the microlenses in the MLA 14 was /MA = 3.3 mm. In order to project the MLA image plane 16 onto the camera 20 with the magnification factor of -2, a spherical imaging lens 18 with a focal length of /2 = 10 cm was used. A CCD camera (PCO, Scientific 230XS) 20, containing 1280x1024 pixels and an 8.6x6.9 mm2 active area, was used. Several camera planes were concatenated due to the relatively low number of pixels in the CCD camera 20 used (compared to other cameras on the market today). Note that the use of the available hexagonal-format MLA, rather than a square-format MLA, decreased the quality of the reconstruction because of the mismatch between the MLA and the square- format grid of the computer. Therefore, the results in this example should be considered as a simple proof-of-principle demonstration. Fig. 4 shows several chosen projections cut from different parts of the overall MLA image plane 16 which was captured by the camera. As shown in this figure, the relative positions of the two letters change as a function of the location of the projection on the entire MLA image plane 16. This is the effect that leads to the 3-D properties of the hologram obtained at the end of the process. After capturing the MLA image plane 16 by the CCD camera 20, the processing stage was started by cutting each of the projections from the MLA image plane 16 and centering the projections on a chosen reference point. The cutting process was performed semi- automatically by detecting the first and the last elemental images in each row of the MLA image plane 16. Then, the distance between these two extreme elemental images was divided by the number of microlenses utilized in each row of the MLA 14 and the elemental images were cut from the MLA image plane 16 accordingly. Afterward, digital correlation with a known pattern taken from any of the elemental images was employed in order to fix a common reference point for all the elemental images. It is envisaged by the inventors that completely automatic cutting and centering methods may be possible.
In the experiment, the common reference point was chosen to be the center of the letter T. The meaning of this process was setting the origin of the 3-D scene on the plane of the letter T. Each of the projections was normalized (divided by its maximal value), multiplied, according to Eqs. (1) and (2), by a linear phase function dependent on the position of this projection in the entire set of projections and then summed up into a single complex value in the Fourier hologram H. The magnitude and the phase of the Fourier hologram obtained in the experiment are shown in Figs. 5A and 5B, respectively. In order to digitally reconstruct the 3-D scene recorded into this hologram, a 2-D inverse Fourier transform was first applied to the 2-D complex matrix representing the hologram.
Fig. 5C shows the results of this inverse Fourier transform according to the present invention. In the reconstruction plane obtained by this operation, the letter T is in focus, whereas the letter Η' is out of focus. Then, a Fresnel propagation was applied to this reconstruction plane by convolving it with a quadratic phase [6]. The purpose of this propagation was to reveal other planes along the optical axis of the 3-D scene reconstruction. Fig. 5D shows the reconstruction in the best focus plane of the letter 'H'. In this figure, the letter T is out of focus. This validates the fact that volumetric information is indeed encoded inside the hologram synthesized by the method of the present invention.
Alternative digital processes
One disadvantage of MVP holograms is the complication of acquiring the large number of viewpoint projections of the 3-D scene needed for generating a high resolution hologram. Another difficulty is the numerical complexity and the inaccuracy of the digital process carried out on the acquired projections.
The method of the present invention provides a solution to both of the disadvantages. According to the recording stage of the present invention as described hereinabove, the multiple images of the 3-D scene are acquired by the use of a microlens array which acquires the entire set of viewpoint projections in a single camera shot. Following this, the second
(processing) stage of the invention is carried out to yield a 2-D Fourier hologram of the 3-D scene.
However, this processing stage, illustrated hereinabove, can be carried out in many ways. First, both 1-D and 2-D MVP holograms can be generated. In case of a 1-D MVP hologram, the projections are acquired along a single axis only, and a multiplication by a 1-D phase function is performed, where the inner product sum is the corresponding column in the hologram matrix. In case of a 2-D MVP hologram, the projections are acquired along a two axes (2-D grid), and a multiplication by a 2-D phase function is performed, where the inner product sum is the corresponding pixel in the hologram matrix.
Second, by choosing a different phase function, or point spread function (PSF), we can create correlation holograms. However, in contrast to prior art correlation holograms [7,8], the hologram of the present invention is produced under incoherent white light illumination. It is possible to define new types of digital holograms with certain advantages over the known types of holograms. The inventors have recently proposed a new MVP hologram called a digital incoherent Fresnel hologram (DIMFH) [9,10]. The DIMFH is generated by processing the MVPs directly, rather than performing a Fresnel propagation on the reconstruction of a Fourier hologram as done in the past [4,11]. Therefore, redundant calculations and digital errors during the various transformations are avoided. Furthermore, this direct Fresnel holography method is not limited to small angles and hence the hologram reconstruction is more accurate.
It is also possible to define another type of correlation hologram called digital incoherent protected correlation hologram (DIPCH) [10]. The reconstructed 3-D scene obtained from the DIPCH has a significantly improved transverse resolution compared to the 3-D scene reconstructed from the DIMFH, especially for the far objects in the scene. In addition to this feature, which is important for a wide variety of applications, the 3-D information encoded into the DIPCH is scrambled with a random PSF and thus the hologram can be used for encrypting the recorded 3-D scene. The general theoretical framework presented in this invention can be used for defining other types of new digital holograms for obtaining other advantages over the known types of digital holograms. As explained above, any type of incoherent correlation holograms can be generated from the acquired projections and for each of the hologram types, both 1-D and 2-D correlation holograms can be synthesized.
One dimensional Hologram
For the 1-D incoherent correlation hologram, 2K + \ projections of the 3-D scene along the horizontal axis only are acquired. The projections are numbered by m, so that the middle projection is denoted by m = 0, the right projection by m = K and the left projection by m = -K. According to the method of this embodiment of the present invention, each horizontal line of the /M-th projection Pm{xp,yp ) is multiplied by the same 1-D PSF and the product is summed into the (m,n)-th. pixel in a complex matrix as follows: HPm (xp 3yX (xp 1yp - nΔp)dx pdy p, (12) where Ex{xp,yp) represents the generating PSF of the 1-D hologram, xp and yp are the axes on the projection plane, n is the row number in the complex matrix H1 and Ap is the pixel size of the digital camera. Ex[xp,yp) is defined as follows:
Figure imgf000020_0002
where Ax and gx are general functions dependent on xp only and may be defined differently for every type of the incoherent correlation hologram as shown below, b is an adjustable parameter (with units that preserve the arguments of A1 and ^1 as unitless quantities), δ is Dirac delta function. Additionally, the function Aλ (bxp)exp[-ig}(bxp)] has the property that its
Fourier transform is a pure phase function. As shown in the following, this condition is necessary to guarantee that the hologram generated from this
PSF can be reconstructed properly. According to Eq. (12), each projection contributes a different column to the complex matrix Hx{m,ή) , which, as confirmed herein below, represents the 1-D incoherent correlation hologram of the 3-D scene.
To obtain the reconstructed plane, S1 (m,n;zr), located at an axial distance Zr from the 1-D correlation hologram, the hologram can be digitally convolved with a reconstructing PSF as follows: s] (m,n;zr) = \ Hλ (m,n)* Rλ {m;zr) \, (14) where * denotes a 1-D convolution and Rx{m;zr) is the reconstructing PSF of the 1-D hologram defined as follows:
Figure imgf000021_0001
A} and g, are the same functions used for generating the PSF of the 1-D hologram [Eq. (13)].
Two Dimensional Hologram The 2-D incoherent correlation hologram is synthesized from (2K+\) horizontal by (2K+\) vertical projections of the 3-D scene. The projections are numbered by m and n, so that the middle projection is denoted by (m,ή) - (0,0), the upper right projection by (m,ή) = (KJC) and the lower left projection by (m,ή) = (-K, -K). The (m,n)-th projection Pm n[xp,yp ) is multiplied by a 2-D PSF and the product is summed to the (m,ή)-th pixel in a complex matrix as follows:
Figure imgf000022_0001
where E2[xp,yp ) represents the generating PSF of the 2-D hologram defined as follows:
E2(xp,yp)= A2 (bxp , byp
Figure imgf000022_0002
(17)
A1 and g2 are general functions depending on (xp , yp) and may be defined differently for every type of incoherent correlation hologram as discussed below. Once more, the function E2[xp,yp ) has the property that its Fourier transform is a pure phase function in order to enable a proper reconstruction as it is in the case of the 1-D hologram. The process manifested by Eq. (16) is repeated for all the projections, but in contrast to the 1-D case presented herein above, in the 2-D case, each projection contributes a single pixel to the hologram, rather than a column of pixels. In the end of this digital process, the obtained 2-D complex matrix H2(m,n) represents the 2-D incoherent correlation hologram of the 3-D scene.
The reconstructed plane s2{m,n;zr), located a distance zτ from the 2-D incoherent correlation hologram, is obtained by digitally convolving the hologram with a reconstructing PSF as follows:
S2 (m, n;zr) = \ H2 (m, n) * R2 (m, n\ zr ) |, (18) where this time * denotes a 2-D convolution and R2{m,n;zr) is the reconstructing PSF of the 2-D hologram, defined as follows:
R2(m,n;zr) = (19)
Figure imgf000023_0001
A2 and g2 are the same functions used in the generating PSF of the 2-D hologram in Eq. (17).
Two examples of incoherent correlation holograms
This section presents two possible incoherent correlation holograms, the DIMFH [9,10] and the DIPCH [10], where each of which has certain advantages over the regular types of digital holograms. The only difference between the DIMFH and the DIPCH is the definition of the
PSFs used in the generation and reconstruction of the hologram. More types of incoherent correlation holograms may be defined for gaining other advantages over the regular types of digital holograms, by using other
PSFs. Digital Incoherent Modified Fresnel Hologram (DIMFH) The DIMFH is actually an incoherent Fresnel hologram generated directly by processing the MVPs of the 3-D scene. This direct method is faster and more accurate than the Fourier-based Fresnel holography methods [4,11], since redundant calculations and approximation errors are avoided. The generation and the reconstruction of the 1-D DIMFH is performed by Eqs. (12) and (14), respectively, where the generating PSF is a 1-D quadratic phase function given by:
Eλ {xp,yp ) = exp(/2Λ6 V^) <20> Similarly, the 2-D DIMFH processing is carried out by Eqs. (16) and (18), where the generating PSF is a 2-D quadratic phase function given by:
E2(xp,yp) =
Figure imgf000024_0001
+ yp 2)] . (21)
Digital Incoherent Protected Correlation Hologram (DIPCH)
The DIPCH is a new type of incoherent correlation hologram which has two advantages over the Fresnel hologram in general and over the DIMFH in particular. First, since a constrained random PSF is used to generate the hologram, only an authorized user that knows this constrained random PSF can reconstruct the 3-D scene encoded into the hologram. Therefore, the DIPCH can be used as a method of encrypting the recorded 3-D scene. Second, the reconstruction obtained from the DIPCH has a significantly higher transverse resolution for far objects in the 3-D scene compared to the Fresnel hologram in general and to the DIMFH in particular. In fact, far objects recorded by the DIMFH are reconstructed with a reduced transverse resolution because of two reasons: (a) Due to the parallax effect, far objects 'moves' slower throughout the projections, and therefore they sample a magnified version of the generating PSF. This magnified version has narrower bandwidth and therefore the reconstruction transverse resolution of far objects decreases in comparison to the closest object, (b) The quadratic phase used in the DIMFH has lower frequencies as one approaches its origin. Since far objects are correlated with the central part of the quadratic phase function along a range that becomes shorter as much as the object is more far away, the bandwidth of the DIMFH of far objects becomes even narrower beyond the bandwidth reduction mentioned in (a). In contrast to the DIMFH, the spatial frequencies of the DIPCH are distributed uniformly all over its area. Therefore, the DIPCH suffers from resolution reduction of far objects only due the reason (a). Hence, the images of far objects reconstructed from the DIPCH, besides of being protected by the constrained random PSF, also have higher transverse resolution.
The 1-D DIPCH process is still defined by Eqs. (12) and (14). However, this time, the generating PSF is a random function which fulfills the constraint that its Fourier transform is a pure phase function. In order to find this PSF, the projection is used onto the constraint sets (POCS) algorithm [12,13]. The POCS algorithm used for finding this PSF is illustrated in Fig. 6. The POCS is an iterative algorithm which bounces from the PSF domain to its spatial spectrum domain and backward, using Fourier transform and its inverse transform. In each domain, the function is projected onto the constraint set. The two constraints of the POCS express the two properties required for the PSF of the DIPCH. First, the Fourier transform of the PSF should be a phase-only function. This requirement enables to reconstruct the DIPCH. Therefore, the constraint of the POCS in the spectral domain is the set of all phase-only functions and each transfer function is projected onto this constraint by setting its magnitude distribution to the constant 1. The other property of the PSF is that it should be space limited into a relatively narrow region close to but outside of the origin. This condition reduces the reconstruction noise from the out-of-focus objects because the overlap during the correlation between the resampled space-limited reconstructing PSF and the hologram at out- of-focus regions is lower than the case of using a wide-spread PSF. Of course, this noise is lower by as much as the existence region of the PSF is narrower. However narrowing the existence region makes it difficult for the POCS algorithm to converge to a PSF that satisfies both constraints with an acceptable error. In any event, the constraint set in the PSF domain is all of the complex functions that identically equal zero in any pixel outside the predefined narrow existence region. The projection onto the constraint set in the PSF domain is performed by multiplying the PSFs by a function that is equal to 1 inside the narrow existence region of the PSF and 0 elsewhere. In the case of the 1-D DIPCH, the constrained PSF looks like a narrow strip of columns, whereas in the case of the 2-D DIPCH this PSF looks like a narrow ring. In the end of the process, the POCS algorithm yields the suitable constrained random PSF that can be used in the hologram generation process. Figs 7A and 7B show the resulting PSFs that can be used for generating the 1-D and the 2-D DIPCHs, respectively.
Next is shown that the resolution for far objects in the case of DIMFH is worse than in the case of DIPCH. For a single object point, the resulting hologram in the case of DIMFH is exactly the PSF given by Eq. (20) or (21). These expressions are actually equal to the transfer function of a lens, for which the resolution properties are well known. For a single point located a distance Z1^n from the imaging system, the width of the recorded hologram is 2Kaf/zStm\n, and the smallest resolved detail, as mentioned herein above, is af/(Mzs,mm)- Now, for a point located a distance zs from the imaging system, the width of the recorded hologram is 2Kaf/zs. Since, as explained above, the DIMFH of an object point located in a distance zs from the imaging system, is equivalent to a lens, the hologram resolving power is linear dependent on its width. Therefore, the resolved detail of an object at some distance zs is the smallest ever resolved detail
Figure imgf000027_0001
multiplied by the ratio between the maximum hologram width, 2Kaf/zStm\n, and the actual hologram width, 2Kaf/zs. Hence the resolved detail of an object at some distance zs is
Figure imgf000028_0001
The recalled size of the resolved object's detail in the case of DIPCH is af/(Mzs,mn). Therefore, the ratio between the resolving power of the DIPCH and the DIMFH is (z/zs,mm). Again, this means that as much as the object is far from zsjnιn, the resolution power of the DIPCH over the DIMFH is better.
While this invention has been described in terms of specific examples, many modifications and variations are possible. It is therefore understood that within the scope of the appended claims, the invention may be realized otherwise than as specifically described.
REFERENCES
1. B. W. Schilling, T. -C. Poon, G. Indebetouw, B. Storrie, K. Shinoda, Y.
Suzuki, and M. H. Wu, "Three-dimensional holographic fluorescence microscopy," Opt. Lett. 22, 1506 (1997).
2. J. Rosen and G. Brooker, "Digital spatially incoherent Fresnel holography," Opt. Lett, (to be published).
3. D. Abookasis and J. Rosen, "Computer-generated holograms of three- dimensional objects synthesized from their multiple angular viewpoints," J. Opt. Soc. Am. A 20, 1537 (2003).
4. Y. Sando, M. Itoh, and T. Yatagai, "Holographic three-dimensional display synthesized from three-dimensional Fourier spectra of real existing objects," Opt. Lett. 28, 2518 (2003).
5. T. Mishina, M. Okui, and F. Okano, "Calculation of holograms from elemental images captured by integral photography," Appl. Opt. 45,
4026 (2006).
6. J. Goodman, Introduction to Fourier Optics, 2nd ed. (McGraw-Hill, New York, 1996), Chap. 5.
7. B. Javidi and A. Sergent, "Fully phase encoded key and biometrics for security verification," Opt. Eng. 36, 935-942 (1997).
8. D. Abookasis and J. Rosen, "Digital correlation holograms implemented on a joint transform correlator," Opt. Commun. 225, 31- 37 (2003). 9. N. T. Shaked and J. Rosen, "Modified Fresnel computer generated hologram directly recorded by multiple viewpoint projections," Accepted for Publication to Applied Optics - Special Issue on Digital Holography. To be published. 10. N. T. Shaked and J. Rosen, "Multiple viewpoint projection holograms synthesized by spatially-incoherent correlation with a general function," Submitted.
11. D. Abookasis and J. Rosen, "Three types of computer- generated hologram synthesized from multiple angular viewpoints of a three- dimensional scene," Appl. Opt. 45, 6533-6538 (2006).
12. J. R. Fienup, "Phase-retrieval algorithm: a comparison," Appl. Opt. 21, 2758-2769 (1982).
13. H. Stark, Image Recovery: Theory and Application, Academic Press, Orlando (1987), pp. 29-78 and pp. 277-320.

Claims

1. Method of obtaining a digital hologram of a three-dimensional (3-D) scene comprising the steps of: a. illuminating said scene with incoherent white-light; b. recording multiple projections of said 3-D scene; and c. computer processing of said projections by the performance of a predetermined sequence of mathematical operations; characterized in that a microlens array (MLA) is used to create said multiple projections in an image plane which is projected onto the imaging sensor of a camera, thereby allowing the obtaining of all of said multiple projections in a single camera shot.
2. A method according to claim 1, wherein said predetermined sequence of mathematical operations comprise the steps of: a. cutting the single shot image received from said camera into a set of projections of said 3-D scene; b. centering said projections on the same reference point; c. multiplying said centered projections by linear phase functions; and d. summing each of said multiplied results into a single complex value yielding a complex matrix which represents a digital hologram.
3. A method according to claim 1, wherein said predetermined sequence of mathematical operations comprising the digital incoherent modified Fresnel hologram (DIMFH) method.
4. A method according to claim 1, wherein said predetermined sequence of mathematical operations comprising the digital incoherent protected correlation hologram (DIPCH) method.
5. System for obtaining a digital hologram of a three-dimensional (3- D) scene comprising: a. a source of incoherent white-light; b. a collimating lens; c. a microlens array (MLA); d. a focusing lens; e. a camera; and f. a computer characterized in that: a. said MLA creates multiple images of said scene in the image plane of said MLA; b. said image plane is projected by said focusing lens onto the imaging sensor of said camera, thereby allowing the obtaining of all of said multiple projections of said scene in a single camera shot, which is transferred to said computer, wherein predetermined sequence of mathematical operations is preformed on said projections to obtain said digital hologram.
PCT/IL2008/000142 2007-02-05 2008-02-03 A method and system for obtaining digital holograms in a single camera shot using white-light WO2008096344A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US89940807P 2007-02-05 2007-02-05
US60/899,408 2007-02-05

Publications (2)

Publication Number Publication Date
WO2008096344A2 true WO2008096344A2 (en) 2008-08-14
WO2008096344A3 WO2008096344A3 (en) 2008-09-25

Family

ID=39512813

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2008/000142 WO2008096344A2 (en) 2007-02-05 2008-02-03 A method and system for obtaining digital holograms in a single camera shot using white-light

Country Status (1)

Country Link
WO (1) WO2008096344A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106097343A (en) * 2016-06-14 2016-11-09 西安理工大学 Optical field imaging equipment axial resolution determinator and method

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4621897A (en) * 1982-01-22 1986-11-11 Centre National de la Recherche Scientifique (CNRA) Optical apparatus and a method of recording or instantaneously visulizing enlarged and stereoscopic images of objects

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4621897A (en) * 1982-01-22 1986-11-11 Centre National de la Recherche Scientifique (CNRA) Optical apparatus and a method of recording or instantaneously visulizing enlarged and stereoscopic images of objects

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
ABOOKASIS D ET AL: "Computer-generated holograms of three-dimensional objects synthesized from their multiple angular viewpoints" JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A (OPTICS, IMAGE SCIENCE AND VISION) OPT. SOC. AMERICA USA, vol. 20, no. 8, August 2003 (2003-08), pages 1537-1545, XP007905028 ISSN: 0740-3232 cited in the application *
ABOOKASIS D ET AL: "THREE TYPES OF COMPUTER-GENERATED HOLOGRAM SYNTHESIZED FROM MULTIPLE ANGULAR VIEWPOINTS OF A THREE-DIMENSIONAL SCENE" APPLIED OPTICS, OSA, OPTICAL SOCIETY OF AMERICA, WASHINGTON, DC, vol. 45, no. 25, 1 September 2006 (2006-09-01), pages 6533-6538, XP007901027 ISSN: 0003-6935 cited in the application *
CHOI KYONGSIK ET AL: "Full parallax viewing-angle enhanced computer-generated holographic 3D display system using integral lens array" OPTICS EXPRESS, OPTICAL SOCIETY OF AMERICA, WASHINGTON, DC, US, vol. 13, no. 26, 22 December 2005 (2005-12-22), pages 10494-10502, XP007905008 ISSN: 1094-4087 *
OKANO F ET AL: "Real-time pickup method for a three-dimensional image based on integral photography" APPLIED OPTICS OPT. SOC. AMERICA USA, vol. 36, no. 7, 1 March 1997 (1997-03-01), pages 1598-1603, XP002485813 ISSN: 0003-6935 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106097343A (en) * 2016-06-14 2016-11-09 西安理工大学 Optical field imaging equipment axial resolution determinator and method
CN106097343B (en) * 2016-06-14 2018-11-16 西安理工大学 Optical field imaging equipment axial resolution measurement device and method

Also Published As

Publication number Publication date
WO2008096344A3 (en) 2008-09-25

Similar Documents

Publication Publication Date Title
Tsang et al. Review on the state-of-the-art technologies for acquisition and display of digital holograms
CA2133559C (en) Methods of hologram constructions using computer-processed objects
Takaki et al. Simplified calculation method for computer-generated holographic stereograms from multi-view images
TWI431443B (en) Holographische rekonstruktionseinrichtung
JP5258049B2 (en) Multi-view image generation apparatus, multi-view image generation method, and multi-view image generation program
Yoshikawa et al. Computer generated rainbow hologram
Michalkiewicz et al. Holographic three-dimensional displays with liquid crystal on silicon spatial light modulator
Kreis Applications of digital holography: from microscopy to 3D-television
Park et al. Numerical reconstruction of full parallax holographic stereograms
Shaked et al. Multiple-viewpoint projection holograms synthesized by spatially incoherent correlation with broadband functions
WO2008096344A2 (en) A method and system for obtaining digital holograms in a single camera shot using white-light
Chen et al. Field of view expansion for 3-D holographic display using a single spatial light modulator with scanning reconstruction light
Agour et al. Experimental investigation of holographic 3D-TV approach
Fienup et al. Gigapixel synthetic-aperture digital holography
SHOT kk bandwidth of the light source used. These strict requirements inhibit the usage of conventional holography for many practical
JP2004264839A (en) Computer-synthesized hologram
Kinoshita et al. Computer-generated holograms at an arbitrary viewpoint synthesized from multi-view images
IL et al. PCT (10) International Publication Number WO 2008/096344 A2
Shaked et al. Fresnel incoherent digital holograms directly recorded by multiple viewpoint projections
Shaked et al. Holography of incoherently illuminated 3D scenes
He et al. Single-shot phase retrieval based on axial phase diversity
Park et al. Fourier hologram generation from multiple incoherent defocused images
Ikeda et al. Calculation technique for a holographic stereogram generation from multi-view images
KR101233350B1 (en) hologram transcoding apparatus and the method thereof
Yoshikawa et al. Computer-generated rainbow hologram

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08702721

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 08702721

Country of ref document: EP

Kind code of ref document: A2