A kind of augmented reality holography display methods based on complex amplitude modulation
Technical field
The present invention relates to a kind of holographic display methods, the holographic display of particularly a kind of augmented reality based on complex amplitude modulation
Method.
Background technology
Augmented reality is by the dummy object of computer generation, scene or system prompt information superposition to real world
In scene, perception of the enhancing user to real world.With continuing to develop for this problem, a series of use have nowadays been occurred in that
The technology and product shown in augmented reality, the wherein Hololens of Microsoft are based on diffraction-type head-up display principle, using advanced
Sensor, miniature high-resolution high-contrast Minitype digital optical processor projection (DLP Pico) technology, realize preferably
Augmented reality display effect.However, due to the limitation of technology and device, very three-dimensional, big visual angle is realized on wearable device,
The augmented reality for calculating in real time shows also there are some obstacles.
Holography based on complex amplitude modulation is a kind of technology that can rebuild object complex amplitude light field, by the skill
Art is applied to augmented reality display system and can improve the depth of field of display content, reduces the fatigue that human eye is frequently focused on.Meanwhile, profit
Can effectively increase the angle of visual field as light source with spot light, alleviate traditional diffraction-type augmented reality HUD small nothing of the system angle of visual field
The problem of the depth of field.Diffraction efficiency can be greatly improved using phase type spatial light modulator, while so that imaging system is lighter
Just it is applied to wearable device.
The content of the invention
Goal of the invention:It is an object of the present invention to provide a kind of augmented reality holography display methods based on complex amplitude modulation, should
Method can modulate the speckle issue in the holographic imaging for avoiding random phase from bringing by complex amplitude, strengthen picture contrast,
The depth of field and the visual angle of imaging by using spot light, can be increased simultaneously, the holographic imaging of real-time calculating is applicable to.
Technical scheme:Augmented reality holography display methods based on complex amplitude modulation of the present invention, including following step
Suddenly:
1) spot light, phase type spatial light modulator, lens and filtering diaphragm are laid, makes the light wave that spot light sends successively
By phase type spatial light modulator, lens and filtering diaphragm;
2) according to final reconstruction image, the position of the complex amplitude light field generated needed for acquisition phase type spatial light modulator,
Amplitude and phase parameter;
3) according to resolution of vectors principle, the light vector of the complex amplitude light field each pixel is decomposed into two pure phases positions
Value, obtains two phase-only holograms equal-sized with artwork;Two phase-only holograms are carried out using gridiron pattern pattern
Sampling synthesis, plus the slant plane wave factor on the phase-only hologram that synthesis is obtained, obtains encoded pure phase hologram
Figure;
4) by step 3) the encoded phase-only hologram that obtains is transferred in phase type spatial light modulator, makes a light
The light wave that source sends is projected after carrying out phase-modulation in phase type spatial light modulator, realizes reconstruction image with reality scene
Superposition.
Wherein, waveguide or the first Amici prism are provided between lens and filtering diaphragm, by waveguide or the first Amici prism
Realize being superimposed for reconstruction image and reality scene;Phase type spatial light modulator is reflective phase type spatial light modulator, point
The reflected mirror of light wave or the second Amici prism that light source sends reach reflective phase type spatial light modulator.
In order to avoid reconstruction image is influenceed by device zero order wave, according to slant plane wave factor adjustment filtering diaphragm
Position and size, make filtering diaphragm for rectangular filter diaphragm, and filtering diaphragm is located at the frequency plane (u, v) of phase-only hologram, i.e.,
Imaging surface of the spot light on lens, frequency plane (u, v) is parallel to spatial light modulator plane (x, y) and lens plane, frequency spectrum
With lens centre, spatial light modulator center and spot light on the same line, the straight line is vertical for face (u, v) origin (0,0)
In frequency plane (u, v), the positive direction of (u, v) reference axis is identical with the positive direction of spatial light modulator plane coordinates axle (x, y);Filter
The glistening light of waves door screen center position coordinates beThe size of rectangular filter diaphragm is u direction of principal axisv
Direction of principal axisd1It is spot light and the vertical optical path distance of phase type spatial light modulator, d2For phase type is empty
Between optical modulator and lens distance, d3It is filtering diaphragm and the distance of lens, d3By lens imaging formula
Draw.
Step 2) in, the method for obtaining the position of complex amplitude light field is specially:
Complex amplitude light field is calculated with the diffraction of phase type spatial light modulator apart from l1:
Wherein, l2=d1, it is the vertical optical path distance of spot light and phase type spatial light modulator;l3Drawn by following formula:
Wherein, d2It is phase type spatial light modulator and the distance of lens, f is the focal length of lens, d3It is lens to filtering light
The distance of door screen, d3By lens imaging formulaDraw, d4It is final reconstruction image and the distance of human eye.
Step 3) in, gridiron pattern pattern is M1(iΔx0, j Δs y0)、M2(iΔx0, j Δs y0) pattern, M1(iΔx0, j Δs
y0) and M2(iΔx0, j Δs y0) meet:
M1(iΔx0, j Δs y0)+M2(iΔx0, j Δs y0)=1
Wherein, Δ x0、Δy0It is the pel spacing of spatial light modulator, i, j are the label of pixel, i ∈ (1, N), j ∈
(1, M), i, j are integer.
Obtaining complex amplitude isOutput face, after pixelation resolution ratio for M × N input
The pure phase code formula in face (x, y) is:
φ(iΔx0, j Δs y0)=M1(iΔx0, j Δs y0)θ1(iΔx0, j Δs y0)
+M2(iΔx0, j Δs y0)θ2(iΔx0, j Δs y0)+2πiΔx0sinα/λ
Wherein, A (x, y) represents the amplitude of complex amplitude light field,Represent the phase of complex amplitude light field;φ(iΔx0, j
Δy0) it is the phase value for being input to spatial light modulator, Δ x0、Δy0It is the pel spacing of spatial light modulator, 2 π i Δs x0sin
α/λ is the slant plane wave factor for tilting,λ is that optical wavelength i, j are the label of pixel, i
∈ (1, N), j ∈ (1, M), i, j are integer, θ1(iΔx0, j Δs y0) and θ2(iΔx0, j Δs y0) drawn by following two formula:
AmaxIt is the maximum of A (x, y).
Beneficial effect:Method of the present invention has the advantages that:
1st, reconstruction image speckle is eliminated.Present invention uses the method for complex amplitude modulation, modulation image can shake simultaneously
Width and phase, compared with traditional GS iterative algorithms that can only rebuild target amplitude, it is to avoid due to adjacent in light field is rebuild
Coherent interference between pixel produces extra intensity pattern, i.e. speckle noise, substantially increases picture quality.
2nd, avoid reconstruction image is influenceed by device zero order wave.Slant plane wave of the present invention according to added by hologram because
Son sets position and the size of filtering diaphragm, and after the addition slant plane wave factor, zero order wave and the complex amplitude coding of device are complete
The zero order wave for ceasing figure image can be separated in frequency plane, and can just the zero level information of hologram be being leached while avoiding device during filtering
The interference of part zero level noise, system need not lay polarizer, while so that image is not covered by zero order wave, picture contrast increases
By force.
3rd, compared with general resolution of vectors complex amplitude modulator approach, complex amplitude modulator approach of the invention will not change figure
The size in face.According to the principle of resolution of vectors, vector can always be decomposed into two vectors that amplitude is identical, phase is different
Superposition.Therefore, the reconstruction image of n × n is obtained in traditional resolution of vectors complex amplitude modulator approach just at least needs 2n × n big
Small complex amplitude code pattern so that image size at least reduces one times.And the chessboard trellis coding that this complex amplitude modulator approach is used
Mode, the size and complex amplitude code pattern size of reconstruction image are identicals.
4th, the depth of field of display content can be improved using spot light, the fatigue that human eye is frequently focused on is reduced, while can have
The effect increase angle of visual field, alleviates the small problem of traditional diffraction-type augmented reality HUD system angle of visual field.
5th, the holographic computational methods optimized compared to conventional iterative, method proposed by the present invention is greatly shortened without iteration
Hologram calculates the time, is applicable to the holographic imaging of real-time calculating.
Brief description of the drawings
Fig. 1 is the index path that the light wave that spot light sends injects human eye after phase modulation of spatial light modulators;
Fig. 2 is the meta of final reconstruction image (institute into the virtual image), spot light, spatial light modulator, lens and imaging surface
Put relation schematic diagram;
Fig. 3 is the index path of display system when using reflective phase type spatial light modulator.
Specific embodiment
Embodiment 1
Augmented reality holography display methods based on complex amplitude modulation, comprises the following steps:
(1) display system is laid.
As shown in figure 1, spot light 2, phase type spatial light modulator 3, lens 4 and filtering diaphragm 5 are laid successively, light is put
Position relationship between source 2, lens 4 and filtering diaphragm 5 meets imaging formula, spatial light modulator 3 and generation phase hologram
Computer 1 by data wire connect.The spherical wave that spot light 2 sends injects phase type spatial light modulator 3, then passes through successively
Cross lens and filtering diaphragm enters human eye.The location of phase type spatial light modulator 3 forms input plane (x, y), diaphragm
Positioned at frequency plane (u, v).
Augmented reality display system using reflective phase type spatial light modulator is as shown in Figure 3:What spot light 2 sent
Spherical wave enters spatial light modulator 3 by the second Amici prism 7, and lens 4, the first light splitting are sequentially passed through through the light field of ovennodulation
Prism 8 and filtering diaphragm 5 enter human eye, the reality scene of the opposite side of the first Amici prism 8 by the first Amici prism 8 also into
Human eye, realizes the display effect of augmented reality.
(2) position according to final reconstruction image and content, with reference to optical system parameter, obtain phase type space light modulation
The position of the complex amplitude light field of generation, amplitude and phase parameter needed for device.
Calculate the complex amplitude light field and spot light 2, facies pattern spatial light modulator of generation needed for phase type spatial light modulator 3
3rd, the distance between lens 4 and the plane 6 where final reconstruction image relation are as shown in Figure 2.Wherein, final reconstruction image tool
Body refers to the complex amplitude light field that is generated of phase type spatial light modulator 3 by the virtual image formed by lens 4.
The specific method for determining diffraction distance is:
Assuming that to be d apart from human eye distance4The final reconstruction image of one, 6 one-tenth of plane at place, then it is multiple during computed hologram
Amplitude Diffraction of Light apart from l1For:
Wherein l2=d1, it is the vertical optical path distance between spot light 2 and phase type spatial light modulator 3, l3For reality is multiple
Diffraction distance between amplitude light field and spatial light modulator, l3Be given by formula (2)
Wherein d2It is the vertical optical path distance of phase type spatial light modulator 3 to lens 4, f is the focal length of lens 4, d3For saturating
Mirror 4 (is located at the imaging surface of spot light, therefore d due to filtering diaphragm 5 to the vertical optical path distance of spot light imaging3Also it is
Vertical optical path distance of the mirror 4 to filtering diaphragm 5), d3By lens imaging formulaDraw.
Obtain the amplitude of the complex amplitude light field of generation needed for phase type spatial light modulator and the method for phase parameter is specific
For:
If the image of target generation is U (ξ, η)=A (ξ, η) e0, its plane is even phase for wherein phase, can be set to
0.Then the complex amplitude light field of generation is by taking fresnel diffraction as an example needed for spatial light modulator:
Wherein z=-l1, k is wave number, and λ is wavelength, and j is imaginary unit, and (ξ, η) is the seat of image surface corresponding with (x, y)
Mark.
(3) the complex amplitude modulator approach decomposed using quarter-phase is encoded to complex amplitude light field.
As shown in table 1, according to resolution of vectors principle, the light vector of complex amplitude light field each pixel is decomposed into two pure phases
Place value, obtains two phase-only holograms equal-sized with artwork, and two phase-only holograms are entered using gridiron pattern pattern
Row sampling synthesis, plus the slant plane wave factor on the phase-only hologram that synthesis is obtained, obtains encoded pure phase position complete
Breath figure.
The specific method that complex amplitude light field is encoded into phase-only hologram is as follows.
Random two-dimensional complex amplitude light field can be represented with formula (4):
In formula (4), A (x, y) represents the amplitude of complex amplitude light field,Represent the phase of complex amplitude light field.According to arrow
The principle decomposed is measured, any one vector can be synthesized by two equal vectors of mould, such that it is able to obtain following formula:
In formula, B=Amax/ 2 is a constant, AmaxIt is the maximum of A (x, y), θ1(x, y) and θ2(x, y) is respectively by following
Two formulas are obtained:
It is assumed that to obtain complex amplitude beingOutput face, resolution ratio is for M × N after pixelation
The pure phase code formula of input face (x, y) is:
In formula (8), Δ x0、Δy0It is the pel spacing of spatial light modulator, i, j are the label of pixel, i ∈ (1, N), j
∈ (1, M), i, j are integer.Can be seen that the quarter-phase complex amplitude coding method for using of the invention by above-mentioned coding result need not
Extra pixel is sacrificed, i.e., the reconstruction image that obtain n × n only needs to the complex amplitude code pattern of n × n sizes.φ(iΔx0, j
Δy0) it is the phase value for being input to spatial light modulator, θ1(iΔx0, j Δs y0) and θ2(iΔx0, j Δs y0) by formula (9) and formula
(10) determine;M1(iΔx0, j Δs y0) and M2(iΔx0, j Δs y0) determined by formula (11) and formula (12):
M1(iΔx0, j Δs y0) and M2(iΔx0, j Δs y0) equation is met all the time:
M1(iΔx0, j Δs y0)+M2(iΔx0, j Δs y0)=1 (13)
Generally, also by M1(iΔx0, j Δs y0)、M2(iΔx0, j Δs y0) pattern be referred to as gridiron pattern.2πiΔx0 sinα/λ
It is the slant plane wave factor for tilting, specific determination method is:
The resolution ratio of spatial light modulator is designated as MM × NN, and the resolution ratio of the phase-only hologram of input face (x, y) is less than
Equal to the resolution ratio of spatial light modulator, the region beyond the phase-only hologram of coding, spatial light modulator all pixels
Phase value be set to π;Slant plane wave factor wave vector is α with the angle of horizontal direction, by adopting for phase type spatial light modulator 3
Sample spacing determines, because α is smaller, so sin α ≈ tan α, generally desirableWherein Δ x0It is spatial light
Modulator x-axis direction is the pel spacing of horizontal direction, and λ is optical wavelength.
Table 1
4) computer by data wire by step 3) the encoded phase-only hologram that obtains is transferred to phase type space
In optical modulator 3, projected after the light wave that spot light 2 sends is carried out phase-modulation in phase type spatial light modulator 3, realized
Reconstruction image is superimposed with reality scene.
5) position according to slant plane wave factor adjustment filtering diaphragm and size, make the zero order wave of hologram through filtering
Diaphragm, while blocking the zero level wave interference of spatial light modulator, is imaged on being close to filter the human eye retina of diaphragm.
The position of diaphragm 5 is filtered by the inclination alpha of the slant plane wave factor, phase type spatial light modulator 3 and spot light 2
Apart from d1, phase type spatial light modulator 3 to lens 4 is apart from d2And the focal length f of lens 4 determines;The light modulation of phase type space
The size of device 3 is (square vertically by the x-axis direction (horizontal direction) of phase type spatial light modulator 3 and y-axis direction according to sampling thheorem
To) pel spacing Ax0、Δy0, wavelength X and d1, d2, f determines that specific determination method is:
Filtering diaphragm is located at the frequency plane (u, v) of phase-only hologram, i.e. imaging surface of the spot light on lens, frequency plane
(u, v) parallel to spatial light modulator plane (x, y) and lens plane, the origin (0,0) of frequency plane (u, v) and lens centre,
On the same line, the straight line is perpendicular to frequency plane (u, v), (u, v) reference axis for spatial light modulator center and spot light
Positive direction and spatial light modulator plane coordinates axle positive direction (x, y) it is identical;The position coordinates at filtering diaphragm center isThe size of rectangular filter diaphragm is u direction of principal axisV direction of principal axisd1For
The vertical optical path distance of spot light and phase type spatial light modulator 3, d2For phase type spatial light modulator is vertical with lens
Optical path distance, d3It is filtering diaphragm and the vertical optical path distance of lens, d3By lens imaging formulaDraw.
In the present invention, encoded phase-only hologram is loaded into phase type spatial light modulator 3 by computer 1,
The light that spot light 2 sends injects phase type spatial light modulator 3, and light wave carries out phase-modulation in phase spatial light modulator 3
After project, by lens 4 after, diaphragm 5 is filtered after filtering, make first-order diffraction through filtering diaphragm 5, human eye be close to filter
Glistening light of waves door screen is it can be seen that the virtual image without speckle.
Embodiment 2
Display system is obtained using the structure shown in Fig. 3.That is, computer 1 passes through data wire and reflective phase type space
Optical modulator 3 is connected, reflective phase type spatial light modulator 3, the second Amici prism 7, lens 4, the first Amici prism 8, filter
Glistening light of waves door screen 5 sets gradually, and spot light 2 is located at the top of the second Amici prism 7.The relative position of each optical element is caused more than setting
The light that spot light 2 sends injects reflective phase type spatial light modulator 3 by the light splitting of the second Amici prism 7, then sequentially passes through
Second Amici prism 7, lens 4, the first Amici prism 8 and filtering diaphragm 5.
Spot light 2 uses LED point light source, sends wavelength by LED point light source and is about 532 nanometers of green glow and is projected;
The phase spatial light modulator Holoeye Pluto that phase type spatial light modulator 3 is produced using Holoeye companies of Germany, its
Specification is 1920 × 1080 pixels, and pel spacing is 8 microns, i.e. Δ x0=Δ y0=8 μm;The focal length f of lens 4 is 0.1 meter.
Rectangular filter diaphragm is located at the frequency plane (u, v) of phase-only hologram, and frequency plane (u, v) is parallel to space light modulation
Device plane (x, y) and lens plane, origin (0,0) and lens centre, spatial light modulator center and the point of frequency plane (u, v)
Light source on the same line, perpendicular to frequency plane (u, v), the positive direction and spatial light modulator of (u, v) reference axis put down by the straight line
The positive direction (x, y) of areal coordinate axle is identical;LED point light source apart from phase type spatial light modulator 3 vertical optical path apart from d1For
0.05 meter, the vertical optical path of phase type spatial light modulator 3 and lens 4 is apart from d2It is 0.13 meter, then encodes inclination in formula (8)
The angle of inclination of plane is sin α ≈ 0.02351.
The coordinate at the center of rectangular filter diaphragm 5 is (1.47mm, 0), the size of rectangular filter diaphragm 5 for 1.47mm ×
1.47mm。
In the display system, encoded phase-only hologram is loaded into phase space light modulation by computer 1
In device 3, the light that spot light 2 sends injects phase type spatial light modulator 3 by the light splitting of the second Amici prism 7, and light wave is in phase
Carry out projecting after phase-modulation in type spatial light modulator 3, by lens 4 after, inject the first Amici prism 8, after filtering
Diaphragm 5 is filtered, and human eye is close to filtering diaphragm 5 it can be seen that the virtual image without speckle is true with the opposite side of the first Amici prism 8
The augmented reality display result of scene fusion.
If final reconstruction image (i.e. institute into the virtual image) is 0.625 meter with the distance of human eye, then Diffraction Calculation complex amplitude light field
Apart from phase type spatial light modulator 3 apart from l1It is 0.025 meter.
According to parameter determined above, using the method described in the step of embodiment 1 (3) it is encoded after to obtain pure phase position complete
Breath figure.The phase-only hologram for obtaining is loaded into spatial light modulator 3 by computer 1, it becomes possible to obtained accordingly in plane 6
The virtual image of reconstruction.Method due to having used complex amplitude to modulate, effectively eliminates speckle, substantially increases picture quality.Meanwhile,
Due to having used LED point light source as light source, the depth of field and visual angle that image expands simultaneously have been further smoothed.