CN109683461A - Method for generating holograms, system, storage medium and nearly eye AR hologram three-dimensional display system based on light field rendering - Google Patents
Method for generating holograms, system, storage medium and nearly eye AR hologram three-dimensional display system based on light field rendering Download PDFInfo
- Publication number
- CN109683461A CN109683461A CN201910067317.XA CN201910067317A CN109683461A CN 109683461 A CN109683461 A CN 109683461A CN 201910067317 A CN201910067317 A CN 201910067317A CN 109683461 A CN109683461 A CN 109683461A
- Authority
- CN
- China
- Prior art keywords
- light
- light field
- field rendering
- hologram
- plane
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000009877 rendering Methods 0.000 title claims abstract description 129
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000003860 storage Methods 0.000 title claims abstract description 15
- 238000005286 illumination Methods 0.000 claims description 20
- 230000003287 optical effect Effects 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 7
- 238000001093 holography Methods 0.000 description 13
- 238000001914 filtration Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000001228 spectrum Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 239000013307 optical fiber Substances 0.000 description 5
- 230000003321 amplification Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 238000003199 nucleic acid amplification method Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 239000000835 fiber Substances 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 230000004941 influx Effects 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 239000004576 sand Substances 0.000 description 2
- 241001502050 Acis Species 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 208000003464 asthenopia Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 208000002173 dizziness Diseases 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000003760 hair shine Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000001259 photo etching Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000004304 visual acuity Effects 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0465—Particular recording light; Beam shape or geometry
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B27/0103—Head-up displays characterised by optical features comprising holographic elements
- G02B2027/0105—Holograms with particular structures
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B27/0103—Head-up displays characterised by optical features comprising holographic elements
- G02B2027/0109—Head-up displays characterised by optical features comprising holographic elements comprising details concerning the making of holograms
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Holo Graphy (AREA)
Abstract
The invention discloses a kind of method for generating holograms, system, storage medium and nearly eye AR hologram three-dimensional display systems based on light field rendering.The method for generating holograms, comprising: (1) construct at least two light field rendering planes, each light field rendering plane is made of several luminous points；(2) three dimensional point cloud of three-dimension object is rendered to respectively on different light field rendering planes, obtains the light field image of each light field rendering plane；(3) point spread function by the light field image of light field rendering plane and the light field image on holographic facet carries out convolution, obtains complex amplitude of the light field image on holographic facet；(4) complex amplitude of the light field image of all light field rendering planes on holographic facet is overlapped, introduces reference light interference later and calculate and encoded, obtains the hologram of the three-dimension object.The method for generating holograms calculating speed is fast, can be realized holographic map generalization real-time, quickly.
Description
Technical field
The present invention relates to hologram three-dimensional display field more particularly to it is a kind of based on light field rendering method for generating holograms,
System, storage medium and nearly eye AR hologram three-dimensional display system.
Background technique
Currently, nearly eye AR Three-dimensional Display is an important field of research and application field, nearly eye AR Three-dimensional Display is realized
Mode there are many, such as realize AR Three-dimensional Display using micro-display and complicated eyepiece system, utilize three that the program is realized
Dimension display is mostly binocular parallax Three-dimensional Display, there are influx conflict, wear such AR three-dimensional display apparatus can cause asthenopia and
Dizziness, to teen-age visual acuity, there are certain adverse effects, are not suitable for teenager and wear.
It is shown when realizing nearly eye AR Three-dimensional Display using optical waveguide and coupling grating technology compared to complicated eyepiece system
Show that system bulk and weight greatly reduce, is an important development direction of nearly eye AR Three-dimensional Display at present, however it is most
Nearly eye AR Three-dimensional Display based on optical waveguide is still the Three-dimensional Display of binocular parallax Three-dimensional Display or more depth, however it remains spoke
The problem of concentrate around one point, as spokes on acis conflicts.
Light field display technology is that the dimension display technologies of the direction of propagation of light are controlled using certain mode, such as using micro-
Lens array etc. controls the direction of propagation of light.The defect that Three-dimensional Display is carried out using the technology is the image angle shown
Resolution ratio is low, in 3-D image a point, is the object point of the low angular resolution synthesized by the light of sparse multiple directions.
The true stereoscopic display that holography display is realized using principle of holography, is internationally recognized optimal Three-dimensional Display
Scheme.Whole features of stereoscopic display can be seen in human eye, and have parallax and occlusion effect.It is observed in different positions
When, object has significant motion parallax.It is optimal dimension display technologies that hologram three-dimensional, which is shown, and dynamic holographic three-dimensional is aobvious at present
The calculating holography for showing field is a research hotspot.
Calculating holographic production model mainly has based on three kinds of point member, face element and layering.Hologram based on member generates
In method as, object is regarded to the composition of a large amount of three-dimensional object points, calculate complex amplitude of each object point on holographic facet and is superimposed
To the complex amplitude of entire object light；In hologram image generation method based on face element, mainly use Triangular object model as data cell,
Three-dimension object regarded to the combination of a large amount of Triangular object models as, the conversion of use space coordinate and frequency domain transformational relation when calculating, in frequency
The frequency spectrum of three-dimension object light wave is reconstructed in domain, is carried out inverse Fourier transform later and is obtained the complex amplitude of the object light on holographic facet；Base
In the method for generating holograms of layering, three-dimension object is divided into multilayer along the direction z, each layer of distribution passes through Fresnel
Diffraction, calculates the complex amplitude of hologram plane, complex amplitude superposition of all layers on holographic facet, obtains answering for total object light on holographic facet
Amplitude.It obtains on holographic facet after the complex amplitude of object light, introduces reference light interference calculating and be encoded to computed hologram.
Above-mentioned three kinds of method for generating holograms all suffer from problem that is computationally intensive, calculating time length, if realizing meter in real time
Calculation will need great hardware resource, be that hologram three-dimensional shows a great obstacle for being applied to nearly eye AR Three-dimensional Display.
Summary of the invention
The present invention provides a kind of method for generating holograms based on light field rendering, compared to existing hologram generation side
The features such as method, method for generating holograms of the invention have calculation amount few, and calculating speed is fast.
Specific technical solution is as follows:
A kind of method for generating holograms based on light field rendering, comprising the following steps:
(1) at least two light field rendering planes are constructed, each light field rendering plane is made of several luminous points；At one
In light field rendering plane, the light emitting angle of each luminous point is identical with light emission direction；It is each to shine in different light field rendering planes
The light emitting angle of point is identical and light emission direction is different；
(2) three dimensional point cloud of three-dimension object is rendered to respectively on different light field rendering planes, obtains each light field
The light field image of rendering plane；
(3) light field image of light field rendering plane and point spread function of the light field image on holographic facet are rolled up
Product, obtains COMPLEX AMPLITUDE of the light field image on holographic facet；
(4) COMPLEX AMPLITUDE of the light field image of all light field rendering planes on holographic facet is overlapped, is obtained total
Object light COMPLEX AMPLITUDE, introduce reference light interference calculate simultaneously is encoded, obtain the hologram of the three-dimension object.
The light emitting angle refers to the light emitting region angle an of luminous point, and light emission direction refers to the center of light emitting angle
Angle between line and light field rendering plane normal.
The method for generating holograms calculation amount rendered the present invention is based on light field is smaller, and the light field figure of light field rendering plane
As rendering and calculatings of holographic facet complex amplitude can carry out parallel acceleration calculating in GPU video memory, it can be achieved that hologram it is quick
It calculates and is used for real-time three-dimensional and show.
Constructed light field rendering plane can be located at additional or three-dimensional point cloud object the inside of three-dimensional point cloud object.
In step (1), when constructing light field rendering plane, the parameter of light field rendering plane by display hologram spatial light tune
The angle of diffraction and resolution of eye of device processed determine.
That is, the number of light field rendering plane by display hologram spatial light modulator angle of diffraction and light field render it is flat
The light emitting angle of luminous point determines on face: the angle of diffraction of definition space optical modulator is θ, the light emitting angle of light field rendering plane
For Δ θ；It is equal it is observed that image, the then quantity of the light field rendering plane at least needed in order to meet the human eye in θ angular rangeAnd two adjacent light emission direction light field rendering plane light emission direction differential seat angle be less than or equal to Δ θ.At this point, all
The light emitting angle of light field rendering plane covers entire θ angle.WhereinP is the pixel ruler of spatial light modulator
Very little, λ is the wavelength of illumination light.
Further, the light emitting angle of luminous point is determined by the angular resolution of human eye on light field rendering plane: defining Δ is
The size of one object point of three-dimension object, zpmaxTo be rendered with light field rendering plane apart from farthest object point to light field in three-dimension object
The distance of plane, the then light emitting angle of light field rendering plane
Further, Δ=δgzd, wherein δeFor the angular resolution of human eye, in display field, the resolution angle of human eye is generally set
It is set to δe=1.5 '.zdBy human eye to the distance for the picture point watched,
Preferably, all light field rendering planes are located at same depth.At this point, rendering obtains on each light field rendering plane
Light field image is equal with the distance between holographic facet.
Furthermore it is possible to only set a light field rendering plane, then the plane is the two-dimensional projection on three-dimensional article assigned direction
Image, the hologram being calculated and be shown at this time realize two-dimentional display.
Step (2) includes:
According to the coordinate of three-dimension object object point, the light emission direction of light field rendering plane and three-dimension object object point and light field wash with watercolours
The distance between plane is contaminated, the three-dimension object object point corresponding coordinate on light field rendering plane is calculated, and rendered, obtains
Light field image of the three-dimension object on the light field rendering plane；
The image of different light field rendering planes is rendered according to light emitting angle and direction, it is flat to obtain different light field renderings
The light field image in face.
In step (3), point spread function of the light field image of light field rendering plane on holographic facet is indicated are as follows:
Wherein, λ is the wavelength of illumination light, xhFor the coordinate of holographic facet, d is between the light field rendering plane and holographic facet
Distance.
When carrying out color hologram Three-dimensional Display, different colours component is made according to the wavelength of R, G, B illumination light respectively
Hologram, the display lighting source of hologram synchronize control, carry out timesharing color three dimension and show.
Based on identical inventive concept, the present invention also provides a kind of holograms based on light field rendering to generate system, packet
It includes computer storage, computer processor and is stored in the computer storage and can be in the computer processor
The computer program of upper execution, based on light field rendering described in realization when the computer processor executes the computer program
The step of method for generating holograms.
It can be desktop computer, laptop, palm that the hologram based on light field rendering, which generates system,
The computer equipments such as computer, microcomputer, remote server.
In addition, the computer-readable medium storage has meter the present invention also provides a kind of computer readable storage medium
Calculation machine program, the computer program, which is subsequently can by computer, realizes the hologram generation side based on light field rendering when device executes
The step of method.
The computer readable storage medium can be deposited for memory bar, mobile hard disk, plug-in type hard disk, CD, intelligence
Card storage, flash card etc..
The present invention also provides the nearly eyes for the hologram that the method for generating holograms based on light field rendering described in one kind generates
AR hologram three-dimensional display system, comprising:
Light source module provides illumination light for spatial light modulator；
Spatial light modulator is controlled by computer and is loaded into hologram by computer, issues after being modulated to illumination light
By the diffraction image light of the hologram modulates and not by the zero order light of the hologram modulates and Advanced Diffraction light；
Filter module is filtered the modulated light of spatial modulator, filters out the zero order light and Advanced Diffraction
Light；
Human eye is imaged in the filtered light field of filter module to AR lens module；
Computer according to the method for generating holograms production hologram based on light field rendering and is loaded into the space
Optical modulator.
The filter module is 4f optical filter system.
It is further preferred that nearly eye AR hologram three-dimensional display system includes:
Light source issues illumination light；
Illumination light is reflexed to semi-transparent semi-reflecting eyeglass by reflecting optics；
Illumination light part is reflexed to lens one by semi-transparent semi-reflecting eyeglass；
The illumination light of lens one, semi-transparent semi-reflecting eyeglass reflection forms plane wave after lens one, illuminates space light modulation
Device；
Spatial light modulator is controlled by computer and is loaded into hologram by computer, issues after being modulated to illumination light
By the diffraction image light of the hologram modulates and not by the zero order light of the hologram modulates and Advanced Diffraction light；
Lens two, the light that spatial light modulator issues enter lens two after lens one, semi-transparent semi-reflecting eyeglass；Lens one
4f optical system is formed with lens two, filter is provided on the focal plane of 4f optical system, filter filters out described zero
Grade light and Advanced Diffraction light；
Human eye is imaged in the filtered light field of filter module to AR lens module；
Computer according to the method for generating holograms production hologram based on light field rendering and is loaded into the sky
Between optical modulator.
The nearly eye AR hologram three-dimensional display system architectures are more compact, so that nearly eye AR hologram three-dimensional display system volume
It is small, light-weight.
Due to the dot structure and filling rate problem of spatial light modulator, there is the direct current point not being diffracted in holographic reconstructed image
Measure the Advanced Diffraction light of (referred to as zero order light) and diffraction generation.Nearly eye AR hologram three-dimensional display system of the invention uses 4f light
Filtering system is learned, the influence of zero order light and Advanced Diffraction light is removed, filtered light field is imaged laggard by AR lens module
Enter human eye, human eye is the three-dimensional virtual image it can be seen that remotely located amplification, while environment light can insusceptibly enter human eye, is realized
Nearly eye AR hologram three-dimensional is shown.
The light source module is made of light source, collimation lens, reflecting mirror and semi-transparent semi-reflecting lens.The diverging light that light source issues
It after collimated collimated, then is reflected by a reflector into semi-transparent semi-reflecting lens, a portion light wave is reflected by semi-transparent semi-reflecting lens
Spatial light modulator is illuminated, by the modulated smooth backpropagation of spatial light modulator, by entering 4f optics after semi-transparent semi-reflecting lens
Filtering system filtering, filtered light field enters AR eyeglass by reflecting mirror, to eyes imaging.
The light source is optical fiber source, enters optical fiber by monochromatic LED, one-wavelength laser, three-color LED or three color laser coupleds
It obtains.
When carrying out color hologram Three-dimensional Display, three-color light source can be used, realized by time-multiplexed mode colored close
Eye AR hologram three-dimensional is shown.Three-color light source is controlled by photoswitch, illuminates spatial light in such a way that computer programming is using timing
Modulator, the synchronous hologram for being loaded into different colours component of spatial light modulator, realizes sequential colorization Three-dimensional Display.
The spatial light modulator is amplitude type or phase type reflective spatial light modulator, preferred space light modulation
Device is pure phase bit-type LCOS.
Filter module is made of the identical lens of 2 focal lengths, forms 4f optical system, the focal plane between two lens
On, filter is placed, zero order light and the advanced interference as diffraction light are removed.
The AR lens module is three-chip type AR eyeglass or holographic optical elements (HOE) HOE.
The divergent spherical wave issued from light source, is reflected by a reflector after collimation lens collimates, semi-transparent semi-reflecting later
Spatial light modulator is illuminated after mirror reflection, spatial light modulator is loaded into the hologram calculated based on light field rendering, hologram control
Mingguang City is modulated, and reflected light and diffraction light enter filtering system after semi-transparent semi-reflecting lens, by the light field quilt of filtering system
Reflecting mirror is reflected into AR eyeglass mould group, and for AR eyeglass mould group by the optical field imaging of display, the void of formed amplification is can be seen in human eye
Picture simultaneously sees the scene in actual environment；Or it is reflected into holographic optical elements (HOE) HOE by the light field of filtering system, pass through
The reversed diffraction of HOE enters human eye, and HOE is volume holography, only allows the light of special angle specific wavelength that diffraction, ring occurs
Border photoetching it is interference-free human eye is entered by HOE element, realize that AR is shown；When colour display, R, G, B three pieces diffraction light are used
It learns element HOE to stack, as AR lens module.
The display system can make two sets, be respectively used to the 3-D image that display corresponds to left eye and right eye, realize
The nearly eye AR hologram three-dimensional of binocular is shown.
Compared with prior art, the invention has the benefit that
The present invention provides a kind of method for generating holograms based on light field rendering, compared to existing hologram generation side
Method, the method for generating holograms calculating speed is fast, and can be realized holographic map generalization, shown image real-time, quickly has more
High angular resolution and better image quality；It is of the invention compared to the three-dimensional display system and light field display methods of binocular
Nearly eye AR hologram three-dimensional display system can be realized high-resolution, true Three-dimensional Display, and no influx conflict is that one kind has important make
With the nearly eye AR three-dimensional display system of value.
Detailed description of the invention
Fig. 1 is the schematic illustration of the method for generating holograms rendered based on light field；Wherein (a) is the principle of light field rendering
Schematic diagram (b) renders schematic illustration for the light field image of a certain light field rendering plane, (c) is the light field of light field rendering plane
To the Computing Principle schematic diagram of the point spread function of holographic facet；
Fig. 2 is the structural schematic diagram of the nearly eye AR hologram three-dimensional display system of embodiment 2；
Fig. 3 is the structural schematic diagram of the nearly eye AR hologram three-dimensional display system of embodiment 3；
Fig. 4 is the structural schematic diagram of the nearly eye AR hologram three-dimensional display system of embodiment 4.
Specific embodiment
Present invention is further described in detail with reference to the accompanying drawings and examples, it should be pointed out that reality as described below
It applies example to be intended to convenient for the understanding of the present invention, and does not play any restriction effect to it.
Embodiment 1
This gives the method for generating holograms rendered based on light field, generating principle is as shown in Figure 1, wherein
It (a) is the hologram generating principle of light field rendering, wherein 101,102,103 be three light field rendering planes, in a light field wash with watercolours
It contaminates in plane, the light emitting angle of each point is identical with light emission direction, and the light emitting angle of different light field rendering planes is identical and luminous
Direction is different, and 104,105,106 respectively indicate the light emitting angle of three light field rendering planes and direction.110 be one in space
Point, the spatial point are the low-angles issued by three luminous points 107,108,109 on light field rendering plane 101,102,103
The public domain that the overlapping region of light wave is formed.111 be hologram plane, it will record travels to this by the sending of light field rendering plane
The light field complex amplitude of plane.Hologram plane is respectively d at a distance from three light field rendering planes1, d2And d3。
Light emitting angle size and Orientation on each light field rendering plane is controllable, it is assumed that the hair of each light field rendering plane
Angular is Δ θ, and the distance of object point to farthest light field rendering plane is zpmax, since designed light emitting angle Δ θ is smaller,
Then the physical size of object point is about Δ θ zpmax.In the case that the size of object point meets resolution of eye requirement, designed parameter
Actual demand can be met；Assuming that the distance of human eye to three-dimensional picture point is zp, the resolution angle of human eye is δe, then human eye viewing requirement
Image spot size be Δ=δezp, thus Δ=δezp=Δ θ zpmax, haveThe light field of all light field rendering planes
Total light emitting angle, the angle of diffraction of the spatial light modulator by finally showing hologramIt determines, wherein p is sky
Between optical modulator Pixel Dimensions, λ be illumination light wavelength.Therefore light field rendering plane number required forBy upper
State light field rendering plane number determined by analysis, the light emitting angle interval on total light emitting angle and each light field rendering plane
For optimal design parameters.
The distance of multiple light field rendering plane to holographic facets may be configured as identical distance, such as d1=d2=d3Situation.
A light field rendering plane can be only designed, with biggish light emitting angle.The two dimension that is shown as realized at this time is shown
Show；More light field rendering planes are designed, different light field rendering planes have identical light emitting angle and different light emission directions, and difference shines
The low-angle light wave in direction synthesizes Three-dimensional Display.
When in space including the three-dimension object of multiple and different depth, multiple groups light field rendering plane, each group of light can be designed
Field rendering plane is responsible for the rendering of a three-dimension object.
(b) is the image rendering method of light field rendering plane in Fig. 1, simple in order to analyze, and is analyzed with xoz plane,
Wherein 201 be a light field rendering plane.Three-dimension object can regard the object being made of a large amount of three-dimensional points as, and (b) only gives in Fig. 1
Out the case where two object point renderings, wherein 202 and 203 be two object points in space, coordinate is respectively (x1, z1) and (x2,
z2).The angular bisector of small light emitting angle and the angle of x-axis of the light field rendering plane are θxi, on light field rendering plane, institute
Two corresponding points of the light field image of rendering are respectively 204 and 205, and coordinate is respectively xp1And xp2, to have:
Assuming that the light field image of light field rendering plane is by ImiIt indicates, wherein i indicates i-th of light field rendering plane, then light field
A point can indicate on rendering plane are as follows:
Wherein xpjFor pthjA object point is in image ImiOn coordinate, can be calculated by formula (1).ApjFor pthjA object
The gray value or color value of point.ImiIt can be the cromogram of single pass grayscale image or triple channel.Above-mentioned analysis provides two-dimentional seat
Calculated case in mark system, the calculating in three-dimensional system of coordinate can analogize, repeat no more.Light field image rendering can be fast in GPU
Speed is completed.
(c) gives the schematic diagram calculated from light field rendering plane to hologram plane in Fig. 1.Wherein 301 be a light field
Rendering plane, light emitting angle are Δ θ, direction of propagation θxi.305 be hologram plane, and 302 be a point in light field plane,
Two luminous boundaries are 303 and 304 respectively in two endpoints of holographic facet, and coordinate is respectively xsAnd xe, the light field rendering plane with
The distance of holographic facet is d.Here, we calculate the point spread function from light field rendering plane to holographic facet, it is assumed that put 302 x
Coordinate is 0, and the coordinate of holographic facet is xh.Distribution of the spherical waves on holographic facet that point 302 issues is exactly point spread function, can be with
It indicates are as follows:
Wherein λ indicates that the wavelength of light wave, d are distance of the light field rendering plane to holographic facet.xhEffective range be xs≤xh
≤xe.Wherein xsAnd xeCoordinate can indicate are as follows:
After obtaining point spread function, the COMPLEX AMPLITUDE on holographic facet can be indicated are as follows:
Im is the light field image that the light field rendering plane renders,Indicate convolution.
Image Im is rendered for multiple light fieldsiSituation, each light field rendering image calculates its corresponding point spread function
Number psfi, total light field COMPLEX AMPLITUDE E on holographic facetallIt can be expressed as
Wherein N is that total light field renders image number.After we obtain light field COMPLEX AMPLITUDE, it is dry that reference light can be introduced
Calculating is related to, amplitude hologram is encoded to or is encoded to phase-only hologram using double phase encoding mode or only retains phase, is encoded
For phase-only hologram.The coding mode of hologram is the prior art.
Embodiment 2
Fig. 2 is the schematic diagram of the nearly eye AR hologram three-dimensional display system of the present embodiment.Wherein 401 be light source, can be list
Color LED light source or laser light source, can be three-color LED or laser light source is coupled into optical fiber, and timesharing is lighted, in fiber port
Issue divergent spherical wave.The divergent spherical wave that light source issues, collimation is plane wave after lens 402, is reflected through reflecting mirror 403
After again pass by 404 part of semi-transparent semi-reflecting lens reflection, indirect lighting spatial light modulator 405, spatial light modulator 405 is anti-
Formula amplitude type or phase type LCOS are penetrated, hologram is loaded into LCOS by computer, and computer is not shown.By LCOS tune
The light field of system is reversed diffraction, by forming frequency spectrum in the focal plane of lens 406 407 after lens 406, adds filtering in frequency spectrum plane
Device (not shown) filters the zero order light not being diffracted and the advanced light as caused by dot structure, after after lens 408
Diffraction a distance forms three-dimensional real image.Lens 406 are combined into 4f filtering system with 408 groups of lens.Light field after lens 408
AR lens module is reflected by reflecting mirror 409 and reflecting mirror 410, the module is by field lens 411, semi-transparent semi-reflecting lens 412 and semi-transparent
Semi-reflective mirror 413 forms.The light field of holography display by AR lens module enters human eye, makes one the amplification that eye is seen in distant place
The three-dimensional virtual image, and environment light enters human eye by semi-transparent semi-reflecting lens 412 and semi-transparent semi-reflecting lens 413, is not distorted, it can be achieved that close
Eye AR hologram three-dimensional display effect.In this design, light source part and LCOS show that light path part is a double-layer structure, can
Bigger efficiency utilizes space.
Embodiment 3
Fig. 3 is the schematic diagram of the nearly eye AR hologram three-dimensional display system of the present embodiment.Wherein 501 be light source, can be list
Color LED light source or laser light source, can be three-color LED or laser light source is coupled into optical fiber, and timesharing is lighted, in fiber port
Issue divergent spherical wave.The divergent spherical wave that light source issues again passes by semi-transparent semi-reflecting lens 503 after the reflection of reflecting mirror 502
Divide reflection, reflected light is plane wave illumination spatial light modulator 505 by the collimation of lens 504, and spatial light modulator 505 is reflection
Formula amplitude type or phase type LCOS, hologram are loaded into LCOS by computer, and computer is not shown.It is modulated by LCOS
Light field be reversed diffraction, by after lens 504 the focal plane of lens 504 506 formed frequency spectrum, add filter in frequency spectrum plane
(not shown) filters the zero order light not being diffracted and the advanced light as caused by dot structure, after spread out after lens 507
It penetrates a distance and forms three-dimensional real image.Lens 504 and 507 group are combined into 4f filtering system.Light field after 507 lens is reflected
Mirror 508 and reflecting mirror 509 are reflected into AR lens module, and the module is by field lens 510, semi-transparent semi-reflecting lens 511 and semi-transparent semi-reflecting lens
512 compositions.The 3 d light fields of holography display enter human eye by AR lens module, it is seen that the three-dimensional of the amplification in distant place is empty
Picture, and environment light enters human eye by semi-transparent semi-reflecting lens 511 and semi-transparent semi-reflecting lens 512, is not distorted, it can be achieved that AR display effect
Fruit.In this design, light source part and LCOS show that light path part is a double-layer structure, and be capable of bigger efficiency utilizes sky
Between, and compared with eye AR hologram three-dimensional display system close with embodiment 2, reduce a collimation lens, lens 504 play
The effect of dual function, it will be apparent that shorten optical path, be a kind of overall compact nearly eye AR hologram three-dimensional display system.
Embodiment 4
Fig. 4 is the schematic diagram of the nearly eye AR hologram three-dimensional display system of the present embodiment.Wherein 601 be light source, can be list
Color LED light source or laser light source, can be three-color LED or laser light source is coupled into optical fiber, and timesharing is lighted, in fiber port
Issue divergent spherical wave.The divergent spherical wave that light source issues again passes by semi-transparent semi-reflecting lens 603 after the reflection of reflecting mirror 602
Divide reflection, reflected light is plane wave illumination spatial light modulator 605 by the collimation of lens 604, and spatial light modulator 605 is reflection
Formula amplitude type or phase type LCOS, hologram are loaded into LCOS by computer, and computer is not shown.Light through ovennodulation
Field is reversed diffraction, by forming frequency spectrum in the focal plane of lens 604 606 after lens 604, adds filter (figure in frequency spectrum plane
In be not shown), the zero order light not being diffracted and the advanced light as caused by dot structure are filtered, after after lens 607 diffraction
A distance forms three-dimensional real image.Lens 604 are combined into 4f filtering system with 607 groups of lens.Light field after 607 lens is anti-
It penetrates mirror 608 and is reflected into volume holography 609, volume holography 609 can be to the certain wave of specific direction incidence
Long light wave carries out reversed diffraction imaging, makes one the holographic virtual image for arriving remotely located reproduction soon.And volume holography
There is angular selectivity to incident light, what environment light can be interference-free enters eyes by volume holography 609, realizes
AR is shown.When color sequential is shown, volume holography 609 is the overlapping of three pieces volume holography, and each sheet body is complete
It ceases optical element and diffraction only is occurred to the light wave of the specific wavelength of specific direction incidence, colour three is realized by time division multiplexing
Dimension display.Volume holography 609 is hololens, is the prior art.
Compared with the nearly eye AR hologram three-dimensional display system of embodiment 2 and 3, AR lens module is only by monolithic or three plate planes
The hololens of type forms, and thinner, volume is smaller, and weight is lighter, and the nearly eye AR hologram three-dimensional display system of the present embodiment has
Overall compact structure, it is more with practical value.
Technical solution of the present invention and beneficial effect is described in detail in embodiment described above, it should be understood that
Above is only a specific embodiment of the present invention, it is not intended to restrict the invention, it is all to be done in spirit of the invention
Any modification, supplementary, and equivalent replacement etc., should all be included in the protection scope of the present invention.
Claims (10)
1. a kind of method for generating holograms based on light field rendering, which comprises the following steps:
(1) at least two light field rendering planes are constructed, each light field rendering plane is made of several luminous points；In a light field
In rendering plane, the light emitting angle of each luminous point is identical with light emission direction；In different light field rendering planes, each luminous point
Light emitting angle is identical and light emission direction is different；
(2) three dimensional point cloud of three-dimension object is rendered to respectively on different light field rendering planes, obtains each light field rendering
The light field image of plane；
(3) point spread function by the light field image of light field rendering plane and the light field image on holographic facet carries out convolution, obtains
To complex amplitude of the light field image on holographic facet；
(4) complex amplitude of the light field image of all light field rendering planes on holographic facet is overlapped, obtains total object light
Complex amplitude introduces reference light interference and calculates and encoded, obtains the hologram of the three-dimension object.
2. the method for generating holograms according to claim 1 based on light field rendering, which is characterized in that in step (1), structure
When building light field rendering plane, the parameter of light field rendering plane by display hologram spatial light modulator angle of diffraction and people
Eye resolution ratio determines.
3. the method for generating holograms according to claim 2 based on light field rendering, which is characterized in that light field rendering plane
Number determined by the angle of diffraction of spatial light modulator and the light emitting angle of luminous point on light field rendering plane of display hologram
It is fixed:
The angle of diffraction of definition space optical modulator is θ, and the light emitting angle of light field rendering plane is Δ θ；
Then the quantity of light field rendering plane is at leastAnd two adjacent light emission direction light field rendering plane between shine side
It is less than or equal to Δ θ to differential seat angle.
4. the method for generating holograms according to claim 3 based on light field rendering, which is characterized in that light field rendering plane
The light emitting angle of upper luminous point is determined by the angular resolution of human eye:
Define the size that Δ is one object point of three-dimension object, zpmaxFor in three-dimension object with light field rendering plane apart from farthest object
Point arrives the distance of light field rendering plane, then the light emitting angle of light field rendering plane
Δ=δezd, wherein δeFor the angular resolution of human eye, zdBy human eye to the distance of viewing picture point.
5. the method for generating holograms according to claim 1 based on light field rendering, which is characterized in that step (2) includes:
It is flat according to the coordinate of three-dimension object object point, the light emission direction of light field rendering plane and three-dimension object object point and light field rendering
The distance between face calculates the three-dimension object object point corresponding coordinate on light field rendering plane, and is rendered, and can be somebody's turn to do
Light field image of the three-dimension object on the light field rendering plane；
The image of different light field rendering planes is rendered according to light emitting angle and direction, obtains different light field rendering planes
Light field image.
6. a kind of hologram based on light field rendering generates system, including computer storage, computer processor and storage
In the computer storage and the computer program that can be executed on the computer processor, which is characterized in that described
The step of computer processor realizes method as described in claim 1 when executing the computer program.
7. a kind of computer readable storage medium, the computer-readable medium storage has computer program, which is characterized in that institute
It states computer program and is subsequently can by computer the step of realizing method as described in claim 1 when device executes.
8. a kind of nearly eye AR hologram three-dimensional display system characterized by comprising
Light source module provides illumination light for spatial light modulator；
Spatial light modulator is controlled by computer and is loaded into hologram by computer, issues after being modulated to illumination light by institute
State the diffraction image light of hologram modulates and not by the zero order light of the hologram modulates and Advanced Diffraction light；
Filter module is filtered the modulated light of spatial modulator, filters out the zero order light and Advanced Diffraction light；
Human eye is imaged in the filtered light field of filter module to AR lens module；
Computer, described in any item method for generating holograms based on light field rendering make hologram according to claim 1~5
And it is loaded into the spatial light modulator.
9. nearly eye AR hologram three-dimensional display system according to claim 8, which is characterized in that the filter module is 4f
Optical filter system.
10. nearly eye AR hologram three-dimensional display system according to claim 9 characterized by comprising
Light source issues illumination light；
Illumination light is reflexed to semi-transparent semi-reflecting eyeglass by reflecting optics；
Illumination light part is reflexed to lens one by semi-transparent semi-reflecting eyeglass；
The illumination light of lens one, semi-transparent semi-reflecting eyeglass reflection forms plane wave after lens one, illuminates spatial light modulator；
Spatial light modulator is controlled by computer and is loaded into hologram by computer, issues after being modulated to illumination light by institute
State the diffraction image light of hologram modulates and not by the zero order light of the hologram modulates and Advanced Diffraction light；
Lens two, the light that spatial light modulator issues enter lens two after lens one, semi-transparent semi-reflecting eyeglass；Lens one and thoroughly
Mirror two forms 4f optical system, and filter is provided on the focal plane of 4f optical system, and filter filters out the zero order light
And Advanced Diffraction light；
Human eye is imaged in the filtered light field of filter module to AR lens module；
Computer, described in any item method for generating holograms based on light field rendering make hologram according to claim 1~5
And it is loaded into the spatial light modulator.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910067317.XA CN109683461B (en) | 2019-01-24 | 2019-01-24 | Hologram generation method and system based on light field rendering, storage medium and near-to-eye AR holographic three-dimensional display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910067317.XA CN109683461B (en) | 2019-01-24 | 2019-01-24 | Hologram generation method and system based on light field rendering, storage medium and near-to-eye AR holographic three-dimensional display system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109683461A true CN109683461A (en) | 2019-04-26 |
| CN109683461B CN109683461B (en) | 2020-11-10 |
Family
ID=66194451
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910067317.XA Active CN109683461B (en) | 2019-01-24 | 2019-01-24 | Hologram generation method and system based on light field rendering, storage medium and near-to-eye AR holographic three-dimensional display system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109683461B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112882228A (en) * | 2019-11-29 | 2021-06-01 | 北京航空航天大学 | Color holographic near-eye AR display system based on white light illumination and color holographic calculation method |
| CN113093500A (en) * | 2021-02-24 | 2021-07-09 | 北京邮电大学 | Hologram generation method and system |
| CN113448232A (en) * | 2021-07-06 | 2021-09-28 | 哈尔滨理工大学 | Measurement matrix dimension reduction method for three-dimensional layered target compression holography |
| CN113470154A (en) * | 2021-07-30 | 2021-10-01 | 北京达佳互联信息技术有限公司 | Image processing method, image processing device, electronic equipment and storage medium |
| CN115167087A (en) * | 2022-05-27 | 2022-10-11 | 四川大学 | Spherical holographic reconstruction quality improving method based on random gradient descent optimization algorithm |
| CN115202174A (en) * | 2022-07-14 | 2022-10-18 | 浙江理工大学 | Holographic volume view acquisition method, system and application based on light field image |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103348409A (en) * | 2010-10-19 | 2013-10-09 | 国立大学法人北海道大学 | Holographic memory reproduction device and holographic memory reproduction method, demodulation device and demodulation method, and observation device and observation method |
| CN105549371A (en) * | 2016-03-04 | 2016-05-04 | 北京工业大学 | Multi-angle continuous THz wave illumination digital holographic imaging method |
| WO2016172384A1 (en) * | 2015-04-23 | 2016-10-27 | Ostendo Technologies, Inc. | Methods and apparatus for full parallax light field display systems |
| US20170208292A1 (en) * | 2016-01-20 | 2017-07-20 | Gerard Dirk Smits | Holographic video capture and telepresence system |
| CN107145053A (en) * | 2017-05-22 | 2017-09-08 | 电子科技大学 | The holographic axially position method of optical scanner based on TR MUSIC algorithms |
| CN108646538A (en) * | 2018-04-24 | 2018-10-12 | 安徽大学 | A kind of single exposure complex amplitude object holographic reconstruction method, equipment and system |
| CN108803053A (en) * | 2018-06-06 | 2018-11-13 | 北京邮电大学 | 3 d light fields display system |
| CN108873323A (en) * | 2018-07-09 | 2018-11-23 | 苏州大学 | A kind of method and system for realizing edge enhancing imaging |
| KR20180138514A (en) * | 2017-06-20 | 2018-12-31 | 한국과학기술원 | Method and apparatus for recording and projecting 3 dimensional holographic image using scattering layer |
-
2019
- 2019-01-24 CN CN201910067317.XA patent/CN109683461B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103348409A (en) * | 2010-10-19 | 2013-10-09 | 国立大学法人北海道大学 | Holographic memory reproduction device and holographic memory reproduction method, demodulation device and demodulation method, and observation device and observation method |
| WO2016172384A1 (en) * | 2015-04-23 | 2016-10-27 | Ostendo Technologies, Inc. | Methods and apparatus for full parallax light field display systems |
| US20170208292A1 (en) * | 2016-01-20 | 2017-07-20 | Gerard Dirk Smits | Holographic video capture and telepresence system |
| CN105549371A (en) * | 2016-03-04 | 2016-05-04 | 北京工业大学 | Multi-angle continuous THz wave illumination digital holographic imaging method |
| CN107145053A (en) * | 2017-05-22 | 2017-09-08 | 电子科技大学 | The holographic axially position method of optical scanner based on TR MUSIC algorithms |
| KR20180138514A (en) * | 2017-06-20 | 2018-12-31 | 한국과학기술원 | Method and apparatus for recording and projecting 3 dimensional holographic image using scattering layer |
| CN108646538A (en) * | 2018-04-24 | 2018-10-12 | 安徽大学 | A kind of single exposure complex amplitude object holographic reconstruction method, equipment and system |
| CN108803053A (en) * | 2018-06-06 | 2018-11-13 | 北京邮电大学 | 3 d light fields display system |
| CN108873323A (en) * | 2018-07-09 | 2018-11-23 | 苏州大学 | A kind of method and system for realizing edge enhancing imaging |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112882228A (en) * | 2019-11-29 | 2021-06-01 | 北京航空航天大学 | Color holographic near-eye AR display system based on white light illumination and color holographic calculation method |
| CN113093500A (en) * | 2021-02-24 | 2021-07-09 | 北京邮电大学 | Hologram generation method and system |
| CN113093500B (en) * | 2021-02-24 | 2022-05-17 | 北京邮电大学 | Hologram generation method and system |
| CN113448232A (en) * | 2021-07-06 | 2021-09-28 | 哈尔滨理工大学 | Measurement matrix dimension reduction method for three-dimensional layered target compression holography |
| CN113448232B (en) * | 2021-07-06 | 2022-06-21 | 哈尔滨理工大学 | Measurement matrix dimension reduction method for three-dimensional layered target compression holography |
| CN113470154A (en) * | 2021-07-30 | 2021-10-01 | 北京达佳互联信息技术有限公司 | Image processing method, image processing device, electronic equipment and storage medium |
| CN113470154B (en) * | 2021-07-30 | 2023-11-28 | 北京达佳互联信息技术有限公司 | Image processing method, device, electronic equipment and storage medium |
| CN115167087A (en) * | 2022-05-27 | 2022-10-11 | 四川大学 | Spherical holographic reconstruction quality improving method based on random gradient descent optimization algorithm |
| CN115167087B (en) * | 2022-05-27 | 2023-12-26 | 四川大学 | Spherical holographic reconstruction quality improvement method based on random gradient descent optimization algorithm |
| CN115202174A (en) * | 2022-07-14 | 2022-10-18 | 浙江理工大学 | Holographic volume view acquisition method, system and application based on light field image |
| CN115202174B (en) * | 2022-07-14 | 2023-11-10 | 浙江理工大学 | Holographic view acquisition method, system and application based on light field image |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109683461B (en) | 2020-11-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109683461A (en) | Method for generating holograms, system, storage medium and nearly eye AR hologram three-dimensional display system based on light field rendering | |
| CN105372824B (en) | A kind of bore hole 3D laser display apparatus | |
| Hong et al. | Three-dimensional display technologies of recent interest: principles, status, and issues | |
| Paturzo et al. | Synthesis and display of dynamic holographic 3D scenes with real-world objects | |
| Geng | Three-dimensional display technologies | |
| CN104884862B (en) | Lighting apparatus | |
| CN105700320B (en) | A kind of hologram three-dimensional display methods and device based on spatial light modulator | |
| CN108803295B (en) | Method for manufacturing large-field-of-view hologram, display system and dot matrix light source | |
| CN102854630B (en) | Three-dimensional display device based on constructive interferences | |
| CN102033413B (en) | Three-dimensional display device based on random constructive interference principle | |
| He et al. | Three-dimensional holographic communication system for the metaverse | |
| Ren et al. | Review on tabletop true 3D display | |
| CN109085700A (en) | The nearly eye AR display system of in-line holographic of no zero order light interference and its application and hologram optimization method | |
| CN101014911A (en) | Method and device for encoding and reconstructing computer-generated video holograms | |
| WO2003036993A1 (en) | Projection of three-dimensional images | |
| CN113885209B (en) | Holographic AR three-dimensional display method, module and near-to-eye display system | |
| CN210666315U (en) | Multi-view three-dimensional display device based on holographic projection | |
| Skirnewskaja et al. | Automotive holographic head‐up displays | |
| CN102213943B (en) | All-perspective three-dimensional holographic display system and method based on rotation modulating unit | |
| CN102183883A (en) | Multibeam time division multiplexing (TDM) holographic three-dimensional display system and method | |
| CN109031669A (en) | The holographic nearly eye AR display system of compact based on complex function holographic optical elements (HOE) and its application | |
| EP3792681B1 (en) | Multi-image display apparatus using holographic projection | |
| KR101524336B1 (en) | Thin Flat Type Converge Lens | |
| CN107390379A (en) | A kind of nearly eye hologram three-dimensional display system and display methods | |
| CN205750291U (en) | A kind of hologram three-dimensional display device based on spatial light modulator |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |