CN101743519A - Holographic display - Google Patents

Holographic display Download PDF

Info

Publication number
CN101743519A
CN101743519A CN200880024344.9A CN200880024344A CN101743519A CN 101743519 A CN101743519 A CN 101743519A CN 200880024344 A CN200880024344 A CN 200880024344A CN 101743519 A CN101743519 A CN 101743519A
Authority
CN
China
Prior art keywords
holographic
display device
hologram
circuit
slm
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN200880024344.9A
Other languages
Chinese (zh)
Other versions
CN101743519B (en
Inventor
伯·克罗尔
罗伯特·梅斯巴奇
亚历山大·史威特纳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SeeReal Technologies GmbH
SeeReal Technologies SA
Original Assignee
SeeReal Technologies GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from DE102007023737A external-priority patent/DE102007023737B4/en
Priority claimed from DE102007023785.7A external-priority patent/DE102007023785B4/en
Priority claimed from GB0709379A external-priority patent/GB0709379D0/en
Priority claimed from DE102007023740A external-priority patent/DE102007023740B4/en
Priority claimed from DE102007023739.3A external-priority patent/DE102007023739B4/en
Priority claimed from GB0709376A external-priority patent/GB0709376D0/en
Priority claimed from GB0718596A external-priority patent/GB0718596D0/en
Priority claimed from GBGB0718598.6A external-priority patent/GB0718598D0/en
Application filed by SeeReal Technologies GmbH filed Critical SeeReal Technologies GmbH
Publication of CN101743519A publication Critical patent/CN101743519A/en
Application granted granted Critical
Publication of CN101743519B publication Critical patent/CN101743519B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/08Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
    • G02B26/0875Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light by means of one or more refracting elements
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/02Details of features involved during the holographic process; Replication of holograms without interference recording
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2202Reconstruction geometries or arrangements
    • G03H1/2205Reconstruction geometries or arrangements using downstream optical component
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2294Addressing the hologram to an active spatial light modulator
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/08Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005Adaptation of holography to specific applications
    • G03H2001/0088Adaptation of holography to specific applications for video-holography, i.e. integrating hologram acquisition, transmission and display
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/02Details of features involved during the holographic process; Replication of holograms without interference recording
    • G03H2001/0208Individual components other than the hologram
    • G03H2001/0216Optical components
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/08Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0808Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
    • G03H2001/0833Look up table
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2202Reconstruction geometries or arrangements
    • G03H2001/2236Details of the viewing window
    • G03H2001/2242Multiple viewing windows
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2249Holobject properties
    • G03H2001/2263Multicoloured holobject
    • G03H2001/2271RGB holobject
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2210/00Object characteristics
    • G03H2210/303D object
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2210/00Object characteristics
    • G03H2210/303D object
    • G03H2210/36Occluded features resolved due to parallax selectivity
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2210/00Object characteristics
    • G03H2210/40Synthetic representation, i.e. digital or optical object decomposition
    • G03H2210/44Digital representation
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2222/00Light sources or light beam properties
    • G03H2222/20Coherence of the light source
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2222/00Light sources or light beam properties
    • G03H2222/20Coherence of the light source
    • G03H2222/22Spatial coherence
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2222/00Light sources or light beam properties
    • G03H2222/20Coherence of the light source
    • G03H2222/24Low coherence light normally not allowing valuable record or reconstruction
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2223/00Optical components
    • G03H2223/18Prism
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2223/00Optical components
    • G03H2223/19Microoptic array, e.g. lens array
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2225/00Active addressable light modulator
    • G03H2225/20Nature, e.g. e-beam addressed
    • G03H2225/22Electrically addressed SLM [EA-SLM]
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2225/00Active addressable light modulator
    • G03H2225/55Having optical element registered to each pixel
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2226/00Electro-optic or electronic components relating to digital holography
    • G03H2226/02Computing or processing means, e.g. digital signal processor [DSP]
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2226/00Electro-optic or electronic components relating to digital holography
    • G03H2226/04Transmission or communication means, e.g. internet protocol
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2226/00Electro-optic or electronic components relating to digital holography
    • G03H2226/05Means for tracking the observer
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2300/00Aspects of the constitution of display devices
    • G09G2300/02Composition of display devices
    • G09G2300/026Video wall, i.e. juxtaposition of a plurality of screens to create a display screen of bigger dimensions
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2300/00Aspects of the constitution of display devices
    • G09G2300/04Structural and physical details of display devices
    • G09G2300/0404Matrix technologies
    • G09G2300/0408Integration of the drivers onto the display substrate
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2300/00Aspects of the constitution of display devices
    • G09G2300/08Active matrix structure, i.e. with use of active elements, inclusive of non-linear two terminal elements, in the pixels together with light emitting or modulating elements
    • G09G2300/0809Several active elements per pixel in active matrix panels

Abstract

Disclosed is a holographic display including a spatial light modulator, and including a position detection and tracking system, such that a viewer's eye positions are tracked, with variable beam deflection to the viewer's eye positions being performed using a microprism array which enables controllable deflection of optical beams.

Description

Holographic display
Background of invention
1. technical field
The present invention relates to holographic display, particularly computing machine generates video holograms (Computer-Generated video Holograms, the holographic display of CGHs) encoding on spatial light modulator.This holographic display can generate 3D hologram and rebuild.
2. background technology
Computing machine generates video holograms (CGHs), and (this SLMs can comprise electricity or light controllable for SpatialLight Modulators, SLMs) middle coding in one or more spatial light modulators.This unit is worth to come the amplitude and/or the phase place of light modulated corresponding to the holography of video holograms by coding.Can for example calculate CGH like this: follow the trail of by coherent light, by the light of scene reflectivity and the interference between the reference light wave, perhaps pass through Fourier transform or Fresnel conversion by simulation.Desirable SLM can represent any complex value number (complex-valued numbers), promptly control the complex value number of incident light wave amplitude and phase place respectively.Yet typical SLM only controls a characteristic, or is amplitude, or is phase place, and the spinoff of not expecting that also influences another characteristic is arranged.The diverse ways that has light modulated amplitude or phase place, for example, electrical addressing liquid crystal SLM (electrically addressedliquid crystal SLM), light addressing liquid crystal SLM (optically addressed liquid crystalSLM), magneto-optic SLM (magneto optical SLM), micro-mirror device (micro mirror device) or acousto-optic modulator (acousto-optic modulator).The modulation of light can be that the space is continuous or be made up of independent addressable unit, is one dimension or that arrange two-dimensionally, binary, multistage or continuous.
In the present invention, term " coding " expression controlling value is offered spatial light modulator the zone with encoded holographic figure, so that can rebuild the mode of 3D scene from SLM.
Different with pure autostereoscopic display apparatus (auto-stereoscopic displays), for video holograms, the observer sees the optics reconstruction that the light wave of three-dimensional scenic is preceding.Rebuild in the space that the 3D scene is extended between observer's eyes and spatial light modulator (SLM).Can also be with the video holograms SLM that encodes, make the observer see that the object of the three-dimensional scenic of rebuilding previously at SLM and other are on SLM or the object of back.
The unit of spatial light modulator is preferably the transmission units that light passes, and the light of this transmission units can be interfered at assigned position and above millimeter generation of coherent length number at least.This just allows holographic reconstruction to have enough resolution at one dimension at least.This light will be called as " fully coherent light ".
In order to ensure sufficient coherence, the spectrum of the light that is sent by light source must be limited in the enough narrow wavelength coverage, promptly must be nearly monochromatic light.The spectral bandwidth of high brightness LED (LEDs) is enough narrow, can guarantee the temporal coherence of holographic reconstruction.Angle of diffraction and the wavelength of SLM are proportional, this means the clear reconstruction of having only monochromatic source can cause object point.The spectrum of widening will cause object point to broaden and object is rebuild fuzzy.The spectrum of LASER Light Source can be thought monochromatic.The line width of LED is enough narrow to help good reconstruction.
Spatial coherence is relevant with the horizontal expansion of light source.Conventional light source, (Cold Cathode Fluorescent Lamps CCFLs), if they are luminous by enough narrow aperture, also can satisfy such needs as LEDs or cold-cathode fluorescence lamp.Can think in diffraction limit (diffraction limits) to send from pointolite from the light of LASER Light Source, and depend on the purity of model and cause the clear reconstruction of object, promptly each object point all is redeveloped into a point in diffraction limit.
From the light horizontal expansion in spatial incoherent light source, and cause that rebuilding object blurs.Fuzzy total amount is provided by the size that broadens of the object point of rebuilding at given position.In order to use the spatial incoherent light source that is used for hologram reconstructing, find balance between must limiting in brightness with to the horizontal expansion of porose light source.Light source is more little, and its spatial coherence is good more.
If, then can regard line source as pointolite from observing with the rectangular position of the longitudinal extension of line source.Therefore light wave can coherently be propagated on this direction, but irrelevant on all other directions.
Generally speaking, hologram passes through holographic ground of the coherent superposition re-construct of light wave in the horizontal and vertical directions.Such video holograms is called full parallax hologram (full-parallax hologram).Can watch reconstruction object in the horizontal and vertical directions, just as material object with motion parallax.Yet, need on the level of SLM and vertical direction, all have high resolving power with great visual angle.
Often (horizontal-parallax-only, hologram HPO) reduces the requirement to SLM by only being restricted to horizontal parallax.Holographic reconstruction occurs over just on the horizontal direction, and does not have holographic reconstruction in vertical direction.This causes rebuilding object and has the tangential movement parallax.When vertical movement, skeleton view does not change.The resolution of the SLM that the HPO hologram needs in vertical direction is less than the resolution of the SLM of full parallax hologram needs.Only also have the vertical parallax hologram (vertical-parallax-only, VPO), but uncommon.Holographic reconstruction occurs over just on the vertical direction, and causes rebuilding object and have the vertical movement parallax.There is not motion parallax in the horizontal direction.The different skeleton views that are used for left eye and right eye must produce respectively.
The real-time calculating of hologram needs high calculated performance, calculating in real time can instant like this realization, for example, by means of having field programmable gate array (Field Programmable Gate Arrays, FPGAs), full custom ic (full custom ICs), or special IC (ApplicationSpecific Integrated Circuits, hardware costliness ASICs), special is realized, perhaps by use can parallel processing many central processing units (Central Processing Units CPUs) realizes.
(Thin Film Transistor, TFT) in the display device, the pel spacing on the orthogonal directions has determined the zone of each pixel at thin film transistor (TFT).This zone is divided into and is used for liquid crystal (LiquidCrystal, LC) Kong Zhi transparency electrode, the TFT with electric capacity and row and column lead.Required frequency and display size on the column wire define required profile, and therefore also define the width of row and column lead.
Desirable holographic display needs higher resolution than the at present commercial available supervising device based on TFT.Resolution is high more, and pel spacing is more little, and the frequency on the row and column lead is owing to more line number increases simultaneously.This so cause the size in the zone that covered by the row and column lead of whole pixel region, compare with the increase of resolution and superly increase pro rata.Therefore, the space that can be used for transparency electrode becomes still less, so that the transmittance of display device will reduce significantly.This means that the desirable high resolving power holographic display with high refresh rate only could produce under the strictness restriction.Because to the extreme requirement of calculated performance, no matter therefore use the hardware of which kind of specific type, the hardware that can be used in hologram calculating in real time at present is all very expensive.Because the data volume that relates to is huge, the image data transmission from the computing unit to the display device also is very difficult.
The common structure of active-matrix formula LCD will be briefly described with reference to prior art shown in Figure 10, and this Figure 10 takes from US6, and 153, No. 893 patent documents are here by with reference to quoting the full content of this patent document.As shown in figure 10, this active-matrix formula display has slab construction, and this slab construction comprises main substrate 101, relative substrate 102 and the space 103 that main substrate is fixed to relative substrate, accommodates liquid crystal material between this two-layer substrate.The peripheral driver portion 107 that forms display part 106 and link to each other with display part 106 on the surface of main substrate, display part 106 is formed by pixel electrode 104 with the switchgear 105 that the matrix form arrangement is used to drive pixel electrode 104.Switchgear 105 is made up of thin film transistor (TFT).Thin film transistor (TFT) also forms as circuit component in periphery 107.
Describe the method that is used for computing computer generation video holograms by No. 2006/066906 patent document of WO that the applicant submits to, quoted this document by reference here.According to this method, the object with complex amplitude of three-dimensional scenic is assigned to the matrix dot of parallel (parallel) virtual sectional layer, so that for each sectional layer, define the single body data set with amplitude discrete in the matrix dot, and be used for the holographic encoding of the spatial light modulator of hologram display device from the view data centralized calculation.
According to No. 2008/025839 patent publication of WO of applicant, quote this document by reference here, following steps are finished by area of computer aided:
-being the observer plane from each object data set of each chromatography scene section calculates diffraction image with the form of wave field Two dimensional Distribution independently, this observer's plane separation sectional layer limited distance also is parallel to sectional layer, wherein, be at least the wave field of shared virtual all sections of observer's window calculation, this virtual observer's window is arranged in the eyes of observer plane near the observer, compare with video holograms, the area of described observer's window decreases;
-in the data centralization of quoting with respect to the observer plane, add and the total wave field that is used for observer's window is defined in the distribution that calculates of all sectional layers;
-reference data set is transformed to the hologram plane, this hologram plane separation reference planes limited distance also is parallel to reference planes, the hologram data collection that is used for total computer-generated hologram of scene with establishment, wherein, spatial light modulator is arranged in the hologram plane, and encode the back under the help of described spatial light modulator, re-construct in the space of observer's eyes front.
Method above-mentioned and display device are based on such idea, i.e. re-construct object itself not, but in one or more virtual observer's windows, rebuild the wavefront that sends by object.
The observer can watch scene by virtual observer's window.Virtual observer's window covers the pupil of observer's eyes, and under the help of known position sensing and tracing system, virtual observer's window can be followed the trail of the physical location to the observer.Virtual, truncate capitiform is rebuild the space and is extended between the spatial light modulator of hologram display device and observer's window, and wherein, SLM represents the bottom of truncate capitiform, and observer's window is represented the top of truncate capitiform.If observer's window is very little, frustum just is similar to pyramid.The observer sees through virtual observer's window and looks to display device, and receives the wavefront of expression scene at observer's window.Because necessary conversion enormous amount is so the holographic encoding process causes huge computation burden.Real-time coding will need expensive high performance computing unit.
No. 2008/025839 patent document of WO that the applicant submits to discloses a kind of permission generates video holograms in real time from the 3 d image data with depth information method.This makes that using simple and cheap relatively computing unit to generate these holograms becomes possibility.
No. 2008/025839 patent document of WO that the applicant submits to discloses a kind of method that computing machine generates video holograms that is used for generating in real time.Based on the view data with depth information, coding is used for the holography value that three-dimensional scenic presents, and presenting by the object point on the spatial light modulator SLM of this three-dimensional scenic makes up.Similar with prior art solution above-mentioned, disclosed method is based on such idea in No. 2008/025839 patent document of WO, i.e. re-construct object not itself, but in one or more virtual observer's windows, rebuild the wavefront that sends by object.Generate the wave field of modulating by spatial light modulator SLM from abundant coherent light, this wave field is by the control of hologram value, and the real or virtual three-dimensional scenic that needs is rebuild in the interference of passing through in the space.Rebuilding the virtual observer's window of generation in the space with SLM as the truncate capitiform of bottom.Window is arranged near observer's eyes place, and under the help of known position sensing and tracing system, window can be followed the trail of the physical location to the observer.Disclosed method is based on such fact in No. 2008/025839 patent document of WO, and promptly the observer sees that the zone of scene is to rebuild the space by the truncate capitiform that extends to observer's window from SLM to define.Frustum can be similar to pyramid, because observer's window is little more many than SLM.In addition, this method is based on following principle, i.e. the reconstruction of single object point only needs the subclass of subhologram as SLM.Therefore the information about each scene point can not be distributed in the whole hologram, but only is included in the specific limited area promptly so-called subhologram.According to this theory, the single object point of scene is only rebuild by the limited pixel region on the SLM (so-called subhologram).Disclosure in No. 2008/025839 patent document of WO is based on such idea, promptly for each object point, can from question blank, obtain the distribution of subhologram, and accumulate these subholograms, with total hologram of the reconstruction that is formed for whole scene with respect to the whole reconstruction of scene.
According to the more preferred example of disclosed method in No. 2008/025839 patent document of WO, the view of scene is to be limited by each observer's position and view direction thereof.In the observer plane, each observer is assigned at least one virtual observer's window near observer's eyes.In pre-treatment step, scene disperses three-dimensionally and is visible object point.These data may be obtained from interface.Disclosed treatment step is in No. 2008/025839 patent document of WO:
-step 1:
Be each object point, find out the position of subhologram: the scope of this position and corresponding subhologram is derived from the position of object point, i.e. the horizontal x of object point, y coordinate, and depth distance.
-step 2:
From question blank, obtain the distribution of corresponding subhologram.
-step 3:
All object points are repeated above-mentioned two steps, and wherein, the accumulation subhologram is with total hologram of the reconstruction that is formed for whole scene.
According to disclosed simple case in No. 2008/025839 patent document of WO, the size of distributing to the subhologram of object point is based on that the cross spider principle draws.The observer's window or its part that cover pupil project in the hologram plane through object point, promptly project on the SLM.Determine the index of the pixel of the subhologram that this scene point of reconstruction is required thus.
According to disclosed content in No. 2008/025839 patent document of WO more on the one hand, subhologram or total hologram are applied additional calibration function, for example, the SLM error that causes for position or the shape that compensates by SLM is perhaps in order to improve reconstruction quality.For example, corrected value is added on the data value of subhologram and/or on the data value of total hologram.And, because all being physical location by observer's window, each subhologram limits, thus can generate the special question blank that is used for more uncommon observer's windows, for example, if the observer looks to display device with wide-angle the position from the side.
As illustrated in No. 2008/025839 patent document of WO, preferably, can expand the principle of using question blank.For example, the supplemental characteristic that is used for color and monochrome information can be stored in independently question blank.And the data value of subhologram and/or total hologram can be used for from the brightness of question blank and/or color value modulation.Based on the idea that primary colors can obtain from question blank separately, colour presents also therein.
In No. 2008/025839 patent document of WO disclosed method based on question blank, preferably generate, here by with reference to quoting this two pieces of files according to No. 2006/066906 patent document of WO or No. 2006/066919 patent document of WO that the applicant submits to.Question blank can be stored in suitable data carrier and the storage medium subsequently.
Figure 26 A has represented the general thought of the disclosure of No. 2008/025839 patent document of WO, and this patent document has single observer's example.The view of scene (S) is limited by observer's (O) position and view direction.In reference planes, distribute at least one virtual observer's window (VOW) near observer's eyes to the observer.Generate the wave field of modulating by spatial light modulator (SLM) from abundant coherent light, this wave field is controlled by the hologram value.This method and the display device that is derived from this method are based on such idea, i.e. re-construct object itself not, but the wavefront that reconstruction is sent by object in one or more virtual observer's windows (VOW).In Figure 26 A, object is represented by single object point (PP).Observer (O) can see scene (S) by virtual observer's window (VOW).Virtual observer's window (VOW) covers observer's (O) eye pupil, and under the help of known position sensing and tracing system, virtual observer's window (VOW) can be followed the trail of the physical location to the observer.Therefore controlling spatial light modulator (SLM) with the hologram value of video holograms can cause wave field, and this wave field is modulated in pixel and sent from display screen, to rebuild desired three-dimensional scenic by generating to interfere in rebuilding the space.Shown in Figure 26 A, according to the general principles of this embodiment, the single object point (PP) of scene (S) is only rebuild by the limited pixel region on the spatial light modulator (SLM) (so-called subhologram (SH)).Shown in Figure 26 A, according to the simplest solution, the size of subhologram (SH) defines based on the cross spider principle, draws the required pixel index of reconstruction that is used for this object point (OP) in view of the above subsequently.The position of subhologram (SH) and scope are derived from the position of object point (PP), i.e. the horizontal x of object point, y coordinate and depth distance thereof or z distance.Subsequently, from question blank LUT, obtain the required hologram value of reconstruction this object point (PP).
Subhologram (SH) is modulated with brightness and/or color value, and is accumulated as the hologram plane in position separately subsequently, to form so-called total hologram.Generate the data that comprised in the above-mentioned question blank in advance.As above-cited prior art part, preferably use the method described in No. 2006/066906 patent document of WO to generate data, and with data storage in suitable data carrier and storage medium.Under the help of the position of object point and attribute, calculate corresponding subhologram in advance, and generate question blank, color and brightness value and the correction parameter of subhologram thus.
Figure 26 B has shown this principle in more detail, and represented to distribute to respectively object point (P1, subhologram P2) (SH1, SH2).As can be seen, these subholograms are limited in Figure 26 B, and form the subclass of little, contiguous total hologram, promptly whole spatial light modulator (SLM).As shown in figure 26, except position and scope based on the definite subhologram of cross spider principle, further funtcional relationship also is possible.
3. description of Related Art
WO 2004/044659 (US2006/0055994) and US7315408B2 patent document by applicant's submission, describe a kind of device that passes through the mode reconstruction of three-dimensional scene of fully relevant diffraction of light, quoted the full content of these two pieces of files here by reference; Described device comprises pointolite or line source, is used for the lens and the spatial light modulator of optically focused.Different with traditional holographic display, the SLM that is in transfer mode rebuilds 3D scene (referring to appendix I and the II discussion to this term and correlation technique) at least one " virtual observer's window ".Each virtual observer's window is positioned at the eyes place near the observer, and its size is restricted, so that virtual observer's window is arranged in the single order of diffraction, thereby make every eye rebuild the complete reconstruction of seeing three-dimensional scenic in the space at the truncate capitiform that extends between SLM surface and the virtual observer's window.For making holographic reconstruction interference-free, the size of virtual observer's window must not exceed all period interval of an order of diffraction of reconstruction.Yet it must be at least enough big so that the observer can see the reconstruction of whole 3D scene by window (s).The another eyes can be watched by identical virtual observer's window, and perhaps for it distributes second virtual observer's window, this second virtual observer's window is correspondingly created by secondary light source.Here, typical sizable visible area is limited in the local virtual observer's window that is provided with.Known solution is rebuild the large tracts of land that the high resolving power by traditional SLM surface causes in small-sized mode, and it is reduced to the size of virtual observer's window.This causes such result: because former thereby less angle of diffraction of geometry and the resolution of SLMs at present under the situation of using rational, popular level calculation equipment, enough obtain high-quality holographic real-time and rebuild.
Disclose the mobile phone that generates 3-D view in the US2004/0223049 patent document, quoted the full content of this document here by reference.Yet its disclosed 3-D view is to use automatic stereo to show what (autostereoscopy) generated.Automatic stereo shows that a problem of the 3-D view that generates is: typically, the observer feels image in the display device the inside, and observer's eyes tend to focus on the surface of display device.In many cases, after a period of time, the inconsistent meeting between the position of the 3-D view that position that observer's eyes focus on and observer feel causes the observer uncomfortable.Under the situation that 3-D view is generated by holography (holography), this problem can not take place, and perhaps reduces significantly.
Summary of the invention
A kind of holographic display is provided, it comprises spatial light modulator (SLM), also comprise position sensing and tracing system so that tracing study person's eye position, variable beam to the deflection of observer's eye position by use can control bundle deflection microprism array carry out.
Holographic display can be such device: in this device, position sensing and tracing system tracing study person's eye position, variable beam to the deflection of observer's eye position by use can control bundle deflection microprism array carry out.
Holographic display can be such device: in this device, the deflection of variable beam is continuous variable.
Holographic display can be such device: in this device, the deflection of variable beam is to use electric moistening technology to carry out.
Holographic display can be such device: in this device, the deflection of variable beam is to use variable pressure reduction to carry out, and this variable pressure reduction is applied to and is positioned at each electric moistening cell array not on the different electrodes of ipsilateral.
Holographic display can be such device: in this device, obtain two-dimensional deflection by the microprism array that uses two series connection.
Holographic display can be such device: in this device, prism is little liquid prism.
Holographic display can be such device: in this device, virtual observer's window (VOW) is arranged on the position of one or more observers' eyes.
Holographic display can be such device: in this device, the focusing instrument that is arranged in prism array front or back is assisted convergence of rays to VOW.
Holographic display can be such device: in this device, by the dynamic calibration to the coding of spatial light modulator, can reduce the optical effect of lens aberration.
Holographic display can be such device: in this device, prism not all has identical deflection angle.
Holographic display can be such device: in this device, prism not all has identical deflection angle, assembles a little at VOW so that penetrate the light of prism array.
Holographic display can be such device: in this device, prism angle calculate to be to carry out in the counting circuit on the substrate of SLM.
Holographic display can be such device: in this device, it is to carry out in the counting circuit on being arranged on the substrate of prism array that prism angle is calculated.
Holographic display can be such device: in this device, the substrate of SLM also is used as the substrate of prism array.
Holographic display can be such device: in this device, it is discontinuous with the caused phase place of compensating prism array to apply phase correction.
Holographic display can be such device: in this device, phase correction is to be carried out by the operation of SLM.
Holographic display can be such device: in this device, hologram image generates in the projection type device, and wherein, projection comprises SLM is imaged onto on the prism array, and the reconstruction of desired 3D scene takes place in the front of VOW simultaneously.
Holographic display can be such device: in this device, when being imaged onto SLM on the prism array, for prism array provides phase compensation.
Holographic display can be such device: in this device, by being arranged on the additional SLM near prism array, for prism array provides phase compensation.
Holographic display can be such device: in this device, SLM is a printing opacity, and prism array is reflective.
Holographic display can be such device: in this device, SLM is reflective, and prism array is a printing opacity.
Holographic display can be such device: in this device, SLM is a printing opacity, and prism array also is a printing opacity.
A kind of method that generates the holographic reconstruction of three-dimensional scenic is provided, and this three-dimensional scenic is made up of a plurality of discrete points, and this method is used according to holographic display of the present invention, and this display device is included as the light source and the optical system of spatial light modulator illumination; The method comprising the steps of:
Encoded holographic figure on spatial light modulator.
Description of drawings
Fig. 1 is the data rate synoptic diagram more much bigger than the data rate of original real space data of expression hologram.
Fig. 2 is with the structure of a prior art SLM part and Performance Characteristics and can carries out the synoptic diagram that the part of the holographic SLM that calculates compares in the space of picture element matrix.
Fig. 3 is the structural representation of the part of SLM, and holographic calculating can be carried out in the space of picture element matrix among this SLM.
Fig. 4 is the synoptic diagram of the part of SLM, for the demonstration of holographic data, can carry out decompress(ion) and calculate in the space of picture element matrix among this SLM.
Fig. 5 is the synoptic diagram of the part of SLM, for the demonstration of traditional 2D video data, can carry out decompress(ion) and calculate in the space of picture element matrix among this SLM.
Fig. 6 is the synoptic diagram of expression TFTs manufacturing process.
Fig. 7 is the synoptic diagram of expression TFTs manufacturing process.
Fig. 8 is a synoptic diagram of rebuilding the method for hologram according to a kind of embodiment.
Fig. 9 is a synoptic diagram of rebuilding the method for hologram according to a kind of embodiment.
Figure 10 is the skeleton view according to the general structure of traditional active-matrix formula LCD of prior art.
Figure 11 is the synoptic diagram of installation step of active-matrix substrate of the holographic display of a kind of embodiment of expression.
Figure 12 is the synoptic diagram of the expression further installation step of active-matrix substrate shown in Figure 11.
Figure 13 is the synoptic diagram of the expression further installation step of active-matrix substrate shown in Figure 12.
Figure 14 is the synoptic diagram that the holography that presents of the object point of discrete and optional position shows.
Figure 15 is in a kind of holographic display of embodiment, the synoptic diagram of the functional unit that can implement in graphics calculations.
Figure 16 is the synoptic diagram of the question blank that is used for subhologram SH that uses in a kind of holographic display of embodiment.
Figure 17 is the synoptic diagram that is used for the attached processing unit of holographic conversion and coding in a kind of holographic display of embodiment.
Figure 18 is in the holographic display of a kind of embodiment of expression, if use subhologram, then because the quantity of unit tails off the synoptic diagram that computation burden is littler.
Figure 19 is expression t scene, the scene in the further t+1 moment and the synoptic diagram of difference scene constantly.
Figure 20 is the synoptic diagram of the holographic display with the transmission of addressable data of a kind of embodiment of expression.
Figure 21 is in a kind of holographic display of embodiment, and the synoptic diagram of the part of spreadsheet calculates transistorized quantity in this spreadsheet.
Figure 22 is the synoptic diagram of the remainder of spreadsheet shown in Figure 21.
Figure 23 is in the holographic display according to a kind of embodiment, the rough schematic view of cluster design.
Figure 24 is in the holographic display according to a kind of embodiment, the synoptic diagram in the path that video data is taked.
Figure 25 is the synoptic diagram of the part of SLM, for showing the traditional 2D video data or the display device of holographic video data, can carry out calculating in the space of picture element matrix among this SLM.
Figure 26 is according to prior art, generates the synoptic diagram of the method for subhologram.
Figure 27 is according to a kind of embodiment, rebuilds the synoptic diagram of the method for hologram.
Figure 28 is according to a kind of embodiment, the synoptic diagram of panel tiling.
Figure 29 is and blocks the synoptic diagram that relevant geometry is considered.
Figure 30 is and blocks the synoptic diagram that relevant geometry is considered.
Figure 31 is according to a kind of embodiment, handles the synoptic diagram of the method for blocking phenomenon.
Figure 32 is according to a kind of embodiment, handles the synoptic diagram of the method for blocking phenomenon.
Figure 33 is in the holographic display according to a kind of embodiment, the synoptic diagram in the path that video data is taked.
Figure 34 is according to a kind of embodiment, follows the trail of the synoptic diagram of one or more users' method by using controlled prism mobile virtual observer window.
Embodiment
A. the hologram display device of on same substrate, calculating with pixel
A kind of embodiment comprises display device, and this display device receives real space image data, as with corresponding intensity map of 3-D view (intensity map) and depth map (depth map).Subsequently based on 3 d image data, in real time or the quasi real time holographic encoding of computer memory photomodulator.Holographic at least some that calculate can be carried out in the existing physical space of picture element matrix, by in conjunction with two functional units, be hologram computing unit and hologram display unit, these two unit separate on the function He on the space in the equipment of prior art, in conjunction with the back to be formed on the sharing unit of implementing on the substrate.This means that the transistor that is used at least some holograms calculating can be integrated between the transistor that is used for pixel control, perhaps the next-door neighbour is used for the transistor of pixel control.Alternatively, all holograms calculate and can carry out in the existing physical space of picture element matrix, by in conjunction with two functional units, be hologram computing unit and hologram display unit, these two unit separate on the function He on the space in the equipment of prior art, in conjunction with the back to be formed on the sharing unit of implementing on the substrate.Alternatively, being used for some or all of transistors that hologram calculates can be in the outside of picture element matrix, but with the transistor that is used for pixel control at same substrate.It will be apparent to those skilled in the art that term " on same substrate " and do not mean that transistor can only be on atomic level and substrate contacts, but mean that substrate provides the physical support that circuit is set medium generally.More information about the meaning of " substrate " can provide in the paragraph of " substrate " at title.
The calculating of other position hologram is not limited to the analysis hologram computing method described in the prior art in the picture element matrix or on the same substrate.The computing method of other type also are feasible as question blank (LUT) method.Analysis calculation method can be used as the example of demonstration computing method.For the calculating of the hologram in the picture element matrix, holographic computing method can be identical on whole display device, and preferred outside the distance that is about the subhologram size exchange be used to add data with subhologram.Subhologram is used for calculating.Can be on whole display device surface unfolding calculation equably.But for design, simulation and the checking that alleviates hardware, calculating can be divided into the little identical part that is called cluster, this cluster is tiled in the display device surface.Tiling not necessarily must be a rectangle, also can be other structure, as the hexagon (" honeycomb ") of tiling.Title " cluster " is used for the computing unit in cover part or whole hologram computational data path.Therefore, cluster can be the minimum unit that can calculate the hologram data that is used for the display device tiling from the part of original real space data.These clusters are swap data between adjacent unit preferably, so that from the subhologram of adjacent unit when overlapping, can accurate coding SLM.This as shown in figure 24.An advantage of cluster method is: after the design cluster, can successfully set up holographic the demonstration together by identical cluster is tiled.
Ideally, need very high resolution as 16,000 * 12,000 pixel has the very hologram of high image quality with demonstration, shows that perhaps virtual observer's window is 1 centimetre or more centimetres wide but not the hologram of several mm wides, perhaps these two kinds of situations.The picture material that shows comprises intensity image and three-dimensional depth information (can be called " Z buffering "), and this picture material typically only has the nearly resolution of 2,000 * 1,500 pixels.As shown in Figure 1, the required data rate of display holography figure is much larger than showing the required data rate of raw data, and for example, for given example value, multiple is 48.In Fig. 1,3 d image data is that the form with intensity map and three dimensional depth figure provides.Preferably, should be each eye, be each virtual observer's window and make up a depth map and intensity map pairing.Each of these figure is all by 2,000 * 1, and the data array of 500 pixels is formed.In each figure, the data that are used for each pixel are represented by three colors and a z value, i.e. 4 values, 8 of each values.The position is a binary digit.Therefore each pixel needs 32.Speed with 25Hz or 25 frame per seconds (fps) provides video data.As shown in the figure, use two views (left eye and right eye), data transfer rate is per second 4.8Gbits.In simple example, these data are used for computed hologram on basis frame by frame, can carry out in more complicated example although relate to some data processing of successive frame, for example, in order to level and smooth noise or reduction artificial affecting, or reduce needed message transmission rate.Holographic calculating generates and the corresponding data output of the data array of 16,000 * 12,000 pixel, and wherein, each pixel is by 8 bit representations, and frame rate is 150fps, uses the video rate of 25Hz, two views and three kinds of colors simultaneously.Therefore as shown in the figure, the data rate that is used for hologram is per second 230Gbits.Content representation among Fig. 1 show the process of three primary colors red, green and blues.This example relates to single user's configuration, but corresponding multi-user's configuration with higher frame rate of display also is feasible.To those skilled in the art, many other examples of data rate will be conspicuous in the holographic display.
It is emphasized that for mobile image the frame rate of about 25Hz is minimum acceptable speed.Be higher than the playback that the frame rate of 25Hz should be more smooth.Frame rate is high more, and the observer is presented in playback will be smooth more.
Only can be to given display light wavelength computed hologram.Why Here it is carries out the reason of calculating for three times to each object point, is each and forms color, carries out once as red, green and blue.Other color can assign to create by using these three kinds of color-set, and this blend of colors can realize in order or simultaneously.
If generate in the circuit of hologram on same substrate, as in picture element matrix, then only raw image data need be sent to display device substrate.When hologram is to use under the situation that the circuit in the picture element matrix generates, intensity and depth information are sent to will need them to be used for the position that hologram calculates subsequently in the panel.In a kind of preferred display device of embodiment,, only consider the value of the child partition of original image for the pixel value of computed hologram.A reason of doing like this is, in the preferred display device of this embodiment, the light that is used to rebuild is not relevant fully on whole display device, but relevant in the child partition of display device, this child partition may be a very little child partition of display device.Do not exist relevant, the perhaps relevant limited range that exists only in from a child partition of display device to the different child partition of display device.Each child partition of preferred display device can be with the corresponding subhologram that generates whole hologram.Therefore the size of subhologram defines the largest extension of pixel peripheral region, from this pixel, needs the intensity of original image and depth value to be used for the calculating of subhologram.As Fig. 3, this so that define the length of inner necessary lead (so-called " local interconnect (localinterconnections) ").Because, according to this solution, generate the whole of the required a large amount of pixel datas of hologram or at least some are to calculate in the direct zone that they will be shown on display panel, do not need or reduced the needs that transmit holographic video data or intermediate storage of data by long lead.This can reduce the resolution of the data that will send to display panel, and can reduce the data rate that sends to display panel thus.If this example is applied in the situation shown in Figure 1, message transmission rate will obtain about 50 times reduction.Therefore, according to Fig. 3, will correspondingly reduce across the quantity of the row and column lead on whole front panel (so-called " globally interconnected (global interconnections) ").Enough be used for lead that raw image data transmits than enough being used for lead that hologram data transmits still less, and can correspondingly reduce transmission frequency, also help to reduce the power attenuation of row and column in driving extraly.
Reduction data transmission frequency helps to reduce the power attenuation in the row and column driving.This is because of from 0 to 1 conversion binary numeral, or opposite transition, all needs electric energy.When conversion ratio rose, power requirement also can rise.Energy finally dissipates with heat energy, and this can cause the temperature problem in the high data transmission frequency display device.Temperature problem can comprise splitting of the assembly heating can not be touched, thermic stress causes electronic package and inefficacy, unwanted chemical reaction such as electronic package oxidation, be exposed to the decline of the liquid crystal material quality that causes under the extreme temperature, and the raise heat that causes of the change of semiconductor material characteristic such as temperature is carried schizogenesis and is become (thermal carrier generation).When installing with powered battery, if from battery, draw more energy, battery is discharged faster, this can be reduced in the number of times that device can be used between the battery charge.
The major part of needed each elemental area of row and column lead can be used for other purpose now in the prior art solution.Fig. 2 has compared the principle of work of two kinds of solutions.In based on prior art solutions, consider high resolving power holographic display with 16,000 * 12,000 pixel.In order to shorten rowaand column lines, for example as shown in figure 28, the display device tiling is 4 quadrants.Each quadrant has 8,000 column wires and 6,000 row leads.Need 32,000 column wires and 24,000 row leads altogether.For a user, has the frame rate of display that three kinds of composition colors (as red, green, blue) and each two view (left side and right) with 25fps video rate (frame rate-intensity of input data and z buffering) cause per second 150 width of cloth images.Multiply by line number and increase by the 10% blank transmission time that is used for interframe, then need the row driving frequency of 1MHz.In the example according to a kind of solution of embodiment, view data is according to 2,000 * 1, and the real image pixel array of 500 pixels provides.If display device is 4 quadrants by tiling also, then each quadrant has 750 row leads.It is multiply by per second 150 width of cloth images and increase by the 20% blank transmission time that is used for interframe, then only need the row driving frequency of 135kHz.This example relates to single user's configuration, but the multi-user's configuration that correspondingly has higher frame rate of display also is feasible.
Depend on panel and calculating parameter, the space of saving in the row and column lead can be omitted in the solution according to the embodiment of Fig. 2, when when comparing according to the prior art solutions of Fig. 2, the space of this saving can be bigger than being used for the circuits needed space that hologram calculates, and therefore only needs the part in the space saved to be used for hologram and calculate employed transistor.In this case, the area of transparency electrode can be increased, and the transmittance of LCD can be improved thus.Owing to calculate is to realize in the pixel region of saving, so do not become redundant at the additional computing unit that can cause sizable difficulty and cost on the same substrate and in any known legacy equipment with display device.Another advantage is, greatly reduced the complicacy of panel control, and reason is that to be used for the data rate and the traditional LC Ds of panel control basic identical.For exemplary 2, the resolution of 000 * 1,500 pixels, 25fps and every pixel have two views of 32, the data rate of 4.8Gbit/s with have 1, the data rate of the TFT panel of 920 * 1,600 pixels, 60Hz frame rate and three kinds of 8 colors is basic identical.This example relates to single user configuration, but the multi-user's configuration that correspondingly has a higher frame rate of display also is feasible.This means with traditional display technique and just can control this panel like a cork, yet, transmission between computing unit and display device electron device and between display device electron device and the display device panel with whole hologram of exemplary data transmission speed 230Gbits/s among Fig. 1, have only be only when using special solution feasible, those skilled in the art should understand, use special solution to be difficult to carry out, and will be very expensive.
If we consider hologram two-dimensional encoded on the spatial light modulator, wherein original real space image has 2,000 * 1,500 pixels, and provide with the video frame rate of 25fps, then need about 100,000,000 transistors to be used for holographic calculating, i.e. about 34 transistors of each real space pixel haply.This is for the monocrystalline silicon circuit with 200MHz inversion frequency.Because the TFT that is made by polysilicon can have the inversion frequency that only is about 25MHz, so about 6.9 hundred million transistors rather than 100,000,000 transistors are necessary, with the low slewing rate of compensate for slower.The hologram resolution of given 16,000 * 12,000 pixel this means about 4 transistors of each hologram pixel.Because when showing new images, the data that calculate only can write in the pixel cell, so each pixel will need 1 or 2 transistor adding.When keeping identical resolution, the size of display device is big more, and pel spacing will be big more, and the transistorized quantity that therefore can additionally be arranged in around the pixel will be big more.In " transistor size estimation " part, can provide more detailed number of transistors purpose and estimate.
If by row and column lead control panel, then these leads should be wideer, display device should be bigger.This is because for fixing conductor material resistivity and long-pending for fixing conductive wire cross-section, the resistance of lead is directly proportional with its length; For fixing conductor material resistivity with for fixing conductor length and thickness, the resistance of lead and its width are inversely proportional to.This means, relative classical control technology, particularly big relatively high resolving power holographic display, this method of computed hologram is favourable in picture element matrix.
As the transistorized integrated huge advantage that has of TFT, the transistor AND gate pixel transistor that promptly is used to calculate together is applied to substrate.
Have only when the transistorized quantity that increases may cause higher probability of malfunction, just can produce additional cost.This can remedy by using the fault-tolerant calculation method, and wherein the mistake in each element only can cause the little deviation from result of calculation, if there is not assembly to have defective, then will obtain this deviation.
In Fig. 2 and Fig. 3, calculate in many contiguous computing units that are called cluster and carry out.Generally, the size of computing unit (cluster) is with optimised, because their size is big more, the saving in the message transmission rate will be more little on the one hand, yet the realization of calculating on the other hand will be easy more.
In a kind of further example of embodiment, display device is used to show based on real space data such as intensity map and depth map data and the hologram image data that calculate.The intrinsic problem of display device is in the prior art, the circuit that they need not implemented on same substrate with the display device circuit.This additional circuit must be implemented on the substrate that separates with display device substrate.This can cause not desired characteristics, as bigger equipment volume and weight.The consumer constantly requires littler, thinner or lighter display device.A kind of holographic display of embodiment has and the counting circuit of display device circuit on same substrate.This counting circuit can be between the pixel of display device, or can be in the picture element matrix outside of display device but still on same substrate.
Incorporate explanation in liquid crystal on silicon (LCoS) display device
For little LCoS display device, situation is slightly different, and little LCoS display device is applicable to silicon single crystal wafer.For this display technique, higher frequency is feasible, so to be less than a transistor also will be enough even calculate each pixel for holography.In general, calculate identically with discrete calculation to a great extent, computing unit only can be interrupted by pixel cell.Because it is identical calculating required silicon area, so can obtain by this fact of data that only transmits or store lesser amt to save here.This has reduced the required area of row and column lead, helps the transmission of data to LCoS.Yet, counting circuit can with the display device circuit on same substrate, this counting circuit is not arranged in the display device circuit, compares on different substrates with the display device circuit with counting circuit, this solution will be compacter and more cheap.
The local forwarding
Because existence is used for the data that calculate are carried out the local additional logic of transmitting, so it can also be used in the lump to each zone forwarding original image, so that overall row and column lead becomes unnecessary fully.For example, raw data is forwarded to cluster with shift register from cluster.Because row control realizes in this locality, so the omission of row lead can also make the left and right writing information that is used for of display device on hand.
The fault-tolerant calculation unit
For having resolution as 1,600 * 1, the general T FT display device of 200 pixels may have foozle, because this manufacturing mistake of pixel error can become obvious.In holography, high-definition display device has the pixel of greater number, therefore has the TFTs of greater number, and this has greatly increased the possibility of pixel error.If for calculating integrated additional TFTs, error rate will rise again.Therefore, need a kind of computation process of design so that the error among the single fault TFTs can not propagated by whole display device, and only cause the local deviation little with ideal performance.
Some foozles may cause the sightless consequence of observer, perhaps only can be perceived slightly by people's vision system.In this case, people may tolerate this defective.But for example the cluster that damages fully is flagrant, because in this case, many SLM unit has been subjected to influence.
Redundant circuit as TFTs, can be made in the space of picture element matrix, so that sort circuit can be used for some circuit of using when alternative starts, if find that device starts some circuit that use and breaks down.Device is self check every now and then, as the indicating circuit fault whether of the converting characteristic by detecting a circuit.Faulty circuit can be recorded as in storer such as nonvolatile memory and can't use, and other circuit is recorded as in its position use.In " PhysicsToday (physics today) " the 38-42 page or leaf in January, 2000, report a kind of similar method that is used for fault-tolerant traditional calculations machine circuit in " Physicsand the Information Revolution (physics and information revolution) " literary composition of J.Birnbaum and R.S.Williams, quoted the document by reference here.Alternatively, this circuit can be designed to cause the likelihood of failure of permanent black picture element bigger than the likelihood of failure that causes permanent bright pixels, because the observer more is difficult to accept the latter.
For the fault-tolerant design of optimum, the transistor of big component size can be implemented in prior position in circuit, especially has the transistor of big lateral dimension, to reduce the more possibility of pith fault of circuit.Further method is the hybrid pipeline, so that the distribution of results of defective unit is on big surf zone.Be understandable that,, can add about 1000 or bigger value for the value of calculation holographic pixel.If these values all come from same pipeline, then when this pipeline breaks down, the hologram pixel value will be full of prunes value.If cluster is made up of parallel pipeline, inner cluster topology can be arranged by this way, promptly is used for the numerical value of addition to come from pipelines that all walk abreast.If numerical value comes from for example 4 pipelines, then when a pipeline fault, only 25% of input value will be incorrect.In this case, the hologram pixel value that calculates will be more accurate than input value 100% incorrect situation.
" repairing " strategy subsequently can use in some cases.In this case, at the test phase identification trouble unit of display device, and revise circuit by the relevant transmission line of physical break subsequently.This method can solve short circuit.Cut off to connect and to guarantee that most of fault pixels of not expecting (for example, high strength continues the pixel of flash of light) can be improved their blackening by simply they being turned off.
For device according to embodiment, can be according to summary manufacture process given below, or their some combinations, or make according to conspicuous other manufacture process for a person skilled in the art.In the device of embodiment, organic semiconductor also can be used for making circuit.
B. the hologram display device of calculating on same substrate, this device can effectively calculate for the coding of spatial light modulator.
The conversion of the three-dimensional content that presents of the big hologram (CGH) that generates for the computing machine of the reconstruction that is used in real time or quasi real time changes, known method can only be paid great efforts and could realize aspect computational resource.In the prior art, name is called " being used for generating in real time the method that computing machine generates video holograms under the help of LUTs ", publication number is to have described a kind of improvement in the patent document of WO 2008/025839, and the interactive real-time hologram with reconstruction object point of 1920 * 1080 can be with personal computer (PC) system on sale on the market, use the precomputation subhologram and real-time interactive ground demonstration under the help of question blank (LUTs).The characteristics of art methods are that object point only can be rebuild in the specific discrete position, shown in circle open among Figure 14.The method of a kind of embodiment described herein has been walked around this restriction, and object point can generate in the optional position in rebuilding frustum in the method, shown in circle closed among Figure 14.How the object point that Figure 14 has represented to use prior art LUT method to generate (circle) is distributed to the certain objects plane regularly.Object plane and then be arranged on from fixed range place, hologram plane.By contrast, according to a kind of analytical approach of embodiment, object point (circle of filling) can be at an arbitrary position.
The enforcement of part A can use the computer memory photomodulator Methods for Coding that is used for of prior art to implement.Alternatively, the enforcement of part A can be used provides more efficient coding Calculation Method to implement to spatial light modulator.In publication number is the patent document of WO 2008/025839, a kind of more effective computing method have been described.Following more efficient methods is a kind of embodiment of applicant, and itself does not need the calculating of Fourier transform or Fresnel conversion this method, therefore can effectively implement.Can also say so that following more efficient methods does not need the calculating of Fourier variation or the calculating of Fresnel conversion.
For spatial light modulator provides the example of more efficient coding Calculation Method as follows.It is the method for an analysis, describe with reference to figure 8 and Fig. 9, the computing machine that is used for holographic display (HAE) generates the generation of video holograms, this holographic display comprises spatial light modulator device (SLM1), wherein in one or more virtual observer's windows (VOW), rebuild the wavefront that sends by object, and, the reconstruction of each single object point (OP) of three-dimensional scenic (3D-S) only needs the subclass of subhologram (SH) as the whole hologram (H ∑ SLM) that will encode on SLM, it is characterized in that, with 3D scene (3D-S) discrete turn to a plurality of object points after, this method comprises following steps:
Each visible object point (OP) for the 3D scene
Steps A:, determine the position of subhologram (SH) for each object point (OP).
For example, use the cross spider principle, wherein, by from the object point on hologram plane with virtual visibility region project to SLM originally on one's body.If enough degree of accuracy are arranged, subhologram just can be similar to/be modelled as rectangle.Distribute the initial point local coordinate system of the heart therein to subhologram; The x coordinate is a horizontal ordinate, and the y coordinate is an ordinate.Subhologram has half-breadth and is " a ", and half height is the size of " b ".
Step B:, determine the subhologram of virtual lens (L) for each subhologram (SH) in hologram plane (HE).
B1: the focal length (f) of determining virtual lens.The focal length of lens (f) is with the orthogonal distance of the SLM of rebuilt object point (OP) in hologram plane (HE).
B2: the subhologram (SH of lens L) complex value:
Use formula z L=exp{-i*[(π/λ f) * (x 2+ y 2)] determine the complex value of subhologram, and wherein λ is that beche-de-mer without spike is examined wavelength, f is a focal length.Shown in Fig. 9 A, the positive sign of f is corresponding to convex lens in the formula.As shown in figure 27, if SLM dorsad observer's a side use virtual divergent lens to rebuild object point (OP), then need the f of negative value.
B3: because z LWith respect to the symmetry of the positive negative value aspect of x and y, so use suitable symbol just to be enough in a quadrant, determine z LValue, and enough the result is transferred in other three quadrants.
Step C. determines the subhologram (SH of prism in the hologram plane (HE) P):
Because selected local coordinate system, prism will cause phase shifts, and phase shifts is the linear function of x and y coordinate thus.
C1: the linear factor C that determines to have the prism (P) of level effect x, wherein, in the interval x ∈ [0, a], C x=M* (2 π/λ); M is prism absolute slope (Fig. 9 B).
C2: the linear factor C that determines to have the prism (P) of vertical effect y, wherein, in the interval y ∈ [0, b], C y=N* (2 π/λ); N is prism absolute slope (Fig. 9 C).
C3: prism subhologram (SH P) complex value:
Subhologram (SH is determined in stack by prism P) complex value, z wherein p=exp{i*[C x* (x-a)+C y* (y-b)] }.
C4:, then can ignore prismatic correction if light source is imaged onto VOW by holographic display.
Step D: the modulation of the subhologram of lens and the subhologram of prism:
Shown in Fig. 9 A, the complex value of combination subhologram is answered to take advantage of and is provided by the effect of virtual lens (L) and virtual prism (P), i.e. z SH=z L* z P, this formula can symbolically be expressed as SH=SH L* SH P
Step e: phase shifts
Evenly throw light in order in visibility region, to obtain, each subhologram (SH) (homogeneous distributes) phase shifts modulation, wherein the phase shifts of each subhologram is inequality.This can reduce the speckle patterns from the light source with optical coherence.The size of phase shifts is enough to be used for reducing speckle patterns, and can less than the π radian (that is, and needn't-π<Φ o<π, yet for example-π/4<Φ o<π/4).This process can be by z SH:=z SHExp (i Φ 0) represent that this formula can symbolically be expressed as SH:=SH exp (i Φ 0).
Step F: intensity modulated
The complex value of each subhologram uses the intensity factor that obtains from frame buffer content (monochromatic or colored as R, G, B) to modulate respectively, so that object point presents they self brightness and color when appropriate.
z SH=C*z SH, this formula can symbolically be expressed as SH:=C*SH;
Step G: add with subhologram to form whole hologram H ∑ SLM
Subhologram can use the complex addition stack.According to the coordinate system that is used for complete hologram, whole hologram be the plural number of subhologram add and, by the H ∑ SLM=∑ SH iProvide, this formula can symbolically be expressed as Z SLM=∑ z SHi
In the example of some embodiments, above-mentioned steps C, D and E can omit or make up omission separately, wherein, for some benefits, as reducing the manufacturing cost of implementing the required hardware of said method, can and then reduce the quality of rated output or hologram.
Further note that if the object point of rebuilding is thought of as the focus of optical system, this means in the hologram plane has lens, this lens tilt also has focal distance f.The lens that tilt are made up of non-inclination lens and prism.According to method herein, rebuild object point so that in subhologram coding lens function, if necessary, the prism function of also encoding (referring to Fig. 9 A).Can generate the scene of forming by a large amount of points by the stack of subhologram.By the use of this method, the object point that is used for the interactive real-time holographic reconstruction can use standard hardware components on sale on the market to generate in any position that rebuilds frustum.This solution can also easily be readjusted the quantity of object point.When the performance of processing unit strengthens, can increase the quantity of object point.
Computation process may be summarized to be:
1. the calculating of lens
A. find out focal distance f
B. the use of lens equation: * (x e^{-i*[(π/λ f) 2+ y 2)]
2. the calculating of prism condition (it is optional to depend on process)
A. determine Cx, Cy, a and b
B. equation: e^{i*[Cx* (x-a)+Cy* (y-b)] }
Cx=(2π/λ)*m
Cy=(2π/λ)*n
3. the modulation of prism and lens condition (it is optional to depend on process)
4. the application of random phase (it is optional to depend on process)
5. intensity modulated
6.SLM-the specific coding of hologram
C. on same substrate, carry out the hologram display device that decompress(ion) calculates
A kind of embodiment comprises display device, and this display device receives real space image data, as with corresponding intensity map of 3-D view and depth map.Then based on 3 d image data, in real time or the quasi real time holographic encoding of computer memory photomodulator.All or at least some hologram demonstration is calculated and can be carried out in the existing physical space of picture element matrix, by making up two functional units, be that hologram shows computing unit and hologram display unit, these two unit separate on the function He on the space in prior-art devices, and the combination back is to be formed on the sharing unit of implementing on the substrate.This means that being used for all or at least some hologram shows that the transistor that calculates is integrated between the transistor that is used for pixel control, or the contiguous transistor that is used for pixel control.Alternatively, hologram shows to calculate can use with the circuit of image element circuit on same substrate to be implemented, but wherein, hologram shows the outside of counting circuit at image element circuit.
In this further example of a kind of embodiment, hologram calculates in such position and carries out, and this position is not in the occupied space of picture element matrix.Be that such calculating has the advantage of local look-up table access (LUTs) described in the patent document of WO2008/025839 as publication number, it has increased the counting yield of calculating.As Fig. 1 clear and definite, the outside problem of carrying out holographic Calculation Method is in the space of display device pixel: for the pixel of display device, need very high total data transfer rate.If adopt method as shown in Figure 4, then can avoid this problem.
In display device, the hologram coded data is outside calculating the in the occupied space of picture element matrix.Carry out these calculating the space can, also can be not on the substrate identical with the substrate of display device.Use known data compression technique compression hologram coded data, being transferred to then is in the display device cluster of a whole display device part.In Fig. 4, the TFTs that is used for hologram calculating carries out the data that receive by the row and column lead and separates compression functions.Yet data can also receive by alternate manner, and as by parallel data bus line, or serial data connects.Therefore, also allow based on the hologram display device of cluster one by one, this hologram display device has reduced the requirement that interconnects between the source of hologram display device pixel and image intensity figure, picture depth figure.So also be feasible, that is: hologram calculating and data compression can be carried out in the outside of display device substrate, data decompression is to use with the circuit of pixel on same substrate of display device and carries out simultaneously, but wherein, decompress(ion) is in the outside execution in the space of picture element matrix.For those skilled in the art, other example will be conspicuous.
D. on same substrate, carry out the high-definition display device that decompress(ion) calculates
In a kind of further example of embodiment, high-definition display device is used for the display of high resolution images data, and these data can be normal video datas or can be based on intensity map and hologram video data that the depth map data computation goes out.The intrinsic problem of the high-definition display device of prior art is: they need high-density circuit, and high-density circuit has foozle easily, and the high inversion frequency of they needs, and high inversion frequency can cause producing overheated problem.If adopt method as shown in Figure 5, then can reduce or avoid these problems.
In high-definition display device, view data is in the known data compression technique compression of the inner or outside use of display device, and being transferred to then is in the display device cluster of a whole display device part.Carry out space that compression calculates can, also can be not on the substrate identical with the substrate of display device.In Fig. 5, the TFTs that is used for decompress(ion) calculating carries out the data that receive by the row and column lead and separates compression functions.Yet data can also receive by alternate manner, and as by parallel data bus line, or serial data connects.For minimum storage requirement, will need the 25Hz frame rate be used for the TFTs that decompress(ion) calculates, be used in 40ms or the pixel data presented by cluster in the time still less with decompress(ion).Therefore, also allow based on the image display device of cluster one by one, this image display device has reduced the requirement that interconnects between the source of image display and image intensity figure, picture depth figure.For those skilled in the art, other example will be conspicuous.
In preferred example, send the real space image data of compression to the cluster of display device.In first step, cluster is carried out decompress(ion) to the real space image data of compression.In second step, come the calculation holographic video data by the data that the cluster of display device uses first step to produce.For those skilled in the art, other example will be conspicuous.
E. the hologram display device of calculating on same substrate is used for the attached processing unit of holographic conversion and coding by introducing, and the 3D that this device has the expansion that is used for graphics subsystem plays up pipeline.
The enforcement of part A can use the method that is used for the space encoder photomodulator in the prior art to implement.Alternatively, the enforcement of part A can be used provides the method for more efficient coding to implement to spatial light modulator.Spatial light modulator is provided the example of method of more efficient coding as follows, but for those skilled in the art, many other examples will be conspicuous.
An example of this method as shown in figure 15, the 3D that the attached processing unit that this method is used for holographic conversion and coding by introducing has been expanded graphics subsystem plays up pipeline.This method is applicant's a embodiment.Statement " attached processing unit that is used for holographic conversion and coding " will be substituted by term " holographic pipeline (holo-pipeline) " in the back.Holographic pipeline directly is arranged in the descending of 3D graphic pipeline.The 3D pipeline data that is used for each cluster is sent to the corresponding cluster of display device; Explanation from here on concentrates on single other embodiment of cluster level.Z figure buffering and color diagram buffering (color diagram R, color diagram G, color diagram B) form the interface between two pipelines.This is shown schematically among Figure 15.For each a single point in the pixel coordinate, Z figure comprises the z value, and this z value is a bi-directional scaling, and it can be represented with different definition grade (definition level).The Z value is convergent-divergent in the scope between 0.0 to 1.0 typically, but other scope also is feasible.The definition grade is determined by figure place, promptly is generally 8,16 or 24.
In the Modern Graphic subsystem, color diagram is with 24 definition, and promptly each color component is 8, R, G, B (red, green, blue).Color diagram forms the part of frame buffering, and the content of color diagram normally is presented on the screen.Definition contains two bufferings of Z figure and color diagram, is used for forming 3D and plays up interface between pipeline and the holographic pipeline.For a demonstration wavelength provides Z figure, but this is not the specific wavelength of R, G, B.The copy of Z Figure 150 1 and 1502 is provided for all the other two demonstration wavelength.
Only can be with given display light wavelength computed hologram.Why Here it is carries out the reason of calculating for three times for each object point, and promptly each primary color red (λ R), green (λ G), blue (λ B) are respectively once.Can assign to create other color by utilizing these three kinds of color-set, and this blend of colors can realize in order or simultaneously.In order to improve processing speed, use at least two additional holographic pipelines, so that hologram calculates executed in parallel.The result of all three kinds of color component can obtain simultaneously like this.Because like this, the z diagram data need be copied to additional memory portion 1501 and 1502 (referring to Figure 15), these two memory portion can independent access.Thereby prevent that the operation meeting that comprises memory portion such as z diagram data from hindering mutually.Therefore desirable memory portion should physically be separated.The color diagram RGB content that is used for color G and B also copies to memory portion color diagram G and color diagram B separately respectively, to guarantee the independent access (referring to Figure 15) to three kinds of color component.Once more, memory portion can physically be separated, conflict when preventing memory access, and reduce or eliminate the problems such as realization difficulty of the synchronization of access that has semaphore, mutually exclusive algorithm (or " mutex (mutexes) "), these problems have adverse effect to system performance.However, although memory portion can be physically separated from each other, they still preferably are arranged in the same cluster of display device.It should be noted that semaphore is shielded variable (or abstract data type), and it has constituted the classical way that is used in the multiprogramming environment limiting to shared resource (as storer) visit; Mutually exclusive algorithm is used in the concurrency programming and uses when avoiding common source, as global variable, is used simultaneously by the multistage computer code that is called key component.
The hypothesis hologram is made up of many subholograms below.Wherein m subhologram represented by lens, scioptics Function e ^ (i C t* (x m 2+ y m 2)) describe.Constant C tThe focal distance f that comprises lens; The value of f was calculated before using the lens function, so that the value of f thereby can be used for all three pipelines.Therefore, the value of f is not that color is specific, because it is a virtual lens, it does not need to demonstrate aberration.Can utilize the advantage of lens funtcional relationship, because lens are axisymmetric about himself x and y.In order intactly to describe lens, function only needs to be applied in the quadrant.The lens functional value that calculates in quadrant can be applied in other three quadrants by using the sign rule of symmetry subsequently.
C tAlso depend on wavelength X, this wavelength X is inequality naturally in three kinds of color R, G, B.Do not need to calculate the value of λ, because it is known, owing to use laser or the light source determined to be used for each wavelength; Yet, in order to calculate the C that is used for each original display color t, the value of λ should can obtain (referring to Figure 15) in calculating.
Depend on employed technology, except that the lens function, may also need to use prism function (referring to Figure 15), to revise the direction that light is propagated.In the prism function, constant also comprises wavelength X.Because three kinds of primary colors have different wavelength, thus the value of this constant change so that for each of three holographic pipelines, the value of this constant has specific value.
As shown in figure 15, lens function and prism function are all taken advantage of at 1503,1504 and 1505 places now again.Subsequently, use random phase at 1506,1507 and 1508 places, this random phase adds on the result of multiplication of lens and prism function.This method is intended to avoid the brightness peak in the observer plane, or " spot ".Use the intensity of each color diagram to modulate each hologram at 1509,1510,1511 places then.
In the next procedure, subhologram carries out complex addition to be formed for total hologram (referring to Figure 15) of cluster.Can obtain being used for the result of subsequent treatment now, if be suitable for, then in the holographic display cluster, use additional algorithm, as the application of correction chart or gray level image (gamma correction), this only is decided by the system property of SLM, so that they are preferably proofreaied and correct in this stage.Follow by cataloged procedure.
Hologram can be rebuild with colour.Depend on employed SLM, encryption algorithm (referring to Figure 15) changes bigger, and it can be phase encoding, amplitude coding or otherwise encode.
It will be recognized by those skilled in the art that some aspects of the embodiment that this part provides have more detailed open in other place of the application.
F. the hologram display device of calculating on same substrate has the mode of the 3D pipeline of the holographic graphics card that calculates pipeline by expansion, and this device carries out sequenced holographic conversion to the point in the three dimensions
The enforcement of part A can be used and be used to carry out holographic Calculation Method in the prior art and implement.Alternatively, the enforcement of part A can be used to carrying out the holographic method of calculating the time delay that reduction is provided and implement.For the example of carrying out the holographic method of calculating the time delay that reduction is provided as follows, but to those skilled in the art, many other examples will be conspicuous.
The purpose of embodiment is for the hologram display device of calculating near pixel, to compare the minimizing time delay with other holographic calculating.This can cause the extension of framework, as the extension of the framework of the graphics card (3D pipeline) of present use, by the additional hardware module that is used for holographic real-time conversion and coding.
Generally speaking, before carrying out holographic transformation calculations, whole three-dimensional scenic is formed by realizing that many 3D conversion and illumination are calculated.The pel (as point, line, triangle) of forming the object of scene will be handled the end pixelsization of pipeline at 3D.Whole result can obtain in two memory portion subsequently.These are frame buffering and Z buffering, can see from the observer position, and the frame buffering contains the color value (color diagram) of the scene of being seen by the observer, and Z cushions the depth map that contains the scene that convergent-divergent presents.In the method for prior art, only as result's (two memory portion) but whole times spent all just begin holographic conversion and cataloged procedure, because need visit this two memory portion to this.This causes the time delay of a frame of video.Such time delay is vital in some interactive application, as in game device.If time delay is long, the reaction time that can be used for player's operation will be too short, makes the player can not carry out the operation that some can be carried out originally.In playing fast, be vital the time delay that is no less than the frame of about 17ms in the 60Hz display device.Because if be useful on the application of they (target group such as video gamer should be included), holographic display just can be accepted by market.
3D hologram is imaged in the Military Application may have advantage, and as can observing the enemy army, or out of Memory such as terrain information, three-dimensional can be improved the fight that 2-D data shows and render a service.If use display device in the fight operation in Military Application, then above-mentioned time delay may cause attendant's killed or wounded, or the damage of expensive military equipment or destruction.Therefore, in Military Application, reduce the effectiveness that time delay can be improved the 3D hologram imaging.
In order to reduce time delay, do not need to wait until that whole colors and Z buffering figure are available.On the contrary, in case but a point in the space becomes the time spent by after the 3D line treatment, just can carry out holographic calculating immediately.Therefore, the 3D pipeline can be expanded by holographic pipeline as can be seen.
Being used for holographic conversion and calculation of coding time preferably should be no more than the 3D pipeline and calculate the 3D required time of point, because otherwise will generate further time lag.This theory is easy to realize on the subhologram basis, because in this case, only needs to handle necessary information.In view of this, consider that the result can be 1000 times or more times the computation burden of adding if holographic conversion is the whole dimension that single 3D point is applied to hologram or SLM from the space.Then, use current available computing hardware to come real-time calculating will become infeasible.The theory of subhologram and related description thereof are as shown in Figure 8.Figure 18 has represented the preferred use of subhologram in a kind of example of embodiment.Because subhologram is littler than SLM, so each subhologram can calculate quickly than the single hologram across whole SLM.In addition, subhologram can calculate in order, and like this, the situation than only carrying out after the entire frame that receives view data across the calculating of the hologram of whole SLM has greatly reduced time delay.When relatively two width of cloth Figure 18 A and 18B, can find that if uses subhologram the computation burden that then is used to calculate each object point is little a lot, because compare with whole SLM, the quantity of unit is still less in the subhologram.
In some examples of a kind of embodiment, be stored in the subhologram buffering from the subhologram (Figure 16) of the nearest point of observer.The 3D pipeline data that is used for each cluster sends to the corresponding cluster (Figure 17) of display device; Explanation from here on concentrates on single other embodiment of cluster level.To offer cluster as the input (Figure 17) of calculating about VOW size, VOW direction and its data from the distance of SLM.Each cluster of display device all has its oneself question blank, is used to store the coding of the subhologram of its demonstration, and this subhologram can be one or more subholograms.If generate more close observer's new point, then will calculate corresponding to this point (SH n) subhologram (referring to Figure 17), that is, after the size of having determined subhologram, carry out holographic conversion.Subsequently, the content of the cluster of SLM can not be covered by subhologram simply, because the SLM unit may contain the information from a plurality of subholograms.Why Here it is is subhologram (SH at position xy place N-1) the reason of clauses and subclauses search inquiry table, these clauses and subclauses were also shown on the cluster of SLM at that time.After the content of having read, calculate (the SH of current demonstration from the SH of LUT N-1) and new SH (SH n) between poor (referring to Figure 17).
Subsequently will be in position xy place computer memory than previous more close observer's 3D point, in this case, with this SH nRather than old SH N-1Be written to LUT (referring to Figure 17).Now, differ from SH DWill with the value addition among the SLM, and be stored in the frame buffering.After this process coding, if possible, and correction (referring to Figure 17).
Display device (SLM) offers computing unit (referring to Figure 17) with its configuration information (as typewriting resolution), and this fact means that any holographic display (SLM) will be feasible.This device size can be different, the number of unit or even the type of coding also can be different.Therefore, this solution is not subject to the SLM of particular type.
G. the hologram display device of calculating on a substrate, this device carries out randow addressing to holographic display
The enforcement of part A can use prior art be used to carry out holographic Calculation Method and implement.Alternatively, the enforcement of part A can be used to carrying out the holographic method of calculating the process that improvement is provided and implement.For the example of carrying out the holographic method of calculating the process that improvement is provided as follows, but to those skilled in the art, many other examples will be conspicuous.
The purpose of embodiment is by utilize the characteristics of subhologram in application, to reduce the amount that is sent to the data of exposure module (being holographic display) from content generating module (as graphics card).
In the prior art, the transmission of the view data of (as LCD or cathode ray tube (CRT) display) makes the full content of image export line by line from top to bottom from content generation unit (as graphics card) to exposure module, and is identical with traditional tube display.For the HDTV (HDTV) of resolution height to 3840 * 2400 pixels (as at http://www.pcmag.com/article2/0,1895,2038797,00.asp IIIAMA of the IBM of middle description (RTM) Berta display → present etc.), this can not cause problem, transmits fast enough because needed data volume can be passed through standard interface (as digital video interface (DVI) or high-definition media interface (HDMI)).
Yet desirable holographic display needs the pixel of greater number, in the observer plane, generating virtual observer's window (VOW), with in the more original device wide about 5 millimeters different, this virtual observer's window is wide 1 centimetre or more.Big VOW is very beneficial, because it is big more, the reliability aspect will be firm more when holographic display commerce was used.This is that the requirement to other assembly in the holographic display of tracking will be lower because in this case, and the holographic display of tracking for example is tracing system or the position sensors of tracing study person's eyes with respect to the position of display device.Alternatively, in the device of not implementing to follow the trail of,, then can improve the tolerance that move little to observer's head if increase the size of VOW.
The purpose of embodiment is to reduce the amount that is sent to the data of exposure module in the holographic display from content generating module, and in this holographic display, all or at least some holographic calculating occurs in the picture element matrix.
In the prior art data transfer procedure of Miao Shuing, transmitted all information in the above, comprised those information constant from a frame to next frame.Because hologram reconstruction point in three dimensions, so enough learn with respect to which point of former frame variation has taken place.In subsequent process, only consider those points (referring to Figure 19).
Single object point is created by subhologram SH, and the size of this object point depends on observer's position.Because the SLM unit may not only contain the information of a subhologram, may also comprise the information of a plurality of subholograms, so the SH's of the new point in SH that should calculate at the old point in position xyz place and same position xyz place is poor.In this example of a kind of embodiment, subsequently can be on SLM this difference subspace hologram of recompile SHD.
On basis frame by frame, be positioned at the inner or outside circuit kit of display device and receive the 3D rendering data, these 3D rendering data are made up of color or intensity map and Z buffering.As shown in figure 20, calculate the poor of successive frame.And then, with the form of image difference data, the video data after the holographic converter unit of display device sends renewal.As shown in figure 20, send and it is used to the relevant 3D difference dot image data of reconstruction point of encoding on SLM to each holographic converter unit.If for the successive frame at given cluster place, do not have difference between the video data, or difference can ignore, then do not need to send data to holographic converter unit, this can improve effective SLM turnover rate of display system.The part that system generates SHDs can be called " content generating module ", and can be made up of computing function and graphics card.Send subhologram to each cluster subsequently.The first task that cluster is carried out is to handle the information that receives by the separation hologram data with about the size of SHDs and the data of position.The task of cluster comprises SHD is write in the suitable R AM unit, so that SH shows with correct size exactly in suitable SLM position.
Except subhologram SH D(or optionally, the SH of new frame) can also be limited to the size and the position in the display device cluster thereof of subhologram in the pixel.The holographic video data that (for example as shown in figure 20) has separation vessel, this separation vessel to calculate in the holographic display cluster is divided into subhologram data, size and positional information.Both values of back are intended to calculate the address realm of subhologram among the RAM, so that subhologram SH or SH DData be written in the SLM unit correct in the cluster.
Common SLMs is an active matrix display device, and its unit should be brought in constant renewal in drop-out not.If only fresh content is written among the SLM, then the information in other zone will be lost (for example, referring to Figure 19: 4 stains wherein will no longer show).For this reason, special random-access memory (ram) be can use in this case, that is: new SH or SH only write at input end DS, and read whole storer line by line at output terminal, and write information to SLM.For this purpose, can use to allow to carry out simultaneously aforesaid two-port RAM s or other storage system that reads with write operation.
In the content generation unit, will determine to transmit which point, promptly depend on the variation in the 3D scene.Therefore, before sending data to holographic display, carry out the action of minimise data stream.Information can transmit with random order, because as mentioned above, subhologram is with additional information.This has different significantly with the transmission of data line by line that manifesting of prior art carries out in the system.
Aspect the client, promptly generate the place of content, described in the enforcement mode, before data transmit beginning, make the decision that whether will transmit data.If content changes fully,, then should transmit and the corresponding many subholograms of 3D object point as after interrupting or the situation about changing fully of the scene that will show.We can say that typically, the resolution of SLM is high more, it is big more that the transmission subhologram substitutes the advantage that transmits whole hologram.
H. the display device of computing function in pixel space
In a kind of further example of embodiment, display device is used for display image data, and this view data can be normal video data, perhaps can be based on the hologram video data that intensity map and depth map data computation go out.The intrinsic problem of the display device of prior art is, the circuit that they need not implemented on same substrate with the display device circuit.This additional circuit must with substrate that display device substrate separates mutually on implement.This has caused the performance do not expected, as bigger equipment volume and weight.The consumer continues to require littler, thinner or lighter display device.If adopt method, then can reduce these problems, as bigger equipment volume and weight as Figure 25.If computing unit is arranged on the pixel place near display device, then can reduce to show the delay of the arbitrary data that is used to show that calculates by computing unit.Delay behind this reducing helps the application as the high speed game station, or helps to be used for the equipment of Military Application, and when being used for the equipment of Military Application, the equipment execution speed of improvement can bring military superiority.
In the display device of Figure 25, carry out computing function at display device cluster place, this display device cluster is arranged between the display pixel of display device, perhaps the display pixel of close display device.The space of execution computing function and the substrate of display device are on same substrate.In Figure 25, the TFTs that is used to calculate carries out computing function.To those skilled in the art, other example will be conspicuous.
I. block
In computer graphical, term " blocks " and is used to illustrate that the object in the more close visual field covers (or blocking) mode further from the object in the visual field.At the graphic pipeline that is used for the 2D display device, before shadowed and rasterisation generation, implement a kind of blocking to remove hiding surface.Here in the content of hologram, the enforcement of blocking comprises that the object point of guaranteeing more close virtual observer's window covers further from the object point of virtual observer's window along same sight line.
In Figure 29, provided the example of the desired behavior of blocking that is used for holographic display.In Figure 29, from shown in eye position, can not see the side that cube is thicker because it by cube that side of the most close observer block.If VOW is that several times of eye pupil are big, then the observer can see cube from different directions, so that can see the side that cube is thicker.But for the simple embodiment that blocks, the side that cube is thicker will can not encoded on SLM, so even the observer changes direction of observation, the observer can not see the side that cube is thicker yet, because it is not encoded on SLM.
In Figure 30, the observer is from watching cube with directions different shown in Figure 29, so that can see the side that cube is thicker.But for the simple embodiment that blocks, if do not implement to block for the situation of Figure 29, then the side that cube is thicker will can not encoded on SLM, so the observer among Figure 30 just can't see the thicker side of cube, because it is not being encoded on the SLM: in Figure 29, be not the thicker object point that stresses to build of cube, therefore, in Figure 30, just be not the thicker object point that stresses to build of cube.
A solution of problem shown in Figure 30 is that VOW is divided into two or more segments.Be that each VOW segment is rebuild object point subsequently.Preferred and the human eye pupil of the size of each VOW segment big or small roughly the same.
In Figure 31, the observer will see object point 1 from eye position 1, but can not see the object point 2 that blocks.From eye position 2, the observer will see object point 2, but can not see the object point 1 that can not see from that position and direction of observation.Therefore, from eye position 2, the observer can see the object point 2 that is blocked by object point 1 when eye position 1 is seen.Object point 1 and object point 2 are encoded respectively in subhologram 1 and subhologram 2.
Yet in Figure 32, the object point 1 of coincidence and object point 2 can be seen from eye position 1 and eye position 2, because they are encoded respectively in subhologram 1 and subhologram 2.
Alternatively, can in the stage that makes up depth map and intensity map, carry out and block.In this case, be preferably that each eye (being each virtual observer's window) make up a depth map and intensity map is right.
In the example of the embodiment that comprises, block that calculating that the circuit that is to use in the picture element matrix space carries out implements here.Sort circuit can comprise TFTs.Block can also use with picture element matrix on same substrate but realize in the performed calculating of picture element matrix circuit external.
J. graphics card function
Graphics Processing Unit (Graphics Processing Unit) or GPU (are also referred to as VPU (Visual Processing Unit) sometimes or VPU) are the dedicated graphics rendering apparatus that is used for personal computer, workstation or game console.Modern GPUs is very effective aspect manipulation and demonstration computer graphical, and their high parallel organization makes them more effective than the CPUs that typically is used for the complex algorithm scope.
Modern Graphic processing unit (GPU) uses their most of transistors to carry out the calculating relevant with the 3D computer graphical.They are used for quickening texture at first and play up polygonal memory intensive work, have increased the unit subsequently to quicken geometrical calculation, as the summit being converted into different coordinate systems.The nearest development of GPUs comprises the interpolation technique of support (these programming tinter energy many identical operations that enough CPUs supported are come control vertex and texture), over-sampling and reduction aliasing to tinter able to programme, and very high-precision color space.
Except 3D hardware, current GPUs comprises that also basic 2D quickens and the frame surge capability (has Video Graphics Array (Video Graphics Array, VGA) compatibility mode) usually.In addition, support YUV color space and hardware overlapping (hardwareoverlays) (very important) from most of GPUs of nineteen ninety-five manufacturing, and support Motion Picture Experts Group's (MPEG) pel such as motion compensation and inverse discrete cosine transform (iDCT) from many GPUs of manufacturing in 2000 to digital video playback.Nearest graphics card in addition on card the high definition video of decoding, removed some burdens of CPU (central processing unit).YUV color space model is with the formal definition color space of a brightness and two chrominance components.The YUV color model is used in PAL, NTSC and the SECAM tertiary colour video standard.
Here in the context of hologram, the enforcement of graphics card function comprises the function of introducing above guaranteeing to implement when for the display device computed hologram, wherein, display device can be carried out all holographies and calculate in the picture element matrix space, perhaps carry out at least some holographic calculating in the picture element matrix space.For example, these many identical operations that comprise that enforcement can enough CPUs support are come painted, the over-sampling of control vertex and texture and in order to reduce interpolation technique, the very use of high precision color space of aliasing, to quicken texture and to play up polygonal memory intensive work, be converted to the geometrical calculation of different coordinates system in order to acceleration as with the summit, and carry out the calculating that comprises matrix and vector operations.For computed hologram, the structure of the highly-parallel of GPUs makes it more effective than the CPUs that typically is used for the complex algorithm scope.Alternatively, holographic display can be a device of not carrying out holographic calculating in the picture element matrix space.
Here in the context of hologram, the enforcement of graphics card function can comprise uses 3D to play up pipeline, and this 3D plays up pipeline and implemented by the TFTs in the picture element matrix space, perhaps outside but implement with the TFTs of picture element matrix on same substrate by picture element matrix.In other words, 3D plays up the function of pipeline, for example implements colouring function, and employed graphics card has been transferred to the TFTs that is arranged in the LC panel from prior art.
Alternatively, holographic display can be a device of not carrying out holographic calculating in the picture element matrix space.Also alternatively, holographic display can be one and not carry out the holographic device that calculates in the picture element matrix space, but holographic calculating can be used with the circuit of picture element matrix on same substrate and carries out.
K.2D-3D conversion
In an example of 2D-3D conversion, first image and second image that form a stereoscopic image send to display device, and all or at least some holographic calculating carried out in other position in pixel space or on the substrate of pixel.The 2D-3D conversion Calculation can occur in the circuit in the picture element matrix space or other position on the substrate of pixel, perhaps can occur in the circuit that generation will send to the depth map of display device and color intensity figure, perhaps as those skilled in the clear, it can occur in the circuit of other position.Second image transmitted can be two difference images (difference image) between the stereo-picture, because difference image will be typically than complete image needs data still less.If show carrying out 3 D video, then first image self can be expressed as the difference image between the preceding image of present image and steps.Similarly, second image can be expressed as the difference image between the image before present image and the steps.Display device can be used the calculation procedure changed of being used for commonly known in the art subsequently between 2D and three-dimensional (3D) image, from the data that receive, calculate two dimension (2D) image and corresponding depth map thereof.Under the situation of coloured image, need trichromatic three component 2D images, and their corresponding depth maps.Just can handle with the display holography image with 2D image and the corresponding data of depth map by device.Device is encoded holographic figure in its SLM.In order effectively to use transmission bandwidth, the corresponding decompress(ion) that the data of transmitting may be accepted known compression step and carry out in display device in this system.
Carry out the circuit of 2D-3D conversion and can have the right to visit the data bank that contains the known 3D shape of a cover, the 3D Data Matching that this data bank can manage to calculate with it, perhaps it can have the right to visit the data bank that contains the known 2D sectional view of a cover, and this data bank can be managed and the 2D view data coupling of importing into.If can find good coupling for known shape, this just can the speed-up computation process, because 2D or 3D rendering can be expressed with respect to known shape subsequently.The data bank of 3D shape can be provided, the 3D shape is as the shape of one group of sports star as the most successful tennis player or athletic face of Association football or health, and all or part of shape of topmost athletic ground such as famous tennis court or famous association football pitch.For example, the 3D rendering of people's face can be expressed as the image that display device has the right to visit, and adds the variation of facial expression, for example can be to smile or frown, some of adding hair lengths change, because since the data of for example storing from obtaining, hair may be elongated or have been cut.If the variation that continues has taken place, make to clearly illustrate that the data that device has the right to visit are expired that change significantly on long-time basis as people's hair lengths, then the display device data of having the right to visit can be upgraded by display device.If counting circuit runs into a 2D or 3D rendering, when can not find good coupling for this 2D or 3D rendering counting circuit in it has the right accessed record, it can the shape that this is new join in the record set.
The 2D-3D image transitions can also be based on single, non-three-dimensional 2D image, and uses the step that is used to carry out this conversion as known in the art to carry out.3D rendering data (depth map and color diagram) can send to subsequently and be used for the display device that hologram image calculates and shows.
Above-mentioned 2D-3D changes and can be used for being used for data presented on holographic display, in this holographic display, all holographies are calculated in the circuit that occurs in the picture element matrix space, perhaps at least some holographic calculating in the circuit that occurs in the picture element matrix space perhaps occur in other locational circuit of pixel substrate.
L. meeting (3D Skype TM)
From the E3660065 of European Community trademark application, Skype TMBecause of following well-known: the networking telephone (VOIP) point-to-point communication, file-sharing and instant messages service based on global network are provided; Communication service, file-sharing and instant messages service based on computer network are provided.
From the E4521084 of European Community trademark application, Skype TMBecause of following well-known: for other people provide Computer Service and software development, that is, and the computer software that uses during Telecommunications ﹠ Networking phone (VOIP) is used and design, data transmission and the instant messages service of hardware; For other people create and maintaining web; On computer server trustship other people be used for the website of global computer network; The installation and maintenance of computer software; The interim use that allows the user to use online, the computer software that can not download of VOIP communication service is provided; The online software that other people download that is used for that allows the user to use the VOIP communication service is provided.
From No. 2358090 trade marks of Britain, Skype TMBecause of following well-known: access to the Internet, inlet and cache service are provided; Telecommunications and telecommunications service; Internet Protocol (" IP ") service; The networking telephone (" VoIP ") service; Email and Internet traffic service; Via third-party telecommunications service; Internet Protocol (" IP ") to digit phone number and digit phone number to " IP " mapped system and database; Domain name and dns database system; The lease of the access time of the Computer Database that the ISP is provided.
Except Skype TMProvide that VOIP's is the sort of, top any one can provide with holographic display, this holographic display can use the circuit in the picture element matrix space to carry out all holographies and calculate, perhaps use the circuit in the picture element matrix space to carry out at least some holographic calculating, here provide based on the voice of Internet Protocol and hologram image (Voice and Holographic ImageOver Internet Protocol, VHIOIP).In one case, above-described process is carried out by the TFTs in the LC-panel.Alternatively, except Skype TMThe the sort of of VOIP is provided, and above-mentioned any one can provide with carrying out the holographic holographic display that calculates in the circuit in the picture element matrix space not, and voice and hologram image (VHIOIP) based on Internet Protocol are provided here.Also alternatively, except Skype TMProvide that VOIP's is the sort of, top any one can provide with do not carry out the holographic holographic display that calculates in the picture element matrix space, this holographic display is to use with the circuit of picture element matrix on same substrate and carries out holographic calculating, and voice and hologram image (VHIOIP) based on Internet Protocol are provided here.Also alternatively, except Skype TMThe the sort of of VOIP is provided, and top any one can provide with any holographic display, and voice and hologram image (VHIOIP) based on Internet Protocol are provided here.
Alternatively, except Skype TMThe the sort of of VOIP is provided, above any one can provide with do not carry out the holographic holographic display that calculates in the picture element matrix space, voice and hologram image (VHIOIP) based on Internet Protocol are provided here.
In above-mentioned, VHIOIP can (voice and video holographic image over internet protocol, form VVHIOIP) provides with the voice and video hologram image based on Internet Protocol.VHIOIP or WHIOIP can provide in real time or quasi real time, and these Internet Protocols can make, and video is holographic in real time or quasi real time between two people that all use holographic display separately communicates by letter.
M. coding compensation.
In the traditional photography art, exposure compensating is a kind of technology that exposure levels antagonism calculating or plan may cause the other factors of the most dissatisfied image that compensates.These factors may comprise variation, filter and the non-standard processing in the camera system, or the under-exposure that is intended to reach or over-exposed.Photographer can also be for the change using exposure compensation of shutter angle in the other factors or film speed.In photography, some cameras comprise that this adjusts the exposure of automatic calculating as feature to allow the user.Can forward (increasing exposure) and negative sense (reducing exposure) apply compensation by level, increment 1/3rd or half f-stop (f-stop) on each direction usually, maximum two or three apertures (stop) usually.
In optics, the diameter of the f-number of optical system (f-number) expression entrance pupil from effective focusing length aspect of prism.On camera, f-number with the discrete stages adjustment, is called f-stop usually.Each " aperture " is marked with its corresponding f-number, and representative reducing by half from last aperture light intensity.This is little with 2 subduplicate factor demultiplication corresponding to pupil and diaphragm diameter (aperture diameters), and so reducing by half corresponding to the pupil area.
When the user knows the exposure that the automatic exposure calculating of camera can cause not expecting, the using exposure compensation.Thin shade accounts for leading scene through regular meeting's under-exposure, and the scene of low key tone can be over-exposed.Experienced photographer can know when this can occur in, and uses how many compensation to obtain the photo of perfect exposure.
Above-mentioned any one can provide with holographic display, this holographic display with the same substrate of picture element matrix on carry out all holographic calculating, perhaps on same substrate, is carrying out at least some holographic calculating with picture element matrix.Above-mentioned any one can provide with holographic display, and this holographic display is perhaps carried out at least some holographic calculating carrying out all holographic calculating with picture element matrix on same substrate in the picture element matrix space.Alternatively, above-mentioned any one can provide with any holographic display.In coding step or before, can apply compensation to the hologram image data, so that the easier image of watching to be provided, promptly typical observer can find the exposure exactly of this image, has not both had under-exposure, does not also have over-exposed.
N. eyes are followed the trail of
For one or more observer, holographic apparatus can use eyes to follow the trail of.When the size of the watch window that is used for each eye hour, for example only several millimeters the time, this is particularly advantageous to horizontal length.Preferred use location detector is followed the trail of user's eyes with following several steps:
1) limits the hunting zone by the face of surveying the user
2) limit tracking range by surveying eyes
3) follow the trail of eyes
Provide right to the computing module that is used to carry out the eye position recognition function by the stereo-picture of stereoscopic camera supply.After the algorithm that has used module, module is returned x-, y-and the z-coordinate of each eye with respect to point of fixity (as the center of SLM).This coordinate can be transmitted by for example serial line interface.Can carry out by circuit for carrying out the required calculating of this process, be arranged on TFTs on the same substrate, comprise the circuit that is arranged in the picture element matrix as pixel with display device.
For tracing study person's eyes, the holographic encoding on SLM can be arranged in x-and/or the y-direction, promptly in panel plane.Depend on the type (as the ID coding) of employed holographic encoding method, preferably, follow the trail of and realize by whole holographic encoding content being displaced on the SLM in x-or the y-direction at the eyes of a horizontal direction.Before the holographic encoding of SLM, computing module calculation holographic data in x-or y-direction with respect to the skew of SLM.As input, provide x, y and the z-coordinate of observer's eyes.
For tracing study person's eyes, the holographic encoding on the SLM panel can promptly be shifted in the plane of panel in x-and/or y-direction.Follow the trail of and to realize like this so that the light source of the SLM that coherently throws light on and observer's the same moved further of change in location.Mobile luminous light source is perhaps by the pointolite of incoherent light illumination or have in the line source of narrow opening very and generate coherent light.Pass that the light of this opening is considered to be concerned with.If light source is created by the pixel of LC-display device, then they are addressable, and can adapt to observer's position in real time.
O. aberration correction
In the holographic display of some types, aberration correction is the correction of aberration that the lens of carrying out Fourier transform in microlens array or the 2D lens arra are caused.The aberration effect depends on light to the direction of observer's propagation and the angle between the optical axis, and can dynamically proofread and correct by the coding of spatial light modulator.Correcting algorithm can walk abreast, carry out independently, and it is independent of holographic calculating until the step that generates total hologram.After this step, can modulate total hologram and aberration correction figure together.
The aberration correction algorithm can be realized with analyzing, perhaps also can use question blank (LUT) to realize.Preferably, only after total hologram can be used, modulate the hologram calculated value that obtains by complex multiplication.Provided the example of a kind of embodiment of aberration correction among Figure 33.In Figure 33, aberration correction is to use the circuit in the picture element matrix space to implement.Yet in other cases, aberration correction also can use in the picture element matrix outside but implement with the circuit of picture element matrix on same substrate.
P. spot is proofreaied and correct
In the holographic display of some types, it is reducing or eliminating of spot that the optical coherence largely between the zones of different on the display device is caused that spot is proofreaied and correct.Mottled effect can dynamically be proofreaied and correct by the coding of spatial light modulator.Correcting algorithm can walk abreast, carry out independently, and it is independent of holographic calculating until the step that generates total hologram.After this step, can modulate total hologram and spot correction chart together.
The spot correcting algorithm can be realized with resolving, perhaps also can use question blank (LUT) to realize.Preferably, only after total hologram can be used, modulate the hologram calculated value that obtains by complex multiplication.Provided the example of a kind of embodiment of spot correction among Figure 33.In Figure 33, the spot correction is to use the circuit in the picture element matrix space to realize.Yet spot is proofreaied and correct and also can be used in the picture element matrix outside but implement with the circuit of picture element matrix on same substrate.
Q. be used for the deciphering of the digital copyright management (DRM) of holographic display
The content-data that offers holographic display may be subjected to the protection of DRM, and promptly display device receives the content-data after encrypting.(High-bandwidth DigitalContent Protection HDCP) is the common standard that the 2D display device realizes DRM to HDCP.(High-Definition Multimedia Interface, HDMI) receiver is arranged on the printed circuit board (PCB) (PCB) of 2D display device electron device usually to have the HDMI (High Definition Multimedia Interface) of HDCP deciphering.The transmission that a basic shortcoming of legacy system is the view data from the display device electron device to panel is normally after deciphering.Therefore, might be by making electronics be connected to be used for the data transmission circuit of panel to catch the data after the deciphering.
In a kind of example of embodiment, deciphering and hologram calculating are to use the circuit in the picture element matrix to carry out.In a kind of further example of embodiment, deciphering and hologram calculating are to use the distributed execution of circuit that is distributed in the picture element matrix.Therefore, just do not have on the panel single position can catch all the deciphering after data.If different decruption keys is used in the different zone of counter plate, then the extraction of decruption key will become difficult more.Because on panel, therefrom do not extract the connector of decruption key, must know circuit diagram so avoid the idea of DRM, and a plurality of TFT transistors must be connected in the display device that extensively separately distributes at work to read the data after the deciphering.This helps to improve the protection of DRM.
A kind of further example of embodiment is that the circuit that deciphering and hologram calculate on the substrate that is to use picture element matrix is carried out, and comprises the situation of circuit in the picture element matrix outside.A kind of further example of embodiment is that deciphering and hologram calculating are to use the distributed execution of circuit that is distributed on the picture element matrix substrate, comprises the situation of circuit in the picture element matrix outside.
R. be used for the deciphering of the digital copyright management (DRM) of 2D display device
The content-data that offers the 2D display device may be subjected to the protection of DRM, and promptly display device receives the content-data after encrypting.HDCP (HDCP) is the common standard that the 2D display device realizes DRM.HDMI (High Definition Multimedia Interface) (HDMI) receiver with HDCP deciphering is arranged on the printed circuit board (PCB) (PCB) of 2D display device electron device usually.The transmission that a basic shortcoming of legacy system is the view data from the display device electron device to panel is normally after deciphering.Therefore, might be by making electronics be connected to be used for the data transmission circuit of panel to catch the data after the deciphering.
In a kind of example of embodiment, deciphering is to use the distributed execution of circuit that is distributed on the SLM panel.Therefore, just do not have on the panel single position can catch all the deciphering after data.If different decruption keys is used in the different zone of counter plate, then the extraction of decruption key will become difficult more.Because on panel, therefrom do not extract the connector of decruption key, must know circuit diagram so avoid the idea of DRM, and a plurality of TFT transistors must be connected in the display device that extensively separately distributes at work to read the data after the deciphering.This helps to improve the protection of DRM.
In a kind of further example of embodiment, exist deciphering to calculate the 2D display device that is to use the circuit in the single zone of display device substrate to carry out, this circuit can be positioned at picture element matrix inside or picture element matrix outside.Sort circuit more is difficult to visit than the circuit on the PCB of display device.This helps to improve the protection of DRM.
S. the software application of in the hardware that is connected to display device firmly, implementing
Many in principle computer softwares hardware that can use a computer is implemented independently.In a kind of example of embodiment, can use the application of software implementation in hardware, to use the circuit on the substrate that is distributed in the SLM panel to implement on the contrary.Circuit can be in picture element matrix, perhaps it can with picture element matrix on same substrate but in the picture element matrix outside.The SLM panel can be used for holographic display, or is used for the 2D display device.
T. the variable beam deflection of implementing with microprism
For holographic display, eye position that can tracing study person, the microprism array that use can control bundle deflection is carried out the variable beam deflection towards observer's eye position.Controlled deflection can be continuous variable.Tracking is carried out by position sensing and tracing system.The attribute of prism can be controlled by this way, i.e. their one dimensions or make light deflection two-dimensionally.Can obtain two-dimensional deflection by the microprism array that uses two series connection, for example, the longitudinal axis of the prism in array is arranged on significant angle, 90 ° according to appointment with respect to the longitudinal axis of the prism in another array.At for example US4, in 542, No. 449 patent documents such geometric configuration has been described, be used for different application, quote this document by reference here.To have shown the attribute deflection that depends on prism littler or the light of wide-angle more for Figure 34.Prism can be little liquid prism [for example, optics letter (Optics Express) 14 phases, 6557-6563 (2006) page or leaf, described in people such as Heikenfeld " beam of wide-angle flexibly with electric moistening microprism turns to (Agile wide-angle beam steering with electrowetting microprisms) ", here quote this document by reference], for little liquid prism, deflection angle can change according to the known prism array that can control bundle deflection of the electric charge that applies or other.
As seeing among Figure 34, pass of the attribute deflection of the parallel light of SLM and prism mask according to prism.The benefit of this process is can reduce optical effect such as lens aberration before light passes prism.This method is applicable to the eyes place that VOWs is arranged on the observer.In optional example, the focalizer such as the fourier transform lens array that are arranged on prism array front or back will help convergence of rays in VOW.
When the observer changes its position, can correspondingly adjust the deflection angle of prism, as by being adjusted at the voltage that applies on little liquid prism array.Deflection angle can be a continuous variable.Prism does not need all have identical deflection angle.In addition, also might control each prism separately, so that each all has different deflection angles, for example being used for Z follows the trail of, that is: the light that penetrates prism array is assembled a little at the VOW place, because when the observer moves to more close display device or during further from display device, VOW may change from the distance of display device.
Prism angle is calculated and can be considered that the user position carries out.Prism angle is calculated and can be carried out at the counting circuit that is arranged on the substrate of SLM, as rebuilding the circuit of object point, perhaps uses the counting circuit on the substrate that is positioned at prism array to carry out.If the substrate of SLM can also be used as the substrate that is used for prism array, then do not need to be used for the independently substrate of prism array.
Communication interface between position sensor and the SLM is necessary: for example, it can be a serial line interface.
If the counting circuit that is used to calculate the prism array deflection angle is at the substrate of prism array, but on the substrate of SLM, then to connect be necessary to the data between two substrates, so that the electrode of prism array can use result calculated to control.
Except being used to control the calculating of prism, also need to apply the phase place " (jumps) jumps " (or phase place is discontinuous) that phase correction is brought by prism array with compensation.Otherwise, prism array will turn round as blazed grating (blazed grating), the part of promptly passing the wavefront of different prisms has the different optical path length towards VOW, therefore, they will turn round as grating, and the variable effect of prism angle is distributed to the amount of the energy of different diffraction level simultaneously.This phase correction can be by SLM additional execution outside its hologram encoding function.Pass the light of two assemblies (being prism array and SLM), process is by the complex multiplication of the function of each assembly.Phase diagram after the correction comprises the needed phase correction of microprism array: hologram is encoded with the value of representing the SLM location mode of rebuilding object point, and this value comprises the phase correction condition.
Above-mentionedly can also be applied to this situation: hologram image generates in the projection type device, wherein projection comprises SLM is imaged onto on the prism array, the reconstruction of desired 3D scene takes place in the front of VOW simultaneously, and therefore creating projection arrangement is equivalent to technology well known in the art.It should be appreciated by those skilled in the art that needed calculating and device and above-described similar.Need to calculate and to be used for the deflection angle of prism array prism, and be used for the discontinuous phase compensation of phase calibration accordingly.The phase compensation that is used for prism array can provide when being imaged onto SLM on the prism array, is perhaps provided separately by the additional SLM that is arranged near prism array.It should be appreciated by those skilled in the art that prism array can be reflective when SLM can be printing opacity in order to strengthen projection, prism array was a printing opacity when perhaps SLM can be reflective.
Little liquid prism is in file such as optics letter (Optics Express) 14 phases, 6557-6563 (2006) page or leaf, be described in people such as Heikenfeld " beam of wide-angle flexibly with electric moistening microprism turns to (Agile wide-angle beam steering with electrowetting microprisms) ", quote this document by reference here.This technology is called " electricity moistening (electrowetting) " or " electronics moistening (e-wetting) ".In this technology, the contact angle that is formed by the interface between transparent conductive liquid and the other fluid (as air) is the function of voltage difference, this other fluid has the electrode of the hydrophobic insulator of scribbling, and this voltage difference is applied on the electrode with respect to transparent conductive liquid.When light beam passes the unit, the independent control that is applied to two voltages on the electrode allows the control of the angle of beam steering, each electrode is coated with hydrophobic insulator, and each electrode forms the sidewall of the moistening unit of electronics, and this sidewall is relative with the other sidewall that is formed by other electrode.To those skilled in the art, other structure that is used for obtaining by the moistening prism of electricity beam steering will be conspicuous.The beam deflection angle is controlled by the variable voltage difference that use is applied to different electrodes, and this electrode is arranged on the not ipsilateral of each electric moistening cell array.
The first summary manufacturing process
In a kind of basic structure of thin film semiconductor's display device of embodiment, display part with circuit is provided, this circuit is arranged between the pixel of display part, perhaps is arranged on other position on the substrate, be used to carry out with install display part on the relevant calculating of demonstration of data.Display part and in display part or integrally formed on substrate in the calculation execution unit of other position on the substrate.Other circuit that is used to drive display part can be formed on the display part periphery, but is integrated on the same substrate.
TFT circuit and other circuit (as being used for the circuit that actuating logic is operated) of being used for the operating space modulator, can on substrate, create by method as described below, it is similar that being used to of describing among this method and the US6,153, No. 893 patent documents built the method for distinct device structure; Here quote US6 by reference, the full content of 153, No. 893 patent documents so far.To those skilled in the art, other method will be conspicuous.Substrate can be a large-area substrates, and substrate can be the glass of adequate types.For glass substrate, often the technology of using is tended to sub zero treatment, passes through the standard of silicon equipment manufacturing technology at least.Being used for the technology (as the silicon thermal oxidation technology near 1000 ℃) of production equipment gate insulation layer tends to incompatible sub zero treatment, and sub zero treatment is typically in 350 ℃ to 700 ℃ temperature range.
Pixel electrode is arranged in the matrix of display part with the thin film transistor (TFT) that is used for switch.The thin film transistor (TFT) of forming circuit element between the pixel of display part, the perhaps position of other on substrate, and can being selected in the display driver portion that can be integrated on the same substrate.Thin film transistor (TFT) can be a bottom gate type, the polycrystal semiconductor layer that comprise gate electrode, on the insulation course above the gate electrode, forms, and be formed in the source that forms on the polysilicon semiconductor layer and the high concentration impurities film of leakage.The TFTs that is used for switch can have lightly doped drain, and (wherein the low concentration impurity film is inserted between polycrystal semiconductor layer and the high concentration impurities film for lightly doped drain, LDD) structure.
In typical embodiment, display part has the upper end that comprises pixel electrode, comprises the bottom of the TFTs that is used for switch and has color filter layer, black mask layer and is inserted in planarization layer between the upper and lower side.In this case, black mask layer comprises the metal line pattern, and this metal line pattern is electrically connected to the high concentration impurities layer that is used for source and leakage.And pixel electrode is electrically connected to the high concentration impurities layer that is used to leak by the metal line pattern.Alternatively, if backlightly use with three kinds of primary colors with time-multiplexed mode illumination, color filter layer can omit.
Display device with said structure can be made by the sub zero treatment of back.At first, on glass substrate, form gate electrode.Then, on the dielectric film on the gate electrode, form semiconductive thin film, then semiconductive thin film is transformed to polycrystal layer by laser annealing.Only optionally form low concentration impurity layer on the polycrystal layer in being included in pixel switch then, for example the use by mask layer.Further, on the low concentration impurity film, be formed for the high concentration impurities film of source and leakage, and therefore be formed for the TFTs that having of switch piled up the LDD structure.Meanwhile, by making the TFTs that is used for circuit component being included in the high concentration impurities layer that directly is formed for source and leakage on the polycrystal layer of circuit part, as be used for image and show and calculate, perhaps be used for peripheral drive circuit.Preferably, optionally carry out laser annealing on the high concentration impurities layer in being included in circuit part, to reduce the resistance of polycrystal semiconductor layer.
On glass substrate, form after the gate electrode, on the gate insulating film on gate electrode top, form semiconductor film at low temperatures.By laser annealing semiconductor film is transformed to polycrystal layer subsequently.Therefore, it is feasible forming polycrystalline TFT by sub zero treatment.The laser that uses typically will have the short wavelength, so that laser emission strong absorption in silicon: an example is an excimer laser, yet other also is known.Because TFT is a bottom gate type, this structure can not be subjected to the adverse effect from impurity (as the sodium in the glass substrate) easily.It is less that the polycrystal semiconductor layer that uses in the device zone allows to make TFT to make.Be used for the TFTs of pixel switch, the LDD structure keeps low-leakage current.If leakage current is too high, this will be the significant deficiency in the display device.In the TFTs of forming circuit element, by contrast, N channel TFT s and P channel TFT s can be by forming by sub zero treatment stack high concentration impurities layer on polycrystal semiconductor layer simultaneously.Can carry out additional laser annealing to the TFTs of forming circuit element, to increase the speed of these TFTs.Can adopt further structure, comprise color filter layer, black mask layer and planarization layer, be beneficial to obtain the aperture rate (aperture rates) of higher picture element density and Geng Gao.
Can be not limited to the TFT structure by the structure of this manufacture method manufacturing, but go for the structure of any known.
The second summary manufacturing process
In a kind of basic structure of thin film semiconductor's display device of embodiment, display part with circuit is provided, this circuit is arranged between the pixel of display part, perhaps is arranged on other position on the same substrate, be used to carry out with this device display part on the relevant calculating of demonstration of data.Display part and calculation execution unit are integrally formed on substrate.Other circuit that is used to drive display part can be formed on the periphery of display part, but is integrated on the same substrate.
TFT circuit and other circuit (as being used for the circuit that actuating logic is operated) of being used for the operating space photomodulator, can be by creating on substrate as following method, it is similar that being used to described in this method and the US6,140, No. 667 patent documents constructed the method for distinct device structure; Here quote US6 by reference, the full content of 140, No. 667 patent documents so far.To those skilled in the art, other method will be conspicuous.Such silicon that can use this manufacturing process to make is called " grain silicon continuously ", and the electrical characteristic of its electrical characteristic and monocrystalline silicon in some respects perhaps many-side may be similar.
Figure 11,12 and 13 has represented to be used for to form the summary of the operation of continuous particle (CG) silicon, and this continuous particle (CG) silicon is applicable in the display device, comprises being used in pixel switch, display driver and the logical circuit.Substrate 1101 can be a large-area substrates, and substrate can be the glass of adequate types, or quartzy.Nontransparent substrate such as interior polysilicon or ceramic can being used under the situation of the display device that only is used in luminous geometry, because in reflective geometry, the not necessarily requirement of the light transmission of substrate.Substrate has insulating surface.Film 1102 be silicon thickness at 10nm to the amorphous silicon film between the 75nm, it does not comprise the oxide of any formation.This film can pass through low-pressure chemical vapor deposition, and (chemical vapour deposition CVD) or by plasma CVD technology grows.
In the back, described the technology of silicon metal, but in the art, many other technologies are known.Form mask insulating film 1103, its split shed is corresponding to the CG silicon desired position on the substrate.A solution comprises the Ni as the catalyst elements that is used for the crystallization amorphous silicon is applied by spin coating proceeding that cambium layer 1104 in this technology.Can use other catalyst elements such as Co, Fe, Sn, Pb, Pd, Pt, Cu or Au etc.At the opening part of film 1103, introduce catalyst film 1104 and contact with amorphous silicon film 1102.Subsequently can be in inert gas or in the gas that comprises hydrogen or oxygen, between 500 ℃ to 700 ℃ of temperature, time 4hr is between the 12hr, by annealing crystallization amorphous silicon film 1102.
Shown in Figure 11 B, in zone 1105 and 1106, promote the crystallization of amorphous silicon 1102 by the Ni catalyzer.Form the horizontal growth zone 1107 and 1108 of growing across substrate in fact.Only these horizontal growth zones as 1107 and 1108, are used as the active layer (active layer) in the TFT device that forms in the TFT device on substrate.After annealing is finished, remove mask layer 1103 from substrate.Shown in Figure 11 C, form pattern then.As the island semiconductor layer 1109,1110 and 1111 of active layer across being formed on the substrate.The 1109th, the active layer of the N channel-type TFT of formation complementary metal oxide semiconductor (CMOS) (CMOS) circuit, the 1110th, the active layer of the P channel-type TFT of formation cmos circuit, the 1111st, the active layer of the N channel-type TFT of formation pixel matrix circuit.
After active layer 1109,1110 and 1111 forms, form gate insulating film 1112, this gate insulating film 1112 comprises the dielectric film that comprises silicon.The thickness of gate insulating film 1112 can be at 20nm in the 250nm scope, and should allow some oxidations to this tunic in step of thermal oxidation after a while.Film 1112 can use known method of vapor-phase growing to grow.
Figure 11 C has represented to be used to remove the heat treatment method of Ni catalyst elements.Heating is to carry out existing under the situation of halogen-containing material.Heating is between 700 ℃ to 1000 ℃ of temperature, and time 0.1hr is to carrying out between the 6hr.Example be contain the percent by volume of HCl (vol%) be 3 or more generally the gas of percent by volume between 0.5 to 10 in, at 950 ℃ of thermal treatment 0.5hr.The oxidation of the silicon in the film can reduce by mix nitrogen-rich gas N2 in employed gas.Except that HCl, other halogen-containing material is HF for example, HBr, and Cl2, F2, Br2, NF3 ClF3, BCl3 etc. also can use.This gettering process helps to remove the Ni catalyzer from film.Seem that this is to take place by the volatility nickel chloride that formation is discharged in the gas.In oxidizing process, the thickness of gate insulating film 1112 will tend to increase.Zone 1109,1110 and 1111 correspondingly attenuation, this has reduced closing among the TFT (OFF) electric current, and has increased the field effect flowability on other tangible benefit.
After above-mentioned processing, the heat treated of 950 ℃ of heating 1hr has been improved the quality of gate insulating film 1112 in nitrogen, and the quality at the interface between gate insulating film 1112 and the zone 1109,1110,1111.
Formation has the aluminium film of the scandium (Sc) of 0.2 percentage by weight (wt%), and is formed for constituting the electrode pattern of gate electrode prototype, and is mentioned to having below this.This also is not shown among Figure 11.Can use to be suitable for other material of this purpose, as Ta, W, Mo or Si.Shown in Figure 11 D, by the surface of anodic oxidation pattern, form gate electrode 1113,1114 and 1115, and anode film 1116,117 and 1118.In next step, shown in Figure 11 E, etch away film 1112, for example by using gases CHF 3, so that film 1112 still only be retained in electrode under, for example in the position 1119,1120 and 1121.Etching mask 1122 is used for covering the zone that is used for P channel-type TFT.Shown in the arrow among Figure 11 E, add the foreign ion that is used for n section bar material, for example by injecting or plasma deposition.Form n type zone 1123,1124,1125 and 1126.And then this process can be removed Etching mask 1122, and Etching mask 1127 can be arranged on the top (Figure 12 A) in n type zone.Can deposit p type zone 1128 and 1129 subsequently, for example by injecting or plasma deposition.The p deposition region is the LDD zone.Can remove the Etching mask 1127 of top, n type zone subsequently.
On sidewall 1130,1131 and 1132, form silicon oxide film by etch-back (etch-back) technology.P type zone is covered by mask 1133, and adds the n type and mix, with the concentration of n type doping in the zone that increases not oxidized thing sidewall covering.The sheet resistance of adjustment source/drain region (sheetresistance) preferably is lower than 300 Ω to being lower than 500 Ω.Below gate electrode, form intrinsic or intrinsic in fact channel formation region territory 1137.The channel formation region territory 1141 (Figure 12 C) that forms source region 1138, drain region 1139, low concentration impurity zone 1140 and constitute the N channel TFT of pixel matrix circuit.In Figure 12 D, remove Etching mask 1133, and above N channel-type TFTs, form Etching mask 1142.Further add p type impurity to increase the concentration that the p type mixes.Remove Etching mask 1142 then, and by heat treated (as furnace annealing, laser annealing etc.) activated impurity ion.Reduce or elimination injection infringement by heat treated.
Thickness with 20nm to 50nm forms titanium film 1147, and carries out the heat treated with lamp annealing.As shown in FIG. 13A, the pasc reaction that contacts with titanium film forms titanium silicide, and forms silicide regions 1148,1149 and 1150.Figure 13 B has represented island type pattern 1151,1152 and 1153, forms them and is eliminated to prevent silicide film zone 1148,1149 and 1150, prevents to form in the subsequent step contact hole of connection source/drain region and wiring.
The silicon oxide film that forms 0.3 μ m to 1 μ m thickness is as first interlayer dielectric 1154.Shown in Figure 13 B, form contact hole, and form source wiring 1155,1156,1157 and leak routing 1158,1159.Organic resin can be used as first interlayer dielectric 1154.In Figure 13 C, on substrate, form second insulation course 1160 of 0.5 μ m to 3 μ m thickness range.Polyimide, acryl resin, polyamide or amino polyimide (polyimide amide) etc. can be used as organic resin film.On film 1160, form black mask 1161.Form the 3rd interlayer dielectric 1162 of 0.1 μ m to 0.3 μ m thickness range, as monox, silicon nitride, silicon oxynitride, organic resin mould or these laminated film.Form contact hole at film 1160 and film 1162 places, and form the pixel electrode 1163 of 120nm thickness.Shown in Figure 13 C,, form auxiliary capacitor 1164 in the location of black mask 1161 overlaid pixel electrodes 1163.
In hydrogen environment, heated whole base plate 1 to 2 hour at 350 ℃, this can compensate dangling bonds, especially the dangling bonds in the active layer of film.After these steps, on same substrate, can form the cmos circuit in Figure 13 C left side and the pixel matrix circuit on Figure 13 C right side, for example form with the adjacent position.
Can be not limited to the TFT structure by the structure that this manufacture method is made, but go for the structure of any known, comprise bottom grid TFTs.
The 3rd summary manufacturing process
In a kind of basic structure of thin film semiconductor's display device of embodiment, display part with circuit is provided, this circuit is arranged between the pixel of display part, perhaps is arranged on other position on the same substrate, be used to carry out with install display part on the relevant calculating of demonstration of data.Display part and calculation execution unit are integrally formed on substrate.Other circuit that is used to drive display part can be formed on the display part periphery, but is integrated on the same substrate.
TFT circuit and other circuit (as being used for the circuit that actuating logic is operated) of being used for the operating space photomodulator, can on substrate, create by method described as follows, it is similar that being used to described in this method and the US6,759, No. 677 patent documents constructed the method for distinct device structure; Here quote US6 by reference, the full content of 759, No. 677 patent documents so far.To those skilled in the art, other method will be conspicuous.Such semiconductor that can use this manufacturing process to make is a polycrystalline silicon germanium, and its electrology characteristic perhaps many-side may be similar with monocrystalline silicon in some respects, or surpass monocrystalline silicon.
The result of this manufacturing process is the circuit on the monobasal.Generate the TFTs of one group of polysilicon, the pixel of its control display device as its active layer.Generation has other TFTs of function such as gate driver circuit, source electrode drive circuit and signal processing circuit, and wherein active layer is a SiGe, to realize high speed operation.In the circuit part that needs high speed operation, add germanium, and polysilicon is used in the circuit part that needs low close current characteristic.
Make the active type matrix display device, this device has pixel matrix circuit and driving circuit, and driving circuit is cmos circuit in this example, and pixel matrix circuit and driving circuit all are formed on the insulating surface of monobasal.Process as shown in Figure 6.
As shown in Figure 6A, prepare glass substrate 601 to form silicon oxide layer 602 thereon.Form the amorphous silicon film 603 of 30nm thickness by the plasma CVD method.Provide Etching mask 604 by on amorphous silicon film 603, forming pattern.Form resist film, will organize the zone that is used for pixel matrix circuit that forms with TFT to cover.Do not cover and to form the zone of high speed circuit.Shown in Fig. 6 B, add germanium by technology such as ion injection, plasma doping or laser doping.Add germanium in order to change the component of amorphous silicon film, to create Si 1-xGe xThe average composition of film, wherein, 0<x<1.If use ion to inject, then add the zone 605 of germanium and can bear the injection infringement.Si 1-xGe xFilm 605 is amorphous states.
Because the energy of activation that are used for a large amount of diffusions in germanium low than at silicon, and in being lower than the binary alloy phase diagram of melting temperature, germanium and silicon form solid solution among each other, so with respect to the crystallization of pure silicon film, having of germanium helps quicken Si 1-xGe xThe crystallization of film.At this on the one hand, germanium can be thought the catalysis semiconductor of silicon crystallization, for example in laser induced crystallization.
In Fig. 6 C, as US5, described in 643, No. 826 patent documents, remove resist layer 603, and increase in whole surface and to contain nickel dam 606, here by with reference to quoting US5, the full content of 643, No. 826 patent documents is so far.Nickel is used as catalysis material, to accelerate silicon or Si 1-xGe xThe crystallization of film.For this purpose, can use the element except nickel, as Co, Fe, Cu, Pd, Pt, Au or In.Shown in Fig. 6 D,,, obtain silicon and Si 600 ℃ of heating 8 hours by furnace annealing 1-xGe xThe crystallization of film.This has caused polycrystalline Si 1-xGe xZone 607 and polysilicon region 608.Thermal treatment can use other method to realize, as laser annealing or lamp annealing.
In Fig. 6 E, polycrystalline Si 1-xGe xZone 607 forms active layer 609.Polysilicon region 608 forms active layer 610.Active layer 609 is the active layers that are used for constituting subsequently the TFTs of driving circuit and signal processing circuit.Active layer 610 is the active layers that are used for constituting subsequently the TFTs of pixel matrix circuit.
By US5, the technology described in 648, No. 277 patent documents forms source region, drain region and lightly doped drain (LDD) zone; Here quote US5 by reference, the full content of 648, No. 277 patent documents so far.To sum up this technology now.At first, contain the Al film of the Sc of 2% weight by use, form island type pattern, this island type pattern can form gate electrode subsequently.Then, island type pattern is carried out anodic oxidation, on the sidewall of island type pattern, to form the porous anodic oxide film.Then, change the processing means, to form tight anodic oxide coating around island type pattern with further realization anodic oxidation.Form by this way after porous anodic oxide film and the tight anodic oxide coating, use dry-etching method etch-gate deielectric-coating.After the etching of finishing gate dielectric film, remove the porous anodic oxide film, obtain the state shown in Fig. 7 A thus.
In Fig. 7 A, 711,712 and 713 is by the film formed gate insulating film of monox, and 714,715 and 716 is by the film formed gate electrode of the Al that comprises Sc, and 717,718 and 719 is the tight anodic oxide coatings that are used for the grill-protected electrode.In Fig. 7 B, the zone that forms the P channel TFT is covered by mask 720.There is the n type ion of injection in all the other zones, so that n type electric conductivity to be provided.As US5, described in 648, No. 277 patent documents, use two kinds of different accelerating potentials, with the ion concentration that injection is provided and the more consistent distribution of the degree of depth.
In Fig. 7 B, technology has caused being used to constituting drain region 721, source region 722, LDD zone 723 and the channel region 724 of the n channel TFT of driving circuit.Also be formed with drain region 726, source region 725, LDD zone 727 and the channel region 728 of the N channel TFT that is used to constitute pixel matrix circuit.
In Fig. 7 C, remove Etching mask 720, and increase Etching mask 729 to cover n type zone.Then as US5, described in 648, No. 277 patent documents, use two accelerating potential implanting impurity ions, so that p type conduction to be provided, and provide the more consistent distribution of the ion concentration and the degree of depth of injection.This has formed source region 730, drain region 731, LDD zone 732 and the channel region 733 of the P channel TFT that is used to constitute driving circuit.Foreign ion activates by annealing steps.
Form first interlayer dielectric 734, and open wherein contact hole to form source electrode 735,736,737 and drain electrode 738,739.Insulation course 734 can be made by the material that is selected from monox, silicon nitride, silicon oxynitride and resin molding.Finished the TFTs that is used for driving circuit now.Must finish the TFTs that is used for picture element matrix now.After forming source electrode and drain electrode, form second interlayer dielectric 740, form the black mask 741 that comprises the Ti film then thereon.If before formation black mask 741, the position above drain electrode 739, part is removed second interlayer dielectric, then might form auxiliary capacitor by black mask, second interlayer dielectric and drain electrode.And then above black mask 741, form the 3rd insulating layer film 742, and form contact hole therein, and form the pixel electrode 743 that comprises nesa coating (as indium tin oxide) thereon.
Shown in Fig. 7 D, the active type matrix substrate with TFTs is disclosed thus, it comprises integrally formed pixel and driving circuit, this pixel and driving circuit can be adjacent one another are.The person of ordinary skill in the field will be understood that the cmos circuit of Fig. 7 D can be replaced by other circuit, signal processing circuit for example, and it can form on the polycrystalline silicon germanium zone.The polycrystalline silicon germanium zone has the high-field effect flowability, and therefore is suitable for high speed operation.Although compare with the polycrystalline silicon germanium zone, polysilicon region has low operating speed characteristic, and when being applied to picture element matrix TFTs, polysilicon region has better low close current characteristic.
Can be not limited to the TFT structure by the structure that this manufacture method is made, it goes for the structure of any known, comprises bottom grid TFTs.
LASER Light Source
RGB solid-state laser light source is as the RGB solid-state laser light source based on GaInAs or GaInAsN material, because the light direction of their compactedness and their height can be the suitable sources that is used for holographic display.This light source comprises light emitting diode, and the RGB vertical cavity surface emitting laser of being made by Novalux (RTM) company of California, USA (VCSEL).This LASER Light Source can be used as single laser or laser array, although each light source can be used to generate a plurality of light beams by using diffraction optical element.Light beam can be relayed from multimode optical fiber, if be used in the relevant too high of tight holographic display, then this can reduce relevant level, can't cause artificial affecting such as the LASER SPECKLE pattern do not expected.The LASER Light Source array can be one dimension or two-dimentional.
Substrate
Should be emphasized that: word " substrate " refers to make the plate of material of display device thereon.Typically, it will be insulated substrate such as sheets of glass substrate or sapphire substrate or semiconductor substrate such as Si or GaAs, but other substrate also is feasible as polymer sheet or sheet metal.Substrate as sheets of glass or semiconductor substrate such as Si or GaAs, is generally used for the device manufacturing, because they have simplified treatment step and the transfer between the different device of carrying out different disposal step (as material deposition, annealing and material etching).Word " substrate " does not refer to single circuit board, disclosed in Optics Express (optics letter) 13,4196 (2005) as people such as Shimobaba: the single circuit plate does not allow and can go up a series of manufacturing process of carrying out at single substrate (as sheets of glass).
The number of transistors purpose is estimated
This part comprises needed number of transistors purpose estimation in the display device, and the holography that is used for being implemented by the circuit between the pixel that is arranged on display device is calculated.
For the embodiment that uses FPGA, holographic calculating is made up of following step, and wherein, the number percent that marks is the percentage that is used for the logical resource of given step use on the FPGA.
Lens function: depend on the generation (4.5%) that the z value is added random phase and subhologram
CORDIC calculates: complex values is changed to real-valued and empty value from phase place and quantitative change, and carry out density modulation (62.5%)
Add with subhologram to form hologram (15.5%)
The decoding hologram: cordic algorithm is used for that also numerical value is converted to phase place and amount and conversion and is back to real-valued and empty value, and the cutting and the normalization (17.5%) that are used for data
Because the transistor size of bank bit does not rely on the pipeline frequency, when carrying out calculating in picture element matrix, the number percent number that provides above can be inequality.The calculated amount that is used for addition and decoding will increase along with the number of hologram pixel.
Depend on the z value, lens function (LF) can have some little question blanks (LUTs) with definition subhologram size and the initial constant that is used for lens function.Therefore, lens function has the high relatively fixing transistor size that is used for LUTs, and depends on the variable transistors number of each clock period by the number of the CORDIC unit of lens function parallel drive.Generally, the size of computing unit (cluster) should be best, because their size is big more, the saving in the data transmission rate will be more little.On the other hand, bigger cluster makes the realization of calculating be more prone to.The example of Figure 23 has only represented that the cluster of simplifying designs, because a cluster can be made of 1,000,000 transistors or more a plurality of transistor.
We estimate the transistorized number that needs in the display device now, and the holography that is used for being implemented by the circuit between the pixel that is arranged on display device is calculated.Because cordic algorithm need be carried out CORDIC calculating so estimate to concentrate on more than 75% resource on the transistor in the FPGA embodiment.Reference material " cordic algorithm; Architekturen und monolithischeRealisierungen mit Anwendungen in der Bildverarbeitung; Dirk Timmermann; 1990 ", provided from 100 pages to 101 pages and to be used to estimate that CORDIC number of transistors purpose a bit helps, here by with reference to quoting this document.For the FPGA solution, the appropriate C ORDIC unit of different reductions are used in exploitation, and the transistor size that estimates that therefore is used for the CORDIC unit of a pipeline approximately is 5.2 ten thousand transistors.
Spreadsheet has represented that the estimation of the hologram calculating of plan is had 16,000 * 12,000 hologram pixel among Figure 21 and 22, and from 2,000 * 1,500 pixel real space images begin.For each pixel in the subhologram, need a CORDIC operation, promptly amount to per second 250*10 Λ9 operations.For the pipeline frequency of 25MHz, need 9800 parallel CORDIC unit.The cluster design influences transistor size and design efficiency, and cost is higher because bigger cluster means the hologram data distribution.If but cluster is too little, the calculating in the cluster is just inefficent, because what is not done in most of times in some unit, and has therefore increased transistorized number.
If cluster is made of 1 lens function unit and 1 CORDIC unit, then needs 9800 clusters and 6.6 hundred million transistors to be used for subhologram and calculate.If cluster is made of 1 lens function unit and 8 CORDIC unit, then display device is made of 1200 clusters, and needs 5.3 hundred million transistors to be used for subhologram calculating.Therefore, cluster size can change on a large scale at one, and for the sampling design, selects to have the cluster of 4 CORDIC unit and 1 lens function.As estimation, this causes 2500 clusters and 5.5 hundred million transistors to be used for subhologram calculating.
In order to find out optimum cluster size, must carry out detailed design.Numeral in the spreadsheet (Figure 21 and 22) only is a "ball-park" estimate, but they have shown the main dependence form of parameter.
CORDIC (method, Volder algorithm) by turn (for CORDIC) is simple, the effective algorithm that calculates hyperbolic curve and trigonometric function.Because CORDIC is used for complex values is converted to real-valued and empty value from phase place and value here, vice versa, can adopt other algorithm.If do not have hardware multiplier (for example, simple microcontroller and FPGAs) available, then use CORDIC usually, because it only needs little question blank, bit shift and addition.In addition, when implementing in software or specialized hardware, cordic algorithm is applicable to stream line operation.Modern cordic algorithm was described by Jack E.Voider first in nineteen fifty-nine, although it and Henry Briggs are similar as far back as disclosed technology in 1624.Originally, CORDIC implements with scale-of-two.In the 1970's, decimal system CORDIC is extensive use of in pocket calculator, and their great majority are not with binary operation but operate with the binary code decimal system (BCD).CORDIC is specially adapted to handheld calculator, and for the application of handheld calculator, price (and therefore the number of grid on the chip) specific rate is more important.In the time can't obtaining hardware multiplier (for example in microcontroller), perhaps when needed number of gates of application of enforcement need minimize (for example in FPGA), CORDIC is faster than other method usually.
CORDIC is the part of " displacement and addition " this class algorithm, is logarithm and the exponentiation algorithm that originates from the work of Henry Briggs.Other can be used to calculate the displacement of many elementary functions is the BKM algorithm with computation system mutually, and this algorithm is the conclusion to the logarithm and the exponentiation algorithm of complex plane.For example, BKM can be by calculating the index of 0+ix, and promptly cosx+isinx calculates sine and the cosine of solid horn degree x (radian).The BKM algorithm 1994 by J.C.Bajard, S.KIa and J.M.Muller at " IEEE Transactions on Computers " (43 (8): 955-963, in August, 1994) open for the first time, this BKM algorithm is more complicated a little than CORDIC, but has the advantage that does not need conversion factor.In the present embodiment, the BKM algorithm can be used for substituting cordic algorithm.
Computing method
Current, CPU (central processing unit) (CPUs) and digital signal processor (DSP) unit mainly use the digital synchronous logic to be used for calculating.The FPGA hologram calculates also can use this method.Because the low number of transistors of each hologram pixel is so other method can preferably depend on calculation procedure.Following tabulation has represented to be used for the key property of some other computing method:
Digital synchronous logic (clocked logic)
High number of transistors
Short computing time
Easily timing is calculated
Good design tool support
Numeral asynchronous logic (non-clocked logic)
Good power efficiency
High number of transistors
Short computing time
The design tool support of difference
Difficult timing is calculated
Pulse-length modulation (PWM)
Low number of transistors
Long computing time
Simulation
Mainly develop from 1950 to nineteen sixty
Except simple high-frequency was used, current analog computation was uncommon
Low-down number of transistors
Short computing time
Limited precision
High manufacturing parameter drift relies on
Hybrid technology
The demand of calculation procedure is different.Because as the limited capacity of polysilicon transistors, so should select computing method as requested.Best practice will depend on accurate enforcement.Be some examples below.
In order to reduce transistorized quantity, have low calculation procedure that requires such as lens function and decoding and can use PWM.Analogue shift register can be used for data distribution, because real space data and hologram data only use about 8 precision.Custom-designed synchronous CORDIC unit can be used for reducing power attenuation.Each step uses the method more than can further reduce transistorized quantity, but can increase design cost.
Display device type
Display device be preferably use on display device surface transistor or other on-off element (as electricity, light) active matrix structure.Transistor material should have enough structure width and the additional transistor of switching frequency to implement to be used to calculate.Can use monocrystalline silicon and polysilicon variant such as low temperature polycrystalline silicon (LTPS), CGS, individual particle silicon or polycrystalline silicon germanium.The switching frequency of amorphous silicon is too low generally concerning the high-performance hologram calculates.In principle, organic semiconductor or carbon nano-tube also can be used as the on-off element material.Traditional big display device needs big area to be used for the row and column lead.Use method of the present invention can save this area.
Because the area saving is bigger on bigger display device, the display device type below therefore preferably adopting:
LCD (LCD) based on LTPS
Organic Light Emitting Diode (OLED) based on LTPS (comprises light emitting polymer (lightemitting polymers, LEP))
Monocrystalline silicon only is used for little display device, compares the advantage that has still less with new method.The example that monocrystalline silicon uses is:
·LCOS
Digital light is handled (DLP) technology
The tabulation of the feasible display technique that can be used to implement is:
LCD (LCD)-type
Liquid crystal over silicon LCOS
Nematic liquid crystal NLC
Twisted-nematic TN
Homeotropic alignment is to row VAN
Ferroelectric liquid crystals FLC
Field-emitter display FED
Surface-conduction-electron emission display SED
Carbon nanotube emitter is (based on silicon substrate or be coated in indium tin oxide (indium tin oxide, ITO), yet these can only be used as light source, because send incoherent light) on the glass substrate
Mechatronic Systems
Lens array/digital light is handled (DLP) technology
MEMS (micro electro mechanical system) (MEMS) mirror is also referred to as Micro-Opto-Electro-Mechanical Systems (MOEMS)
The tabulation of hologram computing method:
-question blank (LUT)
-analytical Calculation
-publication number is the method described in the patent document of WO 2006/066919, here by with reference to quoting this document
-ray-tracing scheme
Alternative types:
-2D conversion
-in a horizontal plane 1D conversion
-1D conversion in vertical plane
Type of coding:
-Burckhardt (Burckhardt) coding
-phase encoding only
-double phase encoding
-BIAS coding
-minimum distance code (minimum distance encoding, MDE)-use the coding of every hologram pixel more than 3 slm pixels
Hardware
Outside hologram computing unit can be made up of a pair of high-end FPGAs or special IC (ASIC) or the full custom ic with about 0.52 hundred million transistor and 500MHz pipeline frequency.In order to transmit data, can use about 230 the low-voltage differential signal (LVDS) of per second emission 1Gbits right to display device.In order to receive data, also need glass chip on board (chip on glass, COG) rowaand column lines driver.Be integrated on the display device substrate if calculate, then only high inversion frequency part as digital video interface (DVI) receiver must be realized on additional hardware.Only must 50 times of low raw data of transmit data rate (referring to Fig. 1).Can use the dog-cheap display device electron device that is connected that minority and display device are only arranged.This electron device and current low resolution 2D TFT display device are much at one.
Explain
The feature of above-mentioned three kinds of summary manufacture methods can make up without departing from the scope of the invention.
Among the figure here, shown relative size is not necessarily drawn in proportion.
To those skilled in the art, without departing from the scope of the invention, in the illustrative example that various modifications of the present invention and to replace will be conspicuous, and should be appreciated that, the present invention should too not be limited to here to be showed.
Many notions (being described as " notion A-T ") are arranged among the present invention.Appendix III comprises may be to defining the useful content of these notions.Be noted that for those skilled in the art the disclosure for a notion has the situation that helps illustrate other notion.Will be clear that from the other parts of presents some of these notions can form a part of the present invention.
Appendix I
The technology brief introduction
Following chapters and sections are as the explanation of the several gordian techniquies that are used for implementing systems more of the present invention.
In traditional holography, the observer can see the holographic reconstruction of object (can be the scene that changes); Yet he is also uncorrelated apart from the distance of hologram.In a typical optical arrangement, rebuild on the plane of delineation of the light source occur in the illumination hologram or near the plane of delineation, therefore rebuild on the Fourier plane that occurs in hologram or near.Therefore, reconstruction has the far field light distribution identical with the real world objects of rebuilding.
An early stage system (is described in WO 2004/044659 and No. 2006/0055994 patent document of US, here quote the full content of these two pieces of files by reference) determined very different arrangements, wherein the object of Chong Jianing is not on the Fourier plane of hologram or near the Fourier plane.On the contrary, virtual observer's window region is on the Fourier plane of hologram; The eyes that have only the observer just can be seen correct reconstruction in this position.Hologram is gone up coding at LCD (perhaps other type space photomodulator), and throws light on optics setting, makes virtual observer's window become the Fourier transform of hologram (so it is the Fourier transform of direct imaging on eyes); Be formed on the reconstruction object in the frustum that extends between observer's window and the SLM then, the preferably propagation of describing with the Fresnel conversion of hologram is not because it is in the focusing surface of lens.It is but determined by near field of light distribution (with modeling before the spherical wave, opposite with the plane wave front of far-field distribution).This reconstruction can appear between virtual observer's window (as mentioned above, in the Fourier plane of hologram) and the SLM Anywhere, perhaps in addition the back that appears at SLM as dummy object.
There are several results in this method.At first, the basic restriction faced of the designers of holographic video system is the pel spacing of SLM (or other class photomodulator).Target is to realize big holographic reconstruction in order to the SLMs with pel spacing that rational cost is bought.But this is impossible in the past, and reason is as follows.Periodic intervals between the contiguous order of diffraction in Fourier plane is given by λ D/p, and λ is the illumination light wavelength, and D is the distance that hologram arrives Fourier plane, and p is the pel spacing of SLM.But in traditional holographic display, rebuild object in Fourier plane or near.Therefore, rebuilding object must keep less than periodic intervals; If it is bigger, then its edge will begin fuzzy the reconstruction from the contiguous order of diffraction.This causes very little reconstruction object-typically only across several centimetres, even also be like this for little spacing display device costliness, specialty.But this method of using, virtual observer's window (its described in the above mistake is arranged in the Fourier plane of hologram) only needs the same with eye pupil big.As a result, also can use even have the SLMs of intermediate reach size.And because the reconstruction object can fill up the frustum between virtual observer's window and the hologram fully, it in fact can be very big, that is, big more a lot of than periodic intervals.In addition, when using OASLM, just do not have pixelation (pixelation), therefore not periodically, like this, keep virtual observer's window just no longer suitable less than the restriction of periodic intervals.
Also have another advantage, it launches in a modification.When computed hologram, with people to the knowledge of rebuilding object begin-as, you may have the 3D rendering file of racing car.This document will describe which type of the object of seeing is from many different viewing location.In traditional holography, the needed hologram of reconstruction that generates racing car directly obtains from the 3D rendering file in the computation-intensive process.But virtual observer's windowhood method can provide different and calculate otherwise effective technique more.Begin with a plane that rebuilds object, we can calculate virtual observer's window, because it is the Fresnel conversion of object.We carry out this method to all objects plane then, add the Fresnel conversion with the generation accumulation with the result; This has determined to cross over the wave field of virtual observer's window.Our computed hologram is as the Fourier transform of this virtual observer's window then.Because virtual observer's window comprises all information of object, so only the virtual observer's window in monoplane must Fourier transform becomes hologram and is not many planar objects.If there be not monotropic changing step suddenly from virtual observer's window to hologram, but the iterated transform as iteration Fourier transformation computation rule is arranged, then this is very favorable.Iteration if desired, each iterative step only comprises single Fourier transform of virtual observer's window rather than of each object plane, and the result is that calculating strength obviously reduces.
Another interesting result of virtual observer's windowhood method is that all are rebuild the needed information of given object point and are included in the relatively little part of hologram; This and traditional hologram are completely different, and the information of rebuilding given object point in traditional hologram is crossed over whole hologram and distributed.Because we need be encoded to information the abundant little part of hologram, mean we need handle with the information encoded total amount far below traditional hologram.This so mean traditional calculations device (for example price and performance are suitable for the conventional digital signal processor (DSP) that mass marketed is sold) even can be used for the real-time video holography.
Yet, have some unwanted results.At first, apart from the viewing distance of hologram very important-hologram encodes by this way and throws light on: only just can see correct reconstruction when eyes are on the Fourier plane of hologram or when neighbouring; And in the hologram of standard, viewing distance is unimportant.But, have multiplely to be used to reduce Z sensitivity or around the technology that reduces the Z sensitivity design.
Also have, owing to encode by this way and throw light on hologram: only just can see correct holographic reconstruction, so need the eyes tracking in accurate and little viewing location (that is, horizontal location especially, but also on Z distance).Owing to have Z sensitivity, therefore exist multiplely to be used to reduce X, Y sensitivity or around the technology that reduces X, Y sensitivity design.For example, (will along with the manufacturing progress of LCD) reduces because pel spacing, and virtual observer's window size will increase.In addition, efficient coding technology (as kino formula coding (Kinoform encoding)) helps the more most of of periodic intervals used as virtual observer's window more, and has therefore increased virtual observer's window.
We are handling fourier hologram hypothesis mentioned above.Virtual observer's window in the Fourier plane of hologram, that is, and in the plane of delineation of light source.As advantage, diffraction light does not focus at so-called DC point (DC-spot).This technology can also be used for the not Fresnel hologram in the plane of delineation of light source of virtual observer's window.Yet, should be noted in the discussion above that the light of diffraction is not sightless as jamming pattern.The on the other hand term " conversion " that should be noted that should be interpreted as comprising that the conversion with describing the light propagation is equal to or akin any mathematics or computing technique mutually.Conversion is approaching of physical process only, more accurately defines by Maxwell's wave propagation equations; Fresnel and Fourier transform are that second order approaches, but have such advantage: (a) because they are the algebraically relative with differential, therefore can handle them in the mode of calculating effective ways; (b) they can accurately be implemented in optical system.
Further be presented in detail among U.S. Patent application US 2006-0138711 and US2006-0139710 and the US 2006-0250671 and provide, the content of these files is to be incorporated into this with reference to the mode of quoting.
Appendix II
Glossary used in the present invention
Computer-generated hologram
It is the hologram that calculates from scene that computing machine generates video holograms CGH.CGH can comprise the amplitude of the needed representative light wave of expression re-construct and the complex value number of phase place.For example CGH can follow the trail of by coherent light and calculate, calculates by the simulation of the interference between scene and the reference wave, perhaps calculates by Fourier transform or Fresnel conversion.
Coding
Coding is the process that the controlling value of video holograms is provided to spatial light modulator (for example, it constitutes the unit, or continuous SLM, as the proximity of OASLM).Usually, hologram comprises the complex value number of expression amplitude and phase place.
The code area
The code area is the typical space restricted area of video holograms, the hologram information of the single scene point of this district's coding.Space constraint can be blocked or by realizing to the smooth transition that the Fourier transform of video holograms obtains by virtual observer's window by unexpected.
Fourier transform
Fourier transform is used for calculating the light propagation in the far field of photomodulator.Wavefront is described by plane wave.
Fourier plane
Fourier plane comprises the photodistributed Fourier transform on the spatial light modulator.Without any condenser lens, the Fourier plane infinity.If near spatial light modulator, then Fourier plane equals to comprise the plane of light source image to condenser lens in light path.
The Fresnel conversion
The Fresnel conversion is used for the light in the near field of computer memory photomodulator and propagates.Wavefront is described by spherical wave.The phase factor of light wave comprises the item that secondary depends on lateral coordinates.
Frustum
Virtual frustum makes up between virtual observer's window and SLM, and extends in the SLM back.Scene is rebuild in this frustum.The size of the scene of rebuilding is limited by this frustum, rather than is limited by the periodic intervals of SLM.
Photosystem
Photosystem can comprise coherent source as laser or the partial coherence light source as LED.The relevant of the time of partial coherence light source and space must be enough to help good scene rebuilding, that is, the lateral magnification of spectral line width and emitting surface must be enough little.
Virtual observer's window (VOW)
Virtual observer's window is the virtual window in the observer plane, can see the 3D object of reconstruction by it.VOW is the Fourier transform of hologram and is arranged in one-period at interval to avoid the multiple reconstruction of visible object.The size of VOW must be the size of eye pupil at least.If at least one VOW is positioned at the position of the observer's eyes with observer's tracing system, the VOW lateral extent that can move much smaller than the observer then.This helps to use and has moderate resolution so the little SLM of periodic intervals.VOW keyhole can be thought of as, the 3D object of reconstruction can be seen by it, or VOW of every eyes, or VOW of two eyes.
Periodic intervals
If CGH shows that on the SLM that is made up of independent addressable unit CGH then samples.This sampling causes the periodicity of diffraction pattern to repeat.Periodic intervals is λ D/p, and λ is a wavelength, and D is the distance that hologram arrives Fourier plane, and p is the spacing of SLM unit.Yet OASLMs does not have sampling, does not therefore have the periodicity of diffraction pattern to repeat; Repeating reality is effectively suppressed.
Rebuild
Rebuilding primary light with the spatial light modulator of the illumination of hologram coding distributes.This light distributes and is used for computed hologram.Ideally, the observer will can not tell the light distribution of reconstruction from primary light distributes.The light of re-construct distributes in most of holographic displays.But in our display device, in virtual observer's window, rebuild light and distribute.
Scene
The scene of rebuilding is real or the three-dimensional light that computing machine generates distributes.As special example, it can also be that two-dimentional light distributes.Scene can constitute the different object fixing or that move that is arranged in the space.
Spatial light modulator (SLM)
SLM is used for the wavefront of modulating the incident light.Desirable SLM can represent any complex value number, promptly control the amplitude and the phase place of light wave respectively.Yet typical traditional SLM only controls a characteristic, is amplitude or is phase place, and have the spinoff of not expecting that also influences another characteristic.
Appendix III
Notion
Many notions (being described as notion " A-T ") are arranged among the present invention.Following content may be helpful to defining these notions.
A. the hologram display device of on same substrate, calculating with pixel
In holographic display, performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out.
Performed at least some calculating that are used for determining the spatial light modulator coding are to use the circuit between the pixel of spatial light modulator to carry out.
In the zone of dispersion of display device, carry out to calculate, with the pixel of the corresponding zone of dispersion of coding on the basis of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
The active area of at least some circuit (active region) is made up of polysilicon.
The active area of at least some circuit is made up of continuous grain silicon (continuous grain Si).
The active area of at least some circuit is made up of polycrystalline silicon germanium.
The active area of at least some circuit is made up of monocrystalline silicon.
The active area of at least some circuit is made up of individual particle silicon (single grain Si).
The active area of at least some circuit is made up of organic semiconductor.
Substrate is a monocrystalline silicon.
Substrate is a glass.
Only the real space image data transmission is to display device.
Video frame rate is at least about 25Hz.
View data is made up of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating is to use look-up-table method to carry out.
Subhologram is used for calculating.
The data that are used to add with subhologram exchange in the distance that surpasses the subhologram size.
Holographic calculating on whole display device surface evenly launched.
Holography is calculated to be divided into and is tiled in the little identical part that the display device surface is called cluster (cluster).
The data that are used to add with subhologram exchange in the distance that surpasses cluster size.
Holographic demonstration can be set up together by identical cluster is tiled.
Holographic display is a high-definition display device.
Holographic display is very high-resolution display device.
Virtual observer's window is an eye pupil diameter or wideer.
Virtual observer's window is 1 centimetre or wideer.
Each virtual observer's window makes up a depth map and intensity map is right for each eye is.
Show monochrome image.
Color display.
The coloured image that shows is a rgb format.
For the pixel value of computed hologram, only consider the value of the child partition (sub-section) of original image.
The light that is used to rebuild is not relevant fully on whole display device, but relevant in the child partition of display device.
The lead that enough is used for the raw image data transmission lacks than the lead that is used for the hologram data transmission.
Reduction data transmission frequency helps reducing the power consumption in the row and column driving.
The major part of the needed pixel region of row and column lead can be used for other purpose in the prior art solution.
The area of transparency electrode can be increased, the transmittance of display device can be improved thus.
Display panel can use traditional display technique to control.
Display device is to use the liquid crystal over silicon technology to manufacture.
Display device is to use the MEMS technology to manufacture.
Display device is to use the field-emitter display technology to manufacture.
Holographic conversion is an one-dimensional transform.
Holographic conversion is a two-dimensional transform.
Exist to be used for the local additional logic of transmitting the data that calculate, and additional logic can also be used in the lump to cluster forwarding original image, so that can eliminate at least some overall row and column leads.
Redundant circuit as TFTs, can be made in the space of picture element matrix, so that some circuit that sort circuit uses when finding that device starts can be used for some circuit of using when replacement device starts when breaking down.
Use the method for holographic display.
B. the hologram display device of calculating on same substrate, this device have the effective calculating to the coding of spatial light modulator
In holographic display, performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, and wherein calculate and do not relate to the calculating of Fourier transform or the calculating of Fresnel conversion.
Performed at least some calculating that are used for determining the spatial light modulator coding are to use the circuit between the pixel of spatial light modulator to carry out.
In the zone of dispersion of display device, carry out to calculate, with the pixel of the corresponding zone of dispersion of coding on the basis of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
The active area of at least some circuit is made up of polysilicon.
The active area of at least some circuit is made up of continuous grain silicon.
The active area of at least some circuit is made up of polycrystalline silicon germanium.
The active area of at least some circuit is made up of monocrystalline silicon.
The active area of at least some circuit is made up of individual particle silicon.
The active area of at least some circuit is made up of organic semiconductor.
Substrate is a monocrystalline silicon.
Substrate is a glass.
Only the real space image data are sent to display device.
Video frame rate is at least about 25Hz.
View data is made up of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating is to use look-up-table method to carry out.
Subhologram is used for calculating.
Holographic calculating on whole display device surface evenly launched.
Holography is calculated to be divided into and is tiled in the little identical part that is called cluster on the display device surface.
Holographic display is a high-definition display device.
Virtual observer's window is an eye pupil diameter or wideer.
Show monochrome image.
Color display.
For the pixel value of computed hologram, only consider the value of the child partition of original image.
The light that is used to rebuild is not relevant fully on whole display device, but relevant in the child partition of display device.
The lead that enough is used for the raw image data transmission lacks than the lead that is used for the hologram data transmission.
Reduction data transmission frequency helps reducing the power consumption in the row and column driving.
The major part of the needed pixel region of row and column lead can be used for other purpose in the prior art solution.
The area of transparency electrode can be increased, the transmittance of display device can be improved thus.
Display panel can use traditional display technique to control.
Display device is to use the liquid crystal over silicon technology to manufacture.
Display device is to use the MEMS technology to manufacture.
Display device is to use the field-emitter display technology to manufacture.
Holographic conversion is an one-dimensional transform.
Holographic conversion is a two-dimensional transform.
Exist to be used for the local additional logic of transmitting the data that calculate, and additional logic can also be used in the lump to cluster forwarding original image, so that can eliminate at least some overall row and column leads.
Redundant circuit as TFTs, can be made in the space of picture element matrix, so that some circuit that sort circuit uses when finding that device starts can be used for some circuit of using when replacement device starts when breaking down.
The wavefront that object sends is rebuild in one or more virtual observer's windows (VOW), and wherein the reconstruction of each single object point (OP) of three-dimensional scenic (3D S) only needs the subclass of subhologram (SH) as the whole hologram (H ∑ SLM) that will encode on SLM.
Turning to a plurality of object points (OP) afterwards with scene (3D S) is discrete, for the object point (OP) of each visible 3D scene, coding lens subhologram (SH on SLM L) complex values, wherein the complex values of lens subhologram is to use formula z L=exp{-i*[(π/λ f) * (x 2+ y 2)] determine, wherein λ is a reference wavelength, and f is a focal length, and x and y are the normal coordinates in the subhologram plane.
For mobile virtual observer window away from the optical axis, (hologram-plane determines the subhologram (SH of prism in HE) on the hologram plane P).
The subhologram of lens and the subhologram of prism are asked convolution, and this convolution can symbolically be expressed as SH=SH L* SH P
Each subhologram (SH) is with the unified phase deviation modulation that distributes, wherein phase deviation subhologram difference one by one.
Add with subhologram to form whole hologram.
The reproduction of the computer-generated hologram that is used to rebuild, this reconstruction are real-time or quasi real time.
Question blank is used for holographic calculating.
Object point can generate in the optional position in rebuilding frustum.
Use the method for holographic display.
C. on same substrate, carry out the hologram display device that decompress(ion) calculates
In holographic display, in the outside computed hologram coded data in the occupied space of picture element matrix, use known data compression technique to compress this hologram coded data then, and be transferred in the circuit on the display device substrate, by this circuit the data that receive are carried out again and separated compression functions.
Performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out.
Circuit comprises thin film transistor (TFT).
The active area of at least some circuit is made up of polysilicon.
The active area of at least some circuit is made up of continuous grain silicon.
The active area of at least some circuit is made up of polycrystalline silicon germanium.
The active area of at least some circuit is made up of monocrystalline silicon.
The active area of at least some circuit is made up of individual particle silicon.
The active area of at least some circuit is made up of organic semiconductor.
Substrate is a monocrystalline silicon.
Substrate is a glass.
Video frame rate is at least about 25Hz.
View data is made up of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating is to use look-up-table method to carry out.
Subhologram is used for calculating.
Holographic display is a high-definition display device.
Virtual observer's window is an eye pupil diameter or wideer.
Show monochrome image.
Color display.
For the pixel value of computed hologram, only consider the value of the child partition of original image.
The light that is used to rebuild is not relevant fully on whole display device, but relevant in the child partition of display device.
Reduction data transmission frequency helps reducing the power consumption in the row and column driving.
The major part of the needed pixel region of row and column lead can be used for other purpose in the prior art solution.
The area of transparency electrode can be increased, the transmittance of display device can be improved thus.
Display panel can use traditional display technique to control.
Display device is to use the liquid crystal over silicon technology to manufacture.
Display device is to use the MEMS technology to manufacture.
Display device is to use the field-emitter display technology to manufacture.
Holographic conversion is an one-dimensional transform.
Holographic conversion is a two-dimensional transform.
Redundant circuit as TFTs, can be made in the space of picture element matrix, so that some circuit that sort circuit uses when finding that device starts can be used for some circuit of using when replacement device starts when breaking down.
The wavefront that object sends is rebuild in one or more virtual observer's windows (VOW), and wherein the reconstruction of each single object point (OP) of three-dimensional scenic (3D S) only needs the subclass of subhologram (SH) as the whole hologram (H ∑ SLM) that will encode on SLM.
Turning to a plurality of object points (OP) afterwards with scene (3D S) is discrete, for the object point (OP) of each visible 3D scene, coding lens subhologram (SH on SLM L) complex values, wherein the complex values of lens subhologram is to use formula z L=exp{-i*[(π/λ f) * (x 2+ y 2)] determine, wherein λ is a reference wavelength, and f is a focal length, and x and y are the normal coordinates in the subhologram plane.
For mobile virtual observer window away from the optical axis, in hologram plane (HE), determine the subhologram (SH of prism P).
The subhologram of lens and the subhologram of prism are asked convolution, and this convolution can symbolically be expressed as SH=SH L* SH P
Carry out holographic space of calculating can, also can be not on the substrate identical with the substrate of display device.
The circuit of carrying out decompress(ion) calculating is between the pixel of display device.
The circuit of carrying out decompress(ion) calculating is positioned at the picture element matrix outside of display device, but on same substrate.
Cluster is carried out decompress(ion) and is calculated.
Be used for the row and column lead reception data of the cluster of decompress(ion) calculating by display device.
Each cluster that is used for decompress(ion) calculating receives data by parallel data bus line.
Each cluster that is used for decompress(ion) calculating connects the reception data by serial data.
Use the method for holographic display.
D. on same substrate, carry out the high-definition display device that decompress(ion) calculates
The high-definition display device of display of high resolution images data, on this display device, at first use known data compression technique packed data, then data are sent in the circuit on the display device substrate, this circuit is carried out the data that receive and is separated compression functions, video data on the pixel of display device subsequently then.
Decompression circuit is between the pixel of display device.
Decompression circuit is positioned at the picture element matrix outside of display device, but with display device on same substrate.
The data of compression are transferred on the display device cluster of a whole display device part, and cluster is carried out the data that receive and separated compression functions, video data on the pixel of local cluster more then.
Show normal video data.
The display holography video data.
Carry out space that compression calculates can, also can be not on the substrate identical with the substrate of display device.
Be used for the row and column lead reception data of the cluster of decompress(ion) calculating by display device.
Each cluster that is used for decompress(ion) calculating receives data by parallel data bus line.
Each cluster that is used for decompress(ion) calculating connects the reception data by serial data.
It is very high-resolution display device.
Decompress(ion) is carried out in 40ms or less time by each cluster.
Hologram image calculates after decompress(ion) and carries out.
Performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out.
Performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, and wherein calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel conversion.
Performed at least some calculating that are used for determining the spatial light modulator coding are to use the circuit between the pixel of spatial light modulator to carry out.
In the zone of dispersion of display device, carry out to calculate, with the pixel of the corresponding zone of dispersion of coding on the basis of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
The active area of at least some circuit is made up of polysilicon.
The active area of at least some circuit is made up of continuous grain silicon.
The active area of at least some circuit is made up of polycrystalline silicon germanium.
The active area of at least some circuit is made up of monocrystalline silicon.
The active area of at least some circuit is made up of individual particle silicon.
The active area of at least some circuit is made up of organic semiconductor.
Substrate is a monocrystalline silicon.
Substrate is a glass.
Video frame rate is at least about 25Hz.
Only the real space image data transmission is to display device.
View data is made up of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating is to use look-up-table method to carry out.
Subhologram is used for calculating.
Display device is to use the liquid crystal over silicon technology to manufacture.
Display device is to use the MEMS technology to manufacture.
Display device is to use the field-emitter display technology to manufacture.
Use the method for high-definition display device.
E. the hologram display device of calculating on same substrate, this device is played up pipeline by the 3D that incorporates the attached processing unit that is used for holographic conversion and coding into and have the expansion that is used for graphics subsystem.
In holographic display, performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, and incorporate the attached processing unit that is used for holographic conversion and coding into so that the 3D of graphics subsystem plays up pipeline.
The holographic circuit that calculates between the pixel that is to use display device is carried out.
Holographic calculating is to use in the picture element matrix outside of display device but carries out with the circuit of pixel on same substrate of display device.
Performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, and wherein calculate and do not relate to the calculating of Fourier transform or the calculating of Fresnel conversion.
In the zone of dispersion of display device, carry out to calculate, with the pixel of the corresponding zone of dispersion of coding on the basis of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
Video frame rate is at least about 25Hz.
Only the real space image data transmission is to display device.
View data is made up of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating is to use look-up-table method to carry out.
Subhologram is used for calculating.
Holographic calculating on whole display device surface evenly launched.
Holography is calculated to be divided into and is tiled in the little identical part that the display device surface is called cluster.
Holographic display is a high-definition display device.
Virtual observer's window is an eye pupil diameter or wideer.
Show monochrome image.
Color display.
For the pixel value of computed hologram, only consider the value of the child partition of original image.
The light that is used to rebuild is not relevant fully on whole display device, but relevant in the child partition of display device.
Holographic conversion is an one-dimensional transform.
Holographic conversion is a two-dimensional transform.
Redundant circuit as TFTs, can be made in the space of picture element matrix, so that some circuit that sort circuit uses when finding that device starts can be used for some circuit of using when replacement device starts when breaking down.
The wavefront that object sends is rebuild in one or more virtual observer's windows (VOW), and wherein the reconstruction of each single object point (OP) of three-dimensional scenic (3D S) only needs the subclass of subhologram (SH) as the whole hologram (H ∑ SLM) that will encode on SLM.
Turning to a plurality of object points (OP) afterwards with scene (3D S) is discrete, for the object point (OP) of each visible 3D scene, coding lens subhologram (SH on SLM L) complex values, wherein the complex values of lens subhologram is to use formula z L=exp{-i*[(π/λ f) * (x 2+ y 2)] determine, wherein λ is a reference wavelength, and f is a focal length, and x and y are the normal coordinates in the subhologram plane.
For mobile virtual observer window away from the optical axis, in hologram plane (HE), determine the subhologram (SH of prism P).
The subhologram of lens and the subhologram of prism are asked convolution, and this convolution can symbolically be expressed as SH=SH L* SH P
Each subhologram (SH) is with the unified phase deviation modulation that distributes, wherein phase deviation subhologram difference one by one.
Add with subhologram to form whole hologram.
For the reproduction of the computer-generated hologram that is used to rebuild, this reconstruction is real-time or quasi real time.
Question blank is used for holographic calculating.
Object point can generate in the optional position in rebuilding frustum.
Duplicate the Z figure that is used for the first demonstration wavelength and be used for the second and the 3rd demonstration wavelength for twice.
To three parallel each computed holograms that shows wavelength.
The color diagram RGB content that is used for two kinds of colors is copied to independently memory portion, to guarantee three kinds of color component independent access.
The lens function and the prism function that are used for every kind of Show Color have all passed through complex multiplication.
Each cluster application phase place at random for display device.
The SLM coding that calculates stands follow-up processing, and additional algorithm is used in this follow-up processing in the holographic display cluster.
Use the method for holographic display.
F. the hologram display device of calculating on same substrate, this device has the mode of the 3D pipeline of the holographic graphics card that calculates pipeline by expansion, and the point in the three dimensions is carried out holographic successively conversion
In holographic display, performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, so that the holographic successively conversion of the point in the three dimensions is carried out by the mode that expansion has the 3D pipeline of the holographic graphics card that calculates pipeline.
The holographic circuit that calculates between the pixel that is to use display device is carried out.
Holographic calculating is to use in the outside of picture element matrix but carries out with the circuit of display device on same substrate.
Performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, and wherein calculate and do not relate to the calculating of Fourier transform or the calculating of Fresnel conversion.
In the zone of dispersion of display device, carry out to calculate, with the pixel of the corresponding zone of dispersion of coding on the basis of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
Video frame rate is at least about 25Hz.
Only the real space image data transmission is to display device.
View data is made up of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating is to use look-up-table method to carry out.
Subhologram is used for calculating.
Holographic calculating on whole display device surface evenly launched.
Holography is calculated to be divided into and is tiled in the little identical part that the display device surface is called cluster.
Holographic display is a high-definition display device.
Virtual observer's window is an eye pupil diameter or wideer.
Show monochrome image.
Color display.
For the pixel value of computed hologram, only consider the value of the child partition of original image.
The light that is used to rebuild is not relevant fully on whole display device, but relevant in the child partition of display device.
Holographic conversion is an one-dimensional transform.
Holographic conversion is a two-dimensional transform.
Redundant circuit as TFTs, can be made in the space of picture element matrix, so that some circuit that sort circuit uses when finding that device starts can be used for some circuit of using when replacement device starts when breaking down.
The wavefront that object sends is rebuild in one or more virtual observer's windows (VOW), and wherein the reconstruction of each single object point (OP) of three-dimensional scenic (3D S) only needs the subclass of subhologram (SH) as the whole hologram (H ∑ SLM) that will encode on SLM.
Turning to a plurality of object points (OP) afterwards with scene (3D S) is discrete, for the object point (OP) of each visible 3D scene, coding lens subhologram (SH on SLM L) complex values, wherein the complex values of lens subhologram is to use formula z L=exp{-i*[(π/λ f) * (x 2+ y 2)] determine, wherein λ is a reference wavelength, and f is a focal length, and x and y are the normal coordinates in the subhologram plane.
For mobile virtual observer window away from the optical axis, in hologram plane (HE), determine the subhologram (SH of prism P).
The subhologram of lens and the subhologram of prism are asked convolution, and this convolution can symbolically be expressed as SH=SH L* SH P
Each subhologram (SH) is with the unified phase deviation modulation that distributes, wherein phase deviation subhologram difference one by one.
Add with subhologram to form whole hologram.
For the reproduction of the computer-generated hologram that is used to rebuild, this reconstruction is real-time or quasi real time.
Question blank is used for holographic calculating.
Object point can generate in the optional position in rebuilding frustum.
The 3D of graphics subsystem plays up pipeline and incorporates the attached processing unit that is used for holographic conversion and coding into.
Duplicate the Z figure that is used for the first demonstration wavelength and be used for the second and the 3rd demonstration wavelength for twice.
To three parallel each computed holograms that shows wavelength.
The color diagram RGB content that is used for two kinds of colors is copied to independently memory portion, to guarantee three kinds of color component independent access.
The lens function and the prism function that are used for every kind of Show Color have all passed through complex multiplication.
Each cluster application phase place at random for display device.
The SLM coding that calculates stands follow-up processing, and additional algorithm is used in this follow-up processing in the holographic display cluster.
Holographic calculating can beginning before color diagram and Z buffering are all available.
The holography that execution is used for each subhologram is calculated the needed time and is less than a frame time cycle.
It is 17ms or still less that the needed time is calculated in the holography that execution is used for each subhologram.
Be used for Military Application.
The question blank that each cluster of display device all has oneself is used for storing the coding of the subhologram of its demonstration.
Read after the content from the SH of LUT, calculated (the SH of current demonstration N-1) and new SH (SH n) poor.
The holographic successively conversion of the point in the three dimensions, the mode that has the 3D pipeline of the holographic graphics card that calculates pipeline by expansion is carried out, and is not subjected to the restriction of particular type SLM.
Use the method for holographic display.
G. the hologram display device of calculating on same substrate, it carries out randow addressing to holographic display
In holographic display, performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, to be used in the holographic real space image data of calculating are the poor of continuous real space image frame, and holographic video data is sent to the holographic display cluster with the form of subhologram differential data and display storage location data.
The holographic successively conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
The holographic circuit that calculates between the pixel that is to use display device is carried out.
Holographic calculating is to use in the picture element matrix outside but carries out with the circuit of display device on same substrate.
Performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, and wherein calculate and do not relate to the calculating of Fourier transform or the calculating of Fresnel conversion.
In the zone of dispersion of display device, carry out to calculate, with the pixel of the corresponding zone of dispersion of coding on the basis of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
Video frame rate is at least about 25Hz.
Only the real space image data transmission is to display device.
View data is made up of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating is to use look-up-table method to carry out.
Show subhologram.
Holographic calculating on whole display device surface evenly launched.
Holography is calculated to be divided into and is tiled in the little identical part that the display device surface is called cluster.
Holographic display is a high-definition display device.
Virtual observer's window is an eye pupil diameter or wideer.
Show monochrome image.
Color display.
For the pixel value of computed hologram, only consider the value of the child partition of original image.
The light that is used to rebuild is not relevant fully on whole display device, but relevant in the child partition of display device.
Holographic conversion is an one-dimensional transform.
Holographic conversion is a two-dimensional transform.
Redundant circuit as TFTs, can be made in the space of picture element matrix, so that some circuit that sort circuit uses when finding that device starts can be used for some circuit of using when replacement device starts when breaking down.
The wavefront that object sends is rebuild in one or more virtual observer's windows (VOW), and wherein the reconstruction of each single object point (OP) of three-dimensional scenic (3D S) only needs the subclass of subhologram (SH) as the whole hologram (H ∑ SLM) that will encode on SLM.
Turning to a plurality of object points (OP) afterwards with scene (3D S) is discrete, for the object point (OP) of each visible 3D scene, coding lens subhologram (SH on SLM L) complex values, wherein the complex values of lens subhologram is to use formula z L=exp{-i*[(π/λ f) * (x 2+ y 2)] determine, wherein λ is a reference wavelength, and f is a focal length, and x and y are the normal coordinates in the subhologram plane.
For mobile virtual observer window away from the optical axis, in hologram plane (HE), determine the subhologram (SH of prism P).
The subhologram of lens and the subhologram of prism are asked convolution, and this convolution can symbolically be expressed as SH=SH L* SH P
Each subhologram (SH) is modulated together with the unified phase deviation that distributes, wherein phase deviation subhologram difference one by one.
Add with subhologram to form whole hologram.
For the reproduction of the computer-generated hologram that is used to rebuild, this reconstruction is real-time or quasi real time.
Object point can generate in the optional position in rebuilding frustum.
The 3D of graphics subsystem plays up pipeline and incorporates the attached processing unit that is used for holographic conversion and coding into.
Duplicate the Z figure that is used for the first demonstration wavelength and be used for the second and the 3rd demonstration wavelength for twice.
To three parallel each computed holograms that shows wavelength.
The color diagram RGB content that is used for two kinds of colors is copied to independently memory portion, to guarantee three kinds of color component independent access.
The lens function and the prism function that are used for every kind of Show Color have all passed through complex multiplication.
Each cluster application phase place at random for display device.
The SLM coding that calculates stands follow-up processing, and additional algorithm is used in this follow-up processing in the holographic display cluster.
Be used for Military Application.
Receive the image difference data by holographic computing unit.
If do not have difference between the video data of given cluster place successive frame, or difference can ignore, and then do not need to send data to cluster.
Send the 3D discrepancy view data (3D difference point image data) relevant to each holographic computing unit with the reconstruction point that is used on SLM, encoding.
In each holographic display cluster separation vessel is arranged all, this separation vessel is divided into subhologram data and size and positional information with the hologram video data that calculates, wherein, both values of back can be used for calculating the address realm of subhologram among the RAM, so that subhologram SH or SH DData be written in the SLM unit correct in the cluster.
Use special random-access memory (ram): only write new SH or SH at input side DS reads whole storer line by line at outgoing side simultaneously, and writes information to SLM.
Use the method for holographic display.
H. the display device that in pixel space, has computing function
In display device, computing function is to carry out by the circuit that the pixel with display device is arranged on the same substrate.
Computing function is to carry out by the circuit between the pixel of display device.
Computing function is by in the picture element matrix outside but carry out with the circuit of display device on same substrate.
Carry out in other position if be arranged on the computing function that the circuit on the same substrate carries out by the pixel with display device, then the time-delay meeting during video data is still less on display device.
Calculating is graphic computation.
It is the part of high speed game station.
Be used for Military Application.
In the zone of dispersion of display device, carry out to calculate, with the pixel of the corresponding zone of dispersion of coding on the basis of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
The active area of at least some circuit is made up of polysilicon.
The active area of at least some circuit is made up of continuous grain silicon.
The active area of at least some circuit is made up of polycrystalline silicon germanium.
The active area of at least some circuit is made up of monocrystalline silicon.
The view data frame rate is at least about 25Hz.
Can be that the calculating of parallel computation is divided into and is tiled in the little identical part that the display device surface is called cluster.
Demonstration can come together by identical cluster is tiled to set up.
Display device is a high-definition display device.
Display device is very high-resolution display device.
Color display.
The coloured image that shows is a rgb format.
Display device is to use the liquid crystal over silicon technology to manufacture.
Exist to be used for the local additional logic of transmitting the data that calculate, and additional logic can also be used in the lump to cluster forwarding original image, so that can eliminate at least some overall row and column leads.
Use the method for display device
I. block
In holographic display, performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, and, guarantee to cover further from the object point of virtual observer's window along the more close virtual observer's of identical sight line object point for this holographic display.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel conversion.
In the outside computed hologram coded data in the occupied space of picture element matrix, with known data compression technique compression hologram coded data, be transferred to the circuit on the display device substrate then then, this circuit is carried out the data that receive and is separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates the attached processing unit that is used for holographic conversion and coding into.
The holographic successively conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and holographic video data sends to the holographic display cluster with the form of subhologram differential data and display storage location data.
Use to calculate and implement to block, this calculating is by carrying out with the circuit of picture element matrix on same substrate.
Use to calculate and implement to block, this calculating is to carry out by the circuit between the pixel of display device.
Virtual observer's window is an eye pupil diameter or wideer.
VOW is divided into two or more segments.
The size of each VOW segment and human eye pupil size are basic identical.
Each VOW segment is by different subhologram codings.
Block is to carry out in the stage that makes up depth map and intensity map.
Use the method for holographic display.
J. graphics card function
In holographic display, performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, and wherein the graphics card function is to implement by using with the circuit of pixel on same substrate of display device.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel conversion.
Outside computed hologram coded data in the occupied space of picture element matrix is used known data compression technique compression hologram coded data then, is transferred to the circuit on the display device substrate then, and this circuit is carried out the data that receive and separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates the attached processing unit that is used for holographic conversion and coding into.
The holographic successively conversion of three dimensions mid point is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and holographic video data sends to the holographic display cluster with the form of subhologram differential data and display storage location data.
The graphics card function is by using the circuit between the pixel of display device to implement.
The graphics card function is implemented in the picture element matrix circuit external by using.
The graphics card function comprises texture.
The graphics card function comprises plays up polygon.
The graphics card function comprises the summit is transformed in the different coordinate systems.
The graphics card function comprises tinter able to programme.
The graphics card function comprises in order to reduce the over-sampling and the interpolation technique of aliasing.
The graphics card function comprises very high-precision color space.
The graphics card function comprises 2D speed-up computation ability.
The graphics card function comprises the frame surge capability.
The graphics card function comprises Motion Picture Experts Group (Moving Picture Experts Group, MPEG) pel.
The graphics card function comprises carries out the calculating that relates to matrix and vector operations.
The graphics card function comprises uses 3D to play up pipeline, and this 3D plays up pipeline by implementing with the TFTs of picture element matrix on same substrate.
Use the method for holographic display.
K.2D-3D conversion
In holographic display, performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, and implement the 2D-3D image transitions in this holographic display.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel conversion.
In the outside computed hologram coded data in the occupied space of picture element matrix, use known data compression technique compression hologram coded data then, be transferred to the circuit on the display device substrate then, this circuit is carried out the data that receive and is separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates the attached processing unit that is used for holographic conversion and coding into.
The holographic successively conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and holographic video data sends to the holographic display cluster with the form of subhologram differential data and display storage location data.
The 2D-3D image changes to be to use with the circuit of pixel on same substrate of display device to be implemented.
The 2D-3D image change be to use with the pixel of display device not the circuit on same substrate implement.
The 2D-3D image transitions is to use the circuit between the pixel of display device to implement.
The 2D-3D image transitions is to use in the picture element matrix outside but implements with the circuit of pixel on same substrate of display device.
The 2D-3D image transitions is to use paired stereo-picture to implement.
Display device from the data that receive, calculate two dimension (2D) image with and corresponding depth map.
Carry out the circuit of 2D-3D conversion and have the right to visit the data bank that comprises one group of known 3D shape.
Carry out the circuit of 2D-3D conversion and have the right to visit the data bank that comprises one group of known 2D sectional view, this circuit manages to find out the 2D sectional view that is complementary with the 2D view data of importing into.
The 2D-3D image transitions is based on that single, non-automatic three-dimensional 2D image carries out.
Use the method for holographic display.
L. meeting (3D Skype TM)
Provide voice and hologram image (voice and holographicimage over internet protocol, VHIOIP) Fu Wu holographic display with it based on Internet Protocol.
Performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel conversion.
Outside computed hologram coded data in the occupied space of picture element matrix is used known data compression technique compression hologram coded data then, is transferred to the circuit on the display device substrate then, and this circuit is carried out the data that receive and separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates the attached processing unit that is used for holographic conversion and coding into.
The holographic successively conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and holographic video data sends to the holographic display cluster with the form of subhologram differential data and display storage location data.
VHIOIP is provided point-to-point communication.
File-sharing is provided.
In the global network that is connected, provide the instant messages service.
In the computer network that is connected, provide communication service.
In the computer network that is connected, provide file-sharing service.
In the computer network that is connected, provide the instant messages service.
The permission user that provide online, can not download uses the interim use of the computer software of VHIOIP communication service.
The permission user who is provided for downloading uses the online software of VHIOIP communication service.
Be provided for visiting the territory of holographic video data or the inlet of regional data base system.
Use the method for holographic display.
M. coding compensation
In holographic display, before coding step or coding step, the hologram image data are applied compensation so that the easier image of watching to be provided.
Performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel conversion.
Outside computed hologram coded data in the occupied space of picture element matrix is used known data compression technique compression hologram coded data then, is transferred to the circuit on the display device substrate then, and this circuit is carried out the data that receive and separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates the attached processing unit that is used for holographic conversion and coding into.
The holographic successively conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and holographic video data sends to the holographic display cluster with the form of subhologram differential data and display storage location data.
Compensation is to use the circuit of pixel on same substrate with display device to apply.
Compensation is to use the circuit between the pixel of display device to apply.
Compensation is applied on the hologram image data at coding step.
Compensation is being applied to before the coding step on the hologram image data.
Applying compensation mainly is thin shade (light tones) and the scene of tending to under-exposure to proofread and correct.
Applying compensation mainly is low key tone (dark tones) and tends to over-exposed scene to proofread and correct.
Use the method for holographic display.
N. eyes are followed the trail of
In holographic display, performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, and implement eyes and follow the trail of in this holographic display.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel conversion.
Outside computed hologram coded data in the occupied space of picture element matrix is used known data compression technique compression hologram coded data then, is transferred to the circuit on the display device substrate then, and this circuit is carried out the data that receive and separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates the attached processing unit that is used for holographic conversion and coding into.
The holographic successively conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and holographic video data sends to the holographic display cluster with the form of subhologram differential data and display storage location data.
For implementing eyes, single observer follows the trail of.
For implementing eyes, a plurality of observers follow the trail of.
The eyes tracking is to limit the hunting zone by the face through surveying the user, limits tracking range by surveying eyes then, implements by the tracking eyes again.
Be provided for carrying out the eyes tracking computing module of eye position recognition function, it is right that the stereo-picture that is provided by stereo camera is provided this module.
Module is returned the x-of each eye with respect to point of fixity, y-, and z-coordinate.
In order to carry out the needed calculating of tracking is by carrying out with the circuit of display device pixel on same substrate.
In order to carry out the needed calculating of tracking is to carry out by the circuit in picture element matrix.
Holographic encoding on the SLM panel can be displaced in the panel plane.
An eyes tracking in a lateral direction is to realize by x-or the whole holographic encoding content of y-direction superior displacement at SLM.
Follow the trail of so that coherently illuminate light source and the same moved further of observer's change in location of SLM.
Use the method for holographic display.
O. aberration correction
In holographic display, performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, and implement aberration correction in this holographic display.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel conversion.
Outside computed hologram coded data in the occupied space of picture element matrix is used known data compression technique compression hologram coded data then, is transferred to the circuit on the display device substrate then, and this circuit is carried out the data that receive and separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates the attached processing unit that is used for holographic conversion and coding into.
The holographic successively conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and holographic video data sends to the holographic display cluster with the form of subhologram differential data and display storage location data.
Aberration correction is to use with the circuit of picture element matrix on same substrate and implements.
Aberration correction is to use the circuit between pixel to implement.
Aberration is dynamically to proofread and correct by the coding of spatial light modulator.
Aberration after the correction is the aberration in the lens in microlens array.
Aberration after the correction is the aberration in the lens in the 2D lens arra.
Show subhologram.
Total hologram is generated by subhologram.
The aberration correction algorithm is to calculate until the step that generates total hologram concurrently, carry out independently with holography.
Total hologram and aberration correction figure modulate together.
The aberration correction algorithm is to resolve to implement.
The aberration correction algorithm is to use question blank (LUT) to implement.
Use the method for holographic display.
P. spot is proofreaied and correct
In holographic display, performed at least some calculating that are used for determining the spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator and carry out, and implement spot and proofread and correct in this holographic display.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel conversion.
Outside computed hologram coded data in the occupied space of picture element matrix is used known data compression technique compression hologram coded data then, is transferred to the circuit on the display device substrate then, and this circuit is carried out the data that receive and separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates the attached processing unit that is used for holographic conversion and coding into.
The holographic successively conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and holographic video data sends to the holographic display cluster with the form of subhologram differential data and display storage location data.
Spot is proofreaied and correct to be to use with the circuit of picture element matrix on same substrate and is implemented.
The spot correction is to use the circuit between pixel to implement.
Spot is dynamically to proofread and correct by the coding of spatial light modulator.
Show subhologram.
Total hologram is generated by subhologram.
The spot correcting algorithm is to calculate until the step that generates total hologram concurrently, carry out independently with holography.
Total hologram and spot correction chart are modulated together.
The spot correcting algorithm is to resolve to implement.
The spot correcting algorithm is to use question blank (LUT) to implement.
Use the method for holographic display.
Q. be used for digital copyright management (Digital Rights Management, DRM) deciphering in of holographic display
In holographic display, deciphering and hologram calculating are to use the circuit on the picture element matrix substrate to carry out.
Deciphering and hologram calculating are to use the distributed execution of circuit on the substrate that is distributed in picture element matrix.
Deciphering and hologram calculate and are to use the interior circuit of picture element matrix to carry out.
Deciphering and hologram calculating are to use in the picture element matrix outside but carry out with the circuit of picture element matrix on same substrate.
Individually can not be on the substrate to catch all decrypted data.
Different panel zones is used different decruption keys.
Use the method for holographic display.
R. be used for the deciphering of the digital copyright management (DRM) of 2D demonstration
In the 2D display device, the distributed execution of circuit be to use on the substrate that is distributed in picture element matrix is calculated in deciphering.
The distributed execution of circuit be to use in picture element matrix is calculated in deciphering.
Deciphering is calculated and to be to use in the picture element matrix outside but with the circuit distributed execution of picture element matrix on same substrate.
Individually can not be on the substrate to catch all decrypted data.
Different substrate regions is used different decruption keys.
Use the method for display device.
In the 2D display device, deciphering calculating is to use the circuit in the single zone of display device substrate to carry out.
Circuit is in picture element matrix inside.
Circuit is in the picture element matrix outside.
Use the method for display device.
S. the software application of in the hardware that is connected to display device firmly, implementing
In display device, can be by the application of using software to implement, the circuit that is distributed on the substrate of SLM panel by use in hardware is implemented on the contrary.
Display device is the 2D display device.
Display device is a holographic display.
Application is to use the circuit between the pixel of display device to implement.
Application is to use to be implemented in the picture element matrix circuit external of display device.
Use the method for display device.
T. the variable beam deflection of implementing with microprism
Use the microprism array of energy control bundle deflection to come tracing study person's holographic display.
Two-dimensional deflection is to obtain by the microprism array that uses two series connection.
Prism is little liquid prism.
Can reduce the optical effect of lens aberration.
VOWs is arranged on observer's eyes place.
Being arranged on the front of prism array or the focusing instrument of back helps convergence of rays in VOW.
Prism does not have identical deflection angle entirely.
Prism not all has identical deflection angle, so that assemble a little at VOW from the light of prism array ejaculation.
Prism angle calculate to be to carry out in the counting circuit on the SLM substrate.
It is to carry out in the counting circuit that is provided with on the prism array substrate that prism angle is calculated.
The substrate of SLM also is used as the substrate of prism array.
It is discontinuous with the caused phase place of compensating prism array to apply phase correction.
Phase correction is carried out by SLM.
Generate hologram image in the projection type device, wherein projection comprises SLM is imaged onto on the prism array, and the reconstruction of desired 3D scene takes place in the place ahead of VOW simultaneously.
When being imaged onto SLM on the prism array, provide phase compensation to prism array.
Phase compensation to prism array is to be provided by the additional SLM that is arranged near prism array.
SLM is a printing opacity, and prism array is reflective.
SLM is reflective, and prism array is a printing opacity.
Use the method for holographic display.

Claims (24)

1. holographic display, comprise spatial light modulator (SLM), also comprise position sensing and tracing system so that observer's eye position is tracked, towards the deflection of the variable beam of observer's eye position by use can control bundle deflection microprism array carry out.
2. holographic display according to claim 1, it is characterized in that, position sensing and tracing system tracing study person's eye position, towards the deflection of the variable beam of observer's eye position by use can control bundle deflection microprism array carry out.
3. holographic display according to claim 1 and 2 is characterized in that the deflection of variable beam is continually varying.
4. according to the described holographic display of above-mentioned arbitrary claim, it is characterized in that the deflection of variable beam is carried out the moistening technology of electricity consumption.
5. according to the described holographic display of above-mentioned arbitrary claim, it is characterized in that the deflection of variable beam uses the variable voltage difference to carry out, this variable voltage difference is applied on the different electrodes of the not ipsilateral that is positioned at each electric moistening cell array.
6. according to the described holographic display of above-mentioned arbitrary claim, it is characterized in that prism is little liquid prism.
7. according to the described holographic display of above-mentioned arbitrary claim, it is characterized in that two-dimensional deflection obtains by the microprism array that uses two series connection.
8. according to the described holographic display of above-mentioned arbitrary claim, it is characterized in that virtual observer's window (VOW) is arranged on observer's eyes place.
9. holographic display according to claim 8 is characterized in that, the focalizer that is arranged on prism array front or back helps convergence of rays to virtual observer's window (VOW).
10. according to the described holographic display of above-mentioned arbitrary claim, it is characterized in that, can be by the dynamic calibration of the coding of spatial light modulator being reduced the optical effect of lens aberration.
11., it is characterized in that prism not all has identical deflection angle according to the described holographic display of above-mentioned arbitrary claim.
12. holographic display according to claim 11 is characterized in that, prism not all has identical deflection angle, locates to assemble a little at virtual observer's window (VOW) so that penetrate the light of prism array.
13. according to the described holographic display of above-mentioned arbitrary claim, it is characterized in that, carry out in the counting circuit of prism angle calculating on the SLM substrate.
14. according to the described holographic display of arbitrary claim in the claim 1 to 12, it is characterized in that, carry out in the counting circuit of prism angle calculating on being arranged on the substrate of prism array.
15., it is characterized in that the substrate of SLM also is used as the substrate of prism array according to the described holographic display of above-mentioned arbitrary claim.
16., it is characterized in that it is discontinuous with the caused phase place of compensating prism array to apply phase correction according to the described holographic display of above-mentioned arbitrary claim.
17. holographic display according to claim 16 is characterized in that, phase correction is carried out by the operation of SLM.
18. according to the described holographic display of above-mentioned arbitrary claim, it is characterized in that hologram image generates in the projection type device, wherein, projection comprises SLM is imaged onto on the prism array, and the reconstruction of desired 3D scene takes place in the front of VOW simultaneously.
19. according to the described holographic display of arbitrary claim in the claim 16 to 18, it is characterized in that, when being imaged onto SLM on the prism array, for prism array provides phase compensation.
20. according to the described holographic display of arbitrary claim in the claim 16 to 19, it is characterized in that, provide phase compensation for prism array by the additional SLM that is arranged near prism array.
21. according to the described holographic display of above-mentioned arbitrary claim, it is characterized in that SLM is a printing opacity, prism array is reflective.
22. according to the described holographic display of arbitrary claim in the claim 1 to 20, it is characterized in that SLM is reflective, prism array is a printing opacity.
23. according to the described holographic display of arbitrary claim in the claim 1 to 20, it is characterized in that SLM is a printing opacity, prism array is a printing opacity.
24. a method that generates the holographic reconstruction of three-dimensional scenic, this three-dimensional scenic is made up of a plurality of discrete points, and this method is used the described holographic display of above-mentioned arbitrary claim, and this display device comprises the light source and the optical system of lighting space photomodulator; Described method comprises step:
Encoded holographic figure on spatial light modulator.
CN200880024344.9A 2007-05-16 2008-05-16 Holographic display Expired - Fee Related CN101743519B (en)

Applications Claiming Priority (39)

Application Number Priority Date Filing Date Title
DE102007023739.3A DE102007023739B4 (en) 2007-05-16 2007-05-16 Method for rendering and generating color video holograms in real time and holographic display device
GB0709376A GB0709376D0 (en) 2007-05-16 2007-05-16 Smart display
DE102007023739.3 2007-05-16
DE102007023785.7A DE102007023785B4 (en) 2007-05-16 2007-05-16 Analytical method for calculating video holograms in real time and holographic display device
GB0709376.8 2007-05-16
DE102007023785.7 2007-05-16
DE102007023740A DE102007023740B4 (en) 2007-05-16 2007-05-16 Method for generating video holograms for a holographic display device with random addressing
GB0709379.2 2007-05-16
DE102007023737.7 2007-05-16
DE102007023740.7 2007-05-16
GB0709379A GB0709379D0 (en) 2007-05-16 2007-05-16 Smart display extended
DE102007023737A DE102007023737B4 (en) 2007-05-16 2007-05-16 Method for generating video holograms in real time for extending a 3D rendering graphics pipeline
GB0718622.4 2007-09-25
GB0718649.7 2007-09-25
GB0718629.9 2007-09-25
GB0718598.6 2007-09-25
GB0718632.3 2007-09-25
GB0718596A GB0718596D0 (en) 2007-05-16 2007-09-25 Holograms
GB0718656.2 2007-09-25
GB0718607.5 2007-09-25
GB0718640.6 2007-09-25
GB0718602.6 2007-09-25
GB0718596.0 2007-09-25
GBGB0718598.6A GB0718598D0 (en) 2007-05-16 2007-09-25 Holograms
GB0718614.1 2007-09-25
GB0718617.4 2007-09-25
GB0718633.1 2007-09-25
GB0718626.5 2007-09-25
GBGB0718654.7A GB0718654D0 (en) 2007-05-16 2007-09-25 Holograms
GBGB0718656.2A GB0718656D0 (en) 2007-05-16 2007-09-25 Holograms
GB0718595.2 2007-09-25
GB0718659.6 2007-09-25
GBGB0718649.7A GB0718649D0 (en) 2007-05-16 2007-09-25 Holograms
GB0718619.0 2007-09-25
GB0718636.4 2007-09-25
GBGB0718602.6A GB0718602D0 (en) 2007-05-16 2007-09-25 Holograms
GB0718634.9 2007-09-25
GB0718654.7 2007-09-25
PCT/EP2008/056030 WO2008138986A2 (en) 2007-05-16 2008-05-16 Holographic display with microprism array

Publications (2)

Publication Number Publication Date
CN101743519A true CN101743519A (en) 2010-06-16
CN101743519B CN101743519B (en) 2013-04-24

Family

ID=48141638

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200880024344.9A Expired - Fee Related CN101743519B (en) 2007-05-16 2008-05-16 Holographic display

Country Status (1)

Country Link
CN (1) CN101743519B (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105390066A (en) * 2015-12-02 2016-03-09 昆山龙腾光电有限公司 Display device
CN107015466A (en) * 2017-04-19 2017-08-04 电子科技大学 The holographic one-point positioning method of optical scanner based on TR MUSIC algorithms
CN107209362A (en) * 2015-01-21 2017-09-26 加州理工学院 Fourier overlapping associations tomography
CN107438796A (en) * 2014-12-26 2017-12-05 Cy视觉公司 Nearly eye display device
CN108027475A (en) * 2015-06-01 2018-05-11 光学技术注册协会莱布尼兹研究所 The improvement related with multimode fibre
WO2018141152A1 (en) * 2017-02-06 2018-08-09 京东方科技集团股份有限公司 Holographic display device and display method thereof, and display apparatus
CN108780296A (en) * 2016-03-02 2018-11-09 视瑞尔技术公司 Lighting device
US10401609B2 (en) 2012-10-30 2019-09-03 California Institute Of Technology Embedded pupil function recovery for fourier ptychographic imaging devices
US10419665B2 (en) 2013-08-22 2019-09-17 California Institute Of Technology Variable-illumination fourier ptychographic imaging devices, systems, and methods
CN110476864A (en) * 2019-09-17 2019-11-22 广东工业大学 A kind of Intelligent fish tank system
US10568507B2 (en) 2016-06-10 2020-02-25 California Institute Of Technology Pupil ptychography methods and systems
US10606055B2 (en) 2013-07-31 2020-03-31 California Institute Of Technology Aperture scanning Fourier ptychographic imaging
US10652444B2 (en) 2012-10-30 2020-05-12 California Institute Of Technology Multiplexed Fourier ptychography imaging systems and methods
CN111176093A (en) * 2018-11-12 2020-05-19 杜尔利塔斯有限公司 Spatial light modulator for holographic projection
US10679763B2 (en) 2012-10-30 2020-06-09 California Institute Of Technology Fourier ptychographic imaging systems, devices, and methods
US10684458B2 (en) 2015-03-13 2020-06-16 California Institute Of Technology Correcting for aberrations in incoherent imaging systems using fourier ptychographic techniques
US10718934B2 (en) 2014-12-22 2020-07-21 California Institute Of Technology Epi-illumination Fourier ptychographic imaging for thick samples
US10732396B2 (en) 2015-01-26 2020-08-04 California Institute Of Technology Array level Fourier ptychographic imaging
US10754140B2 (en) 2017-11-03 2020-08-25 California Institute Of Technology Parallel imaging acquisition and restoration methods and systems
US11092795B2 (en) 2016-06-10 2021-08-17 California Institute Of Technology Systems and methods for coded-aperture-based correction of aberration obtained from Fourier ptychography
CN113687586A (en) * 2021-07-23 2021-11-23 四川大学 Large-field-angle holographic display method for seamlessly splicing multi-segment cylindrical surfaces
US11468557B2 (en) 2014-03-13 2022-10-11 California Institute Of Technology Free orientation fourier camera
CN115616790A (en) * 2022-12-20 2023-01-17 煤炭科学研究总院有限公司 Hologram display system based on volume holographic optical waveguide
CN116819909A (en) * 2023-08-31 2023-09-29 光科芯图(北京)科技有限公司 Data compression method, device, exposure equipment and storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6582980B2 (en) * 2001-01-30 2003-06-24 Eastman Kodak Company System for integrating digital control with common substrate display devices
CN1751525B (en) * 2003-02-21 2012-02-01 皇家飞利浦电子股份有限公司 Autostereoscopic display
WO2006050340A2 (en) * 2004-11-01 2006-05-11 Polytechnic University Methods and apparatus for modifying gel adhesion strength
WO2006119760A2 (en) * 2005-05-13 2006-11-16 Seereal Technologies Gmbh Projection device and method for holographic reconstruction of scenes

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10652444B2 (en) 2012-10-30 2020-05-12 California Institute Of Technology Multiplexed Fourier ptychography imaging systems and methods
US10401609B2 (en) 2012-10-30 2019-09-03 California Institute Of Technology Embedded pupil function recovery for fourier ptychographic imaging devices
US10679763B2 (en) 2012-10-30 2020-06-09 California Institute Of Technology Fourier ptychographic imaging systems, devices, and methods
US10606055B2 (en) 2013-07-31 2020-03-31 California Institute Of Technology Aperture scanning Fourier ptychographic imaging
US10419665B2 (en) 2013-08-22 2019-09-17 California Institute Of Technology Variable-illumination fourier ptychographic imaging devices, systems, and methods
US11468557B2 (en) 2014-03-13 2022-10-11 California Institute Of Technology Free orientation fourier camera
US10718934B2 (en) 2014-12-22 2020-07-21 California Institute Of Technology Epi-illumination Fourier ptychographic imaging for thick samples
CN107438796A (en) * 2014-12-26 2017-12-05 Cy视觉公司 Nearly eye display device
CN107438796B (en) * 2014-12-26 2020-07-03 Cy视觉公司 Head-mounted display device, near-to-eye display device and method
US10665001B2 (en) 2015-01-21 2020-05-26 California Institute Of Technology Fourier ptychographic tomography
CN107209362A (en) * 2015-01-21 2017-09-26 加州理工学院 Fourier overlapping associations tomography
US10754138B2 (en) 2015-01-26 2020-08-25 California Institute Of Technology Multi-well fourier ptychographic and fluorescence imaging
US10732396B2 (en) 2015-01-26 2020-08-04 California Institute Of Technology Array level Fourier ptychographic imaging
US10684458B2 (en) 2015-03-13 2020-06-16 California Institute Of Technology Correcting for aberrations in incoherent imaging systems using fourier ptychographic techniques
CN108027475A (en) * 2015-06-01 2018-05-11 光学技术注册协会莱布尼兹研究所 The improvement related with multimode fibre
CN105390066A (en) * 2015-12-02 2016-03-09 昆山龙腾光电有限公司 Display device
CN108780296A (en) * 2016-03-02 2018-11-09 视瑞尔技术公司 Lighting device
US10568507B2 (en) 2016-06-10 2020-02-25 California Institute Of Technology Pupil ptychography methods and systems
US11092795B2 (en) 2016-06-10 2021-08-17 California Institute Of Technology Systems and methods for coded-aperture-based correction of aberration obtained from Fourier ptychography
CN108398872B (en) * 2017-02-06 2019-08-27 京东方科技集团股份有限公司 A kind of holographic display device and its display methods, display device
US10754296B1 (en) 2017-02-06 2020-08-25 Boe Technology Group Co., Ltd. Holographic display and display method thereof and display device
CN108398872A (en) * 2017-02-06 2018-08-14 京东方科技集团股份有限公司 A kind of holographic display device and its display methods, display device
WO2018141152A1 (en) * 2017-02-06 2018-08-09 京东方科技集团股份有限公司 Holographic display device and display method thereof, and display apparatus
CN107015466B (en) * 2017-04-19 2019-07-19 电子科技大学 Optical scanner holography one-point positioning method based on TR-MUSIC algorithm
CN107015466A (en) * 2017-04-19 2017-08-04 电子科技大学 The holographic one-point positioning method of optical scanner based on TR MUSIC algorithms
US10754140B2 (en) 2017-11-03 2020-08-25 California Institute Of Technology Parallel imaging acquisition and restoration methods and systems
CN111176093A (en) * 2018-11-12 2020-05-19 杜尔利塔斯有限公司 Spatial light modulator for holographic projection
CN111176093B (en) * 2018-11-12 2022-02-11 杜尔利塔斯有限公司 Spatial light modulator for holographic projection
CN110476864A (en) * 2019-09-17 2019-11-22 广东工业大学 A kind of Intelligent fish tank system
CN113687586A (en) * 2021-07-23 2021-11-23 四川大学 Large-field-angle holographic display method for seamlessly splicing multi-segment cylindrical surfaces
CN115616790A (en) * 2022-12-20 2023-01-17 煤炭科学研究总院有限公司 Hologram display system based on volume holographic optical waveguide
CN116819909A (en) * 2023-08-31 2023-09-29 光科芯图(北京)科技有限公司 Data compression method, device, exposure equipment and storage medium
CN116819909B (en) * 2023-08-31 2023-11-17 光科芯图(北京)科技有限公司 Data compression method, device, exposure equipment and storage medium

Also Published As

Publication number Publication date
CN101743519B (en) 2013-04-24

Similar Documents

Publication Publication Date Title
CN101802726B (en) Holographic display with communications
CN101743519B (en) Holographic display
CN101802725B (en) Holographic display
US8218211B2 (en) Holographic display with a variable beam deflection
TWI564876B (en) The full-image display is reconstructed with all-dimensional images that produce a three-dimensional scene
TWI447540B (en) Holographic display with communications

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130424

Termination date: 20160516