CN101743519B - Holographic display - Google Patents

Holographic display Download PDF

Info

Publication number
CN101743519B
CN101743519B CN200880024344.9A CN200880024344A CN101743519B CN 101743519 B CN101743519 B CN 101743519B CN 200880024344 A CN200880024344 A CN 200880024344A CN 101743519 B CN101743519 B CN 101743519B
Authority
CN
China
Prior art keywords
holographic
display device
slm
hologram
circuit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN200880024344.9A
Other languages
Chinese (zh)
Other versions
CN101743519A (en
Inventor
伯·克罗尔
罗伯特·梅斯巴奇
亚历山大·史威特纳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SeeReal Technologies GmbH
Original Assignee
SeeReal Technologies GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from DE102007023740A external-priority patent/DE102007023740B4/en
Priority claimed from GB0709376A external-priority patent/GB0709376D0/en
Priority claimed from GB0709379A external-priority patent/GB0709379D0/en
Priority claimed from DE102007023737A external-priority patent/DE102007023737B4/en
Priority claimed from DE102007023739.3A external-priority patent/DE102007023739B4/en
Priority claimed from DE102007023785.7A external-priority patent/DE102007023785B4/en
Priority claimed from GBGB0718649.7A external-priority patent/GB0718649D0/en
Priority claimed from GB0718596A external-priority patent/GB0718596D0/en
Application filed by SeeReal Technologies GmbH filed Critical SeeReal Technologies GmbH
Publication of CN101743519A publication Critical patent/CN101743519A/en
Application granted granted Critical
Publication of CN101743519B publication Critical patent/CN101743519B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/08Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
    • G02B26/0875Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light by means of one or more refracting elements
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/02Details of features involved during the holographic process; Replication of holograms without interference recording
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2202Reconstruction geometries or arrangements
    • G03H1/2205Reconstruction geometries or arrangements using downstream optical component
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2294Addressing the hologram to an active spatial light modulator
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/08Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005Adaptation of holography to specific applications
    • G03H2001/0088Adaptation of holography to specific applications for video-holography, i.e. integrating hologram acquisition, transmission and display
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/02Details of features involved during the holographic process; Replication of holograms without interference recording
    • G03H2001/0208Individual components other than the hologram
    • G03H2001/0216Optical components
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/08Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0808Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
    • G03H2001/0833Look up table
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2202Reconstruction geometries or arrangements
    • G03H2001/2236Details of the viewing window
    • G03H2001/2242Multiple viewing windows
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2249Holobject properties
    • G03H2001/2263Multicoloured holobject
    • G03H2001/2271RGB holobject
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2210/00Object characteristics
    • G03H2210/303D object
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2210/00Object characteristics
    • G03H2210/303D object
    • G03H2210/36Occluded features resolved due to parallax selectivity
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2210/00Object characteristics
    • G03H2210/40Synthetic representation, i.e. digital or optical object decomposition
    • G03H2210/44Digital representation
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2222/00Light sources or light beam properties
    • G03H2222/20Coherence of the light source
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2222/00Light sources or light beam properties
    • G03H2222/20Coherence of the light source
    • G03H2222/22Spatial coherence
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2222/00Light sources or light beam properties
    • G03H2222/20Coherence of the light source
    • G03H2222/24Low coherence light normally not allowing valuable record or reconstruction
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2223/00Optical components
    • G03H2223/18Prism
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2223/00Optical components
    • G03H2223/19Microoptic array, e.g. lens array
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2225/00Active addressable light modulator
    • G03H2225/20Nature, e.g. e-beam addressed
    • G03H2225/22Electrically addressed SLM [EA-SLM]
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2225/00Active addressable light modulator
    • G03H2225/55Having optical element registered to each pixel
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2226/00Electro-optic or electronic components relating to digital holography
    • G03H2226/02Computing or processing means, e.g. digital signal processor [DSP]
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2226/00Electro-optic or electronic components relating to digital holography
    • G03H2226/04Transmission or communication means, e.g. internet protocol
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2226/00Electro-optic or electronic components relating to digital holography
    • G03H2226/05Means for tracking the observer
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2300/00Aspects of the constitution of display devices
    • G09G2300/02Composition of display devices
    • G09G2300/026Video wall, i.e. juxtaposition of a plurality of screens to create a display screen of bigger dimensions
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2300/00Aspects of the constitution of display devices
    • G09G2300/04Structural and physical details of display devices
    • G09G2300/0404Matrix technologies
    • G09G2300/0408Integration of the drivers onto the display substrate
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2300/00Aspects of the constitution of display devices
    • G09G2300/08Active matrix structure, i.e. with use of active elements, inclusive of non-linear two terminal elements, in the pixels together with light emitting or modulating elements
    • G09G2300/0809Several active elements per pixel in active matrix panels

Abstract

Disclosed is a holographic display including a spatial light modulator, and including a position detection and tracking system, such that a viewer's eye positions are tracked, with variable beam deflection to the viewer's eye positions being performed using a microprism array which enables controllable deflection of optical beams.

Description

Holographic display
Background of invention
1. technical field
The present invention relates to holographic display, particularly computing machine generating video holograms (Computer-Generated video Holograms, the CGHs) holographic display of encoding in spatial light modulator.This holographic display can the generating three-dimensional holographic reconstruction.
2. background technology
Computing machine generating video holograms (CGHs) is encoded in one or more spatial light modulators (SpatialLight Modulators, SLMs), and this SLMs can comprise electricity or light controllable.This unit is worth to come amplitude and/or the phase place of light modulated corresponding to the holography of video holograms by coding.Can for example calculate like this CGH: follow the trail of by coherent light, by the light of scene reflectivity and the interference between the reference light wave, perhaps pass through Fourier transform or Fresnel transform by simulation.Desirable SLM can represent any complex value number (complex-valued numbers), namely control respectively the complex value number of incident light wave amplitude and phase place.Yet typical SLM only controls a characteristic, or is amplitude, or is phase place, and the spinoff of not expecting that also affects another characteristic is arranged.The diverse ways that has light modulated amplitude or phase place, for example, Electrically addressed liquid crystal SLM (electrically addressedliquid crystal SLM), light addressing liquid crystal SLM (optically addressed liquid crystalSLM), magneto-optic SLM (magneto optical SLM), micro-mirror device (micro mirror device) or acousto-optic modulator (acousto-optic modulator).The modulation of light can be that the space is continuous or be comprised of independent addressable unit, is one dimension or that arrange, binary, multistage or continuous two-dimensionally.
In the present invention, term " coding " expression controlling value is offered spatial light modulator the zone with encoded holographic figure, in order to can rebuild from SLM the mode of 3D scene.
Different from pure autostereoscopic display apparatus (auto-stereoscopic displays), for video holograms, the observer sees the optics reconstruction that the light wave of three-dimensional scenic is front.Rebuild in the space that the 3D scene is extended between observer's eyes and spatial light modulator (SLM).Can also be with the video holograms SLM that encodes, so that the observer sees the object of the three-dimensional scenic of rebuilding previously at SLM and other on SLM or the object of back.
The unit of spatial light modulator is preferably the transmission units that light passes, and the light of this transmission units can be interfered at assigned position and above millimeter generation of coherent length number at least.This just allows holographic reconstruction to have enough resolution at one dimension at least.This light will be called as " fully coherent light ".
In order to ensure sufficient coherence, the spectrum of the light that is sent by light source must be limited in the enough narrow wavelength coverage, namely must be nearly monochromatic light.The spectral bandwidth of high brightness LED (LEDs) is enough narrow, can guarantee the temporal coherence of holographic reconstruction.Angle of diffraction and the wavelength of SLM are proportional, this means the clear reconstruction of only having monochromatic source can cause object point.The spectrum of widening will cause object point to broaden and object is rebuild fuzzy.The spectrum of LASER Light Source can be thought monochromatic.The line width of LED is enough narrow to help good reconstruction.
Spatial coherence is relevant with the horizontal expansion of light source.Conventional light source such as LEDs or cold-cathode fluorescence lamp (Cold Cathode Fluorescent Lamps, CCFLs), if they are luminous by enough narrow aperture, also can satisfy such needs.Can think in diffraction limit (diffraction limits) to send from pointolite from the light of LASER Light Source, and depend on the purity of model and cause the clear reconstruction of object, namely each object point is redeveloped into a point in diffraction limit.
From the light horizontal expansion in spatial incoherent light source, and cause that rebuilding object blurs.Fuzzy total amount is provided by the size that broadens of the object point of rebuilding at given position.In order to use the spatial incoherent light source for hologram reconstructing, find balance between must limiting in brightness with to the horizontal expansion of porose light source.Light source is less, and its spatial coherence is better.
If from observing with the rectangular position of the longitudinal extension of line source, then can regard line source as pointolite.Therefore light wave can upwards coherently be propagated the party, but irrelevant on all other directions.
Generally speaking, hologram passes through in the horizontal and vertical directions holographic ground of the coherent superposition re-construct of light wave.Such video holograms is called full parallax hologram (full-parallax hologram).Can watch in the horizontal and vertical directions the reconstruction object with motion parallax, just as material object.Yet, need on the horizontal and vertical direction of SLM, all have high resolving power with great visual angle.
Often reduce requirement to SLM by being restricted to the hologram of horizontal parallax (horizontal-parallax-only, HPO) only.Holographic reconstruction occurs over just on the horizontal direction, and does not have holographic reconstruction in vertical direction.This causes rebuilding object and has the tangential movement parallax.When vertical movement, skeleton view does not change.The resolution of the SLM that the HPO hologram needs in vertical direction is less than the resolution of the SLM of full parallax hologram needs.Only vertical parallax hologram (vertical-parallax-only, VPO) also may be arranged, but uncommon.Holographic reconstruction occurs over just on the vertical direction, and causes rebuilding object and have the vertical movement parallax.There is not in the horizontal direction motion parallax.The different skeleton views that are used for left eye and right eye must produce respectively.
The real-time calculating of hologram needs high calculated performance, in real time calculating can instant like this realization, for example, by means of having field programmable gate array (Field Programmable Gate Arrays, FPGAs), full custom ic (full custom ICs), or special IC (ApplicationSpecific Integrated Circuits, hardware costliness ASICs), special is realized, perhaps by use can parallel processing many central processing units (Central Processing Units, CPUs) realize.
In thin film transistor (TFT) (Thin Film Transistor, TFT) display device, the pel spacing on the orthogonal directions has determined the zone of each pixel.This zone is divided into transparency electrode, the TFT with electric capacity and the row and column wire for liquid crystal (LiquidCrystal, LC) control.Required frequency and display size on the column wire define required profile, and therefore also define the width of row and column wire.
Desirable holographic display needs higher resolution than the at present commercial available supervising device based on TFT.Resolution is higher, and pel spacing is less, and the frequency on the row and column wire is owing to more line number increases simultaneously.This so cause the size in the zone that covered by the row and column wire of whole pixel region, compare with the increase of resolution and superly increase pro rata.Therefore, the space that can be used for transparency electrode becomes still less, so that the transmittance of display device will reduce significantly.This means that the desirable high resolving power holographic display with high refresh rate only could produce under strict restriction.Because to the extreme requirement of calculated performance, no matter therefore use the hardware of which kind of specific type, the hardware that can be used at present in real time calculating of hologram is all very expensive.Because the data volume that relates to is huge, the transmission of the view data from the computing unit to the display device also is very difficult.
The common structure of active matrix liquid crystal display device will be briefly described with reference to prior art shown in Figure 10, and this Figure 10 takes from US6, and 153, No. 893 patent documents are here by with reference to quoting the full content of this patent document.As shown in figure 10, this active matrix display has slab construction, and this slab construction comprises main substrate 101, relative substrate 102 and the space 103 that main substrate is fixed to relative substrate, accommodates liquid crystal material between this two-layer substrate.In the peripheral driver section 107 that the surface of main substrate forms display part 106 and links to each other with display part 106, display part 106 is arranged for the switchgear 105 that drives pixel electrode 104 by pixel electrode 104 with matrix form and is formed.Switchgear 105 is comprised of thin film transistor (TFT).Thin film transistor (TFT) also forms as circuit component in periphery 107.
Describe the method that is used for the computing computer generating video holograms by No. 2006/066906 patent document of WO that the applicant submits to, quoted this document by reference here.According to the method, the object with complex amplitude of three-dimensional scenic is assigned to the matrix dot of parallel (parallel) virtual sectional layer, so that for each sectional layer, define the single body data set with amplitude discrete in the matrix dot, and be used for the holographic encoding of the spatial light modulator of hologram display device from the view data centralized calculation.
According to No. 2008/025839 patent publication of WO of applicant, quote this document by reference here, following steps are finished by area of computer aided:
-being the observer plane from each object data set of each chromatography scene section calculates diffraction image with the form of wave field Two dimensional Distribution independently, this observer's plane separation sectional layer limited distance also is parallel to sectional layer, wherein, be at least the wave field of shared virtual all sections of observer's window calculation, this virtual observer's window is arranged in the observer plane near observer's eyes, compare with video holograms, the area of described observer's window decreases;
-in the data centralization of quoting with respect to the observer plane, add and total wave field for observer's window is defined in the distribution that calculates of all sectional layers;
-transform to the hologram plane with reference to data set, this hologram plane separation reference planes limited distance also is parallel to reference planes, to create the hologram data collection of the total computer-generated hologram that is used for scene, wherein, spatial light modulator is arranged in the hologram plane, and coding is rear under the help of described spatial light modulator, re-construct in the space of observer's eyes front.
Method above-mentioned and display device are based on such idea, i.e. re-construct object itself not, but in one or more virtual observer's windows, rebuild the wavefront that is sent by object.
The observer can watch scene by virtual observer's window.Virtual observer's window covers the pupil of observer's eyes, and under the help of known position sensing and tracing system, virtual observer's window can be followed the trail of the physical location to the observer.Virtual, truncate capitiform is rebuild the space and is extended between the spatial light modulator of hologram display device and observer's window, and wherein, SLM represents the bottom of truncate capitiform, and observer's window represents the top of truncate capitiform.If observer's window is very little, frustum just is similar to pyramid.The observer sees through virtual observer's window and looks to display device, and receives the wavefront of expression scene at observer's window.Because necessary conversion enormous amount is so the holographic encoding process causes huge computation burden.Real-time coding will need expensive high performance computing unit.
No. 2008/025839 patent document of WO that the applicant submits to discloses a kind of permission from the method for the real-time generating video holograms of 3 d image data with depth information.This becomes possibility so that generate these holograms with relatively simple and cheap computing unit.
No. 2008/025839 patent document of WO that the applicant submits to discloses a kind of method for generating in real time the computing machine generating video holograms.Based on the view data with depth information, coding is used for the holography value that three-dimensional scenic presents, and presenting by the object point on the spatial light modulator SLM of this three-dimensional scenic makes up.Similar with prior art solution above-mentioned, disclosed method is based on such idea in No. 2008/025839 patent document of WO, i.e. re-construct object not itself, but in one or more virtual observer's windows, rebuild the wavefront that is sent by object.Generated the wave field of modulation from abundant coherent light by spatial light modulator SLM, this wave field is by the control of hologram value, and the real or virtual three-dimensional scenic that needs is rebuild in the interference of passing through in the space.Rebuilding generating virtual observer window in the space with SLM as the truncate capitiform of bottom.Window is arranged near observer's eyes place, and under the help of known position sensing and tracing system, window can be followed the trail of the physical location to the observer.Disclosed method is based on such fact in No. 2008/025839 patent document of WO, and namely the observer sees that the zone of scene is to rebuild the space by the truncate capitiform that extends to observer's window from SLM to define.Frustum can be similar to pyramid, because observer's window is little more many than SLM.In addition, the method is based on following principle, i.e. the reconstruction of single object point only needs subhologram as the subset of SLM.Therefore the information about each scene point can not be distributed in the whole hologram, but only is included in the specific limited area, i.e. so-called subhologram.According to this theory, the single object point of scene is only rebuild by the limited pixel region on the SLM (so-called subhologram).Disclosure in No. 2008/025839 patent document of WO is based on such idea, namely for each object point, can from question blank, obtain subhologram with respect to the distribution of the whole reconstruction of scene, and accumulate these subholograms, with total hologram of the reconstruction that is formed for whole scene.
According to the more preferred example of disclosed method in No. 2008/025839 patent document of WO, the view of scene is to be limited by each observer's position and view direction thereof.In the observer plane, each observer is assigned at least one near virtual observer's window of observer's eyes.In pre-treatment step, scene disperses three-dimensionally and is visible object point.These data may be obtained from interface.Disclosed treatment step is in No. 2008/025839 patent document of WO:
-step 1:
Be each object point, find out the position of subhologram: the scope of this position and corresponding subhologram is derived from the position of object point, i.e. the horizontal x of object point, y coordinate, and depth distance.
-step 2:
From question blank, obtain the distribution of corresponding subhologram.
-step 3:
All object points are repeated above-mentioned two steps, and wherein, the accumulation subhologram is with total hologram of the reconstruction that is formed for whole scene.
According to disclosed simple case in No. 2008/025839 patent document of WO, the size of distributing to the subhologram of object point is based on the cross spider principle and draws.The observer's window or its part that cover pupil project in the hologram plane through object point, namely project on the SLM.Determine thus the index of the pixel of the subhologram that this scene point of reconstruction is required.
According to disclosed content in No. 2008/025839 patent document of WO more on the one hand, subhologram or total hologram are applied additional calibration function, for example, the SLM error that causes for position or the shape that compensates by SLM is perhaps in order to improve reconstruction quality.For example, corrected value is added on the data value of subhologram and/or on the data value of total hologram.And, because being physical location by observer's window, each subhologram limits, thus can generate special question blank for more uncommon observer's windows, for example, if the observer looks to display device with wide-angle the position from the side.
As illustrated in No. 2008/025839 patent document of WO, preferably, can expand the principle of using question blank.For example, the supplemental characteristic for color and monochrome information can be stored in independently question blank.And the data value of subhologram and/or total hologram can be used for from the brightness of question blank and/or color value modulation.Based on the idea that primary colors can obtain from question blank separately, colour presents also therein.
In No. 2008/025839 patent document of WO disclosed method based on question blank, preferably generate according to No. 2006/066906 patent document of WO or No. 2006/066919 patent document of WO that the applicant submits to, here by with reference to quoting this two pieces of files.Question blank can be stored in the suitable data carrier and storage medium subsequently.
Figure 26 A has represented the general thought of the disclosure of No. 2008/025839 patent document of WO, and this patent document has single observer's example.The view of scene (S) is limited by observer's (O) position and view direction.In reference planes, distribute at least one near virtual observer's window (VOW) of observer's eyes to the observer.Generated the wave field of modulation from abundant coherent light by spatial light modulator (SLM), this wave field is controlled by the hologram value.The method and the display device that is derived from the method are based on such idea, i.e. re-construct object itself not, but the wavefront that reconstruction is sent by object in one or more virtual observer's windows (VOW).In Figure 26 A, object is represented by single object point (PP).Observer (O) can see scene (S) by virtual observer's window (VOW).Virtual observer's window (VOW) covers observer's (O) eye pupil, and under the help of known position sensing and tracing system, virtual observer's window (VOW) can be followed the trail of the physical location to the observer.Therefore controlling spatial light modulator (SLM) with the hologram value of video holograms can cause wave field, and this wave field is modulated in pixel and sent from display screen, to rebuild desired three-dimensional scenic by generating to interfere in rebuilding the space.Shown in Figure 26 A, according to the general principles of this embodiment, the single object point (PP) of scene (S) is only rebuild by the limited pixel region on the spatial light modulator (SLM) (so-called subhologram (SH)).Shown in Figure 26 A, according to the simplest solution, the size of subhologram (SH) defines based on the cross spider principle, draws subsequently accordingly the required pixel index of reconstruction for this object point (OP).The position of subhologram (SH) and scope are derived from the position of object point (PP), i.e. the horizontal x of object point, y coordinate and depth distance thereof or z distance.Subsequently, from question blank LUT, obtain the required hologram value of reconstruction this object point (PP).
Subhologram (SH) is modulated with brightness and/or color value, and is accumulated as the hologram plane in position separately subsequently, to form so-called total hologram.Generate in advance the data that comprise in the above-mentioned question blank.As above-cited prior art part, preferably come generated data with the method described in No. 2006/066906 patent document of WO, and store data in the suitable data carrier and storage medium.Under the help of the position of object point and attribute, calculate in advance corresponding subhologram, and generate thus question blank, color and brightness value and the correction parameter of subhologram.
Figure 26 B has shown this principle in more detail, and has represented to distribute to respectively the subhologram (SH1, SH2) of object point (P1, P2).Can find out in Figure 26 B, these subholograms are limited, and form the subset of little, contiguous total hologram, i.e. whole spatial light modulator (SLM).As shown in figure 26, except position and scope based on the definite subhologram of cross spider principle, further funtcional relationship also is possible.
3. description of Related Art
WO 2004/044659 (US2006/0055994) and US7315408B2 patent document by applicant's submission, describe a kind of device that passes through the mode reconstruction of three-dimensional scene of fully relevant diffraction of light, quoted the full content of these two pieces of files here by reference; Described device comprises pointolite or line source, is used for lens and the spatial light modulator of optically focused.Different from traditional holographic display, the SLM that is in transfer mode rebuilds 3D scene (referring to appendix I and the II discussion to this term and correlation technique) at least one " virtual observer's window ".Each virtual observer's window is positioned at the eyes place near the observer, and its size is restricted, so that virtual observer's window is arranged in the single order of diffraction, thereby make every eye rebuild the complete reconstruction of seeing three-dimensional scenic in the space at the truncate capitiform that extends between SLM surface and the virtual observer's window.For making holographic reconstruction interference-free, the size of virtual observer's window must not exceed all period interval of an order of diffraction of reconstruction.Yet it must be at least enough large so that the observer can see by window (s) reconstruction of whole 3D scene.The another eyes can be watched by identical virtual observer's window, and perhaps for it distributes second virtual observer's window, this second virtual observer's window is correspondingly created by secondary light source.Here, typical sizable visible area is limited in the local virtual observer's window that arranges.Known solution is rebuild the large tracts of land that the high resolving power by traditional SLM surface causes in small-sized mode, and it is reduced to the size of virtual observer's window.This causes such result: because the former thereby less angle of diffraction of geometry and the present resolution of SLMs in the situation that use rational, popular level calculation equipment, enough obtain high-quality holographic real-time and rebuild.
Disclose the mobile phone of generating three-dimensional image in the US2004/0223049 patent document, quoted the full content of this document here by reference.Yet its disclosed 3-D view is to use automatic stereo to show what (autostereoscopy) generated.Automatic stereo shows that a problem of the 3-D view that generates is: typically, the observer feels image in the display device the inside, and observer's eyes tend to focus on the surface of display device.In many cases, after a period of time, the inconsistent meeting between the three-dimensional plot the position of image that the position that observer's eyes focus on and observer feel causes the observer uncomfortable.In the situation that 3-D view is generated by holography (holography), this problem can not occur, and perhaps reduces significantly.
Summary of the invention
A kind of holographic display is provided, it comprises spatial light modulator (SLM), also comprise position sensing and tracing system, so that tracing study person's eye position, the microprism array that variable beam can be controlled beam deflection to the deflection of observer's eye position by usefulness is carried out.
Holographic display can be such device: in this device, and position sensing and tracing system tracing study person's eye position, the microprism array that variable beam can be controlled beam deflection to the deflection of observer's eye position by usefulness is carried out.
Holographic display can be such device: in this device, the deflection of variable beam is continuous variable.
Holographic display can be such device: in this device, the deflection of variable beam is carried out the moistening technology of electricity consumption.
Holographic display can be such device: in this device, the deflection of variable beam is to carry out with variable pressure reduction, and this variable pressure reduction is applied to and is positioned at each electric moistening cell array not on the Different electrodes of ipsilateral.
Holographic display can be such device: in this device, obtain two-dimensional deflection by the microprism array with two series connection.
Holographic display can be such device: in this device, prism is little liquid prism.
Holographic display can be such device: in this device, virtual observer's window (VOW) is arranged on the position of one or more observers' eyes.
Holographic display can be such device: in this device, the focusing instrument that is arranged in prism array front or back is assisted convergence of rays to VOW.
Holographic display can be such device: in this device, by the dynamic calibration to the coding of spatial light modulator, can reduce the optical effect of lens aberration.
Holographic display can be such device: in this device, prism not all has identical deflection angle.
Holographic display can be such device: in this device, prism not all has identical deflection angle, assembles a little at VOW so that penetrate the light of prism array.
Holographic display can be such device: in this device, prism angle calculate to be to carry out in the counting circuit on the substrate of SLM.
Holographic display can be such device: in this device, it is to carry out in the counting circuit on being arranged on the substrate of prism array that prism angle is calculated.
Holographic display can be such device: in this device, the substrate of SLM also is used as the substrate of prism array.
Holographic display can be such device: in this device, apply phase correction discontinuous with the caused phase place of compensating prism array.
Holographic display can be such device: in this device, phase correction is to be carried out by the operation of SLM.
Holographic display can be such device: in this device, hologram image generates in the projection type device, and wherein, projection comprises SLM is imaged onto on the prism array, and the reconstruction of desired 3D scene occurs in the front of VOW simultaneously.
Holographic display can be such device: in this device, when being imaged onto SLM on the prism array, for prism array provides phase compensation.
Holographic display can be such device: in this device, by being arranged on the additional SLM near prism array, for prism array provides phase compensation.
Holographic display can be such device: in this device, SLM is printing opacity, and prism array is reflective.
Holographic display can be such device: in this device, SLM is reflective, and prism array is printing opacity.
Holographic display can be such device: in this device, SLM is printing opacity, and prism array also is printing opacity.
A kind of method of holographic reconstruction of generating three-dimensional scene is provided, and this three-dimensional scenic is comprised of a plurality of discrete points, and the method is used according to holographic display of the present invention, and this display device is included as light source and the optical system of spatial light modulator illumination; The method comprising the steps of:
Encoded holographic figure on spatial light modulator.
Description of drawings
Fig. 1 is the data rate schematic diagram more much bigger than the data rate of original real space data of expression hologram.
Fig. 2 is with the structure of a prior art SLM part and Performance Characteristics and can carries out the schematic diagram that the part of the holographic SLM that calculates compares in the space of picture element matrix.
Fig. 3 is the structural representation of the part of SLM, and holographic calculating can be carried out in the space of picture element matrix among this SLM.
Fig. 4 is the schematic diagram of the part of SLM, for the demonstration of holographic data, can carry out decompress(ion) and calculate in the space of picture element matrix among this SLM.
Fig. 5 is the schematic diagram of the part of SLM, shows the demonstration of data among this SLM for traditional 2D, can carry out decompress(ion) and calculate in the space of picture element matrix.
Fig. 6 is the schematic diagram of expression TFTs manufacturing process.
Fig. 7 is the schematic diagram of expression TFTs manufacturing process.
Fig. 8 is the schematic diagram of rebuilding the method for hologram according to a kind of embodiment.
Fig. 9 is the schematic diagram of rebuilding the method for hologram according to a kind of embodiment.
Figure 10 is the skeleton view according to the general structure of traditional active matrix liquid crystal display device of prior art.
Figure 11 is the schematic diagram of installation step of active-matrix substrate of the holographic display of a kind of embodiment of expression.
Figure 12 is the schematic diagram of the expression further installation step of active-matrix substrate shown in Figure 11.
Figure 13 is the schematic diagram of the expression further installation step of active-matrix substrate shown in Figure 12.
Figure 14 is the schematic diagram that the holography that presents of the object point of discrete and optional position shows.
Figure 15 is in a kind of holographic display of embodiment, the schematic diagram of the functional unit that can implement in graphics calculations.
Figure 16 is the schematic diagram of the question blank that is used for subhologram SH that uses in a kind of holographic display of embodiment.
Figure 17 is the schematic diagram that is used for the attached processing unit of holographic conversion and coding in a kind of holographic display of embodiment.
Figure 18 is in the holographic display of a kind of embodiment of expression, if use subhologram, then because the quantity of unit tails off the schematic diagram that computation burden is less.
Figure 19 is expression t scene, the scene in the further t+1 moment and the schematic diagram of difference scene constantly.
Figure 20 is the schematic diagram of the holographic display with the transmission of addressable data of a kind of embodiment of expression.
Figure 21 is in a kind of holographic display of embodiment, and the schematic diagram of the part of spreadsheet calculates transistorized quantity in this spreadsheet.
Figure 22 is the schematic diagram of the remainder of spreadsheet shown in Figure 21.
Figure 23 is in the holographic display according to a kind of embodiment, the rough schematic view of cluster design.
Figure 24 is in the holographic display according to a kind of embodiment, shows the schematic diagram in the path that data are taked.
Figure 25 is the schematic diagram of the part of SLM, for showing traditional 2D demonstration data or the holographic display device that shows data, can carry out calculating in the space of picture element matrix among this SLM.
Figure 26 is according to prior art, generates the schematic diagram of the method for subhologram.
Figure 27 is according to a kind of embodiment, rebuilds the schematic diagram of the method for hologram.
Figure 28 is according to a kind of embodiment, the schematic diagram of panel tiling.
Figure 29 is and the schematic diagram that blocks relevant geometry consideration.
Figure 30 is and the schematic diagram that blocks relevant geometry consideration.
Figure 31 is according to a kind of embodiment, processes the schematic diagram of the method for eclipse phenomena.
Figure 32 is according to a kind of embodiment, processes the schematic diagram of the method for eclipse phenomena.
Figure 33 is in the holographic display according to a kind of embodiment, shows the schematic diagram in the path that data are taked.
Figure 34 is according to a kind of embodiment, follows the trail of the schematic diagram of one or more users' method by using controlled prism mobile virtual observer window.
Embodiment
A. the hologram display device of calculating at same substrate with pixel
A kind of embodiment comprises display device, and this display device receives the real space image data, such as the intensity map corresponding with 3-D view (intensity map) and depth map (depth map).Subsequently based on 3 d image data, in real time or the quasi real time holographic encoding of computer memory photomodulator.Holographic at least some that calculate can be carried out in the existing physical space of picture element matrix, by in conjunction with two functional units, be hologram computing unit and hologram display unit, on the function and space in the equipment of prior art, these two unit separate, in conjunction with afterwards to be formed on the sharing unit of implementing on the substrate.This means that the transistor that calculates at least some holograms can be integrated between the transistor of controlling for pixel, perhaps the next-door neighbour is used for the transistor of pixel control.Alternatively, all holograms calculate and can carry out in the existing physical space of picture element matrix, by in conjunction with two functional units, be hologram computing unit and hologram display unit, on the function and space in the equipment of prior art, these two unit separate, in conjunction with afterwards to be formed on the sharing unit of implementing on the substrate.Alternatively, being used for some or all of transistors that hologram calculates can be in the outside of picture element matrix, but with the transistor that is used for pixel control at same substrate.It will be apparent to those skilled in the art that term " on same substrate " and do not mean that transistor can only be on atomic level and substrate contacts, but mean that substrate provides the physical support that circuit is set medium generally.More information about the meaning of " substrate " can provide in the paragraph of " substrate " at title.
The calculating of other position hologram is not limited to the analysis hologram computing method described in the prior art in the picture element matrix or on the same substrate.The computing method of other type also are feasible such as question blank (LUT) method.Analysis calculation method can be used as the example of demonstration computing method.For the calculating of the hologram in the picture element matrix, holographic computing method can be identical on whole display device, and preferred outside the distance that is about the subhologram size exchange be used for adding data with subhologram.Subhologram is used for calculating.Can be on whole display device surface unfolding calculation equably.But for design, simulation and the checking that alleviates hardware, calculating can be divided into the little identical part that is called cluster, this cluster is tiled in the display device surface.Tiling not necessarily must be rectangle, also can be other structure, such as the hexagon (" honeycomb ") of tiling.Title " cluster " is used for the computing unit in cover part or whole hologram computational data path.Therefore, cluster can be the minimum unit that can calculate the hologram data that is used for the display device tiling from the part of original real space data.These clusters are swap data between adjacent unit preferably, so that when overlapping from the subhologram of adjacent unit, can accurate coding SLM.This as shown in figure 24.An advantage of cluster method is: after the design cluster, can successfully set up holographic the demonstration together by identical cluster is tiled.
Ideally, need very high resolution such as 16,000 * 12,000 pixel has the very hologram of high image quality with demonstration, shows that perhaps virtual observer's window is 1 centimetre or more centimetres wide but not the hologram of several mm wides, perhaps these two kinds of situations.The picture material that shows comprises intensity image and three-dimensional depth information (can be called " Z buffering "), and this picture material typically only has the nearly resolution of 2,000 * 1,500 pixels.As shown in Figure 1, the required data rate of display holography figure is much larger than showing the required data rate of raw data, and for example, for given example value, multiple is 48.In Fig. 1,3 d image data is that the form with intensity map and three dimensional depth figure provides.Preferably, should be each eye, be each virtual observer's window and make up a depth map and intensity map pairing.Each of these figure is by 2,000 * 1, and the data array of 500 pixels forms.In each figure, the data that are used for each pixel represent by three colors and a z value, i.e. 4 values, 8 of each values.The position is binary digit.Therefore each pixel needs 32.Speed with 25Hz or 25 frame per seconds (fps) provides video data.As shown in the figure, use two views (left eye and right eye), data transfer rate is per second 4.8Gbits.In simple example, these data are used for computed hologram on basis frame by frame, process and can carry out in more complicated example although relate to some data of successive frame, for example, in order to level and smooth noise or reduction artificial affecting, or reduce needed message transmission rate.Holographic calculating generates the data output corresponding with the data array of 16,000 * 12,000 pixel, and wherein, each pixel is by 8 bit representations, and frame rate is 150fps, uses simultaneously the video rate of 25Hz, two views and three kinds of colors.Therefore as shown in the figure, the data rate for hologram is per second 230Gbits.Content representation among Fig. 1 show the process of three primary colors red, green and blues.This example relates to the configuration of alone family, but corresponding multi-user's configuration with higher frame rate of display also is feasible.To those skilled in the art, many other examples of data rate will be apparent in the holographic display.
It is emphasized that for moving images, approximately the frame rate of 25Hz is minimum acceptable speed.Be higher than the playback that the frame rate of 25Hz should be more smooth.Frame rate is higher, and the observer is presented in playback will be more smooth.
Only can be to given display light wavelength computed hologram.Why Here it is carries out the reason of calculating for three times to each object point, is each and forms color, carries out once such as red, green and blue.Other color can assign to create by using these three kinds of color-set, and this blend of colors can realize in order or simultaneously.
If generate in the circuit of hologram on same substrate, as in picture element matrix, then only raw image data need to be sent to display device substrate.When hologram is to use in the situation of the circuit evolving in the picture element matrix, intensity and depth information are sent to will need them to be used for the position that hologram calculates subsequently in the panel.In a kind of preferred display device of embodiment, for the pixel value of computed hologram, only consider the value of the child partition of original image.A reason of doing like this is, in the preferred display device of this embodiment, is not fully relevant on whole display device for the light of rebuilding, but relevant in the child partition of display device, this child partition may be a very little child partition of display device.Do not exist relevant, the perhaps relevant limited range that exists only in from a child partition of display device to the different child partition of display device.Each child partition of preferred display device can be used for generating the corresponding subhologram of whole hologram.Therefore the size of subhologram defines the largest extension of pixel peripheral region, from this pixel, needs the intensity of original image and depth value to be used for the calculating of subhologram.Such as Fig. 3, this so that define the length of inner necessary wire (so-called " local interconnect (localinterconnections) ").Because, according to this solution, a large amount of pixel datas that generating hologram is required whole or at least some are to calculate in the zone that directly they will be shown on display panel, do not need or have reduced by long lead and transmitted the holographic needs that show data or intermediate storage of data.This can reduce the resolution of the data that will send to display panel, and can reduce the data rate that sends to display panel thus.If this example is applied in the situation shown in Figure 1, message transmission rate will obtain approximately 50 times reduction.Therefore, according to Fig. 3, will correspondingly reduce across the quantity of the row and column wire on whole panel (so-called " globally interconnected (global interconnections) ").Enough be used for wire that raw image data transmits than enough being used for wire that hologram data transmits still less, and can correspondingly reduce transmission frequency, also help extraly to reduce the power attenuation in the row and column driving.
Reduction data transmission frequency helps to reduce the power attenuation in the row and column driving.This is because from 0 to 1 conversion binary is digital, or opposite transition, all needs electric energy.When conversion ratio rose, power requirement also can rise.Energy finally dissipates with heat energy, and this can cause the temperature problem in the high data transmission frequency display device.Temperature problem can comprise splitting of the assembly heating can not be touched, thermic stress causes electronic package and inefficacy, unwanted chemical reaction such as electronic package oxidation, be exposed to the decline of the liquid crystal material quality that causes under the extreme temperature, and the raise heat that causes of the change of semiconductor material characteristic such as temperature is carried schizogenesis and is become (thermal carrier generation).When installing with powered battery, if from battery, draw more energy, battery is discharged faster, this can be reduced in the number of times that device can be used between the battery charging.
The major part of needed each elemental area of row and column wire can be used for other purpose now in the prior art solution.Fig. 2 has compared the principle of work of two kinds of solutions.In the solution based on prior art, consider the high resolving power holographic display with 16,000 * 12,000 pixel.In order to shorten rowaand column lines, for example as shown in figure 28, the display device tiling is 4 quadrants.Each quadrant has 8,000 column wires and 6,000 row wires.Altogether need 32,000 column wires and 24,000 row wires.For a user, has the frame rate of display that three kinds of composition colors (such as red, green, blue) and each two view (left and right) with 25fps video rate (frame rate-intensity of input data and z buffering) cause per second 150 width of cloth images.Multiply by line number and increase by the 10% blank transmission time for interframe, then need the row driving frequency of 1MHz.In the example according to a kind of solution of embodiment, view data is according to 2,000 * 1, and the real image pixel array of 500 pixels provides.If display device is 4 quadrants by tiling also, then each quadrant has 750 row wires.It is multiply by per second 150 width of cloth images and increase by the 20% blank transmission time for interframe, then only need the row driving frequency of 135kHz.This example relates to the configuration of alone family, but the multi-user's configuration that correspondingly has higher frame rate of display also is feasible.
Depend on panel and calculating parameter, the space of saving in the row and column wire can be omitted in the solution according to the embodiment of Fig. 2, when when comparing according to the solution of the prior art of Fig. 2, the space of this saving can be larger than being used for the needed space of circuit that hologram calculates, and therefore only needs the part in the space saved to be used for hologram and calculate employed transistor.In this case, the area of transparency electrode can be increased, and the transmittance of LCD can be improved thus.Because calculating is to realize in the pixel region of saving, so do not become redundant at the additional computing unit that can cause sizable difficulty and cost on the same substrate and in any known legacy equipment with display device.Another advantage is, greatly reduced the complicacy of panel control, and reason is basic identical for data rate and the traditional LC Ds of panel control.For exemplary 2, the resolution of 000 * 1,500 pixels, 25fps and every pixel have two views of 32, the data rate of 4.8Gbit/s with have 1, the data rate of the TFT panel of 920 * 1,600 pixels, 60Hz frame rate and three kinds of 8 colors is basic identical.This example relates to the configuration of alone family, but the multi-user's configuration that correspondingly has a higher frame rate of display also is feasible.This means with traditional display technique and just can control like a cork this panel, yet, the transmission with whole hologram of exemplary data transmission speed 230Gbits/s among Fig. 1 between computing unit and display device electron device and between display device electron device and the display device panel, be only feasible when only having the special solution of use, those skilled in the art should understand, use special solution to be difficult to carry out, and will be very expensive.
If we consider hologram two-dimensional encoded on the spatial light modulator, wherein original real space image has 2,000 * 1,500 pixels, and provide with the video frame rate of 25fps, then need haply approximately 100,000,000 transistors to be used for holographic calculating, i.e. about 34 transistors of each real space pixel.This is for the monocrystalline silicon circuit with 200MHz inversion frequency.Because the TFT that made by polysilicon can have the inversion frequency that only is about 25MHz, so approximately 6.9 hundred million transistors rather than 100,000,000 transistors are necessary, with the low slewing rate of compensate for slower.The hologram resolution of given 16,000 * 12,000 pixel this means approximately 4 transistors of each hologram pixel.Because when showing new images, the data that calculate only can the writing pixel unit in, so each pixel will need 1 or 2 transistor adding.When keeping identical resolution, the size of display device is larger, and pel spacing will be larger, and the transistorized quantity that therefore can additionally be arranged in around the pixel will be larger.In " transistor size estimation " part, can provide more detailed number of transistors purpose and estimate.
If by row and column wire control panel, then these wires should be wider, display device should be larger.This is because for fixing conductor material resistivity and long-pending for fixing conductive wire cross-section, the resistance of wire is directly proportional with its length; For fixing conductor material resistivity with for fixing conductor length and thickness, the resistance of wire and its width are inversely proportional to.This means, relative classical control technology, particularly relatively large high resolving power holographic display, the method for computed hologram is favourable in picture element matrix.
As the transistorized integrated huge advantage that has of TFT, the transistor AND gate pixel transistor that namely is used for calculating together is applied to substrate.
Only have when the transistorized quantity that increases may cause higher probability of malfunction, just can produce additional cost.This can be by remedying with the fault-tolerant calculation method, and wherein the mistake in each element only can cause the little deviation from result of calculation, if there is not assembly to have defective, then will obtain this deviation.
In Fig. 2 and Fig. 3, calculate in many contiguous computing units that are called cluster and carry out.Generally, the size of computing unit (cluster) is with optimised, because their size is larger, the saving in the message transmission rate will be less on the one hand, yet the realization of calculating on the other hand will be easier.
In a kind of further example of embodiment, display device be used for to show the hologram image data that calculate based on real space data such as intensity map and depth map data.The intrinsic problem of display device is in the prior art, the circuit that they need to not implemented at same substrate with the display device circuit.This additional circuit must be implemented at the substrate that separates with display device substrate.This can cause the characteristic do not expected, such as larger equipment volume and weight.The consumer constantly requires less, thinner or lighter display device.A kind of holographic display of embodiment has and the counting circuit of display device circuit on same substrate.This counting circuit can be between the pixel of display device, or can be outside but still on same substrate at the picture element matrix of display device.
Integrated explanation in liquid crystal on silicon (LCoS) display device
For little LCoS display device, situation is slightly different, and little LCoS display device is applicable to silicon single crystal wafer.For this display technique, higher frequency is feasible, so to be less than a transistor also will be enough even calculate each pixel for holography.In general, calculate identically with discrete calculation to a great extent, computing unit only can be interrupted by pixel cell.Because it is identical calculating required silicon area, so can obtain by this fact of data that only transmits or store lesser amt to save here.This has reduced the required area of row and column wire, helps data to the transmission of LCoS.Yet, counting circuit can with the display device circuit on same substrate, this counting circuit is not arranged in the display device circuit, compares at different substrates with the display device circuit from counting circuit, this solution will be compacter and more cheap.
The local forwarding
Owing to exist for the additional logic of the data that calculate being carried out local forwarding, so it can also be used in the lump to regional forwarding original image, so that overall row and column wire becomes fully unnecessary.For example, raw data is forwarded to cluster with shift register from cluster.Because row control realizes in this locality, the omission of row wire can also be so that the left and right writing information that is used on hand of display device.
The fault-tolerant calculation unit
For having resolution such as 1,600 * 1, the general T FT display device of 200 pixels may have foozle, because this manufacturing mistake of pixel error can become obvious.In holography, high-definition display device has the pixel of greater number, therefore has the TFTs of greater number, and this has greatly increased the possibility of pixel error.If for calculating integrated additional TFTs, error rate will rise again.Therefore, need a kind of computation process of design so that the error among the single fault TFTs can not propagated by whole display device, and only cause the local deviation little with ideal performance.
Some foozles may cause the sightless consequence of observer, perhaps only can be perceived slightly by human visual system.In this case, people may tolerate this defective.But the cluster that for example damages fully is flagrant, because in this case, many SLM unit has been subject to impact.
Redundant circuit such as TFTs, can be made in the space of picture element matrix, so that sort circuit can be used for some circuit of using when alternative starts, if find that device starts some circuit that use and breaks down.Device is self check every now and then, such as the indicating circuit fault whether of the converting characteristic by detecting a circuit.Faulty circuit can be recorded as in storer such as nonvolatile memory and can't use, and other circuit is recorded as in its position use.In " PhysicsToday (physics today) " the 38-42 page or leaf in January, 2000, report a kind of similar method for fault-tolerant traditional computer circuit in " Physicsand the Information Revolution (physics and information revolution) " literary composition of J.Birnbaum and R.S.Williams, quoted the document by reference here.Alternatively, this circuit can be designed to cause the likelihood of failure of permanent black picture element larger than the likelihood of failure that causes permanent bright pixels, because the observer more is difficult to accept the latter.
For the fault-tolerant design of optimum, the transistor of larger component size can be implemented in prior position in circuit, especially has the transistor of larger lateral dimension, to reduce the more possibility of pith fault of circuit.Further method is to mix to calculate pipeline, so that the distribution of results of defective unit is on larger surf zone.Be understandable that, for the value of calculation holographic pixel, can add approximately 1000 or larger value.If these values all come from same pipeline, then when this pipeline breaks down, the hologram pixel value will be full of prunes value.If cluster is comprised of parallel pipeline, inner cluster topology can arrange by this way, namely is used for the numerical value of addition to come from all parallel pipelines.If numerical value comes from for example 4 pipelines, then when a pipeline fault, only 25% of input value will be incorrect.In this case, the hologram pixel value that calculates will be more accurate than input value 100% incorrect situation.
" repairing subsequently " strategy can use in some cases.In this case, at the test phase identification trouble unit of display device, and come modification circuits by the relevant transmission line of physical break subsequently.This method can solve short circuit.Cut off to connect and to guarantee that most of fault pixels of not expecting (for example, high strength continues the pixel of flash of light) can be improved their blackening by simply they being turned off.
For the device according to embodiment, can be according to summary manufacture process given below, or their some combinations, or make according to apparent other manufacture process for a person skilled in the art.In the device of embodiment, organic semiconductor also can be used for making circuit.
B. the hologram display device of calculating at same substrate, this device can effectively calculate for the coding of spatial light modulator.
For being used in real time or the conversion of the three-dimensional content that presents of the large hologram (CGH) that the computing machine of the reconstruction that quasi real time changes generates, known method can only be paid great efforts and could realize aspect computational resource.In the prior art, name is called " method that is used for generating in real time the computing machine generating video holograms under the help of LUTs ", publication number is to have described a kind of improvement in the patent document of WO 2008/025839, and the interactive real time hologram with reconstruction object point of 1920 * 1080 can be with personal computer (PC) system on sale on the market, use the precomputation subhologram and real-time interactive ground demonstration under the help of question blank (LUTs).The characteristics of art methods are that object point only can be at the specific discrete position reconstruction, shown in circle open among Figure 14.The method of a kind of embodiment described herein has been walked around this restriction, and object point can generate the optional position in rebuilding frustum in the method, shown in circle closed among Figure 14.How the object point that Figure 14 has represented to use prior art LUT method to generate (circle) is distributed to the certain objects plane regularly.Object plane and then be arranged on from fixed range place, hologram plane.By contrast, according to a kind of analytical approach of embodiment, object point (circle of filling) can be at an arbitrary position.
The enforcement of part A can be implemented with the method that is used for computer memory photomodulator coding of prior art.Alternatively, the enforcement of part A can be implemented with the method that spatial light modulator is provided more efficient coding calculate.In publication number is the patent document of WO 2008/025839, a kind of more effective computing method have been described.Following more effective method is a kind of embodiment of applicant, and the method itself does not need the calculating of Fourier transform or Fresnel transform, therefore can effectively implement.Can also so say, following more effective method does not need the calculating of Fourier variation or the calculating of Fresnel transform.
For spatial light modulator provides the example of the method that more efficient coding calculates as follows.It is the method for an analysis, describe with reference to figure 8 and Fig. 9, be used for the generation of the computing machine generating video holograms of holographic display (HAE), this holographic display comprises spatial light modulator device (SLM1), wherein in one or more virtual observer's windows (VOW), rebuild the wavefront that is sent by object, and, the reconstruction of each single object point (OP) of three-dimensional scenic (3D-S) only needs subhologram (SH) as the subset of the whole hologram (H ∑ SLM) that will encode at SLM, it is characterized in that, with 3D scene (3D-S) discrete turn to a plurality of object points after, the method comprises following steps:
Each visible object point (OP) for the 3D scene
Steps A: for each object point (OP), determine the position of subhologram (SH).
For example, use the cross spider principle, wherein, by from the object point on hologram plane with virtual visibility region project to SLM originally with it.If enough degree of accuracy are arranged, subhologram just can be similar to/be modelled as rectangle.Distribute the therein local coordinate system system of the heart of initial point to subhologram; The x coordinate is horizontal ordinate, and the y coordinate is ordinate.Subhologram has half-breadth and is " a ", and half height is the size of " b ".
Step B: for each subhologram (SH) in hologram plane (HE), determine the subhologram of virtual lens (L).
B1: the focal length (f) of determining virtual lens.The focal length of lens (f) is with the orthogonal distance of the SLM of rebuilt object point (OP) in hologram plane (HE).
B2: the subhologram (SH of lens L) complex value:
Use formula z L=exp{-i*[(π/λ f) * (x 2+ y 2)] determine the complex value of subhologram, and wherein λ is that beche-de-mer without spike is examined wavelength, f is focal length.Shown in Fig. 9 A, the positive sign of f is corresponding to convex lens in the formula.As shown in figure 27, if SLM dorsad observer's a side rebuild object point (OP) with virtual divergent lens, then need the f of negative value.
B3: because z LWith respect to the symmetry of the positive negative value aspect of x and y, so use suitable symbol just to be enough in a quadrant, determine z LValue, and enough the result is transferred in other three quadrants.
Step C. determines the subhologram (SH of prism in the hologram plane (HE) P):
Because selected local coordinate system system, prism will cause phase shifts, and phase shifts is the linear function of x and y coordinate thus.
C1: the linear factor C that determines to have the prism (P) of level effect x, wherein, in the interval x ∈ [0, a], C x=M* (2 π/λ); M is prism absolute slope (Fig. 9 B).
C2: the linear factor C that determines to have the prism (P) of vertical effect y, wherein, in the interval y ∈ [0, b], C y=N* (2 π/λ); N is prism absolute slope (Fig. 9 C).
C3: prism subhologram (SH P) complex value:
Subhologram (SH is determined in stack by prism P) complex value, z wherein p=exp{i*[C x* (x-a)+C y* (y-b)] }.
C4: if light source is imaged onto VOW by holographic display, then can ignore prismatic correction.
Step D: the modulation of the subhologram of lens and the subhologram of prism:
Shown in Fig. 9 A, the complex value of combination subhologram is answered to take advantage of and is provided by the effect of virtual lens (L) and virtual prism (P), i.e. z SH=z L* z P, this formula can symbolically be expressed as SH=SH L* SH P
Step e: phase shifts
In order to obtain Uniform Illumination in visibility region, each subhologram (SH) is modulated with (homogeneous distributes) phase shifts, and wherein the phase shifts of each subhologram is not identical.This can reduce the speckle patterns from the light source with optical coherence.The size of phase shifts is enough to reduce speckle patterns, and can less than the π radian (that is, and needn't-π<Φ o<π, yet for example-π/4<Φ o<π/4).This process can be by z SH:=z SHExp (i Φ 0) represent, this formula can symbolically be expressed as SH:=SH exp (i Φ 0).
Step F: intensity modulated
The complex value of each subhologram uses respectively the intensity factor that obtains from frame buffer content (monochromatic or colored such as R, G, B) to modulate, so that object point presents they self brightness and color when appropriate.
z SH=C*z SH, this formula can symbolically be expressed as SH:=C*SH;
Step G: add with subhologram to form whole hologram H ∑ SLM
Subhologram can use the complex addition stack.According to the coordinate system that is used for complete hologram, whole hologram be the plural number of subhologram add and, by the H ∑ SLM=∑ SH iProvide, this formula can symbolically be expressed as Z SLM=∑ z SHi
In the example of some embodiments, above-mentioned steps C, D and E can omit separately or make up omission, wherein, for some benefits, as reducing the manufacturing cost of implementing the required hardware of said method, can and then reduce the quality of rated output or hologram.
Further note that, if the object point of rebuilding is thought of as the focus of optical system, this means in the hologram plane has lens, and this lens tilt also has focal distance f.The lens that tilt are comprised of non-inclination lens and prism.According to method herein, rebuild object point so that in subhologram coding lens function, if necessary, the prism function of also encoding (referring to Fig. 9 A).Can generate by the stack of subhologram the scene that is formed by a large amount of points.By the use of the method, the object point that is used for interactive holographic real-time reconstruction can use standard hardware components on sale on the market to generate in any position that rebuilds frustum.This solution can also easily be readjusted the quantity of object point.When the property enhancement of processing unit, can increase the quantity of object point.
Computation process may be summarized to be:
1. the calculating of lens
A. find out focal distance f
B. the use of lens equation: e^{-i*[(π/λ f) * (x 2+ y 2)]
2. the calculating of prism condition (depending on process optional)
A. determine Cx, Cy, a and b
B. equation: e^{i*[Cx* (x-a)+Cy* (y-b)] }
Cx=(2π/λ)*m
Cy=(2π/λ)*n
3. the modulation of prism and lens condition (depending on process optional)
4. the application of random phase (depending on process optional)
5. intensity modulated
6.SLM-the specific coding of hologram
C. carry out the hologram display device that decompress(ion) calculates at same substrate
A kind of embodiment comprises display device, and this display device receives the real space image data, such as the intensity map corresponding with 3-D view and depth map.Then based on 3 d image data, in real time or the quasi real time holographic encoding of computer memory photomodulator.All or at least some hologram demonstration is calculated and can be carried out in the existing physical space of picture element matrix, by making up two functional units, be that hologram shows computing unit and hologram display unit, on the function and space in prior-art devices, these two unit separates, and combination is rear to be formed on the sharing unit of implementing on the substrate.This means for all or at least some hologram to show that the transistor that calculates is integrated between the transistor of controlling for pixel, or the contiguous transistor that is used for pixel control.Alternatively, hologram show to calculate can be with implementing with the circuit of image element circuit on same substrate, but wherein, hologram shows that counting circuit is in the outside of image element circuit.
In this further example of a kind of embodiment, hologram calculates in such position and carries out, and this position is not in the occupied space of picture element matrix.Be that such calculating has advantages of local IP access question blank (LUTs) described in the patent document of WO2008/025839 such as publication number, it has increased the counting yield of calculating.As Fig. 1 clear and definite, the outside problem of carrying out the holographic method of calculating is in the space of display device pixel: for the pixel of display device, need very high total data transfer rate.If adopt method as shown in Figure 4, then can avoid this problem.
In display device, the hologram coded data is outside calculating the in the occupied space of picture element matrix.Carry out these calculating the space can, also can be not on the substrate identical with the substrate of display device.Use known data compression technique compression hologram coded data, then being transferred to is in the display device cluster of a whole display device part.In Fig. 4, be used for the data execution solution compression functions of TFTs to receiving by the row and column wire that hologram calculates.Yet data can also receive by alternate manner, and as by parallel data bus line, or serial data connects.Therefore, also allow based on the hologram display device of cluster one by one, this hologram display device has reduced the requirement that interconnects between the source of hologram display device pixel and image intensity figure, picture depth figure.So also be feasible, that is: hologram calculating and data compression can be carried out in the outside of display device substrate, data decompression is to use with the circuit of pixel on same substrate of display device to carry out simultaneously, but wherein, decompress(ion) is in the outside execution in the space of picture element matrix.For those skilled in the art, other example will be apparent.
D. carry out the high-definition display device that decompress(ion) calculates at same substrate
In a kind of further example of embodiment, high-definition display device is used for the display of high resolution images data, and these data can be to show normally data or can be based on intensity map and hologram that the depth map data calculate shows data.The intrinsic problem of the high-definition display device of prior art is: they need high-density circuit, and high-density circuit easily has foozle, and the high inversion frequency of they needs, and high inversion frequency can cause producing overheated problem.If adopt method as shown in Figure 5, then can reduce or avoid these problems.
In high-definition display device, view data is in the known data compression technique compression of the inner or outside use of display device, and then being transferred to is in the display device cluster of a whole display device part.Carry out space that compression calculates can, also can be not on the substrate identical with the substrate of display device.In Fig. 5, be used for the data execution solution compression functions of TFTs to receiving by the row and column wire that decompress(ion) calculates.Yet data can also receive by alternate manner, and as by parallel data bus line, or serial data connects.For minimum storage requirement, will need the 25Hz frame rate be used for the TFTs that decompress(ion) calculates, be used in 40ms or data that still less pixel by cluster shows in the time with decompress(ion).Therefore, also allow based on the image display device of cluster one by one, this image display device has reduced the requirement that interconnects between the source of image display and image intensity figure, picture depth figure.For those skilled in the art, other example will be apparent.
In preferred example, send the real space image data of compression to the cluster of display device.In first step, cluster is carried out decompress(ion) to the real space image data of compression.In second step, come calculation holographic to show data by the data that the cluster of display device produces with first step.For those skilled in the art, other example will be apparent.
E. the hologram display device of calculating at same substrate, by introducing the attached processing unit that is used for holographic conversion and coding, the 3D that this device has for the expansion of graphics subsystem plays up pipeline.
The enforcement of part A can be implemented with the method that is used for the space encoder photomodulator in the prior art.Alternatively, the enforcement of part A can be with spatial light modulator being provided the method for more efficient coding implement.Spatial light modulator is provided the example of method of more efficient coding as follows, but for those skilled in the art, many other examples will be apparent.
An example of the method as shown in figure 15, the 3D that the method has been expanded graphics subsystem by the attached processing unit that introduce to be used for holographic conversion and coding plays up pipeline.The method is applicant's a embodiment.Statement " attached processing unit that is used for holographic conversion and coding " will be substituted by term " holographic pipeline (holo-pipeline) " in the back.Holographic pipeline directly is arranged in the descending of 3D graphic pipeline.The 3D pipeline data that is used for each cluster is sent to the corresponding cluster of display device; Explanation from here on concentrates on single other embodiment of cluster level.Z figure buffering and color diagram buffering (color diagram R, color diagram G, color diagram B) form the interface between two pipelines.This is shown schematically among Figure 15.For each a single point in the pixel coordinate, Z figure comprises the z value, and this z value is bi-directional scaling, and it can represent with different definition grade (definition level).The Z value is convergent-divergent in the scope between 0.0 to 1.0 typically, but other scope also is feasible.The definition grade is determined by figure place, namely is generally 8,16 or 24.
In the Modern Graphic subsystem, color diagram is with 24 definition, and namely each color component is 8, R, G, B (red, green, blue).Color diagram forms the part of frame buffering, and the content of color diagram normally is presented on the screen.Definition contains two bufferings of Z figure and color diagram, is used for forming 3D and plays up interface between pipeline and the holographic pipeline.For a demonstration wavelength provides Z figure, but this is not the specific wavelength of R, G, B.The copy of Z Figure 150 1 and 1502 is provided for all the other two demonstration wavelength.
Only can be with given display light wavelength computed hologram.Why Here it is carries out the reason of calculating for three times for each object point, and namely each primary color red (λ R), green (λ G), blue (λ B) are respectively once.Can assign to create other color by utilizing these three kinds of color-set, and this blend of colors can realize in order or simultaneously.In order to improve processing speed, use at least two additional holographic pipelines, so that hologram calculates executed in parallel.The result of all three kinds of color component can obtain simultaneously like this.Because like this, the z diagram data need to be copied to additional memory portion 1501 and 1502 (referring to Figure 15), these two memory portion can independent access.Thereby prevent that the operation meeting that comprises memory portion such as z diagram data from hindering mutually.Therefore desirable memory portion should physically be separated.The color diagram RGB content that is used for color G and B also copies to respectively memory portion color diagram G and color diagram B separately, to guarantee the independent access (referring to Figure 15) to three kinds of color component.Again, memory portion can physically be separated, conflict when preventing memory access, and reduce or eliminate problems such as realization difficulty with the synchronization of access of semaphore, mutually exclusive algorithm (or " mutex (mutexes) "), these problems have adverse effect to system performance.However, although memory portion can be physically separated from each other, they still preferably are arranged in the same cluster of display device.It should be noted that semaphore is shielded variable (or abstract data type), and it has consisted of the classical way that is used in the multiprogramming environment limiting to shared resource (such as storer) access; Mutually exclusive algorithm is used in the concurrency programming and uses when avoiding common source, such as global variable, is used simultaneously by the multistage computer code that is called key component.
The below's hypothesis hologram is comprised of many subholograms.Wherein m subhologram represented by lens, scioptics function e^ (i C t* (x m 2+ y m 2)) describe.Constant C tThe focal distance f that comprises lens; The value of f was calculated before using the lens function, so that the value of f thereby can be used for all three pipelines.Therefore, the value of f is not that color is specific, because it is virtual lens, it does not need to demonstrate aberration.Can utilize the advantage of lens funtcional relationship, because lens are axisymmetric about himself x and y.In order intactly to describe lens, function only needs to be applied in the quadrant.The lens functional value that calculates in quadrant can be applied in other three quadrants by using the sign rule of symmetry subsequently.
C tAlso depend on wavelength X, this wavelength X is naturally not identical in three kinds of color R, G, B.Do not need to calculate the value of λ, because it is known, owing to using laser or the light source determined to be used for each wavelength; Yet, in order to calculate the C for each original display color t, the value of λ should can obtain (referring to Figure 15) in calculating.
Depend on employed technique, except the lens function, may also need to use prism function (referring to Figure 15), the direction of propagating to revise light.In the prism function, constant also comprises wavelength X.Because three kinds of primary colors have different wavelength, thus the value of this constant change so that for each of three holographic pipelines, the value of this constant has specific value.
As shown in figure 15, lens function and prism function are all taken advantage of at 1503,1504 and 1505 places now again.Subsequently, use random phase at 1506,1507 and 1508 places, this random phase adds on the result of multiplication of lens and prism function.The method is intended to avoid the brightness peak in the observer plane, or " spot ".Then modulate each hologram at 1509,1510,1511 places with the intensity of each color diagram.
In the next step, subhologram carries out complex addition to be formed for total hologram (referring to Figure 15) of cluster.Can obtain now the result for subsequent treatment, if applicable, then in the holographic display cluster, use additional algorithm, such as the application of correction chart or gray level image (gamma correction), this only is decided by the system property of SLM, so that they are preferably proofreaied and correct in this stage.Follow by cataloged procedure.
Hologram can be rebuild with colour.Depend on employed SLM, encryption algorithm (referring to Figure 15) changes larger, and it can be phase encoding, optical amplitude encoding or otherwise encode.
It will be recognized by those skilled in the art, some aspects of the embodiment that this part provides have more detailed open in other place of the application.
F. the hologram display device of calculating at same substrate has the mode of the 3D pipeline of the holographic graphics card that calculates pipeline by expansion, this device carries out sequenced holographic conversion to the point in the three dimensions
The enforcement of part A can be implemented with being used for carrying out the holographic method of calculating in the prior art.Alternatively, the enforcement of part A can be with implementing for carrying out the holographic method of calculating the time delay that reduction is provided.For the example of carrying out the holographic method of calculating the time delay that reduction is provided as follows, but to those skilled in the art, many other examples will be apparent.
The purpose of embodiment is for the hologram display device of calculating near pixel, to compare the minimizing time delay with other holographic calculating.This can cause the extension of framework, such as the extension of the framework of the graphics card (3D pipeline) of present use, by the additional hardware module that is used for holographic real-time conversion and coding.
Generally speaking, before carrying out holographic transformation calculations, whole three-dimensional scenic forms by realizing that many 3D conversion and illumination are calculated.The pel (such as point, line, triangle) that forms the object of scene will be processed at 3D the end pixels of pipeline.Whole result can obtain in two memory portion subsequently.These are frame buffering and Z buffering, can see from the observer position, and the frame buffering contains the color value (color diagram) of the scene of being seen by the observer, and Z cushions the depth map that contains the scene that convergent-divergent presents.In the method for prior art, only as result's (two memory portion) but whole times spent all just begin holographic conversion and cataloged procedure, because need to access this two memory portion to this.This causes the time delay of a frame of video.Such time delay is vital in some interactive application, as in game device.If time delay is long, the reaction time that can be used for player's operation will be too short, so that the player can not carry out the operation that some can be carried out originally.In playing fast, being no less than approximately in the 60Hz display device, be vital the time delay of the frame of 17ms.Because if be useful on the application of they (target group such as video gamer should be included), holographic display just can be accepted by market.
3D hologram is imaged in the Military Application may have advantage, if observe the enemy army, or out of Memory such as terrain information, three-dimensional can be improved the fight effectiveness that 2-D data shows.If use display device in the fight operation in Military Application, then above-mentioned time delay may cause attendant's killed or wounded, or the damage of expensive military equipment or destruction.Therefore, in Military Application, reduce the effectiveness that time delay can be improved the 3D hologram imaging.
In order to reduce time delay, do not need to wait until that whole colors and Z buffering figure are available.On the contrary, in case but a point in the space becomes the time spent by after the 3D line treatment, just can carry out immediately holographic calculating.Therefore, can find out that the 3D pipeline can expand by holographic pipeline.
Preferably should be no more than the 3D pipeline and calculate the 3D required time of some computing time that is used for holographic conversion and coding, because otherwise will generate further time lag.This theory is easy to realize on the subhologram basis, because in this case, only needs to process necessary information.In view of this, consider that the result can be 1000 times or more times the computation burden of adding if holographic conversion is the whole size that single 3D point is applied to hologram or SLM from the space.Then, with current can with computing hardware come real-time calculating will become infeasible.The theory of subhologram and related description thereof are as shown in Figure 8.Figure 18 has represented the preferred use of subhologram in a kind of example of embodiment.Because subhologram is less than SLM, so each subhologram can calculate quickly than the single hologram across whole SLM.In addition, subhologram can calculate in order, and like this, the situation than only carrying out after the whole frame that receives view data across the calculating of the hologram of whole SLM has greatly reduced time delay.When comparing two width of cloth Figure 18 A and 18B, can find if use subhologram, the computation burden that then is used for each object point of calculating is little a lot, because compare with whole SLM, the quantity of unit is still less in the subhologram.
In some examples of a kind of embodiment, be stored in the subhologram buffering from the subhologram (Figure 16) of the nearest point of observer.The 3D pipeline data that is used for each cluster sends to the corresponding cluster (Figure 17) of display device; Explanation from here on concentrates on single other embodiment of cluster level.To offer cluster as the input (Figure 17) of calculating about VOW size, VOW direction and its data from the distance of SLM.Each cluster of display device has its oneself question blank, is used for the coding of the subhologram of its demonstration of storage, and this subhologram can be one or more subholograms.If generate more close observer's new point, then will calculate corresponding to this point (SH n) subhologram (referring to Figure 17), that is, after the size of having determined subhologram, carry out holographic conversion.Subsequently, the content of the cluster of SLM can not be covered by subhologram simply, because the SLM unit may contain the information from a plurality of subholograms.Why Here it is is subhologram (SH at position xy place N-1) the reason of clauses and subclauses search inquiry table, these clauses and subclauses were also shown on the cluster of SLM at that time.After the content of having read from the SH of LUT, calculate (the SH of current demonstration N-1) and new SH (SH n) between poor (referring to Figure 17).
Subsequently will be in position xy place computer memory than previous more close observer's 3D point, in this case, with this SH nRather than old SH N-1Be written to LUT (referring to Figure 17).Now, differ from SH DWill with SLM in the value addition, and be stored in the frame buffering.Coding after this process, if possible, and correction (referring to Figure 17).
Display device (SLM) offers computing unit (referring to Figure 17) with its configuration information (such as typewriting resolution), and this fact means that any holographic display (SLM) will be feasible.The size of this device can be different, the number of unit or even the type of coding also can be different.Therefore, this solution is not subject to the SLM of particular type.
G. the hologram display device of calculating at a substrate, this device carries out randow addressing to holographic display
The enforcement of part A can be implemented with the holographic method of calculating of execution that is used for of prior art.Alternatively, the enforcement of part A can be with implementing for carrying out the holographic method of calculating the process that improvement is provided.For the example of carrying out the holographic method of calculating the process that improvement is provided as follows, but to those skilled in the art, many other examples will be apparent.
The purpose of embodiment is by utilize the characteristics of subhologram in application, to reduce the amount that is sent to the data of exposure module (being holographic display) from content generating module (such as graphics card).
In the prior art, the transmission of the view data of (such as LCD or cathode-ray tube (CRT) (CRT) display) from content generation unit (such as graphics card) to exposure module is so that the from top to bottom line by line output of the full content of image is identical with traditional tube display.For the high HDTV to 3840 * 2400 pixels of resolution (HDTV) (as at http://www.pcmag.com/article2/0,1895,2038797,00.asp IIIAMA of the IBM of middle description (RTM) Berta display → present etc.), this can not cause problem, transmits fast enough because needed data volume can be passed through standard interface (such as digital video interface (DVI) or high-definition media interface (HDMI)).
Yet desirable holographic display needs the pixel of greater number, with generating virtual observer window (VOW) in the observer plane, from the more original device wide approximately 5 millimeters different, this virtual observer's window is wide 1 centimetre or more.Large VOW is beneficial to very much, because it is larger, the reliability aspect will be more firm during the commercial use of holographic display.This is that the requirement to other assembly in the holographic display of tracking will be lower because in this case, and the holographic display of tracking for example is that tracing study person's eyes are with respect to tracing system or the position sensor of the position of display device.Alternatively, in the device of not implementing to follow the trail of, if increase the size of VOW, then can improve the tolerance to the little movement of observer's head.
The purpose of embodiment is to reduce the amount that is sent to the data of exposure module in the holographic display from content generating module, and in this holographic display, all or at least some holographic calculating occurs in the picture element matrix.
In the prior art data transfer procedure of describing, transmit all information in the above, comprised those information constant from a frame to next frame.Because hologram reconstruction point in three dimensions, so enough learn with respect to which point of former frame variation has occured.In subsequent process, only consider those points (referring to Figure 19).
Single object point is created by subhologram SH, and the Size-dependent of this object point is in observer's position.Because the SLM unit may not only contain the information of a subhologram, may also comprise the information of a plurality of subholograms, so the SH's of the new point in the SH that should calculate at the old point in position xyz place and same position xyz place is poor.In this example of a kind of embodiment, subsequently can be on SLM this difference subspace hologram of recompile SHD.
On basis frame by frame, be positioned at the inner or outside circuit kit of display device and receive the 3D rendering data, these 3D rendering data are comprised of color or intensity map and Z buffering.As shown in figure 20, calculate the poor of successive frame.And then, with the form of image difference data, send demonstration data after upgrading to the holographic converter unit of display device.As shown in figure 20, send with it to each holographic converter unit and be used for the relevant 3D difference dot image data of the reconstruction point of encoding at SLM.If for the successive frame at given cluster place, showing between the data does not have difference, or difference can ignore, and does not then need to send data to holographic converter unit, and this can improve effective SLM turnover rate of display system.The part that system generates SHDs can be called " content generating module ", and can be comprised of computing function and graphics card.Send subhologram with backward each cluster.The first task that cluster is carried out is to process the information that receives by the separation hologram data with about the size of SHDs and the data of position.The task of cluster comprises SHD is write in the suitable ram cell, so that SH shows with correct size exactly in suitable SLM position.
Except subhologram SH D(or optional, the SH of new frame) can also be limited to size and the position in the display device cluster thereof of subhologram in the pixel.In the holographic display cluster (for example as shown in figure 20) separation vessel is arranged, holography that this separation vessel will calculate shows that data are divided into subhologram data, size and positional information.Both values are intended to calculate the address realm of subhologram among the RAM afterwards, so that subhologram SH or SH DData be written in the SLM unit correct in the cluster.
Common SLMs is active matrix display device, and its unit should be constantly updated with drop-out not.If only fresh content is written among the SLM, then the information in other zone will be lost (for example, referring to Figure 19: 4 stains wherein will no longer show).For this reason, special random access memory (RAM) be can use in this case, that is: new SH or SH only write at input end DS, and read line by line whole storer at output terminal, and write information to SLM.For this purpose, can use to allow to carry out simultaneously aforesaid two-port RAM s or other storage system that reads with write operation.
In the content generation unit, will determine to transmit which point, namely depend on the variation in the 3D scene.Therefore, before sending data to holographic display, carry out the action of minimise data stream.Information can transmit with random order, because as mentioned above, subhologram is with additional information.This has different significantly from the line by line data transmission that manifesting of prior art carries out in the system.
Aspect the client, namely the decision that whether will transmit data described in the enforcement mode, before data transmit beginning, is made in the place of generating content.If content changes fully, as after interrupting or the situation about changing fully of the scene that will show, then should transmit the many subholograms corresponding with the 3D object point.Can say, typically, the resolution of SLM is higher, and it is larger that the transmission subhologram substitutes the advantage that transmits whole hologram.
H. the display device of computing function in pixel space
In a kind of further example of embodiment, display device is used for display image data, and this view data can be to show normally data, perhaps can be based on the hologram demonstration data that intensity map and depth map data calculate.The intrinsic problem of the display device of prior art is, the circuit that they need to not implemented at same substrate with the display device circuit.This additional circuit must be implemented at the substrate that separates mutually with display device substrate.This has caused the performance do not expected, such as larger equipment volume and weight.The consumer continues to require less, thinner or lighter display device.If adopt the method such as Figure 25, then can reduce these problems, such as larger equipment volume and weight.If computing unit is arranged on the pixel place near display device, then can reduce to show the delay of the arbitrary data that is used for demonstration that is calculated by computing unit.Delay behind this reducing helps the application such as the high speed game station, or helps the equipment for Military Application, and when being used for the equipment of Military Application, the equipment execution speed of improvement can bring military superiority.
In the display device of Figure 25, carry out computing function at display device cluster place, this display device cluster is arranged between the display pixel of display device, perhaps the display pixel of close display device.The space of execution computing function and the substrate of display device are on same substrate.In Figure 25, the TFTs that is used for calculating carries out computing function.To those skilled in the art, other example will be apparent.
I. block
In computer graphical, term " blocks " object that is used for the more close visual field of explanation covers (or blocking) further from the mode of the object in the visual field.At the graphic pipeline that is used for the 2D display device, before shadowed and rasterisation generation, implement a kind of hiding surface of blocking to remove.Here in the content of hologram, the enforcement of blocking comprises that the object point of guaranteeing more close virtual observer's window covers further from the object point of virtual observer's window along same sight line.
In Figure 29, provided the example that is used for the desired behavior of blocking of holographic display.In Figure 29, from shown in eye position, can not see the side that cube is thicker because it by cube that side of the most close observer block.If VOW is that several times of eye pupil are large, then the observer can see cube from different directions, in order to can see the side that cube is thicker.But for the simple embodiment that blocks, the side that cube is thicker will can not encoded at SLM, so even the observer changes direction of observation, the observer can not see the side that cube is thicker yet, because it is not encoded at SLM.
In Figure 30, the observer is from watching cube from directions different shown in Figure 29, in order to can see the side that cube is thicker.But for the simple embodiment that blocks, if do not implement to block for the situation of Figure 29, the side that then cube is thicker will can not encoded at SLM, so the observer among Figure 30 just can't see the thicker side of cube, because it is not encoded at SLM: in Figure 29, be not the thicker object point that stresses to build of cube, therefore, in Figure 30, just be not the thicker object point that stresses to build of cube.
A solution of problem shown in Figure 30 is that VOW is divided into two or more segments.Be that each VOW segment is rebuild object point subsequently.The size of each VOW segment is preferred and the oculopupillary size of people is roughly the same.
In Figure 31, the observer will see object point 1 from eye position 1, but can not see the object point 2 that blocks.From eye position 2, the observer will see object point 2, but can not see the object point 1 that can not see from that position and direction of observation.Therefore, from eye position 2, the observer can see the object point 2 that is blocked by object point 1 when seeing from eye position 1.Object point 1 and object point 2 are encoded respectively in subhologram 1 and subhologram 2.
Yet in Figure 32, the object point 1 of coincidence and object point 2 can be seen from eye position 1 and eye position 2, because they are encoded respectively in subhologram 1 and subhologram 2.
Alternatively, can in the stage that makes up depth map and intensity map, carry out and block.In this case, be preferably each eye (being each virtual observer's window) and make up a depth map and intensity map pair.
In the example of the embodiment that comprises here, blocking is that the calculating of using the circuit in the picture element matrix space to carry out is implemented.Sort circuit can comprise TFTs.Block and to use with picture element matrix on same substrate but realize in the performed calculating of the circuit of picture element matrix outside.
J. graphics card function
Graphics Processing Unit (Graphics Processing Unit) or GPU (sometimes are also referred to as VPU (Visual Processing Unit) or VPU) are dedicated graphics rendering apparatus for personal computer, workstation or game console.Modern GPUs is very effective aspect manipulation and Display control computer figure, and their high parallel organization makes them more effective than typical CPUs for the complex algorithm scope.
Modern Graphic processing unit (GPU) carries out the calculating relevant with the 3D computer graphical with their most of transistors.They are used at first accelerating texture and play up polygonal memory intensive work, have increased subsequently the unit and have calculated to accelerate how much, as the summit being converted into different coordinate systems.The nearest development of GPUs comprises the interpolation technique of support (the many identical operation that the enough CPUs of this programming tinter energy support comes control vertex and texture), over-sampling and reduction aliasing to tinter able to programme, and very high-precision color space.
Except 3D hardware, current GPUs comprises that also basic 2D accelerates and frame surge capability (usually having Video Graphics Array (Video Graphics Array, VGA) compatibility mode).In addition, most of GPUs of manufacturing support YUV color space and hardware overlapping (hardwareoverlays) (very important to digital video playback) from nineteen ninety-five, and many GPUs of manufacturing supported Motion Picture Experts Group's (MPEG) pel such as motion compensation and inverse discrete cosine transform (iDCT) from 2000.Nearest graphics card even at the card high definition video of decoding has been removed some burdens of CPU (central processing unit).The YUV Color space model is with the formal definition color space of a brightness and two chrominance components.The YUV color model is used in PAL, NTSC and the SECAM tertiary colour video standard.
Here in the context of hologram, the enforcement of graphics card function comprises the function of introducing above guaranteeing to implement when for the display device computed hologram, wherein, display device can be carried out all holographies and calculate in the picture element matrix space, perhaps carry out at least some holographic calculating in the picture element matrix space.For example, this many identical operation that comprises that enforcement can enough CPUs be supported comes painted, over-sampling and interpolation technique, the very use of high precision color space in order to reduce aliasing of control vertex and texture, to accelerate texture and to play up polygonal memory intensive work, in order to how much calculating accelerating to unite as the summit being converted to different coordinates, and carry out the calculating that comprises matrix and vector operations.For computed hologram, the structure of the highly-parallel of GPUs makes it more effective than typical CPUs for the complex algorithm scope.Alternatively, holographic display can be a device of not carrying out holographic calculating in the picture element matrix space.
Here in the context of hologram, the enforcement of graphics card function can comprise uses 3D to play up pipeline, and this 3D plays up pipeline and implemented by the TFTs in the picture element matrix space, perhaps outside by picture element matrix but implement with the TFTs of picture element matrix on same substrate.In other words, 3D plays up the function of pipeline, for example implements colouring function, and employed graphics card has been transferred to the TFTs that is arranged in the LC panel from prior art.
Alternatively, holographic display can be a device of not carrying out holographic calculating in the picture element matrix space.Also alternatively, holographic display can be one and not carry out the holographic device that calculates in the picture element matrix space, but holographic calculating can be with carrying out with the circuit of picture element matrix on same substrate.
K.2D-3D conversion
In an example of 2D-3D conversion, the first image and the second image that form a stereoscopic image send to display device, and all or at least some holographic calculating carried out in other position in pixel space or on the substrate of pixel.The 2D-3D conversion is calculated in the circuit that can occur in the picture element matrix space or other position on the substrate of pixel, perhaps can occur in the circuit that generation will send to the depth map of display device and color intensity figure, perhaps as those skilled in the clear, it can occur in the circuit of other position.The image of the second transmission can be two difference images (difference image) between the stereo-picture, because difference image will be typically than complete image needs data still less.If show carrying out 3 D video, then the first image self can be expressed as the difference image between the front image of present image and steps.Similarly, the second image can be expressed as the difference image between the image before present image and the steps.Display device can be used the calculation procedure for changing commonly known in the art subsequently between 2D and three-dimensional (3D) image, from the data that receive, and Two-dimensional (2D) image and corresponding depth map thereof.In the situation that coloured image needs trichromatic three component 2D images, and their corresponding depth maps.The data corresponding with 2D image and depth map just can be processed with the display holography image by device.Device is encoded holographic figure in its SLM.In order effectively to use transmission bandwidth, the corresponding decompress(ion) that the data of transmitting may be accepted known compression step and carry out in display device in this system.
The circuit of carrying out the 2D-3D conversion can Internet access contains the data bank of the known 3D shape of a cover, the 3D Data Matching that this data bank can manage to calculate with it, perhaps it can contain a data bank of overlapping known 2D sectional view by Internet access, the 2D view data coupling that this data bank can be managed and be imported into.If can find good coupling for known shape, this just can the speed-up computation process, because 2D or 3D rendering can be expressed with respect to known shape subsequently.The data bank of 3D shape can be provided, the 3D shape is such as the shape of one group of sports star such as the most successful tennis player or the athletic face of Association football or health, and all or part of shape of topmost athletic ground such as famous tennis court or famous association football pitch.For example, the 3D rendering of people's face can be expressed as the image of display device Internet access, adds the variation of facial expression, for example can be to smile or frown, some of adding hair lengths change, because for example since obtain the data of storing, hair is may be elongated or cut.If the variation that continues has occured, so that clearly illustrate that the data of device Internet access are expired, such as hair lengths significantly change on long-time basis of people, then the data of display device Internet access can be upgraded by display device.If counting circuit runs into a 2D or 3D rendering, when can not find good coupling for this 2D or 3D rendering counting circuit in the record of its Internet access, it can the shape that this is new join in the record set.
The 2D-3D image transitions can also be based on single, non-three-dimensional 2D image, and carries out be used to the step of carrying out this conversion with as known in the art.3D rendering data (depth map and color diagram) can send to the display device of calculating and showing for hologram image subsequently.
Above-mentioned 2D-3D conversion can be for the data that are used for showing at holographic display, in this holographic display, all holographies are calculated in the circuit that occurs in the picture element matrix space, perhaps at least some holographic calculating in the circuit that occurs in the picture element matrix space perhaps occur in other locational circuit of pixel substrate.
L. meeting (3D Skype TM)
From the E3660065 of European Community trademark application, Skype TMBecause of following well-known: the networking telephone (VOIP) point-to-point communication, file-sharing and instant messages service based on global network are provided; Communication service, file-sharing and instant messages service based on computer network are provided.
From the E4521084 of European Community trademark application, Skype TMBecause of following well-known: for other people provide Computer Service and software development, that is, and the computer software that uses during Telecommunications ﹠ Networking phone (VOIP) is used and design, data transmission and the instant messages service of hardware; For other people create and maintaining web; On computer server trustship other people be used for the website of global computer network; The installation and maintenance of computer software; The Interim use that allows the user to use online, the computer software that can not download of VOIP communication service is provided; The online software that other people download that is used for that allows the user to use the VOIP communication service is provided.
From No. 2358090 trade marks of Britain, Skype TMBecause of following well-known: access to the Internet, entrance and cache service are provided; Telecommunications and telecommunications service; Internet Protocol (" IP ") service; The networking telephone (" VoIP ") service; Email and Internet traffic service; Via third-party telecommunications service; Internet Protocol (" IP ") to digit phone number and digit phone number to " IP " mapped system and database; Domain name and dns database system; The lease of the access time of the Computer Database that the ISP is provided.
Except Skype TMProvide that VOIP's is the sort of, top any one can provide with holographic display, this holographic display can be carried out all holographies with the circuit in the picture element matrix space and calculate, perhaps carry out at least some holographic calculating with the circuit in the picture element matrix space, voice and hologram image (Voice and Holographic ImageOver Internet Protocol, VHIOIP) based on Internet Protocol are provided here.In one case, above-described process is carried out by the TFTs in the LC-panel.Alternatively, except Skype TMThe the sort of of VOIP is provided, and above-mentioned any one can provide with carrying out the holographic holographic display that calculates in the circuit in the picture element matrix space not, and voice and hologram image (VHIOIP) based on Internet Protocol are provided here.Also alternatively, except Skype TMProvide that VOIP's is the sort of, top any one can provide with do not carry out the holographic holographic display that calculates in the picture element matrix space, this holographic display is to use with the circuit of picture element matrix on same substrate to carry out holographic calculating, and voice and hologram image (VHIOIP) based on Internet Protocol are provided here.Also alternatively, except Skype TMThe the sort of of VOIP is provided, and top any one can provide with any holographic display, and voice and hologram image (VHIOIP) based on Internet Protocol are provided here.
Alternatively, except Skype TMThe the sort of of VOIP is provided, above any one can provide with do not carry out the holographic holographic display that calculates in the picture element matrix space, voice and hologram image (VHIOIP) based on Internet Protocol are provided here.
In above-mentioned, VHIOIP can provide with the form based on the voice and video hologram image (voice and video holographic image over internet protocol, VVHIOIP) of Internet Protocol.VHIOIP or WHIOIP can provide in real time or quasi real time, and these Internet Protocols can make, and video is holographic in real time or quasi real time between two people that all use separately holographic display communicates by letter.
M. coding compensation.
In the traditional photography art, exposure compensating is a kind of technology that exposure levels antagonism calculating or plan may cause the other factors of the image of not being satisfied with most that compensates.These factors may comprise variation, filter and the non-standard processing in the camera system, or the under-exposure that is intended to reach or over-exposed.Photographer can also be for the change using exposure compensation of the shutter angle in the other factors or film speed.In photography, some cameras comprise this as feature to allow the user to adjust the exposure of automatic calculating.Can forward (increasing exposure) and negative sense (reducing exposure) apply compensation by level, usually increment 1/3rd or half f-stop (f-stop) on each direction, maximum usually two or three apertures (stop).
In optics, the diameter of the f-number of optical system (f-number) expression entrance pupil from effective focusing length aspect of prism.On camera, f-number with the discrete stages adjustment, is called f-stop usually.Each " aperture " is marked with its corresponding f-number, and representative reducing by half from last aperture light intensity.This doubly reduces with 2 subduplicate factor corresponding to pupil and diaphragm diameter (aperture diameters), and therefore reducing by half corresponding to pupil area.
When the user knows the exposure that the automatic exposure calculating of camera can cause not expecting, the using exposure compensation.Thin shade accounts for leading scene often can be under-exposed, and the scene of low key tone can be over-exposed.Experienced photographer can know when this can occur in, and uses how many compensation to obtain the photo of perfect exposure.
Above-mentioned any one can provide with holographic display, and this holographic display is being carried out all holographic calculating with the same substrate of picture element matrix, perhaps carrying out at least some holographic calculating with picture element matrix at same substrate.Above-mentioned any one can provide with holographic display, and this holographic display is perhaps carried out at least some holographic calculating carrying out all holographic calculating with picture element matrix at same substrate in the picture element matrix space.Alternatively, above-mentioned any one can provide with any holographic display.In coding step or before, can apply compensation to the hologram image data, so that the image of more easily watching to be provided, namely typical observer can find the exactly exposure of this image, has not both had under-exposure, does not also have over-exposed.
N. eyes are followed the trail of
For one or more observer, holographic apparatus can use eyes to follow the trail of.When the size of the watch window that is used for each eye hour, for example only several millimeters the time, this is particularly advantageous to horizontal length.Preferred use location detector is followed the trail of user's eyes with following several steps:
1) limits the hunting zone by the face of surveying the user
2) limit tracking range by surveying eyes
3) follow the trail of eyes
Provide by the stereo-picture of stereoscopic camera supply pair to computing module that be used for to carry out the eye position recognition function.After the algorithm that has used module, module is returned each eye with respect to x-, y-and the z-coordinate of point of fixity (such as the center of SLM).This coordinate can be transmitted by for example serial line interface.Can be carried out by circuit for carrying out the required calculating of this process, be arranged on TFTs on the same substrate such as the pixel with display device, comprise the circuit that is arranged in the picture element matrix.
For tracing study person's eyes, the holographic encoding on SLM can be arranged in x-and/or the y-direction, namely in panel plane.Depend on the type (such as the ID coding) of employed holographic encoding method, preferably, follow the trail of and realize by the SLM that whole holographic encoding content is displaced in x-or the y-direction at the eyes of a horizontal direction.Before the holographic encoding of SLM, computing module calculation holographic data in x-or y-direction with respect to the skew of SLM.As input, provide x, y and the z-coordinate of observer's eyes.
For tracing study person's eyes, the holographic encoding on the SLM panel can in x-and/or y-direction, namely be shifted in the plane of panel.Follow the trail of and to realize so that the light source of the SLM that coherently throws light on and observer's change in location synchronizing moving like this.Mobile luminous light source is perhaps by the pointolite of illumination of incoherent light or have in the line source of narrow opening very and generate coherent light.Pass that the light of this opening is considered to be concerned with.If light source is created by the pixel of LC-display device, then they are addressable, and can adapt in real time observer's position.
O. aberration correction
In the holographic display of some types, aberration correction is the correction of aberration that the lens of carrying out Fourier transform in microlens array or the 2D lens arra are caused.The aberration effect depends on light to the direction of observer's propagation and the angle between the optical axis, and can dynamically proofread and correct by the coding of spatial light modulator.Correcting algorithm can walk abreast, carry out independently, and it is independent of holographic calculating until generate the step of total hologram.After this step, can modulate together total hologram and aberration correction figure.
The aberration correction algorithm can be realized with analyzing, perhaps also can use question blank (LUT) to realize.Preferably, only after total hologram can be used, modulate the hologram calculated value that obtains by complex multiplication.Provided the example of a kind of embodiment of aberration correction among Figure 33.In Figure 33, aberration correction is to implement with the circuit in the picture element matrix space.Yet in other cases, aberration correction also can be used in the picture element matrix outside but implement with the circuit of picture element matrix on same substrate.
P. spot is proofreaied and correct
In the holographic display of some types, it is reducing or eliminating of spot that the largely optical coherence between the zones of different on the display device is caused that spot is proofreaied and correct.Mottled effect can dynamically be proofreaied and correct by the coding of spatial light modulator.Correcting algorithm can walk abreast, carry out independently, and it is independent of holographic calculating until generate the step of total hologram.After this step, can modulate together total hologram and spot correction chart.
The spot correcting algorithm can be realized with resolving, perhaps also can use question blank (LUT) to realize.Preferably, only after total hologram can be used, modulate the hologram calculated value that obtains by complex multiplication.Provided the example of a kind of embodiment of spot correction among Figure 33.In Figure 33, it is to use the circuit in the picture element matrix space to realize that spot is proofreaied and correct.Yet the spot correction also can be used in the picture element matrix outside but implement with the circuit of picture element matrix on same substrate.
Q. be used for the deciphering of the digital copyright management (DRM) of holographic display
The content-data that offers holographic display may be subjected to the protection of DRM, and namely display device receives the content-data after encrypting.HDCP (High-bandwidth DigitalContent Protection, HDCP) is the common standard that the 2D display device realizes DRM.HDMI (High Definition Multimedia Interface) (High-Definition Multimedia Interface, HDMI) receiver with HDCP deciphering is arranged on the printed circuit board (PCB) (PCB) of 2D display device electron device usually.The transmission that a basic shortcoming of legacy system is the view data from the display device electron device to panel is normally after deciphering.Therefore, might be by catching data after the deciphering so that electronics is connected to for the data transmission circuit of panel.
In a kind of example of embodiment, it is to carry out with the circuit in the picture element matrix that deciphering and hologram calculate.In a kind of further example of embodiment, it is to use the distributed execution of circuit that is distributed in the picture element matrix that deciphering and hologram calculate.Therefore, just do not have on the panel single position can catch all the deciphering after data.If different decruption keys is used in the different zone of counter plate, then the extraction of decruption key will become more difficult.Because on panel, therefrom do not extract the connector of decruption key, must know circuit diagram so avoid the idea of DRM, and a plurality of TFT transistors must be connected in the display device that extensively separately distributes at work to read the data after the deciphering.This helps to improve the protection of DRM.
A kind of further example of embodiment is that deciphering and hologram calculating are to use the circuit on the substrate of picture element matrix to carry out, and comprises that circuit is in the situation of picture element matrix outside.A kind of further example of embodiment is that deciphering and hologram calculate to be that use is distributed in the distributed execution of circuit on the picture element matrix substrate, comprises that circuit is in the situation of picture element matrix outside.
R. be used for the deciphering of the digital copyright management (DRM) of 2D display device
The content-data that offers the 2D display device may be subjected to the protection of DRM, and namely display device receives the content-data after encrypting.HDCP (HDCP) is the common standard that the 2D display device realizes DRM.HDMI (High Definition Multimedia Interface) (HDMI) receiver with HDCP deciphering is arranged on the printed circuit board (PCB) (PCB) of 2D display device electron device usually.The transmission that a basic shortcoming of legacy system is the view data from the display device electron device to panel is normally after deciphering.Therefore, might be by catching data after the deciphering so that electronics is connected to for the data transmission circuit of panel.
In a kind of example of embodiment, deciphering is to use the distributed execution of circuit be distributed on the SLM panel.Therefore, just do not have on the panel single position can catch all the deciphering after data.If different decruption keys is used in the different zone of counter plate, then the extraction of decruption key will become more difficult.Because on panel, therefrom do not extract the connector of decruption key, must know circuit diagram so avoid the idea of DRM, and a plurality of TFT transistors must be connected in the display device that extensively separately distributes at work to read the data after the deciphering.This helps to improve the protection of DRM.
In a kind of further example of embodiment, existing deciphering to calculate is the 2D display device of using the circuit in the single zone of display device substrate to carry out, and this circuit can be positioned at picture element matrix inside or picture element matrix is outside.Sort circuit more is difficult to access than the circuit on the PCB of display device.This helps to improve the protection of DRM.
S. the software application of in the hardware that firmly is connected to display device, implementing
Many computer softwares can use computer hardware to implement independently in principle.In a kind of example of embodiment, can in hardware, implement with the circuit on the substrate that is distributed in the SLM panel on the contrary with the application of implement software.Circuit can be in picture element matrix, perhaps it can with picture element matrix on same substrate but outside at picture element matrix.The SLM panel can be for holographic display, or is used for the 2D display device.
T. the variable beam deflection of implementing with microprism
For holographic display, eye position that can tracing study person is carried out variable beam deflection towards observer's eye position with the microprism array that can control beam deflection.Controlled deflection can be continuous variable.Tracking is carried out by position sensing and tracing system.The attribute of prism can be controlled by this way, i.e. their one dimensions or make two-dimensionally light deflection.Can obtain two-dimensional deflection by the microprism array that uses two series connection, for example, the longitudinal axis of the prism in array is arranged on significant angle, 90 ° according to appointment with respect to the longitudinal axis of the prism in another array.At for example US4, in 542, No. 449 patent documents such geometric configuration has been described, be used for different application, quote this document by reference here.Figure 34 has shown the attribute deflection that the depends on prism light of smaller or greater angle.Prism can be little liquid prism [for example, optics letter (Optics Express) 14 phases, 6557-6563 (2006) page or leaf, described in the people such as Heikenfeld " the flexibly wide-angle beam with electric moistening microprism turns to (Agile wide-angle beam steering with electrowetting microprisms) ", here quote this document by reference], for little liquid prism, deflection angle can change according to the electric charge that applies or other the known prism array that can control beam deflection.
As seeing among Figure 34, pass the parallel light of SLM and prism mask according to the attribute deflection of prism.The benefit of this process is can reduce optical effect such as lens aberration before light passes prism.This method is applicable to VOWs is arranged on observer's eyes place.In optional example, the focalizer such as the fourier transform lens array that are arranged on prism array front or back will help convergence of rays in VOW.
When the observer changes its position, can correspondingly adjust the deflection angle of prism, as by being adjusted at the voltage that applies on little liquid prism array.Deflection angle can be continuous variable.Prism does not need all have identical deflection angle.In addition, also might control separately each prism, so that each has different deflection angles, for example being used for Z follows the trail of, that is: the light that penetrates prism array is assembled a little at the VOW place, because when the observer moves to more close display device or during further from display device, VOW may change from the distance of display device.
Prism angle is calculated and can be considered that the user position carries out.Prism angle is calculated and can be carried out at the counting circuit that is arranged on the substrate of SLM, as rebuilding the circuit of object point, perhaps carries out with the counting circuit on the substrate that is positioned at prism array.If the substrate of SLM can also be used as the substrate for prism array, then do not need the independently substrate for prism array.
Communication interface between position sensor and the SLM is necessary: for example, it can be serial line interface.
If the counting circuit that be used for to calculate the prism array deflection angle is at the substrate of prism array, but on the substrate of SLM, then to connect be necessary to the data between two substrates, so that the electrode of prism array can be controlled with the result who calculates.
Except the calculating that is used for the control prism, also need to apply the phase place " (jumps) jumps " (or phase place is discontinuous) that phase correction is brought by prism array with compensation.Otherwise, prism array will turn round as blazed grating (blazed grating), the part of namely passing the wavefront of different prisms has the different optical path length towards VOW, therefore, they will turn round as grating, and the variable effect of prism angle is distributed to the amount of the energy of different diffraction level simultaneously.This phase correction can be by SLM additional execution outside its hologram encoding function.Pass the light of two assemblies (being prism array and SLM), process is by the complex multiplication of the function of each assembly.Phase diagram after the correction comprises the needed phase correction of microprism array: hologram is encoded with the value that represents the SLM location mode of rebuilding object point, and this value comprises the phase correction condition.
Above-mentionedly can also be applied to this situation: hologram image generates in the projection type device, wherein projection comprises SLM is imaged onto on the prism array, the reconstruction of desired 3D scene occurs in the front of VOW simultaneously, and therefore creating projection arrangement is equivalent to technology well known in the art.It should be appreciated by those skilled in the art that needed calculating and device and above-described similar.Need to calculate be used for the deflection angle of prism array prism, and be used for accordingly the discontinuous phase compensation of phase calibration.The phase compensation that is used for prism array can provide when being imaged onto SLM on the prism array, is perhaps provided separately by the additional SLM that is arranged near prism array.It should be appreciated by those skilled in the art that prism array can be reflective when SLM can be printing opacity in order to strengthen projection, prism array was printing opacity when perhaps SLM can be reflective.
Little liquid prism is in file such as optics letter (Optics Express) 14 phases, 6557-6563 (2006) page or leaf, be described in the people such as Heikenfeld " the flexibly wide-angle beam with electric moistening microprism turns to (Agile wide-angle beam steering with electrowetting microprisms) ", quote this document by reference here.This technology is called " electricity moistening (electrowetting) " or " electronics moistening (e-wetting) ".In this technology, contact angle by the interface formation between transparent conductive liquid and the other fluid (such as air) is the function of voltage difference, this other fluid has the electrode of the hydrophobic insulator of scribbling, and this voltage difference is applied on the electrode with respect to transparent conductive liquid.When light beam passes the unit, the independent control that is applied to two voltages on the electrode allows the control of the angle that light beam turns to, each electrode is coated with hydrophobic insulator, and each electrode forms the sidewall of the moistening unit of electronics, and this sidewall is relative with the other sidewall that is formed by other electrode.To those skilled in the art, it will be apparent being used for obtaining other structure that light beam turns to by the moistening prism of electricity.The beam deflection angle is by using poor control of variable voltage that is applied to Different electrodes, and this electrode is arranged on the not ipsilateral of each electric moistening cell array.
The first summary manufacturing process
In a kind of basic structure of thin film semiconductor's display device of embodiment, display part with circuit is provided, this circuit is arranged between the pixel of display part, perhaps is arranged on other position on the substrate, the relevant calculating of demonstration of the data on being used for execution and installing display part.Display part and in display part or integrally formed on substrate in the calculation execution unit of other position on the substrate.Other circuit that is used for the driving display part can be formed on the display part periphery, but is integrated on the same substrate.
TFT circuit and other circuit (as being used for the circuit of actuating logic operation) of being used for the operating space modulator, can create at substrate by method as described below, it is similar that being used for of describing among the method and the US6,153, No. 893 patent documents built the method for distinct device structure; Here quote US6 by reference, the full content of 153, No. 893 patent documents so far.To those skilled in the art, other method will be apparent.Substrate can be large-area substrates, and substrate can be the glass of suitable type.For glass substrate, the technique of often using is tended to sub zero treatment, passes through at least the standard of silicon equipment manufacturing technology.Being used for the technique (such as the silicon thermal oxidation technique near 1000 ℃) of production equipment gate insulation layer tends to incompatible sub zero treatment, and sub zero treatment is typically in 350 ℃ to 700 ℃ temperature range.
Pixel electrode and the thin film transistor (TFT) that is used for switch are arranged in the matrix of display part.The thin film transistor (TFT) of forming circuit element between the pixel of display part, the perhaps position of other on substrate, and can being selected in the display driver section that can be integrated on the same substrate.Thin film transistor (TFT) can be bottom gate type, comprises the polycrystal semiconductor layer that gate electrode, the insulation course above gate electrode form, and is formed in the source that forms on the polysilicon semiconductor layer and the high concentration impurities film of leakage.The TFTs that is used for switch can have lightly doped drain (lightly doped drain, LDD) structure, and wherein the low concentration impurity film is inserted between polycrystal semiconductor layer and the high concentration impurities film.
In typical embodiment, display part has the upper end that comprises pixel electrode, comprise for the bottom of the TFTs of switch and color filter layer, black mask layer may be arranged and be inserted in planarization layer between the upper and lower side.In this case, black mask layer comprises metal wiring pattern, and this metal wiring pattern is electrically connected to the high concentration impurities layer for source and leakage.And pixel electrode is electrically connected to for the high concentration impurities layer that leaks by metal wiring pattern.Alternatively, if backlightly use with three kinds of primary colors with time-multiplexed mode illumination, color filter layer can omit.
Display device with said structure can be made by the sub zero treatment of back.At first, form gate electrode at glass substrate.Then, the dielectric film on gate electrode forms semiconductive thin film, then semiconductive thin film is transformed to polycrystal layer by laser annealing.Then only optionally form low concentration impurity layer on the polycrystal layer in being included in pixel switch, for example the use by mask layer.Further, be formed for the high concentration impurities film of source and leakage at the low concentration impurity film, and therefore be formed for the TFTs of the stacking LDD structure of having of switch.Meanwhile, by making TFTs for circuit component being included in the high concentration impurities layer that directly is formed for source and leakage on the polycrystal layer of circuit part, show and calculate as being used for image, perhaps be used for peripheral drive circuit.Preferably, optionally carry out laser annealing on the high concentration impurities layer in being included in circuit part, to reduce the resistance of polycrystal semiconductor layer.
After glass substrate formed gate electrode, the gate insulating film on gate electrode top formed semiconductor film at low temperatures.By laser annealing semiconductor film is transformed to polycrystal layer subsequently.Therefore, it is feasible forming polycrystalline TFT by sub zero treatment.The laser that uses typically will have the short wavelength, so that laser emission strong absorption in silicon: an example is excimer laser, yet other also is known.Because TFT is bottom gate type, this structure can not be subject to the adverse effect from impurity (such as the sodium in the glass substrate) easily.It is less that the polycrystal semiconductor layer that uses in the device zone allows to make TFT to make.At the TFTs that is used for pixel switch, the LDD structure keeps low-leakage current.If leakage current is too high, this will be the significant deficiency in the display device.In the TFTs of forming circuit element, by contrast, N channel TFT s and P channel TFT s can be by forming by sub zero treatment stack high concentration impurities layer on polycrystal semiconductor layer simultaneously.Can carry out additional laser annealing to the TFTs of forming circuit element, to increase the speed of these TFTs.Can adopt further structure, comprise color filter layer, black mask layer and planarization layer, be beneficial to obtain the aperture rate (aperture rates) of higher picture element density and Geng Gao.
Can be not limited to by the structure of this manufacture method manufacturing the TFT structure, but go for the structure of any known.
The second summary manufacturing process
In a kind of basic structure of thin film semiconductor's display device of embodiment, display part with circuit is provided, this circuit is arranged between the pixel of display part, perhaps is arranged on other position on the same substrate, installs the relevant calculating of demonstration of the data on display part for execution and this.Display part and calculation execution unit are integrally formed on substrate.Other circuit that is used for the driving display part can be formed on the periphery of display part, but is integrated on the same substrate.
TFT circuit and other circuit (as being used for the circuit of actuating logic operation) of being used for the operating space photomodulator, can be by creating as described below on substrate, the method that is used for structure distinct device structure described in the method and the US6,140, No. 667 patent documents is similar; Here quote US6 by reference, the full content of 140, No. 667 patent documents so far.To those skilled in the art, other method will be apparent.Such silicon that can use this manufacturing process to make is called " continuous particulate silicon ", and the electrical characteristic of its electrical characteristic and monocrystalline silicon in some respects perhaps many-side may be similar.
Figure 11,12 and 13 has represented to be used for to form the summary of the operation of continuous particulate (CG) silicon, and this continuous particulate (CG) silicon is applicable in the display device, comprises being used in pixel switch, display driver and the logical circuit.Substrate 1101 can be large-area substrates, and substrate can be the glass of suitable type, or quartzy.Nontransparent substrate such as interior polysilicon or ceramic can being used in the situation of the display device that only is used in luminous geometry, because in reflective geometry, the light of substrate transmits not necessarily requirement.Substrate has insulating surface.Film 1102 be silicon thickness at 10nm to the amorphous silicon film between the 75nm, it does not comprise the oxide of any formation.This film can pass through low-pressure chemical vapor deposition (chemical vapour deposition, CVD) or be grown by plasma CVD technique.
In the back, described the technique of silicon metal, but in the art, many other techniques are known.Form mask insulating film 1103, its split shed is corresponding to the desired position of CG silicon on the substrate.A solution comprises the Ni as the catalyst elements that is used for crystallizing amorphous silicon is applied by spin coating proceeding, forms layer 1104 in this technique.Can use other catalyst elements such as Co, Fe, Sn, Pb, Pd, Pt, Cu or Au etc.At the opening part of film 1103, introduce catalyst film 1104 and contact with amorphous silicon film 1102.Subsequently can be in inert gas or in the gas that comprises hydrogen or oxygen, between 500 ℃ to 700 ℃ of temperature, time 4hr is between the 12hr, by annealing crystallization amorphous silicon film 1102.
Shown in Figure 11 B, in zone 1105 and 1106, promote the crystallization of amorphous silicon 1102 by the Ni catalyzer.Form the horizontal growth zone 1107 and 1108 of growing across substrate in fact.Only these horizontal growth zones such as 1107 and 1108, are used as the active layer in the TFT device that substrate forms (active layer) in the TFT device.After annealing is finished, remove mask layer 1103 from substrate.Shown in Figure 11 C, then form pattern.As the island semiconductor layer 1109,1110 and 1111 of active layer across being formed on the substrate.The 1109th, the active layer of the N channel-type TFT of formation complementary metal oxide semiconductor (CMOS) (CMOS) circuit, the 1110th, the active layer of the P channel-type TFT of formation cmos circuit, the 1111st, the active layer of the N channel-type TFT of formation pixel matrix circuit.
After active layer 1109,1110 and 1111 forms, form gate insulating film 1112, this gate insulating film 1112 comprises the dielectric film that comprises silicon.The thickness of gate insulating film 1112 can be at 20nm in the 250nm scope, and should allow some oxidations to this tunic in step of thermal oxidation after a while.Film 1112 can be grown with known method of vapor-phase growing.
Figure 11 C has represented to be used for removing the heat treatment method of Ni catalyst elements.Heating is in the situation that exist halogen-containing material to carry out.Heating is between 700 ℃ to 1000 ℃ of temperature, and time 0.1hr is to carrying out between the 6hr.Example is to be 3 or more usually in the gas of percent by volume between 0.5 to 10, at 950 ℃ of thermal treatment 0.5hr containing the percent by volume of HCl (vol%).The oxidation of the silicon in the film can reduce by mix nitrogen-rich gas N2 in employed gas.Except HCl, other halogen-containing material is HF for example, HBr, and Cl2, F2, Br2, NF3 ClF3, BCl3 etc. also can use.This gettering process helps to remove the Ni catalyzer from film.Seem that this is to occur by the volatility nickel chloride that formation is discharged in the gas.In oxidizing process, the thickness of gate insulating film 1112 will tend to increase.Zone 1109,1110 and 1111 correspondingly attenuation, this has reduced closing among the TFT (OFF) electric current, and it is mobile to have increased field effect in other obvious benefit.
After above-mentioned processing, the heat treated of 950 ℃ of heating 1hr has been improved the quality of gate insulating film 1112 in nitrogen, and the quality at the interface between gate insulating film 1112 and the zone 1109,1110,1111.
Formation has the aluminium film of the scandium (Sc) of 0.2 percentage by weight (wt%), and is formed for consisting of the electrode pattern of gate electrode prototype, and is mentioned to having below this.This also is not shown among Figure 11.Can use to be suitable for other material of this purpose, such as Ta, W, Mo or Si.Shown in Figure 11 D, by the surface of anodic oxidation pattern, form gate electrode 1113,1114 and 1115, and anode film 1116,117 and 1118.In next step, shown in Figure 11 E, etch away film 1112, for example by using gas CHF 3, so that film 1112 still only be retained in electrode under, for example in the position 1119,1120 and 1121.Etching mask 1122 is used for covering the zone for P channel-type TFT.Shown in the arrow among Figure 11 E, add the foreign ion that is used for the N-shaped material, for example by injecting or plasma deposition.Form N-shaped zone 1123,1124,1125 and 1126.And then this process can be removed Etching mask 1122, and Etching mask 1127 can be arranged on the top (Figure 12 A) in N-shaped zone.Can deposit subsequently p-type zone 1128 and 1129, for example by injecting or plasma deposition.The p deposition region is the LDD zone.Can remove subsequently the Etching mask 1127 of top, N-shaped zone.
Form silicon oxide film at sidewall 1130,1131 and 1132 by etch-back (etch-back) technique.The p-type zone is covered by mask 1133, and adds N-shaped and mix, with the concentration of N-shaped doping in the zone that increases not oxidized thing sidewall covering.The sheet resistance of adjustment source/drain region (sheetresistance) preferably is lower than 300 Ω to being lower than 500 Ω.Below gate electrode, form intrinsic or intrinsic in fact channel formation region territory 1137.The channel formation region territory 1141 (Figure 12 C) that forms source region 1138, drain region 1139, low concentration impurity zone 1140 and consist of the N channel TFT of pixel matrix circuit.In Figure 12 D, remove Etching mask 1133, and above N channel-type TFTs, form Etching mask 1142.Further add the concentration that p-type impurity mixes to increase p-type.Then remove Etching mask 1142, and by heat treated (such as furnace annealing, laser annealing etc.) activated impurity ion.Reduce or elimination injection infringement by heat treated.
Thickness with 20nm to 50nm forms titanium film 1147, and carries out the heat treated with lamp annealing.As shown in FIG. 13A, the pasc reaction that contacts with titanium film forms titanium silicide, and forms silicide regions 1148,1149 and 1150.Figure 13 B has represented island type pattern 1151,1152 and 1153, forms them and is eliminated to prevent silicide film zone 1148,1149 and 1150, prevents from forming in the subsequent step contact hole of connection source/drain region and wiring.
Form the silicon oxide film of 0.3 μ m to 1 μ m thickness as the first interlayer dielectric 1154.Shown in Figure 13 B, form contact hole, and form source wiring 1155,1156,1157 and leak routing 1158,1159.Organic resin can be used as the first interlayer dielectric 1154.In Figure 13 C, form the second insulation course 1160 of 0.5 μ m to 3 μ m thickness range at substrate.Polyimide, acryl resin, polyamide or amino polyimide (polyimide amide) etc. can be used as organic resin film.Form black mask 1161 at film 1160.Form the 3rd interlayer dielectric 1162 of 0.1 μ m to 0.3 μ m thickness range, such as monox, silicon nitride, silicon oxynitride, organic resin mould or these laminated film.Form contact hole at film 1160 and film 1162 places, and form the pixel electrode 1163 of 120nm thickness.Shown in Figure 13 C, in the location of black mask 1161 overlaid pixel electrodes 1163, form auxiliary capacitor 1164.
In hydrogen environment, heated whole substrates 1 to 2 hour at 350 ℃, this can compensate dangling bonds, especially the dangling bonds in the active layer of film.After these steps, on same substrate, can form the cmos circuit in Figure 13 C left side and the pixel matrix circuit on Figure 13 C right side, for example form with the adjacent position.
Can be not limited to the TFT structure by the structure that this manufacture method is made, but go for the structure of any known, comprise bottom grid TFTs.
The 3rd summary manufacturing process
In a kind of basic structure of thin film semiconductor's display device of embodiment, display part with circuit is provided, this circuit is arranged between the pixel of display part, perhaps is arranged on other position on the same substrate, the relevant calculating of demonstration of the data on being used for execution and installing display part.Display part and calculation execution unit are integrally formed on substrate.Other circuit that is used for the driving display part can be formed on the display part periphery, but is integrated on the same substrate.
TFT circuit and other circuit (as being used for the circuit of actuating logic operation) of being used for the operating space photomodulator, can on substrate, be created by method described as follows, the method that is used for structure distinct device structure described in the method and the US6,759, No. 677 patent documents is similar; Here quote US6 by reference, the full content of 759, No. 677 patent documents so far.To those skilled in the art, other method will be apparent.Such semiconductor that can use this manufacturing process to make is polycrystalline silicon germanium, and its electrology characteristic perhaps many-side may be similar with monocrystalline silicon in some respects, or surpass monocrystalline silicon.
The result of this manufacturing process is the circuit on the monobasal.Generate one group of polysilicon as the TFTs of its active layer, the pixel of its control display device.Generation has other TFTs of function such as gate driver circuit, source electrode drive circuit and signal processing circuit, and wherein active layer is SiGe, to realize high speed operation.In the circuit part that needs high speed operation, add germanium, and polysilicon is used in the circuit part that needs low close current characteristic.
Make the active type matrix display device, this device has pixel matrix circuit and driving circuit, and driving circuit is cmos circuit in this example, and pixel matrix circuit and driving circuit all are formed on the insulating surface of monobasal.Process as shown in Figure 6.
As shown in Figure 6A, prepare glass substrate 601 to form silicon oxide layer 602 thereon.Form the amorphous silicon film 603 of 30nm thickness by the plasma CVD method.Provide Etching mask 604 by forming pattern in amorphous silicon film 603.Form resist film, will organize the zone that is used for pixel matrix circuit that forms with TFT to cover.Do not cover and to form the zone of high speed circuit.Shown in Fig. 6 B, add germanium by the technology such as Implantation, plasma doping or laser doping.Add germanium in order to change the component of amorphous silicon film, to create Si 1-xGe xThe average composition of film, wherein, 0<x<1.If the use Implantation then adds the zone 605 of germanium and can bear the injection infringement.Si 1-xGe xFilm 605 is amorphous states.
Because low than at silicon of the energy of activation that are used for a large amount of diffusions in germanium, and in being lower than the binary alloy phase diagram of melting temperature, germanium and silicon form solid solution among each other, so with respect to the crystallization of pure silicon film, having of germanium helps accelerate Si 1-xGe xThe crystallization of film.At this on the one hand, germanium can be thought the catalysis semiconductor of silicon crystallization, for example in laser induced crystallization.
In Fig. 6 C, such as US5, described in 643, No. 826 patent documents, remove resist layer 603, and increase in whole surface and to contain nickel dam 606, here by with reference to quoting US5, the full content of 643, No. 826 patent documents is so far.Nickel is used as catalysis material, to accelerate silicon or Si 1-xGe xThe crystallization of film.For this purpose, can use the element except nickel, such as Co, Fe, Cu, Pd, Pt, Au or In.Shown in Fig. 6 D, by furnace annealing, 600 ℃ of heating 8 hours, obtain silicon and Si 1-xGe xThe crystallization of film.This has caused polycrystalline Si 1-xGe xZone 607 and polysilicon region 608.Thermal treatment can realize with other method, such as laser annealing or lamp annealing.
In Fig. 6 E, polycrystalline Si 1-xGe xZone 607 forms active layer 609.Polysilicon region 608 forms active layer 610.Active layer 609 is the active layers for the TFTs that consists of subsequently driving circuit and signal processing circuit.Active layer 610 is the active layers for the TFTs that consists of subsequently pixel matrix circuit.
By US5, the technique described in 648, No. 277 patent documents forms source region, drain region and lightly doped drain (LDD) zone; Here quote US5 by reference, the full content of 648, No. 277 patent documents so far.To sum up this technique now.At first, contain the Al film of the Sc of 2% weight by use, form island type pattern, this island type pattern can form gate electrode subsequently.Then, island type pattern is carried out anodic oxidation, form the porous anodic oxide film with the sidewall at island type pattern.Then, change the processing means with further realization anodic oxidation, to form tight anodic oxide coating around island type pattern.Form by this way after porous anodic oxide film and the tight anodic oxide coating, use dry-etching method etch-gate deielectric-coating.After the etching of finishing gate dielectric film, remove the porous anodic oxide film, obtain thus the state shown in Fig. 7 A.
In Fig. 7 A, 711,712 and 713 is by the film formed gate insulating film of monox, and 714,715 and 716 is by the film formed gate electrode of the Al that comprises Sc, and 717,718 and 719 is the tight anodic oxide coatings for the protection of gate electrode.In Fig. 7 B, the zone that forms the P channel TFT is covered by mask 720.There is the N-shaped ion of injection in all the other zones, so that N-shaped electric conductivity to be provided.Such as US5, described in 648, No. 277 patent documents, use two kinds of different accelerating potentials, with ion concentration that injection is provided and the more consistent distribution of the degree of depth.
In Fig. 7 B, technique has caused for the drain region 721 of the n channel TFT that consists of driving circuit, source region 722, LDD zone 723 and channel region 724.Also be formed with drain region 726, source region 725, LDD zone 727 and channel region 728 for the N channel TFT that consists of pixel matrix circuit.
In Fig. 7 C, remove Etching mask 720, and increase Etching mask 729 to cover the N-shaped zone.Then such as US5, described in 648, No. 277 patent documents, use two accelerating potential implanting impurity ions, so that the p-type conduction to be provided, and provide the more consistent distribution of ion concentration and the degree of depth of injection.This has formed source region 730, drain region 731, LDD zone 732 and the channel region 733 of the P channel TFT that is used for the formation driving circuit.Foreign ion activates by annealing steps.
Form the first interlayer dielectric 734, and open wherein contact hole to form source electrode 735,736,737 and drain electrode 738,739.Insulation course 734 can be made by the material that is selected from monox, silicon nitride, silicon oxynitride and resin molding.Finished now the TFTs that is used for driving circuit.Must finish now the TFTs for picture element matrix.After forming source electrode and drain electrode, form the second interlayer dielectric 740, then form the black mask 741 that comprises the Ti film thereon.If before formation black mask 741, the position above drain electrode 739, part is removed the second interlayer dielectric, then might form auxiliary capacitor by black mask, the second interlayer dielectric and drain electrode.And then above black mask 741, form the 3rd insulating layer film 742, and form therein contact hole, and form the pixel electrode 743 that comprises nesa coating (such as indium tin oxide) thereon.
Shown in Fig. 7 D, the active type matrix substrate with TFTs is disclosed thus, it comprises integrally formed pixel and driving circuit, this pixel and driving circuit can be adjacent one another are.The person of ordinary skill in the field will be understood that, the cmos circuit of Fig. 7 D can be replaced by other circuit, signal processing circuit for example, and it can form in the polycrystalline silicon germanium zone.The polycrystalline silicon germanium zone has the high-field effect flowability, and therefore is suitable for high speed operation.Although compare with the polycrystalline silicon germanium zone, polysilicon region has low operating speed characteristic, and when being applied to picture element matrix TFTs, polysilicon region has better low close current characteristic.
Can be not limited to the TFT structure by the structure that this manufacture method is made, it goes for the structure of any known, comprises bottom grid TFTs.
LASER Light Source
RGB solid-state laser light source is such as the RGB solid-state laser light source based on GaInAs or GaInAsN material, because the light directionality of their compactedness and their height can be the suitable sources for holographic display.This light source comprises light emitting diode, and the RGB vertical cavity surface emitting laser (VCSEL) of being made by Novalux (RTM) company of California, USA.This LASER Light Source can be used as single laser or laser array, although each light source can be used for generating a plurality of light beams by using diffraction optical element.Light beam can be relayed from multimode optical fiber, if be used in the relevant too high of tight holographic display, then this can reduce relevant level, can't cause artificial affecting such as the LASER SPECKLE pattern do not expected.The LASER Light Source array can be one dimension or two-dimentional.
Substrate
Should be emphasized that: word " substrate " refers to make the plate of material of display device thereon.Typically, it will be insulated substrate such as sheets of glass substrate or sapphire substrate or semiconductor substrate such as Si or GaAs, but other substrate also is feasible such as polymer sheet or sheet metal.Substrate such as sheets of glass or semiconductor substrate such as Si or GaAs, is generally used for the device manufacturing, because they have simplified treatment step and the transfer between the different device of carrying out different disposal step (such as deposition of material, annealing and material etching).Word " substrate " does not refer to single circuit board, disclosed in Optics Express (optics letter) 13,4196 (2005) such as people such as Shimobaba: the single circuit plate does not allow can be in a series of manufacturing process of single substrate (such as sheets of glass) execution.
The number of transistors purpose is estimated
This part comprises needed number of transistors purpose estimation in the display device, and the holography that is used for being implemented by the circuit between the pixel that is arranged on display device is calculated.
For the embodiment of use FPGA, holographic calculating is comprised of following step, and wherein, the number percent that marks is the upper percentage that is used for the logical resource of given step use of FPGA.
Lens function: depend on the generation (4.5%) that the z value is added random phase and subhologram
CORDIC calculates: complex values is changed to real-valued and empty value from phase place and quantitative change, and carry out density modulation (62.5%)
Add with subhologram to form hologram (15.5%)
The decoding hologram: cordic algorithm also is used for numerical value being converted to phase place and amount and converting back to real-valued and empty value, and the cutting and the normalization (17.5%) that are used for data
Because the transistor size of bank bit does not rely on the pipeline frequency, when carrying out calculating in picture element matrix, the number percent number that the above provides can be not identical.The calculated amount that is used for addition and decoding will increase along with the number of hologram pixel.
Depend on the z value, lens function (LF) can have some little question blanks (LUTs) to define the subhologram size and to be used for the initial constant of lens function.Therefore, lens function has the relatively high fixing transistor size for LUTs, and depends on each clock period by the variable transistors number of the number of the CORDIC unit of lens function parallel drive.Generally, the size of computing unit (cluster) should be best, because their size is larger, the saving in the data transmission rate will be less.On the other hand, larger cluster so that the realization of calculating be more prone to.The example of Figure 23 has only represented that the cluster of simplifying designs, because a cluster can be made of 1,000,000 transistors or more transistor.
We estimate the transistorized number that needs in the display device now, and the holography that is used for being implemented by the circuit between the pixel that is arranged on display device is calculated.Because cordic algorithm need to more than 75% resource, be carried out CORDIC calculating so estimate to concentrate on the transistor in the FPGA embodiment.Reference material " cordic algorithm; Architekturen und monolithischeRealisierungen mit Anwendungen in der Bildverarbeitung; Dirk Timmermann; 1990 ", provided for estimating that CORDIC number of transistors purpose a bit helps, and quotes this document by reference here from 100 pages to 101 pages.For the FPGA solution, the suitable CORDIC unit of the different reductions of application, and the transistor size that estimates that therefore is used for the CORDIC unit of a pipeline approximately is 5.2 ten thousand transistors.
Spreadsheet has represented that the estimation of the hologram calculating of plan is had 16,000 * 12,000 hologram pixel among Figure 21 and 22, and from 2,000 * 1,500 pixel real space images begin.For each pixel in the subhologram, need a CORDIC operation, namely amount to per second 250*10 Λ9 operations.For the pipeline frequency of 25MHz, need 9800 parallel CORDIC unit.The cluster design affects transistor size and design efficiency, and cost is higher because larger cluster means the hologram data distribution.If but cluster is too little, the calculating in the cluster is just inefficent, because what is not done in most of time in some unit, and has therefore increased transistorized number.
If by 1 lens function unit and 1 CORDIC cell formation, then needing 9800 clusters and 6.6 hundred million transistors to be used for subhologram, calculates cluster.If cluster is by 1 lens function unit and 8 CORDIC cell formations, then display device is made of 1200 clusters, and needs 5.3 hundred million transistors to be used for subhologram calculating.Therefore, cluster size can change on a large scale at one, and for sampling Design, selects to have the cluster of 4 CORDIC unit and 1 lens function.As estimation, this causes 2500 clusters and 5.5 hundred million transistors to be used for subhologram calculating.
In order to find out optimum cluster size, must carry out detailed design.Numeral in the spreadsheet (Figure 21 and 22) only is "ball-park" estimate, but they have shown the main dependence form of parameter.
CORDIC (by turn method, Volder algorithm) (for CORDIC) is simple, the Effective arithmetic that calculates hyperbolic curve and trigonometric function.Because CORDIC is used for complex values is converted to real-valued and empty value from phase place and value here, vice versa, can adopt other algorithm.If do not have hardware multiplier (for example, simple microcontroller and FPGAs) available, then usually use CORDIC, because it only needs little question blank, bit shift and addition.In addition, when implementing in software or specialized hardware, cordic algorithm is applicable to stream line operation.Modern cordic algorithm was described by Jack E.Voider first in nineteen fifty-nine, although it and Henry Briggs are similar as far back as disclosed technology in 1624.Originally, CORDIC implements with scale-of-two.In the 1970's, decimal system CORDIC is widely used in pocket calculator, and their great majority are not with binary operation but operate with the binary code decimal system (BCD).CORDIC is specially adapted to handheld calculator, and for the application of handheld calculator, price (and therefore the number of grid on the chip) specific rate is more important.In the time can't obtaining hardware multiplier (for example in microcontroller), perhaps when needed number of gates of application of enforcement need to minimize (for example in FPGA), CORDIC is usually fast than other method.
CORDIC is the part of " displacement and addition " this class algorithm, is logarithm and the exponentiation algorithm that originates from the work of Henry Briggs.Other can be used for calculating the displacement of many elementary functions is the BKM algorithm with computation system mutually, and this algorithm is the conclusion to logarithm and the exponentiation algorithm of complex plane.For example, BKM can be by calculating the index of 0+ix, and namely cosx+isinx calculates sine and the cosine of solid horn degree x (radian).The BKM algorithm 1994 by J.C.Bajard, S.KIa and J.M.Muller at " IEEE Transactions on Computers " (43 (8): 955-963, in August, 1994) open for the first time, this BKM algorithm is more slightly more complex than CORDIC, and still having advantages of does not need conversion factor.In the present embodiment, the BKM algorithm can be used for substituting cordic algorithm.
Computing method
Current, CPU (central processing unit) (CPUs) and digital signal processor (DSP) unit mainly use the digital synchronous logic to be used for calculating.The FPGA hologram calculates also can use the method.Because the low number of transistors of each hologram pixel is so other method can preferably depend on calculation procedure.Following tabulation has represented to be used for the key property of some other computing method:
Digital synchronous logic (clocked logic)
High number of transistors
Short computing time
Easily timing is calculated
Good design tool support
Numeral asynchronous logic (non-clocked logic)
Good power efficiency
High number of transistors
Short computing time
Poor design tool support
Difficult timing is calculated
Pulse-length modulation (PWM)
Low number of transistors
Long computing time
Simulation
Mainly develop from 1950 to nineteen sixty
Except simple high-frequency was used, current analog computation was uncommon
Low-down number of transistors
Short computing time
Limited precision
High manufacturing parameter drift relies on
Hybrid technology
The demand of calculation procedure is different.Because such as the limited capacity of polysilicon transistors, so should select as requested computing method.Best practice will depend on accurate enforcement.The below is some examples.
In order to reduce transistorized quantity, have the low calculation procedure that requires such as lens function and decoding and can use PWM.Analogue shift register can be used for Data dissemination, because real space data and hologram data only use approximately 8 precision.Custom-designed synchronous CORDIC unit can be used for reducing power attenuation.Each step uses the method more than can further reduce transistorized quantity, but can increase design cost.
Display device type
Display device be preferably use on display device surface transistor or other on-off element (as electricity, light) active matrix structure.Transistor material should have enough structure width and the additional transistor of switching frequency to implement to be used for calculating.Can use monocrystalline silicon and polysilicon variant such as low temperature polycrystalline silicon (LTPS), CGS, individual particle silicon or polycrystalline silicon germanium.The switching frequency of amorphous silicon is too low generally concerning the high-performance hologram calculates.In principle, organic semiconductor or carbon nano-tube also can be used as the on-off element material.Traditional large display device needs large area to be used for the row and column wire.Use method of the present invention can save this area.
Because the area saving is larger on larger display device, the display device type below therefore preferably adopting:
Liquid crystal display (LCD) based on LTPS
Organic Light Emitting Diode (OLED) (comprising light emitting polymer (lightemitting polymers, LEP)) based on LTPS
Monocrystalline silicon only is used for little display device, compares the advantage that has still less with new method.The example that monocrystalline silicon uses is:
·LCOS
Digital light is processed (DLP) technology
The tabulation that can be used for the feasible display technique of enforcement is:
Liquid crystal display (LCD)-type
Liquid crystal over silicon LCOS
Nematic liquid crystal NLC
Twisted-nematic TN
Homeotropic alignment is to row VAN
Ferroelectric liquid crystals FLC
Field-emitter display FED
Surface-conduction-electron emission display SED
Carbon nanotube emitter (based on silicon substrate or be coated in indium tin oxide (indium tin oxide, ITO) on the glass substrate, yet these can only be used as light source, because send incoherent light)
Mechatronic Systems
Lens array/digital light is processed (DLP) technology
MEMS (micro electro mechanical system) (MEMS) mirror is also referred to as Micro-Opto-Electro-Mechanical Systems (MOEMS)
The tabulation of hologram computing method:
-question blank (LUT)
-analytical Calculation
-publication number is the method described in the patent document of WO 2006/066919, here by with reference to quoting this document
-ray-tracing scheme
Alternative types:
-2D conversion
-in a horizontal plane 1D conversion
-1D conversion in vertical plane
Type of coding:
-Burckhardt (Burckhardt) coding
-phase encoding only
-double phase encoding
-BIAS coding
-minimum distance code (minimum distance encoding, MDE)-every hologram pixel of use is more than the coding of 3 slm pixels
Hardware
Outside hologram computing unit can be comprised of a pair of high-end FPGAs or special IC (ASIC) or the full custom ic that has approximately 0.52 hundred million transistor and a 500MHz pipeline frequency.In order to transmit data to display device, can use approximately 230 the low-voltage differential signal (LVDS) of per second emission 1Gbits right.For receive data, also need glass chip on board (chip on glass, COG) rowaand column lines driver.Be integrated on the display device substrate if calculate, then only high inversion frequency part as digital video interface (DVI) receiver must be realized at additional hardware.Only must 50 times of low raw data of transmit data rate (referring to Fig. 1).Can use the dog-cheap display device electron device that is connected that minority and display device are only arranged.This electron device is almost identical with current low resolution 2D TFT display device.
Explain
The feature of above-mentioned three kinds of summary manufacture methods can make up without departing from the scope of the invention.
Among the figure here, shown relative size is not necessarily drawn in proportion.
To those skilled in the art, without departing from the scope of the invention, various modifications of the present invention and replacement will be apparent, and should be appreciated that, the present invention should too not be limited in the illustrative example of showing here.
Many concepts (being described as " concept A-T ") are arranged among the present invention.Appendix III comprises may be to defining the useful content of these concepts.Be noted that for those skilled in the art the situation that may help to illustrate other concept for the disclosure of a concept.Will be clear that from the other parts of presents, some of these concepts can form a part of the present invention.
Appendix I
The technology brief introduction
Following chapters and sections are as the explanation for several gordian techniquies of implementing systems more of the present invention.
In traditional holography, the observer can see the holographic reconstruction of object (can be the scene that changes); Yet he is also uncorrelated apart from the distance of hologram.In a typical optical arrangement, rebuild on the plane of delineation of the light source occur in the illumination hologram or near the plane of delineation, therefore rebuild on the Fourier plane that occurs in hologram or near.Therefore, reconstruction has the far field light distribution identical with the real world objects of rebuilding.
An early stage system (is described in WO 2004/044659 and No. 2006/0055994 patent document of US, here quote the full content of these two pieces of files by reference) determined very different arrangements, the object of wherein rebuilding is not on the Fourier plane of hologram or near the Fourier plane.On the contrary, virtual observer's window region is on the Fourier plane of hologram; Only have observer's eyes in this position, just can see correct reconstruction.Hologram is encoded at LCD (perhaps other type space photomodulator), and throws light on optics setting, so that virtual observer's window becomes the Fourier transform (so it is the Fourier transform of direct imaging on eyes) of hologram; Then be formed on the reconstruction object in the frustum that extends between observer's window and the SLM, the propagation of preferably describing with the Fresnel transform of hologram is not because it is in the focusing surface of lens.It is but determined by near field of light distribution (with modeling before the spherical wave, opposite with the plane wave front of far-field distribution).This reconstruction can appear between virtual observer's window (as mentioned above, in the Fourier plane of hologram) and the SLM Anywhere, perhaps in addition the back that appears at SLM as dummy object.
There are several results in the method.At first, the basic restriction faced of the designers of holographic video system is the pel spacing of SLM (or other class photomodulator).Target is to realize large holographic reconstruction in order to the SLMs with pel spacing that rational cost is bought.But this is impossible in the past, and reason is as follows.Periodic intervals between the contiguous order of diffraction in Fourier plane is given by λ D/p, and λ is the illumination light wavelength, and D is the distance that hologram arrives Fourier plane, and p is the pel spacing of SLM.But in traditional holographic display, rebuild object in Fourier plane or near.Therefore, rebuilding object must keep less than periodic intervals; If it is larger, then its edge will begin fuzzy the reconstruction from the contiguous order of diffraction.This causes very little reconstruction object-typically only across several centimetres, even also be like this for little spacing display device costliness, specialty.But this method of using, virtual observer's window (it is described mistake in the above, is arranged in the Fourier plane of hologram) only needs the same with eye pupil large.As a result, also can use even have the SLMs of intermediate reach size.And because the reconstruction object can fill up the frustum between virtual observer's window and the hologram fully, it in fact can be very large, that is, more much larger than periodic intervals.In addition, when using OASLM, just do not have pixelation (pixelation), therefore not periodically, like this, keep virtual observer's window just no longer applicable less than the restriction of periodic intervals.
Also have another advantage, it launches in a modification.When computed hologram, with people to the knowledge of rebuilding object begin-as, you may have the 3D rendering file of racing car.This document will describe which type of the object of seeing is from many different viewing location.In traditional holography, the needed hologram of reconstruction that generates racing car directly obtains from the 3D rendering file in the computation-intensive process.But virtual observer's windowhood method can provide different and calculate more effectively technology.Begin with a plane that rebuilds object, we can calculate virtual observer's window, because it is the Fresnel transform of object.Then we carry out the method to all objects plane, add with the result to produce the Fresnel transform of accumulation; This has determined to cross over the wave field of virtual observer's window.Then our computed hologram is as the Fourier transform of this virtual observer's window.Because virtual observer's window comprises all information of object, so only the virtual observer's window in monoplane must Fourier transform becomes hologram and is not many planar objects.If do not have single shift step from virtual observer's window to hologram, but the iterated transform as iteration Fourier transformation computation rule is arranged, then this is very favorable.If need iteration, each iterative step only comprises single Fourier transform of virtual observer's window rather than of each object plane, and the result is that calculating strength obviously reduces.
Another interesting result of virtual observer's windowhood method is that all are rebuild the needed information of given object point and are included in the relatively little part of hologram; This and traditional hologram are completely different, and the information of rebuilding given object point in traditional hologram is crossed over whole hologram and distributed.Because we need to be with information coding to the abundant little part of hologram, mean that informational capacity that we need to process and encode is far below traditional hologram.This so mean traditional calculations device (for example price and performance are suitable for the conventional digital signal processor (DSP) that mass marketed is sold) even can be used for the real-time video holography.
Yet, have some unwanted results.At first, apart from the viewing distance of hologram very important-hologram encodes by this way and throws light on: only just can see correct reconstruction when eyes are on the Fourier plane of hologram or when neighbouring; And in the hologram of standard, viewing distance is unimportant.But, have multiple be used to reducing Z sensitivity or centering on the technology that reduces the Z sensitivity design.
Also have, owing to encoding by this way and throw light on hologram: only just can see correct holographic reconstruction in accurate and little viewing location (that is, horizontal location especially, but also on Z distance), so need the eyes tracking.Owing to having Z sensitivity, therefore existing multiple be used to reducing X, Y sensitivity or centering on the technology that reduces X, Y sensitivity design.For example, (will along with the manufacturing progress of LCD) reduces because pel spacing, and virtual observer's window size will increase.In addition, efficient coding technology (as kino formula coding (Kinoform encoding)) helps the greater part of periodic intervals is used as virtual observer's window more, and has therefore increased virtual observer's window.
We are processing fourier hologram hypothesis mentioned above.Virtual observer's window in the Fourier plane of hologram, that is, and in the plane of delineation of light source.As advantage, diffraction light does not focus at so-called DC point (DC-spot).This technology can also be used for the not Fresnel hologram in the plane of delineation of light source of virtual observer's window.Yet, should be noted in the discussion above that the light of diffraction is not sightless as jamming pattern.The on the other hand term " conversion " that should be noted that should be interpreted as comprising that the conversion with describing the light propagation is equal to or akin any mathematics or computing technique mutually.Conversion is approaching of physical process only, more accurately defines by Maxwell's wave propagation equations; Fresnel and Fourier transform are that second order approaches, but have advantages of such: (a) because they are the algebraically relative with differential, therefore can process them in the mode of calculating effective ways; (b) they can accurately be implemented in optical system.
Further introduction provides in U.S. Patent application US 2006-0138711 and US2006-0139710 and US 2006-0250671 in detail, and the content of these files is to be incorporated into this with reference to the mode of quoting.
Appendix II
Glossary used in the present invention
Computer-generated hologram
Computing machine generating video holograms CGH is the hologram that calculates from scene.CGH can comprise the amplitude of the needed representative light wave of expression re-construct and the complex value number of phase place.For example CGH can follow the trail of to calculate, calculate by the simulation of the interference between scene and the reference wave by coherent light, perhaps calculates by Fourier transform or Fresnel transform.
Coding
Coding is the process that the controlling value of video holograms is provided to spatial light modulator (for example, its Component units, or continuous SLM are such as the proximity of OASLM).Usually, hologram comprises the complex value number of expression amplitude and phase place.
The code area
The code area is the typical space constraint district of video holograms, the hologram information of the single scene point of this district's coding.Space constraint can be blocked or by realizing to the smooth transition that the Fourier transform of video holograms obtains by virtual observer's window by unexpected.
Fourier transform
Fourier transform is used for calculating the light propagation in the far field of photomodulator.Wavefront is described by plane wave.
Fourier plane
Fourier plane comprises the photodistributed Fourier transform on the spatial light modulator.Without any condenser lens, Fourier plane is infinitely great.If near spatial light modulator, then Fourier plane equals to comprise the plane of light source image to condenser lens in light path.
Fresnel transform
Fresnel transform is used for the light in the near field of computer memory photomodulator and propagates.Wavefront is described by spherical wave.The phase factor of light wave comprises the item that secondary depends on lateral coordinates.
Frustum
Virtual frustum makes up between virtual observer's window and SLM, and extends in the SLM back.Scene is rebuild in this frustum.The size of the scene of rebuilding is limited by this frustum, rather than is limited by the periodic intervals of SLM.
Photosystem
Photosystem can comprise as the coherent source the laser or the partial coherence light source as LED.The relevant of the time of partial coherence light source and space must be enough to help good scene rebuilding, that is, the lateral magnification of spectral line width and emitting surface must be enough little.
Virtual observer's window (VOW)
Virtual observer's window is the virtual window in the observer plane, can see the 3D object of reconstruction by it.VOW is the Fourier transform of hologram and is arranged in the one-period interval to avoid the multiple reconstruction of visible oBject.The size of VOW must be the size of eye pupil at least.If at least one VOW is positioned at the position of the observer's eyes with observer's tracing system, the VOW lateral extent that can move much smaller than the observer then.This helps to use and has moderate resolution so the little SLM of periodic intervals.VOW keyhole can be thought of as, the 3D object of reconstruction can be seen by it, or VOW of every eyes, or VOW of two eyes.
Periodic intervals
If CGH shows at the SLM that is comprised of independent addressable unit, CGH then samples.This sampling causes the periodicity of diffraction pattern to repeat.Periodic intervals is λ D/p, and λ is wavelength, and D is the distance that hologram arrives Fourier plane, and p is the spacing of SLM unit.Yet OASLMs does not have sampling, does not therefore have the periodicity of diffraction pattern to repeat; Repeat actual in establishment.
Rebuild
Rebuilding primary light with the spatial light modulator of the illumination of hologram coding distributes.This light distributes and is used for computed hologram.Ideally, the observer will can not tell the light distribution of reconstruction from primary light distributes.The light of re-construct distributes in most of holographic displays.But in our display device, in virtual observer's window, rebuild light and distribute.
Scene
The scene of rebuilding is real or the three-dimensional light that computing machine generates distributes.As special example, it can also be that two-dimentional light distributes.Scene can consist of the different fixing or mobile object that is arranged in the space.
Spatial light modulator (SLM)
SLM is used for the wavefront of modulating the incident light.Desirable SLM can represent any complex value number, namely control respectively amplitude and the phase place of light wave.Yet typical traditional SLM only controls a characteristic, is amplitude or is phase place, and have the spinoff of not expecting that also affects another characteristic.
Appendix III
Concept
Many concepts (being described as concept " A-T ") are arranged among the present invention.Following content may be helpful to defining these concepts.
A. the hologram display device of calculating at same substrate with pixel
In holographic display, performed being used for determines that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out.
Circuit between the pixel that performed at least some calculating that are used for determining the spatial light modulator coding are usage space photomodulators is carried out.
In the zone of dispersion of display device, carry out to calculate, with in the pixel of the corresponding zone of dispersion of basis coding of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
The active area of at least some circuit (active region) is comprised of polysilicon.
The active area of at least some circuit is comprised of continuous particulate silicon (continuous grain Si).
The active area of at least some circuit is comprised of polycrystalline silicon germanium.
The active area of at least some circuit is comprised of monocrystalline silicon.
The active area of at least some circuit is comprised of individual particle silicon (single grain Si).
The active area of at least some circuit is comprised of organic semiconductor.
Substrate is monocrystalline silicon.
Substrate is glass.
Only the real space image data transmission is to display device.
Video frame rate is at least about 25Hz.
View data is comprised of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating is to use look-up-table method to carry out.
Subhologram is used for calculating.
The data that are used for adding with subhologram exchange in the distance that surpasses the subhologram size.
Holographic calculating at whole display device surface uniform launched.
Holography is calculated to be divided into and is tiled in the little identical part that the display device surface is called cluster (cluster).
The data that are used for adding with subhologram exchange in the distance that surpasses cluster size.
Holographic demonstration can be set up together by identical cluster is tiled.
Holographic display is high-definition display device.
Holographic display is very high-resolution display device.
Virtual observer's window is eye pupil diameter or wider.
Virtual observer's window is 1 centimetre or wider.
For being each virtual observer's window, each eye makes up a depth map and intensity map pair.
Show monochrome image.
Color display.
The coloured image that shows is rgb format.
For the pixel value of computed hologram, only consider the value of the child partition (sub-section) of original image.
The light that is used for rebuilding is not fully relevant on whole display device, but relevant in the child partition of display device.
The wire that enough is used for the raw image data transmission lacks than the wire that is used for the hologram data transmission.
Reduction data transmission frequency is conducive to reduce the power consumption in the row and column driving.
The major part of the needed pixel region of row and column wire can be used for other purpose in the prior art solution.
The area of transparency electrode can be increased, the transmittance of display device can be improved thus.
Display panel can be controlled with traditional display technique.
Display device uses the liquid crystal over silicon technology to manufacture.
Display device uses the MEMS technology to manufacture.
Display device uses the field-emitter display technology to manufacture.
Holographic conversion is one-dimensional transform.
Holographic conversion is two-dimensional transform.
Exist to be used for the local additional logic of transmitting the data that calculate, and additional logic can also be in the lump for transmitting original image to cluster, so that can eliminate at least some overall row and column wires.
Redundant circuit such as TFTs, can be made in the space of picture element matrix, so that some circuit that sort circuit uses when finding that device starts can be used for some circuit of using when replacement device starts when breaking down.
Use the method for holographic display.
B. the hologram display device of calculating at same substrate, this device has the effectively computable to the coding of spatial light modulator
In holographic display, performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, and wherein calculate and do not relate to the calculating of Fourier transform or the calculating of Fresnel transform.
Circuit between the pixel that performed at least some calculating that are used for determining the spatial light modulator coding are usage space photomodulators is carried out.
In the zone of dispersion of display device, carry out to calculate, with in the pixel of the corresponding zone of dispersion of basis coding of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
The active area of at least some circuit is comprised of polysilicon.
The active area of at least some circuit is comprised of continuous particulate silicon.
The active area of at least some circuit is comprised of polycrystalline silicon germanium.
The active area of at least some circuit is comprised of monocrystalline silicon.
The active area of at least some circuit is comprised of individual particle silicon.
The active area of at least some circuit is comprised of organic semiconductor.
Substrate is monocrystalline silicon.
Substrate is glass.
Only the real space image data are sent to display device.
Video frame rate is at least about 25Hz.
View data is comprised of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating is to use look-up-table method to carry out.
Subhologram is used for calculating.
Holographic calculating at whole display device surface uniform launched.
Holography is calculated to be divided into and is tiled in the little identical part that is called cluster on the display device surface.
Holographic display is high-definition display device.
Virtual observer's window is eye pupil diameter or wider.
Show monochrome image.
Color display.
For the pixel value of computed hologram, only consider the value of the child partition of original image.
The light that is used for rebuilding is not fully relevant on whole display device, but relevant in the child partition of display device.
The wire that enough is used for the raw image data transmission lacks than the wire that is used for the hologram data transmission.
Reduction data transmission frequency is conducive to reduce the power consumption in the row and column driving.
The major part of the needed pixel region of row and column wire can be used for other purpose in the prior art solution.
The area of transparency electrode can be increased, the transmittance of display device can be improved thus.
Display panel can be controlled with traditional display technique.
Display device uses the liquid crystal over silicon technology to manufacture.
Display device uses the MEMS technology to manufacture.
Display device uses the field-emitter display technology to manufacture.
Holographic conversion is one-dimensional transform.
Holographic conversion is two-dimensional transform.
Exist to be used for the local additional logic of transmitting the data that calculate, and additional logic can also be in the lump for transmitting original image to cluster, so that can eliminate at least some overall row and column wires.
Redundant circuit such as TFTs, can be made in the space of picture element matrix, so that some circuit that sort circuit uses when finding that device starts can be used for some circuit of using when replacement device starts when breaking down.
The wavefront that object sends is rebuild in one or more virtual observer's windows (VOW), and wherein the reconstruction of each single object point (OP) of three-dimensional scenic (3D S) only needs subhologram (SH) as the subset of the whole hologram (H ∑ SLM) that will encode at SLM.
Turning to a plurality of object points (OP) afterwards with scene (3D S) is discrete, for the object point (OP) of each visible 3D scene, at SLM coding lens subhologram (SH L) complex values, wherein the complex values of lens subhologram is to use formula z L=exp{-i*[(π/λ f) * (x 2+ y 2)] determine, wherein λ is reference wavelength, and f is focal length, and x and y are the normal coordinates in the subhologram plane.
For mobile virtual observer window away from the optical axis, in hologram plane (hologram-plane, HE), determine the subhologram (SH of prism P).
The subhologram of lens and the subhologram of prism are asked convolution, and this convolution can symbolically be expressed as SH=SH L* SH P
Each subhologram (SH) is modulated with the phase deviation of univesral distribution, and wherein subhologram is different one by one in phase deviation.
Add with subhologram to form whole hologram.
The reproduction of the computer-generated hologram of be used for rebuilding, this reconstruction are real-time or quasi real time.
Question blank is used for holographic calculating.
Object point can generate the optional position in rebuilding frustum.
Use the method for holographic display.
C. carry out the hologram display device that decompress(ion) calculates at same substrate
In holographic display, in the outside computed hologram coded data in the occupied space of picture element matrix, then use known data compression technique to compress this hologram coded data, and be transferred in the circuit on the display device substrate, by this circuit the data that receive are carried out again and separated compression functions.
Performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out.
Circuit comprises thin film transistor (TFT).
The active area of at least some circuit is comprised of polysilicon.
The active area of at least some circuit is comprised of continuous particulate silicon.
The active area of at least some circuit is comprised of polycrystalline silicon germanium.
The active area of at least some circuit is comprised of monocrystalline silicon.
The active area of at least some circuit is comprised of individual particle silicon.
The active area of at least some circuit is comprised of organic semiconductor.
Substrate is monocrystalline silicon.
Substrate is glass.
Video frame rate is at least about 25Hz.
View data is comprised of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating is to use look-up-table method to carry out.
Subhologram is used for calculating.
Holographic display is high-definition display device.
Virtual observer's window is eye pupil diameter or wider.
Show monochrome image.
Color display.
For the pixel value of computed hologram, only consider the value of the child partition of original image.
The light that is used for rebuilding is not fully relevant on whole display device, but relevant in the child partition of display device.
Reduction data transmission frequency is conducive to reduce the power consumption in the row and column driving.
The major part of the needed pixel region of row and column wire can be used for other purpose in the prior art solution.
The area of transparency electrode can be increased, the transmittance of display device can be improved thus.
Display panel can be controlled with traditional display technique.
Display device uses the liquid crystal over silicon technology to manufacture.
Display device uses the MEMS technology to manufacture.
Display device uses the field-emitter display technology to manufacture.
Holographic conversion is one-dimensional transform.
Holographic conversion is two-dimensional transform.
Redundant circuit such as TFTs, can be made in the space of picture element matrix, so that some circuit that sort circuit uses when finding that device starts can be used for some circuit of using when replacement device starts when breaking down.
The wavefront that object sends is rebuild in one or more virtual observer's windows (VOW), and wherein the reconstruction of each single object point (OP) of three-dimensional scenic (3D S) only needs subhologram (SH) as the subset of the whole hologram (H ∑ SLM) that will encode at SLM.
Turning to a plurality of object points (OP) afterwards with scene (3D S) is discrete, for the object point (OP) of each visible 3D scene, at SLM coding lens subhologram (SH L) complex values, wherein the complex values of lens subhologram is to use formula z L=exp{-i*[(π/λ f) * (x 2+ y 2)] determine, wherein λ is reference wavelength, and f is focal length, and x and y are the normal coordinates in the subhologram plane.
For mobile virtual observer window away from the optical axis, in hologram plane (HE), determine the subhologram (SH of prism P).
The subhologram of lens and the subhologram of prism are asked convolution, and this convolution can symbolically be expressed as SH=SH L* SH P
Carry out holographic space of calculating can, also can be not on the substrate identical with the substrate of display device.
Carry out the circuit of decompress(ion) calculating between the pixel of display device.
The circuit of carrying out decompress(ion) calculating is positioned at the picture element matrix outside of display device, but on same substrate.
Cluster is carried out decompress(ion) and is calculated.
Be used for the cluster of decompress(ion) calculating by the row and column wire receive data of display device.
Be used for each cluster of decompress(ion) calculating by the parallel data bus line receive data.
Each cluster that is used for decompress(ion) calculating connects receive data by serial data.
Use the method for holographic display.
D. carry out the high-definition display device that decompress(ion) calculates at same substrate
The high-definition display device of display of high resolution images data, on this display device, at first use known data compression technique packed data, then data are sent in the circuit on the display device substrate, then this circuit is carried out the data that receive and is separated compression functions, and the pixel in display device shows data subsequently.
Decompression circuit is between the pixel of display device.
It is outside that decompression circuit is positioned at the picture element matrix of display device, but with display device on same substrate.
The data of compression are transferred on the display device cluster of a whole display device part, and then cluster is carried out the data that receive and separated compression functions, and the pixel in local cluster shows data again.
Show the normal data that show.
Display holography shows data.
Carry out space that compression calculates can, also can be not on the substrate identical with the substrate of display device.
Be used for the cluster of decompress(ion) calculating by the row and column wire receive data of display device.
Be used for each cluster of decompress(ion) calculating by the parallel data bus line receive data.
Each cluster that is used for decompress(ion) calculating connects receive data by serial data.
It is very high-resolution display device.
Decompress(ion) is to be carried out at 40ms or in the time still less by each cluster.
Hologram image calculates after decompress(ion) and carries out.
Performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out.
Performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, and wherein calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel transform.
Circuit between the pixel that performed at least some calculating that are used for determining the spatial light modulator coding are usage space photomodulators is carried out.
In the zone of dispersion of display device, carry out to calculate, with in the pixel of the corresponding zone of dispersion of basis coding of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
The active area of at least some circuit is comprised of polysilicon.
The active area of at least some circuit is comprised of continuous particulate silicon.
The active area of at least some circuit is comprised of polycrystalline silicon germanium.
The active area of at least some circuit is comprised of monocrystalline silicon.
The active area of at least some circuit is comprised of individual particle silicon.
The active area of at least some circuit is comprised of organic semiconductor.
Substrate is monocrystalline silicon.
Substrate is glass.
Video frame rate is at least about 25Hz.
Only the real space image data transmission is to display device.
View data is comprised of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating carried out with look-up-table method.
Subhologram is used for calculating.
Display device uses the liquid crystal over silicon technology to manufacture.
Display device uses the MEMS technology to manufacture.
Display device uses the field-emitter display technology to manufacture.
Use the method for high-definition display device.
E. the hologram display device of calculating at same substrate, this device is played up pipeline by the 3D that incorporates attached processing unit for holographic conversion and coding into and have for the expansion of graphics subsystem.
In holographic display, performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, incorporate attached processing unit for holographic conversion and coding into so that the 3D of graphics subsystem plays up pipeline.
Holographic calculating is to carry out with the circuit between the pixel of display device.
Holographic calculate be use at the picture element matrix of display device outside but carry out with the circuit of pixel on same substrate of display device.
Performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, and wherein calculate and do not relate to the calculating of Fourier transform or the calculating of Fresnel transform.
In the zone of dispersion of display device, carry out to calculate, with in the pixel of the corresponding zone of dispersion of basis coding of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
Video frame rate is at least about 25Hz.
Only the real space image data transmission is to display device.
View data is comprised of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating carried out with look-up-table method.
Subhologram is used for calculating.
Holographic calculating at whole display device surface uniform launched.
Holography is calculated to be divided into and is tiled in the little identical part that the display device surface is called cluster.
Holographic display is high-definition display device.
Virtual observer's window is eye pupil diameter or wider.
Show monochrome image.
Color display.
For the pixel value of computed hologram, only consider the value of the child partition of original image.
The light that is used for rebuilding is not fully relevant on whole display device, but relevant in the child partition of display device.
Holographic conversion is one-dimensional transform.
Holographic conversion is two-dimensional transform.
Redundant circuit such as TFTs, can be made in the space of picture element matrix, so that some circuit that sort circuit uses when finding that device starts can be used for some circuit of using when replacement device starts when breaking down.
The wavefront that object sends is rebuild in one or more virtual observer's windows (VOW), and wherein the reconstruction of each single object point (OP) of three-dimensional scenic (3D S) only needs subhologram (SH) as the subset of the whole hologram (H ∑ SLM) that will encode at SLM.
Turning to a plurality of object points (OP) afterwards with scene (3D S) is discrete, for the object point (OP) of each visible 3D scene, at SLM coding lens subhologram (SH L) complex values, wherein the complex values of lens subhologram is to use formula z L=exp{-i*[(π/λ f) * (x 2+ y 2)] determine, wherein λ is reference wavelength, and f is focal length, and x and y are the normal coordinates in the subhologram plane.
For mobile virtual observer window away from the optical axis, in hologram plane (HE), determine the subhologram (SH of prism P).
The subhologram of lens and the subhologram of prism are asked convolution, and this convolution can symbolically be expressed as SH=SH L* SH P
Each subhologram (SH) is modulated with the phase deviation of univesral distribution, and wherein subhologram is different one by one in phase deviation.
Add with subhologram to form whole hologram.
For the reproduction of the computer-generated hologram of be used for rebuilding, this reconstruction is real-time or quasi real time.
Question blank is used for holographic calculating.
Object point can generate the optional position in rebuilding frustum.
Copy for first and show that the Z figure of wavelength is used for the second and the 3rd demonstration wavelength for twice.
To three parallel each computed holograms that shows wavelength.
The color diagram RGB content that is used for two kinds of colors is copied to independently memory portion, to guarantee three kinds of color component independent access.
The lens function and the prism function that are used for every kind of Show Color have all passed through complex multiplication.
Be the random phase place of each cluster application of display device.
The SLM coding that calculates stands follow-up processing, and additional algorithm is used in this follow-up processing in the holographic display cluster.
Use the method for holographic display.
F. the hologram display device of calculating at same substrate, this device have the mode of the 3D pipeline of the holographic graphics card that calculates pipeline by expansion, the point in the three dimensions is carried out successively holographic conversion
In holographic display, performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, so that the successively holographic conversion of the point in the three dimensions is carried out by the mode that expansion has the 3D pipeline of the holographic graphics card that calculates pipeline.
Holographic calculating is to carry out with the circuit between the pixel of display device.
Holographic calculating is to use in the outside of picture element matrix but carry out with the circuit of display device on same substrate.
Performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, and wherein calculate and do not relate to the calculating of Fourier transform or the calculating of Fresnel transform.
In the zone of dispersion of display device, carry out to calculate, with in the pixel of the corresponding zone of dispersion of basis coding of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
Video frame rate is at least about 25Hz.
Only the real space image data transmission is to display device.
View data is comprised of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating carried out with look-up-table method.
Subhologram is used for calculating.
Holographic calculating at whole display device surface uniform launched.
Holography is calculated to be divided into and is tiled in the little identical part that the display device surface is called cluster.
Holographic display is high-definition display device.
Virtual observer's window is eye pupil diameter or wider.
Show monochrome image.
Color display.
For the pixel value of computed hologram, only consider the value of the child partition of original image.
The light that is used for rebuilding is not fully relevant on whole display device, but relevant in the child partition of display device.
Holographic conversion is one-dimensional transform.
Holographic conversion is two-dimensional transform.
Redundant circuit such as TFTs, can be made in the space of picture element matrix, so that some circuit that sort circuit uses when finding that device starts can be used for some circuit of using when replacement device starts when breaking down.
The wavefront that object sends is rebuild in one or more virtual observer's windows (VOW), and wherein the reconstruction of each single object point (OP) of three-dimensional scenic (3D S) only needs subhologram (SH) as the subset of the whole hologram (H ∑ SLM) that will encode at SLM.
Turning to a plurality of object points (OP) afterwards with scene (3D S) is discrete, for the object point (OP) of each visible 3D scene, at SLM coding lens subhologram (SH L) complex values, wherein the complex values of lens subhologram is to use formula z L=exp{-i*[(π/λ f) * (x 2+ y 2)] determine, wherein λ is reference wavelength, and f is focal length, and x and y are the normal coordinates in the subhologram plane.
For mobile virtual observer window away from the optical axis, in hologram plane (HE), determine the subhologram (SH of prism P).
The subhologram of lens and the subhologram of prism are asked convolution, and this convolution can symbolically be expressed as SH=SH L* SH P
Each subhologram (SH) is modulated with the phase deviation of univesral distribution, and wherein subhologram is different one by one in phase deviation.
Add with subhologram to form whole hologram.
For the reproduction of the computer-generated hologram of be used for rebuilding, this reconstruction is real-time or quasi real time.
Question blank is used for holographic calculating.
Object point can generate the optional position in rebuilding frustum.
The 3D of graphics subsystem plays up pipeline and incorporates attached processing unit for holographic conversion and coding into.
Copy for first and show that the Z figure of wavelength is used for the second and the 3rd demonstration wavelength for twice.
To three parallel each computed holograms that shows wavelength.
The color diagram RGB content that is used for two kinds of colors is copied to independently memory portion, to guarantee three kinds of color component independent access.
The lens function and the prism function that are used for every kind of Show Color have all passed through complex multiplication.
Be the random phase place of each cluster application of display device.
The SLM coding that calculates stands follow-up processing, and additional algorithm is used in this follow-up processing in the holographic display cluster.
Holographic calculating can beginning before color diagram and Z buffering are all available.
The holography that carry out to be used for each subhologram is calculated the needed time and is less than a frame time cycle.
It is 17ms or still less that the needed time is calculated in the holography that carry out to be used for each subhologram.
Be used for Military Application.
The question blank that each cluster of display device has oneself is used for storing the coding of the subhologram of its demonstration.
Read after the content from the SH of LUT, calculated (the SH of current demonstration N-1) with new SH (SH n) poor.
The successively holographic conversion of the point in the three dimensions, the mode that has the 3D pipeline of the holographic graphics card that calculates pipeline by expansion is carried out, and is not subjected to the restriction of particular type SLM.
Use the method for holographic display.
G. the hologram display device of calculating at same substrate, it carries out randow addressing to holographic display
In holographic display, performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, are the poor of continuous real space image frame to be used in the holographic real space image data of calculating, and the holographic data that show are sent to the holographic display cluster with the form of subhologram differential data and display storage location data.
The successively holographic conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Holographic calculating is to carry out with the circuit between the pixel of display device.
Holographic calculate be use at picture element matrix outside but carry out with the circuit of display device on same substrate.
Performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, and wherein calculate and do not relate to the calculating of Fourier transform or the calculating of Fresnel transform.
In the zone of dispersion of display device, carry out to calculate, with in the pixel of the corresponding zone of dispersion of basis coding of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
Video frame rate is at least about 25Hz.
Only the real space image data transmission is to display device.
View data is comprised of intensity and depth map data.
Holographic calculating is to carry out in real time or quasi real time.
Holographic calculating carried out with look-up-table method.
Show subhologram.
Holographic calculating at whole display device surface uniform launched.
Holography is calculated to be divided into and is tiled in the little identical part that the display device surface is called cluster.
Holographic display is high-definition display device.
Virtual observer's window is eye pupil diameter or wider.
Show monochrome image.
Color display.
For the pixel value of computed hologram, only consider the value of the child partition of original image.
The light that is used for rebuilding is not fully relevant on whole display device, but relevant in the child partition of display device.
Holographic conversion is one-dimensional transform.
Holographic conversion is two-dimensional transform.
Redundant circuit such as TFTs, can be made in the space of picture element matrix, so that some circuit that sort circuit uses when finding that device starts can be used for some circuit of using when replacement device starts when breaking down.
The wavefront that object sends is rebuild in one or more virtual observer's windows (VOW), and wherein the reconstruction of each single object point (OP) of three-dimensional scenic (3D S) only needs subhologram (SH) as the subset of the whole hologram (H ∑ SLM) that will encode at SLM.
Turning to a plurality of object points (OP) afterwards with scene (3D S) is discrete, for the object point (OP) of each visible 3D scene, at SLM coding lens subhologram (SH L) complex values, wherein the complex values of lens subhologram is to use formula z L=exp{-i*[(π/λ f) * (x 2+ y 2)] determine, wherein λ is reference wavelength, and f is focal length, and x and y are the normal coordinates in the subhologram plane.
For mobile virtual observer window away from the optical axis, in hologram plane (HE), determine the subhologram (SH of prism P).
The subhologram of lens and the subhologram of prism are asked convolution, and this convolution can symbolically be expressed as SH=SH L* SH P
Each subhologram (SH) is modulated together with the phase deviation of univesral distribution, and wherein subhologram is different one by one in phase deviation.
Add with subhologram to form whole hologram.
For the reproduction of the computer-generated hologram of be used for rebuilding, this reconstruction is real-time or quasi real time.
Object point can generate the optional position in rebuilding frustum.
The 3D of graphics subsystem plays up pipeline and incorporates attached processing unit for holographic conversion and coding into.
Copy for first and show that the Z figure of wavelength is used for the second and the 3rd demonstration wavelength for twice.
To three parallel each computed holograms that shows wavelength.
The color diagram RGB content that is used for two kinds of colors is copied to independently memory portion, to guarantee three kinds of color component independent access.
The lens function and the prism function that are used for every kind of Show Color have all passed through complex multiplication.
Be the random phase place of each cluster application of display device.
The SLM coding that calculates stands follow-up processing, and additional algorithm is used in this follow-up processing in the holographic display cluster.
Be used for Military Application.
Receive the image difference data by holographic computing unit.
If do not have difference between the demonstration data of given cluster place successive frame, or difference can ignore, and then do not need to send data to cluster.
Send the 3D discrepancy view data (3D difference point image data) relevant with the reconstruction point that is used for encoding at SLM to each holographic computing unit.
In each holographic display cluster separation vessel is arranged, this separation vessel shows that with the hologram that calculates data are divided into subhologram data and size and positional information, wherein, both values can be used for calculating the address realm of subhologram among the RAM afterwards, so that subhologram SH or SH DData be written in the SLM unit correct in the cluster.
Use special random access memory (RAM): only write new SH or SH at input side DS reads line by line whole storer at outgoing side simultaneously, and writes information to SLM.
Use the method for holographic display.
H. the display device that in pixel space, has computing function
In display device, computing function is to carry out by the circuit that the pixel with display device is arranged on the same substrate.
Computing function is to carry out by the circuit between the pixel of display device.
Computing function is by outside but carry out with the circuit of display device on same substrate at picture element matrix.
Carry out in other position if be arranged on the computing function that the circuit on the same substrate carries out by the pixel with display device, then the time-delay meeting when display device shows data still less.
Calculating is graphic computation.
It is the part of high speed game station.
Be used for Military Application.
In the zone of dispersion of display device, carry out to calculate, with in the pixel of the corresponding zone of dispersion of basis coding of zone of dispersion one by one.
Circuit comprises thin film transistor (TFT).
The active area of at least some circuit is comprised of polysilicon.
The active area of at least some circuit is comprised of continuous particulate silicon.
The active area of at least some circuit is comprised of polycrystalline silicon germanium.
The active area of at least some circuit is comprised of monocrystalline silicon.
The view data frame rate is at least about 25Hz.
Can be that the calculating of parallel computation is divided into and is tiled in the little identical part that the display device surface is called cluster.
Demonstration can come together by identical cluster is tiled to set up.
Display device is high-definition display device.
Display device is very high-resolution display device.
Color display.
The coloured image that shows is rgb format.
Display device uses the liquid crystal over silicon technology to manufacture.
Exist to be used for the local additional logic of transmitting the data that calculate, and additional logic can also be in the lump for transmitting original image to cluster, so that can eliminate at least some overall row and column wires.
Use the method for display device
I. block
In holographic display, performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, and for this holographic display, guarantee to cover further from the object point of virtual observer's window along the more close virtual observer's of identical sight line object point.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel transform.
In the outside computed hologram coded data in the occupied space of picture element matrix, then with known data compression technique compression hologram coded data, then be transferred to the circuit on the display device substrate, this circuit is carried out the data that receive and is separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates attached processing unit for holographic conversion and coding into.
The successively holographic conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and the holographic data that show send to the holographic display cluster with the form of subhologram differential data and display storage location data.
Implement to block with calculating, this calculating is by carrying out with the circuit of picture element matrix on same substrate.
Implement to block with calculating, this calculating is to carry out by the circuit between the pixel of display device.
Virtual observer's window is eye pupil diameter or wider.
VOW is divided into two or more segments.
The size of each VOW segment and human eye pupil size are basic identical.
Each VOW segment is by different subhologram codings.
Block is to carry out in the stage that makes up depth map and intensity map.
Use the method for holographic display.
J. graphics card function
In holographic display, performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, and wherein the graphics card function is to implement by using with the circuit of pixel on same substrate of display device.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel transform.
Then outside computed hologram coded data in the occupied space of picture element matrix uses known data compression technique compression hologram coded data, then is transferred to the circuit on the display device substrate, and this circuit is carried out the data that receive and separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates attached processing unit for holographic conversion and coding into.
The successively holographic conversion of three dimensions mid point is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and the holographic data that show send to the holographic display cluster with the form of subhologram differential data and display storage location data.
The graphics card function is by using the circuit between the pixel of display device to implement.
The graphics card function is to implement by using at the circuit of picture element matrix outside.
The graphics card function comprises texture.
The graphics card function comprises plays up polygon.
The graphics card function comprises the summit is transformed in the different coordinate systems.
The graphics card function comprises tinter able to programme.
The graphics card function comprises reducing over-sampling and the interpolation technique of aliasing.
The graphics card function comprises very high-precision color space.
The graphics card function comprises 2D speed-up computation ability.
The graphics card function comprises the frame surge capability.
The graphics card function comprises Motion Picture Experts Group (Moving Picture Experts Group, MPEG) pel.
The graphics card function comprises carries out the calculating that relates to matrix and vector operations.
The graphics card function comprises uses 3D to play up pipeline, and this 3D plays up device for cleaning pipeline and crosses with the TFTs of picture element matrix on same substrate and implement.
Use the method for holographic display.
K.2D-3D conversion
In holographic display, performed being used for determines that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, and implements the 2D-3D image transitions in this holographic display.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel transform.
In the outside computed hologram coded data in the occupied space of picture element matrix, then use known data compression technique compression hologram coded data, then be transferred to the circuit on the display device substrate, this circuit is carried out the data that receive and is separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates attached processing unit for holographic conversion and coding into.
The successively holographic conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and the holographic data that show send to the holographic display cluster with the form of subhologram differential data and display storage location data.
The 2D-3D image turns to be to use with the circuit of pixel on same substrate of display device to be implemented.
The 2D-3D image turn be to use with the pixel of display device not the circuit on same substrate implement.
The 2D-3D image transitions is to use the circuit between the pixel of display device to implement.
The 2D-3D image transitions be use at picture element matrix outside but implement with the circuit of pixel on same substrate of display device.
The 2D-3D image transitions is to implement with paired stereo-picture.
Display device from the data that receive Two-dimensional (2D) image with and corresponding depth map.
The circuit Internet access of carrying out the 2D-3D conversion comprises the data bank of one group of known 3D shape.
The circuit Internet access of carrying out the 2D-3D conversion comprises the data bank of one group of known 2D sectional view, and this circuit manages to find out the 2D sectional view that is complementary with the 2D view data of importing into.
The 2D-3D image transitions is based on single, non-automatic three-dimensional 2D image and carries out.
Use the method for holographic display.
L. meeting (3D Skype TM)
Provide based on the voice of Internet Protocol and the holographic display of hologram image (voice and holographicimage over internet protocol, VHIOIP) service with it.
Performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel transform.
Then outside computed hologram coded data in the occupied space of picture element matrix uses known data compression technique compression hologram coded data, then is transferred to the circuit on the display device substrate, and this circuit is carried out the data that receive and separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates attached processing unit for holographic conversion and coding into.
The successively holographic conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and the holographic data that show send to the holographic display cluster with the form of subhologram differential data and display storage location data.
The VHIOIP point-to-point communication is provided.
File-sharing is provided.
In the global network that connects, provide the instant messages service.
In the computer network that connects, provide communication service.
In the computer network that connects, provide file-sharing service.
In the computer network that connects, provide the instant messages service.
Interim use online, that permission user that can not download uses the computer software of VHIOIP communication service is provided.
The permission user who is provided for downloading uses the online software of VHIOIP communication service.
Be provided for accessing the holographic territory of data or the entrance of regional data base system of showing.
Use the method for holographic display.
M. coding compensation
In holographic display, before coding step or coding step, the hologram image data are applied compensation so that the image of more easily watching to be provided.
Performed be used for determining that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel transform.
Then outside computed hologram coded data in the occupied space of picture element matrix uses known data compression technique compression hologram coded data, then is transferred to the circuit on the display device substrate, and this circuit is carried out the data that receive and separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates attached processing unit for holographic conversion and coding into.
The successively holographic conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and the holographic data that show send to the holographic display cluster with the form of subhologram differential data and display storage location data.
Compensation is to use the circuit of pixel on same substrate with display device to apply.
Compensation is to use the circuit between the pixel of display device to apply.
Compensation is applied on the hologram image data at coding step.
Compensation is being applied to before the coding step on the hologram image data.
Applying compensation mainly is thin shade (light tones) and the scene of tending to under-exposure to proofread and correct.
Applying compensation mainly is low key tone (dark tones) and tends to over-exposed scene to proofread and correct.
Use the method for holographic display.
N. eyes are followed the trail of
In holographic display, performed being used for determines that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, and implements eyes and follow the trail of in this holographic display.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel transform.
Then outside computed hologram coded data in the occupied space of picture element matrix uses known data compression technique compression hologram coded data, then is transferred to the circuit on the display device substrate, and this circuit is carried out the data that receive and separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates attached processing unit for holographic conversion and coding into.
The successively holographic conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and the holographic data that show send to the holographic display cluster with the form of subhologram differential data and display storage location data.
For implementing eyes, single observer follows the trail of.
For implementing eyes, a plurality of observers follow the trail of.
The eyes tracking is to limit the hunting zone by the face through surveying the user, then limits tracking range by surveying eyes, implements by the tracking eyes again.
The eyes that are provided for carrying out the eye position recognition function are followed the trail of computing module, and the stereo-picture that provided by stereo camera pair is provided this module.
Module is returned each eye with respect to the x-of point of fixity, y-, and z-coordinate.
To follow the trail of needed calculating be by carrying out with the circuit of display device pixel on same substrate in order to carry out.
To follow the trail of needed calculating be to carry out by the circuit in picture element matrix in order to carry out.
Holographic encoding on the SLM panel can be displaced in the panel plane.
An eyes tracking in a lateral direction is to realize by x-or the whole holographic encoding content of y-direction superior displacement at SLM.
Follow the trail of so that coherently illuminate light source and the observer's change in location synchronizing moving of SLM.
Use the method for holographic display.
O. aberration correction
In holographic display, performed being used for determines that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, and implements aberration correction in this holographic display.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel transform.
Then outside computed hologram coded data in the occupied space of picture element matrix uses known data compression technique compression hologram coded data, then is transferred to the circuit on the display device substrate, and this circuit is carried out the data that receive and separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates attached processing unit for holographic conversion and coding into.
The successively holographic conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and the holographic data that show send to the holographic display cluster with the form of subhologram differential data and display storage location data.
Aberration correction is to use with the circuit of picture element matrix on same substrate to implement.
Aberration correction is to use the circuit between pixel to implement.
Aberration is dynamically to proofread and correct by the coding of spatial light modulator.
Aberration after the correction is the aberration in the lens in microlens array.
Aberration after the correction is the aberration in the lens in the 2D lens arra.
Show subhologram.
Total hologram is generated by subhologram.
The aberration correction algorithm be calculate with holography until the step that generates total hologram concurrently, carry out independently.
Total hologram and aberration correction figure modulate together.
The aberration correction algorithm is to resolve to implement.
The aberration correction algorithm uses question blank (LUT) to implement.
Use the method for holographic display.
P. spot is proofreaied and correct
In holographic display, performed being used for determines that at least some calculating of spatial light modulator coding are to use with the circuit of pixel on same substrate of spatial light modulator to carry out, and implements spot and proofread and correct in this holographic display.
Calculating itself does not relate to the calculating of Fourier transform or the calculating of Fresnel transform.
Then outside computed hologram coded data in the occupied space of picture element matrix uses known data compression technique compression hologram coded data, then is transferred to the circuit on the display device substrate, and this circuit is carried out the data that receive and separated compression functions.
The 3D of graphics subsystem plays up pipeline and incorporates attached processing unit for holographic conversion and coding into.
The successively holographic conversion of the point in the three dimensions is to carry out by the mode that expansion has a 3D pipeline of the holographic graphics card that calculates pipeline.
Being used for the holographic real space image data of calculating is the poor of continuous real space image frame, and the holographic data that show send to the holographic display cluster with the form of subhologram differential data and display storage location data.
It is to use with the circuit of picture element matrix on same substrate to implement that spot is proofreaied and correct.
It is to use the circuit between pixel to implement that spot is proofreaied and correct.
Spot is dynamically to proofread and correct by the coding of spatial light modulator.
Show subhologram.
Total hologram is generated by subhologram.
The spot correcting algorithm be calculate with holography until the step that generates total hologram concurrently, carry out independently.
Total hologram and spot correction chart are modulated together.
The spot correcting algorithm is to resolve to implement.
The spot correcting algorithm uses question blank (LUT) to implement.
Use the method for holographic display.
Q. be used for the deciphering in the digital copyright management (Digital Rights Management, DRM) of holographic display
In holographic display, it is to carry out with the circuit on the picture element matrix substrate that deciphering and hologram calculate.
It is the distributed execution of circuit of using on the substrate that is distributed in picture element matrix that deciphering and hologram calculate.
It is to carry out with the circuit in the picture element matrix that deciphering and hologram calculate.
Deciphering and hologram calculate to be to use in the picture element matrix outside but to carry out with the circuit of picture element matrix on same substrate.
There are not the individually square data that can catch all deciphering on the substrate.
Different panel zones is used different decruption keys.
Use the method for holographic display.
R. be used for the deciphering of the digital copyright management (DRM) of 2D demonstration
In the 2D display device, it is the distributed execution of circuit of using on the substrate that is distributed in picture element matrix that deciphering is calculated.
It is the distributed execution of circuit of using in picture element matrix that deciphering is calculated.
Deciphering calculate to be is used at picture element matrix outside but with the circuit distributed execution of picture element matrix on same substrate.
There are not the individually square data that can catch all deciphering on the substrate.
Different substrate regions is used different decruption keys.
Use the method for display device.
In the 2D display device, it is to use the circuit in the single zone of display device substrate to carry out that deciphering is calculated.
Circuit is inner at picture element matrix.
Circuit is outside at picture element matrix.
Use the method for display device.
S. the software application of in the hardware that firmly is connected to display device, implementing
In display device, can be by the application of implementing with software, on the contrary in hardware by implementing with the circuit on the substrate that is distributed in the SLM panel.
Display device is the 2D display device.
Display device is holographic display.
Application is to use the circuit between the pixel of display device to implement.
Application is to use at the circuit of the picture element matrix outside of display device to implement.
Use the method for display device.
T. the variable beam deflection of implementing with microprism
Come tracing study person's holographic display with the microprism array that can control beam deflection.
Two-dimensional deflection is to obtain by the microprism array with two series connection.
Prism is little liquid prism.
Can reduce the optical effect of lens aberration.
VOWs is arranged on observer's eyes place.
Being arranged on the front of prism array or the focusing instrument of back helps convergence of rays in VOW.
Prism does not have identical deflection angle entirely.
Prism not all has identical deflection angle, so that assemble a little at VOW from the light of prism array ejaculation.
Prism angle calculate to be to carry out in the counting circuit on the SLM substrate.
It is to carry out in the counting circuit that the prism array substrate arranges that prism angle is calculated.
The substrate of SLM also is used as the substrate of prism array.
Apply phase correction discontinuous with the caused phase place of compensating prism array.
Phase correction is carried out by SLM.
Generating hologram picture in the projection type device, wherein projection comprises SLM is imaged onto on the prism array, and the reconstruction of desired 3D scene occurs in the place ahead of VOW simultaneously.
When being imaged onto SLM on the prism array, provide the phase compensation to prism array.
Phase compensation to prism array is to be provided by the additional SLM that is arranged near prism array.
SLM is printing opacity, and prism array is reflective.
SLM is reflective, and prism array is printing opacity.
Use the method for holographic display.

Claims (17)

1. holographic display, comprise spatial light modulator (SLM), also comprise position sensing and tracing system, so that observer's eye position is tracked, towards the deflection of the variable beam of observer's eye position by carrying out with the microprism array that can control beam deflection, wherein, apply phase correction discontinuous with the caused phase place of compensating prism array, thereby compensation is towards the different optical path lengths of observer's eye position.
2. holographic display according to claim 1 is characterized in that, the deflection of variable beam is continually varying, and/or the deflection of variable beam is carried out the moistening technology of electricity consumption.
3. holographic display according to claim 1 is characterized in that, the deflection of variable beam is carried out with variable voltage is poor, and this variable voltage is poor to be applied on the Different electrodes of the not ipsilateral that is positioned at each electric moistening cell array.
4. holographic display according to claim 1, it is characterized in that, microprism array comprises a plurality of prisms, this prism is electric moistening unit, each electric moistening unit has at least two electrodes and the interphase between electrically conducting transparent liquid and other liquid, wherein each electrode scribbles hydrophobic insulator, and interfacial contact angle can form the function of voltage difference, and this voltage difference is applied at least one electrode with respect to electrically conducting transparent liquid.
5. holographic display according to claim 1 is characterized in that, two-dimensional deflection obtains by the microprism array that uses two series connection.
6. holographic display according to claim 1, it is characterized in that, the lens that described device comprises pointolite or line source and is used for focusing on, wherein, virtual observer's window (VOW) is arranged on observer's eyes place, virtual observer's window (VOW) generates in the Fourier plane of spatial light modulator (SLM), and the size of virtual observer's window (VOW) is all period interval of an order of diffraction of excess space photomodulator (SLM) not.
7. holographic display according to claim 6 is characterized in that, the lens that are arranged on the focusing of prism array front or back help convergence of rays to virtual observer's window (VOW).
8. holographic display according to claim 1 is characterized in that, can be by the dynamic calibration of the coding of spatial light modulator being reduced the optical effect of lens aberration.
9. according to claim 1 or 8 described holographic displays, it is characterized in that, independent control between prism is mutual, therefore beam deflection is set up in the control that depends on each prism of each prism, and/or prism not all has identical deflection angle, locates to assemble at virtual observer's window (VOW) so that penetrate the light of prism array.
10. holographic display according to claim 1, it is characterized in that, it is to carry out in the counting circuit on spatial light modulator (SLM) substrate that prism angle is calculated, and perhaps, it is to carry out in the counting circuit on being arranged on the substrate of prism array that prism angle is calculated.
11. holographic display according to claim 1 is characterized in that, the substrate of spatial light modulator (SLM) also is used as the substrate of prism array.
12. holographic display according to claim 1, it is characterized in that, spatial light modulator (SLM) can change the phase place with the interactional light of spatial light modulator (SLM), and wherein, phase correction is carried out by the operation of spatial light modulator (SLM).
13. according to claim 1 or 8 described holographic displays, it is characterized in that, hologram image generates in the projection type device, wherein in described projection type device, the reconstruction of desired 3D scene occurs in image projection on the spatial light modulator (SLM) simultaneously in the front of virtual observer's window (VOW) to prism array.
14. according to claim 1 or 12 described holographic displays, it is characterized in that, when being imaged onto spatial light modulator (SLM) on the prism array, for prism array provides phase correction.
15. according to claim 1 or 12 described holographic displays, it is characterized in that, provide phase correction by the additional space photomodulator (SLM) that is arranged near prism array for prism array.
16. holographic display according to claim 1, it is characterized in that, spatial light modulator (SLM) when being printing opacity prism array be reflective or printing opacity, perhaps, prism array was printing opacity when spatial light modulator (SLM) was reflective.
17. the method for the holographic reconstruction of a generating three-dimensional scene, this three-dimensional scenic is comprised of a plurality of discrete points, and the method is used the described holographic display of above-mentioned arbitrary claim, and this display device comprises light source and the optical system of lighting space photomodulator; Described method comprises step:
Encoded holographic figure on spatial light modulator.
CN200880024344.9A 2007-05-16 2008-05-16 Holographic display Expired - Fee Related CN101743519B (en)

Applications Claiming Priority (39)

Application Number Priority Date Filing Date Title
GB0709376.8 2007-05-16
GB0709379.2 2007-05-16
DE102007023739.3 2007-05-16
DE102007023739.3A DE102007023739B4 (en) 2007-05-16 2007-05-16 Method for rendering and generating color video holograms in real time and holographic display device
DE102007023785.7A DE102007023785B4 (en) 2007-05-16 2007-05-16 Analytical method for calculating video holograms in real time and holographic display device
GB0709376A GB0709376D0 (en) 2007-05-16 2007-05-16 Smart display
DE102007023737.7 2007-05-16
DE102007023737A DE102007023737B4 (en) 2007-05-16 2007-05-16 Method for generating video holograms in real time for extending a 3D rendering graphics pipeline
GB0709379A GB0709379D0 (en) 2007-05-16 2007-05-16 Smart display extended
DE102007023740.7 2007-05-16
DE102007023740A DE102007023740B4 (en) 2007-05-16 2007-05-16 Method for generating video holograms for a holographic display device with random addressing
DE102007023785.7 2007-05-16
GB0718632.3 2007-09-25
GB0718622.4 2007-09-25
GB0718614.1 2007-09-25
GB0718633.1 2007-09-25
GBGB0718649.7A GB0718649D0 (en) 2007-05-16 2007-09-25 Holograms
GB0718656.2 2007-09-25
GB0718617.4 2007-09-25
GB0718654.7 2007-09-25
GBGB0718602.6A GB0718602D0 (en) 2007-05-16 2007-09-25 Holograms
GB0718629.9 2007-09-25
GBGB0718654.7A GB0718654D0 (en) 2007-05-16 2007-09-25 Holograms
GB0718595.2 2007-09-25
GB0718596A GB0718596D0 (en) 2007-05-16 2007-09-25 Holograms
GBGB0718656.2A GB0718656D0 (en) 2007-05-16 2007-09-25 Holograms
GB0718619.0 2007-09-25
GB0718659.6 2007-09-25
GB0718596.0 2007-09-25
GB0718626.5 2007-09-25
GB0718636.4 2007-09-25
GB0718598.6 2007-09-25
GB0718607.5 2007-09-25
GB0718649.7 2007-09-25
GB0718602.6 2007-09-25
GB0718634.9 2007-09-25
GBGB0718598.6A GB0718598D0 (en) 2007-05-16 2007-09-25 Holograms
GB0718640.6 2007-09-25
PCT/EP2008/056030 WO2008138986A2 (en) 2007-05-16 2008-05-16 Holographic display with microprism array

Publications (2)

Publication Number Publication Date
CN101743519A CN101743519A (en) 2010-06-16
CN101743519B true CN101743519B (en) 2013-04-24

Family

ID=48141638

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200880024344.9A Expired - Fee Related CN101743519B (en) 2007-05-16 2008-05-16 Holographic display

Country Status (1)

Country Link
CN (1) CN101743519B (en)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9864184B2 (en) 2012-10-30 2018-01-09 California Institute Of Technology Embedded pupil function recovery for fourier ptychographic imaging devices
WO2014070656A1 (en) 2012-10-30 2014-05-08 California Institute Of Technology Fourier ptychographic imaging systems, devices, and methods
US10652444B2 (en) 2012-10-30 2020-05-12 California Institute Of Technology Multiplexed Fourier ptychography imaging systems and methods
US9497379B2 (en) 2013-08-22 2016-11-15 California Institute Of Technology Variable-illumination fourier ptychographic imaging devices, systems, and methods
JP2016534389A (en) 2013-07-31 2016-11-04 カリフォルニア インスティチュート オブ テクノロジー Aperture scanning Fourier typography imaging
US11468557B2 (en) 2014-03-13 2022-10-11 California Institute Of Technology Free orientation fourier camera
EP3238135B1 (en) 2014-12-22 2020-02-05 California Institute Of Technology Epi-illumination fourier ptychographic imaging for thick samples
WO2016105281A1 (en) * 2014-12-26 2016-06-30 Koc University Near-to-eye display device
CN107209362B (en) * 2015-01-21 2020-11-06 加州理工学院 Fourier ptychographic tomography
CN109507155B (en) 2015-01-26 2021-08-24 加州理工学院 Array-level fourier ptychographic imaging
JP2018509622A (en) 2015-03-13 2018-04-05 カリフォルニア インスティチュート オブ テクノロジー Aberration correction in incoherent imaging systems using Fourier typography techniques
GB201509418D0 (en) * 2015-06-01 2015-07-15 Univ Dundee Fibre based imaging
CN105390066A (en) * 2015-12-02 2016-03-09 昆山龙腾光电有限公司 Display device
US11300924B2 (en) * 2016-03-02 2022-04-12 Seereal Technologies S.A. Illumination device
US10568507B2 (en) 2016-06-10 2020-02-25 California Institute Of Technology Pupil ptychography methods and systems
US11092795B2 (en) 2016-06-10 2021-08-17 California Institute Of Technology Systems and methods for coded-aperture-based correction of aberration obtained from Fourier ptychography
CN108398872B (en) * 2017-02-06 2019-08-27 京东方科技集团股份有限公司 A kind of holographic display device and its display methods, display device
CN107015466B (en) * 2017-04-19 2019-07-19 电子科技大学 Optical scanner holography one-point positioning method based on TR-MUSIC algorithm
US10754140B2 (en) 2017-11-03 2020-08-25 California Institute Of Technology Parallel imaging acquisition and restoration methods and systems
GB2580298B (en) * 2018-11-12 2021-08-11 Dualitas Ltd A spatial light modulator for holographic projection
CN110476864B (en) * 2019-09-17 2022-05-06 广东工业大学 Intelligent fish tank system
CN113687586B (en) * 2021-07-23 2022-10-21 四川大学 Large-field-angle holographic display method for seamlessly splicing multi-segment cylindrical surfaces
CN115616790B (en) * 2022-12-20 2023-04-07 煤炭科学研究总院有限公司 Hologram display system based on volume holographic optical waveguide
CN116819909B (en) * 2023-08-31 2023-11-17 光科芯图(北京)科技有限公司 Data compression method, device, exposure equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020142504A1 (en) * 2001-01-30 2002-10-03 Eastman Kodak Company System for integrating digital control with common substrate display devices
CN1751525A (en) * 2003-02-21 2006-03-22 皇家飞利浦电子股份有限公司 Autostereoscopic display
WO2006050340A2 (en) * 2004-11-01 2006-05-11 Polytechnic University Methods and apparatus for modifying gel adhesion strength
WO2006119760A2 (en) * 2005-05-13 2006-11-16 Seereal Technologies Gmbh Projection device and method for holographic reconstruction of scenes

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020142504A1 (en) * 2001-01-30 2002-10-03 Eastman Kodak Company System for integrating digital control with common substrate display devices
CN1751525A (en) * 2003-02-21 2006-03-22 皇家飞利浦电子股份有限公司 Autostereoscopic display
WO2006050340A2 (en) * 2004-11-01 2006-05-11 Polytechnic University Methods and apparatus for modifying gel adhesion strength
WO2006119760A2 (en) * 2005-05-13 2006-11-16 Seereal Technologies Gmbh Projection device and method for holographic reconstruction of scenes

Also Published As

Publication number Publication date
CN101743519A (en) 2010-06-16

Similar Documents

Publication Publication Date Title
CN101743519B (en) Holographic display
CN101802726B (en) Holographic display with communications
CN101802725B (en) Holographic display
US8218211B2 (en) Holographic display with a variable beam deflection
TWI564876B (en) The full-image display is reconstructed with all-dimensional images that produce a three-dimensional scene
TWI412904B (en) A holographic display and method of generating a holographic reconstruction of a three dimensional scene

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130424

Termination date: 20160516