WO2008138980A2 - Verfahren zur generierung von videohologrammen für eine holographische wiedergabeeinrichtung mit wahlfreier adressierung - Google Patents
Verfahren zur generierung von videohologrammen für eine holographische wiedergabeeinrichtung mit wahlfreier adressierung Download PDFInfo
- Publication number
- WO2008138980A2 WO2008138980A2 PCT/EP2008/056023 EP2008056023W WO2008138980A2 WO 2008138980 A2 WO2008138980 A2 WO 2008138980A2 EP 2008056023 W EP2008056023 W EP 2008056023W WO 2008138980 A2 WO2008138980 A2 WO 2008138980A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- hologram
- sub
- data
- object point
- light modulator
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 65
- 230000015654 memory Effects 0.000 claims description 38
- 230000005540 biological transmission Effects 0.000 claims description 14
- 238000003860 storage Methods 0.000 claims description 14
- 238000003384 imaging method Methods 0.000 claims description 12
- 230000003287 optical effect Effects 0.000 claims description 7
- 230000006870 function Effects 0.000 claims description 6
- 238000009826 distribution Methods 0.000 claims description 5
- 238000005520 cutting process Methods 0.000 claims description 2
- 238000000926 separation method Methods 0.000 claims description 2
- 238000001514 detection method Methods 0.000 claims 1
- 238000012545 processing Methods 0.000 description 8
- 210000001747 pupil Anatomy 0.000 description 6
- 238000009877 rendering Methods 0.000 description 6
- 230000009466 transformation Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 239000011159 matrix material Substances 0.000 description 4
- 238000012546 transfer Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000000844 transformation Methods 0.000 description 3
- 230000005855 radiation Effects 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000001093 holography Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
- G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2294—Addressing the hologram to an active spatial light modulator
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
- G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
- G03H2001/0825—Numerical processing in hologram space, e.g. combination of the CGH [computer generated hologram] with a numerical optical element
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
- G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
- G03H2001/0833—Look up table
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2210/00—Object characteristics
- G03H2210/30—3D object
- G03H2210/36—Occluded features resolved due to parallax selectivity
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2210/00—Object characteristics
- G03H2210/40—Synthetic representation, i.e. digital or optical object decomposition
- G03H2210/45—Representation of the decomposed object
- G03H2210/452—Representation of the decomposed object into points
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2226/00—Electro-optic or electronic components relating to digital holography
- G03H2226/05—Means for tracking the observer
Definitions
- the invention relates to a method for generating video holograms for a holographic display device with random addressing.
- the means for carrying out the method are referred to as content generation.
- the content generation generates the hologram values required for display on the holographic display device and can thus be interpreted as a data source.
- the generated hologram values can be transmitted directly to the holographic display device or stored in digital storage means.
- a holographic display device with random addressing is interpreted as a data receiver and provides the holographic representation of the hologram data generated according to the method or the content generation.
- Real-time holograms have been used in key areas due to the advancement of hardware components and computational techniques.
- An important task of digital holography is to handle a much higher amount of data per image compared to conventional video data. This large amount of data places very high demands on the storage and transmission media, such as network components and bus systems. Even the transmission and processing of conventional video data places high demands on these resources.
- a holographic reproduction device is fundamentally based on the principle that at least one light modulator means into which a scene decomposed into object points is encoded as an overall hologram and is to be seen as a reconstruction from a visibility region which lies within a periodicity interval of the reconstructed video hologram a sub-hologram is defined with each object point of the scene to be reconstructed and the total hologram is formed from a superimposition of sub-holograms.
- the principle is pursued to primarily reconstruct the wavefront that would emit an object into one or more visibility regions.
- the holographic display device contains at least one screen means.
- the on-screen means are either the light modulator itself in which the hologram of a scene is coded or an optical element-for example a lens or mirror-onto which a hologram coded in the light modulator or a wavefront of a scene coded in the light modulator is imaged.
- a device for controlling the intensity, color and / or phase by switching, blanking or modulating light beams of one or more independent light sources is referred to as light modulator means or SLM.
- a holographic display typically includes a matrix of controllable pixels, the pixels varying the amplitude and / or phase of transmitted light to reconstruct the object points.
- a light modulator means comprises such a matrix.
- the light modulator means may, for example, be implemented discretely as acousto-optic modulator AOM or also continuously.
- An embodiment for the reconstruction of the holograms by amplitude modulation can be carried out with a liquid crystal display (LCD).
- the present invention also relates to other controllable devices for modulating sufficiently coherent light into a lightwave front or to a lightwave relief.
- pixel comprises a controllable hologram pixel of the light modulator, represents a discrete value of the hologram point and is individually addressed and controlled. Each pixel represents a hologram point of the hologram.
- a pixel means an individually controllable display pixel.
- a pixel is an individually controllable micromirror or a small group thereof.
- a pixel comprises an imaginary region representing the hologram point.
- a pixel is usually divided into a plurality of subpixels, which represent the primary colors.
- transformation is to be construed as including any mathematical or computational technique that approximates or approximates a transformation. Transformations in the mathematical sense are merely approximations of physical processes, which are described in more detail by Maxwell's wave propagation equations. Transformations such as Fresnel transforms or the special group of transforms known as Fourier transforms describe second order approximations. Transformations usually lead to algebraic and non-differential descriptions and can therefore be handled computationally efficiently and performant. Moreover, they can be modeled precisely as optical systems.
- the middle! for content generation the data source, for example, graphics cards or graphics subsystems that implement the so-called 3D rendering pipeline.
- the 3D rendering graphics pipeline describes the path from the vectorial, mathematical description of a 3D scene to rasterized Image data in a frame buffer for display on a monitor.
- the three-dimensional image data includes depth information and, as a rule, additional descriptions of material and surface properties.
- the conversion of screen coordinates into device coordinates, texturing, clipping and anti-aliasing takes place.
- the rasterized image 1 a 2D projection of the 3D scene, which is stored in the frame buffer of a graphics adapter, now contains the data of the pixel values for the controllable pixels of a monitor, for example an LCD display.
- the holographic pipeline From the results of the 3D rendering graphics pipeline, the holographic pipeline generates the complex log ram values for display on the holographic display device.
- the object of the invention is to provide a method which significantly reduces the amount of data generated for video holograms. Consequently, the amount of data that is to be transmitted between the data source, that is, means of content generation, and the data receiver, ie the holographic display device, should be minimized. Consequently, the amount of data required to store the video holograms in digital storage media should also be reduced.
- a holographic display device is to be created, which ensures that the sequence can be presented without any loss of quality even in the case of the reduced amount of received data.
- the method should allow to use known means for data storage and data transmission. A manageable amount of data should help to enable a retransmission and acceptance of video holograms.
- the entire amount of data from the means for content generation - as a data source - to a holographic display device - as a data receiver - transmitted.
- the entire hologram information is transmitted, even those that have not changed in a picture change.
- As a hologram object points in reconstructs three-dimensional space it is sufficient to first know which object points have changed in an image frame compared to the previous image frame. The change affects in particular the situation but also the color and brightness.
- the method according to the invention for generating video holograms is primarily suitable for holographic display devices with at least one light modulator means into which a scene decomposed into object points is encoded as an overall hologram and is to be seen as a reconstruction from a visibility region which lies within a periodicity interval of the reconstructed video hologram in which the visibility region, together with each object point of the scene to be reconstructed, defines a sub-hologram and the overall hologram is formed from a superimposition of sub-holograms.
- Such a holographic display device with corresponding light modulator means is based on the principle of superimposing the information of object points of a scene on modulated wavefronts in at least one visibility region. The definitions of visibility have already been explained.
- the principle is used that the reconstruction of a single object point of a scene only requires one sub-hologram as a subset of the total hologram coded on the light modulator means.
- a single object point is generated in each case by a sub-hologram whose position depends on the position of the object point and its size on the position of the observer.
- the area of the sub-hologram on the light modulator means is hereinafter referred to as modulator area.
- the modulator region is that subregion of the light modulator means which is required to reconstruct the object point.
- the modulator area describes which pixels on the light modulator must be correspondingly driven in order to reconstruct this object point.
- the position of the modulator area remains fixed if it is a so-called stationary object point.
- the object point to be reconstructed changes its position as a function of the observer position.
- the modulator range depending on the Observer position is achieved that the object point is coded stationary, that is, it does not change its spatial position depending on the viewer position.
- these principles can be treated analogously.
- the center of the modulator area lies in the simplest possible solution on the straight line through the object point to be reconstructed and the center of the visibility area.
- the size of the modulator region is determined in a simplest possible solution with the aid of the radiation set, wherein the visibility region is traced back to the light modulator means by the object point to be reconstructed.
- a pixel as the smallest controllable unit of the light modulator contains not only the information of a single sub-hologram but, as a result of the overlays, the information of several sub-holograms.
- the invention is based on the idea of generating in a sequence of images in each case the difference sub-hologram of a new visible object point and of a now concealed object point (or vice versa).
- a differential sub-hologram see also the following figures and exemplary embodiments, is defined by:
- the displacement of an object point can be generalized as omission and addition of corresponding points are interpreted and is in the case distinction of visibility. Also included are cases where there is no background for object points. In this case, the difference sub-hologram is the corresponding sub-hologram of the object point.
- data describing the changes in color and / or brightness or, if appropriate, corresponding sub-holograms are preferably determined.
- description data are generated for each differential sub-hologram.
- the description data generally serves to enable, control or facilitate the processing of the difference sub-holograms, ie ultimately the performance by the holographic reproduction device.
- Description data includes, for example, the size of the difference sub-hologram, the position on the light modulator, pixel areas, references to storage areas, indexes, or the like.
- the description data thus permit high-performance processing, for example by allowing the necessary references to memory areas to allow rapid data access.
- they serve, for example, to read the address range of the differential sub-hologram in a screen buffer of the holographic display device or performant to determine. In order for these memory areas can be filled performant, so that finally the corresponding pixels of the light modulator can be controlled.
- the description data and the difference sub-hologram are combined into the so-called difference data.
- a control unit decides optimizing whether it is more advantageous to generate the difference data or alternatively the Bacthoiogramm, so the complete image content. If the image content has changed too much, as is the case, for example, with video clips, a large number of differential data corresponding to the object points must be transmitted. The cost of data transmission or the processing of this amount of data in this case can be higher than the cost of the entire hologram of the whole In this case, the entire hologram is generated with advantage.
- the generation, storage and transmission of the difference data can be done in a loose or disordered order, since, as described above, the differential sub-hologram according to the invention by the description data, the additional information required for processing are attached.
- the method according to the invention allows random generation and thus random transmission or storage.
- the difference data are transmitted immediately, ie immediately after their determination, to the data receivers, for example to the holographic display device. It is also possible to combine the difference data of several points into data packets. According to the invention, these generated data, that is to say differential sub-holograms and the associated description data, are provided for digital storage means or transmitted directly to the holographic display device.
- the inventive method ensures that the required amount of data for video holograms can be significantly reduced.
- the advantage of the invention lies in the fact that the higher the light modulator of the holographic display device is resolved, the more often instead of the entire hologram only individual differential sub-holograms, ie a significantly smaller amount of data, are transmitted or stored. It is also conceivable to transmit at fixed intervals the total hologram in order to support a perfect quality of the holographic representation.
- the significantly smaller amount of data allows the storage of video sequences on conventional digital storage media.
- the cost of data transmission over a computer network and the Internet is significantly reduced.
- the description data additionally contain generalized information that assigns the difference sub-frames to enable various holographic playback devices that apply the principle of sub-holograms in an advantageous manner.
- Such schemes can be established or agreed as industry standards.
- the holographic reproduction device is interpreted as the receiver side.
- the holographic display device thus requires means and methods to be able to present the holograms in turn from video hologram data prepared in accordance with the method.
- the holographic display device contains at least one screen means.
- the means of display means either the light modulator itself, in which the hologram of a scene is coded, or an optical element (for example lens, mirror) onto which a hologram coded in the light modulator or a wavefront of a scene coded in the light modulator is imaged.
- the determination of the screen means and the associated principles for the reconstruction of the scene in the visibility area are described by documents of the applicant.
- the screen means is the light modulator itself.
- the screen means is an optical element onto which a hologram coded in the light modulator is imaged.
- the screen means is an optical element to which a wavefront of the scene coded in the light modulator is imaged.
- WO 2006/066919 of the applicant describes the already mentioned method for calculating video holograms.
- the holographic display includes a screen memory or memory architecture from which pixel values are read. With the pixel values, a corresponding control of the pixels of the light modulator means.
- the screen memory is the memory of a graphics card in which the data for a screen display are located; it is also referred to as video RAM (or VRAM for short).
- the holographic display device also comprises a so-called splitter. Splitters are calculation means which, on the one hand, recognize difference data from the data flow generated according to the method and separate it into the data of the difference sub-holograms and the associated description data. With the help of the description data, the splitter ensures, for example, that the difference sub-holograms are written into the memory areas of the screen memory provided for this purpose and thus made available to the modulator means.
- Light modulators are usually active matrix displays whose pixel values must be constantly refreshed so as not to lose the information. If only those image contents that have changed were transferred to the light modulator, the corresponding information would be lost in the areas of unchanged image contents. Unchanged object points would therefore no longer appear. For such a light modulator, the entire image content must be available in the screen memory in each refresh cycle, since the entire image content is read out of the screen memory in a refresh cycle and the pixels are driven or refreshed accordingly.
- the data of the difference sub-holograms are written in the screen memory.
- a special screen memory or suitable memory architectures are proposed, which fulfill the functions for simultaneous reading and writing.
- the new differential sub-holograms are stored in the write mode and, at the same time, the entire screen memory is read in the read mode and the information is transmitted to the light modulator for driving the pixels.
- dual port RAMs are proposed as screen memories.
- the difference sub-holograms are advantageously generated.
- the inventive method allows a reduction in the amount of data from the content generation to a holographic display device.
- the requirements for storage means and transfer means are also advantageously reduced.
- Previously known storage media allow the storage of a long video sequence. Analog ensure already known means of transmission, such as Internet, LAN 1 WL-AN 1 DVI, HDMI and the like, a high-performance transmission.
- FIG. 1 b the difference sub-hologram for a point to be added
- FIG. 1 c the difference sub-hologram for a disappearing point
- FIG. 2 a flowchart of the method
- FIG. 3 a structure diagram of the holographic display device.
- Imaging element of lens and prism
- FIG. B2b shows a modulator area and a vertically acting prism
- FIG. B2c shows a modulator area and a horizontally acting prism
- FIG. B3 shows a flow chart of the method according to the invention
- FIG. B4 shows a variant of the method for reconstructing a
- Fig. 1a illustrates the underlying principle of a holographic display (HAE) for a viewer.
- the principle is analogous to several viewers.
- the position of an observer is characterized by the position of his eyes or of his pupils (VP).
- the device contains a light modulator means (SLM), which for ease of illustration in this embodiment is equal to the screen means (B), and superimposes the wavefronts modulated with information of object points of a scene (3D-S) in at least one visibility region (VR).
- SLM light modulator means
- VR visibility region
- the reconstruction of a single object point (OP) of a scene (3D-S) requires only one sub-hologram (SH) as a subset of the total hologram (H ⁇ SLM ) coded on the light modulator means (SLM).
- SH sub-hologram
- H ⁇ SLM total hologram
- SLM light modulator means
- MR modulator area
- the modulator region (MR) is only a small subregion of the light modulator means (SLM).
- the center of the modulator area (MR) lies in the simplest possible solution on the straight line through the object point (OP) to be reconstructed and the center of the visibility area (VR).
- the size of the modulator region (MR) is determined in the simplest possible solution with the aid of the radiation set, the visibility region (VR) being traced back to the light modulator device (SLM) by the object point (OP) to be reconstructed. Furthermore, this results in the indices of those pixels on the light modulator means (SLM), which are required for the reconstruction of this object point.
- a new object point (OPN) has been added to the current image (P n ) of the sequence with respect to the past image, which, however, as shown in the figure, according to the observer's visibility in the last image (P n -O
- the difference sub-hologram describes the corresponding color or brightness information. In general, however, it is sufficient to detail these changes using descriptive data.
- the description data contains data that facilitate or facilitate an assignment of the difference sub-holograms in the screen memory of the display device.
- the description data include the location and size of the difference sub-hologram, and preferably additional indices for pixel areas, memory areas and the like.
- Fig. 2 shows a flowchart of the method.
- the differences to the preceding image are determined for the current image of the sequence. For example, this data is obtained from a 3D rendering graphics pipeline.
- the position of the observer that is, more precisely, the position of his eye pupils or of the visibility regions which cover the pupil of the eye are made available.
- a control means CU
- CU control means
- the difference sub-hologram is formed as a difference of the sub-holograms of the respectively visible or invisible object points.
- the sub-holograms are calculated analytically or preferably determined or read from look-up tables.
- the analytical method is based, for example, on the principle according to WO 2006/066919, wherein the sub-holograms of the look-up tables are preferably also determined on the basis of this method.
- WO 2006/066919 of the applicant describes a method for calculating video holograms.
- the hologram values of the sub-hologram of an object point are thereby determined by computer-assisted following steps:
- a diffraction image is computed in the form of a separate two-dimensional distribution of wavefields for a viewer plane with a finite distance parallel to the intersection planes, the wavefields of all intersections being calculated for at least one common visibility region,
- the reference data set for generating a hologram data set for a common computer-generated hologram of the scene is transformed into a parallel hologram plane finally removed from the reference plane, wherein the light modulator means lies in the hologram plane.
- the difference sub-hologram of the color or brightness changes can also be determined. However, it is usually sufficient to describe these changes by descriptive parameters.
- the description data are determined for the differential sub-photograms. As can be seen or understood from Fig. 1a, these data include the location and size of the differential sub-hologram on the light modulator means (SLM) as well as index, memory and address ranges or the like.
- the memory areas or address areas of a screen memory (VRAM) required for the differential sub-hologram are contained in the holographic display device (HAE). In general, this description data will allow, control or facilitate the display on the light modulator.
- the initialization data of the holographic display device and in particular the light modulator are assumed to be known here. For example, these data were requested or read out by the holographic display device. With regard to the description data, reference is made to FIG. 3, which explains the processing of the data generated here by the holographic reproduction device.
- the difference sub-hologram (SD) of an object point and the associated descriptive data (SDJND) together form the difference data (D), which now, optionally after further data compression, are provided to the storage means, to the transfer means or to the holographic display device.
- Fig. 3 shows a schematic of the holographic display (HAE) and illustrates the principle of representing the video data generated according to the method without sacrificing quality.
- the input data for the reproducing device include the difference data (D) associated with an object point, which are composed of the description data (SDJND) and the difference data (SD), respectively.
- the difference data of an object point contain with the description data all data required for further processing.
- the difference data is exemplified with dot indexes "3", "126" and "1056", indicating that it is possible to transmit the difference data in a loose order.
- the display device comprises a light modulator means (SLM).
- SLM light modulator means
- the data of the pixel values for controlling the light modulator means (SLM) shown here only schematically are read from a screen memory (VRAM).
- the playback device includes
- additional calculation means are required, which determine the memory or address ranges of the difference sub-holograms, if they are not or not completely present in the description data.
- these calculating means (IC) are combined with the splitter (SX).
- VRAM screen memory
- the light modulator is an active matrix display whose pixel values must be constantly refreshed so as not to lose the information.
- the entire image content must be available in screen memory (VRAM) in each refresh cycle.
- VRAM screen memory
- a special screen memory (VRAM) is proposed, which fulfills the functions for simultaneous reading and writing.
- SD differential sub-holograms
- a particularly preferred method for generating the sub-holograms is explained below with reference to FIGS. B1 to B4.
- Starting point of the method is a three-dimensional scene (3D-S) with color and depth information, which is structured into a plurality of object points.
- 3D-S three-dimensional scene
- a pixel as the smallest controllable unit of the light modulator, contains not only the information of a single sub-hologram but, as a result of the overlays, the information of several sub-holograms.
- the preferred method is based on the idea that the complex hologram values of a sub-hologram from the wavefront of each object point to be reconstructed are determined in a modulator region of the light modulator means by the transmission or modulation functions of an imaging element modeled in the modulator region, at the focal point of which the object point to be reconstructed is located , calculated and evaluated.
- the hologram plane is defined by the location of a screen means, with the screen means being the light modulator itself for simplicity in the following explanations.
- the imaging element comprises a lying in the hologram plane lens with the focal length f, which is inclined.
- An inclined lens is a composition of a lens not tilted with respect to the hologram plane, and a vertical and a horizontally acting prism. Strictly speaking, no sub-hologram is defined by a prism, since no object point due to the non-focal prism function is reconstructed. However, in the interests of clarity of the inventive idea, this is referred to below as the prism in the modulator area also contributes to the complex hologram values.
- the method is further detailed below.
- this detailing of the method comprises the following steps for each visible object point of the scene:
- A Determination of the size and position of the modulator area, analogous to the above-mentioned embodiments, but below the modulator area is based on a local coordinate system, with the origin of the system at the center, the x-coordinate the abscissa and the y-coordinate the ordinate ,
- "a" is chosen as the half width and "b" as the half height as the dimension, with these interval limits going into the following terms.
- B determination of the sub-hologram of the lens in the hologram plane:
- B1 determination of the focal length f of the lens:
- the focal length f of the lens is preferably the normal distance of the object point to be reconstructed from the hologram plane.
- B2 Complex values of the associated sub-hologram of the lens:
- the superimposed prism goes through the origin of the local coordinate system.
- C4 A corresponding prisnce term is omitted if the holographic reproduction device has the property of imaging the light source in the visibility range.
- D Modulation of Subholograms for Lens and Prisms:
- Each modulated sub-hologram from step D becomes a randomized one
- ZSH ZSH exp (i ⁇ 0 ) or symbolic
- the random phase is assigned to each sub-hologram individually. Preferably, globally considered, the random phases of all sub-holograms are equally distributed.
- the complex values are provided with an additional multiplication factor, which represents the intensity or the brightness.
- Total hologram complex sum of sub-holograms with or symbolically
- the method is preferably used only for visible object points.
- the visibility of the object point is determined in the course of the rendering of the scene by a 3D rendering graphics pipeline and follows from the observer position, ie the corresponding position of the pupils and consequently from the position of the visibility region which tracks the position of the pupils.
- the modulator region (MR) is based on a coordinate system with the origin of the system in the center, the x-coordinate the abscissa and the y-coordinate the ordinate.
- the modulator region (MR) is assigned a as half width and b as half height.
- Fig. B2a shows the holographic display (HAE) in a side view and illustrates the basic principle of the method.
- Analogous to FIG. B1 is derived from the range of visibility (VR) of the modulator region (MR).
- This area is in the hologram plane (HE) in which the light modulator (SLM) is located.
- the modulator area is assigned the above-mentioned coordinate system.
- the imaging element (OS) which here comprises a condenser lens (L) and a prism (P).
- L condenser lens
- P prism
- Fig. B2b shows a horizontally acting prism wedge (PH) in front of the modulator area (MR) with the correspondingly used coordinates and dimensions.
- the prism wedge goes through the ordinate here.
- Fig. B2c shows analogously a vertically acting, passing through the abscissa prism wedge (PV).
- the two prism wedges are superimposed as explained below.
- Fig. B3 shows an exemplary plan of the preferred method.
- the starting point of the method is a three-dimensional scene (3D-S) 1 which is structured into a multiplicity of object points (OP). Color and depth information is available for the object points (OP). On the basis of the depth information of the object point whose visibility is determined according to the viewer's position, respectively the pupils of the viewer.
- the size and position of the associated modulator area (MR) in the hologram plane (HE) or on the light modulator means is determined in step (A).
- the object point (OP) to be reconstructed is interpreted as the focal point of an imaging element lying in the hologram plane.
- the imaging element is here understood as a combination of a converging lens (L) and, see FIGS. 2b, 2c, of vertically or horizontally acting prisms (PH, PV).
- the focal length of the lens (L) is thus determined as normal distance of the object point (OP) to the hologram plane (HE) in step (B1).
- the coordinate system is defined as described above.
- step (C) the sub-holograms (SH P ) of the prisms (P) in the hologram plane are determined.
- the complex values of the associated sub-hologram (SH P ) become the superposition of the two prism terms
- a prismmenter is omitted if the holographic display device has the property of imaging the light source in the visibility region (VR).
- step (E) the sub-hologram (SH) is provided with an equally distributed random phase.
- step (F) takes place an intensity modulation, wherein the sub-hologram (SH) by
- the total hologram (H ⁇ SLM ) represents the hologram of all object points. It thus represents and reconstructs the entire scene (3D-S).
- the sub-holograms for the interactive holographic representation for object points can be generated in real time at any position within the reconstruction space with standard hardware components available today.
- the sub-holograms are preferably determined using the preferred method and the named look-up tables are filled with the sub-holograms.
- it is suitable for holographic transfer devices, which likewise use the principle of the sub-holograms in an advantageous manner. In particular, these are analogous to those already done Explanations, devices according to WO 2004/044659, WO 2006/027228, WO 2006119760 and DE 10 2006 004 300.
Abstract
Description
Claims
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020097025970A KR101496801B1 (ko) | 2007-05-16 | 2008-05-16 | 자유 어드레싱 방식 홀로그램 재생 장치용 비디오 홀로그램 생성 방법 |
JP2010507926A JP5557737B2 (ja) | 2007-05-16 | 2008-05-16 | ランダムアドレッシングを有するホログラフィック表示装置に対してビデオホログラムを生成する方法 |
US12/600,325 US8493642B2 (en) | 2007-05-16 | 2008-05-16 | Method for generating video holograms for a holographic display device with random addressing |
CN2008800162102A CN101711377B (zh) | 2007-05-16 | 2008-05-16 | 一种为具有随机寻址的全息显示装置生成视频全息图的方法 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102007023740.7 | 2007-05-16 | ||
DE102007023740A DE102007023740B4 (de) | 2007-05-16 | 2007-05-16 | Verfahren zur Generierung von Videohologrammen für eine holographische Wiedergabeeinrichtung mit wahlfreier Adressierung |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2008138980A2 true WO2008138980A2 (de) | 2008-11-20 |
WO2008138980A3 WO2008138980A3 (de) | 2010-01-14 |
Family
ID=39868894
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2008/056023 WO2008138980A2 (de) | 2007-05-16 | 2008-05-16 | Verfahren zur generierung von videohologrammen für eine holographische wiedergabeeinrichtung mit wahlfreier adressierung |
Country Status (7)
Country | Link |
---|---|
US (1) | US8493642B2 (de) |
JP (1) | JP5557737B2 (de) |
KR (1) | KR101496801B1 (de) |
CN (1) | CN101711377B (de) |
DE (1) | DE102007023740B4 (de) |
TW (1) | TWI446783B (de) |
WO (1) | WO2008138980A2 (de) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101847393A (zh) * | 2010-04-23 | 2010-09-29 | 中国电子科技集团公司第五十四研究所 | 遥感影像图的处理方法 |
JP2012008207A (ja) * | 2010-06-22 | 2012-01-12 | Kwang Woon Univ Industry-Academic Collaboration Foundation | ルックアップテーブルと画像の時間的重複性を用いた3次元動画の計算機合成ホログラムの算出方法及びその装置 |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9030532B2 (en) * | 2004-08-19 | 2015-05-12 | Microsoft Technology Licensing, Llc | Stereoscopic image display |
DE102007023737B4 (de) * | 2007-05-16 | 2009-01-02 | Seereal Technologies S.A. | Verfahren zum Generieren von Videohologrammen in Echtzeit zur Erweiterung einer 3D-Rendering-Graphikpipeline |
US8199186B2 (en) * | 2009-03-05 | 2012-06-12 | Microsoft Corporation | Three-dimensional (3D) imaging based on motionparallax |
JP5448981B2 (ja) | 2009-04-08 | 2014-03-19 | 株式会社半導体エネルギー研究所 | 液晶表示装置の駆動方法 |
US8334889B2 (en) * | 2010-03-18 | 2012-12-18 | Tipd, Llc | Auto stereoscopic 3D telepresence using integral holography |
KR101926547B1 (ko) * | 2011-10-28 | 2018-12-10 | 삼성전자주식회사 | 고속으로 3d 홀로그램을 생성하는 방법 및 장치 |
FR2986874A1 (fr) * | 2012-02-15 | 2013-08-16 | France Telecom | Procede de codage de motif holographique, dispositif de codage et programme d'ordinateur correspondants |
US10080049B2 (en) | 2012-09-07 | 2018-09-18 | At&T Intellectual Property I, L.P. | Apparatus and method for presentation of holographic content |
JP6232778B2 (ja) | 2013-06-27 | 2017-11-22 | セイコーエプソン株式会社 | 画像処理装置、画像表示装置、および画像処理装置の制御方法 |
WO2018037077A2 (de) * | 2016-08-24 | 2018-03-01 | Seereal Technologies S.A. | Holographische anzeigevorrichtung |
US11385595B2 (en) | 2016-10-19 | 2022-07-12 | Kt Corporation | Refractive optical screen and floating hologram system using same |
KR102497832B1 (ko) * | 2017-12-26 | 2023-02-08 | 한국전자통신연구원 | 홀로그램 생성 장치 및 그 방법 |
JP7267967B2 (ja) * | 2020-03-24 | 2023-05-02 | Kddi株式会社 | 計算機合成ホログラム生成装置、方法およびプログラム |
US11962867B2 (en) | 2021-11-04 | 2024-04-16 | Tencent America LLC | Asset reusability for lightfield/holographic media |
CN116819909B (zh) * | 2023-08-31 | 2023-11-17 | 光科芯图(北京)科技有限公司 | 一种数据压缩方法、装置、曝光设备及存储介质 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH10171336A (ja) * | 1996-12-06 | 1998-06-26 | Nippon Telegr & Teleph Corp <Ntt> | 三次元空間画像作成方法並びに装置 |
US20030156306A1 (en) * | 2001-12-17 | 2003-08-21 | Dai Nippon Printing Co., Ltd. | Computer-generated hologram fabrication process, and hologram-recorded medium |
WO2006021818A1 (en) * | 2004-08-24 | 2006-03-02 | University Of Durham | Holographic lithography |
WO2006119760A2 (de) * | 2005-05-13 | 2006-11-16 | Seereal Technologies Gmbh | Projektionsvorrichtung und verfahren zur holographischen rekonstruktion von szenen |
WO2006134398A2 (en) * | 2005-06-14 | 2006-12-21 | Light Blue Optics Ltd | Signal processing system for synthesizing holograms |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3414417B2 (ja) * | 1992-09-30 | 2003-06-09 | 富士通株式会社 | 立体画像情報伝送システム |
JP3442981B2 (ja) * | 1996-12-06 | 2003-09-02 | 日本電信電話株式会社 | 計算機ホログラム作成方法及びその方法を記録した記録媒体及び動画ホログラム表示装置 |
US7839548B2 (en) | 2002-11-13 | 2010-11-23 | Seereal Technologies Gmbh | Video hologram and device for reconstructing video holograms |
DE102004044111B4 (de) | 2004-09-08 | 2015-05-07 | Seereal Technologies Gmbh | Verfahren und Vorrichtung zum Kodieren und Rekonstruieren von computergenerierten Videohologrammen |
DE102004063838A1 (de) | 2004-12-23 | 2006-07-06 | Seereal Technologies Gmbh | Verfahren und Einrichtung zum Berechnen computer generierter Videohologramme |
US7535607B2 (en) * | 2005-05-06 | 2009-05-19 | Seereal Technologies S.A. | Device for holographic reconstruction of three-dimensional scenes |
DE102005023743B4 (de) * | 2005-05-13 | 2016-09-29 | Seereal Technologies Gmbh | Projektionsvorrichtung und Verfahren zur holographischen Rekonstruktion von Szenen |
DE102006004300A1 (de) | 2006-01-20 | 2007-08-02 | Seereal Technologies S.A. | Projektionsvorrichtung zur holographischen Rekonstruktion von Szenen |
DE102006025096B4 (de) * | 2006-05-23 | 2012-03-29 | Seereal Technologies S.A. | Verfahren und Einrichtung zum Rendern und Generieren computer-generierter Videohologramme |
CN101512445B (zh) * | 2006-09-01 | 2013-07-17 | 视瑞尔技术公司 | 借助亚全息图实时生成视频全息图的方法 |
-
2007
- 2007-05-16 DE DE102007023740A patent/DE102007023740B4/de not_active Expired - Fee Related
-
2008
- 2008-05-16 WO PCT/EP2008/056023 patent/WO2008138980A2/de active Application Filing
- 2008-05-16 CN CN2008800162102A patent/CN101711377B/zh not_active Expired - Fee Related
- 2008-05-16 TW TW097118293A patent/TWI446783B/zh not_active IP Right Cessation
- 2008-05-16 US US12/600,325 patent/US8493642B2/en not_active Expired - Fee Related
- 2008-05-16 JP JP2010507926A patent/JP5557737B2/ja not_active Expired - Fee Related
- 2008-05-16 KR KR1020097025970A patent/KR101496801B1/ko not_active IP Right Cessation
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH10171336A (ja) * | 1996-12-06 | 1998-06-26 | Nippon Telegr & Teleph Corp <Ntt> | 三次元空間画像作成方法並びに装置 |
US20030156306A1 (en) * | 2001-12-17 | 2003-08-21 | Dai Nippon Printing Co., Ltd. | Computer-generated hologram fabrication process, and hologram-recorded medium |
WO2006021818A1 (en) * | 2004-08-24 | 2006-03-02 | University Of Durham | Holographic lithography |
WO2006119760A2 (de) * | 2005-05-13 | 2006-11-16 | Seereal Technologies Gmbh | Projektionsvorrichtung und verfahren zur holographischen rekonstruktion von szenen |
WO2006134398A2 (en) * | 2005-06-14 | 2006-12-21 | Light Blue Optics Ltd | Signal processing system for synthesizing holograms |
Non-Patent Citations (1)
Title |
---|
TAKAHASHI HIDEYA ET AL: "Direct volume access by an improved electro-holography image generator" PROCEEDINGS OF THE SPIE - THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING, SPIE, US, Bd. 2406, 1. Januar 1995 (1995-01-01), Seiten 220-225, XP007903699 ISSN: 0277-786X * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101847393A (zh) * | 2010-04-23 | 2010-09-29 | 中国电子科技集团公司第五十四研究所 | 遥感影像图的处理方法 |
JP2012008207A (ja) * | 2010-06-22 | 2012-01-12 | Kwang Woon Univ Industry-Academic Collaboration Foundation | ルックアップテーブルと画像の時間的重複性を用いた3次元動画の計算機合成ホログラムの算出方法及びその装置 |
Also Published As
Publication number | Publication date |
---|---|
TW200901749A (en) | 2009-01-01 |
KR20100023865A (ko) | 2010-03-04 |
TWI446783B (zh) | 2014-07-21 |
CN101711377A (zh) | 2010-05-19 |
US8493642B2 (en) | 2013-07-23 |
JP2010527038A (ja) | 2010-08-05 |
CN101711377B (zh) | 2013-08-21 |
DE102007023740B4 (de) | 2009-04-09 |
KR101496801B1 (ko) | 2015-03-02 |
JP5557737B2 (ja) | 2014-07-23 |
DE102007023740A1 (de) | 2008-11-20 |
US20100149610A1 (en) | 2010-06-17 |
WO2008138980A3 (de) | 2010-01-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE102007023740B4 (de) | Verfahren zur Generierung von Videohologrammen für eine holographische Wiedergabeeinrichtung mit wahlfreier Adressierung | |
EP2160655B1 (de) | Verfahren zum generieren von videohologrammen in echtzeit zur erweiterung einer 3d-rendering-graphikpipeline | |
DE102007023739B4 (de) | Verfahren zum Rendern und Generieren von Farbvideohologrammen in Echtzeit und holographische Wiedergabeeinrichtung | |
EP2158522B1 (de) | Analytisches verfahren zur berechnung von videohologrammen in echtzeit | |
EP2005259B1 (de) | Verfahren zum rendern und generieren computer-generierter videohologramme in echtzeit | |
EP2024793B1 (de) | Verfahren und einrichtung zum rendern und generieren computer-generierter videohologramme | |
DE10353439B4 (de) | Einrichtung zur Rekonstruktion von Videohologrammen | |
DE112006003377B4 (de) | Verfahren zur multimodalen Darstellung von Bildinhalten auf einer Anzeigeeinrichtung für Videohologramme und multimodale Anzeigeeinrichtung | |
DE102004063838A1 (de) | Verfahren und Einrichtung zum Berechnen computer generierter Videohologramme | |
WO2008025844A1 (de) | Verfahren zum generieren computer-generierter videohologramme in echtzeit mittels propagation | |
EP2062100B1 (de) | Verfahren und vorrichtung zur kodierung von computergenerierten hologrammen in pixelierten lichtmodulatoren | |
DE112004002390B4 (de) | Verfahren und Vorrichtung zum Erzeugen einer Animation | |
DE102006042324B4 (de) | Verfahren zum Generieren computer-generierter Videohologramme in Echtzeit mittels Teilhologrammen | |
WO2008025841A1 (de) | Holografische kodiereinheit zum generieren von videohologrammen | |
DE102006042326A1 (de) | Holographische Kodiereinheit zum Generieren computergenerierter Videohologramme | |
WO2007085482A1 (de) | Verfahren zur erzeugung und darstellung räumlich wahrnehmbarer bilder | |
DE102006042323B4 (de) | Verfahren zum Generieren computer-generierter Videohologramme in Echtzeit mittels Propagation | |
WO2007085233A2 (de) | Verfahren zur datenkompression computergenerierter videohologramme |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200880016210.2 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 08785873 Country of ref document: EP Kind code of ref document: A2 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010507926 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12600325 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 20097025970 Country of ref document: KR Kind code of ref document: A |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 08785873 Country of ref document: EP Kind code of ref document: A2 |