Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T15/00—Three-dimensional [3D] image rendering
  • G06T15/50—Lighting effects
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
  • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
  • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
  • G09G3/003—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
  • H04N13/106—Processing image signals
  • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
  • H04N13/106—Processing image signals
  • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
  • H04N13/183—On-screen display [OSD] information, e.g. subtitles or menus
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
  • H04N13/305—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
  • H04N13/31—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/324—Colour aspects
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/366—Image reproducers using viewer tracking
  • H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/398—Synchronisation thereof; Control thereof
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
  • G06T2219/20—Indexing scheme for editing of 3D models
  • G06T2219/2012—Colour editing, changing, or manipulating; Use of colour codes
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2300/00—Aspects of the constitution of display devices
  • G09G2300/04—Structural and physical details of display devices
  • G09G2300/0439—Pixel structures
  • G09G2300/0452—Details of colour pixel setup, e.g. pixel composed of a red, a blue and two green components
• • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
  • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
  • Y10T—TECHNICAL SUBJECTS COVERED BY FORMER US CLASSIFICATION
  • Y10T29/00—Metal working
  • Y10T29/49—Method of mechanical manufacture
  • Y10T29/49002—Electrical device making
  • Y10T29/49004—Electrical device making including measuring or testing of device or component part

Definitions

• the invention relates to a method for generating three-dimensional images for reproduction on an autostereoscopic display, in particular an autostereoscopic display. Furthermore, the invention relates to an autostereoscopic display for generating three-dimensional images.
• Autostereoscopic visualization systems are intended to allow one or more observers who are in front of an autostereoscopic display to obtain a three-dimensional image without visual aids, such as visual aids. to look at red / blue glasses, shutter or polarization glasses, etc.
• visual aids such as visual aids. to look at red / blue glasses, shutter or polarization glasses, etc.
• Parallax barrier systems or lenticular lens systems positioned in front of the display panel. Since one or more observers may be at different angles relative to a direction perpendicular to the display, more than two perspectives must always be generated and fed to the respective left and right eyes in order to provide as natural a three-dimensional image impression as possible for the viewer allow respective viewer.
• These systems are also referred to as multi-viewer systems or multiview systems.
• WO 2007/121970 A2 discloses a method and a device for pseudoholographic image generation, according to which, with a relatively large number of perspectives, the requirements on the hardware, in particular on the storage space requirement, are reduced.
• the known method and the known device that a satisfactory image reproduction is not possible in all presentation scenarios.
• CONFIRMATION COPY Positioning narrow vertical objects can lead to unnatural three-dimensional image impressions. If a relatively narrow object ⁇ is located relatively close to the camera during image acquisition, a more distant object O 2 can appear to the left of the object O for the left eye, while the right eye sees the object O 2 to the right of O. This effect is referred to below as a cross-over effect and can not be displayed correctly in the known method or the known device.
• the present invention is therefore based on the object of designing and further developing a method and an autostereoscopic display for generating three-dimensional images such that an improved three-dimensional representation of the largest possible number of perspectives on the autostereoscopic display is possible with as little storage space as possible.
• a method for generating three-dimensional images for reproduction on an autostereoscopic display in particular an autostereoscopic display, specified, wherein a subpixel of the display, preferably by means of a perspective map, a perspective is assigned, wherein from a supplied input image with a number of M 2 perspectives, a display image is generated for display on the display with a number of N> 3 perspectives, where N> M, and N-M intermediate perspectives are produced by image synthesis using a disparity map, with no monotonicity of the disparities in the image synthesis Is assumed and at least one pixel or subpixel of an intermediate perspective that is not used to render the intermediate perspective on the display is not synthesized.
• an autostereoscopic display for generating three-dimensional images wherein the display has subpixels with associated perspectives, wherein the display means for generating a display image with a number of N 3 perspectives from a wherein N> M, said means for generating a display image comprising image synthesis means for generating N-M intermediate perspectives by image synthesis using a disparity map, said image synthesis means not being monotone in image synthesis Require disparities in the disparity map, and wherein the image synthesis means does not synthesize at least one pixel or sub-pixels of an intermediate perspective that is not used to render the intermediate perspective on the display.
• two perspectives corresponding to a left partial image and a right partial image can be supplied with the input image.
• a stereo image consisting of a left and right partial image can be used as an input image, wherein the left and right partial image are or are rectified for further processing.
• a disparity estimate can be made to calculate the disparity map, with the disparity estimate from the left and right tiles taking into account extracted features.
• Conceivable here are a SURF (Speed up Robust Features) feature extraction with respect to prominent pixels or a Sobel feature extraction with respect to edge detection.
• Each pixel may be augmented by the calculated feature values to ensure association, allowing a disparity estimate in which each pixel can represent a feature vector.
• a cross-over preprocessing can be carried out, wherein image segments are determined in each line of the left partial image, in which a cross-over effect is present.
• legal occlusions are therefore identified by the value -1.
• the values of Wohin (j) are always greater than or equal to 0.
• j_unten positions and j_oben determined.
• the position j_unten is determined to be just below j / 3.
• the position j_oben is chosen so that it is just above j / 3.
• the N-M intermediate perspectives can be synthesized by a virtual camera travel along the stereo base between a pixel (i, j) of the left field and the corresponding pixel (i ', j') of the right field.
• a cross-over post-processing can be carried out, with an area in which a cross-over image segment from the left partial image travels via the intermediate perspectives to the right partial image being post-processed.
• an advantageous embodiment of an overlay is when a sub-pixel j r in a cross-over area in the perspective of P.
• the described method and the advantageous embodiments relate to a calculation from the left to the right partial image. It should be noted that the calculations can also be performed in the opposite direction, ie from the right field to the left field. The various steps are readily apparent to a person skilled in the art. It is to be understood that this reverse direction of calculation is also to be understood as belonging to the scope of the appended claims.
• the processing of a line i of the display image from an associated row computing unit is associated with a local memory for performing the machining operations and wherein the row computing unit accesses a global memory.
• Data such as the input images or the rectified input images, feature vectors and / or the output image are kept in a global memory, which can be accessed in parallel by all the row computation units. Since all units access this data only read-only and / or write only on their associated line of the image and display, there are no synchronization or blocking problems.
• the row calculation units can be controlled by a control unit for synchronization.
• a line calculation unit can be assigned to one line of the display image.
• an application scenario with a disparity map in accordance with the monotony law of stereoscopy an application scenario with a disparity map for processing a cross-over Effect
• a flow chart illustrating the cross-over preprocessing a flow chart of an embodiment according to a method for displaying the cross-over post-processing according to the invention
• the continuation of the flowchart for illustrating the cross-over post-processing of Fig. 6 the continuation 7 shows a flow chart of an embodiment according to a method according to the invention, wherein the image synthesis is shown with a cross-over processing, the continuation of the F 9 and the hardware layout of the overall system according to an embodiment of the autostereoscopic display according to the invention.
• FIG. 1 shows a block diagram for illustrating the overall system according to an exemplary embodiment of the method according to the invention for generating three-dimensional images.
• the exemplary embodiment according to FIG. 1 relates to a method for generating three-dimensional images for reproduction on an autostereoscopic display, on which a plurality of perspectives, generally more than 100, of a supplied stereo image in any 3D format are displayed in a combed manner.
• the display consists of an optical element and an image-forming unit.
• the multitude of perspectives is generated in such a way that only those pixels of a perspective are generated, which also have to be displayed.
• the imaging unit of the display consists of pixels / subpixels which emit a color, eg red, green or blue.
• the autostereoscopic display is capable of producing a 3-D image or an SD image sequence in any format, e.g. a stereo image or a stereo image sequence.
• Other formats, such as Stereo image including a disparity card can also be received and processed.
• a received stereo image is first rectified, i. brought to stereo normal form or in the epipolar standard configuration. If this is already the case, then the identical figure arises here.
• the disparity map of the stereo image is calculated. It contains an assignment of the pixels of the left and right field, which are present in both received perspectives. In addition, the left and right occlusions are identified.
• any number of perspectives are synthesized. This is done so that only those subpixels are synthesized, which must be displayed on the display actually. Thus, for 100 perspectives to be displayed, only 1% of the subpixels are calculated from each perspective.
• the information about which perspective is to be displayed on which subpixel is defined in the perspective map P.
• the perspective map is defined and stored in the production of the display by a calibration process between subpixels and optical system. Adjacent subpixels are generally associated with different perspectives. The storage of the various subpixels from the different perspectives in the pseudoholographic image B is referred to below as concealment.
• the autostereoscopic display is characterized by a panel of subpixels and an upstream optical element.
• the subpixels are color subpixels, e.g. RGB or CMY.
• RGB or CMY color subpixels
• the color information of the subpixels of the perspectives to be displayed is displayed.
• a pseudoholographic display according to FIG. 1 has at least 10 to 20 times as many subpixels as are present in the received stereo image. This greater number of subpixels makes it possible to represent a larger number of pixels per perspective out of the many perspectives that are synthesized.
• each so-called row calculation unit is its own small number of Lines of the display assigned. In extreme cases, each row calculation unit could be assigned its own line of the display.
• the display has e.g. 1080 lines, which corresponds to today's HD format, so the arithmetic unit has 1080 Zeilenrechenticianen. All processors have local memory to perform their operations and can access a global memory in parallel. A control unit ensures the synchronization of the individual processing steps.
• the hardware layout is shown in FIG.
• Fig. 2 shows a flow chart of the overall system of Fig. 1. The details will be described below.
• each pixel is extended by the previously calculated feature values to secure the assignment.
• a disparity estimate in which each pixel represents a feature vector is the result.
• the pseudoholographic image synthesis according to WO 2007/121970 A2 is modified in such a way that the monotonicity law of stereoscopy no longer has to be fulfilled in order to calculate the pixels of a perspective to be displayed.
• a display with a resolution of 19,200 x 10,800 pixels can be considered high-resolution.
• a stereo HD picture is enlarged ten times horizontally and vertically.
• a first step the rectification is performed.
• These methods are known from the literature.
• nine prominent points which are uniformly distributed over the image are searched for by the SURF method.
• the coordinate of each prominent point is used as the center of a search block in the right field l r .
• this search block the most similar point in the right field l r is searched.
• the rectified sub-images are supplemented by various features.
• the later calculation of the disparity map is characterized in that it can be carried out very quickly, because the disparities are calculated massively separately in parallel for each line.
• this has the disadvantage that local features such as e.g. Shapes, textures or edges are not taken into account. Therefore, in the feature extraction phase, various features are described that describe local properties.
• SURF Speed up Robust Features
• Sobel Edge Detector method can be used to calculate features.
• This method is based on approximating the determinant of the Hesse matrix for each pixel.
• the procedure is as follows.
• NZ the number of rows
• NS the number of columns
• the procedure is such that first of all each row i is assigned a row calculation unit i which calculates the partial sum recursively:
• Isum, (y): Isum, (j-1) + R r (/, y)
• D * y J): D LO (/, y) + D m (/, y) ⁇ D RO (/, y) - D LÜ (/, j)
• M r (/, y, 1): (/, y) ⁇ D n (/, j) - 0.81 ⁇ (/, y) ⁇ (/, y)
• the Sobel operator is just one of a large number of edge operators and is therefore described as an example.
• an edge operator is of particular importance, as it helps to assign more importance to edges than to smooth surfaces. Since an edge is always a regional property, this procedure within a row also allows to take into account the properties of local regions.
• the Sobel-Prewitt operator operates e.g. with 3x3.Matrices, which detect the edges in different directions. Basically, here are horizontal, vertical, left and right diagonal edges to distinguish. For their detection, the following 3x3 matrices are used:
• An implementation according to an embodiment of the method according to the invention proceeds in such a way that each row i is assigned a row calculation unit i.
• the computational unit becomes local Field edge (1) to edge (9) from the right rectified field R r as filled:
• each row calculation unit i calculates for each index j:
• H 2 : 2 - edge ⁇ 4) + 2 ⁇ edge (5) + 2 ⁇ edge ⁇ 6)
• H 3 : 2 - edge (7) + 2 ⁇ edge (5) + 2 ⁇ edge ⁇ 3)
• the disparity map must be created in an intermediate step.
• (i, j), d (R, (i, j))) the correlation between the point R, (i, j) of the left field and the point R r (i, j -d (R, (i, j))) of the right field, ie, the point of the left field shifted by the disparity d (R, (i, j)).
• M r (i, j): (M r (i, j, 1), ..., M, (i, j, K)).
• This may contain, for example, the luminance values and / or the color values and / or the edge operator Sobel and / or the structure operator SURF. Other features can be added accordingly.
• ⁇ B x denotes the block size of the reference block U by M, (i, j) in horizontal and B y the block size in the vertical direction.
• p b denotes the points from the reference block by M, (i, j).
• the a priori probability can not be considered Markov process 1. order
• the pixels R, (i, j) of the left as well as the right field are projections of space points belonging to certain objects of the scene. Pixels R, (i, j) of a common object therefore have a high correlation with regard to their projection behavior; at least as long as one starts from rigid objects.
• the method presented here is extended in such a way that first for each pixel R, (i, j) of the partial image R, in an environment Uy, defined by
• This method is structured both hierarchically and temporally by using the fields R, and R r together with the feature matrices M, and M r in an information pyramid. At the top level, a disparity map calculation is performed iteratively until the left to right mappings and vice versa are consistent.
• the disparities of the previous partial image R, k 1 are used as initial values of the disparity map, if no so-called "hardcut" is recognized in the image sequence between the current stereo image k and the previous stereo image k-1 disparity
• D E ': ⁇ o
• the next step is to perform the pseudoholographic image synthesis shown in FIGS. 9 and 10.
• the procedure for the image synthesis is to search in a first sub-step in each line those image segments in which there is a cross-over effect. This is called crossover preprocessing.
• Your goal is to create a field crossover (j) with the following property:
• the i-th row of the disparity map D is put into an assignment field with Wo (j) ⁇ - j + D (ij).
• a variable j is first set to 1 and incremented continuously.
• Crossover (j) is set to 0. If the run variable drifts to a pixel CrossAnf for which Where (CrossAnf) ⁇ Where (CrossAnf - 1) applies, then the crossover image segment starts there and crossover (j) is set to 1 starting there. Now j is incremented until the condition Where (j)> Where (CrossAnf - 1) is fulfilled. From there, crossover (j) is reset to 0 until the next crossover image segment or the end of line i.
• a flow chart of this cross-over preprocessing is shown in FIG. In a second sub-step, a running variable j r is run over all subpixels of the display image B for each line.
• each pixel consists of 3 subpixels. Consequently, the transition from the subpixel to the associated pixel is always divided by 3. In the case that a pixel consists of more subpixels, eg 4 subpixels, it must be divided by 4 accordingly.
• the perspective to be displayed is first fetched from the matrix P. This matrix P indicates for each subpixel of the display which perspective should be displayed there.
• a variable j is assigned to each line of the left field, which is initially set to 0 (the left edge of the display image B).
• jl_PositionNeu In connection with the disparity D is a variable jl_PositionNeu can now be calculated which indicates at which position of the pixel P (i, j r) th perspective of the pixel R (i, j,) of the left part of the image would be represented. If this position is greater than j / 3, then j, must be decremented. If this position is smaller than j / 3, then j, must be incremented. This process is continued until a position j_unten is found which is just below j / 3. In the same way, j is incremented or decremented until a position j_oben is found which is just above j / 3.
• the subpixel can be fetched from R, (i, j_oben) or R, (i, j_unten).
• the corresponding pixel must be made of R, by interpolation between R, (i, j_unten) and R, (i, j_oben) and Figure on the perspective P (i, j r ) are calculated. From this, the required subpixel is extracted.
• the corresponding pixel has to be calculated from R r by interpolation between R r (i, Wohin (j_unten)) and R r (i, Wohin (j_oben)) and mapping to the perspective P (i, j r ). From this, the required subpixel is extracted.
• This case is treated like a left occlusion.
• the image segment must be displayed from left to right. (See 13 in FIG. 4)
• the cross-over postprocessing is performed.
• the left and right input field are set as perspective 0 and M-1 and have been automatically processed correctly.
• the left edge is labeled pixel position jimin.
• the right margin is labeled jlmax.
• this area is indicated by 14a.
• Wohin (jlmin) and Wohin (jlmax) For each of these variables is given Wohin (jlmin) and Wohin (jlmax).
• jrmin min (jlmin, Wohin (jlmin)) and
• jrmax: max (jlmax, where (jlmax)) the pixel indices between which the cross-over image segment from the left field R must travel to the right field R r .
• a running variable j r now runs from the left subpixel jrmin * 3 to the right subpixel jrmax * 3. For each of these subpixels, the perspective P (i, j r ) to be displayed can again be selected.
• jrmin_PositionNeu jimin + (Where (jlmin) - jimin) »P (i, j r) / M-1).
• jrmin_position is new> j / 3
• j r lies to the left of the cross-over range to be overlaid in the perspective P (i, j r ). In this case, nothing needs to happen.
• j r can be incremented. This case is marked in Fig. 4 with P1.
• jrmax_PositionNeu J I max + (Where (J I max) - J I max) "P (i, j r) / M-1) .. be calculated. If jrmax_PositionNew ⁇ j / 3, then j r lies to the right of the cross-over area to be overlaid in the perspective P (i, j r ). In this case, nothing must be done. j r can be incremented. This case is marked P3 in FIG. An overlay only has to be done if jrmin_PositionNew j / 3 ⁇ jrmax_PositionNew applies. In this case, the pixel will crossover pixels with
• j_scale denotes a variable which defines the cross-over image area between R, (i, jimin) and R
• (i, jlmax) maps to the cross-over image area of the perspective P (i, j r ), since it is not assumed that jlmax - jimin Wohinfllmax) - where (jlmin).
• CrossoverPixel transfers the corresponding subpixel to display image B of the interlaced perspectives. This case is indicated in Fig. 4 with P2.
• a scene without a crossover image segment is shown by way of example in FIG. 3 shows a left scene 1 and a right scene 1 1.
• the assignment field 2 describes the assignments of the pixels of the left scene 1 and to the pixels of the right scene 11.
• the left partial image 3 is the image of the left scene 1 and the right partial image 10 is the image of the right scene 11.
• the intermediate perspectives 4, 5, 6, 7, 8, and 9 must be synthesized or interpolated.
• In the left part of image 3 is the right cover 12 and in the right part of image 10, the left cover 13.
• the object 2b is in each case in the left part of image 3 and in the right part of image 10 available.
• FIG. 4 shows a left scene 1 and a right scene 1 1.
• the assignment field describing the assignments of the pixels of the left scene 1 and to the pixels of the right scene 1 1 is not shown in FIG.
• the left partial image 3 is the image of the left scene 1
• the right partial image 10 is the image of the right scene 1 1.
• the intermediate perspectives 4, 5, 6, 7, 8, and 9 must be synthesized or interpolated.
• 4 shows a rear object 2b and a front object 2c, which are respectively present in the left partial image 3 and in the right partial image 10.
• In the left partial image 3 is the right occlusion 12 and in the right partial image 10 the left occlusion 13.
• FIG. In the left partial image 3 is still thepieverdeckung 2a of the front object 2c.
• In the right partial image 10 is the left occlusion 2d of the front object 2c.
• the object surface of the cross-over object is parallel to the stereo base.
• the object surface of the cross-over object is facing the left camera with the left partial image.
• intermediate areas of the cross-over image area are to be treated as legal concealments and have to be in the course of the transition to the right partial image be hidden. The procedure for doing this is described in the step for regular disparity processing.
• the object surface of the cross-over object faces the right camera with the right field.
• intermediate areas of the cross-over image area are to be treated as left occlusions and must be superimposed during the transition to the right partial image. The procedure for doing this is described in the step for regular disparity processing.
• a high-resolution pseudoholographic or autostereoscopic display first receives a stereo image in one of the known formats with a resolution of, for example, 1920 ⁇ 1080 per image. It is then scaled to the resolution of the display, which is assumed to simplify the description at 19,200 x 1080.
• This received stereo image is analyzed and a very large number of intermediate perspectives, e.g. 1,000 perspectives synthesized therefrom, which are subsequently displayed on the display e.g. be displayed with lenticular lenses.
• each line of the display is assigned its own processing unit with the required local memory. This is referred to below as a row calculation unit.
• all units are synchronized by a control and monitoring unit.
• Data such as the output images, the rectified images, the feature vectors, or the interleaved output image are held in global memory which all of the row computation units can access in parallel. Since all units access this data only read-only or writing only on their associated line of the image and display, there are no synchronization or blocking problems. For a display with a resolution of 19,200 x 1080, at least 1080 row computation units are required. An implementation as a chip or single-board unit are no problem for today's chip technology, since graphics cards already exist with an equal number of processing units, called shaders.
• each row of the display is assigned a plurality of processing units.
• each pixel has its own processing unit.
• the then started search process continues as described.
• the structure of the pixel-wise assigned row calculation units is shown in FIG. 11.
• the global memory is divided into the memory for image data, feature data, disparity map and pseudoholographic output image.
• image data feature data
• disparity map disparity map
• pseudoholographic output image the following storage capacity must be calculated:
• Image data 33 MB Feature data 40 MB
• the inventive high-resolution pseudo-holographic display therefore has a storage capacity of 256 MB, including various intermediate variables. This display can already display 10 perspectives in high resolution without pixel loss.

Landscapes

• Engineering & Computer Science (AREA)
• Signal Processing (AREA)
• Multimedia (AREA)
• General Physics & Mathematics (AREA)
• Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Computer Graphics (AREA)
• Computer Hardware Design (AREA)
• Human Computer Interaction (AREA)
• Architecture (AREA)
• General Engineering & Computer Science (AREA)
• Software Systems (AREA)
• Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
• Devices For Indicating Variable Information By Combining Individual Elements (AREA)
• Stereoscopic And Panoramic Photography (AREA)

Applications Claiming Priority (2)

Publications (2)

Family

ID=44149833

Family Applications (3)

Family Applications After (2)

Country Status (6)

Families Citing this family (12)

Citations (2)

Family Cites Families (49)

• 2010
  • 2010-02-25 DE DE102010009291A patent/DE102010009291A1/de not_active Ceased
• 2011
  • 2011-02-25 JP JP2012554214A patent/JP6060329B2/ja active Active
  • 2011-02-25 US US13/580,909 patent/US9396579B2/en not_active Expired - Fee Related
  • 2011-02-25 KR KR1020127024214A patent/KR101852209B1/ko active Active
  • 2011-02-25 WO PCT/DE2011/000186 patent/WO2011103865A2/de not_active Ceased
  • 2011-02-25 JP JP2012554215A patent/JP6142985B2/ja active Active
  • 2011-02-25 EP EP11720977A patent/EP2540089A2/de not_active Withdrawn
  • 2011-02-25 KR KR1020127024212A patent/KR101825759B1/ko active Active
  • 2011-02-25 US US13/580,924 patent/US9324181B2/en not_active Expired - Fee Related
  • 2011-02-25 WO PCT/DE2011/000188 patent/WO2011103867A1/de not_active Ceased
  • 2011-02-25 WO PCT/DE2011/000187 patent/WO2011103866A2/de not_active Ceased
• 2016
  • 2016-03-23 US US15/078,596 patent/US10134180B2/en active Active
  • 2016-06-13 US US15/181,282 patent/US10229528B2/en active Active
  • 2016-10-24 JP JP2016208015A patent/JP6278323B2/ja not_active Expired - Fee Related

Patent Citations (2)

Non-Patent Citations (5)

Also Published As

Similar Documents

Legal Events