JP2007101930A - Method for forming and displaying element image of stereoscopic image and stereoscopic image display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method for forming and displaying the element image of a stereoscopic image for a stereoscopic image display device which has only to require small data capacity, small memory capacity and short processing time, which are made constant, when forming the element image for obtaining the stereoscopic image comprising a plurality of three-dimensional display elements, and the natural stereoscopic image can be observed, and to provide the stereoscopic image display device. <P>SOLUTION: In the stereoscopic image display device having a micro convex lens two-dimensional array 1 and a two-dimensional image display device 2 installed on the focal plane of the micro convex lens two-dimensional array 1, three-dimensional display pixel data comprising pixel position information and pixel color information, which are the component elements of the stereoscopic image, is successively selected, and the element image of the stereoscopic image is formed or displayed on the two-dimensional image display device 2 with the color information of a pixel group in a projection area of the selected three-dimensional display pixel data to the display surface of the two-dimensional display image device 2 as the color information of the three-dimensional display pixel data. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a stereoscopic image element image creation and display method and a stereoscopic image display device for obtaining a stereoscopic image from three-dimensional display pixel data.

  Images that give a three-dimensional effect are classified into several types according to visual effects that give a three-dimensional effect, as described in, for example, (Non-Patent Document 1) and (Non-Patent Document 2). Among them, holography that can observe a stereoscopic image by reproducing the same visual effect as when an object is actually seen is generally known.

  As one of these methods, an integral photography (hereinafter referred to as “IP”) method, a lenticular method, and the like are known. This is a method of shooting and displaying a stereoscopic image through a closely arranged fly-eye lens array or lenticular lens array, or a shooting of a stereoscopic image through a pinhole array described in Non-Patent Document 3. Some display devices are attracting attention because they can observe natural three-dimensional images without wearing special glasses.

  Here, taking IP as an example, FIG. 7 shows a basic principle for photographing and displaying a stereoscopic image.

  FIG. 7 is a diagram for explaining a conventional stereoscopic image display apparatus. For photographing, a fly-eye lens array (a compound-eye convex lens) 31 called a fly-eye lens (fly-eye lens) in which small convex lenses are regularly arranged is used. For each convex lens of the fly-eye lens array 31, an element image 34 of the object 33 is recorded on the film 32 and recorded. During reproduction, the film 32 is developed, placed in its original position, illuminated from the back, and the element image 34 recorded on the film 32 is observed through the fly-eye lens array 31, and the observer 35 sees the three-dimensional image 36. be able to. Each point of the elemental image 34 recorded on the film 32 is focused on the position where the original object 33 was located via each convex lens of the fly-eye lens array 31 at the time of display. It seems that light is emitted from that point. That is, the observer 35 forms a real image in the space where the object 33 was present, as if the real object is present there, and the visible portion of the stereoscopic image 36 appears to change according to the movement of the line of sight.

  However, in this state, a phenomenon occurs in which the depth of the stereoscopic image 36 is reversed. In other words, an image having the opposite irregularities is obtained. This is because the reproduced light beam travels backward toward the three-dimensional image 36 and is observed from the left side regardless of being photographed from the right side of the object 33 in FIG. Therefore, a procedure for converting the element image 34 shown in FIG. 8 is added. That is, since a simple convex lens results in an inverted image, the process of converting to an erect image is performed symmetrically with respect to the optical axis.

  In the IP system, since the upper limit of the resolution of the stereoscopic image 36 is determined by the lens density of the fly-eye lens array 31 viewed from the observer 35, a large number of lenses (that is, a large number of lenses) constituting the fly-eye lens array 31 are required to ensure image quality. Element image 34) is required. In addition, since each element image 34 requires a certain number of pixels, a large number of pixels are required as a whole.

  An image (hereinafter referred to as “element image”) displayed on a two-dimensional image display device for obtaining a stereoscopic image including such an IP system is a range finder, a stereo camera, CG (Computer Graphics), CT (Computerized Tomography). ), Each coordinate component (for example, X, Y, Z) of three-dimensional coordinates acquired by a medical device such as MRI (Magnetic Resonance Imaging), etc., and unique information such as color information (for example, R, G, B) of each object After creating multidimensional data constituted by the above, that is, voxel data, an element image is obtained by performing image processing called rendering on the voxel data. The rendering of the elemental image is performed on the voxel data in a pseudo manner by digital processing using mathematical calculation, corresponding to the optical analog processing performed using the film 32 and the actual object 33 described above. It is. For example, it is realized as follows by a program operating on a computer, a dedicated hardware circuit, or the like.

  That is, in the digital processing, first, a two-dimensional display pixel on the two-dimensional image display device is selected. Next, voxel data on a straight line passing through the two points “two-dimensional display pixel” and “lens principal point or pinhole position” is obtained. Then, the voxel data closest to the viewer is searched for among the voxel data, and the color information of the voxel data is set as the color information of the selected two-dimensional display pixel. That is, a search is performed in accordance with the direction of the light beam that is reproduced during stereoscopic image display, and the color of the 2D image display device is based on the “position information of the pixel of the 2D image display device” and the “lens principal point position or pinhole position”. The process of obtaining information is sequentially performed on all the two-dimensional display pixels of the two-dimensional image display device.

  Hereinafter, an example of an element image rendering method using a conventional stereoscopic image display apparatus (see, for example, Patent Document 1) will be described with reference to FIGS. 9 and 10.

  FIG. 9 shows another conventional stereoscopic image display apparatus, which is composed of a micro convex lens two-dimensional array 11 and a virtual photoconductor 22 which is one of two-dimensional image display devices. FIG. 10 is a flowchart showing processing of a stereoscopic image element image creation / display method in another conventional stereoscopic display device.

  First, in S101, Pa is selected. Next, in S102, a straight line Pa connecting Pa and the principal point of one convex lens in the micro convex lens two-dimensional array 11 (intersection of straight line Pa-Sa, straight line Pb-Sb, straight line Pc-Sc at the lens center). -Find Sa first. In S103, among the two three-dimensional pixels on the straight line Pa-Sa, the RGB value that is the color information of the pixel Fa on the observer side is set as the RGB value of the color information of the two-dimensional display pixel Pa. Thereafter, in S104, the presence or absence of the remaining “two-dimensional display image data” is checked. In S104, when there is no remaining “two-dimensional display image data”, the process is terminated, and when there is, the process proceeds to S101. When the process proceeds to S101, a three-dimensional pixel on the straight line Pb-Sb is searched for Pb, and the RGB value of the three-dimensional pixel Fb is set as the RGB value of the two-dimensional display pixel Pb. Similarly, for Pc, a three-dimensional pixel on the straight line Pc-Sc is searched, and the RGB value of the three-dimensional pixel Fc is set as the RGB value of the two-dimensional display pixel Pc. In this way, the process is sequentially repeated from S101 to S103 for all the two-dimensional display pixels. That is, basically, basic processing is performed for the number of pixels of the two-dimensional image display device.

  In the process of finding the pixel on the most observer side in S103, Pa, Pb, Pc on the search line on the search line in increments of several pixels from the farthest point indicated by Sa, Sb, Sc. The search is repeatedly performed in the direction of..., And when it enters the inside of the stereoscopic image, a process of searching pixel by pixel in the reverse direction is performed.

  That is, iterative processing is performed in order to obtain the most necessary three-dimensional pixel on the viewer side on the search line from one selected two-dimensional pixel.

The element image thus obtained allows a natural three-dimensional image to be observed through a fly-eye lens or a pinhole, and a high sense of presence and immersion can be experienced.
JP 2003-109042 A Takayoshi Ohkoshi, “3D image engineering” (version), Asakura Shoten, (Date of publication), (Page) Hiroshi Inoue, “Exploring the Mystery of Stereoscopic Vision”, (Version), Optronics, (Date of Publication), (Page) Kazutoshi Yanaka, Satoshi Sasaki, Hideo Kasuga, Tanyuki Hoshino, “Stereoscopic Display Using Inkjet Printer”, IEICE Technical Report, (Date of Publication), 102, 642, p. 17-20

  Since voxel data, that is, three-dimensional pixel data, requires a large amount of calculation and a large data storage area for data acquisition, generally the number of these three-dimensional display pixels is a pixel on a two-dimensional image display device that renders an element image. Not so big compared to the number.

  For example, the number of three-dimensional display pixels generally used in medical images is 512 × 512 × 512 or 512 × 512 × 256. The stereoscopic image display does not require the pixels inside the displayed three-dimensional object, and it is sufficient if there are pixels on the surface, so the number of pixels actually required is six planes of 512 × 512 pixels, that is, 512 × 512 ×. 6 is considered.

  On the other hand, the number of pixels of the two-dimensional image display device used to display this stereoscopic image is 7600 × 9200 pixels (1016 ppi, 8 × 10 inch size) if the two-dimensional image display device to be used is a high resolution film. In the case of printing with an inkjet printer of Non-Patent Document 3, it is 5760 × 5760 pixels (720 ppi, A4 size). The liquid crystal display capable of stereoscopic display that has started to appear recently has 3840 × 2400 pixels (204 ppi, 22-inch liquid crystal). This is the above-mentioned “the number of three-dimensional display pixels only on the surface required for stereoscopic image display 512 × 512”. × 6 ”is about 6 times.

  In order to obtain a natural stereoscopic effect, as described in Non-Patent Document 3, in order to display an image in the direction of 32 × 32 = 1024 on the two-dimensional image display device, 512 × 512 × 1024. Two-dimensional display pixels are required, which is about 170 times the above-mentioned “the number of three-dimensional display pixels only on the surface required for stereoscopic image display 512 × 512 × 6”.

  With the development of high-definition video software such as high-definition television, digital terrestrial broadcasting, and high-definition DVD (Digital Versatile Disk) movie appreciation, the resolution of 2D image display devices will continue to increase. However, since the number of pixels on the two-dimensional image display device is at least about 6 times larger than the three-dimensional display pixel as described above, the number of basic processes is considerably increased in the conventional rendering method. Since a search process with an indefinite number of repetitions is performed in the three-dimensional pixel search process in the basic process, a large amount of calculation is required.

  That is, (1) in a process of searching for a three-dimensional display pixel in space from a two-dimensional display pixel on a plane, in order to obtain a target three-dimensional display pixel, a two-dimensional display pixel and a lens principal point or pin It is necessary to perform an iterative search process with an indefinite number of repetitions on a search line that passes through two points at the hole position, and the amount of calculation of the color information calculation process itself for each two-dimensional display pixel increases. (2) The acquisition of 3D display pixel data requires a high amount of computation, and a parallax image from multiple directions is required to obtain a natural stereoscopic effect. The number of two-dimensional display pixels of the element image is larger than the number. (3) If a high-resolution two-dimensional image display device is used, “if the number of two-dimensional pixels is doubled, the amount of calculation is also doubled”, for example, “color information of each two-dimensional display pixel” There is a problem that the number of operations of “calculation processing” simply increases, and it is difficult to achieve both high image quality and high-speed processing.

  In view of this, the present invention provides a small and constant data capacity, memory capacity and processing time when creating an element image for obtaining a three-dimensional image composed of a plurality of three-dimensional display pixels. An object of the present invention is to provide a stereoscopic image element image creation and display method and a stereoscopic image display device.

  To achieve the above object, the present invention sequentially selects three-dimensional display pixel data consisting of pixel position information and pixel color information, which are components of a stereoscopic image, and a two-dimensional display image of the selected three-dimensional display pixel shape. The color information of the pixel group in the projection area on the device display surface is used as the color information of the three-dimensional display pixel data to create or display a stereoscopic image element image on the two-dimensional image display device.

  According to the stereoscopic image element image creation and display method of the present invention, the basic processing of stereoscopic image display is the number of stereoscopic pixels, whereas the conventional method is the basic processing of the number of two-dimensional pixels, Reduction can be realized.

  In addition, even when the 2D image display device has a higher resolution, the color information of the 2D display pixel group in the projection area onto the 2D image display surface of the 3D display pixel shape is collectively acquired. For this reason, an increase in the calculation time due to the increase in the number of pixels only increases the number of times of writing color information in the memory by the number of pixels, and there is no significant change in the calculation time, and high resolution can be realized.

  In addition, since an indefinite repeated calculation process does not occur, a stereoscopic image element image can always be obtained in the same processing time.

  That is, since the color information of the two-dimensional display pixel of the element image is obtained from the projection area on the two-dimensional image display device display surface of the three-dimensional display pixel shape of the stereoscopic image, the following effects are produced.

  (1) In general, iterative processing for the number of three-dimensional display pixels smaller than the number of pixels of the two-dimensional image display device is sufficient.

  (2) The search is not performed by an iterative process with an indefinite number of repetitions, but “a search line that passes through two points of“ vertex of 3D display pixel shape in space ”and“ lens principal point position or pinhole position ”and“ “Several two-dimensional display pixels” (hereinafter, referred to as “multiple two-dimensional display pixels” in the projection area onto the “two-dimensional image display device display surface” of the three-dimensional display pixel shape by simple calculation of obtaining the intersection of the “display surface of the two-dimensional image display device”. Color information of a two-dimensional display pixel group) can be acquired at once.

  (3) As described in (2) above, since the color information of the two-dimensional pixel group in the projection area can be acquired at once, even if the resolution of the two-dimensional image display device is increased and the number of pixels is increased, the amount of calculation does not change greatly.

  (4) The voxel data is sorted in advance from the back of the observer in the depth direction, and the sorted voxel data is rendered in order from the back of the data so that the previous image is overwritten on the shadowed portion. This has the advantage that the hidden surface processing can be performed naturally, and is effective in achieving both high image quality and high-speed processing in stereoscopic image display.

  1st invention of this application selects the three-dimensional display pixel data which consist of pixel position information and pixel color information which are the components of a three-dimensional image one by one, The two-dimensional display image device display surface of the selected three-dimensional display pixel shape The color information of the pixel group in the projection area is generated or displayed as the color information of the three-dimensional display pixel data on the two-dimensional image display device.

  As a result, the basic processing of stereoscopic image display is the number of stereoscopic pixels, and the number of computations can be reduced while the conventional method is the basic processing of the number of two-dimensional pixels.

  In addition, even when the 2D image display device has a higher resolution, the color information of the 2D display pixel group in the projection area onto the 2D image display surface of the 3D display pixel shape is collectively acquired. Therefore, an increase in the calculation time due to the increase in the number of pixels only increases the number of times of writing color information in the memory by the number of pixels, and there is no significant change in the calculation time, and high resolution can be realized.

  In addition, since an indefinite repeated calculation process does not occur, a stereoscopic image element image can always be obtained in the same processing time.

  A second invention of the present application is a stereoscopic image display device having a two-dimensional micro convex lens two-dimensional array and a two-dimensional image display device installed on a focal plane thereof, and pixel position information and pixel color information which are components of a stereoscopic image. 3D display pixel data is sequentially selected, and the color information of the pixel group in the projection area of the selected 3D display pixel data on the 2D display image device display surface is displayed. As described above, a three-dimensional element image is created or displayed on the two-dimensional image display device.

  A stereoscopic image display device having a two-dimensional array of micro convex lenses and a two-dimensional image display device installed on the focal plane thereof enables a stereoscopic image to be created or displayed on the two-dimensional image display device. An image display device can be created, and a more natural and high-resolution stereoscopic image can always be obtained in the same processing time.

  According to a third aspect of the present invention, in a stereoscopic image display apparatus having a pinhole two-dimensional array and a two-dimensional image display device installed in parallel therewith, from pixel position information and pixel color information which are components of a stereoscopic image. The three-dimensional display pixel data is sequentially selected, and the color information of the pixel group in the projection region of the selected three-dimensional display pixel data on the display surface of the two-dimensional display image device is used as the color information of the three-dimensional display pixel data. A stereoscopic image element image is created or displayed on the two-dimensional image display device.

  A stereoscopic image display device having a pinhole two-dimensional array and a two-dimensional image display device installed in parallel with the pinhole two-dimensional array enables creation or display of a three-dimensional element image on the two-dimensional image display device. A display device can be created, and a more natural and high-resolution stereoscopic image can always be obtained in the same processing time.

  A fourth invention of the present application is a stereoscopic image display device having a lenticular lens array and a two-dimensional image display device installed in parallel therewith, comprising pixel position information and pixel color information which are constituent elements of a stereoscopic image. The three-dimensional display pixel data is sequentially selected, and the color information of the pixel group in the projection area of the selected three-dimensional display pixel data on the two-dimensional display image device display surface is used as the color information of the three-dimensional display pixel data. A stereoscopic image element image is created or displayed on the two-dimensional image display device.

  By forming a stereoscopic image display device having a lenticular lens array and a two-dimensional image display device installed in parallel therewith, a stereoscopic image display for creating or displaying a stereoscopic image element image on the two-dimensional image display device A device can be created, and a more natural and high-resolution stereoscopic image can always be obtained in the same processing time.

  A fifth invention of the present application is a stereoscopic image display apparatus having a parallax barrier and a two-dimensional image display device installed in parallel therewith, comprising 3 pixel position information and pixel color information which are components of a stereoscopic image. The three-dimensional display pixel data is sequentially selected, and the color information of the pixel group in the projection region of the selected three-dimensional display pixel data on the two-dimensional display image device display surface is used as the color information of the three-dimensional display pixel data. A feature is that a stereoscopic image element image is created or displayed on a two-dimensional image display device.

  A stereoscopic image display apparatus having a parallax barrier and a two-dimensional image display device installed in parallel with the parallax barrier, and creating or displaying a three-dimensional element image on the two-dimensional image display device. Thus, a more natural and high-resolution stereoscopic image can always be obtained with the same processing time.

  Hereinafter, a stereoscopic image display device according to an embodiment of the present invention will be described with reference to the drawings.

(Embodiment)
FIG. 1 is a diagram for explaining a stereoscopic image display apparatus that displays images by a stereoscopic image element image creation / display method according to an embodiment of the present invention. As shown in FIG. 1, the stereoscopic image display apparatus according to the present embodiment includes a micro-convex lens two-dimensional array 1 and a two-dimensional image display device 2.

  The micro-convex lens two-dimensional array 1 has an action of changing the direction of light emitted from the two-dimensional image display device 2 in a direction corresponding to the pixel position with respect to the lens. In the present embodiment, a pinhole two-dimensional array can be used as the micro-convex lens two-dimensional array 1. If the parallax direction only needs to be one direction, the micro convex lens two-dimensional array 1 can also be used as a lenticular lens or a parallax barrier. When the micro convex lens two-dimensional array 1 is a pinhole two-dimensional array, a lenticular lens, or a parallax barrier, the two-dimensional image display device 2 is installed in parallel.

  The two-dimensional image display device 2 is installed on the focal plane of the micro convex lens two-dimensional array 1 and has a function of emitting light rays that are the basis of a stereoscopic image to the micro convex lens two-dimensional array 1. The two-dimensional image display device 2 may be a combination of a printing sheet and a flat light source with a film or a printer, or a display screen with a liquid crystal display or a projector. In addition, if the light can be emitted to the micro convex lens two-dimensional array 1 by reflected light from the viewer side instead of light emission from the back side, the two-dimensional image display device 2 can be used for simple film, printer, offset printing, and the like. It may be printed matter.

  In order to display the stereoscopic image 5 in an arbitrary space, the stereoscopic image display device according to the present embodiment displays a 3D display pixel (hereinafter referred to as “voxel”) for representing the stereoscopic image 5 as a set of minute rectangular parallelepipeds. And the global coordinate origin 3 placed on the two-dimensional image display device 2 to define the positional relationship of the entire apparatus.

  The observer 6 observes the direction of the two-dimensional image display device 2 from the micro convex lens two-dimensional array 1 side with respect to the two-dimensional image display device 2. Here, it is parallel to the display surface of the two-dimensional image display device 2, the horizontal direction is the X direction, the vertical direction is the Y direction, and is perpendicular to the display surface of the two-dimensional image display device 2, and 2 A direction from the display surface of the two-dimensional image display device 2 to the micro convex lens two-dimensional array 2 is defined as a Z direction.

  A stereoscopic image element image creation / display method according to the embodiment of the present invention will be described with reference to FIG. FIG. 2 is a flowchart showing processing of the stereoscopic image element image creation / display method according to the embodiment of the present invention.

  First, the voxel data is sorted in the order of each depth data component. In the case of the present embodiment, the data is rearranged in ascending order according to the value of the Z data, and the voxel data is sorted from the viewer back side to the viewer front side (S201 processing).

  Next, one voxel data is selected in the sorted order (S202 process), and a lens for reproducing light rays is selected from the micro convex lens two-dimensional array 1 (S203 process). In this embodiment, since each voxel is a cube (shown by reference numerals 72 and 75 in FIG. 5 and reference numerals 82 and 85 in FIG. 6, details will be described later), the voxel data includes eight vertices. It is a collection of coordinate data and color data.

  Next, each straight line connecting each of the eight vertices of the voxel data selected in S202 and the principal point of the lens selected in S203 is extended, and these extended straight lines and the display surface of the two-dimensional image display device 2 are displayed. Is obtained (S204 processing). The region projected on the display surface of the two-dimensional image display device 2 formed by these eight intersections is usually a hexagon. That is, at least two vertices of the eight vertices of the voxel data are projected into a region connecting the other six vertices. If the voxel selected in S202 faces the lens selected in S203, the region projected on the display surface of the two-dimensional image display device 2 is a square.

  Thus, out of the areas projected on the display surface of the two-dimensional image display device 2, the color information data RGB value of the two-dimensional display pixel group in the lens area selected in S203 is the color of the voxel data selected in S202. Information RGB values are set (S205).

  Here, the contents of the processing of S204 and S205 will be described in detail based on FIG. 3 and FIG. 3 and 4 are cross-sectional views seen from the direction A in FIG.

  First, in FIG. 3, when a straight line is drawn from each vertex of the voxel cross section 54 to the lens principal point 53 to obtain an intersection with the two-dimensional image display device 2, a two-dimensional display pixel 55 is obtained as a projection region of the voxel cross section 54. It is done. As shown in FIG. 4, the case of the cross-section 62 and the cross-section 65 of two voxels having different depth data, that is, Z data values will be compared. When the projection area on the display surface of the two-dimensional image display device 2 at the lens principal point 61 with respect to the voxel cross-section 62 and with the lens principal point 64 with respect to the voxel cross-section 65 is obtained, 2 pixels for 5 pixels are obtained. The two-dimensional display pixel group 63 and the two-dimensional display pixel 66 having only a projection area originally less than one pixel are obtained.

  As can be seen from FIG. 4, even for voxels of the same size, the projection area becomes larger as the distance from the lens principal point plane 52 becomes smaller, and the projection area becomes smaller as the distance from the lens principal point plane 52 increases.

  Therefore, in the process of S205, the same color information data (for example, RGB) can be written to a larger number of two-dimensional pixels as voxels near the principal point plane of the lens.

  Further, in the batch writing process to a large number of two-dimensional pixels as in S205, the calculation calculation amount of the projected point coordinates on the display surface of the two-dimensional image display device 2 calculated from the eight vertices of the selected voxel is the projection area. Since it is constant regardless of the size, the increase in the processing time due to the increase in the number of pixels of the two-dimensional pixel group is only an increase in the time for writing the color information data RGB values into the memory. Since the writing time to the memory in S205 is usually insignificant compared with the projection coordinate calculation processing time shown in S202 to S204, even if the resolution on the surface of the two-dimensional image display device 2 is increased, the entire time shown in FIG. The processing time is not so long.

  Thereafter, the same process is sequentially performed by checking the presence or absence of the remaining lens in S206 and performing the presence or absence of the remaining voxel data in S207.

  As described above, the number of repetitions from S202 to S207 is generally the number of voxel pixels smaller than the number of two-dimensional display pixels. The processing shown in S202 to S204 (calculation processing of projection point coordinates on the display surface of the two-dimensional image display device 2 from the eight vertices of each selected voxel) is not a search processing in which the number of repetitions is uncertain, Since it is possible to formulate it, it is easy to speed up parallel processing and the like. As a result, the processing time can be further shortened.

  Next, in order to improve the image quality of the displayed stereoscopic image, the calculation processing time when the high-resolution two-dimensional image display device 2 is used is compared. In the conventional method, the number of two-dimensional display pixels is basically the required number of processes. Therefore, when the number of pixels is doubled using a high-resolution two-dimensional image display device, it is usually simply doubled. It was calculation processing time. However, in the stereoscopic image element image creation and display method according to the present embodiment, the number of three-dimensional display pixels (number of voxels) is basically the number of necessary processes, and the two-dimensional image display device 2 from one voxel data. Batch writing processing to the two-dimensional display pixel group in the projection area on the display surface is also possible.

  This is shown in FIG. 5 and FIG. FIG. 6 shows a display state of a two-dimensional display pixel when using the high-resolution two-dimensional image display device 2 having the number of pixels twice as long as that in FIG. 5 and four times as large as the area. The voxel 72 and voxel 82 near the lens principal point are compared with the voxel 75 and voxel 85 far from the lens principal point. The projection area of each voxel shape on the display surface of the two-dimensional image display device 2 is a hexagon having the same size and shape as shown in FIG. 5 and FIG.

  Note that the projection area indicated by the solid line in FIG. 5 and FIG. 6 is a virtual illustration of the result of the calculation of the projection point position coordinates performed by the internal processing at the time of rendering. It is not displayed on the two-dimensional image display device 2. In actual display, the shaded pixel group is displayed in the color information data RGB value corresponding to each voxel. The difference between FIG. 5 and FIG. 6 is only the difference in the number of pixels in the projection area due to the size difference of the two-dimensional display pixels included in the hexagonal projection area. Therefore, even if the number of pixels of the two-dimensional pixel increases, the calculation calculation amount of the projection point coordinates on the two-dimensional image display device 2 of the voxel is constant regardless of the size of the projection region. The increase in the processing time due to the increase in the number is only an increase in the writing time of the color information data RGB values into the memory. Since the writing time to the memory is very small compared with the calculation processing time of the projected coordinates, the increase in the calculation time due to the increase in the number of pixels of the two-dimensional image display device 2 is small. From the above, it can be said that the stereoscopic image element image creation and display method according to the present embodiment is advantageous for achieving both high resolution and high speed processing as compared with the conventional method.

  As described above, according to the stereoscopic image element image creation and display method according to the embodiment of the present invention, the number of processes that are basically required for stereoscopic image display is the number of stereoscopic pixels (number of voxels), and the conventional method is two-dimensional. In contrast to the basic processing of the number of pixels, the number of operations can be reduced.

  Further, even when the two-dimensional image display device 2 has a higher resolution, a process of collectively acquiring the color information of the two-dimensional display pixel group in the projection area onto the two-dimensional image display surface having the three-dimensional display pixel shape. Therefore, the increase in the calculation time due to the increase in the number of pixels only increases the number of times of writing the color information in the memory by the number of pixels, and high resolution can be realized without increasing the calculation time so much.

  In addition, since an indefinite repeated calculation process does not occur, a stereoscopic image element image can always be obtained in the same processing time. Furthermore, a more natural and high-resolution stereoscopic image can always be obtained in the same processing time.

  Note that, here, a case in which parallax has parallax in two directions like a micro-convex lens two-dimensional array has been shown, but in the case of having parallax only in one direction like a lenticular lens array or parallax barrier, FIG. It is only necessary to consider that the cross section as shown in FIG. 4 exists in the direction in which parallax does not occur, that is, usually the number of three-dimensional display pixels (number of voxels) in the vertical direction, and similar effects can be obtained.

  As described above, the stereoscopic image element image creation and display method according to the present invention has an effect of achieving both high resolution and high speed processing when displaying a stereoscopic image from three-dimensional display pixel data. The present invention can be applied to a service that provides a stereoscopic image, a stereoscopic image receiving terminal used for the service, a hologram display device, a hologram CAD for architecture, design, and mechanism, a stereoscopic image generation software that operates on a computer, and the like.

The figure explaining the stereoscopic image display apparatus displayed with the stereoscopic image element image creation display method in embodiment of this invention The flowchart which shows the process of the stereo image element image creation display method in embodiment of this invention Sectional view seen from direction A in FIG. Sectional view seen from direction A in FIG. The figure which shows the display state of the two-dimensional display pixel in embodiment of this invention The figure which shows the display state of the two-dimensional display pixel at the time of use of the high-resolution two-dimensional image display device in embodiment of this invention The figure explaining the conventional stereoscopic image display apparatus The figure which shows the process of the stereoscopic image element image creation display method in the conventional stereoscopic display apparatus The figure explaining other conventional three-dimensional image display apparatuses. The flowchart which shows the process of the stereoscopic image element image preparation display method in the other conventional stereoscopic display apparatus

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Micro convex lens 2D array 2 2D image display device 3 Global coordinate origin 4 Origin of 3D display pixel (voxel) 5 Stereo image 6 Observer 52 Lens principal point surface 53 Lens principal point 54 Cross section 55 Two-dimensional display pixel 61 Lens Main point 62 Cross section of voxel 63 Two-dimensional display pixel group 64 Lens main point 65 Cross section of voxel 66 Two-dimensional display pixel 72 Voxel 75 Voxel 82 Voxel 85 Voxel

Claims (5)

A group of pixels in the projection area of the three-dimensional display pixel data, which is sequentially selected from the three-dimensional display pixel data including the pixel position information and the pixel color information, which are components of the stereoscopic image, and the selected three-dimensional display pixel data on the two-dimensional display image device display surface A stereoscopic image element image creating / displaying method comprising: creating or displaying a stereoscopic image element image on a two-dimensional image display device using the color information as color information of the three-dimensional display pixel data. In a stereoscopic image display apparatus having a micro-convex lens two-dimensional array and a two-dimensional image display device installed on the focal plane thereof,
Pixels in the projection area of the selected 3D display pixel data on the display surface of the 2D display image device are selected by sequentially selecting 3D display pixel data consisting of pixel position information and pixel color information, which are constituent elements of a stereoscopic image. A three-dimensional image display apparatus that creates or displays a three-dimensional element image on the two-dimensional image display device using color information of a group as color information of the three-dimensional display pixel data. In a stereoscopic image display device having a pinhole two-dimensional array and a two-dimensional image display device installed in parallel therewith,
Pixels in the projection area of the selected 3D display pixel data on the display surface of the 2D display image device are selected by sequentially selecting 3D display pixel data consisting of pixel position information and pixel color information, which are constituent elements of a stereoscopic image. A three-dimensional image display apparatus that creates or displays a three-dimensional element image on the two-dimensional image display device using color information of a group as color information of the three-dimensional display pixel data. In a stereoscopic image display apparatus having a lenticular lens array and a two-dimensional image display device installed in parallel therewith,
Pixels in the projection area of the selected 3D display pixel data on the display surface of the 2D display image device are selected by sequentially selecting 3D display pixel data consisting of pixel position information and pixel color information, which are constituent elements of a stereoscopic image. A three-dimensional image display apparatus that creates or displays a three-dimensional element image on the two-dimensional image display device using color information of a group as color information of the three-dimensional display pixel data. In a stereoscopic image display apparatus having a parallax barrier and a two-dimensional image display device installed in parallel therewith,
Pixels in the projection area of the selected 3D display pixel data on the display surface of the 2D display image device are selected by sequentially selecting 3D display pixel data consisting of pixel position information and pixel color information, which are constituent elements of a stereoscopic image. A three-dimensional image display apparatus that creates or displays a three-dimensional element image on the two-dimensional image display device using color information of a group as color information of the three-dimensional display pixel data.

Images