JP2007104474A - Solid image display unit and method for generating and displaying element image thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method for generating and displaying an element image for a solid image of a solid image display unit, and to provide the solid image display unit, enabling reduction of data capacity, memory capacity and processing time of constant magnitude, when generating the element image for obtaining the solid image constituted of a plurality of three-dimensional display elements, and enabling the solid image to be observed without unnaturalness. <P>SOLUTION: In the processing for generating the element image for the solid image on a two-dimensional image display device, a view field angle 15b obtained through the positional relationship between a two-dimensional convex microlens array 1 and the two-dimensional display device 2 is calculated in two orthogonal directions in the display plane of the two-dimensional display device, to obtain an X-directional view field angle and a Y-directional view field angle. The calculation object of the element image of the solid image is limited only to a convex microlens having a principal point positioned in the area of a quadrangular pyramid formed of the selected three-dimensional display pixel position as vertex, the X-directional view field angle and the Y-directional view field angle as vertical angles, and the display plane of the two-dimensional display device 2 as base. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a stereoscopic image element image creation and display method and a stereoscopic image display apparatus for a stereoscopic image display apparatus for obtaining a stereoscopic image from three-dimensional pixel display data.

  Images that give a three-dimensional effect are classified into several types according to visual effects that give a three-dimensional effect, as described in, for example, (Non-Patent Document 1) and (Non-Patent Document 2). Among them, holography that can observe a stereoscopic image by reproducing the same visual effect as when an object is actually seen is generally known.

  As one of these methods, an integral photography (hereinafter referred to as “IP”) method, a lenticular method, and the like are known. This is a method of taking and displaying a stereoscopic image through a closely arranged fly-eye lens array or lenticular lens array, or a pinhole array described in (Non-patent Document 3). There are some that take pictures and display, and they are attracting attention because they can observe natural three-dimensional images without wearing special glasses.

  Here, taking IP as an example, FIG. 8 shows a basic principle for photographing and displaying a stereoscopic image.

  FIG. 8 is a diagram illustrating a basic principle for photographing a stereoscopic image by the integral photography method.

  For photographing, a fly-eye lens array (a compound eye lens) 31 called a fly-eye lens (fly-eye lens) in which small convex lenses are regularly arranged is used. For each convex lens of the fly-eye lens array 31, an element image 34 of the three-dimensional object 33 is recorded on the film 32 and recorded. During reproduction, the film 32 is developed, placed in its original position, illuminated from the back, and the element image 34 recorded on the film 32 is observed through the fly-eye lens array 31, and the observer 35 sees the three-dimensional image 36. be able to. Each point of the element image 34 recorded on the film 32 is focused on the position where the original three-dimensional object 33 was located via each convex lens of the fly-eye lens array 31 at the time of display. And it seems that light is actually emitted from that point. That is, the observer 35 forms a real image in the space where the three-dimensional object 33 was present, and it appears as if the real object is there, and the visible portion of the stereoscopic image 36 changes according to the movement of the line of sight. .

  However, in this state, a phenomenon occurs in which the depth of the stereoscopic image 36 is reversed. In other words, an image having the opposite irregularities is obtained. This is because the reproduced light beam travels backward toward the three-dimensional image 36 and is observed from the left side regardless of being photographed from the right side of the three-dimensional object 33 in FIG. For this reason, a procedure for converting the element image 34 shown in FIG. 9 is added. That is, since a simple convex lens results in an inverted image, the process of converting to an erect image is performed symmetrically with respect to the optical axis.

  In the IP system, since the upper limit of the resolution of the stereoscopic image 36 is determined by the lens density of the fly-eye lens array 31 viewed from the observer 35, a large number of lenses (that is, a large number of lenses) constituting the fly-eye lens array 31 are required to ensure image quality. Element image 34) is required. In addition, since each element image 34 requires a certain number of pixels, a large number of pixels are required as a whole.

  An image (hereinafter referred to as “element image”) displayed on a two-dimensional display device for obtaining a stereoscopic image including such an IP system is a range finder, a stereo camera, a CG (Computer Graphics), and a CT (Computerized Tomography). Specific information such as coordinate components (eg, X, Y, Z) of three-dimensional coordinates and color information (eg, R, G, B) of each object acquired by medical equipment such as MRI (Magnetic Resonance Imaging) After creating multi-dimensional data to be configured, that is, voxel data, an element image is obtained by performing image processing called rendering on the voxel data. The rendering of the element image is performed by artificially processing the portion corresponding to the optical analog processing performed using the film 32 and the actual three-dimensional object 33 on the voxel data by digital processing using mathematical calculation. Is what you do. For example, it is realized as follows by a program operating on a computer, a dedicated hardware circuit, or the like.

  That is, in the digital processing, first, a two-dimensional display pixel on the two-dimensional display device is selected. Next, voxel data on a straight line passing through the two points “two-dimensional display pixel” and “lens principal point or pinhole position” is obtained. The voxel data closest to the viewer 35 is searched from the voxel data, and the color information of the voxel data is used as the color information of the selected two-dimensional display pixel. In other words, a search is performed according to the direction of the light beam that is reproduced during stereoscopic image display, and the color information of the two-dimensional display device is obtained based on the “pixel position information of the two-dimensional display device” and “lens principal point position or pinhole position” The process of obtaining is sequentially performed for all the two-dimensional display pixels of the two-dimensional display device.

  Hereinafter, an example of an element image rendering method by a conventional stereoscopic image display apparatus will be described with reference to FIGS. 10 and 11 (see, for example, Patent Document 1).

  FIG. 10 is a diagram illustrating an example of a conventional stereoscopic image display apparatus, which includes a micro-convex lens two-dimensional array 11 and a virtual photoconductor 22 that is one of two-dimensional display devices. FIG. 11 is a flowchart showing processing of a stereoscopic image element image creation / display method in a conventional stereoscopic display device.

  First, in S401, Pa is selected. Next, in S402, a straight line Pa- connecting Pa and a principal point of one convex lens in the two-dimensional array of micro convex lenses (intersection of straight line Pa-Sa, straight line Pb-S, straight line Pc-Sc at the lens center). Sa is determined first. In S403, the RGB value that is the color information of the pixel Fa on the viewer 35 side out of the two three-dimensional pixels on the straight line Pa-Sa is set as the RGB value of the color information of the two-dimensional display pixel Pa. In step S404, the presence / absence of the remaining “two-dimensional display image data” is checked. In S404, if there is no remaining “two-dimensional display image data”, the process ends. If there is, the process proceeds to S401. When the process proceeds to S401, a three-dimensional pixel on the straight line Pb-Sb is searched for Pb, and the RGB value of the three-dimensional pixel Fb is set as the RGB value of the two-dimensional display pixel Pb. Similarly, for Pc, a three-dimensional pixel on the straight line Pc-Sc is searched, and the RGB value of the three-dimensional pixel Fc is set as the RGB value of the two-dimensional display pixel Pc. In this manner, S401 to S403 are sequentially repeated for all the two-dimensional display pixels. That is, basically, basic processing is performed for the number of pixels of the two-dimensional display device.

  In the process of finding the pixel closest to the viewer 35 in S403, Pa, Pb, and Pb on the two-dimensional display pixel side on the search line in increments of several pixels from the farthest point indicated by Sa, Sb, Sc. A search is repeatedly performed in the direction of Pc..., And when entering the inside of the stereoscopic image, a process of searching one pixel at a time in the reverse direction is performed. That is, iterative processing is performed in order to obtain the most necessary three-dimensional pixel on the viewer 35 side on the search line from one selected two-dimensional pixel.

  The element image thus obtained allows a natural three-dimensional image to be observed through a fly-eye lens or a pinhole, and a high sense of presence and immersion can be experienced.

  Since voxel data, that is, three-dimensional pixel data, requires a large amount of calculation and a large data storage area for data acquisition, the number of these three-dimensional display pixels is generally the number of pixels on a two-dimensional display device that renders an element image. Is not so big compared to For example, the number of three-dimensional display pixels generally used in medical images is 512 × 512 × 512 or 512 × 512 × 256. The stereoscopic image display does not require the pixels inside the displayed three-dimensional object, and it is sufficient if there are pixels on the surface, so the number of pixels actually required is six planes of 512 × 512 pixels, that is, 512 × 512 ×. 6 is considered. On the other hand, the number of pixels of the 2D display device used to display this stereoscopic image is 7600 × 9200 pixels (1016 ppi, 8 × 10 inch size film) if the 2D display device to be used is a high resolution film. In the case of printing with the inkjet printer of (Non-Patent Document 3), it is 5760 × 5760 pixels (720 ppi, A4 size). The liquid crystal display capable of stereoscopic display that has started to appear recently has 3840 × 2400 pixels (204 ppi, 22-inch liquid crystal). This is the above-mentioned “the number of three-dimensional display pixels only on the surface required for stereoscopic image display 512 × 512”. × 6 ”is about 6 times.

  In order to obtain a natural stereoscopic effect, as described in (Non-Patent Document 3), in order to display an image in the direction of 32 × 32 = 1024 on a two-dimensional display device, 512 × 512 × 1024. 2D display pixels are required, which is approximately 170 times the above-mentioned “the number of 3D display pixels only on the surface required for stereoscopic image display 512 × 512 × 6”.

  With the development of high-definition video software such as high-definition, digital terrestrial broadcasting, and high-definition DVD (Digital Versatile Disk) movie appreciation, it is considered that the resolution of 2D display devices will continue to increase. As described above, since the number of pixels on the two-dimensional display device is at least about 6 times larger than that of the three-dimensional display pixel, the number of basic processes is considerably increased in the conventional rendering method, and each basic process is further increased. In the three-dimensional pixel search process, a search process with an indefinite number of repetitions is performed, so that a large amount of computation is required.

  That is, (1) in a process of searching for a three-dimensional display pixel in space from a two-dimensional display pixel on a plane, in order to obtain a target three-dimensional display pixel, a two-dimensional display pixel and a lens principal point or pin It is necessary to perform an iterative search process with an indefinite number of repetitions on a search line that passes through two points at the hole position, and the amount of calculation of the color information calculation process itself for each two-dimensional display pixel increases. (2) The acquisition of 3D display pixel data requires a high amount of computation, and a parallax image from multiple directions is required to obtain a natural stereoscopic effect. The number of two-dimensional display pixels of the element image is larger than the number. (3) When a high-resolution two-dimensional display device is used, “calculation of color information of each two-dimensional display pixel” in the above (1), for example, “the calculation amount doubles if the number of two-dimensional pixels is doubled”. There is a problem that the number of operations of “processing” simply increases, and it is difficult to achieve both high image quality and high-speed processing.

  In contrast to this conventional stereoscopic image element image creation and display method, 3D display pixel data consisting of pixel position information and pixel color information, which are components of a stereoscopic image, are sequentially selected, and the selected 3D display pixel shape is displayed in 2D Improvement was made in that the elemental image of a stereoscopic image was created or displayed on the two-dimensional display device using the color information of the pixel group in the projection area on the image device display surface as the color information of the three-dimensional display pixel data. With this improvement, the basic processing of stereoscopic image display is the number of stereoscopic pixels, and the number of computations can be reduced compared to the basic processing of the number of two-dimensional pixels.

  FIG. 12 shows processing of another conventional stereoscopic image element image creation / display method.

  FIG. 12 is a flowchart showing processing of another conventional stereoscopic image element image creation / display method.

  First, three-dimensional display pixel (hereinafter referred to as “voxel”) data is sorted in the order of the depth data components. In this case, the data is rearranged in ascending order according to the value of the Z data, and the voxel data is sorted from the back of the viewer to the front of the viewer (S501 processing). Next, one voxel data is selected in the sorted order (S502 process), and a lens for reproducing light rays is selected (S503 process). Next, each straight line connecting each of the eight vertices of the voxel data selected in S502 and the principal point of the lens selected in S503 is extended, and the intersection of these extended straight lines and the display surface of the two-dimensional display device. Is obtained (S504 processing). The region projected on the display surface of the two-dimensional display device formed by these eight intersections is usually a hexagon. That is, at least two vertices of the eight vertices of the voxel data are projected into a region connecting the other six vertices. If the voxel selected in S502 faces the lens selected in S503, the area projected on the display surface of the two-dimensional display device is a square. In this way, among the areas projected on the display surface of the two-dimensional display device, the color information RGB of the voxel data selected in S502 is the color information data RGB value of the two-dimensional display pixel group in the lens area selected in S503. Value. Thereafter, in S506, the presence or absence of the remaining lens is checked, and the presence or absence of the remaining voxel data is performed in S507, whereby the same processing is sequentially performed.

As described above, the number of repetitive processes from S502 to S507 in another conventional stereoscopic image element image creation / display method is generally the number of voxel pixels smaller than the number of two-dimensional display pixels. In addition, the processing shown in S502 to S504 (calculation processing of projection point coordinates on the display surface of the two-dimensional display device from the eight vertices of each selected voxel) is expressed in advance instead of search processing in which the number of repetitions is uncertain. Therefore, it is easy to speed up parallel processing and the like. As a result, the processing time can be further shortened.
JP 2003-109042 A Takayoshi Ohkoshi, “3D Image Engineering” (version), Asakura Shoten, (Date of publication), (Page) Hiroshi Inoue, “Exploring the Mystery of Stereoscopic Vision”, (Version), Optronics, (Date of Publication), (Page) Kazutoshi Yanaka, Satoshi Sasaki, Hideo Kasuga, Tanyuki Hoshino, “Stereoscopic Display Using Inkjet Printer”, IEICE Technical Report, (Date of Publication), 102, 642, p. 17-p20

  However, also in this other conventional stereoscopic image element image creation and display method, it is necessary to repeat the number of times of product of “the number of voxel pixels” and “the number of lenses”. Reduction of the “number of voxel pixels” and the “number of lenses” is difficult to maintain the quality of the reproduced stereoscopic image. In particular, as described above, the “number of lenses” in the IP system generally tends to increase in order to ensure image quality. In order to realize real-time display with an inexpensive processing apparatus with low processing capacity, it is necessary to further reduce the processing amount.

  Therefore, the present invention provides a stereoscopic image free from unnaturalness when creating an element image for obtaining a stereoscopic image composed of a plurality of three-dimensional display pixels, which requires only a small amount of data, memory capacity and processing time and is constant. It is an object of the present invention to provide a stereoscopic image element image creation and display method and a stereoscopic image display device for a stereoscopic image display device.

  In order to achieve the above object, the present invention has a two-dimensional array of micro-convex lenses and a two-dimensional display device installed on the focal plane thereof, and is a three-dimensional image comprising pixel position information and pixel color information that are components of a stereoscopic image. Display pixel data is sequentially selected, and the color information of the pixel group in the projection area on the 2D display image device display surface of the selected 3D display pixel shape is displayed in 2D as the color information of the 3D display pixel data. In a stereoscopic image element image creation and display method of a stereoscopic image display apparatus that creates or displays a stereoscopic image element image on a device, a distance between a principal point plane of the micro convex lens two-dimensional array and a display plane of the two-dimensional display device As a denominator, and a viewing zone angle obtained as an angle twice as large as the arc tangent of a ratio in which one half of the lens pitch of the micro convex lens two-dimensional array is a numerator, The X direction viewing zone angle is calculated for each of the two orthogonal directions within the display surface of the two-dimensional display device, and the Y direction viewing zone angle is calculated, and the selected three-dimensional display pixel is calculated. A region in a quadrangular pyramid having a position as a vertex, the X-direction viewing zone angle as an X-direction apex angle, the Y-direction viewing zone angle as an Y-direction apex angle, and the display surface of the two-dimensional display device as a bottom surface Only a micro-convex lens having a principal point in the three-dimensional image is set as an element image calculation target.

  According to the stereoscopic image element image creation and display method of the present invention, between the principal point plane of the micro convex lens two-dimensional array and the display plane of the two-dimensional display device for the three-dimensional display pixels sequentially selected in the element image creation. The viewing zone angle obtained as an angle twice the arc tangent of the ratio of the numerator as the denominator and half the pitch between the convex lenses of the two-dimensional array of micro convex lenses as the numerator. The X direction viewing zone angle is calculated with respect to the X direction and the Y direction, which are two directions, and the Y direction viewing zone angle is calculated. The selected 3D display pixel position is set as the apex, and the X direction viewing zone angle is set to X. 3D element image calculation for only the micro-convex lens with the principal point in the area within the quadrangular pyramid with the vertical angle of the direction, the Y direction viewing angle as the Y direction vertical angle, and the display surface of the 2D display device as the bottom surface Target and limited In Rukoto, reducing the number of operations is achieved. Therefore, when creating an element image for obtaining a three-dimensional image composed of a plurality of three-dimensional display pixels, the data capacity, the memory capacity and the processing time are small and constant, and a three-dimensional image without unnaturalness can be observed. Become.

  In addition to the micro convex lens two-dimensional array, the present invention can provide the same effect with respect to the limitation of the processing target pin hole in the pin hole two-dimensional array.

  In addition to having a bi-directional parallax as in the case of a micro-convex lens two-dimensional array, a lens or pinhole that is subject to processing limitation can also be used when there is a parallax in only one direction such as a lenticular lens array or a parallax barrier. The area is only changed from two dimensions to one dimension, and the same effect can be obtained.

  A first invention of the present application has a two-dimensional array of micro-convex lenses and a two-dimensional display device installed on a focal plane thereof, and three-dimensional display pixel data including pixel position information and pixel color information which are constituent elements of a stereoscopic image. Are sequentially selected, and the color information of the pixel group in the projection area of the selected 3D display pixel on the display surface of the 2D display image device is displayed on the 2D display device as the color information of the 3D display pixel data. In a stereoscopic image element image creation and display method of a stereoscopic display device that creates or displays a stereoscopic image element image, the distance between the principal point surface of the micro convex lens two-dimensional array and the display surface of the two-dimensional display device is used as a denominator, and the two-dimensional micro convex lens The viewing zone angle obtained as an angle twice the arc tangent of the ratio of half the pitch between the convex lenses of the array as a numerator is set directly on the display surface of the two-dimensional display device. The X direction viewing zone angle is calculated for each of the two directions X direction and Y direction, and the Y direction viewing zone angle is calculated. The selected 3D display pixel position is the vertex, and the X direction viewing zone angle is X 3D element image calculation for only the micro-convex lens with the principal point in the area within the quadrangular pyramid with the vertical angle of the direction, the Y direction viewing angle as the Y direction vertical angle, and the display surface of the 2D display device as the bottom surface It is characterized by being a target.

  As a result, the basic processing of stereoscopic image display is limited to only the lenses involved in the display of individual three-dimensional display pixels among all the lenses of the micro-convex lens two-dimensional array, so that the number of calculations can be reduced.

  The second invention of the present application has a pinhole two-dimensional array and a two-dimensional display device installed in parallel therewith, and three-dimensional display pixel data consisting of pixel position information and pixel color information which are constituent elements of a stereoscopic image. The color information of the pixel group in the projection area on the display surface of the two-dimensional display image device of the selected three-dimensional display pixel data is sequentially selected and is displayed on the two-dimensional display device as the color information of the three-dimensional display pixel data. In a method for creating and displaying a stereoscopic image element image of a stereoscopic image display apparatus that creates or displays a stereoscopic image element image, the distance between the pinhole surface of the pinhole two-dimensional array and the display surface of the two-dimensional display device is used as a denominator. The viewing zone angle obtained as an angle that is twice the arc tangent of the ratio of ½ of the pinhole pitch of the pinhole two-dimensional array as a molecule is displayed on the two-dimensional display device. The X direction viewing zone angle and the Y direction viewing zone angle are calculated for the X direction and the Y direction, which are two orthogonal directions, and the position of the selected three-dimensional display pixel is the apex, and the X direction viewing zone is calculated. 3D element image calculation of only pinholes in the area of the quadrangular pyramid with the angle as the apex angle in the X direction, the viewing angle in the Y direction as the apex angle in the Y direction, and the display surface of the 2D display device as the bottom surface It is characterized by being a target.

  Thereby, the basic processing of stereoscopic image display is limited to only the pin poles involved in the display of individual three-dimensional display pixels among all the pin poles of the pinhole two-dimensional array, so that the number of calculations can be reduced.

  A third invention of the present application has a lenticular lens array and a two-dimensional display device installed on a focal plane thereof, and three-dimensional display pixel data including pixel position information and pixel color information which are components of a stereoscopic image. The color information of the pixel group in the projection area of the selected three-dimensional display pixel on the display surface of the two-dimensional display image device is sequentially selected as the three-dimensional display pixel data color information on the two-dimensional display device. In a stereoscopic image element image creation and display method of a stereoscopic image display apparatus that creates or displays an element image of an image, the distance between the principal point plane of the lenticular lens array and the display surface of the two-dimensional display device is used as a denominator. The viewing angle obtained as an angle twice the arc tangent of the ratio of the half of the pitch between the convex lenses of the lenticular lens array as a molecule is the display surface of the two-dimensional display device. A plane that includes the selected three-dimensional display pixel position, is perpendicular to the display surface of the two-dimensional display device, and is parallel to the pitch direction between the convex lenses of the lenticular lens array. In the cross section, a lens having a principal point in a region in a triangle with the position of the selected three-dimensional display pixel as the apex, the viewing zone angle as the apex angle, and the intersection with the display surface of the two-dimensional display device as the base Only the element image calculation target of the stereoscopic image.

  As a result, the basic processing of stereoscopic image display is limited to only the lenses involved in the display of individual three-dimensional display pixels among all the lenses of the lenticular lens array, so that the number of computations can be reduced.

  The fourth invention of the present application has a parallax barrier and a two-dimensional display device installed in parallel thereto, and sequentially selects three-dimensional display pixel data consisting of pixel position information and pixel color information, which are constituent elements of a stereoscopic image. Then, the color information of the pixel group in the projection area on the display surface of the two-dimensional display image device of the selected three-dimensional display pixel is used as the color information of the three-dimensional display pixel data on the two-dimensional display device. In a stereoscopic image element image creation and display method of a stereoscopic image display apparatus that creates or displays an element image, the distance between the barrier surface of the parallax barrier and the display surface of the two-dimensional display device is used as a denominator, and the slit of the parallax barrier The viewing zone angle obtained as an angle twice the arc tangent of the ratio in which the half of the inter-pitch distance is a numerator is a parallax bar in the display surface of the two-dimensional display device. In a cross-section by a plane that includes the position of the selected three-dimensional display pixel, is perpendicular to the display surface of the two-dimensional display device, and is parallel to the pitch direction between the slits of the parallax barrier. A 3D image of only the slit that has the principal point in the region in the triangle with the position of the selected 3D display pixel as the apex, the viewing zone angle as the apex angle, and the intersection line with the display surface of the 2D display device as the base This is characterized in that it is an element image calculation target.

  As a result, the basic processing of stereoscopic image display is limited to only the slits involved in the display of the individual three-dimensional display pixels among all the slits of the parallax barrier, so that the number of calculations can be reduced.

  According to a fifth aspect of the present application, there is provided a stereoscopic image display apparatus for creating or displaying a stereoscopic image element image on a two-dimensional display device by the stereoscopic image element image creation and display method according to any one of the first to fourth aspects. It is what.

  A stereoscopic image display device that creates or displays a stereoscopic image element image on a two-dimensional display device by the stereoscopic image element image creation and display method can be produced, and a more natural and high-resolution stereoscopic image is always processed in the same manner. Can get in time.

  Hereinafter, a stereoscopic image element image creation / display method according to an embodiment of the present invention will be described with reference to the drawings.

(Embodiment)
FIG. 1 is a diagram for explaining a stereoscopic image display apparatus that displays images by a stereoscopic image element image creation / display method according to an embodiment of the present invention. As shown in FIG. 1, the stereoscopic image display apparatus according to the present embodiment includes a micro-convex lens two-dimensional array 1 and a two-dimensional display device 2.

  The micro convex lens two-dimensional array 1 has an action of changing the direction of light emitted from the two-dimensional display device 2 in a direction corresponding to the pixel position with respect to the lens. In the present embodiment, a pinhole two-dimensional array can be used as the micro-convex lens two-dimensional array 1. If the parallax direction only needs to be one direction, the micro convex lens two-dimensional array 1 can also be used as a lenticular lens or a parallax barrier. When the micro convex lens two-dimensional array 1 is a pinhole two-dimensional array, a lenticular lens, or a parallax barrier, the lenticular lens or parallax barrier and the two-dimensional display device 2 are installed in parallel.

  The two-dimensional display device 2 is installed on the focal plane of the micro-convex lens two-dimensional array 1 and has a function of emitting light rays that are the basis of a stereoscopic image to the micro-convex lens two-dimensional array 1. Note that the two-dimensional display device 2 may be a combination of a film or a print sheet of a printer and a flat light source, or a display screen of a liquid crystal display or a projector. If the light can be emitted to the micro-convex lens two-dimensional array 1 by the reflected light from the observer side, not the light emission from the back side, the two-dimensional display device 2 can be a printed matter by a simple film, a printer, an offset printing or the like. But you can.

  In order to display the stereoscopic image 5 in an arbitrary space, the stereoscopic image display device according to the present embodiment has a three-dimensional display pixel (voxel) origin 4 for representing the stereoscopic image as a set of minute rectangular parallelepipeds, In order to represent the positional relationship of the entire apparatus, a stereoscopic image global coordinate origin 3 placed on the two-dimensional display device 2 is defined.

  The observer observes the direction of the two-dimensional display device 2 from the micro convex lens two-dimensional array 1 side with respect to the two-dimensional display device 2. Here, it is parallel to the display surface of the two-dimensional display device, the horizontal direction is the X direction, the vertical direction is the Y direction, and the two-dimensional display device 2 is perpendicular to the display surface of the two-dimensional display device. The direction from the display surface to the micro convex lens two-dimensional array 2 is defined as the Z direction.

  A stereoscopic image element image creation and display method according to the embodiment of the present invention will be described with reference to FIG. FIG. 7 is a flowchart for explaining a stereoscopic image element image creation / display method according to the embodiment of the present invention.

  First, the voxel data is sorted in the order of each depth data component. In the present embodiment, the data is rearranged in ascending order according to the value of the Z data, and the voxel data is sorted from the viewer's back side to the viewer's front side (S301 process).

  Next, one voxel data is selected in the sorted order (S302 process), and lenses involved in displaying the three-dimensional pixel of the voxel data are listed (S303 process). The limitation of the lens to be processed by this listing will be described later in detail.

  Next, a lens is selected from the list listed in S303 processing, and the same processing as the loop processing from S503 to S506 in the processing shown in FIG. 12 is performed as S304 to S307. After all the lenses listed in S303 are processed, it is determined whether or not there are remaining 3D display pixels (S308 processing). If there are remaining 3D display pixels, the process returns to S302. The next three-dimensional display pixel is selected, and the process is repeated repeatedly.

  Here, in order to describe the list-up process in S302, first, the viewing zone angle will be described based on FIG. 2 and FIG. 2 and 3 are enlarged sectional views of the micro convex lens two-dimensional array 1 and the two-dimensional display device 2 as viewed from the direction A in FIG.

First, as shown in FIG. 2, focusing on one lens 58 in the micro convex lens two-dimensional array 1, the two-dimensional display pixel farthest from the lens center among the pixels of the two-dimensional display device 2 within the convex lens pitch LP. Among the three-dimensional display pixels that can be reproduced by the lens 58, 60 and the two-dimensional display pixel 63 are involved in the display of the three-dimensional display pixel in the largest viewing angle direction. Here, line-of-sight angle, a direction parallel to the observer and Z _G axis is normal vision micro convex lens two-dimensional array 1 as 0, it means the angle between the viewing direction.

  A three-dimensional display pixel (voxel) 62 is reproduced in a linear direction connecting the principal point 57 that is the center of the lens 58 and the two-dimensional display pixel 63. Similarly, a three-dimensional display pixel (voxel) 59 is displayed in a linear direction connecting the principal point 57 of the lens 58 and the two-dimensional display pixel 60. In the range of an angle 56 formed by these two straight lines, that is, a straight line connecting the two-dimensional display pixel 60 and the principal point 57 of the lens and a straight line connecting the two-dimensional display pixel 63 and the principal point 57, the three-dimensional display pixel is formed by the lens 58. It can be displayed. This angle 56 is called the viewing zone angle.

  On the other hand, the case of the pixel of the two-dimensional display device outside the convex lens pitch LP will be described with reference to FIG. As shown in FIG. 3, the two-dimensional display pixel 116 outside the convex lens pitch LP exists within the convex lens pitch LP of the lens 108 adjacent to the lens 111, and thus the range of the viewing zone angle 56 described in FIG. 2. It is involved in the three-dimensional pixel display from the lens 108. That is, it is involved in the display of a three-dimensional display pixel in a linear direction connecting the two-dimensional display pixel 116 and the principal point 107 of the lens 108, for example, the three-dimensional display pixel (voxel) 109 in FIG. Certainly, when the line-of-sight direction is expanded outside the viewing zone angle 56 (see FIG. 2), a linear pixel connecting the principal point 110 of one lens in the two-dimensional display pixel 116 and the micro convex lens two-dimensional array, for example, in FIG. It is also possible to participate in the display of the three-dimensional display pixel (voxel) 115. However, if the line-of-sight direction is expanded to such a direction, the element image creation cannot be realized because the adjacent lens region overlaps with the two-dimensional display pixel. Similarly, in the case of the two-dimensional display pixel 113 which is outside the pitch LP between the convex lenses of the lens 111 in the opposite direction to the two-dimensional display pixel 116, one lens in the two-dimensional array of the micro convex lens of the two-dimensional display pixel 113 and the lens 111. Instead of the three-dimensional display pixel 112 in the linear direction connecting the principal points 110, the display is involved in the three-dimensional display pixel 120 in the linear direction between the lens 111 and the principal point 118 of the adjacent lens 119.

  As described above with reference to FIGS. 2 and 3, in order to create a stereoscopic image element image so that interference between individual lenses of the micro convex lens two-dimensional array 1, that is, overlap with pixels in the adjacent lens region does not occur. Are pixels within the pitch LP between the convex lenses. Therefore, the distance from the lens principal point to the two-dimensional display pixel needs to be smaller than the convex lens pitch LP / 2. From this, when considering the limit value where the size of the two-dimensional display pixel is infinitely small, the viewing zone angle is a half of the pitch LP between the convex lenses as a numerator, and “the principal point plane of the micro convex lens two-dimensional array 1” The distance between the display surface of the two-dimensional display device 2 and the arc tangent of the ratio with the denominator.

In the case of FIG. 2, “the distance 64 in the _XG direction from the main point 57 of the lens 58 to the two-dimensional display pixel 63” and “the main point 57 of the lens 58 to the two-dimensional display pixel 60” on the two-dimensional display device 2. X _G direction distance 61 "is less than one-half of the lens pitch LP. From this, it can be determined that the two-dimensional display pixel 60 to the two-dimensional display pixel 63 are within the viewing zone angle of the lens 58. In addition, the arc tangent of a ratio obtained by dividing the half of the pitch LP between the convex lenses by the distance 54 between the principal point surface of the micro convex lens two-dimensional array 1 and the display surface of the two-dimensional display device 2 is obtained. Thus, the viewing zone angle 56 can be calculated.

For Figure 3, the two-dimensional display "X _G direction distance 117 from first lens principal point 110 in the micro convex lens two-dimensional array of lenses 111 to the two-dimensional display pixel 116" and "two-dimensional display pixel on the device 2 113 X _G direction distance 114 from principal point 110 of the first lens in the micro lens two-dimensional array to a two-dimensional display pixel 113 of the lens 111 'is less than one-half of the lens pitch LP of. From this, it can be determined that the two-dimensional display pixel 113 and the two-dimensional display pixel 116 are outside the viewing angle of the lens 111.

  In addition, the viewing zone angle of the lens 111 is half of the pitch LP between the convex lenses, as in the case of FIG. 2, between the principal point surface of the micro convex lens two-dimensional array 1 and the display surface of the two-dimensional display device 2. It is possible to calculate by calculating twice the arc tangent of the ratio divided by the distance 104. The process of calculating the viewing zone angle in advance and listing only the lenses that can participate in displaying the selected three-dimensional display pixel is the process of S303 in FIG.

  Next, a method for obtaining a lens that can be involved in displaying a selected three-dimensional display pixel from a pre-calculated viewing zone angle will be described. FIG. 4 is an enlarged cross-sectional view of the micro convex lens two-dimensional array 1 and the two-dimensional display device 2 as viewed from the direction A in FIG.

First, consider a case where the three-dimensional display pixel 155 in the displayed stereoscopic image 154 is selected. Lenses comprising the three-dimensional display pixel 155 in the viewing area corner, the principal point of the lens and vertex base is parallel to the X _G axis, three-dimensional display in the region of the triangle the viewing angle and the apex angle Pixel 155 is included. Given this Conversely, an apex a three-dimensional display pixel 155 is selected, the base is parallel to the X _G axis, the lens lens principal point exists apex angle in the region of the triangular viewing angle is, the The lens can be involved in displaying the three-dimensional display pixel 155.

4, the three-dimensional display pixel 155 to the apex, the base is parallel to the X _G axis, the lens principal point that exists within the triangle to the viewing angle 156 and the top angle is 152 from 158. That is, a lens having a principal point in a quadrangular pyramid having the three-dimensional display pixel (voxel) 155 in FIG. 4 as a vertex, the viewing zone angle 156 as an apex angle, and the principal point surface of the micro convex lens two-dimensional array 1 as a bottom surface. The area 160 of the lens is a lens area involved in the display of the three-dimensional display pixel 155, the vertex of the three-dimensional display pixel (voxel) 155, the apex angle of the viewing zone angle 156, and the principal point of the micro convex lens two-dimensional array 1. It can be determined that the lens regions 159 and 161 in which the principal point does not exist in the quadrangular pyramid whose surface is the bottom surface are lens regions that are not involved in the display of the three-dimensional display pixel 155.

FIG. 4 is a cross-sectional view of a plane parallel to the X _G -Z _G plane, but a cross section parallel to the Y _G -Z _G plane perpendicular to this plane can be considered similarly. Here, a viewing zone angle of a cross section parallel to the X _G -Z _G plane is called an X direction viewing zone angle, and a viewing zone angle of a cross section parallel to the Y _G -Z _G plane is called a Y direction viewing zone angle. Among the lenses of the micro convex lens two-dimensional array 1, the lenses involved in the display of the selected three-dimensional display pixel have the selected three-dimensional display pixel position as the apex, and the vertical angle in the X direction is the already calculated X direction view. It can be said that the micro-convex lens has a principal point in a region within a quadrangular pyramid having the two-dimensional display device display surface as a bottom surface, with the region angle and the Y-direction apex angle being the already calculated Y-direction viewing region angle.

  Note that when a pinhole two-dimensional array is used instead of the micro-convex lens array 1, this is exactly the same if the lens principal point is replaced with the pinhole position.

Moreover, instead of two directions of X _G direction and Y _G direction, considering only one direction of the cross-section of the X _G direction only as shown in FIG. 4, the corresponding two-dimensional array 1 and the lens principal point micro convex lens, lenticular It is replaced with the lens array, lens principal point, parallax barrier, and slit position.

  Finally, in order to explain the calculation amount reduction effect according to the present invention, the difference in the number of lenses involved in the reproduction of the pixel due to the difference in the selected three-dimensional display pixel position will be described with reference to FIGS. To do. FIG. 5 is a cross-sectional view showing a position range of the processing target lens with respect to a three-dimensional display pixel far from the lens principal point plane. FIG. 6 is a cross-sectional view showing the position range of the lens to be processed with respect to the three-dimensional display pixel near the lens principal point plane.

  FIG. 5 shows the case of the three-dimensional display pixel 204 far from the lens principal point plane. In this case, all the lenses from the lens 201 to the lens 202, that is, the three-dimensional display pixel (voxel) 204 is set as the apex, the viewing zone angle 205 is set as the apex angle, and the principal point plane of the micro convex lens two-dimensional array 1 is set as the bottom plane. The lens in the lens region 207 in which the principal point exists in the pyramid becomes a lens involved in the reproduction of the pixel. That is, the lens is listed and becomes a calculation target.

  FIG. 6 shows the case of the three-dimensional display pixel 254 in the vicinity of the lens principal point plane. In this case, the lens 252 and the lens 256, that is, the three-dimensional display pixel (voxel) 254 is the vertex, the viewing zone angle 255 is the apex angle, and the main surface of the micro convex lens two-dimensional array is the bottom surface. Only the lens in the lens region 258 where the dot exists is a lens involved in the reproduction of the pixel. That is, 12 lenses in FIG. 5 and 2 lenses in FIG. 6 are lenses that can participate in the display of the selected three-dimensional display pixel.

X _G direction as well, Y when _G direction to assume that exactly the same, FIG. 5, becomes a lens number involved in the reproduction of 12 × 12 = 144 pieces is selected 3D pixel 204, which is 144 times This is equivalent to the need for arithmetic processing. Similarly, considering the case of FIG. 6, 2 × 2 = 4 is the number of lenses involved in the reproduction of the selected 3D display pixel 254, which requires only four arithmetic processes. . In the processing of the other conventional stereoscopic image element image creation / display method shown in FIG. 12, the loop processing from S503 to S506 is executed 144 times in both cases of FIGS. However, in the case of the process of FIG. 7 to which the present invention is applied, the process is 144 times in the case of FIG. 5 and 4 times in the case of FIG.

  From the above, it can be seen that when arithmetic processing is necessary as shown in FIG. 5, that processing is performed, and when arithmetic processing is unnecessary as shown in FIG. 6, the unnecessary processing is reduced. Considering the case of FIG. 6, the processing amount is 4 ÷ 144≈0.03, which is only 3%. In addition, since the processing for the lens that is clearly not involved in the reproduction of the three-dimensional display pixel is reduced, the image quality does not deteriorate at all.

  In the case of a lenticular lens array or parallax barrier in which lenses and pinholes are not two-dimensional arrays but one-dimensional arrays, in the example of FIG. Become.

  In the integral photography 3D image display device, the 3D image with the pixel group near the lens main point plane has the highest spatial resolution and is suitable for displaying high-definition 3D images. In many cases, these pixels occupy most of the displayed stereoscopic image. Therefore, the reduction effect as shown in FIG. 6 can be expected in most of the three-dimensional pixels constituting the displayed stereoscopic image.

  Further, in order to display a stereoscopic image with a large amount of movement, the display area of the stereoscopic image is enlarged, and even if a large-area micro convex lens array having a larger number of lenses is used, Since the processing is performed only on the lenses involved in the display, if the size of the displayed stereoscopic image and the pitch dimension between the lenses are the same, the calculation time does not increase due to the increase in the number of lenses.

  For example, in two stereoscopic image display devices that use a two-dimensional array of micro-convex lenses with the same lens pitch, the height dimension is the same and the lateral direction that is the moving direction of the stereoscopic image is large so that the movement amount of the stereoscopic image can be increased. Consider an example of use in a micro-convex lens two-dimensional array with a double width dimension.

  In the case of the conventional method, the number of lenses is doubled, so the number of calculations is doubled. However, in the method of the present embodiment, if the size of the moving stereoscopic image is constant, the number of lenses involved in stereoscopic image reproduction in each time frame is constant, so the number of lenses is doubled. Even if a micro convex lens two-dimensional array is used, the number of operations remains constant.

  That is, even if the number of lenses is increased in order to improve the quality of a stereoscopic image, an area related to the display of the 3D display pixels in advance for each sequentially selected 3D display pixel in the process of creating a stereoscopic image element image. Since only those lenses are determined as processing targets, it is wasted on lenses that are not involved in the three-dimensional pixel display performed in the conventional stereoscopic image element image creation and display method of the stereoscopic image display device. Processing is reduced, and it is effective in achieving both high image quality and high-speed processing in stereoscopic image display.

  As described above, the stereoscopic image element image creation and display method according to the present invention has an effect of achieving both high resolution and high speed processing when displaying a stereoscopic image from three-dimensional display pixel data. The present invention can be applied to a service that provides a stereoscopic image, a stereoscopic image receiving terminal used for the service, a hologram display device, a hologram CAD for architecture, design, and mechanism, a stereoscopic image generation software that operates on a computer, and the like.

The figure explaining the stereoscopic display apparatus displayed with the stereoscopic image element image creation display method in embodiment of this invention 1 is an enlarged cross-sectional view of the micro convex lens two-dimensional array and the two-dimensional display device as viewed from the direction A in FIG. 1 is an enlarged cross-sectional view of the micro convex lens two-dimensional array and the two-dimensional display device as viewed from the direction A in FIG. 1 is an enlarged cross-sectional view of the micro convex lens two-dimensional array 1 and the two-dimensional display device 2 as viewed from the direction A in FIG. Sectional drawing which shows the position range of the process target lens with respect to the three-dimensional display pixel far from the lens principal point plane Sectional drawing which shows the position range of the process target lens with respect to the three-dimensional display pixel of the lens principal point surface vicinity Flowchart for explaining a stereoscopic image element image creation / display method according to an embodiment of the present invention Diagram showing the basic principle for taking a 3D image using the integral photography method Diagram showing the basic principle for displaying a 3D image in the integral photography system The figure which shows the example of the conventional stereoscopic image display apparatus The flowchart which shows the process of the stereoscopic image element image preparation display method in the conventional stereoscopic display apparatus The flowchart which shows the process of the other conventional 3D image element image creation display method

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Micro convex lens 2D array 2 2D display device 3 Stereo image display apparatus Global coordinate origin 4 3D display pixel (voxel) origin 5 Stereo image 6 Viewer 9 3D display pixel (voxel) data area 10 Medical voxel data image 31 Fly-eye lens array 32 Film 33 Three-dimensional object 34 Element image 35 Viewer 36 Three-dimensional image 52 Two-dimensional display device 54 Distance 56 Angle (viewing zone angle)
57 principal point 58 lens 59 3D display pixel (voxel)
60 2D display pixel 61 X Distance in _G direction 62 3D display pixel (voxel)
63 Two-dimensional display pixel 64 X Distance in the _G direction 102 Two-dimensional display device 104 Distance 106 Viewing zone angle 107 Main point 108 Lens 109 Three-dimensional display pixel (voxel)
110 Main point of one lens in a two-dimensional array of micro convex lenses 111 Lens 112 Three-dimensional display pixel (voxel)
113 2D display pixel 114 X _G direction distance 115 3D display pixel (voxel)
116 2-dimensional display pixel 117 X _G direction distance 118 principal point 119 lens 120 three-dimensional display pixel (voxel)
152 Lens principal point 154 Three-dimensional image 155 Three-dimensional display pixel (voxel)
156 Viewing zone angle 158 Lens principal point 159,161 area 160 area 201 lens 202 lens 204 3D display pixel (voxel)
205 Viewing zone angle of micro convex lens two-dimensional array 206 Lens 207 Region 252 Lens 254 Three-dimensional display pixel (voxel)
255 Viewing angle 256 Lens 258 Region LP Convex lens pitch

Claims (5)

A micro-convex lens two-dimensional array and a two-dimensional image display device installed on the focal plane thereof, sequentially selecting three-dimensional display pixel data consisting of pixel position information and pixel color information, which are constituent elements of a stereoscopic image; The color information of the pixel group in the projection area of the selected 3D display pixel data on the display surface of the 2D display image device is displayed on the 2D image display device as the color information of the 3D display pixel data. In a method for creating and displaying a stereoscopic image element image of a stereoscopic image display device for creating or displaying a stereoscopic image element image,
An arc having a ratio in which the distance between the principal point plane of the two-dimensional array of micro-convex lenses and the display surface of the two-dimensional display device is a denominator and half the pitch between the convex lenses of the two-dimensional array of micro-convex lenses is a numerator. The viewing zone angle obtained as an angle twice the tangent is calculated for the X direction and the Y direction, which are the two orthogonal directions in the display surface of the two-dimensional display device, respectively. Calculate the area angle,
The position of the selected three-dimensional display pixel is a vertex, the X-direction viewing zone angle is the X-direction apex angle, the Y-direction viewing zone angle is the Y-direction apex angle, and the display of the two-dimensional display device A method for creating and displaying a stereoscopic image element image of a stereoscopic image display apparatus, wherein only a micro-convex lens having a principal point in a region within a quadrangular pyramid having a surface as a bottom surface is an object image calculation target of the stereoscopic image. It has a pinhole two-dimensional array and a two-dimensional image display device installed in parallel therewith, and sequentially selects and selects three-dimensional display pixel data consisting of pixel position information and pixel color information that are constituent elements of a stereoscopic image The color information of the pixel group in the projection area of the three-dimensional display pixel data on the display surface of the two-dimensional display image device is converted into a three-dimensional image on the two-dimensional image display device as the color information of the three-dimensional display pixel data. In a stereoscopic image element image creation and display method of a stereoscopic image display device that creates or displays an element image of
The distance between the pinhole surface of the pinhole two-dimensional array and the display surface of the two-dimensional display device is used as a denominator, and the ratio of the numerator is one half of the pitch between pinholes of the pinhole two-dimensional array. The viewing zone angle obtained as an angle twice the arc tangent is calculated for the X direction and the Y direction, which are the two orthogonal directions in the display surface of the two-dimensional display device, and the Y direction. Calculate the viewing zone angle,
The position of the selected three-dimensional display pixel is a vertex, the X-direction viewing zone angle is the X-direction apex angle, the Y-direction viewing zone angle is the Y-direction apex angle, and the display of the two-dimensional display device A method for creating and displaying a stereoscopic image element image of a stereoscopic image display apparatus, wherein only a pinhole in an area within a quadrangular pyramid having a surface as a bottom surface is an object image calculation target for a stereoscopic image. It has a lenticular lens array and a two-dimensional image display device installed at its focal plane, and sequentially selects and selects three-dimensional display pixel data consisting of pixel position information and pixel color information, which are constituent elements of a stereoscopic image The color information of the pixel group in the projection area of the three-dimensional display pixel on the display surface of the two-dimensional display image device is used as the color information of the three-dimensional display pixel data on the two-dimensional image display device. In a stereoscopic image element image creation and display method of a stereoscopic image display device that creates or displays an element image,
The arc tangent of the ratio in which the distance between the principal point surface of the lenticular lens array and the display surface of the two-dimensional display device is the denominator and half the pitch between the convex lenses of the lenticular lens array is the numerator. A viewing zone angle obtained as a double angle is calculated for the pitch direction between convex lenses of the lenticular lens array in the display surface of the two-dimensional display device,
The selected three-dimensional display pixel in a cross-section by a plane including the selected three-dimensional display pixel position, perpendicular to the display surface of the two-dimensional display device, and parallel to the pitch direction between the convex lenses of the lenticular lens array. Only a lens having a principal point in a region in a triangle with a position at the apex, the viewing zone angle as an apex angle, and a line of intersection with the display surface of the two-dimensional display device as a base image is an element image calculation target of a stereoscopic image. A stereoscopic image element image creation and display method for a stereoscopic image display device. A parallax barrier and a two-dimensional image display device installed in parallel with the parallax barrier are used to sequentially select and select three-dimensional display pixel data consisting of pixel position information and pixel color information, which are constituent elements of a stereoscopic image. The color information of the pixel group in the projection area of the 3D display pixel on the display surface of the 2D display image device is used as the color information of the 3D display pixel data, and the 3D element image is displayed on the 2D image display device. In a stereoscopic image element image creation and display method of a stereoscopic image display device that creates or displays
The arc tangent of the ratio in which the distance between the barrier surface of the parallax barrier and the display surface of the two-dimensional display device is a denominator, and the numerator is half the pitch distance between slits of the parallax barrier. A viewing zone angle calculated as an angle of the parallax barrier in the display surface of the two-dimensional display device is calculated for the pitch direction between the slits,
Including the position of the selected three-dimensional display pixel, in a cross section by a plane perpendicular to the display surface of the two-dimensional display device and parallel to the pitch direction between the slits of the parallax barrier. Only a slit having a principal point in a region in a triangle having a position as a vertex, the viewing zone angle as an apex angle, and a line of intersection with the display surface of the two-dimensional display device as a base image is an element image calculation target of a stereoscopic image. A stereoscopic image element image creation and display method for a stereoscopic image display device. 5. A stereoscopic image display apparatus that creates or displays a stereoscopic image element image on a two-dimensional image display device by the stereoscopic image element image creation and display method according to any one of claims 1 to 4.

Images