JP2004334550A - Method for processing three-dimensional image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method for processing three-dimensional images capable of creating image data for three-dimensional images at high speeds and of generating the image data for three-dimensional images of high resolution at high speeds even when images from a number of viewing points are synthesized. <P>SOLUTION: The method comprises a process for storing a predetermined stencil pattern in a stencil buffer, a process for determining a stencil reference value based on the number of a viewing point and one of RGB components, and a process for determining a color mask so that the one component is drawn in a frame buffer. The stencil reference value determined is collated with an element value of the stencil pattern, and based on the color mask determined and using the one component, a three-dimensional model is drawn at a pixel which corresponds to matching values. Similar processes are repeated for the rest of the components. The similar processes are also repeated for the other viewing points to synthesize images from a number of viewing points to create the image data for three-dimensional images. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a method for generating image data for an autostereoscopic display device, and more particularly to a method for generating image data for stereoscopic images by combining images from a plurality of viewpoints.
[0002]
[Prior art]
As a stereoscopic display device, there is a stereoscopic display device that utilizes different images viewed by the right and left eyes. In this method, the right-eye image and the left-eye image are separately prepared, each image is separately polarized through a vertically polarized light and a horizontally polarized light filter, and then the polarized glasses having the longitudinally polarized light and the horizontally polarized light filter as left and right lenses, respectively. When viewed using, each image is synthesized and looks three-dimensional. Also, various types of naked-eye stereoscopic display devices that can be viewed with the naked eye without using glasses or the like have been developed. Such devices include a barrier parallax system and a lenticular system. In this method, images taken from multiple directions are combined on a stripe, and an opening, a slit, and a lenticular lens in the shape of a semicircle are arranged on the front of the display device, and only the images corresponding to the left and right eyes are left and right. It can be observed with each eye. Further, for example, as in Patent Literature 1, a structure having a bellows-like surface combining wedge-shaped surfaces is arranged on the front surface of a display device.
[0003]
As described above, the image data for a stereoscopic image used in the stereoscopic display device draws the images viewed from the left and right eyes, that is, the two viewpoints, and two images are drawn according to the arrangement of the slits and the lenticular lenses. It is generated by combining viewpoint images. As described above, there are various methods for generating image data by synthesizing images viewed from two viewpoints. For example, a method of synthesizing images on a main memory by using a CPU, and a method of There is a method in which a right-eye image and a left-eye image are separately written into a frame buffer using a stencil buffer, and are combined.
[0004]
Furthermore, in recent years, an autostereoscopic display device has been developed which combines images not only from two viewpoints but also from multiple viewpoints so that a stereoscopic image can be observed in a wide range. In this case, when vertical stripe-shaped slits are used by the barrier parallax method or the like, the resolution in the horizontal direction is deteriorated as the number of viewpoints increases. For this reason, an oblique barrier method and the like having a step-like opening so as to distribute the deterioration of resolution in both the vertical and horizontal directions have been developed. Specifically, as shown in FIG. 1, for example, in the case of image data for a stereoscopic image with four viewpoints, by arranging slits obliquely, the degradation of resolution is dispersed in the horizontal direction and the vertical direction, and as a whole, It is possible to prevent the degradation of the resolution to some extent.
[0005]
Further, as disclosed in Patent Document 3, information of a plurality of viewpoints (up to three viewpoints) is written in one pixel by utilizing the fact that one pixel is composed of three components of RGB. This is intended to obtain a clear stereoscopic image by efficiently arranging the RGB components for each viewpoint as one unit. By combining images for each of the RGB components as in this example, it is possible to reduce apparent degradation in resolution. For example, considering the case of two left and right viewpoints, as shown in FIG. 2, the R component of the left viewpoint, the G component of the right viewpoint, and the B component of the left viewpoint are combined to form one pixel. The pixel on the right side is formed by combining the R component of the right viewpoint, the G component of the left viewpoint, and the B component of the right viewpoint. In this arrangement, the optical filter for the barrier parallax method has a checkered slit as shown in the figure. It can be seen that this configuration makes it possible to reduce the apparent deterioration in resolution as compared to the case of one viewpoint per pixel.
[0006]
[Patent Document 1]
JP 2000-249980 A
[Patent Document 2]
JP 2000-20575 A
[Patent Document 3]
JP 08-331605 A
[0007]
[Problems to be solved by the invention]
When generating the image data for the autostereoscopic display device as described above, if the image data is for the left and right eye viewpoints, that is, image data of about two viewpoints, only two images are combined, and thus the CPU is used. Even in the method of synthesizing on the main memory, synthesis can be performed at a certain speed, and real-time processing can be performed to some extent even when creating moving image data in which a three-dimensional model moves. However, when the number of viewpoints increases, in the method of combining images on the main memory, information transmission between the main memory and the frame buffer increases, and this portion becomes a bottleneck in processing speed. Therefore, real-time processing was difficult because the synthesizing process could not be performed in time and the frame rate could not be increased.
[0008]
A method of combining the right-eye image and the left-eye image by separately writing them in the frame buffer using the stencil buffer is advantageous in terms of speed as compared with the case where the images are combined on the main memory. However, in the case of multiple viewpoints, simply arranging the images from each viewpoint in a striped order greatly reduces the apparent resolution. turn into. Specifically, in the case of an image in which images of each viewpoint are sequentially arranged in a stripe pattern for each pixel for a barrier-parallax type autostereoscopic display device using a vertical slit, a multi-viewpoint can be obtained. The more pixels are seen from one viewpoint, the more apart the neighboring pixels are, so that the resolution in the horizontal direction is degraded.
[0009]
Furthermore, there is a diagonal barrier method for preventing the resolution from being deteriorated, but when the above-described synthesizing method for writing to the frame buffer using the stencil buffer is applied to this, writing using the stencil buffer can be performed on a pixel-by-pixel basis. Therefore, information of only one viewpoint can be combined in one pixel after all. Therefore, when the number of viewpoints is increased, the resolution cannot be further increased. More specifically, as shown in FIG. 1, for example, in the case of image data for a stereoscopic image of four viewpoints, when a stereoscopic model is synthesized with information of one viewpoint per pixel, the pixel next to a certain one pixel in one viewpoint is However, even if a pixel of another viewpoint is interposed between three pixels, it is difficult to increase the resolution even if the oblique barrier method is used.
[0010]
Furthermore, in the case where information of a plurality of viewpoints (for a maximum of three viewpoints) is written in one pixel by utilizing the fact that one pixel is composed of three components of RGB, a method of synthesizing on a main memory is used. In addition, the number of processing steps between the frame buffer and the main memory increases, and it is very difficult to increase the processing speed. Thus, the method cannot be used for real-time rendering. Also, the method of writing to the frame buffer using the stencil buffer cannot be applied because writing can be performed only in units of one pixel as described above, and cannot be written to the frame buffer for each RGB component.
[0011]
In view of such circumstances, the present invention can generate image data for a three-dimensional image at high speed, and can generate high-resolution three-dimensional image image data at high speed even when synthesizing multi-viewpoint images. It is intended to provide a possible stereoscopic image processing method.
[0012]
[Means for Solving the Problems]
In order to achieve the above-described object of the present invention, a stereoscopic image processing method according to the present invention for generating image data for a stereoscopic image by combining RGB images obtained by viewing a stereoscopic model from a plurality of viewpoints stores mask information. A stencil buffer to create and store a predetermined stencil pattern including element values for specifying pixels to be drawn in accordance with the autostereoscopic display device, and a viewpoint number m (m = 1, 2,... N) and at least one of the RGB components to be drawn, and a process of determining a stencil reference value. For a pixel corresponding to the determined stencil reference value, The process of determining the color mask so that at least one of the components is drawn in the frame buffer, and comparing the determined stencil reference value with the element value of the stencil pattern Drawing a three-dimensional model on a pixel corresponding to the matched value with at least one component based on the determined color mask, and determining a stencil reference value for the remaining RGB components. A process of determining a color mask and a process of drawing a three-dimensional model, a process of drawing while changing color components, and a stencil reference value for an (m + 1) th (where m <n) viewpoint. The process of deciding, the process of deciding a color mask, the process of drawing a three-dimensional model, and the process of changing color components and performing drawing are repeated until the n-th viewpoint is reached. And a step of drawing, whereby image data for a stereoscopic image is generated.
[0013]
Further, according to the stereoscopic image processing method of the present invention, a predetermined stencil pattern including element values for specifying a pixel to be drawn is created and stored in a stencil buffer storing mask information in accordance with an autostereoscopic display device. And determining a stencil reference value for the three-dimensional model from the viewpoint number m (m = 1, 2,... N) and at least one of the RGB components to be drawn. Determining a color mask so that at least one of the RGB components is drawn in the frame buffer for a pixel corresponding to the stencil reference value, and comparing the determined stencil reference value with the element value of the stencil pattern A process of drawing a three-dimensional model with at least one component on the pixel corresponding to the matched value based on the determined color mask; , M <n), a process of determining a stencil reference value and a process of drawing a three-dimensional model, and repeating these processes until the n-th viewpoint is reached. , A stencil reference value determination process, a color mask determination process, a three-dimensional model rendering process, and a viewpoint changing rendering process for the remaining RGB components. And a step of performing drawing by changing a color component, thereby generating image data for a three-dimensional image.
[0014]
Here, when the number of viewpoints is two (n = 2), the process of determining the color mask is such that two predetermined RGB components are drawn in the frame buffer according to the determined stencil reference value. The process of determining the color mask and drawing the three-dimensional model can be omitted by drawing the three-dimensional model with two components based on the determined color mask according to the determined stencil reference value. is there.
[0015]
In the stencil pattern, a common element value is given to a pixel having the same relationship of viewpoint numbers with respect to the RGB components forming one pixel and each component.
[0016]
Further, after the step of storing the predetermined stencil pattern and before the step of determining the stencil reference value, the method further includes a step of determining the position and orientation of the stereo model, and after the image data for the stereo image is generated. Returning to the process of determining the position and orientation of the three-dimensional model, it is also possible to generate a plurality of frames and generate moving image data for a three-dimensional image by repeating these processes.
[0017]
According to the above means, the following effects can be obtained. That is, the stencil buffer is used to determine the stencil reference value, and the color mask is used to draw each of the RGB components. Therefore, a plurality of viewpoints (up to 3 The effect of writing information for the viewpoint can be obtained. Also, instead of performing compositing processing on the main memory, the data is written directly to the frame buffer using a stencil buffer and color mask, eliminating the need for exchanging information with the main memory and increasing the processing speed. And the like.
[0018]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 3 is a flowchart for explaining the flow of the stereoscopic image processing method of the present invention. In the present invention, the number of viewpoints is not limited, and can be variously changed according to the configuration of a stereoscopic display device and an optical filter. First, a predetermined stencil pattern is stored in a stencil buffer for storing mask information (step 10). The stencil buffer is a buffer used to enable or disable rendering of a target image in units of one pixel. The stencil pattern is made up of element values that specify the pixels to be drawn, and determines the drawing pattern. The stencil pattern is appropriately determined according to the pixel arrangement and the color filter arrangement of the autostereoscopic display device, as described later. As long as the same stereoscopic display device is used, the stencil pattern needs to be created only once. Then, drawing processing is performed using this stencil pattern (step 20). Hereinafter, drawing processing of the stereoscopic image processing method of the present invention will be described in detail with reference to FIG.
[0019]
FIG. 4 is a flowchart for explaining details of the drawing processing step 20 of FIG. First, for the three-dimensional model to be drawn, n (n = 2, 3, 4,...) Viewpoint numbers m (m = 1, 2,... N) of viewpoints and color components to be drawn A stencil reference value is determined from one of the (RGB components) (step 201). Here, the stencil reference value is specified as a value to be compared with the value in the stencil buffer. Next, a color mask is determined so that only one of the RGB components is drawn in the frame buffer (step 202). The color mask, for example, when writing only the R component, masks the other components, the G component, and the B component, and passes only the R component. Then, the stencil reference value determined in step 201 is compared with the element value of the stencil pattern, and the color mask determined in step 202 is applied to the pixel portion corresponding to the matched value, and A three-dimensional model is drawn using only one component (step 203). Then, in step 204, it is determined whether or not all the RGB components have been drawn. If there is any remaining color, the color is changed to the next color (step 205), and the process returns to step 201 where the stencil reference value is determined. This is repeated for all three components, and when all the RGB components have been completed, the process proceeds from step 204 to step 206. At step 206, it is determined whether or not drawing has been performed for all viewpoints. If there is still a viewpoint, the viewpoint is changed to the next viewpoint, that is, the viewpoint number m + 1 (where m <n) (step 207). The process returns to step 201 for determining a stencil reference value. The process of drawing all the RGB components is also performed for the (m + 1) th viewpoint. These steps are repeated until all viewpoints, that is, the n-th viewpoint, are drawn for all viewpoints, so that the drawing process ends and the stereoscopic image processing method of the present invention ends.
[0020]
Hereinafter, a case where the image processing method of the present invention is applied to an autostereoscopic display device of an arrangement example of each RGB component of each viewpoint in the case of two viewpoints illustrated in FIG. 2 will be specifically described. Note that the present invention is not limited to this, and various changes can be made based on the number of viewpoints, the arrangement of phosphors and color filters of the three primary colors of RGB of the display device, and the shape of a slit provided on the front surface of the display device. An example of creating a stencil pattern stored in step 10 of FIG. 3 will be described. The stencil buffer, by its nature, can only write to the frame buffer in pixel units. In the present invention, each RGB element is written for one viewpoint. Referring to the upper left pixel in FIG. 2, the pixel includes an R component (hereinafter referred to as “left-R”) of the left viewpoint, “right-G”, and “left-B”. Since the element value of the stencil pattern is defined in units of one pixel, the element value of the stencil pattern in this portion is set to, for example, "1" for convenience. According to the present invention, for one viewpoint (for example, a left viewpoint), writing is performed for each of the RGB components using a color mask. For example, after “left-R”, “left-G” and “left-R” are used. B ". It is not necessary to write in the order of R, G, and B. The above example is merely an example, and the writing order may be determined arbitrarily. Further, writing may be performed for each viewpoint for one color component. That is, the viewpoint may be changed without changing the color mask. Next, in FIG. 2, the component of “left-G” is, for example, a pixel immediately below the above-mentioned pixel, and thus has an element value different from the above-described stencil pattern element value, for example, “2”. . Next, “right-R” is written. This is to write to a pixel including “left-G”, and this pixel is a pixel whose stencil pattern element value has already been set to “2”. From these, the relationship between the pixel (element) to be written and the element value of the stencil pattern as shown in FIG. 5 can be derived. That is, the element value of the stencil pattern corresponding to the pixel consisting of “left-R”, “right-B”, and “right-G” is “1”, and “left-G”, “right-R”, “right” The element value of the stencil pattern corresponding to the pixel consisting of “−B” is “2”. As described above, in the stencil pattern, a common element value is given to a pixel having the same viewpoint relation with respect to each of the RGB components forming one pixel. The arrows in FIG. 5 indicate the order of writing. Therefore, a stencil pattern to be stored in the stencil buffer corresponding to the arrangement example in FIG. 2 is a pattern as shown in FIG. It should be noted that the numerals 1 and 2 in the figure are element values for specifying the pixel to be drawn, and are numerical values given for convenience. The stencil pattern created in this way is stored in a stencil buffer (step 10 in FIG. 3).
[0021]
Therefore, the process of determining the stencil reference value will be described with reference to FIGS. 2 and 6. For example, when "left-R" is written, the stencil reference value is set to "1" (step 201 in FIG. 4). The color mask may be set so that only the R component can be written (step 202 in FIG. 4). Thereafter, the stencil reference value is compared with the stencil element value, and the three-dimensional model is drawn on the frame buffer using a color mask (step 203 in FIG. 4). Then, when writing the next “left-G”, the stencil reference value may be set to “2” and the color mask may be set so that only the G component can be written. By performing the same for other color components (step 204 in FIG. 4) and the viewpoint / color component on the right side (step 207 in FIG. 4), a composite image as shown in FIG. 2 can be generated.
[0022]
In the case of a stereoscopic image with two viewpoints, two identical viewpoints are included in one pixel. Therefore, by setting a color mask so that two predetermined components of the RGB components can be simultaneously written, Since the step of setting the mask can be partially reduced, further speeding up of the image synthesizing process can be expected.
[0023]
As described above, by using the stencil buffer and the color mask, it is possible to directly write data into the frame buffer in units of one color component, so that there is no bottleneck between the main memory and the frame buffer. This makes it possible to perform drawing at a higher speed than when an image is generated and written into the frame buffer. Therefore, it is possible to synthesize images at high speed, and it is possible not only to generate stereoscopic image image data of a still image but also to generate moving image data for a stereoscopic image.
[0024]
Next, another example of a combined arrangement will be described. FIG. 7 is a partially enlarged view of a display screen showing an example of the arrangement of each pixel of an image of each viewpoint displayed on the autostereoscopic display device for four viewpoints. The figure shows, for example, in an oblique-barrier autostereoscopic display device in which an optical filter having slits arranged in steps as shown in FIG. Of the RGB components are arranged so as to form one image for an autostereoscopic display device and synthesized. Further, the optical filter shown in FIG. 8 has a slit pattern capable of barrier in units of RGB components in one pixel. Although the slit pattern in FIG. 8 is an oblique slit that goes from left to right, the present invention is characterized in that it is possible to draw in the frame buffer in units of RGB components in one pixel. The hardware configuration is not limited, and can be arbitrarily written in any arrangement. For example, if the slit is an oblique slit that goes down from right to left, the arrangement of each pixel of each pixel of the image of each viewpoint may be changed accordingly. Further, instead of a slit, a filter having a hole shape may be used. Further, if it is not considered that the degradation of resolution is dispersed in the horizontal and vertical directions, it is of course possible to apply the present invention to a vertical slit type autostereoscopic display device. As described above, the present invention is not limited to the hardware configuration, and various synthesis processes can be performed in accordance with an autostereoscopic display device to be used.
[0025]
Similar to the stencil pattern for the two viewpoints described with reference to FIGS. 2 and 5, the stencil pattern for the arrangement example of FIG. 7 can be created as follows. Referring to the upper left pixel of the arrangement after the combination in FIG. 7, this pixel is composed of the R component of viewpoint 1 (hereinafter, referred to as “1-R”), “2-G”, and “3-B”. ing. Since the element value of the stencil pattern is defined in units of one pixel, the element value of the stencil pattern in this portion is set to, for example, "1" for convenience. According to the present invention, for each viewpoint (for example, viewpoint 1), writing is performed for each of the RGB components using a color mask, so, for example, after “1-R”, “1-G”, “1-G” B ". Note that it is not necessary to write in the order of R, G, and B, and the above is only an example, and the writing order may be determined arbitrarily. Further, writing may be performed for each viewpoint for one color component. That is, the viewpoint number may be changed without changing the color mask. Next, in FIG. 7, the component of “1-G” is, for example, a pixel immediately below the above-mentioned pixel, and thus has an element value different from the above-mentioned stencil pattern element value, for example, “2”. . Similarly, “1-B” sets the element value to “3”. Next, “2-R” is written for viewpoint 2, and this pixel is a pixel below the pixel containing “1-B”, so that another element value is “4”. Next, “2-G” is written, which is to be written to a pixel including “1-R”, and is a pixel for which the element value of the stencil pattern has already been set to “1”. From these, the relationship between the pixel (element) to be written and the element value of the stencil pattern as shown in FIG. 9 can be derived. That is, the element value of the stencil pattern corresponding to the pixel consisting of “1-R”, “2-G”, and “3-B” is “1”, and “1-G”, “2-B”, “4” The element value of the stencil pattern corresponding to the pixel including “−R” is “2”, and the element value corresponding to “1-B”, “3-R”, and “4-G” is “3”; Element values corresponding to “2-R”, “3-G”, and “4-B” are “4”. Note that the arrows in FIG. 9 indicate the order of writing. Therefore, the stencil pattern to be stored in the stencil buffer corresponding to the arrangement example of FIG. 7 is a pattern as shown in FIG. Note that the numerals 1 to 4 in the drawing are element values for specifying the pixel to be drawn, and are numerical values given for convenience. The stencil pattern created in this way is stored in a stencil buffer (step 10 in FIG. 3). FIG. 11 shows a state in which the stencil patterns in FIG. 10 and the arrangement example of the composite image in FIG. 7 are superimposed so that the relationship becomes clearer.
[0026]
Therefore, the process of determining the stencil reference value will be described with reference to FIG. 11. For example, when "1-R" is written, the stencil reference value is set to "1" (step 201 in FIG. 4), and the color mask is changed. What is necessary is just to set so that only the R component can be written (step 202 in FIG. 4). Thereafter, the stencil reference value is compared with the stencil element value, and the three-dimensional model is drawn on the frame buffer using a color mask (step 203 in FIG. 4). Then, when writing the next “1-G”, the stencil reference value may be set to “2” and the color mask may be set so that only the G component can be written. These operations are performed for another color component (step 204 in FIG. 4), and similarly for another viewpoint / color component (step 207 in FIG. 4). An image can be generated.
[0027]
As described above, by using the stencil buffer and the color mask, it is possible to directly write data to the frame buffer in units of one color component. Higher speed drawing becomes possible. Even when the number of viewpoints increases, high-speed drawing is possible using the stencil buffer, so it is possible not only to generate image data for stereoscopic images of still images, but also to generate moving image data for stereoscopic images. It becomes.
[0028]
Next, yet another example of a combined arrangement will be briefly described. FIG. 12 is a diagram illustrating an arrangement example of each pixel of an image of each viewpoint displayed on the autostereoscopic display device for four viewpoints, and an optical filter used for the pixel. Similarly to the above description, according to the present invention, for example, when the stencil reference value is changed and written in the order of “1-R”, “1-G”, “1-B”, “2-R”,. Then, the stencil pattern as shown in FIG. 13 may be stored in the stencil buffer. Then, by applying a color mask of each component to a pixel where the stencil reference value and the element value of the stencil pattern match, an image of an arrangement example as shown in the figure can be generated.
[0029]
As described above, the stereoscopic image processing method of the present invention creates a predetermined stencil pattern in accordance with the arrangement of the color filters of the autostereoscopic display device, the structure of the optical filters such as the slits, and the combined arrangement of the stereoscopic images according to the arrangement. However, when writing to the frame buffer, writing can be performed using a stencil buffer and a color mask, so that the present invention can be applied to any combination arrangement.
[0030]
Next, a method of generating moving image data using the stereoscopic image processing method of the present invention will be described with reference to FIG. FIG. 14 is a flowchart for explaining the flow of the stereoscopic image processing method for generating moving image data according to the present invention. In the figure, the steps denoted by the same reference numerals as those in FIG. 3 represent the same steps, and therefore, redundant description will be omitted. As shown in the figure, in the case of the present embodiment, a step 30 of determining the position and orientation of the three-dimensional model is provided between the step 10 of storing the stencil pattern in the stencil buffer and the drawing processing 20, unlike the embodiment of FIG. Is a different point.
[0031]
After the step 10 of creating a stencil pattern and storing it in the stencil buffer, the position and orientation of the three-dimensional model are determined (step 30). A rendering process is performed on the position and orientation determined here (step 20), and a multi-view image is synthesized to be image data for a stereoscopic image to create one frame. When the creation of one frame is completed, the process returns to step 30 again to advance to the next frame (step 40), determines the position and orientation of the three-dimensional model in the next frame, and performs drawing processing. By repeating this, moving image data is generated.
[0032]
As described above, since the three-dimensional image processing method of the present invention can be used for synthesizing at higher speed, it is not only necessary to prepare a plurality of images in advance and simply reproduce them, but also to perform real-time synthesizing on the spot. Rendering and the like are also possible. Therefore, for example, even when the viewer of the autostereoscopic display device freely rotates and moves the three-dimensional model on the screen using the input means such as a mouse, the input means of the input means remains displayed in a three-dimensional manner. It is also possible to generate an image that follows the movement in real time. Note that the frame rate depends on the specifications of the rendering machine, but if the frame rate is about 10 frames / sec, the motion is somewhat smooth.
[0033]
It should be noted that the stereoscopic image processing method of the present invention is not limited to the illustrated example described above, and it goes without saying that various changes can be made without departing from the spirit of the present invention. For example, the number of viewpoints specifically exemplified in the above embodiment is merely an example, and various combinations can be made as long as the number of viewpoints is two or more. Similarly, the stencil pattern and the stencil reference value are based on the arrangement of the color filters and the arrangement of the optical filters such as the slits of the autostereoscopic display device, and are limited to those specifically exemplified in the above embodiments. Instead, various changes can be made depending on the arrangement of the color filters of the autostereoscopic display device and the structure of the optical filters such as slits.
[0034]
【The invention's effect】
As described above, according to the three-dimensional image display method of the present invention, image data for a three-dimensional image can be generated at high speed, and even when images of many viewpoints are synthesized, high-resolution An excellent effect of being able to generate the image data for a three-dimensional image can be obtained.
[Brief description of the drawings]
FIG. 1 is a diagram for explaining an example of pixel arrangement at each viewpoint in the case of four viewpoints in an oblique barrier method.
FIG. 2 is a diagram for explaining an example in which information of a plurality of viewpoints is written in one pixel.
FIG. 3 is a flowchart for explaining the flow of the stereoscopic image processing method of the present invention.
FIG. 4 is a flowchart for explaining a drawing process in FIG. 3;
FIG. 5 is a diagram for explaining a relationship between a pixel to be written and an element value of a stencil pattern with respect to the arrangement example of the composite image illustrated in FIG. 2;
FIG. 6 is a diagram illustrating a stencil pattern used in the arrangement example of the composite image illustrated in FIG. 2;
FIG. 7 is a partially enlarged view of a display screen showing one arrangement example of each pixel of an image of each viewpoint displayed on the autostereoscopic display device.
FIG. 8 is a diagram for explaining an optical filter having slits arranged in a staircase, which is used in the example of arrangement of the composite image shown in FIG. 7;
FIG. 9 is a diagram for explaining a relationship between a pixel to be written and an element value of a stencil pattern with respect to the arrangement example of the composite image illustrated in FIG. 7;
FIG. 10 is a diagram showing a stencil pattern used in the example of arrangement of the composite image shown in FIG. 7;
FIG. 11 is a diagram for explaining a relationship between an example of arrangement of the combined image shown in FIG. 7 and the stencil pattern shown in FIG. 10;
FIG. 12 is a diagram illustrating another arrangement example of each pixel of an image of each viewpoint displayed on the autostereoscopic display device and an optical filter used for the pixel;
FIG. 13 is a diagram illustrating a stencil pattern used in the example of arrangement of the composite image illustrated in FIG. 12;
FIG. 14 is a flowchart illustrating a flow of a stereoscopic image processing method for generating moving image data according to the present invention.

Claims (5)

In order to stereoscopically display the stereoscopic model on the autostereoscopic display device, RGB images obtained by viewing the stereoscopic model from n (n = 2, 3, 4. A stereoscopic image processing method for generating
In a stencil buffer storing mask information, according to the autostereoscopic display device, a step of creating and storing a predetermined stencil pattern including element values for specifying pixels to be drawn,
Determining a stencil reference value from the viewpoint number m (m = 1, 2,... N) and at least one of the RGB components to be drawn for the three-dimensional model;
Determining a color mask for a pixel corresponding to the determined stencil reference value so as to render the at least one of the RGB components in a frame buffer;
Comparing the determined stencil reference value and the element value of the stencil pattern, and rendering a stereo model with the at least one component based on the determined color mask on a pixel corresponding to the matched value;
The process of determining the stencil reference value, the process of determining a color mask, and the process of drawing a three-dimensional model are performed on the remaining RGB components. Process
For the (m + 1) th viewpoint (where m <n), a process of determining the stencil reference value, a process of determining a color mask, a process of drawing a three-dimensional model, and a process of changing color components And repeating these until the n-th viewpoint is reached.
A stereoscopic image processing method comprising generating image data for a stereoscopic image by using these. In order to stereoscopically display the stereoscopic model on the autostereoscopic display device, RGB images obtained by viewing the stereoscopic model from n (n = 2, 3, 4. A stereoscopic image processing method for generating
In a stencil buffer storing mask information, according to the autostereoscopic display device, a step of creating and storing a predetermined stencil pattern including element values for specifying pixels to be drawn,
Determining a stencil reference value from the viewpoint number m (m = 1, 2,... N) and at least one of the RGB components to be drawn for the three-dimensional model;
Determining a color mask for a pixel corresponding to the determined stencil reference value so as to render the at least one of the RGB components in a frame buffer;
Comparing the determined stencil reference value and the element value of the stencil pattern, and rendering a stereo model with the at least one component based on the determined color mask on a pixel corresponding to the matched value;
For the (m + 1) th viewpoint (where m <n), the process of determining the stencil reference value and the process of drawing a stereo model are performed, and these processes are repeated until the viewpoint becomes the nth viewpoint. And drawing process,
The process of determining the stencil reference value, the process of determining a color mask, the process of drawing a stereo model, and the process of changing the viewpoint with respect to the remaining RGB components are described. Performing the process of changing the color components and drawing;
A stereoscopic image processing method comprising generating image data for a stereoscopic image by using these. 3. The stereoscopic image processing method according to claim 1, wherein, when the number of viewpoints is two (n = 2), the step of determining the color mask is performed in accordance with the determined stencil reference value. 4. Determining a color mask so that two predetermined components of the RGB components are drawn in a frame buffer; and drawing the three-dimensional model, wherein the step of drawing the three-dimensional model is performed according to the determined stencil reference value. A method of drawing a three-dimensional model using the two components based on a color mask. 4. The stereoscopic image processing method according to claim 1, wherein the stencil pattern has a common element value for pixels having the same relationship between the RGB components forming one pixel and viewpoint numbers for each component. 5. Is provided. 5. The stereoscopic image processing method according to claim 1, further comprising: storing the predetermined stencil pattern and before determining the stencil reference value. 5. It has a process of determining the position and orientation of the model, and after the image data for the stereoscopic image is generated, returns to the process of determining the position and orientation of the stereoscopic model, and repeats these to create a plurality of frames. A three-dimensional image processing method for generating moving image data for a three-dimensional image.

Images